Lead Engineer_Big Data

India·Noidalead

OtherEngineer

0 views0 saves0 applied

Apply Now

Quick Summary

Overview

About Zenon: Zenon AI is a global boutique consulting firm and a leading AI partner for Fortune 500 firms. We partner with clients across the globe to identify their highest-value opportunities, address their most critical challenges, and transform their enterprises using advanced analytics…

Key Responsibilities

Work with business and technology teams to analyze and assess business requirements and develop technical blueprints. Develop cloud enabled, highly scalable Big Data applications using technologies such as Spark, Scala, and open-source tools.

Technical Tools

airflowawsazuredockergcpjavakubernetesmysqlpostgresqlpythonscalaspring-bootsqlagile

About Zenon:

Zenon AI is a global boutique consulting firm and a leading AI partner for Fortune 500 firms. We partner with clients across the globe to identify their highest-value opportunities, address their most critical challenges, and transform their enterprises using advanced analytics and data science.

Responsibilities:

Work with business and technology teams to analyze and assess business requirements and develop technical blueprints.
Develop cloud enabled, highly scalable Big Data applications using technologies such as Spark, Scala, and open-source tools.
Designing data models using RDBMS and NoSQL
Leveraging industry best practices and experience and recommend solutions including solution architecture and design.
Adhere to high design and coding standards, policies, and procedures.
Willing to explore and learn new technologies.

Qualification:

7+ years of hands-on expertise using Big Data technologies and Frameworks.
Min 4 years of relevant experience as Big Data Engineer
Min 4 years of hands-on solid experience on Spark with Scala and Python
Solid Experience in implementing Spark RDD Transformations, actions to
implement business analysis.
Hands on experience on Hadoop framework and other Big Data technologies like HDFS, Oozie, Airflow, Hive or Impala.
Good hold on any cloud platform among AWS, Azure or GCP
Good hold on container-based frameworks like Docker and Kubernetes
Strong Problem-Solving, Analytical, and programming experience using Spark, Scala, RDD, DB2, Hadoop, APIs.
Debugging applications to ensure low-latency and high-availability.
Solid working experience with Databases like PostgreSQL or MySQL and writing optimized SQL queries.
Well versed with Design patterns and various architectural patterns
Good to have exposure on writing APIs using Java based frameworks like Spring Boot
Good knowledge of agile methodology of Software development.
Excellent communication and presentation skills.
BS / MS in Computer Science or equivalent