Sr. Data Engineer

We are seeking a highly skilled Senior Data Engineer with extensive experience in designing, building, and optimizing high-volume data pipelines. The ideal candidate will have strong expertise in Python, Databricks on Azure Cloud services, DevOps, and CI/CD tools, along with a solid understanding of AI/ML techniques and big data processing frameworks like Apache Spark and PySpark.

Responsibilities

• Adhere to coding and Numerator technology standards 

• Build suitable automation test suites within Azure DevOps 

• Maintain and update automation test suites as required 

• Carry out manual testing, load testing, exploratory testing as required 

• Work closely with Business Analysts and Senior Data Developers to consistently achieve sprint goals 

• Assist in estimation of sprint-by-sprint stories and tasks 

• Pro-actively take a responsible approach to product delivery