Senior Data Engineer - GCP

Design and build resilient, scalable data pipelines using GCP services such as BigQuery, Dataflow, and Dataproc.

Collaborate closely with clients to define business requirements and architect fit-for-purpose data solutions.

Apply engineering best practices across the SDLC, including CI/CD, testing, and version control using Git.

Support the migration of legacy on-premise systems to cloud-native architectures.

Champion data governance, security, and compliance, especially in regulated environments.

Strong hands-on experience with GCP including BigQuery, Pub/Sub, Cloud Composer, and IAM.

Proven ability in Python, SQL, and PySpark; experience with data lakes, warehousing, and data modelling.

Demonstrated knowledge of DevOps principles, containerisation, and CI/CD tools such as Jenkins or GitHub Actions.

A track record of delivering data engineering solutions in agile environments.

Confident communication skills, able to convey technical concepts to non-technical stakeholders.

Experience with real-time streaming tools like Kafka or Spark Streaming.

Exposure to MLOps practices and maintaining ML models in production.

Familiarity with data visualisation tools such as Power BI, Qlik, or Tableau.

Experience of developing applications on VertixAI is preferable

Knowledge of both SQL and NoSQL solutions, and the ability to assess trade-offs between ETL and ELT.