Data Engineer

United Kingdom·Londonmid

Data EngineerData

0 views0 saves0 applied

Apply Now

Quick Summary

Overview

Role Overview: We are seeking a Data Engineer to support a key client project, focused on designing, building, and optimising data pipelines within a cloud-based data and analytics environment.

Key Responsibilities

Data Engineering & Pipeline Development Design, develop, and maintain scalable data pipelines across batch and streaming workloads.

Technical Tools

ci-cdcode-reviewetl

We are seeking a Data Engineer to support a key client project, focused on designing, building, and optimising data pipelines within a cloud-based data and analytics environment. The role requires strong data engineering fundamentals, reliable delivery, and the ability to collaborate closely with technical and business teams.

Responsibilities

~1 min read

Data Engineering & Pipeline Development

→
Design, develop, and maintain scalable data pipelines across batch and streaming workloads.
→
Build robust ingestion, transformation, and curation processes aligned with modern data engineering tools and patterns.
→
Develop and maintain data models, curated datasets, and integration layers to support analytics and reporting.
→
Optimise data processing for performance, reliability, and cost efficiency.

Data Quality, Governance & Security

→
Implement data quality checks, validation routines, and automated monitoring.
→
Ensure accurate and up‑to‑date data lineage, metadata management, and documentation.
→
Apply appropriate security controls, including role‑based access, data masking, and protection of sensitive information.

Cloud & Platform Engineering

→
Work with cloud‑native services for storage, compute, and workflow orchestration.
→
Monitor pipelines and platform performance, identifying and resolving issues and bottlenecks.
→
Support environment configuration, standardisation, and implementation of best practices.

DevOps, Automation & Observability

→
Use CI/CD processes to deploy code, configurations, and data assets across environments.
→
Maintain version control, participate in code reviews, and follow release processes.
→
Build monitoring, alerting, and logging to support high‑quality operations and rapid issue resolution.

Collaboration & Delivery

→
Collaborate with Data Scientists, analysts, engineers, and business stakeholders to understand requirements and deliver robust solutions.
→
Support requirement gathering, solution design, documentation, and technical handover.
→
Contribute to continuous improvement, standardisation, and knowledge sharing.