Senior Data Engineer (Poland, Contract)

As a Senior Data Engineer at Nearform your main task will be designing, building, and maintaining scalable data platforms, pipelines, and warehouses using SQL, Python, Spark, Databricks and other relevant technologies. You will play a key role in building efficient data solutions, optimizing performance, and ensuring seamless data integration. However as you’ll likely work on a variety of projects your responsibilities may also include:

• Designing, building, and optimizing data pipelines and ETL processes for large-scale data ingestion and transformation.
• Developing and maintaining data platforms and warehousing solutions to support analytics and business intelligence needs.
• Implementing scalable data storage solutions and ensuring high availability and performance.
• Enhancing performance in data processing workflows for maximum speed and scalability.
• Collaborating with data scientists, analysts, and stakeholders to understand business needs and translate them into data engineering solutions.
• Ensuring data quality, governance, and compliance across all systems.
• Supporting CI/CD processes for data pipeline deployments and implementing best practices in DevOps for data workflows.
• Conducting code reviews and enforcing best practices in version control, automation, and testing.
• Assisting with defining structured source code management and deployment processes.
• Working with and supporting Technical Leaders in project execution and timely delivery.
• Collaborating with client teams.

• Significant experience delivering at a Senior Engineer level, specialising in Data engineering. Our Seniors typically have at least 6 years’ commercial experience.
• Experience with Databricks and Azure Fabric
• Practical experience of delivering in an agile environment.
• Practical experience and knowledge of developing real-world solutions.
• Extensive hands-on experience in SQL, Python, and Spark for large-scale data processing.
• Databricks experience 
• Strong expertise in data warehousing technologies (e.g., Snowflake, Redshift, BigQuery, or similar).
• Experience with distributed data processing frameworks (Spark, Hadoop, or similar).
• Deep understanding of ETL processes, data modeling, and schema design.
• Strong experience with cloud-based data solutions (AWS, Azure, GCP) and data lake architectures.
• Experience with automation, CI/CD for data pipelines, and Infrastructure as Code (IaC).
• Deep understanding of versioning control tools - e.g. Git.
• Experience building software collaboratively using pull requests and code reviews.
• Familiarity with data governance, security, and compliance best practices.
• Excellent communication and collaboration skills.

1. A TalentCall with someone from the Talent team (30 mins approx.) to introduce to you NearForm and the role, and to make sure your experience is relevant for the position and to discuss life as a NearFormer
2. An assessment with a member of the hiring team (1 hr approx.), this session is carried out using a screen share. You will be given a challenge and asked to provide a working solution to a specified problem.
3. A video call with one of our Hiring Managers (45 mins approx.) which allows us to gain a better insight into what interests you, your technical background, and give you an overview of the work we do at NearForm.

Although we are widely dispersed, NearFormers are a tightly-knit team. We trust one another and care about our colleagues. We all get together in person at our annual company retreat, of course when we’re not faced with a global pandemic! Building on our open-source origins, we promote the sharing of thoughts, knowledge and ideas.