Elastic Data Engineer

Our client is undergoing an ambitious digital and organizational transformation. Within the Digital Transformation Office (DTO), we are building modern processes, stronger operational support, and more data-driven services. This consultancy mission at the client site represents Keystone Solutions, where you will contribute to impactful projects that combine digitalization, legacy modernization, and societal relevance.

• →Set up and manage an event-driven data architecture using Apache Kafka as a buffering and processing layer, and Elasticsearch as a data lake solution for structured and unstructured data.
• →Focus on establishing performant Kafka and Elastic stacks (schema management, topic management, indexing strategies) while ensuring data consistency, scalability, and observability throughout the entire data ingestion to consumption process.
• →Design, implement, and document necessary components, making data available via a data service layer (REST APIs, microservices) and ensuring error handling and optimization of the entire pipeline.
• →Develop a data service layer (REST APIs, microservices) that makes data from Elasticsearch available for analysis, monitoring, or integration with other systems.
• →Utilize Docker, Kubernetes, and Openshift for the deployment of components.
• →Ensure data consistency and scalability throughout the entire data ingestion to consumption process, and manage observability, error handling, and optimization via CI/CD pipelines (GitLab CI) and Python scripting.

• Proven experience as a data engineer with a focus on event-driven systems and real-time data integration.
• In-depth knowledge of Apache Kafka (Streams, Connect, Schema Registry, Avro, ksqlDB) and Elasticsearch (including Kibana, ingest pipelines, index lifecycle management).
• Methodical and precise work ethic to ensure data consistency and scalability within the Kafka and Elastic architecture.
• Ability to work autonomously, propose solutions, and adapt quickly to changes in the situation.
• Strong documentation skills to clearly and structurally document analyses, pipelines, schemas, configurations, and technical choices (reports, documentation).
• Excellent written and verbal communication skills to participate seamlessly in meetings with specialists and user representatives.
• Ability to work in a team, prioritize within a complex environment with multiple data pipelines, processes, and technical dependencies, and demonstrate flexibility in scheduling.
• Client-oriented and solution-focused attitude, stress-resistant, creative, constructive, and attentive to user needs.

Dutch
Level Active knowledge
English
Level Active knowledge
French
Level Active knowledge

• Consultancy Nature: Engage in on-site work and embody the consultant identity.
• Dynamic Projects: Tackle diverse challenges across various client environments.
• Turbo-Charged Learning: Experience professional development and broad learning opportunities.
• Skyrocketing Ambition: Commit to career growth within our framework.
• Values: As a
  

  If you are ready to tackle technical and strategic challenges in a dynamic consultancy environment, apply today at Keystone Solutions Career Portal.

  
  

• Apache Kafka (Streams, Connect, Schema Registry, Avro, ksqlDB) - Level: Confirmed - Most recent: Any time
• CI/CD tools (GitLab CI) - Level: Confirmed - Most recent: Any time
• Data Service Layer (REST API’s, microservices) - Level: Confirmed - Most recent: Any time
• Docker, Kubernetes en Openshift - Level: Confirmed - Most recent: Any time
• Elasticsearch (Kibana, ingest pipelines, index lifecycle management) - Level: Confirmed - Most recent: Any time
• Indexingstrategieën en data-consistentie (Elasticsearch) - Level: Confirmed - Most recent: Any time
• Observability, foutafhandeling en optimalisatie van data-pipelines - Level: Confirmed - Most recent: Any time
• PostgreSQL - Level: Confirmed - Most recent: Any time
• Python - Level: Confirmed - Most recent: Any time
• Schema management en topicbeheer (Kafka) - Level: Confirmed - Most recent: Any time