Principal Data Engineer

We're seeking a versatile Principal Data Engineer who can work across the full stack of Anaplan AI applications, from model integration, prompt engineering and set the technical direction for how we ingest, transform, store, serve, and govern the data that powers our LLM-based and agentic systems. You'll build AI features that can be used in real-time. This will help business users use GenAI in their planning workflows. You'll need both deep knowledge of machine learning and strong data engineering skills.

• Design and build the retrieval layer powering RAG and agentic workloads—including vector and graph databases, hybrid search, and architecting knowledge graphs that capture the semantics of customer models.
• Develop end-to-end GenAI features including backend API services, model integration, model monitoring, evaluations and deployments
• Engineer feature and context pipelines balancing batch and streaming patterns to feed forecasting and anomaly-detection models, collaborating closely with data scientists to productionise algorithms.
• Build the data plane for evaluation, implementing rigorous frameworks to continuously monitor, measure, and improve GenAI feature quality, accuracy, latency, and user satisfaction.,
• Collaborate with data scientists to productionise ML models and forecasting algorithms

• Extensive background in Data Science Engineering, with a clear track record of principal-level technical leadership.
• Hands-on experience building and shipping AI/ML products in production
• Deep practical experience with LLM-based systems: RAG architectures, embedding pipelines, prompt and response logging, evaluation frameworks.
• Hands-on expertise with vector databases, graph databases, and knowledge graphs
• End-to-end exposure in model lifecycle development, including extensive experience training and deploying ML models in production environments.
• Deep knowledge of LLM APIs, prompt engineering, and conversational AI patterns.
• Proficiency in Python and modern software development practices (testing, code review, CI/CD).

• Hands-on experience with cloud-native ML infrastructure platforms
• Knowledge of vector databases (Pinecone, Weaviate, Qdrant) and embedding models
• Experience with model serving frameworks (vLLM, TensorRT, Ray)
• Familiarity with Anaplan or similar enterprise planning platforms
• Experience with A/B testing and experimentation frameworks for AI features
• Experience with model observability tools (LangSmith, W&B, MLflow)

We believe attracting and retaining the best talent and fostering an inclusive culture strengthens our business. DEIB improves our workforce, enhances trust with our partners and customers, and drives business success. Build your career in a place where diversity, equity, inclusion and belonging aren’t just words on paper – this is what drives our innovation, it’s how we connect, and it contributes to what makes us a market leader. We believe in a hiring and working environment where all people are respected and valued, regardless of gender identity or expression, sexual orientation, religion, ethnicity, age, neurodiversity, disability status, citizenship, or any other aspect which makes people unique. We hire you for who you are, and we want you to bring your authentic self to work every day! 

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform essential job functions, and receive equitable benefits and all privileges of employment. Please contact us to request accommodation.  

It has come to our attention that fraudulent and fictitious job opportunities are being circulated on the Internet. Prospective candidates are being contacted by certain individuals, mainly through telephone calls, emails and correspondence, claiming they are representatives of Anaplan. The main purpose of these correspondences and announcements is to obtain privileged information from individuals.  

Anaplan does not:  

• Extend offers to candidates without an extensive interview process with a member of our recruitment team and a hiring manager via video or in person.   
• Send job offers via email. All offers are first extended verbally by a member of our internal recruitment team whenever possible and then followed up via written communication.  

All emails from Anaplan would come from an @anaplan.com email address. Should you have any doubts about the authenticity of an email, letter or telephone communication purportedly from, for, or on behalf of Anaplan, please send an email to people@anaplan.com before taking any further action in relation to the correspondence.