Principal Software Engineer - AI Platform

We are looking for an experienced Senior AI Platform Engineer to join our team and lead the development of our core AI execution infrastructure. This role is central to our strategy, focusing on designing, building, and scaling a robust, high-performance platform capable of deploying and managing thousands of concurrent AI agents. You will be responsible for ensuring the platform provides reliability, observability, and cost-efficiency at scale.

●     Platform Architecture: Design and implement the core components of the AI platform, including runtime environments, distributed scheduling, and resource management systems (e.g., CPU/GPU compute clusters, autoscaling).

●     Scalability & Performance: Develop and optimize distributed systems and microservices to handle massive scale and low-latency requirements for agent execution.

●     Infrastructure Automation: Work closely with DevOps/SRE teams to automate deployment, scaling, and monitoring using technologies like Kubernetes, Terraform, and CI/CD pipelines.

●     Agent Lifecycle: Implement APIs and services that manage the full lifecycle of an AI agent, from ingestion and registration to execution, monitoring, and versioning.

●     Observability: Implement comprehensive logging, tracing, and metrics for all platform components to provide deep insights into agent behavior and system health.

●     Best Practices: Drive best practices for code quality, security, and operational excellence within the platform engineering team.

●     10+ years of professional software engineering experience, with a significant focus on cloud infrastructure and platform development.

●     Mandatory: Proven expertise in developing, deploying, and scaling distributed systems (e.g., Kafka or HPC distributed compute frameworks) in a production environment.

●     Expert-level proficiency in at least one modern programming language (e.g., .NET, Python, Rust).

●     Deep practical experience with container orchestration (e.g., Kubernetes, Knative), cloud providers (e.g., Azure, AWS) and infra as code (Terraform).

●     Solid understanding of networking, security, and performance optimization for data-intensive applications.

●     Experience building high-throughput APIs (REST/gRPC) and developing platform service interfaces.

●     Prior experience in MLOps, LLMOps, or building systems specifically for running machine learning models or AI agents.

●     Familiarity with agentic frameworks, large language models (LLMs), agent protocols (MCP, A2A) and their unique deployment challenges.

●     Experience with high-performance computing (HPC) environments or GPU virtualization.

●     Comes from an lead AI software company or a software company delivering LLM frameworks.

At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!

Still hesitating?

You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.

We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.

We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status”.