Platform Engineer - AI Engineering
Quick Summary
Configure and manage multi-engine API gateways, implementing dynamic routing rules, rate limits, and fallback logic for LLM requests.
Strong backend programming experience, specifically in Go and/or Python. Hands-on experience with API design, integration, and platform/cloud engineering concepts. Familiarity with API gateways,
As AI tools drive immense value across the firm, our organization faces a "Dual Mandate": providing low-friction access to the best frontier AI tools while strictly managing an exponentially growing cost curve. The unified AI Platform Team builds the centralized software, operations, and governance layers that safely route users to the most cost-effective models.
We are looking for a Platform Engineer to help build and operationalize our AI tooling ecosystem. Working closely with the Team Lead and Senior/Staff SWE, you will be the hands-on integrator connecting external cloud AI providers, internal models, and end-user tools into our unified control plane.
Responsibilities
~1 min read- →Configure and manage multi-engine API gateways, implementing dynamic routing rules, rate limits, and fallback logic for LLM requests.
- →Execute the technical migration and integration of firm-wide tools into our centralized management plane to ensure all AI traffic is securely logged and governed.
- →Operate within our Shared Responsibility Model alongside the Cloud team to manage AI services deployed in enterprise landing zones (e.g., managing Azure OpenAI instances, model deployments, and API key generation).
- →Write robust Go and Python code to support the continuous sync loop for our usage dashboard and implement automated "progressive friction" mechanisms, such as alerts.
- →Partner with the Inference Infrastructure pod to ensure our self-hosted, on-premise models are successfully registered and routable within our AI gateways.
Requirements
~1 min read- Strong backend programming experience, specifically in Go and/or Python.
- Hands-on experience with API design, integration, and platform/cloud engineering concepts.
- Familiarity with API gateways, proxy configuration, or distributed system networking.
- A strong interest in the rapidly evolving LLM ecosystem and the technical mechanics of AI tooling.
- A collaborative mindset with a focus on writing clean, maintainable code to replace prototype systems.
Location & Eligibility
Listing Details
- Posted
- October 7, 2026
- First seen
- October 7, 2026
- Last seen
- October 7, 2026
Posting Health
- Days active
- 0
- Repost count
- 0
- Trust Level
- 60%
- Scored at
- October 7, 2026
Signal breakdown
Browse Similar Jobs
Stay ahead of the market
Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.
No spam. Unsubscribe at any time.