prior-labs
prior-labs12mo ago
New

ML Engineer, Backend

United StatesUnited States·North Cantonfull-timemid
Machine Learning EngineerData
0 views0 saves0 applied

Quick Summary

Key Responsibilities

Own Inference: Own the serving path end-to-end: latency, throughput, batching, memory behavior on large inputs, and cost per prediction. Our models serve through our managed API, inside customer VPCs,

Technical Tools
Machine Learning EngineerData

Foundation models transformed text and images. Structured data - the largest and most consequential data format in the world - stayed untouched, until now. What LLMs did for language, we're doing for tables.

We pioneered tabular foundation models: TabPFN v2 was a Nature cover story, has passed 3.5M+ downloads and 7,500+ GitHub stars, and runs in production from detecting lung disease with Oxford Cancer Analytics to preventing train failures with Hitachi. The hardest problems - millions of rows, real-time inference, entirely new modalities - are still open, and no one else is working on them at this level.

We're a small, highly selective team of 40+ with backgrounds from Google, DeepMind, Meta, Apple, Amazon, Jane Street, and CERN, led by Frank Hutter, Noah Hollmann, and Sauraj Gambhir, and advised by Bernhard Schölkopf and Turing Award winner Yann LeCun.

In July 2026, less than 18 months after our €9M pre-seed, we joined SAP as an independent frontier AI lab - same team, mission, and open-weights models, now backed by more than €1 billion over four years.

About the Role

~1 min read

You will have ownership over designing, building, and scaling the core systems that bring Prior Labs' foundation models to the world. This is a unique opportunity to make fundamental architectural decisions, establish engineering best practices from the ground up, and profoundly shape the technical direction for serving state-of-the-art AI.

TabPFN does its learning in the forward pass, and it now handles datasets in the millions of rows. Making that fast, reliable, and affordable is an exciting engineering challenge.

You'll work directly with world-class AI researchers, translating cutting-edge models into scalable production systems. This role offers significant autonomy and impact, with clear paths to specialize in areas you're passionate about (like inference optimization and core backend systems) or grow into a technical leadership position as our team expands. You won't just be implementing features; you'll be building the backbone of our company.

  • 3+ years of professional experience in machine learning and backend engineering, with a proven track record of managing production infrastructure.

Nice to Have

~1 min read
  • Experience building or managing infrastructure specifically for machine learning (MLOps, model serving frameworks, feature stores, data pipelines).

  • Deep experience with inference optimization (quantization, compilation, dynamic batching, caching strategies, interplay with distributed computing).

  • Experience with PyTorch and FastAPI specifically.

  • Contributions to relevant open-source projects.

You'll work alongside researchers and builders who hold themselves to a very high bar - in the quality of their work and in how they work with each other. We move fast and still take the time to do things right.

Our teams are based in Berlin, Freiburg, and New York - when you're working on something as hard as TabPFN, being in the same room matters. But great people come from everywhere, and in exceptional cases we're open to remote, which usually means frequent travel to one of our offices. Wherever you're based, the whole company comes together regularly for offsites to build and celebrate together.

The best products and teams are built by people with a wide range of perspectives and backgrounds. We welcome applications from all identities and walks of life - especially if you've ever felt discouraged by "not checking every box" - and provide equal opportunities regardless of gender, sexual orientation, origin, disability, or any other trait that makes you who you are.

We care about how your data is handled - see our Recruiting Data Privacy page

Location & Eligibility

Where is the job
North Canton, United States
On-site at the office
Who can apply
US

Listing Details

Posted
September 26, 2025
First seen
September 26, 2026
Last seen
September 26, 2026

Posting Health

Days active
0
Repost count
0
Trust Level
19%
Scored at
September 26, 2026

Signal breakdown

freshnesssource trustcontent trustemployer trust
Newsletter

Stay ahead of the market

Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.

A
B
C
D
Join 12,000+ marketers

No spam. Unsubscribe at any time.

prior-labsML Engineer, Backend