Machine Learning Engineer Intern- Scenario Simulation

United States·Santa ClaraInternentry

OtherMachine Learning Engineer Intern

0 views0 saves0 applied

Apply Now

Quick Summary

Overview

PlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks. Headquartered in Silicon Valley with operations in the United States and Europe,

Technical Tools

OtherMachine Learning Engineer Intern

PlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks. Headquartered in Silicon Valley with operations in the United States and Europe, Plus was named by Fast Company as one of the World’s Most Innovative Companies. Partners including TRATON GROUP’s Scania, MAN, and International brands, Hyundai Motor Company, Iveco Group, Bosch, and DSV are working with Plus to accelerate the deployment of next-generation autonomous trucks. If you’re ready to make a huge impact and drive the future of autonomy, Plus is looking for talented individuals to join its fast-growing teams.

This project addresses the sim-to-real gap as in our current simulator pipeline. Closed-loop simulation systems are highly effective at generating massive amounts of diverse, high-fidelity ground truth data. However, they assume perfect perception. However, this ideal GT data does not perfectly align with the BEV feature representations extracted from real-world, noisy sensor data.

The project provides two outcomes:
Bridge Sim-to-Real Gap in Data Augmentation with Closed-Loop Simulation: By translating simulation GTs into a realistic BEV embedding space, the synthetic data becomes directly usable for training and fine-tuning BEV-based planning models.
Allow BEV Space Planning Model to be directly fine-tunable via Self-play RL: Once the sim-to-real gap is bridged in the BEV feature space, the planning models can thus be directly finetuned / post-trained in a self-play RL setting.

Bridge the Sim-to-Real Gap: Develop and implement a translation layer that converts idealized simulator Ground Truth (GT) into realistic, "noisy" Bird’s-Eye View (BEV) embeddings.

Optimize Simulation Throughput: Research and implement a "shortcut" pipeline that bypasses slow image/LiDAR rendering to generate BEV features directly from state data.

Enable Closed-Loop Training: Integrate the translated BEV embeddings into a training pipeline to make synthetic data directly usable for planning models.

Support Reinforcement Learning: Create the infrastructure necessary for planning models to undergo self-play RL fine-tuning within the bridged BEV feature space.

Strong foundation in deep learning, computer vision, and machine learning.

Proficiency in Python and deep learning frameworks (PyTorch)

Prior experience with BEV / E2E Autonomous Driving Architectures (understanding of BEV generation, sensor fusion, spatial transformation).

Prior experience in addressing the Sim-to-Real Gap in autonomous systems such as robotics and autonomous driving

Nice-to-have:

Experience with C++

Experience with End-to-End (E2E) driving models.

Experience with working with simulators (CARLA, IsaacSim, Gazebo)

Experience with curating datasets and synthetic data generation (SDG),

Experience with ML Infras (Kubeflow, MLFlow, Weights & Biases, etc)

Basic understanding of simulation / scenario-based testing for autonomous driving systems

Your opportunities joining PlusAI