Senior Applied AI Engineer – ML for Systems & Infrastructure

P-1380

As a Senior Applied AI Engineer at Databricks, you will apply machine learning, scheduling and optimization algorithms to improve the efficiency and performance of our engineering systems and infrastructure. From cluster management all the way down to query compilation, our Applied AI team works on some of the hardest, most interesting problems facing the business, making Databricks infrastructure and products as performant and cost-efficient as possible. This is a high impact problem as our customers look at us to deliver the most optimized workloads.

• Build end-to-end systems from the ground up in a small team of experienced people.
• Shape the direction of our applied ML areas of investment by engaging with engineering and product teams across the company.
• Drive the development and deployment of state-of-the-art AI models and systems that directly impact the capabilities and performance of Databricks' products, infrastructure and services.
• Architect and implement robust, scalable ML infrastructure, including data storage and  processing, model training and serving components, and monitoring and reporting systems to support seamless integration of AI/ML models into production environments.
• Work on novel modeling techniques in the field of ML for Systems
• Contribute to the broader AI community by publishing research, presenting at conferences, and actively participating in open-source projects, enhancing Databricks' reputation as an industry leader.

• 2-8 years of machine learning engineering experience in high velocity, high-growth companies
• Strong understanding of both computer systems and statistics
• Large breadth of knowledge or interest in mathematical modeling beyond ML (OR, combinatorial optimization
• Experience developing AI/ML systems at scale in production
• Strong track record of ML modeling that goes beyond using standard libraries.
• Strong coding and software engineering skills, and familiarity with software engineering principles around testing, code reviews and deployment.
• Experience deploying, scaling and monitoring models in production; deep understanding of the unique infrastructure challenges posed by training and serving predictions in Tier 0 environments.

Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.

Benefits

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks. 

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.