As a Senior Applied Machine Learning Engineer, you will take ownership of production machine learning models that help businesses make smarter, data-driven customer decisions. You will improve churn prediction, customer retention, account health, and segmentation models using real-world business and product usage data. Your work will focus on making predictions more accurate, explainable, and reliable by identifying data quality issues, evaluating model performance, and investigating errors. Working at the intersection of machine learning, statistics, and product engineering, you will turn analytical insights into production-ready improvements. You will collaborate closely with backend engineers to ensure model enhancements are integrated directly into the product rather than remaining in research notebooks. This remote opportunity offers the chance to influence customer-facing AI capabilities, develop automated evaluation systems, and build new predictive models for expansion, cross-selling, forecasting, and marketing. You will thrive in a product-focused environment that values independent problem-solving, rigorous experimentation, and measurable business impact.
Production Model Optimization: Improve existing machine learning models for churn prediction, customer retention, account health, and segmentation using structured customer data and product usage signals.
Prediction Quality and Evaluation: Measure model performance against actual renewal, churn, expansion, and adoption outcomes to ensure predictions remain accurate and relevant to business decisions.
Statistical Analysis and Backtesting: Develop time-based backtesting methodologies and fixed test sets to evaluate models rigorously and prevent data leakage from future information.
Prediction Error Investigation: Analyze incorrect predictions at the individual customer account level to identify problems with labels, features, source data, or underlying assumptions.
Data Quality and Feature Engineering: Investigate inconsistent CRM records and product usage data, address labeling issues, identify data leakage, and improve feature quality to strengthen model performance.
Production Implementation: Translate analytical findings and model improvements into production-ready changes within the existing Go-based product codebase, ensuring that work extends beyond experimentation and notebooks.
Model Monitoring and Automation: Within the first three to six months, automate evaluation processes and implement monitoring mechanisms that detect declines in recall, label quality, and product usage signals before they affect customers.
Initial Model Assessment: During the first 30 days, conduct recall analysis for every existing customer using fixed test sets and implement improvements identified through the analysis.
New Predictive Capabilities: Build, test, and validate additional models for expansion opportunities, cross-selling, forecasting, and marketing applications.
Business-Focused Communication: Explain model performance, prediction errors, statistical findings, and recommended improvements in clear, accessible language for customers and stakeholders without a machine learning background.
Data Confidentiality: Protect sensitive customer information, internal queries, training datasets, and analytical results when communicating findings or discussing model performance.
Cross-Functional Collaboration: Work closely with backend engineering colleagues, particularly the Principal Backend Engineer, to maintain clear ownership boundaries and ensure prediction quality aligns with the wider product architecture.
Independent Problem-Solving: Take ambiguous machine learning challenges from initial investigation through hypothesis development, testing, implementation, and production validation.
Continuous Improvement: Establish repeatable evaluation practices and continuously refine models, datasets, and monitoring systems based on observed performance and real-world outcomes.