Owns the learning loop
Your ML engineer owns the part of the product where data becomes predictions: feature pipelines, training, evaluation, serving and monitoring. They write the code, run the experiments, and stay answerable for how the model behaves in production.
What to verify: Ask which parts of the pipeline the engineer will personally own, and who reviews changes before they reach users.
Data and feature pipelines that reproduce
Models are only as good as their inputs. They build pipelines with versioned datasets, quality checks and transforms that can be re-run months later, so every model can be traced back to the exact data that produced it.
What to verify: Ask how a training run can be reproduced, where datasets are versioned, and what happens when a source changes shape.
Models that ship
A model in a notebook helps nobody. They put models behind versioned endpoints with latency and cost budgets, canary releases and a rollback that works, so an improvement can be reverted in minutes when it misbehaves.
What to verify: Ask how a model is deployed, how versions are tracked, and how long a rollback takes when a release goes wrong.
Evaluation before opinions
They build an evaluation set from your real cases and run it on every change, so a new model is judged on evidence against a baseline. Offline numbers and live behaviour are reported together, not cherry-picked.
What to verify: Ask to see the evaluation set, the baseline it is compared against, and what numbers gate a model from test to production.
Monitoring and drift you can see
Models decay as the world changes. They track input distributions, prediction quality and serving health, alert when drift appears, and make retraining a deliberate decision with evidence rather than a calendar reflex.
What to verify: Ask what is monitored after launch, who gets alerted, and what triggers a retraining decision.
Handover that leaves your team stronger
Every pipeline, dataset, model card and decision lives in your repository with written rationale. When the engagement ends, your team runs, retrains and improves the system without us in the loop.
What to verify: Ask where pipelines and model documentation live, and who on your side can retrain a model after handover.