A/B Testing ML Models In Production: Why, When, & How

ML models deployment strategies and planning effective your model rollout
Yuval Fernbach
Yuval Fernbach
Co-founder & CTO at Qwak
at
at
at

A/B testing is a staple of software development and marketing, but it's often overlooked in the world of machine learning.Why bother A/B testing your ML models when you can just let them loose in the wild and see what happens?It turns out that there are several good reasons to A/B test your ML models before and while delivering them to production.Join Yuval Fernbach, Qwak’s co-founder and CTO to learn more about ML model deployment strategies:

  • How Shadow, Canary and AB deployment methodologies work for ML Models
  • Why A/B testing is important for ML
  • When you should A/B test, and how to go about setting up an effective test.

By the end of this session, you'll have an understanding of ML models deployment strategies and how to plan your model rollout effectively.

A/B testing is a staple of software development and marketing, but it's often overlooked in the world of machine learning.Why bother A/B testing your ML models when you can just let them loose in the wild and see what happens?It turns out that there are several good reasons to A/B test your ML models before and while delivering them to production.Join Yuval Fernbach, Qwak’s co-founder and CTO to learn more about ML model deployment strategies:

  • How Shadow, Canary and AB deployment methodologies work for ML Models
  • Why A/B testing is important for ML
  • When you should A/B test, and how to go about setting up an effective test.

By the end of this session, you'll have an understanding of ML models deployment strategies and how to plan your model rollout effectively.

Qwak optimizes ML Model Production

“We ditched our in-house ML platform for Qwak. I wish we had found them sooner.”
Upside
“Qwak streamlines ML development from prototype to production, freeing us from infrastructure concerns and maximizing our focus on business value.”
Notion
“People ask me how I managed to deploy so many models while onboarding a new team within a year. My answer is: Qwak.”
OpenWeb
“With Qwak, our ML team efficiently manages and deploys various models, both batch and real-time. The addition of an observability and Vector DB layer has been a game-changer, allowing us to confidently bring 10 models into production. Qwak's robust and streamlined approach has significantly enhanced our operational efficiency.”
Happening (Superbet)