A/B Testing ML Models In Production: Why, When, & How

ML models deployment strategies and planning effective your model rollout
Yuval Fernbach
Yuval Fernbach
Co-founder & CTO at Qwak
at
at
at

A/B testing is a staple of software development and marketing, but it's often overlooked in the world of machine learning.Why bother A/B testing your ML models when you can just let them loose in the wild and see what happens?It turns out that there are several good reasons to A/B test your ML models before and while delivering them to production.Join Yuval Fernbach, Qwak’s co-founder and CTO to learn more about ML model deployment strategies:

  • How Shadow, Canary and AB deployment methodologies work for ML Models
  • Why A/B testing is important for ML
  • When you should A/B test, and how to go about setting up an effective test.

By the end of this session, you'll have an understanding of ML models deployment strategies and how to plan your model rollout effectively.

A/B testing is a staple of software development and marketing, but it's often overlooked in the world of machine learning.Why bother A/B testing your ML models when you can just let them loose in the wild and see what happens?It turns out that there are several good reasons to A/B test your ML models before and while delivering them to production.Join Yuval Fernbach, Qwak’s co-founder and CTO to learn more about ML model deployment strategies:

  • How Shadow, Canary and AB deployment methodologies work for ML Models
  • Why A/B testing is important for ML
  • When you should A/B test, and how to go about setting up an effective test.

By the end of this session, you'll have an understanding of ML models deployment strategies and how to plan your model rollout effectively.

Qwak optimizes AI in production

“From our very first interaction, it was clear that Qwak understood our needs and requirements. Their platform enabled us to deploy a complex recommendations solution within a remarkably short timeframe. Moreover, Qwak is an exceptionally responsive partner, continually refining their solution.”
Lightricks
“Our AI and Machine Learning pipelines are fundamentally built on Qwak's comprehensive platform, which has been a game-changer in our journey from the initial ideation to the full-scale production of our banking chatbot 'Ella 2.0'. ”
ONE ZERO BANK
“We ditched our in-house platform for Qwak. I wish we had found them sooner.”
Upside