Experimentation for Engineers

Experimentation for Engineers: From A/B Testing to Bayesian Optimization is a toolbox of techniques for evaluating new features and fine-tuning parameters, used by engineers in the world's most competitive industries. It covers methods like A/B testing, multi-armed bandits, and Bayesian optimization, and helps you deploy experiments in production while avoiding common pitfalls.

Format: Hardback
Length: 248 pages
Publication date: 20 February 2023
Publisher: Manning Publications

Experimentation for Engineers: From A/B testing to Bayesian optimization is a comprehensive toolbox of techniques for evaluating new features and fine-tuning parameters. It begins with a deep dive into methods like A/B testing, progressing to advanced techniques used in industries such as finance and social media to measure performance. By the end of this book, readers will be able to design, run, and analyze A/B tests, break feedback loops caused by periodic retraining of ML models, increase experimentation rates with multi-armed bandits, tune multiple parameters experimentally with Bayesian optimization, clearly define business metrics used for decision-making, identify and avoid common pitfalls of experimentation, and seamlessly deploy experiments in production while avoiding common pitfalls.

This unique book unveils sophisticated experimentation practices developed and proven in the world's most competitive industries, helping readers enhance machine learning systems, software applications, and quantitative trading solutions. Experimentation is the only way to answer questions like whether software works, changes improve or worsen, or features should be traded for performance. By leveraging these practices, engineers can optimize their systems and achieve competitive advantage in their respective fields.

Weight: 456g
Dimension: 234 x 190 x 15 (mm)
ISBN-13: 9781617298158