A/B Testing Course
A/B Testing is used in applications, websites, and research to split the target audience between two variations and statistically determine the better-performing version based on predefined metrics.
One of the most common methods in data analysis and research impact assessment is A/B Testing. The central idea of this methodology is to examine and compare two variations of specific factors on different groups and determine which one yields the best outcome.
Throughout the course, students learn a statistical introduction to test construction and execution, using statistical tools for result analysis, and understanding the implications of these outcomes. Within the business context, the course provides tools for measuring the impact of changes and business decisions, such as choosing the appropriate graphical representation for the most effective result analysis.
During the course, we cover the statistical fundamentals of testing, methods to present and analyze results, and the implications of these findings. We also introduce two approaches: the classical approach based on multiple parameters and the modern approach based on Bayesian logic (Frequentist vs. Bayesian). We examine these approaches in various scenarios with different success metrics relevant to real-world industry scenarios.
Ch. 1
Overview of A/B Testing
Ch. 2
Policy and Ethics for Experiments
Ch. 3
Choosing and Characterizing Metrics
Ch. 4
Designing an Experiment
Ch. 5
Analyzing Results
Benny Cohen
Embedded Academy Founder and CEO
As a long-time veteran in the technology industry, Benny Cohen combines a deep passion for technology with extensive field experience. With a B.Sc. in Electronics Engineering and an M.Sc. in Communication Engineering, he has spent over 20 years developing software and hardware systems, including the last few years focusing on the cybersecurity industry. In addition to his role as the company founder & CEO, Benny also operates as a hands-on practitioner who specializes in penetration testing and has conducted significant security assessments for leading enterprises and security companies worldwide. His approachable teaching style and real-world expertise make learning both engaging and relevant.
News, insights, and learning resources from Embedded Academy