A/B Testing

A/B Testing Course

A/B Testing Online Course Overview

A/B Testing is used in applications, websites, and research to split the target audience between two variations and statistically determine the better-performing version based on predefined metrics.

One of the most common methods in data analysis and research impact assessment is A/B Testing. The central idea of this methodology is to examine and compare two variations of specific factors on different groups and determine which one yields the best outcome.

Throughout the course, students learn a statistical introduction to test construction and execution, using statistical tools for result analysis, and understanding the implications of these outcomes. Within the business context, the course provides tools for measuring the impact of changes and business decisions, such as choosing the appropriate graphical representation for the most effective result analysis.

Course Structure

During the course, we cover the statistical fundamentals of testing, methods to present and analyze results, and the implications of these findings. We also introduce two approaches: the classical approach based on multiple parameters and the modern approach based on Bayesian logic (Frequentist vs. Bayesian). We examine these approaches in various scenarios with different success metrics relevant to real-world industry scenarios.

In the course, you will learn:

  • Fundamental concepts in probability and statistics
  • A/B test fundamentals – definitions, approaches
  • Parametric approach – Model, T-test, sample size estimation
  • Bayesian approach – Discrete model, Continuous model
  • Real-world applications: Learning periods, Control groups, Simulations, Simulators, Online testing

Course Content

Overview of A/B Testing
Policy and Ethics for Experiments
Choosing and Characterizing Metrics
Designing an Experiment
Analyzing Results
Talk to an Advisor

Benny Cohen

Real Time Group Founder and CEO

  • M.Sc. in Communication Engineering
  • B.Sc. in Electronics Engineering
  • Lecturer and Head of the Cyber and Information Security Course at RT-Group, with over 20 years of experience in software/hardware system development, including 6 years in the cybersecurity industry.
  • Specializes in penetration testing and provides training both domestically and internationally. Conducts penetration testing (PT) for security companies as well as leading enterprises in the industry.

Department Head
Come Study with Us
  • Experienced expert instructors
  • Practical courses for gaining hands-on experience
  • Practical project of 145 hours in the Development department
  • Build a portfolio for job interviews
  • Recorded lessons for review
  • Assistance in preparing industry-specific resumes
  • Personal assistance of up to 5 hours per month
All rights reserved Real Time Group ©