A/B Testing Course

Start Date:
TBD
20
academic hours
Final Project
A-B Testing

A/B Testing Course

A/B Testing Online Course Overview

A/B Testing is used in applications, websites, and research to split the target audience between two variations and statistically determine the better-performing version based on predefined metrics.

One of the most common methods in data analysis and research impact assessment is A/B Testing. The central idea of this methodology is to examine and compare two variations of specific factors on different groups and determine which one yields the best outcome.

Throughout the course, students learn a statistical introduction to test construction and execution, using statistical tools for result analysis, and understanding the implications of these outcomes. Within the business context, the course provides tools for measuring the impact of changes and business decisions, such as choosing the appropriate graphical representation for the most effective result analysis.

Course Structure

During the course, we cover the statistical fundamentals of testing, methods to present and analyze results, and the implications of these findings. We also introduce two approaches: the classical approach based on multiple parameters and the modern approach based on Bayesian logic (Frequentist vs. Bayesian). We examine these approaches in various scenarios with different success metrics relevant to real-world industry scenarios.

In the course, you will learn:

  • Fundamental concepts in probability and statistics
  • A/B test fundamentals – definitions, approaches
  • Parametric approach – Model, T-test, sample size estimation
  • Bayesian approach – Discrete model, Continuous model
  • Real-world applications: Learning periods, Control groups, Simulations, Simulators, Online testing

Course Structure

Ch. 1

Overview of A/B Testing

Ch. 2

Policy and Ethics for Experiments

Ch. 3

Choosing and Characterizing Metrics

Ch. 4

Designing an Experiment

Ch. 5

Analyzing Results

Head of the department
teacher-image-Benny-Cohen

Meet your instructor

Benny Cohen

Embedded Academy Founder and CEO

As a long-time veteran in the technology industry, Benny Cohen combines a deep passion for technology with extensive field experience. With a B.Sc. in Electronics Engineering and an M.Sc. in Communication Engineering, he has spent over 20 years developing software and hardware systems, including the last few years focusing on the cybersecurity industry. In addition to his role as the company founder & CEO, Benny also operates as a hands-on practitioner who specializes in penetration testing and has conducted significant security assessments for leading enterprises and security companies worldwide. His approachable teaching style and real-world expertise make learning both engaging and relevant.

What our graduates say

teacher-image-Dima-Solomianik

Dima Solomianik
Real Time Embedded course graduate

RT Embedded Engineer, HP

After completing the course I moved onto the job interview preparation process in which I got valuable insights about what employers search for when seeking a talent to take on the role confident in the skills and experience I gained as a student. I got 3 high tech companies getting back to me to proceed to the next level
teacher-image-Alex-K.

Alex K.
Real Time Embedded course graduate

Linux Kernel Developer

The Embedded systems course was very detailed and relevant as I got to work on actual client projects that show industry challenges. I now work as an embedded engineer and the skills I gained are directly applicable to my daily work.
teacher-image-David-F.

David F.
Embedded System course graduate

Device Driver Developer

The real-time embedded program got deep into relevant industry challenges, and I got to apply new strategies I learned to streamline our development processes.
teacher-image-Liam-S.

Liam S.
Real-Time Embedded course graduate

RTOS Specialist

I came into the real-time embedded course with limited coding experience, but the structured learning path and personalized mentorship made the transition seamless.
Previous Next
All rights reserved Embedded Academy ©