← All projects

TripleTen Data Analyst Bootcamp · Python · Experiment Analysis · Rodrigo Garza García

A/B Landing Page — Experiment Analysis

Landing Page Conversion and Spending Experiment

Evaluated two landing page versions across 40,000 users, comparing conversion and average spending and testing associations with traffic source and user type.

Business questions

Dataset and comparison

The dataset contains 40,000 observations and 9 variables. Each record represents a unique user; the dataset has no missing values. Variables include landing page version, region, device, traffic source, user type, conversion indicator and spending.

Comparison of conversion rates and average spending for landing pages A and B
Portfolio summary of the two primary experiment outcomes.
MetricPage APage BInterpretation
Conversion rate12.57%15.96%+3.38 percentage points for Page B; statistically significant.
Average spending among converted users61.0968.75Approximately 12.5% higher for Page B; statistically significant.

Additional conversion analysis

DimensionObserved ratesStatistical interpretation
Traffic sourceEmail 14.99%; Ads 14.74%; Referral 13.88%; Organic 13.79%.Chi-square test found a statistically significant association, but Cramér's V ≈ 0.015 indicates a very weak relationship.
User typeNew users 14.36%; Returning users 14.09%.No statistically significant association was found between user type and conversion.

Methodology and statistical tests

  1. Data validation and exploratory analysis.
  2. Levene's test to assess equality of variances.
  3. Welch's t-test to compare average spending among converted users on pages A and B.
  4. Two-proportion Z-test to compare conversion rates.
  5. Chi-square tests of independence to test associations between traffic source or user type and conversion.
  6. Cramér's V to measure the strength of the traffic-source association.

Business recommendations

Tools and reproducibility

Python · pandas · NumPy · Matplotlib · SciPy · statsmodels · Jupyter Notebook. The dataset is included in the repository and the notebook uses relative paths, structured to execute from top to bottom.

Statistical significance does not by itself establish business impact or profitability. Average spending is calculated among converted users. Traffic source had a statistically significant but very weak association with conversion; user type did not show a statistically significant association. Further within-page analysis is recommended before drawing conclusions about subgroup patterns.

Project deliverables

Project repository ↗ Jupyter notebook ↗ Dataset (CSV) ↗