Skip to content

Platform Overview

ABetterChoice (ABC) is an all-in-one experimentation and configuration platform built for game studios and internet products. It integrates "which users see what" and "whether this change actually works" into a single product — you no longer need to switch between A/B testing tools, parameter management backends, and data analysis tools.

ABetterChoice platform overview

Three questions ABC helps you answer

QuestionPlatform capability
"Which version is better?"Run controlled comparisons with multiple experiment types; the stats engine gives you a trustworthy conclusion
"Who benefits most?"Causal inference (HTE) identifies how different user segments respond differently to the same change
"How do I release safely?"Remote Config supports gradual rollout, canary traffic, and one-click rollback — no redeploy needed

Unlike standalone A/B testing tools, ABC puts the full decision loop — from hypothesis → experiment → analysis → deployment — on a single platform.

Four platform modules

ABetterChoice platform architecture

ModuleProblem it solves
ExperimentsValidate product changes with controlled experiments — supports layer experiments, config experiments, and MAB (multi-armed bandit) experiments
Remote ConfigChange parameters, copy, and reward values without a redeploy — the server pushes values in real time, effective within seconds
AudiencesDefine segments like "high-spending users" or "new users in Japan" as reusable objects that experiments and configs can reference by name
StatisticsTranslate "the metric went up" into "is this real" — includes CUPED, FDR, SRM detection, and HTE using industry-standard methods

Capabilities at a glance

Experimentation

Scientifically validate the effect of a change through controlled experiments; make decisions based on statistical significance, not intuition.

Experiment typeDescriptionBest for
Layer ExperimentIsolates traffic using a layer-and-domain architecture; multiple experiments run in parallel in independent traffic spacesMost A/B scenarios, especially when multiple experiments need to run simultaneously without contaminating each other
Config ExperimentBinds Remote Config parameters to an experiment; runs independently at 100% traffic for different audiences simultaneously; results are automatically written back to the config when the experiment endsGranular optimization across multiple regions or user segments
MAB ExperimentMulti-armed bandit algorithm that automatically shifts more traffic toward the better-performing group during the runQuickly selecting a winner among multiple variants, or time-sensitive campaigns

Remote Config

Manage parameters from the server in real time — no redeploy required. Use a rule engine to serve different values to different user segments and roll out progressively by traffic percentage.

CapabilityDescription
Parameter managementSupports String / Number / Boolean / JSON; set a default value
Rules and targetingMulti-level IF / ELSE IF / ELSE rule chains matched by audience and traffic percentage
Traffic rolloutGradual rollout from 1% → 100% to reduce full-launch risk
Change auditEvery change is automatically logged; supports version comparison and one-click rollback

Statistics and analysis

CapabilityDescription
Variance reduction (CUPED)Uses pre-experiment covariates to reduce metric variance — converges faster with fewer samples
FDR multiple comparison correctionControls false positives in multi-metric scenarios to avoid "significance inflation"
Bayesian inferenceProvides posterior probability and credible intervals — suited for small samples and continuous decision-making
Drill-down analysis (Explore)Break down results by dimension to locate sub-groups that drive positive or negative effects
HTE heterogeneous treatment effectIdentifies differential responses across user segments — answers "who does this work for?"

HTE is a key differentiator for ABC compared to most competing tools — mainstream A/B testing tools generally do not include native causal inference.

Traffic quality assurance

CapabilityDescription
Dual-hash assignmentDouble-layer hashing guarantees uniform random assignment, eliminating selection bias at the source
SRM detectionMonitors sample ratio mismatch in real time; alerts immediately on anomalies
AA / AB BacktrackPre- and post-experiment data quality diagnostics to identify root causes of anomalies

Where to start

Onboarding by role:

You are...Recommended path
Product manager / OperationsQuickstartRemote Config overviewExperiments overview
Data analystExperiments overviewReading results → Statistics methods
Engineer / SDK integrationQuickstart Step 2 → SDK integration docs → Layer Experiment overview