A living benchmark for machine learning on streaming data. Every learner reads every stream once, in order, predicting before it trains.

Prequential Single-pass Concept drift CapyMOA River

Per-dataset scores

How to read this board

Avg rank
Algorithms are ranked 1st, 2nd, 3rd… on every dataset, then those ranks are averaged. Raw metric values are never averaged across datasets — scales differ.
Wins
Datasets where the algorithm placed first.
Rank per dataset
One cell per dataset (not per time window): teal = ranked 1st on that dataset, clay = ranked last. A solid-teal strip is consistent everywhere; scattered clay shows exactly where it loses. Hover a cell for the dataset name and rank.
κt
Kappa-temporal: skill over the predict-the-previous-label baseline. 100 perfect, 0 no better, negative worse. Shown as a median — it is unbounded below.
Regression fit, scale-free across datasets: 1 is perfect, 0 is no better than predicting the mean.
ARI
Clustering agreement with the ground-truth labels, scored over evaluation windows: 1 is perfect, 0 is random grouping.
AUC
Anomaly detection ROC-AUC over the full stream of scores: 1 is perfect, 0.5 is random.
Wallclock
Total compute across all datasets and seeds. Read it against rank — in streaming, a small quality gap for a 100× time gap is the whole story.