LibriBrain Word Classification
Decode which of 50 words a listener heard — from non-invasive MEG brain recordings.
- MEG
- speech
- decoding
- neuroscience
HULA is where we run our benchmarks: held-out evaluation with several metrics, tracks and splits; code submissions on GPUs; verified results; and a direct line between hosts and participants.
Decode which of 50 words a listener heard — from non-invasive MEG brain recordings.
Predict seizure onset minutes ahead from long-term scalp EEG.
Built by researchers who run competitions, for the people who enter them — first for LibriBrain, and for every benchmark that comes after it.
Public and private standings each have their own visibility. Publish final results when verification is done — not when a timer says so.
Several metrics per board with ordered tie-breakers, any number of held-out splits, and tracks that share one set of teams. Every ranking is deterministic.
Run participants’ code in isolated sandboxes with pinned environments, GPUs and network access when you want it. The answers never leave the platform.
Request code and checkpoints from top teams, review packages in one place, and show verification status next to the final standings.
Participants agree to be contactable when they join. Email everyone, the top ten, or a few hand-picked teams — and discuss it all in the forum.
A JSON and CSV leaderboard API, personal tokens for scripted submissions, and full access to every submission file for hosts.
One click, one checkbox. You’re given a solo team you can grow later.
Files and external resources live on the Data tab, with a sample submission to start from.
Upload a CSV (gzipped or zipped is fine) or a code bundle. Scores arrive within seconds to minutes.
Choose the submissions that count for the private board. Forget, and your best ones are picked for you.
Host it on HULA. Multi-metric leaderboards, tracks, verification of winners and a direct line to your participants — set up in an afternoon.