How accurate is this?
We test the model on decisions it never saw and publish the results, including where it falls short. 63,615 decisions from 5,842 applicants to 180 schools, 2021–2027.
When it says 30%, about 30% get in
Each dot groups decisions by predicted chance, held out from training. Dots on the dashed line mean the odds are honest. Bigger dots hold more decisions.
Below 5% it is too pessimistic: those decisions came in at 10% against 3.7% predicted.
Getting in somewhere
Students with three or more decisions, grouped by predicted chance of at least one admission. Treating schools as independent (amber) overstates it. IvyOdds (navy) models how decisions move together.
Where it misses: students whose lists looked mostly out of reach (126 of them) got in somewhere more often than predicted. Few students fall in these groups, so for lists under about 70% treat our number as a floor.
Why every answer is a range
Students who post their results got in more often than everyone who applied. At Harvard the posters' admit rate is 16%; the real rate is 3.6%. Part of that gap is that posters are stronger applicants, which the model accounts for. Part is that people with good news post more, which it can't see.
So the top of each range treats posters as typical applicants with your profile, and the bottom corrects all the way to the school's published rate. The number we lead with sits halfway.
What each input adds
Five-fold cross-validation, never testing on a student the model trained on. AUC: higher is better. Brier: lower is better.
| Model uses | AUC | Brier |
|---|---|---|
| Which school only | 0.779 | 0.185 |
| + GPA, test, rank | 0.800 | 0.177 |
| + application round | 0.804 | 0.175 |
| + intended major | 0.811 | 0.172 |
| Everything (activities, income, legacy…) | 0.816 | 0.171 |
What we know it misses
- Essays, recommendations and interviews. Nobody's data captures them, and they matter most at the most selective schools.
- Recruited athletes. Only a few dozen posts mention it, too few to measure, so we don't ask.
- Self-reported data. Posters can misremember or embellish, and we can't verify any single post.
- Programs with their own bar (BS/MD, conservatories, some honors colleges) are folded into the school.
How it works
- Data. Every decision in r/collegeresults posts from 2021 to 2027: stats, activities, context, and each school's result and round, read by a language model. A second, independent extraction of 11,292 of the same decisions agrees on 99.7% of them, 98.5% of SAT scores and 91.6% of GPAs.
- Model. A regularized logistic regression on each decision: GPA, test score relative to the school's middle 50%, class rank, activity strength, round (ED, EA, REA, RD), intended major (with separate effects for impacted programs like UIUC computer science), legacy, in-state status at public universities, income and first-generation status. Small schools borrow strength from schools with similar selectivity.
- Your list. A shared factor links one student's decisions, fitted to how often students with three or more decisions were admitted somewhere (standard deviation 1.0 on the log-odds scale).
- Race. Not used. Admissions offices stopped considering it after the 2023 Supreme Court ruling, and we don't want the model to learn it.
- Updates. Retrained each cycle; this page updates with it.