None
EN
$25k Contest: Evals for the Situation Room
['Jordan Schneider']
ChinaTalk
The German Chancellor is testing frontier models against draft legislation on his personal laptop.
Certainly for the tactical and maybe even at the operational level, there’s a rough pathway to measure model progress against ground truth.
Private sector employees can feel out the jaggedness of frontier models at stakes considerably lower than the calls that get made in the Situation Room.
Frontier models can pass the bar, ace the MCAT, and outscore most PhDs on graduate-level physics.
By the way, we’re also running a more open-ended contest where you can submit practically any idea you think ChinaTalk might be into: