Exerakt: Calibrating Jev
What 204 questions asked to both Jev and Claude showed: Jev is almost never confidently wrong, it is unsure on the questions that need careful reading, and the data says almost nothing about how well it catches problems.
What 204 questions asked to both Jev and Claude showed: Jev is almost never confidently wrong, it is unsure on the questions that need careful reading, and the data says almost nothing about how well it catches problems.