Mission
Humanity is advancing full throttle towards general intelligence. Generality, Inc. is building the measures to take us beyond pointwise progress.
We are a group of researchers, scientists, and engineers who are investigating better ways to measure ingenuity and intelligence.
Figure 1: Saturation
Humanity is advancing full tilt towards general intelligence. Generality, Inc. is building the measures to take us beyond pointwise progress.
We are a group of researchers, scientists, and engineers who are investigating better ways to measure ingenuity and intelligence.
Traditionally model performance is measured with benchmarks that resemble standardized tests. These tests are rapidly approaching the zone of diminishing returns presented in Figure 1, beyond which they no longer effectively measure improvements in intelligence.
Once you solve all questions in the International Math Olympiad or reach +90% on SWE-Bench, further incremental improvements may become meaningless or impossible due to issues such as test errors or difficulties in grading responses.