The document outlines a framework for tracking AI progress on open leaderboards and benchmarks over time. It includes a roadmap showing the approximate years that AI is projected to reach various levels of human capabilities, such as pattern recognition, developing cognition, building relationships and filling roles. The roadmap also lists specific leaderboards and benchmarks aligned with these capabilities that can be used to measure progress, such as ImageNet, SQuAD, and ConvAI.