← AI benchmarking

What podcasts say about AI benchmarking

Every statement, with the speaker, the exact quote and the moment it was said.

What experts have said about AI benchmarking

2 statements · 1 positive · 1 negative

  1. Knowledge compression is the best ultimate benchmark for AI.

    “Compression is the ultimate best AI benchmark.”

    Listen at 2:23:26

    Open the episode · The Hugging Face Breach, Moonshot AI Valued at $20B, and Living to 1,759 Years Old | EP #273
  2. Fixed AI benchmarks could distort future model capabilities.

    “we freeze in or otherwise lock in the benchmarks for how we measure capabilities”

    Listen at 25:10

    Open the episode · Mira Murati's 975B Open Model, Ramin Hasani on Post-Transformer AI, and Demis' AI FINRA | EP #271

Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.

AI benchmarking: what podcasts say · PodLume