← Model distillation

What podcasts say about Model distillation

Every statement, with the speaker, the exact quote and the moment it was said.

What experts have said about Model distillation

2 statements · 2 positive

  1. Beren MillidgePositiveSep 11, 2026· Dwarkesh Podcast

    Distilling new information into a separately trained base model is technically easier than continual updating.

    “It's easy to distill it into a different base model”

    Listen at 57:06

    Open the episode · AI researchers debate how close we are to recursive self-improvement
  2. Learning from model outputs is not classical copyright or intellectual-property infringement.

    “That's not IP infringement. That's not copyright infringement in the classical sense.”

    Listen at 16:50

    Open the episode · The Fight Over Open Source AI, Anthropic's $1.5B Payout, NYC Socialists: Evictions = Violence?

Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.

Model distillation: what podcasts say · PodLume