← In-context learning

What podcasts say about In-context learning

Every statement, with the speaker, the exact quote and the moment it was said.

What experts have said about In-context learning

1 statement · 1 positive

  1. Dwarkesh PatelPositiveJun 26, 2026· Dwarkesh Podcast

    Sufficiently strong in-context learning could eliminate the need for continual weight updates.

    “if in context learning gets so good across longer and longer time horizons, then you don't need to distill back everything the model is learning on the job into the weights.”

    Listen at 1:35

    Open the episode · The next big breakthrough will be AIs learning on the job

Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.

In-context learning: what podcasts say · PodLume