← GPU scale-up and scale-out networks

What podcasts say about GPU scale-up and scale-out networks

Every statement, with the speaker, the exact quote and the moment it was said.

What experts have said about GPU scale-up and scale-out networks

1 statement · 1 negative

  1. Reiner PopeNegativeApr 29, 2026· Dwarkesh Podcast

    Scale-out interconnect bandwidth is typically about eight times slower than scale-up bandwidth.

    “the scale out and it tends to be about eight times slower in bad width”

    Listen at 39:35

    Open the episode · Reiner Pope – The math behind how LLMs are trained and served

Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.

GPU scale-up and scale-out networks: what podcasts say · PodLume