GS

GPU scale-up and scale-out networks

Topic

Expert statements

1
1 negative

What experts have said about GPU scale-up and scale-out networks

1 statement · 1 negative

  1. Reiner PopeNegativeApr 29, 2026· Dwarkesh Podcast

    Scale-out interconnect bandwidth is typically about eight times slower than scale-up bandwidth.

    “the scale out and it tends to be about eight times slower in bad width”

    Listen at 39:35

    Open the episode · Reiner Pope – The math behind how LLMs are trained and served
Filter the statements →

Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.

GPU scale-up and scale-out networks · PodLume