← Mixture-of-experts pipeline communication

What podcasts say about Mixture-of-experts pipeline communication

Every statement, with the speaker, the exact quote and the moment it was said.

What experts have said about Mixture-of-experts pipeline communication

1 statement · 1 neutral

  1. Reiner PopeNeutralApr 29, 2026· Dwarkesh Podcast

    Pipeline communication is acceptable when activated experts, layers, and bandwidth ratio multiply above eight.

    “we need the product of these three things to be bigger than eight”

    Listen at 52:56

    Open the episode · Reiner Pope – The math behind how LLMs are trained and served

Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.

Mixture-of-experts pipeline communication: what podcasts say · PodLume