← Mixture of Experts
What podcasts say about Mixture of Experts
Every statement, with the speaker, the exact quote and the moment it was said.
What experts have said about Mixture of Experts
1 statement · 1 negative
A single rack bounds the size of an expert layer under the described communication topology.
“one rack is actually the bounds, the size of an expert layer you can do”
Open the episode · Reiner Pope – The math behind how LLMs are trained and servedListen at 36:41
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.