Mixture of Experts
TopicHeard in 2 episodes across 2 shows since Mar 2026
A machine learning architecture that uses multiple specialized sub-networks to process data more efficiently, allowing for larger model scales with less compute.
Episodes
2
across 2 shows
First heard
Mar 2026
Expert statements
1
1 negative
Episodes per month
Public PodLume episodes featuring it, over the last year.
1
1
Show the data
| Month | Episodes |
|---|---|
| Nov 2025 | 0 |
| Dec 2025 | 0 |
| Jan 2026 | 0 |
| Feb 2026 | 0 |
| Mar 2026 | 1 |
| Apr 2026 | 0 |
| May 2026 | 0 |
| Jun 2026 | 0 |
| Jul 2026 | 0 |
| Aug 2026 | 0 |
| Sep 2026 | 1 |
| Oct 2026 | 0 |
What experts have said about Mixture of Experts
1 statement · 1 negative
A single rack bounds the size of an expert layer under the described communication topology.
“one rack is actually the bounds, the size of an expert layer you can do”
Open the episode · Reiner Pope – The math behind how LLMs are trained and servedListen at 36:41
Statements are attributed to the speaker as said on the episode and reflect their view at the time, not PodLume's. They are not advice.
Episodes
2 episodes featuring Mixture of Experts, newest first
