Latent Space: The AI Engineer Podcast

Black Forest Labs bets multimodal models will drive robotics

Why FLUX 3 Trains on Images, Video and Sound — Andreas Blattmann & Dustin Podell, Black Forest Labs

The conversation connects generative media advances to a broader race over world models, action prediction, and practical robotic intelligence.

3 key takeaways
  1. 1FLUX’s progress reflects better data, captions, training stages, and evaluation as much as architectural innovation.
  2. 2Video, audio, and images could help models learn world structure, but embodiment and interaction remain unresolved.
  3. 3Black Forest Labs sees action prediction and in-context learning accelerating robotics deployment, with 2027 as a pivotal horizon.

Don't miss

Andreas Blattmann outlines FLUX Action as a general multimodal model extended to predict actions for robots, simulations, computer use, and games.

The brief

Andreas Blattmann and Dustin Podell recount how latent diffusion and Stable Diffusion shaped their careers before they founded Black Forest Labs to pursue broader visual intelligence.

The technical story moves from SDXL and video diffusion to SD3 and FLUX, with better data, captions, filtering, and training proving as important as new architectures.

Their central thesis is that images, video, and audio can build richer world models, though observation alone may not provide the embodiment needed for intelligence.

FLUX Context shows how a small, carefully designed dataset enabled general image editing and character consistency without repeated prompt-and-regenerate workflows.

The most consequential extension is FLUX Action: predicting actions for robots, simulations, computer use, and games, with one-shot learning and 2027 deployment as the long-range test.

Books & mentions

Some links are affiliate links — PodLume may earn a commission if you buy.

Weekly email

State of the Pod, every Monday

The week's most-discussed names and stories from podcasts, with the moments behind them. Free, five minutes, unsubscribe in one click.

Listen to the full episode and explore every guest, topic, and moment on PodLume.