Are We Building World Models The Wrong Way? | TITV’s AI Deep Dive
Can interpretability tell us whether a world model has learned physical concepts—or shortcuts that happen to produce convincing results? For Episode 6 of AI Deep Dive, World Mechanics co-founder and CEO Sonia Joseph joins Rocket Drew to explore how understanding a model’s internal representations could help researchers train more accurate, reliable and data-efficient world models. What does it mean for a neural network to represent velocity, direction or object permanence? Can researchers identify those concepts and use them to guide training? Drawing on her research at Meta, Sonia discu