Plain-English: what “manifold constrained” is buying you

Transcript
This chapter, from the episode video's captions · 454 words
1:31:58no one know none of them knew what man hyper uh whatever >> manifold constrained hypercon hyperconnections they everyone's like what is I don't know what manifolds are I don't know what constraint means in this context I don't know what hyper connections are >> but now now you do right hyperconnections is the mixing of the traffic the manifold constraint is just just say the thing that is mixing the traffic better not amplify the traffic or shrink the traffic. >> The traffic better be the same. >> This is obviously going to make models everyone's going to start in different ways capacities using this. It's going to make models much much better. >> Yeah. And and it's also like kind of a a shift in the paradigm of just like it's
1:32:40just compute compute, right? Because right here this is algorithmic innovation >> that's acting as a substitute for compute. You bring up a really good point because that's been the, you know, people sort of say, you know, the argument is like, oh, the Americans are just, you know, being fat and lazy because uh or being dumb and lazy in this context because they just want to throw money at the problem. >> Yeah. >> And then they're not actually doing any of the variety of areas of fundamental research. I mean, some people argue that you can't just scale with this is the Yan Lun, you know, other like you can't just get to >> whatever you want to define as AGI by scaling LLM. you need some or some subset even uh Dario at at Anthropic kind of same says the same thing. You need some subset of other insights or
1:33:21breakthroughs around it. >> Um [clears throat] but you know this is a perfect example of identifying that there's a lot of green space still >> to in these areas that people might not be focusing on because the rat race around being the first AGI is has people just like what is the easiest way to get there quickly throw money at the problem. >> Yeah. And so we don't get clever. Very interesting. Again, the USChina nexus is not going anywhere. >> No, >> it is what it is. Y >> um >> and so we we hit we've hit Rome. >> We went really far back in time. Then we went real real deep on the brain.
1:34:01>> Yeah. >> And then we kind of went a little bit we we went shallow seek on [laughter] >> Yeah. >> on AI, the fake brain. And now we're going to move to our last story of the day. Uh which we have aptly titled econo
From Roman Concrete, Brain "Cognitive Legos," DeepSeek, and Econophysics
Roman concrete, compositional brains, DeepSeek scaling, and market impact physics.