Hyperconnections (multi-stream “highway” for features)

Transcript
This chapter, from the episode video's captions · 215 words
1:19:57if you're the whole point of this skip connection was to make sure that I don't blow up and I don't >> vanish >> vanish. But now if I don't have that identity, I could start blowing up and vanishing here on this end. >> Right. It's the same problem that I had earlier. >> I gotcha. >> Okay. So, so it's it's hard to use these hyperconnections >> because the they were just being let loose a little bit like there like maybe there was a wide road but not lanes. >> Yeah. >> In between what like would be like lanes for different things to go down. I was just like, "Yeah, just everyone the wide road. Let's all go." >> And and if like and if the highway
1:20:37itself is now like magnifying the amount of traffic, >> then you're running into the same problem that you were earlier. >> That makes sense, >> right? Okay. And that is where this particular paper comes in. Okay. With something called a manifold solution. >> Okay. >> Okay. The idea is what you do is you say, "Okay, remember that hyperconnection which is a way to a way to change the how we're merging this traffic stuff, right? It's it's that thing is just
From Roman Concrete, Brain "Cognitive Legos," DeepSeek, and Econophysics
Roman concrete, compositional brains, DeepSeek scaling, and market impact physics.