Topic

Computation and Language

Episodes and research papers from From First Principles that help explain Computation and Language from the ground up.

Research

Papers and studies featured by the show.

arXiv·

mHC: Manifold-Constrained Hyper-Connections

Imagine building with LEGOs. A simple, deep tower (a basic neural network) can get wobbly and fall. Someone invented a special LEGO piece (a 'residual connection') that acts like a super-strong internal support beam, letting you build much taller, stable towers. Then, another builder tried adding lots of extra crisscrossing beams ('Hyper-Connections') for even more strength, but this made the whole structure complicated and surprisingly unstable again. This paper introduces a new, smarter way to add those extra beams ('mHC'). It's like using precisely engineered brackets that add strength without messing up the main support structure, resulting in the tallest, strongest, and most stable tower yet.