You could have invented transformers from memory
2026-10-15 Alex Wang About the limits of memory capacity in multi layer perceptrons (MLP) compared to self-attention.
2026-10-15 Alex Wang About the limits of memory capacity in multi layer perceptrons (MLP) compared to self-attention.
2025-09-08 Ibrahim Diallo Whether the AI generates perfect code or complete hallucinations, you still have to read it. You still have to trace through what it’s supposed to do, how it interacts with the rest of the system, and what…
2025-08-18 Jamie Lord Every textbook showed the same inexorable curve: small models underfit, optimal models generalise, large models catastrophically overfit. End of story. … In 2019, a group of researchers committed the ultimate sin: they ignored the warnings and kept…
2025-08-22 Matheus Lima The real question isn’t whether you’ll make mistakes; it’s what you do after. … When you inevitably lose your patience with your kid or handle something poorly, what matters most is going back and fixing it. Acknowledging…
2025-05-28 Brian Kihoon Lee LLM training datasets includes novices asking questions that don’t make sense, as well as experts that know exactly the piece of information they are lacking and are now requesting. How you ask your question determines which…
2025-04-29 Vítor Fróis Building an intuitive understanding of how Linear Regression works and how it leads to Gradient Descent
2024-09-27 Steven Hochberg and Peter Kendall The Fed doesn’t set interest rates. Investor psychology controls the movement of rates, and the Fed follows. This article has graphs showing the Fed Funds Rate has followed the 3 and 6 month…
2024-07-28 Gary Marcus My strong intuition, having studied neural networks for over 30 years (they were part of my dissertation) and LLMs since 2019, is that LLMs are simply never going to work reliably, at least not in the general…
2022-02-02 Eli Steele Pastor Corey Brooks wished to share his thoughts on Black Lives Matter and Booker T. Washington . . . What makes me especially mad is that we have had blacks like these who milked black pain for…