The Download: the next big thing in LLMs and how AI academic research is shifting

This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology.
These startups are chasing the next big thing in LLMsNine years after Google researchers introduced the transformer, this family of neural networks has become the engine inside every major large language model. But transformers are starting to show their age. As LLMs get bigger and better, transformers have become a bottleneck. Their dense att