Vishal Misra Traces LLM Origins to Claude Shannon's 1948 Paper
Vishal Misra argues that the 1948 Bell Labs paper by Claude Shannon, A Mathematical Theory of Communication, contains the first generative AI model and that modern LLMs trace back to it. He quotes a thread by techNmak recounting Shannon's history.
Original post · 1 min read
Tech with Mak @techNmakIn 1948, a 32-year-old at Bell Labs published a paper nobody fully understood.
Engineers found it too mathematical. Mathematicians found it too engineering-focused. One prominent mathematician reviewed it negatively.
That paper - "A Mathematical Theory of Communication", became the founding document of the digital age.
The man was Claude Shannon. Father of Information Theory.
At 21, he wrote the most important master's thesis of the 20th century.
Working at MIT on an early mechanical computer, Shannon noticed its relay switches had exactly two states - open or closed. He had just taken a …
