This paper presents a comprehensive history of neural networks, tracing the journey from the earliest philosophical speculations about intelligence to modern large language models and diffusion models. It covers biological foundations, the McCulloch-Pitts neuron, Hebb’s rule, the Perceptron, the AI Winter, backpropagation, convolutional neural networks, recurrent networks, the Transformer revolution, and contemporary developments in generative AI, multimodal systems, and AI safety. This revised edition corrects factual errors, fills significant omissions, and expands the coverage of modern developments including scaling laws,RLHF, AlphaFold, vision transformers, and state-space models. Throughout, the mathematical theories underlying each development are explicitly presented, demonstrating that the history of neural networks is inseparable from the evolution of linear algebra, calculus, probability, and optimization.