Deep Learning

Books Deep Learning Machine Learning

New Book: Efficient Deep Learning

Subtitled “Fast, smaller, and better models”. This book goes through algorithms and techniques used by researchers and engineers at Google Research, Facebook AI Research (FAIR), and other eminent AI labs to train and deploy their models on devices ranging from large server-side machines to tiny microcontrollers. The book presents a balance of fundamentals as well […]

Read More
Deep Learning Featured Posts Machine Learning

Amazing Neural Network Video Demonstration

I recently posted an article featuring a very deep neural network in action (250 layers), see here. Each frame in the video represented one layer, with the signal propagating from one layer to the next. In the last layer, the whole space was classified, in the sense that any new observation was immediately assigned to […]

Read More
Deep Learning Machine Learning

New Neural Network with 500 Billion Parameters

Google just published a research article about its Pathways Language Model (PaML), a neural network with 500 billion parameters. It is unclear to me how many layers and how many neurons (also called nodes) it can handle. A parameter in this context is a weight attached to a link between two connected neurons. So the […]

Read More
Deep Learning Explainable AI Machine Learning Synthetic Data Visualization

Very Deep Neural Networks Explained in 40 Seconds

Very deep neural networks (VDNN) illustrated with data animation: a 40 second video, featuring supervised learning, layers, neurons, fuzzy classification, and convolution filters. It is said that a picture is worth a thousand words. Here instead, I use a video to illustrate the concept of very deep neural networks (VDNN). I use a supervised classification […]

Read More