InfoQ

Deep Learning Pioneer Geoffrey Hinton Publishes New Deep Learning Algorithm

Geoffrey Hinton, professor at the University of Toronto and engineering fellow at Google Brain, recently published a paper on the Forward-Forward algorithm (FF), a technique for training neural ...
PC Magazine

AI backpropagation

The method used to train a large language model (LLM). An AI model's neural network learns by recognizing patterns in the data and constantly adjusting its neurons to predict what comes next. With ...
Semiconductor Engineering

In Situ Backpropagation Strategy That Progressively Updates Neural Network Layers Directly in HW (TU Eindhoven)

A new technical paper titled “Hardware implementation of backpropagation using progressive gradient descent for in situ training of multilayer neural networks” was published by researchers at ...
Quanta Magazine

Neuron Bursts Can Mimic Famous AI Learning Strategy

A new model of learning centers on bursts of neural activity that act as teaching signals — approximating backpropagation, the algorithm behind learning in AI. Every time a human or machine learns how ...
Diginomica

Generative AI needs better context - you can't talk about Large Language Models without reverse neural networks and backpropagation

The hype over Large Language Models (LLMs) has reached a fever pitch. But how much of the hype is justified? We can't answer that without some straight talk - and some definitions. Time for a ...