The rapidly growing realm of artificial intelligence (AI) is renowned for its performance but comes at a substantial energy cost. A novel approach, proposed by two leading scientists at the Max Planck Institute for the Science of Light in Erlangen, Germany, aims to train AI more efficiently, potentially revolutionizing the way AI processes data.
Current AI models consume vast amounts of energy during training. While precise figures are elusive, estimates by Statista suggest GPT-3’s training requires roughly 1000 megawatt hours—equivalent to the yearly consumption of 200 sizable German households. While this energy-intensive training has fine-tuned GPT-3 to predict word sequences, there’s consensus that it hasn’t grasped the inherent meanings of such phrases.
Neuromorphic Computing: Merging Brain and Machine
While conventional AI systems rely on digital artificial neural networks, the future may lie in neuromorphic computing. Florian Marquardt, a director at the Max Planck Institute and professor at the University of Erlangen, elucidated the drawback of traditional AI setups.
“The data transfer between processor and memory alone consumes a significant amount of energy,” Marquardt highlighted, noting the inefficiencies when training vast neural networks.
Neuromorphic computing takes inspiration from the human brain, processing data parallelly rather than sequentially. Essentially, synapses in the brain function as both processor and memory. Systems mimicking these characteristics, such as photonic circuits utilizing light for calculations, are currently under exploration.
Training AI with Self-Learning Physical Machines
Working alongside doctoral student Víctor López-Pastor, Marquardt introduced an innovative training method for neuromorphic computers. Their “self-learning physical machine” fundamentally optimizes its parameters via an inherent physical process, making external feedback redundant. “Not requiring this feedback makes the training much more efficient,” Marquardt emphasized, suggesting that this method would save both energy and computing time.
Yet, this groundbreaking technique has specific requirements. The process must be reversible, ensuring minimal energy loss, and sufficiently complex or non-linear. “Only non-linear processes can execute the intricate transformations between input data and results,” Marquardt stated, drawing a distinction between linear and non-linear actions.
Towards Practical Implementation
The duo’s theoretical groundwork aligns with practical applications. Collaborating with an experimental team, they’re advancing an optical neuromorphic computer that processes information using superimposed light waves. Their objective is clear: actualizing the self-learning physical machine concept.
“We hope to present the first self-learning physical machine in three years,” projected Marquardt, indicating that these future networks would handle more data and be trained with larger data sets than contemporary systems. Given the rising demands for AI and the intrinsic inefficiencies of current setups, the shift towards efficiently trained neuromorphic computers seems both inevitable and promising.
In Marquardt’s words, “We are confident that self-learning physical machines stand a solid chance in the ongoing evolution of artificial intelligence.” The scientific community and AI enthusiasts alike wait with bated breath for what the future holds.
Credit: Source link
