How Artificial intelligence is becoming sustainable?

 A research group from Politecnico di Milano has developed a new computing circuit that can execute advanced operations, typical of neural networks for artificial intelligence, in one single operation.

The circuit performance in terms of speed and energy consumption paves the way for a new generation of artificial intelligence computing accelerators that are more energy-efficient and more sustainable on a global scale. The study has been recently published in the prestigious Science Advances.


Recognizing a face or an object, or correctly interpreting a word or a musical tune are operations that are today possible on the most common electronic gadgets, such as smartphones and tablets, thanks to artificial intelligence. For this to happen, complicated neural networks need to be appropriately trained, which is so energetically demanding that, according to some studies, the carbon footprint that derives from the training of a complex neural network can equal the emission of 5 cars throughout their whole life cycle.


To reduce the time and energy consumption of the training, one should develop circuits that are radically different from the conventional approach and that are able to mimic more accurately the structure of the neural networks and the characteristics of the biological synapses. 


An atypical example is the concept of in-memory computing, where data are processed directly within the memory, exactly like in the human brain. Based on this analogy, the research group at Politecnico di Milano has developed a novel circuit that can execute a mathematical function known as regression in just one operation. For this purpose, they use a resistive memory, also known as a memristor, a device that can memorize any datum (for example the value of a share at a certain time) in the value of its resistance. 


By arranging these memory elements within an array with the size of a few micrometres (a few millionths of a meter), the group at Politecnico di Milano has been able to execute a linear regression on a group of data. This operation is capable of determining the straight line that best describes a sequence of data, allowing, for instance, to predict the trend in the stock market based on a simple linear model. 


Logistical regression, which allows classifying data within a database, has also been demonstrated. This function is essential for the so-called recommendation systems, which are crucial marketing tools for online purchases.
x

Comments

Post a Comment

Popular posts from this blog

What is Stochastic gradient descent and Mini Batch Gradient Descent in ML?

Image
 Here we are going to discuss the second and third types of gradient descent which are known as Stochastic Gradient Descent and mini-batch gradient descent. Stochastic gradient descent The word ‘Stochastic’ means a system or a process that is linked with a random probability. Hence, in Stochastic Gradient Descent, a few samples are selected randomly instead of the whole data set for each iteration. In Gradient Descent, there is a term called ‘batch’ which denotes the total number of samples from a dataset that is used for calculating the gradient for each iteration, In typical Gradient descent optimization, like Batch Gradient Descent, the batch is taken to be the whole dataset. Although, using the whole dataset is really useful for getting to the minima in a less noisy or less random manner. But the problem arises when our datasets get really huge. Stochastic gradient descent (often abbreviated SGD) is an iterative method for optimizing an objective function with suitable smoothness p
Read more