\n
![](\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2018\/03\/braincomputer-796x417.jpg\")
<\/p>\n [ad_1]
\n<\/p>\n
A pair of researchers recently developed a method for successfully conducting unsupervised machine learning that closely mimics how scientists believe the human brain works. These biologically-feasible algorithms could provide an alternate path forward for the field of AI.<\/p>\n
IBM researcher Dmitry Krotov and John J. Hopfield, inventor of the associative neural network, developed a set of algorithms that teach machines in the same loose, unfettered way humans learn. Their algorithms allow machines to learn in an unsupervised manner \u2013 without using the shortcuts (biologically-infeasible methods) that modern deep learning does.<\/p>\n A lot of ancient AI research \u2013 conducted in the 1980s and 1990s \u2013 focused on figuring out how the human brain\u2018s neural network<\/a> functions, and how that could be translated for machines. The big idea involved discerning the easiest way to represent how neurons function using math, and then scaling that for machines. Unfortunately this line of inquiry never quite panned out. In fact, most AI research was largely abandoned until the deep learning resurgence in the 2000s.<\/p>\n Krotov and Hopfield\u2019s work<\/a> maintains the simplicity of the old school studies, but represents a novel step forward in brain-emulating neural networks. TNW spoke with Krotov who told us:<\/p>\n If we talk about real neurobiology, there are many important details of how it works: complicated biophysical mechanisms of neurotransmitter dynamics at synaptic junctions, existence of more than one type of cells, details of spiking activities of those cells, etc. In our work, we ignore most of these details. Instead, we adopt one principle that is known to exist in the biological neural networks: the idea of locality. Neurons interact with each other only in pairs.<\/p>\n In other words, our model is not an implementation of real biology, and in fact it is very far from the real biology, but rather it is a mathematical abstraction of biology to a single mathematical concept \u2013 locality.<\/p>\n<\/blockquote>\n Modern deep learning methods often rely on a training technique called backpropagation<\/a>, something that simply wouldn\u2019t work in the human brain because it relies on non-local data. Our brain, for example, can process images without any formal training. We can see and process things we\u2019ve never seen before.<\/p>\n Teaching a machine to learn like a human is difficult, like teaching someone to read by describing the letters of the alphabet but never showing them. Machines don\u2019t have our direct sensory link to the universe. Krotov and Hopfield appear to have avoided this problem by creating algorithms that don\u2019t rely on a bunch of other layers \u2013 other parts of a neural network that have different information \u2013 to figure things out. According to Krotov:<\/p>\n When we train a deep neural network we often (if the task is supervised) tell the algorithm upfront what it should do \u2013 for example, classify handwritten digits. Then the algorithm finds an embedding of the data into a latent space, which depends on this task. In our case, the weights of the first layer of the neural network do not need to know what this task is \u2013 you just train them on data itself. Then, when the training is complete, we can specify the task. In this sense the weights of the first layer are agnostic about the task.<\/p>\n<\/blockquote>\n This research<\/a> is a beacon of progress for the field of artificial intelligence from an often-forgotten splinter. Modern deep learning techniques may be the soup of the day, but biologically-feasible algorithms appear to be making a comeback.<\/p>\n As to the implications of this old-is-new-again approach to AI, the researchers say it\u2019s too early to tell. Krotov told TNW the work in the paper was \u201cmore like a proof of concept that a good performance can be achieved without supervision and in a biologically plausible setting,\u201d but wouldn\u2019t speculate beyond that.<\/p>\n The simple fact that a biologically-feasible algorithm can operate within the same realm of accuracy and usability as today\u2019s popular techniques is worth getting excited over, especially if you\u2019re not convinced deep learning is the future of AI.<\/p>\n Want to learn more about artificial intelligence from some of the best minds in tech? Come see our\u00a0<\/em>Machine:Learners<\/a>\u00a0track speakers at TNW2019!<\/em><\/p>\n \n Read next:<\/b>\n
\n
\n
\n Bioware\u2019s overworked Anthem developers aren\u2019t alone, and that\u2019s the problem <\/a>\n<\/p>\n<\/p><\/div>\n