Siemens Worldwide

Pictures of the Future


Contact Sebastian Webel
Mr. Sebastian Webel


Tel: +49 (89) 636-32221

Fax: +49 89 636-35292

Werner-von-Siemens-Straße 1
80333 Munich

Pictures of the Future
The Magazine for Research and Innovation

Artificial Intelligence

Thriving on Mountains of Data

Professor Bernhard Schölkopf

Emotions play an important role in human learning, which is why psychology will become relevant in the design of intelligent systems, says Professor Bernhard Schölkopf.

What does learning actually mean in a scientific sense?

Schölkopf: That depends on who you ask. A psychologist would say that learning can be defined as the change in behavior that results from experience. That’s only part of it, however. If someone injures their foot, they’re going to limp — not because they learned to but simply because it hurts. I as a physicist, on the other hand, search for certain types of regularities that lead from a specific input to an output. Scientists refer to this drawing of cause and effect conclusions on the basis of observations as “empirical inference.” My institute attempts to convert the associated mechanisms into algorithms in order to find solutions to problems that humans are unable to solve on their own.

Can you provide an example?

Schölkopf: You’ll always find problems like that wherever tremendous amounts of data are involved. Take bioinformatics, for example. Geneticists want to find out where genes on a DNA strand begin and end. You can do this by conducting an experiment in a lab, which will generate data with millions of data points linked to one another by a high-dimensional connection. No human being is going to discover any regularities here that will allow you to predict where the right interfaces will be found. But if you use the data to train software, things work out pretty well. The great thing is that the regularities converge, as we say, which essentially means that the results become more precise as you feed in more data. That’s the big benefit of machine learning. Machines find the kinds of structures in large amounts of data that a human would never find. That’s not surprising, given that our brains are optimized for perception and action — and not for scientific processes. Another advantage of machine learning can be found in those applications where we observe the environment with sensors that humans simply don’t possess. After all, we’re not equipped with built-in laser scanners to measure distances, for example.

Where does the human brain have an advantage?

Schölkopf: The brain is a very complex organ that can carry out some tasks very precisely and efficiently through learning. This is especially true when the brain faces problems that were important to us throughout evolution, like recognizing visual patterns. That’s why we can recognize numbers and letters in fractions of a second, whereas computers have problems with that. On the other hand, if you convert the symbols into barcodes, we can’t read them, but computers can. This is because our brains have been trained our whole lives to extract regularities out of numbers and letters. Neuroscientist Horace Barlow once referred to the brain as a statistical decision-making organ. Still, we have to keep in mind that only certain statistical tasks can be handled very effectively — the ones that have had the greatest significance throughout evolution.

In your opinion, what role do emotions play in learning?

Schölkopf: Emotions definitely play a role in human learning — for example, when assessing what’s important to do, or what makes sense to do, or in situations that involve motivation. Evolution seems to indicate that everything “implemented” in human beings is also useful. That’s why I believe psychology issues will sooner or later become relevant and helpful in the design of intelligent systems. My own feeling, however, tells me that we’re still quite far from being able to understand and implement such artificial intelligence in a functional manner.

Forty years ago scientists thought they would soon be able to build robots with artificial intelligence. What went wrong?

Schölkopf: Those machines were built by engineers, which is why people could understand them. When a sensor in such a robot registers a certain measurement, a motor in the robot will begin to move. Artificial intelligence isn’t an area traditionally addressed by engineers, however. Biological systems are the only truly intelligent systems, so it’s hard for people to understand them. Homespun programs like those in the past won’t work here in any case.

Are you saying machines need to learn how to learn?

Schölkopf: Learning-enabled systems do offer certain benefits, but they’re also designed by engineers. The most progress here has been made with monitored learning, in which case humans first must evaluate measured data, or give it labels, as we say. You can train facial recognition software, for example, by telling a program when a certain person appears in an image. If you do that often enough, the program will be able to extrapolate to a limited extent, even if the person in question looks a little different each time.

In other words, human and animal learning probably can’t be considered monitored learning?

Schölkopf: Right. In most cases it isn’t; but it is monitored learning, for example, when parents show their child a picture of a cat and tell them it’s a cat. Gripping an object, on the other hand, is something children learn by themselves. Machines still can’t do this. That’s why we’re increasingly using something called “reinforced learning,” which is a kind of middle way. Here, a robot designer no longer tells the machine which path its gripper arm needs to take. He or she only reports on whether or not the robot successfully gripped the object. The machine then learns which movements lead to success, and determines the best way to move

Prof. Bernhard Schölkopf is the Director of the Max Plank Institute for Intelligent Systems in Tübingen and Stuttgart, Germany, as well as one of the world’s leading experts in machine intelligence. A physicist and mathematician, Schölkopf develops new learning techniques that are designed to uncover regularities in complex data sets. He has conducted research at Bell Laboratories and Microsoft Research, among other places, and was presented with the Max Planck Research Award in 2011.

Interview by Bernd Müller.
Picture credits: from top: 1. picture: A.Faden/Max-Planck-Institut, 3. F1 online