Situational awareness in robot dogs

Thema:
Artificial intelligence

Some industrial environments are too complex and too dangerous for human inspectors. But not for robots. Disaster zones are a case in point, which is why TNO is developing a robot dog that helps people prevent disasters. But what if a disaster occurs anyway? In that case, the robot can carry out rescue operations autonomously.

Imagine the scene – a huge production site with large tanks containing chemical substances that are not only toxic, but also highly flammable. A leak or too-high pressure could have catastrophic consequences. Continual and meticulous inspections are therefore essential. These are currently carried out by people, but the work itself is very hazardous as there is always a risk of toxic gases escaping or of an explosion taking place.

Robot with artificial intelligence

Imagine the scene – a huge production site with large tanks containing chemical substances that are not only toxic, but also highly flammable. A leak or too-high pressure could have catastrophic consequences. Continual and meticulous inspections are therefore essential. These are currently carried out by people, but the work itself is very hazardous as there is always a risk of toxic gases escaping or of an explosion taking place.

SPOT the robot dog used for inspection and rescue work
SPOT the robot dog can be used for inspection work in dangerous situations instead of people.

Helping and saving people

But that’s not all. TNO is presently investigating what is needed for deploying the robot dog during rescue operations. In such situations, it will not only be helping people, but actually saving their lives. We are currently developing this intelligence.

Situational awareness during a disaster

For both inspection work and rescue missions alike, it is important that the robot is operational as soon as it is activated. It will have to be able to do its work immediately, autonomously, and intelligently. We refer to this as ‘turnkey intellect’. To actually get a robot to this level, it first has to pass through the following three stages:

  1. Making plans based on common sense. The robot has to know what situation it is in – that is, it must have situational awareness.
    At the same time, it has to be able to make hypotheses, such as whether there is a possible gas leak. It then has to verify its hypotheses according to what it observes in the real world. This means the robot must possess the knowledge that people have so far acquired in relation to hazardous situations. It should also be capable of learning new experiences itself.
  2. Anticipating. In any critical situation, there are so many factors at play that things can evolve at a rapid pace. In such cases, the robot will have to check whether its current plan is still feasible. If it is not, then it must quickly devise a new plan and act accordingly.
  3. Improvising. What happens if the camera fails during a measuring operation? There would be little point in the robot continuing to work on the basis of visual input. It would have to find other ways of carrying out its work, with the help of sounds or smells, for example.

Monitoring the robots remotely

Once the robot dogs actually start carrying out inspections and rescue operations, people will be able to monitor them remotely. That’s because they will constantly be sending information about their progress. In doing so, the robots will also be stating how far their knowledge and skills are relevant to the situation in which they find themselves.

Robot Dog Spot with State Secretary for Kingdom Relations and Digitalisation, Alexandra van Huffelen.
SPOT the robot dog interacts with State Secretary for Kingdom Relations and Digitalisation, Alexandra van Huffelen.

Get inspired

32 resultaten, getoond 1 t/m 5

‘Giant AI goes down the European road’

Informatietype:
Insight
31 March 2023

TNO supports the alarming call of the Future of Life Institute regarding AI. Regulation is urgent and cannot be left solely to the market. Read TNO's response.

AI Systems Engineering & Lifecycle Management

Informatietype:
Article

The AI system for the future. At TNO, we work on AI systems that remain reliable and can handle new functions in the future.

Rob de Wijk on the rise of AI in geopolitical context

Informatietype:
Insight
27 September 2022

Anne Fleur van Veenstra, director of science at TNO’s SA&P unit, interviews Rob de Wijk, emeritus professor of international relations in Leiden and founder of The Hague Centre for Strategic Studies. Rob is also a much sought-after expert who appears on radio and television programmes. What does the rise of AI mean geopolitically and in armed conflicts?

Bram Schot on the impact of AI on mobility

Informatietype:
Insight
27 September 2022

Marieke Martens, science director at TNO and professor of automated vehicles at the Eindhoven University of Technology, talks to Bram Schot. Schot was the CEO of Audi until 2020, having previously held management positions at various car makers, including Mercedes and Volkswagen. Their conversation concerns the influence of AI on mobility. How will AI impact the production process? And what does a future with autonomous vehicles look like?

Eppo Bruins on AI in different government domains

Informatietype:
Insight
27 September 2022

Michiel van der Meulen, chief geologist for the Geological Survey of the Netherlands (GDN), speaks with Eppo Bruins. Bruins was educated as a nuclear physicist and has spent many years working in the world of science, innovation, and technology. Between 2015 and 2021, he was a Dutch member of parliament for the Christian Union. He was recently appointed chairman of the Advisory council for science, technology and innovation (AWTI). What will AI mean for the various government domains in the coming years?