Traffic can be very unpredictable. As a result, road users can find suddenly find themselves in dangerous situations. With self-driving cars, it is vital that they are aware of the nature of the circumstances they are in. That is why TNO and other parties with which it is jointly working have devised a proof-of-concept for equipping AI with situation awareness.

Data-learning AI algorithms already enable vehicles to take charge of a large proportion of driving-related tasks. That is certainly an advance. But when it comes to situation awareness, the systems used for autonomous driving are found wanting. This became apparent from the report entitled ‘Wie stuurt?’ by the Dutch Safety Board. The report describes various accidents involving the present generation of vehicles with automatic functions. It makes clear that the situations in question were often those in which the functions were not up to scratch.

Hybrid AI with the gift of prediction

In commonly occurring situations, autonomous vehicles know what they have to do. However, they always need to know what they should do, in every conceivable situation. In addition to the use of data-learning AI algorithms, the competencies of AI should also extend to being able to predict the actions of other road users. This calls for ‘hybrid AI’ – a combination of data-learning AI and domain knowledge. The result is situation awareness. And that is a useful starting point for AI being able to predict what will happen several seconds into the future. A few seconds may not seem very much. But in dangerous traffic situations, they may be the difference between life and death. That’s because they may be enough for the driver of a vehicle to take control safely.

Situation awareness for self-driving cars, lorries, buses, trains

A proof-of-concept test is currently being carried out jointly by TNO, the CWI, the University of Amsterdam, and various manufacturers who produce components that are used for truck platooning. The great thing is that situation awareness is not just relevant to a small group of vehicles. So whether it concerns self-driving cars, lorries, buses, trains, or any other kind of vehicle – in due course, they all stand to gain from the hybrid AI that we are now developing.

Hybrid AI in combination with situation awareness?

If you’d like to know more, please contact Jan-Pieter Paardekooper


Autonomous vehicles & systems

At TNO we are making sure that new AI-enabled autonomous vehicles and systems are safe and reliable. Moreover, we ensure that they comply with the law and with ethical and societal standards. This is by... Read more

AI helps to define information clearly

Whenever we want to make a decision or check something, correct information is crucial. The more clear the information, the better. If not, and for example if different terms are used for the same concept,... Read more

Jan-Pieter Paardekooper