During the webinar ‘AI’s role in government decision-making’, we received many viewer questions. Here, you will find answers to the most common topics.
Rewatch the webinar here
Appl.AI Webinar #1: 'How can AI help the government in transparent and fair decision-making?'
1. What specific problem do you solve by using citizen data and what data do you need for that?
The role of data cannot necessarily be linked to a 'problem-solution', because data-driven decisions are creating all kinds of new problems. We can now learn and anticipate the possible consequences of a policy or decision better through data. Before it wasn’t possible on this large scale. The other side of the coin is that there are also social expectations about the use of general digital resources in society. In other words, you have to keep up with the times. People expect them to be able to complete a form digitally with the government.
2. The corona app seems to me to be of general use. Why then is a solution left to companies?
Because the government does not have the right skills and tools to build an app quickly and agile. Also because we are increasingly understanding worldwide that an app in itself is not a solution and that you need much more. In other words, reaching for technological solutions too quickly before you understand the social problems remains one of the biggest pitfalls of digitization.
3. Who weighs up the extent to which the individual interest relates to the group interest?
There is a huge difference between a Western culture like ours and South Korea, for example.
There are enormous cultural differences when it comes to privacy and the role of the government in the protection of personal data. In the Netherlands (and in the Scandinavian countries), confidence in the government, also to use personal data for the right purposes and to protect it properly, is relatively high. The trade-off is a political one, but within the bounds of the law.
4. If you involve multiple disciplines in the design process (such as a lawyer, policymaker, citizen, algorithm developer, possibly even a philosopher), how could you overcome the language barrier that they do not speak each other's language?
At TNO we have developed a method that we use as the 'Policy Lab'. In a series of sprints we take all the expertise to really understand each other's language within a project. Even between statisticians and data scientists there are big differences about labels, categories and weighting factors of variables. It is a very fascinating topic at the interface of data-driven algorithms and expression-based systems (something we call 'hybrid AI'. Research has only just begun on this theme!
5. Couldn't you give everyone insight by making the corona app open source? This allows everyone (who has knowledge of it) to participate in the development.
Good point. Companies that want to take advantage of the development of such an app should not be shortlisted anyway. The dominant role of Apple and Google in such apps is worrying in that regard, as they sit in the government seat and thereby determine the rules (without releasing them). In Europe, an open-source protocol for Corona tracking apps has been developed and is recognized, criticized and improved by experts. The question remains why the Dutch government does not join this initiative.
6. Which government tasks could you easily replace with autonomous AI systems and which ones would you rather not replace?
AI is very good at 3 things:
1) Copying experts (expert systems)
2) Predicting / classifying / clustering (structured & unstructured machine learning)
3) Making choices that lead to a specific goal (reinforcement learning)
All this is valuable and useful, but in isolation it is insufficient to let go of many decisions without control. For example, AI is not able to think creatively or to appreciate context. So as a predictor when an infrastructure object needs maintenance, it is fine to use AI. As an assessor what kind of punishment is needed, you do not want AI to function autonomously. Understanding how AI works is important to be able to assess for which tasks AI can be used and what level of autonomy we allow.
7. How can you monitor the interaction between separate AI systems?
This is one of the dimensions on which we conduct applied research. AI systems are now often isolated systems that do one job well. But we expect more: AI systems must be able to work together and cooperate with people. That brings a lot, but it is not easy to realize. As always, it starts with the question: what purpose does it serve? From there, subsystems and solutions can be searched for.
8. A self-learning algorithm continuously bases its outcome on newly obtained data and correlations, so that each outcome has a different basis. Doesn't this make it very difficult to check and provide insight into a self-learning algorithm?
Explainability is essentially a semantic and communicative process. To be able to reason about an AI analysis as a human with AI, the frame of reference of AI must be compatible with that of humans. There must be a communicative relationship between man and model. AI often surpasses humans by learning complex connections from very large amounts of data, which complicates the matter.
9. Will it soon become possible as a citizen to ask how a decision of an AI system was made?
Transparency and verifiability are prerequisites for the deployment of AI systems. This means that there must be a process in which people can indeed question government decisions and have an explanation of how a decision was made.
10. As with the aforementioned problem of women's discrimination at Amazon, we also have a problem close to home: the tax authorities and dual citizenship. As long as the bias is known, and is included in retraining to prevent the amplifying effect of the bias, is there really a problem?
If adequate measures have been taken to remove this bias, it may not be an AI problem (anymore). But until then, it still is. In both cases, the real problem lies in the organization that provided the data on which the algorithm was trained. At Amazon, the data apparently showed that there was bias in the offline recruitment process, just like with the tax situation.
11. AI Techniques are becoming more and more advanced, and so the explanation (read transparency) is becoming increasingly complex. What does the future hold with regard to a so-called 'knowledge gap' between AI techniques (and their explanation) and decision-making about AI?
We will have to accept that in a number of cases the relationship between the AI model and human knowledge cannot be properly established. A complex deep learning system that detects cancer is better trusted if it appears afterwards through an additional diagnostic test (by humans). When the system is right 99% of the time, explainability is less important. Being able to calibrate quality and explainability in this way offers an opportunity to include models in a human workflow: in some contexts, lower explainability and higher accuracy are preferable. In other situations, higher explainability at the expense of somewhat lower accuracy is preferable.
Rewatch the webinar here
Appl.AI Webinar #1: 'How can AI help the government in transparent and fair decision-making?'
Appl.AI Webinar #1: AI’s role in government decision-making
The main question we addressed in our webinar is ‘How can AI help the government in transparent and fair decision-making?’. You can watch this webinar that took place on Wednesday, 27 May 2020. Read moreData-driven policy: AI in public policy and services
Every day, policy makers and public servants face complex challenges. Some of these challenges are: fighting long-term unemployment, meeting sustainability goals and anticipating technological impact.... Read morePolicy Lab: developing data-driven policies
The use of new data sources and technological developments such as Artificial Intelligence offers opportunities for policy makers to gain new insights and respond better to societal developments. TNO has... Read moreAI helps to define information clearly
Whenever we want to make a decision or check something, correct information is crucial. The more clear the information, the better. If not, and for example if different terms are used for the same concept,... Read moreFair Machine Learning combats biases
An AI tool bases its calculations on data. If the data is biased, the calculations will be biased. If there was once a male preference within a profession, then this will be adopted by AI tools for recruitment. So... Read moreTowards human-machine teaming
The rising potential of AI, intertwines our lives with the use of AI-technology. It will increasingly behave as a partner rather than a tool. Yet AI-technology is always embedded within a larger organisation,... Read moreTechniques
Read moreDeep Vision extracts information from images
A photo says more than a thousand words. However, it’s difficult for people to get useful information from many photos or videos. Through Deep Vision, we’re developing AI algorithms to make automatic... Read more- Artificial Intelligence
- Application areas
- Use cases
- Program line 1: Safe autonomous systems in an open world
- Program line 2: Responsible human-machine interaction
- Secure learning in money laundering detection
- Fair decision making in the job market
- Secure learning in diabetes-2 advice
- Diagnosing for printer maintenance
- Subsidence monitoring
- Fair decision making in justice
- Augmented worker for smart industry
- Energy balancing for smart homes
- Secure learning in oncology research
- Innovation monitoring in policy
- News
- Defence, Safety & Security
- Roadmaps
- Operations & Human Factors
- Climate Chambers for Research into Human Performance
- Desdemona: The ultimate motion simulator
- LT Lab: the TNO learning technology laboratory
- Performance and health monitoring
- Motion sickness and performance
- The neurobiology of Stress
- NetForce Command: an alternative to hierarchical command and control
- Operational military performance in a virtual world
- SUPRA
- Simulation Live Virtual and Constructive
- Concept Development & Experimentation
- IAMD: Integrated Air & Missile Defence
- JROADS
- FACSIM
- Helicopter studies
- Replacement of the F-16
- MARVEL / Comprehensive Approach
- TNO ACE: Advanced CD&E Environment
- Integrated approach to Dutch Royal Navy patrol ships
- Operational analysis during military operations
- SketchaWorld: from sketch to virtual world
- Camouflage
- Information & Sensor Systems
- Digital Resilience of The Netherlands
- LFAS - Low Frequency Active Sonar
- Tanker Remote Vision System
- Platform signatures
- TNO shapes the future of MMICs and RFICs
- CARPET: Computer-Aided Radar Performance Evaluation Tool
- Underwater Warfare and Security
- Wide Area Motion Imagery WAMI
- SAKAMATA: sonar and marine mammals
- PARANOID: rapid information processing
- Mine analysis and threat evaluation
- Ship acoustics and underwater acoustic signatures
- PERSEUS Wind Turbine Radar Interference Assessment tool
- Electromagnetic security
- Operating safely at sea
- Operations at sea
- Ocean Space
- National Security
- A new vision on modernizing the emergency reporting process
- Social media in the security sector
- Automatic Video Compilation and Analysis System (AVACS)
- The Dutch Cyber Cube Method: Improving Human Capital for SOCs and CSIRTs
- Concealed weapon detection
- FP7 Project IMPACT Europe
- Critical Infrastructure Protection (CIP) policies in Europe
- @MIGO: border control
- Smarter Surveillance, man, machine, synergy
- Cyber Security of Industrial Control Systems
- Privacy enhancing techniques in cyber security data sharing
- Driving Innovation in Crisis Management with DRIVER+
- Crisis management: new challenges, new opportunities
- The learning professional: resilient and deployable for the long term
- Protection, Munitions & Weapons
- Weapons systems control and analysis
- Weapon Effects & Protection Center
- Firepower
- Protection and survivability of vehicles
- Naval protection and survivability
- Infrastructure protection and survivability
- World-class ballistics research
- Countering Explosive Threats
- Materials for protection concepts
- Processing of Propellants, Explosives and Pyrotechnics
- Ammunition Safety
- Ballistic Performance and Personal Protection
- Chemical, Biological, Radiological and Nuclear (CBRN) Protection
- Anticipating accidents, incidents and threats
- Protecting those who protect us
- Process Safety Solutions: Expertise in Handling Hazardous Conditions Safely
- Expertise groups
- Acoustics and Sonar
- Chemical, Biological, Radiological and Nuclear (CBRN) Protection
- Electronic Defence
- Energetic Materials
- Explosions, Ballistics and Protection
- Human Behaviour and Organisational Innovation
- Human Machine Teaming
- Human Performance
- Intelligent Autonomous Systems
- Intelligent Imaging
- Military Operations
- Modelling, Simulation and Gaming
- Networked Organisations
- Radar Technology
- Weapon Systems
- Energy Transition
- Roadmaps
- Renewable electricity
- Towards large-scale generation of wind energy
- The important of support structures
- Wind turbines, fully in motion
- Innovation towards 10-20 MW offshore wind turbines
- Modeling 10MW+ turbines aerodynamically
- Design for Reliable Power Performance (D4REL)
- Optimised wind blade tip design
- Vortex-wake models in wind turbine design
- Modelling improvement wind turbine blades
- Converters for Clean, Low Cost Electricity
- Haliade X: largest wind turbine ever
- New research on blade tip improvements
- Less production per wind turbine, still higher yield
- Logistics innovative strength at home and abroad
- Wind turbine management and maintenance
- Wind farms in synergy with the environment
- Innovative methods for wind measurements
- Keeping the electricity grid stable when there’s a surplus of wind and solar
- Innovation and the rise of solar energy
- Solar farms respecting landscape and nature
- Solar panels on farmland
- Research innovative solar parks
- Better design of solar parks
- Savings on solar farm operations and maintenance
- Floating solar panels on inland waterbodies
- Offshore solar energy
- National Consortium Solar in Landscape
- National Consortium Solar on Water
- Field lab floating solar
- Research into environmental effects of solar, wind energy
- Solar energy on buildings and infrastructure
- Solar panels in façades
- Solar windows
- More focus on safety of solar systems
- Solar heat and PV-T
- Roofs for solar energy
- Noise barriers producing solar energy
- Solar energy in road surfaces and crash barriers
- Solar panel energy generated on dikes
- Solar and infrastructure
- Outdoor test facility for BIPV(T)
- Solar Highways
- Solar-powered cars
- Mass customization
- Solar panel efficiency
- New technologies make PV more versatile
- Webinar: Innovations in solar energy technologies
- Putting Europe back in the lead in solar panel production
- System transition
- The social aspects of the energy transition
- TNO facilities for research into environmental effects of solar and wind energy
- Effective interventions to increase energy efficiency and reduce energy poverty
- Green and Ease under one roof
- Capacity building programme for energy efficiency in industry
- Zooming in on the future to make the right choices
- Scenarios for a climate-neutral energy system
- A fair system without energy poverty
- Financing the energy transition
- LAUNCH
- Successful neighbourhood approach: motivate residents
- Towards a reliable, affordable and fair energy system
- Towards CO2 neutral industry
- Reducing CO2 emissions through capture, use and storage
- SEWGS: revolutionary CO2-reduction technology and blue hydrogen production
- STEPWISE and FReSMe: CO2 reduction solutions for the steel industry
- 3D-printing for CO2 capture productivity increase
- Multi-partner ALIGN-CCUS project
- CEMCAP
- Reduce emissions steel industry
- CO₂ capture with AVR
- On-site CO₂ Capture Services: reducing emissions cost effectively
- SEDMES: Efficient technology to convert CO2 to useful product
- Hydrogen for a sustainable energy supply
- Optimising production hydrogen
- Hydrogen storage and transport
- Hydrogen, fuel and feedstock
- H-vision: blue hydrogen to accelerate carbon-low industry
- 15 things you need to know about hydrogen
- World first: Green hydrogen production in the North Sea
- New research centre for hydrogen production
- Identifying the future international chain of green hydrogen
- Opportunities for green hydrogen for the manufacturing industry investigated
- Hydrogen from offshore wind: optimising the electricity grid
- Faraday lab: optimising and scaling up electrolysis
- Blue hydrogen paves the way for green hydrogen
- Biomass to fuels and feedstock
- ARBAHEAT - Sustainable future for coal-fired power stations possible through conversion to biomass
- AMBITION Advanced biofuel production from lignin rich residues
- BECOOL EU Brazilian cooperation on advanced biofuels
- Horti-BlueC - a new EU cooperation on reducing Bio-waste and CO2-footprint in horticulture
- UNRAVEL - valorization of lignocellulosic biomass
- MacroFuels advanced biofuels from seaweed
- BRISK2 Biofuel Research Infrastructure for Sharing Knowledge
- New facility for seaweed processing
- TORWASH technology successful for waste water treatment and recycling plastics
- Biofuels lab: Making transport more sustainable with biofuels
- Take-Off: Sustainable aviation fuels from CO2, water and green energy
- HEREWEAR: Circular textiles from locally-sourced bio-based materials
- Transition to e-fuels: a strategy for HIC Rotterdam
- Re-use of existing infrastructure to accelerate the energy transition
- Sustainable Industrial Heat System
- 4 pioneering routes to a CO2 neutral industry
- Research facility Industrial Electrification accelerates greening of Rotterdam port
- Mollier facility: innovating in industrial drying technology
- Research facility for negative CO2 emissions
- Carnot lab accelerates sustainable industrial heat management
- Using energy and raw materials efficiently in industry
- e-Missi0n MOOI: TNO supports Dow and Shell in electric cracking
- CO2 reduction requires improvement of industrial processes
- Making the industrial energy transition feasible and affordable
- Sustainable subsurface
- Geological Survey of the Netherlands
- Geological Survey of the Netherlands
- 100 years of geological mapping
- GeoTOP
- Sand, gravel and clay extraction
- GIS and other tools for interactive planning
- DINO, Data and Information of the Dutch Subsurface
- BRO: the Dutch Key Register of the Subsurface
- Sustainable use and management Flemish-Dutch subsurface
- Petroleum Geological Atlas of the Southern Permian Basin
- 3D Subsurface mapping of the Dutch offshore
- Geological Survey of the Netherlands across borders
- Towards an energy-producing environment
- Expertise
- Industry
- Roadmaps
- Flexible & Free-form Products
- Space & Scientific Instrumentation
- Semiconductor Equipment
- Smart Industry
- Expertise groups
- Buildings, Infrastructure & Maritime
- Roadmaps
- Safe and Sustainable Living Environment
- Infrastructure
- Sustainable buildings: towards an energy-producing built environment
- Building innovation
- Greenhouse design
- Digitisation in construction
- Smart megastructures
- Expertise groups
- Circular Economy & Environment
- Roadmaps
- Circular economy
- Environment & Climate
- Sustainable Chemical Industry
- Expertise groups
- Healthy Living
- Roadmaps
- Health Technology & Digital Health
- Biomedical Health
- Work
- Youth
- Expertise groups
- Traffic & Transport
- Roadmaps
- SMART and Safe Traffic and Transport
- Societal impact for accessibility and liveability
- Decision-making information based on facts for municipalities
- Making disruptive technologies practicable
- Accessible, healthy and vibrant cities
- CITYkeys – Performance evaluation framework for smart cities and projects
- Big data ecosystems: collaborating on data-controlled cities
- Knowledge mediator puts an end to bickering
- Intact – Climate resilient critical infrastructure
- Organising mobility
- Smart mobility and logistics
- Smart vehicles
- Smart Mobility Research Centre SMRC
- Sustainable Traffic and Transport
- Sustainable Mobility and Logistics
- Improving air quality by monitoring real-world emissions
- Emission factors for road traffic
- Measuring the emissions of powered two wheelers
- Emissions of particulate matter from diesel cars
- Random Cycle Generator
- EnViVer: model traffic flow and emissions
- Measuring real-world emissions with TNO’s Smart Emissions Measurement System (SEMS)
- Measuring the emissions of trucks and buses
- Reducing Greenhouse Gas Emissions in Commercial Road Transport
- Measuring the emissions of non-road mobile machinery
- Emission measures in practice
- The transition to CO2-neutral mobility in 2050
- Sustainable Vehicles
- Innovative technologies for zero-emission vehicles
- CO2 reduction by high-efficiency Flex Fuel technology with extremely low emissions
- Actual energy consumption and emissions
- Automotive Battery Research
- Making transport more sustainable by means of electric vehicles
- Energy Efficient Electric Bus E3Bus
- eCoMove
- How hydrogen can accelerate energy transition in the transport sector
- Green performance of ships
- Expertise groups
- Information & Communication Technology
- Roadmaps
- Fast open infrastructures
- Data sharing
- Trusted ICT
- Efficiency, effectiveness, quality and the costs of systems
- Expertise groups
- Strategic Analysis & Policy
- Expertise groups
- Strategic Business Analysis
- Strategy & Policy
- Orchestrating Innovation
- Tech Transfer
Dr. ir. Anne Fleur van Veenstra
- Policy Lab
- Data-driven policy
- Digital governance
- Public sector innovation
Send a question to Dr. ir. Anne Fleur van Veenstra
Your question has been sent.
Sorry! Something unexpected happened. Please try again later.