Internship | Zero-shot cross-view matching for robot localization
About this position
Robot localization can be hard when GPS is not available or reliable. The robot’s view can be used for localization, using cross-view matching against geo-referenced satellite/aerial images. Previous works have focused on learning a shared image representation, between ground-level images and satellite or aerial images at the same locations, from large datasets. But such models are highly dataset-specific and may not generalize to the current place which may be very different. The goal of this project is to match the views in a zero-shot fashion, by linking image contents of the different views. In previous works this was not possible, because the typical datasets have views that were recorded at different times, hence they have different objects at the same place. Here we aim to leverage that both views are recorded at the same time, e.g., by a robot accompanied by a drone, that both see the places having the same objects in them. The research question is how to associate the image contents for zero-shot cross-view matching.
What will be your role?
Your task is to research how image contents from various views (ground and aerial) can be associated. A first question is how to represent image contents and how to model relations between contents from two views. A second question is how these relations can be inferred from a new image in a zero-shot fashion. A third question is to select or curate a (subset of a) dataset for the research and the validation.
You will perform this assignment in the Intelligent Imaging department. TNO’s Intelligent Imaging group is specialized in computer vision, image processing, image enhancement, image analysis, visual pattern recognition, artificial intelligence and deep learning. This young, passionate, creative and committed group (of approximately 50 people) works with partners on technological breakthroughs for innovations in important societal and economic themes, developing knowledge in various research areas including both AI (e.g. learning with less data or hybrid AI) as well as crucial non-AI knowledge, real-time algorithms, edge processing and information fusion.
Keywords to describe this project include: robotics, robot localization, cross-view matching, aerial and ground.
What we expect from you
You are in the final stages of your master’s degree in artificial intelligence, robotics, computer science, physics, mathematics, electrical engineering, or a similar degree and you have experience in programming (e.g. Python), deep learning and computer vision.
The project duration is flexible, but preferably within the range of 6 to 12 months. Please mention in your application whether you are looking for an internship or a graduation project, the preferred length of your project and your desired starting date. When doing an internship/graduation project at TNO you will receive an appropriate internship fee.
What you'll get in return
You want to work on the precursor of your career; a work placement gives you an opportunity to take a good look at your prospective future employer. TNO goes a step further. It’s not just looking that interests us; you and your knowledge are essential to our innovation. That’s why we attach a great deal of value to your personal and professional development. You will, of course, be properly supervised during your work placement and be given the scope for you to get the best out of yourself. Naturally, we provide suitable work placement compensation.
TNO as an employer
At TNO, we innovate for a healthier, safer and more sustainable life. And for a strong economy. Since 1932, we have been making knowledge and technology available for the common good. We find each other in wonder and ingenuity. We are driven to push boundaries. There is all the space and support for your talent and ambition. You work with people who will challenge you: who inspire you and want to learn from you. Our state-of-the-art facilities are there to realize your vision. What you do at TNO matters: impact makes the difference. Because with every innovation you contribute to tomorrow’s world. Read more about TNO as an employer.
At TNO we encourage an inclusive work environment, where you can be yourself. Whatever your story and whatever unique qualities you bring to the table. It is by combining our unique strengths and perspectives that we are able to develop innovations that make a real difference in society. Want to know more? Read what steps we are taking in the area of diversity and inclusion.
The selection process
After the first CV selection, the application process will be conducted by the concerning department. TNO will provide a suitable internship agreement. If you have any questions about this vacancy, you can contact the contact person mentioned below.
For this internship vacancy it is required that the AIVD issues a security clearance (VGB) after conducting a security screening. Take into account that this process may take about 8 weeks. If you have been abroad for more than 6 consecutive months, or if you do not have the Dutch nationality, it may take longer. Read more about security screening on the AIVD website.
Students must reside in the Netherlands before the start and also throughout the internship or graduation project at TNO.
Has this job opening sparked your interest?
Then we’d like to hear from you! Please contact us for more information about the job or the selection process. To apply, please upload your CV and covering letter using the ‘apply now’ button.