Internship | Vision-language object-attribute characterization

Your task is to research how vision-language models (VL) can learn new attributes that are re-usable for related concepts. The goal is that if we learn a new token for a stripe on a car, it can generalize to a stripe on other vehicles. This advances the prompt learning methods to attributes. This is challenging because (a) attributes are very localized within the image and (b) the relation with the concept should be maintained. Your role is to explore how these challenges can be solved.

You will perform this assignment in the Intelligent Imaging department. TNO’s Intelligent Imaging group is specialized in computer vision, image processing, image enhancement, image analysis, visual pattern recognition, artificial intelligence and deep learning. This young, passionate, creative and committed group (of approximately 50 people) works with partners on technological breakthroughs for innovations in important societal and economic themes, developing knowledge in various research areas including both AI (e.g. learning with less data or hybrid AI) as well as crucial non-AI knowledge, real-time algorithms, edge processing and information fusion.

Keywords to describe this project include: vision-language models, concepts with attributes, zero-shot.

You are in the final stages of your master’s degree in artificial intelligence, computer science, physics, mathematics, electrical engineering, or a similar degree, you have experience in programming (e.g. Python ) and experience with deep learning and computer vision, and knowledge about vision-language models, is required.

The project duration is flexible, but preferably within the range of 6 to 12 months. Please mention in your application whether you are looking for an internship or a graduation project, the preferred length of your project and your desired starting date. When doing an internship/graduation project at TNO you will receive an appropriate internship fee.

You want to work on the precursor of your career; a work placement gives you an opportunity to take a good look at your prospective future employer. TNO goes a step further. It’s not just looking that interests us; you and your knowledge are essential to our innovation. That’s why we attach a great deal of value to your personal and professional development. You will, of course, be properly supervised during your work placement and be given the scope for you to get the best out of yourself. Naturally, we provide suitable work placement compensation.

At TNO, we innovate for a healthier, safer and more sustainable life. And for a strong economy. Since 1932, we have been making knowledge and technology available for the common good. We find each other in wonder and ingenuity. We are driven to push boundaries. There is all the space and support for your talent and ambition. You work with people who will challenge you: who inspire you and want to learn from you. Our state-of-the-art facilities are there to realize your vision. What you do at TNO matters: impact makes the difference. Because with every innovation you contribute to tomorrow’s world. Read more about TNO as an employer.

At TNO we encourage an inclusive work environment, where you can be yourself. Whatever your story and whatever unique qualities you bring to the table. It is by combining our unique strengths and perspectives that we are able to develop innovations that make a real difference in society. Want to know more? Read what steps we are taking in the area of diversity and inclusion.

After the first CV selection, the application process will be conducted by the concerning department. TNO will provide a suitable internship agreement. If you have any questions about this vacancy, you can contact the contact person mentioned below.

For this internship vacancy it is required that the AIVD issues a security clearance (VGB) after conducting a security screening. Take into account that this process may take about 8 weeks. If you have been abroad for more than 6 consecutive months, or if you do not have the Dutch nationality, it may take longer. Read more about security screening on the AIVD website.

Students must reside in the Netherlands before the start and also throughout the internship or graduation project at TNO.