Internship | Deep Learning for real-time situational awareness on the edge

The Intelligent Imaging group at TNO is researching and developing methods to increase situational awareness of operators and robots in many areas, by leveraging state-of-the-art, real-time edge deep learning and computer vision technologies. To perform situational awareness with high precision on larger areas, high-resolution images or videos are required. For many applications, it is required that all the processing is done locally on the edge device. Usually, these edge devices such as security cameras or robots have restrictions on their Size, Weight and Power (SWaP). Our situational awareness pipelines contain multiple computer vision and deep learning algorithms that are computationally expensive. Deploying such pipelines and processing high-resolution data in real-time while keeping the latency low and high throughput poses a huge challenge on SWaP-restricted edge devices.

Your research will aim to improve a situational awareness pipeline by reducing the latency, increasing the throughput, or one of the other many challenges of such a real-time edge-processing pipeline for situational awareness.

Depending or your interests the assignment could either be more hardware or be more algorithm oriented. A hardware focused assignment could for example be improving the utilization of all heterogenous accelerators on these embedded systems. An algorithm focused assignment could be to reduce the computation and memory usage of the (computer vision) components or deep learning models by exploiting efficient deep learning techniques.

You can get the freedom to choose one of the challenges and directions, or come up with your own challenges in this area. With your work, you will contribute to real-world applications as well. The improvements in (real-time) situational awareness are very important for Search and Rescue applications, for example in drowning detection from a drone at the sea coast where we are currently working on.

You will perform this assignment in the Department of Intelligent Imaging. TNO’s Intelligent Imaging group is specialized in image processing, image enhancement, image analysis, visual pattern recognition, artificial intelligence and deep learning. This young, passionate, creative and committed group (50 people) works with partners on technological breakthroughs for innovations in important societal and economic themes, developing knowledge in various research areas including both AI (e.g. learning with less data or hybrid AI) as well as crucial non-AI knowledge, real-time algorithms, edge processing and information fusion.

You are in the final stages of your master’s degree in artificial intelligence, computer science, mathematics, electrical engineering, robotics, systems and control engineering, physics or a similar degree. You have some experience in computer vision, artificial intelligence and deep learning, and programming in Python. Next to technical expertise, we value communication skills, a results-driven attitude, and that you are motivated to publish your work.

The project is for a period of 6 to 12 months, during which you will have the ability to work from home as well as from our office and you will receive an appropriate internship fee. Please mention in your application letter whether you are looking for a graduation project or an internship, your preferred start date and your preferred duration of the project.

Keywords here are: Deep Learning, Machine Learning, AI, Computer Vision, Image Classification, Object Detection, Object Segmentation, Video Object detection, Tracking PyTorch, PyTorch Lightning, TensorFlow, Keras.

You want to work on the precursor of your career; a work placement gives you an opportunity to take a good look at your prospective future employer. TNO goes a step further. It’s not just looking that interests us; you and your knowledge are essential to our innovation. That’s why we attach a great deal of value to your personal and professional development. You will, of course, be properly supervised during your work placement and be given the scope for you to get the best out of yourself. Naturally, we provide suitable work placement compensation.

At TNO, we innovate for a healthier, safer and more sustainable life. And for a strong economy. Since 1932, we have been making knowledge and technology available for the common good. We find each other in wonder and ingenuity. We are driven to push boundaries. There is all the space and support for your talent and ambition. You work with people who will challenge you: who inspire you and want to learn from you. Our state-of-the-art facilities are there to realize your vision. What you do at TNO matters: impact makes the difference. Because with every innovation you contribute to tomorrow’s world. Read more about TNO as an employer.

At TNO we encourage an inclusive work environment, where you can be yourself. Whatever your story and whatever unique qualities you bring to the table. It is by combining our unique strengths and perspectives that we are able to develop innovations that make a real difference in society. Want to know more? Read what steps we are taking in the area of diversity and inclusion.

After the first CV selection, the application process will be conducted by the concerning department. TNO will provide a suitable internship agreement. If you have any questions about this vacancy, you can contact the contact person mentioned below.

For this internship vacancy it is required that the AIVD issues a security clearance (VGB) after conducting a security screening. Take into account that this process may take about 8 weeks. If you have been abroad for more than 6 consecutive months, or if you do not have the Dutch nationality, it may take longer. Read more about security screening on the AIVD website.