Research Laboratory for AI and Autonomous Driving

In this laboratory, research focuses on autonomous vehicles, with an emphasis on environmental perception—particularly through the use of Artificial Intelligence.

Autonomous Research Vehicle – VW Passat

Technology and Research

The research vehicle uses the vehicle's existing internal actuators to control both longitudinal and lateral movement autonomously. For environmental sensing and modeling, the platform integrates both factory-installed sensors and additional advanced components:

  • Three roof-mounted LiDAR-Sensors for precise environmental perception
  • Six Cameras providing a 360° panoramic view
  • FLIR-Boson-Camera for thermal imaging, operating in the 8–14 µm wavelength range
  • ANavs-Multi-Sensor RTK-System with horizontal position accuracy of 1 cm
  • High-Performance Computing Unit, that processes sensor data and enables AI-supported driving strategies


Thanks to its innovative technology and extensive sensor suite, the vehicle is capable of demonstrating autonomous driving functions both on campus and on public roads. Research on this experimental platform is ongoing. We are continuously developing the vehicle’s autonomous capabilities and refining its perception systems

Image of a VW Passat with sensor setup on roof
Modellauto umbebaut auf autonomes fahren

Scaled Test Vehicles – 1:8 Model Cars

Technology and Research

In addition to the VW Passat as an autonomous test vehicle, we are also researching two 1:8 scale model cars that have been converted to fully autonomous driving mode and can be used both on a scaled indoor test field and outdoors. One aim of these test vehicles is to simulate the sensors and actuators of the VW Passat in miniature. The following sensors, among others, are installed for this purpose:

  • ZED2i stereo camera for recording RGB and depth images
  • Unitree L1 4D-LiDAR Sensor
  • Other sensors (2D LiDAR, ultrasonic sensors, IMUs)
  • ROS2 based System


These scaled test vehicles provide a safe and controlled test environment for experiments with experimental machine learning approaches. It also creates an accessible platform for student work.

Das Video wird Ihnen nicht angezeigt, da Sie nicht der Verwendung von Cookies zugestimmt haben.

Further information about the laboratory:

  • VW Passat test vehicle
  • 2 model cars (scale 1:8) for researching algorithms on a laboratory scale and the interaction of vehicles with each other
  • Simulation equipment: We are able to simulate various scenarios in different environments (AWSIM) in which vehicles learn to drive using AI (reinforcement learning)
  • Sensor components such as: 3 lidars, several cameras
  • Faro Orbis: Mobile SLAM laser scanner as a reference measurement system and for digitising the university environment
  • AI-capable workstations and access to NVIDIA DGX station
  • G117/118, G030

The content and learning objectives of the respective course can be found in the module handbooks of the respective degree programme. Documents and further information can be found on the ILIAS learning platform of Heilbronn University.

Bachelor 

Master ​

Students who are enthusiastic about autonomous driving, AI and sensor technology are also welcome to get involved in our laboratory. Whether as part of a project or thesis or as a member of our team - we welcome new ideas and committed contributors!

Many students have actively participated in these projects and gained valuable practical experience in the development of autonomous systems.

Work from the year 2024:

Seminar projects:

  • Creation of a PCD map for Autoware Core / Universe using a SLAM algorithm (completed)
  • Creation of Coloured Point Cloud Maps and 3D Meshes in Blender and Unity (ongoing)
  • Integration of Lucid Vision Triton HDR ADAS Camera in Autoware with Traffic Light Recognition (completed)
  • Integration of a thermal imaging camera into a ROS2 network for future use as a sensor for ADAS (completed)
  • Implementation of depth maps using a stereo vision system: The influence of variable base widths on the accuracy of depth detection (completed)


Bachelor-Theses:

  • Integration of AI-supported 3D object recognition and semantic segmentation by means of depth maps using stereoscopy with variable base width for application in the field of automated driving (completed)


Masters projects:

  •  Integration and VR visualisation of a multi-sensor perception module with Autoware (ongoing)
  • Autonomous 1:8-Car ROS2 integration and Depth-Camera Sensor Fusion for Obstacle Detection (ongoing)
  • Integration of Vehicle and Sensor Models in Autoware Core / Universe (ongoing)
  • Creation of a digital twin for the TechCampus of Heilbronn University in AWSIM (ongoing)
  • Development of a realistic 3D environment around the TechCampus in AWSIM/Unity (completed)

We look forward to exchanging ideas with interested parties from science and industry. If you are interested in working with us, please contact us!

You can also find more information in our virtual AI-Lab (in the ‘AI&Mobility’ building)

Contact