Rui Song

Rui Song

Research Associate
Fraunhofer IVI

Dr. rer. nat.
Technical University of Munich


About Me

I am a senior researcher at Fraunhofer IVI. I obtained my Ph.D. degree from Technical University of Munich (TUM) with highest distinction (summa cum laude), co-supervised by Prof. Alois Knoll and Prof. Andreas Festag. Before that, I was a software developer for autonomous driving at ZF R&D Center and IPG Automotive.

My research interests include deep learning, computer vision, cooperative intelligence and their applications in autonomous driving, transportation or robotics.

News

06/2025: Two papers were accepted at ICCV.
06/2025: I am happy to have been recognized as an outstanding reviewer for CVPR 2025.
06/2025: One papers was accepted at IROS.
05/2025: One workshop was accepted at ICCV 2025. Find more details here: 2nd DriveX.
04/2025: Two papers were accepted at IEEE IV.
04/2025: I have successfully defensed my PhD at TUM and was honored to graduate with highest distinction (summa cum laude)!
01/2025: One workshop was accepted at CVPR 2025. Find more details here: 1st DriveX.
11/2024: One workshop was accepted at IEEE IV 2025. Find more details here: DLIVA.
10/2024: I am happy to have been recognized as an outstanding reviewer for ACM MM 2024.
08/2024: One papers was accepted at ECCV Workshop. We won the 3rd Place in the ECCV Dataset Distillation Challenge.
03/2024: One papers was accepted at IEEE IV.
02/2024: Two papers were accepted at CVPR. CoHFF & TUMTraf-V2X
10/2023: One paper was accepted at IEEE Internet of Things Journal (IF=10.6).
09/2023: One paper was accepted at IEEE Transactions on Intelligent Vehicles (IF=8.2).
07/2023: One paper was accepted at Knowledge-based Systems (IF=8.8).
05/2023: One paper was accepted at ICRA-CoPerception.
04/2023: One paper was accepted at IJCNN.
03/2023: I open-sourced a repository for a PyTorch implementation of federated learning (FL), integrating various FL algorithms, models, and datasets.
02/2023: One paper was accepted at CVPR (Highlight).
02/2023: We released SensorTraffix, a SENSORIS-based software product for infrastructure communication, as part of the Fraunhofer IVI's assets, CONTACT.
05/2022: I had a live interview at the opening event for our 5G Innovation Lab in Ingolstadt.
05/2022: One paper was accepted at IEEE ITSC.
03/2022: One paper was accepted at IEEE VTC.
02/2022: I officially started my PhD at TUM Informatics-VI department.
12/2021: One paper was accepted at FISITA World Congress (Outstanding Paper Award).
02/2021: I joined Fraunhofer IVI as a researcher and served as the lead in the research project InFra

Selected Publications

Coda-4DGS Thumbnail

CoDa-4DGS: Dynamic Gaussian Splatting with Context and Deformation Awareness for Autonomous Driving

Rui Song*, Chenwei Liang*, Yan Xia, Walter Zimmer, Hu Cao, Holger Caesar, Andreas Festag, Alois Knoll

ICCV 2025

Project Page | Paper | Code

CoHFF Thumbnail

TrafficLoc: Localizing Traffic Surveillance Cameras in 3D Scenes

Yan Xia, Yunxiang Lu, Rui Song, Oussema Dhaouadi, João F. Henriques, Daniel Cremers

ICCV 2025

Project Page | Paper | Code

CoHFF Thumbnail

Collaborative Semantic Occupancy Prediction with Hybrid Feature Fusion in Connected Automated Vehicles

Rui Song, Chenwei Liang, Hu Cao, Zhiran Yan, Walter Zimmer, Markus Gross, Andreas Festag, Alois Knoll

CVPR 2024

Project Page | Paper | Code

CoHFF Thumbnail

TUMTraf V2X Cooperative Perception Dataset

Walter Zimmer, Gerhard Arya Wardana, Suren Sritharan, Xingcheng Zhou, Rui Song, Alois Knoll

CVPR 2024

Project Page | Paper | Data

Academic Activities

Workshop Co-organizer: 2nd DriveX in ICCV 2025, 1st DriveX in CVPR 2025, DLIVA in IEEE IV 2025, 5th DDIVA in IEEE IV 2024
Program Committee Member: 1st MEIS in ECCV 2024.
Conference Reviewer: CVPR, ICCV, ECCV, NeurIPS, ACM MM, AISTATS, IJCNN, IROS, IEEE IV, ITSC
Journal Reviewer: TNNLS, TCSVT, RA-L, Information Fusion, Neurocomputing
Outstanding Reviewer Award: CVPR 2025, ACM MM 2024

Research Projects

2021-2024: 5G Innovation Concept in Ingolstadt (5GoIng), funded by the German Federal Ministry for Digital and Transport (BMDV)
2021-2024: Ingolstadt Innovation Labotory (In2Lab), funded by Bavarian Ministry of Economic Affairs (StMWi), Regional Development and Energy
2021-2023: Artificial Intelligence in the Transportation System in Ingolstadt (KIVI), funded by the German Federal Ministry of Education and Research (BMBF)
2021-2023: Intelligent Infrastructure (Infra), funded by Bavarian Ministry of Economic Affairs (StMWi), Regional Development and Energy.
2018-2021: SetLevel4to5, funded by the German Federal Ministy for Economic Affairs and Energy (BMWi)
2017-2018: Intelligent Maneuver Automation – cooperative hazard avoidance in realtime (IMAGinE) funded by the German Federal Ministy for Economic Affairs and Energy (BMWi)
2017-2018: PEGASUS funded by the German the Federal Ministry for Economic Affairs and Energy (BMWi)

Hobbies

Snowboard: Certificated as level 3 instructor by DSLV (German Ski/Snowboard Instructor Association).
Marathon: PB 3h55; 5KM: PB 18.

© Copyright 2025 Rui Song