Home | Behavioral | Applications | Datasets
Scene gaze | In-vehicle gaze | Distraction detection | Drowsiness detection | Action anticipation | Driver awareness | Self-driving | Papers with code
Click on each entry below to see additional information.
Liao et al., Human Observation-Inspired Trajectory Prediction for Autonomous Driving in Mixed-Autonomy Traffic Environments, ICRA, 2024 | paper | code
-
Dataset(s): NGSIM, HighD, MoCAD
@inproceedings{2024_ICRA_Liao, author = "Liao, Haicheng and Liu, Shangqian and Li, Yongkang and Li, Zhenning and Wang, Chengyue and Li, Yunjian and Li, Shengbo Eben and Xu, Chengzhong", booktitle = "2024 IEEE International Conference on Robotics and Automation (ICRA)", organization = "IEEE", pages = "14212--14219", title = "Human observation-inspired trajectory prediction for autonomous driving in mixed-autonomy traffic environments", year = "2024" }
Xu et al., Transition in Different Critical Situations: How Non-Driving Related Tasks Affect Drivers’ Physiological Response and Takeover Behavior After Partial Automation Silent Failures, Trans. ITS, 2024 | paper
-
Dataset(s): private
@article{2024_T-ITS_Xu_1, author = "Xu, Linli and Guo, Lie and Ge, Pingshu and Wang, Xu", journal = "IEEE Transactions on Intelligent Transportation Systems", publisher = "IEEE", title = "Transition in Different Critical Situations: How Non-Driving Related Tasks Affect Drivers’ Physiological Response and Takeover Behavior After Partial Automation Silent Failures", year = "2024" }
Zhu et al., Quantitative Estimation of Driver Cognitive Workload: A Dual-Stage Learning Approach, Trans. ITS, 2024 | paper
-
Dataset(s): private
@article{2024_T-ITS_Zhu, author = "Zhu, Jieyu and Lv, Chen and Ma, Yanli and Yang, Haohan and Zhang, Yaping", journal = "IEEE Transactions on Intelligent Transportation Systems", publisher = "IEEE", title = "Quantitative Estimation of Driver Cognitive Workload: A Dual-Stage Learning Approach", year = "2024" }
Angkan et al., Multimodal Brain–Computer Interface for In-Vehicle Driver Cognitive Load Measurement: Dataset and Baselines, Trans. ITS, 2024 | paper | code
-
Dataset(s): CL-Drive
@article{2024_T-ITS_Angkan, author = "Angkan, Prithila and Behinaein, Behnam and Mahmud, Zunayed and Bhatti, Anubhav and Rodenburg, Dirk and Hungler, Paul and Etemad, Ali", journal = "IEEE Transactions on Intelligent Transportation Systems", publisher = "IEEE", title = "Multimodal Brain--Computer Interface for In-Vehicle Driver Cognitive Load Measurement: Dataset and Baselines", year = "2024" }
Nair et al., Investigating Drivers’ Awareness of Pedestrians Using Virtual Reality towards Modeling the Impact of External Factors, IV, 2024 | paper
-
Dataset(s): private
@inproceedings{2024_IV_Nair, author = "Nair, Vinu Vijayakumaran and Rehmann, Markus and de la Rosa, Stephan and Curio, Crist{\'o}bal", booktitle = "2024 IEEE Intelligent Vehicles Symposium (IV)", organization = "IEEE", pages = "3001--3008", title = "Investigating Drivers’ Awareness of Pedestrians Using Virtual Reality towards Modeling the Impact of External Factors", year = "2024" }
Konrad et al., Safety Driver Attention on Autonomous Vehicle Operation Based on Head Pose and Vehicle Perception, IV, 2024 | paper
-
Dataset(s): private
@inproceedings{2024_IV_Konrad, author = "Konrad, Santiago Gerling and Berrio, Julie Stephany and Shan, Mao and Masson, Favio and Nebot, Eduardo and Worrall, Stewart", booktitle = "2024 IEEE Intelligent Vehicles Symposium (IV)", organization = "IEEE", pages = "1878--1885", title = "Safety Driver Attention on Autonomous Vehicle Operation Based on Head Pose and Vehicle Perception", year = "2024" }
Wang et al., Traffic Conflict Forecasting and Avoidance System Under Automated Driving System Disengagement: A Non-Intrusive Prototype Design, Trans. ITS, 2023 | paper
-
Dataset(s): private
@article{2023_T-ITS_Wang_1, author = "Wang, Song and Li, Zhixia and Hu, Jia and Xu, Jin and Jiang, Shang", journal = "IEEE Transactions on Intelligent Transportation Systems", publisher = "IEEE", title = "Traffic Conflict Forecasting and Avoidance System Under Automated Driving System Disengagement: A Non-Intrusive Prototype Design", year = "2023" }
Mishra et al., Sensing Accident-Prone Features in Urban Scenes for Proactive Driving and Accident Prevention, Trans. ITS, 2023 | paper
-
Dataset(s): private
@article{2023_T-ITS_Mishra, author = "Mishra, Sumit and Rajendran, Praveen Kumar and Vecchietti, Luiz Felipe and Har, Dongsoo", journal = "IEEE Transactions on Intelligent Transportation Systems", number = "9", pages = "9401--9414", publisher = "IEEE", title = "Sensing accident-prone features in urban scenes for proactive driving and accident prevention", volume = "24", year = "2023" }
Denk et al., Design of an Experiment to Pinpoint Cognitive Failure Processes in the Interaction of Motorists and Vulnerable Road Users, IV, 2023 | paper
-
Dataset(s): private
@inproceedings{2023_IV_Denk, author = {Denk, Florian and Fr{\"o}hling, Felix and Brunner, Pascal and Huber, Werner and Margreiter, Martin and Bogenberger, Klaus and Kates, Ronald}, booktitle = "2023 IEEE Intelligent Vehicles Symposium (IV)", organization = "IEEE", pages = "1--8", title = "Design of an experiment to pinpoint cognitive failure processes in the interaction of motorists and vulnerable road users", year = "2023" }
Dahl et al., Intention-Aware Lane Keeping Assist Using Driver Gaze Information, IV, 2023 | paper
-
Dataset(s): private
@inproceedings{2023_IV_Dahl, author = "Dahl, John and de Campos, Gabriel Rodrigues and Fredriksson, Jonas", booktitle = "2023 IEEE Intelligent Vehicles Symposium (IV)", organization = "IEEE", pages = "1--7", title = "Intention-Aware Lane Keeping Assist Using Driver Gaze Information", year = "2023" }
Nambata et al., Human-like Guidance with Gaze Estimation and Classification-based Text Generation, ITSC, 2023 | paper
-
Dataset(s): private
@inproceedings{2023_ITSC_Nambata, author = "Nambata, Masaki and Shimomura, Kota and Hirakawa, Tsubasa and Yamashita, Takayoshi and Fujiyoshi, Hironobu", booktitle = "2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC)", organization = "IEEE", pages = "3122--3128", title = "Human-like Guidance with Gaze Estimation and Classification-based Text Generation", year = "2023" }
Li et al., Human-like Evaluation of Visual Perception System for Autonomous Vehicles based on Human Visual Attention, ITSC, 2023 | paper
-
Dataset(s): private
@inproceedings{2023_ITSC_Li, author = "Li, Chenhao and Wang, Yijin and Li, Kuang and Fan, Qianhui and Shen, Yu and Ji, Yuxiong", booktitle = "2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC)", organization = "IEEE", pages = "5555--5560", title = "Human-Like Evaluation of Visual Perception System for Autonomous Vehicles Based on Human Visual Attention", year = "2023" }
Heidari et al., Multi-Depth Cross-Calibration of Gaze Tracker and LiDAR Systems, ITSC, 2023 | paper
-
Dataset(s): private
@inproceedings{2023_ITSC_Heidari, author = "Heidari, Farzan and Dalirani, Farhad and Rahman, Taufiq and Cheema, Daniel Singh and Bauer, Michael A", booktitle = "2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC)", organization = "IEEE", pages = "1699--1705", title = "Multi-Depth Cross-Calibration of Gaze Tracker and LiDAR Systems", year = "2023" }
Zhou et al., Using Eye-Tracking Data to Predict Situation Awareness in Real Time During Takeover Transitions in Conditionally Automated Driving, Trans. ITS, 2021 | paper | code
-
Dataset(s): private
@article{2022_T-ITS_Zhou, author = "Zhou, Feng and Yang, X Jessie and de Winter, Joost CF", journal = "IEEE Transactions on Intelligent Transportation Systems", number = "3", pages = "2284--2295", publisher = "IEEE", title = "Using eye-tracking data to predict situation awareness in real time during takeover transitions in conditionally automated driving", volume = "23", year = "2021" }
Wu et al., Toward an Adaptive Situational Awareness Support System for Urban Driving, IV, 2022 | paper
-
Dataset(s): private
@inproceedings{2022_IV_Wu, author = "Wu, Tong and Sachdeva, Enna and Akash, Kumar and Wu, Xingwei and Misu, Teruhisa and Ortiz, Jorge", booktitle = "2022 IEEE Intelligent Vehicles Symposium (IV)", organization = "IEEE", pages = "1073--1080", title = "Toward an Adaptive Situational Awareness Support System for Urban Driving", year = "2022" }
Ahlstrom et al., Towards a Context-Dependent Multi-Buffer Driver Distraction Detection Algorithm, Trans. ITS, 2021 | paper
-
Dataset(s): private
@article{2021_T-ITS_Ahlstrom, author = {Ahlstr{\"o}m, Christer and Georgoulas, George and Kircher, Katja}, journal = "IEEE Transactions on Intelligent Transportation Systems", title = "Towards a Context-Dependent Multi-Buffer Driver Distraction Detection Algorithm", year = "2021" }
Aftab et al., Multimodal Fusion Using Deep Learning Applied to Driver’s Referencing of Outside-Vehicle Objects, IV, 2021 | paper
-
Dataset(s): private
@inproceedings{2021_IV_Aftab, author = "Aftab, Abdul Rafey and Von Der Beeck, Michael and Rohrhirsch, Steven and Diotte, Benoit and Feld, Michael", booktitle = "2021 IEEE Intelligent Vehicles Symposium (IV)", organization = "IEEE", pages = "1108--1115", title = "Multimodal Fusion Using Deep Learning Applied to Driver's Referencing of Outside-Vehicle Objects", year = "2021" }
Zhu et al., Improving Driver Situation Awareness Prediction using Human Visual Sensory and Memory Mechanism, IROS, 2021 | paper
-
Dataset(s): private
@inproceedings{2021_IROS_Zhu, author = "Zhu, Haibei and Misu, Teruhisa and Martin, Sujitha and Wu, Xingwei and Akash, Kumar", booktitle = "2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)", organization = "IEEE", pages = "6210--6216", title = "Improving driver situation awareness prediction using human visual sensory and memory mechanism", year = "2021" }
Kim et al., Toward Real-Time Estimation of Driver Situation Awareness: An Eye-tracking Approach based on Moving Objects of Interest, IV, 2020 | paper
-
Dataset(s): private
@inproceedings{2020_IV_Kim, author = "Kim, Hyungil and Martin, Sujitha and Tawari, Ashish and Misu, Teruhisa and Gabbard, Joseph L", booktitle = "IV", title = "Toward Real-Time Estimation of Driver Situation Awareness: An Eye-tracking Approach based on Moving Objects of Interest", year = "2020" }
Yang et al., A Dual-Cameras-Based Driver Gaze Mapping System With an Application on Non-Driving Activities Monitoring, Trans. ITS, 2019 | paper
-
Dataset(s): private
@article{2019_T-ITS_Yang, author = "Yang, Lichao and Dong, Kuo and Dmitruk, Arkadiusz Jan and Brighton, James and Zhao, Yifan", journal = "IEEE Transactions on Intelligent Transportation Systems", number = "10", pages = "4318--4327", title = "A dual-cameras-based driver gaze mapping system with an application on non-driving activities monitoring", volume = "21", year = "2019" }
Gillmeier et al., Prediction of ego vehicle trajectories based on driver intention and environmental context, IV, 2019 | paper
-
Dataset(s): private
@inproceedings{2019_IV_Gillmeier, author = "Gillmeier, Katharina and Diederichs, Frederik and Spath, Dieter", booktitle = "IV", title = "Prediction of ego vehicle trajectories based on driver intention and environmental context", year = "2019" }
Ma et al., GazeFCW: Filter Collision Warning Triggers by Detecting Driver’s Gaze Area, Workshop on Machine Learning on Edge in Sensor Systems, 2019 | paper
-
Dataset(s): private
@inproceedings{2019_ACM_Ma, author = "Ma, Yinan and Wu, Jing and Long, Chengnian", booktitle = "SenSys-ML", title = "GazeFCW: Filter Collision Warning Triggers by Detecting Driver's Gaze Area", year = "2019" }
Tran et al., A Human-Vehicle Collaborative Driving Framework for Driver Assistance, Trans. ITS, 2018 | paper
-
Dataset(s): private
@article{2018_T-ITS_Tran, author = "Tran, Duy and Du, Jianhao and Sheng, Weihua and Osipychev, Denis and Sun, Yuge and Bai, He", journal = "IEEE Transactions on Intelligent Transportation Systems", number = "9", pages = "3470--3485", title = "A human-vehicle collaborative driving framework for driver assistance", volume = "20", year = "2018" }
Martin et al., Object of Fixation Estimation by Joint Analysis of Gaze and Object Dynamics, IV, 2018 | paper
-
Dataset(s): private
@inproceedings{2018_IV_Martin, author = "Martin, Sujitha and Tawari, Ashish", booktitle = "IV", title = "Object of fixation estimation by joint analysis of gaze and object dynamics", year = "2018" }
Schwehr et al., Multi-Hypothesis Multi-Model Driver’s Gaze Target Tracking, ITSC, 2018 | paper
-
Dataset(s): private
@inproceedings{2018_ITSC_Schwehr, author = "Schwehr, Julian and Willert, Volker", booktitle = "ITSC", title = "Multi-hypothesis multi-model driver's gaze target tracking", year = "2018" }
Zabihi et al., Detection and Recognition of Traffic Signs Inside the Attentional Visual Field of Drivers, IV, 2017 | paper
-
Dataset(s): private
@inproceedings{2017_IV_Zabihi, author = "Zabihi, Sayed Jamal and Zabihi, SM and Beauchemin, Steven S and Bauer, Michael A", booktitle = "IV", title = "Detection and recognition of traffic signs inside the attentional visual field of drivers", year = "2017" }
Schwehr et al., Driver’s Gaze Prediction in Dynamic Automotive Scenes, ITSC, 2017 | paper
-
Dataset(s): private
@inproceedings{2017_ITSC_Schwehr, author = "Schwehr, Julian and Willert, Volker", booktitle = "ITSC", title = "Driver's gaze prediction in dynamic automotive scenes", year = "2017" }
Roth et al., Driver and Pedestrian Awareness-based Collision Risk Analysis, IV, 2016 | paper
-
Dataset(s): private
@inproceedings{2016_IV_Roth, author = "Roth, Markus and Flohr, Fabian and Gavrila, Dariu M", booktitle = "IV", title = "Driver and pedestrian awareness-based collision risk analysis", year = "2016" }
Langner et al., Traffic Awareness Driver Assistance based on Stereovision, Eye-tracking, and Head-Up Display, ICRA, 2016 | paper
-
Dataset(s): private
@inproceedings{2016_ICRA_Langner, author = "Langner, Tobias and Seifert, Daniel and Fischer, Bennet and Goehring, Daniel and Ganjineh, Tinosch and Rojas, Ra{\'u}l", booktitle = "ICRA", title = "Traffic awareness driver assistance based on stereovision, eye-tracking, and head-up display", year = "2016" }
Diederichs et al., Driver Intention Algorithm for Pedestrian Protection and Automated Emergency Braking Systems, ITSC, 2015 | paper
-
Dataset(s): private
@inproceedings{2015_ITSC_Diederichs, author = {Diederichs, Frederik and Sch{\"u}ttke, Tobias and Spath, Dieter}, booktitle = "ITSC", title = "Driver intention algorithm for pedestrian protection and automated emergency braking systems", year = "2015" }
Zabihi et al., Frame-Rate Vehicle Detection within the Attentional Visual Area of Drivers, IV, 2014 | paper
-
Dataset(s): private
@inproceedings{2014_IV_Zabihi, author = "Zabihi, SM and Beauchemin, Steven S and De Medeiros, EAM and Bauer, Michael A", booktitle = "IV", title = "Frame-rate vehicle detection within the attentional visual area of drivers", year = "2014" }
Kowsari et al., Multi-Depth Cross-Calibration of Remote Eye Gaze Trackers and Stereoscopic Scene Systems, IV, 2014 | paper
-
Dataset(s): private
@inproceedings{2014_IV_Kowsari, author = "Kowsari, Taha and Beauchemin, Steven S and Bauer, Michael A and Laurendeau, Denis and Teasdale, Normand", booktitle = "IV", title = "Multi-depth cross-calibration of remote eye gaze trackers and stereoscopic scene systems", year = "2014" }
Doman et al., Estimation of Traffic Sign Visibility Considering Local and Global Features in a Driving Environment, IV, 2014 | paper
-
Dataset(s): private
@inproceedings{2014_IV_Doman, author = "Doman, Keisuke and Deguchi, Daisuke and Takahashi, Tomokazu and Mekada, Yoshito and Ide, Ichiro and Murase, Hiroshi and Sakai, Utsushi", booktitle = "IV", title = "Estimation of traffic sign visibility considering local and global features in a driving environment", year = "2014" }
Tawari et al., Attention Estimation By Simultaneous Analysis of Viewer and View, ITSC, 2014 | paper
-
Dataset(s): private
@inproceedings{2014_ITSC_Tawari_1, author = "Tawari, Ashish and M{\o}gelmose, Andreas and Martin, Sujitha and Moeslund, Thomas B and Trivedi, Mohan M", booktitle = "ITSC", title = "Attention estimation by simultaneous analysis of viewer and view", year = "2014" }
Tanishige et al., Prediction of Driver’s Pedestrian Detectability by Image Processing Adaptive to Visual Fields of View, ITSC, 2014 | paper
-
Dataset(s): private
@inproceedings{2014_ITSC_Tanishige, author = "Tanishige, Ryunosuke and Deguchi, Daisuke and Doman, Keisuke and Mekada, Yoshito and Ide, Ichiro and Murase, Hiroshi", booktitle = "ITSC", title = "Prediction of driver's pedestrian detectability by image processing adaptive to visual fields of view", year = "2014" }
Rezaei et al., Look at the Driver, Look at the Road: No Distraction! No Accident!, CVPR, 2014 | paper
-
Dataset(s): private
@inproceedings{2014_CVPR_Rezaei, author = "Rezaei, Mahdi and Klette, Reinhard", booktitle = "CVPR", title = "{Look at the driver, look at the road: No distraction! No accident!}", year = "2014" }
Bar et al., Seen and Missed Traffic Objects: A Traffic Object-Specific Awareness Estimation, IV, 2013 | paper
-
Dataset(s): private
@inproceedings{2013_IV_Bar, author = {B{\"a}r, Tobias and Linke, Denys and Nienh{\"u}ser, Dennis and Z{\"o}llner, J Marius}, booktitle = "IV", title = "Seen and missed traffic objects: A traffic object-specific awareness estimation", year = "2013" }
George et al., DAARIA: Driver Assistance by Augmented Reality for Intelligent Automobile, IV, 2012 | paper
-
Dataset(s): private
@inproceedings{2012_IV_George, author = "George, Paul and Thouvenin, Indira and Fremont, Vincent and Cherfaoui, V{\'e}ronique", booktitle = "IV", title = "DAARIA: Driver assistance by augmented reality for intelligent automobile", year = "2012" }
Engel et al., Detectability Prediction in Dynamic Scenes for Enhanced Environment Perception, IV, 2012 | paper
-
Dataset(s): private
@inproceedings{2012_IV_Engel, author = "Engel, David and Curio, Crist{\'o}bal", booktitle = "IV", title = "Detectability prediction in dynamic scenes for enhanced environment perception", year = "2012" }
Mori et al., Measuring Driver Awareness Based on Correlation Between Gaze Behavior and Risks of Surrounding Vehicles, ITSC, 2012 | paper
-
Dataset(s): private
@inproceedings{2012_ITSC_Mori, author = "Mori, Masataka and Miyajima, Chiyomi and Angkititrakul, Pongtep and Hirayama, Takatsugu and Li, Yiyang and Kitaoka, Norihide and Takeda, Kazuya", booktitle = "ITSC", title = "Measuring driver awareness based on correlation between gaze behavior and risks of surrounding vehicles", year = "2012" }
Doman et al., Estimation of Traffic Sign Visibility Considering Temporal Environmental Changes for Smart Driver Assistance, IV, 2011 | paper
-
Dataset(s): private
@inproceedings{2011_IV_Doman, author = "Doman, Keisuke and Deguchi, Daisuke and Takahashi, Tomokazu and Mekada, Yoshito and Ide, Ichiro and Murase, Hiroshi and Tamatsu, Yukimasa", booktitle = "IV", title = "Estimation of traffic sign visibility considering temporal environmental changes for smart driver assistance", year = "2011" }
Doman et al., Estimation of Traffic Sign Visibility Toward Smart Driver Assistance, IV, 2010 | paper
-
Dataset(s): private
@inproceedings{2010_IV_Doman, author = "Doman, Keisuke and Deguchi, Daisuke and Takahashi, Tomokazu and Mekada, Yoshito and Ide, Ichiro and Murase, Hiroshi and Tamatsu, Yukimasa", booktitle = "IV", title = "Estimation of traffic sign visibility toward smart driver assistance", year = "2010" }
Doshi et al., Attention Estimation by Simultaneous Observation of Viewer and View, CVPRW, 2010 | paper
-
Dataset(s): private
@inproceedings{2010_CVPRW_Doshi, author = "Doshi, Anup and Trivedi, Mohan M", booktitle = "CVPRW", title = "Attention estimation by simultaneous observation of viewer and view", year = "2010" }