COMPARISON OF POTENTIAL ROAD ACCIDENT DETECTION ALGORITHMS FOR MODERN MACHINE VISION SYSTEM
DOI:
https://doi.org/10.17770/etr2023vol3.7299Keywords:
Machine learning, machine vision, object detection, road accidents, CNNAbstract
Nowadays the robotics is relevant development industry. Robots are becoming more sophisticated, and this requires more sophisticated technologies. One of them is robot vision. This is needed for robots which communicate with the environment using vision instead of a batch of sensors. These data are utilized to analyze the situation at hand and develop a real-time action plan for the given scenario. This article explores the most suitable algorithm for detecting potential road accidents, specifically focusing on the scenario of turning left across one or more oncoming lanes. The selection of the optimal algorithm is based on a comparative analysis of evaluation and testing results, including metrics such as maximum frames per second for video processing during detection using robot’s hardware. The study categorises potential accidents into two classes: danger and not-danger. The Yolov7 and Detectron2 algorithms are compared, and the article aims to create simple models with the potential for future refinement. Also, this article provides conclusions and recommendations regarding the practical implementation of the proposed models and algorithm.
Downloads
References
S. S. Thomas, S. Gupta and V. K. Subramanian, "Event Detection on Roads Using Perceptual Video Summarization," in IEEE Transactions on Intelligent Transportation Systems, vol. 19, no. 9, pp. 2944-2954, Sept. 2018, doi: 10.1109/TITS.2017.2769719.
W. -J. Chang, L. -B. Chen and K. -Y. Su, "DeepCrash: A Deep Learning-Based Internet of Vehicles System for Head-On and Single-Vehicle Accident Detection With Emergency Notification," in IEEE Access, vol. 7, pp. 148163-148175, 2019, doi: 10.1109/ACCESS.2019.2946468.
H. Hayashi, M. Kamezaki and S. Sugano, "Toward Health–Related Accident Prevention: Symptom Detection and Intervention Based on Driver Monitoring and Verbal Interaction," in IEEE Open Journal of Intelligent Transportation Systems, vol. 2, pp. 240-253, 2021, doi: 10.1109/OJITS.2021.3102125.
Q. Xie, X. Hu, L. Ren, L. Qi and Z. Sun, "A Binocular Vision Application in IoT: Realtime Trustworthy Road Condition Detection System in Passable Area," in IEEE Transactions on Industrial Informatics, vol. 19, no. 1, pp. 973-983, Jan. 2023, doi: 10.1109/TII.2022.3145858.
P. Teixeira, S. Sargento, P. Rito, M. Luís and F. Castro, "A Sensing, Communication and Computing Approach for Vulnerable Road Users Safety," in IEEE Access, vol. 11, pp. 4914-4930, 2023, doi: 10.1109/ACCESS.2023.3235863.
X. Mo, C. Sun, C. Zhang, J. Tian and Z. Shao, "Research on Expressway Traffic Event Detection at Night Based on Mask-SpyNet," in IEEE Access, vol. 10, pp. 69053-69062, 2022, doi: 10.1109/ACCESS.2022.3178714.
Q. Zhang, X. Chang and S. B. Bian, "Vehicle-Damage-Detection Segmentation Algorithm Based on Improved Mask RCNN," in IEEE Access, vol. 8, pp. 6997-7004, 2020, doi: 10.1109/ACCESS.2020.2964055.
A. Němcová et al., "Multimodal Features for Detection of Driver Stress and Fatigue: Review," in IEEE Transactions on Intelligent Transportation Systems, vol. 22, no. 6, pp. 3214-3233, June 2021, doi: 10.1109/TITS.2020.2977762.
A. Arsenov, I. Ruban, K. Smelyakov and A. Chupryna, “Evolution of convolutional neural network architectursae in image classification problems”, Selected Papers of the XVIII International Scientific and Practical Conference “Information Technologies and Security” (ITS 2018), Kyiv, Ukraine, November 27, 2018. In CEUR Workshop Proceedings, Vol-2318, 2018, pp. 35-45. https://ceur-ws.org/Vol-2318/
L. Hu, J. Ou, J. Huang, Y. Chen and D. Cao, "A Review of Research on Traffic Conflicts Based on Intelligent Vehicles," in IEEE Access, vol. 8, pp. 24471-24483, 2020, doi: 10.1109/ACCESS.2020.2970164.
K. Smelyakov, P. Dmitry, M. Vitalii and C. Anastasiya, "Investigation of network infrastructure control parameters for effective intellectual analysis," 2018 14th International Conference on Advanced Trends in Radioelecrtronics, Telecommunications and Computer Engineering (TCSET), Lviv-Slavske, Ukraine, 2018, pp. 983-986, doi: 10.1109/TCSET.2018.8336359.
J. Barnett et al., "Automated Vehicles Sharing the Road: Surveying Detection and Localization of Pedalcyclists," in IEEE Transactions on Intelligent Vehicles, vol. 6, no. 4, pp. 649-664, Dec. 2021, doi: 10.1109/TIV.2020.3046859.
H. Fan and H. Zhu, "Separation of Vehicle Detection Area Using Fourier Descriptor Under Internet of Things Monitoring," in IEEE Access, vol. 6, pp. 47600-47609, 2018, doi: 10.1109/ACCESS.2018.2865209.
J. E. Espinosa, S. A. Velastín and J. W. Branch, "Detection of Motorcycles in Urban Traffic Using Video Analysis: A Review," in IEEE Transactions on Intelligent Transportation Systems, vol. 22, no. 10, pp. 6115-6130, Oct. 2021, doi: 10.1109/TITS.2020.2997084.
J. Barnett et al., "Automated Vehicles Sharing the Road: Surveying Detection and Localization of Pedalcyclists," in IEEE Transactions on Intelligent Vehicles, vol. 6, no. 4, pp. 649-664, Dec. 2021, doi: 10.1109/TIV.2020.3046859.
F. Guede-Fernández, M. Fernández-Chimeno, J. Ramos-Castro and M. A. García-González, "Driver Drowsiness Detection Based on Respiratory Signal Analysis," in IEEE Access, vol. 7, pp. 81826-81838, 2019, doi: 10.1109/ACCESS.2019.2924481.
T. Horberry et al., "Human-Centered Design for an In-Vehicle Truck Driver Fatigue and Distraction Warning System," in IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 6, pp. 5350-5359, June 2022, doi: 10.1109/TITS.2021.3053096.
S. Nakashima, H. Arimura, M. Yamamoto, S. Mu and H. Lu, "Improving the Accuracy of Road Surface Distinction Based on Reflection Intensity Variations Using Ultrasonic Sensor," in IEEE Sensors Journal, vol. 22, no. 18, pp. 17399-17405, 15 Sept.15, 2022, doi: 10.1109/JSEN.2020.3033015.
X. Liu, H. Cai, R. Zhong, W. Sun and J. Chen, "Learning Traffic as Images for Incident Detection Using Convolutional Neural Networks," in IEEE Access, vol. 8, pp. 7916-7924, 2020, doi: 10.1109/ACCESS.2020.2964644.
C. M. Travieso-González, J. B. Alonso-Hernández, J. M. Canino-Rodríguez, S. T. Pérez-Suárez, D. D. L. C. Sánchez-Rodríguez and A. G. Ravelo-García, "Robust Detection of Fatigue Parameters Based on Infrared Information," in IEEE Access, vol. 9, pp. 18209-18221, 2021, doi: 10.1109/ACCESS.2021.3052770.
S. Aoki, K. Sezaki, N. J. Yuan and X. Xie, "BusBeat: Early Event Detection with Real-Time Bus GPS Trajectories," in IEEE Transactions on Big Data, vol. 7, no. 2, pp. 371-382, 1 June 2021, doi: 10.1109/TBDATA.2018.2872532.
C. Yang, X. Wang and S. Mao, "Unsupervised Drowsy Driving Detection With RFID," in IEEE Transactions on Vehicular Technology, vol. 69, no. 8, pp. 8151-8163, Aug. 2020, doi: 10.1109/TVT.2020.2995835.
C.-Y. Wang, A. Bochkovskiy, and H.-Y. M. Liao, “Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors,” arXiv.org, 06-Jul-2022. [Online]. URL: https://arxiv.org/abs/2207.02696. [Accessed: 14-Feb-2023].
S. Ren, K. He, R. Girshick, and J. Sun, “Faster R-CNN: Towards real-time object detection with region proposal networks,” arXiv.org, 06-Jan-2016. [Online]. URL: https://arxiv.org/abs/1506.01497. [Accessed: 14-Feb-2023].
O. Byzkrovnyi, “Roboflow,” Roboflow Dataset. [Online]. URL: https://app.roboflow.com/ds/polJ55iQ4a?key=zYXz2EmCeK. [Accessed: 14-Feb-2023].
BeamNG.drive. [Online]. URL: https://www.beamng.com/game/. [Accessed: 14-Feb-2023]
“Google colaboratory,” Google Colab. Detectron2. [Online]. URL: https://colab.research.google.com/drive/1vTh-bC31puePqn68K8lY41eyCAm5DrUt?usp=share_link. [Accessed: 14-Feb-2023].
“Google Colab. Yolov7,” Google Colab. [Online]. URL: https://colab.research.google.com/drive/1kaVsuWK6DfXykeae1PazYH0Yw-ZVzZ-l?usp=share_link. [Accessed: 14-Feb-2023].
