APPLICATION OF THE CONVOLUTIONAL NEURAL NETWORKS FOR THE SECURITY OF THE OBJECT RECOGNITION IN A VIDEO STREAM
DOI:
https://doi.org/10.28925/2663-4023.2020.8.97112Keywords:
Neural Networks; Rolling Networks; Security; Video Streaming; Mobile ApplicationsAbstract
The article is devoted to analyzing methods for recognizing images and finding them in the video stream. The evolution of the structure of convolutional neural networks used in the field of computer video flow diagnostics is analyzed. The performance of video flow diagnostics algorithms and car license plate recognition has been evaluated. The technique of recognizing the license plates of cars in the video stream of transport neural networks is described. The study focuses on the creation of a combined system that combines artificial intelligence and computer vision based on fuzzy logic. To solve the problem of license plate image recognition in the video stream of the transport system, a method of image recognition in a continuous video stream with its implementation based on the composition of traditional image processing methods and neural networks with convolutional and periodic layers is proposed. The structure and peculiarities of functioning of the intelligent distributed system of urban transport safety, which feature is the use of mobile devices connected to a single network, are described.
A practical implementation of a software application for recognizing car license plates by mobile devices on the Android operating system platform has been proposed and implemented. Various real-time vehicle license plate recognition scenarios have been developed and stored in a database for further analysis and use. The proposed application uses two different specialized neural networks: one for detecting objects in the video stream, the other for recognizing text from the selected image. Testing and analysis of software applications on the Android operating system platform for license plate recognition in real time confirmed the functionality of the proposed mathematical software and can be used to securely analyze the license plates of cars in the scanned video stream by comparing with license plates in the existing database. The authors have implemented the operation of the method of convolutional neural networks detection and recognition of license plates, personnel and critical situations in the video stream from cameras of mobile devices in real time. The possibility of its application in the field of safe identification of car license plates has been demonstrated.
Downloads
References
J. Carreira and C. Sminchisescu, "CPMC: Automatic Object Segmentation Using Constrained Parametric Min-Cuts," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 7, pp. 1312-1328, July 2012. DOI: 10.1109/TPAMI.2011.231 (in English).
P. Sermanet, K. Kavukcuoglu, S. Chintala, Y. LeCun, "Pedestrian detection with unsupervised multi-stage feature learning", Proc. IEEE Conf. Comput. Vis. Pattern Recog., pp. 3626-3633, 2013. DOI: 10.1109/CVPR.2013.465 (in English).
A. Krizhevsky, I. Sutskever, G. E. Hinton, “ImageNet classification with deep convolutional neural networks,” Neural Information Processing Systems. 25, 2012, pp. 1097-1105. DOI: 10.1145/3065386 (in English).
K. Simonyan, A. Zisserman, “Very Deep Convolutional Networks for Large–Scale Image Recognition,” CoRR, abs/1409.1556, 2014. DOI: 10.1.1.740.6937 (in English).
C. Szegedy et al., "Going deeper with convolutions," 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, 2015, pp. 1-9. DOI 10.1109/CVPR.2015.7298594 (in English).
He Kaiming, Z. Xiangyu, R. Shaoqing, “Deep Residual Learning for Image Recognition,” In Proceedings of IEEE conference on computer vision and pattern recognition, 2016, p. 770–778. DOI: 10.1109/CVPR.2016.90 (in English)
R. Girshick, J. Donahue, T. Darrell and J. Malik, "Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation," 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, 2014, pp. 580-587. DOI: 10.1109/CVPR.2014.81 (in English)
J.R.R. Uijlings, K.E.A. van de Sande, T. Gevers et al., “Selective Search for Object Recognition,” Int J Comput Vis 104, 2013, pp. 154–171. DOI: 10.1007/s11263-013-0620-5 (in English)
R. Girshick, J. Donahue, T. Darrell and J. Malik, "Region-Based Convolutional Networks for Accurate Object Detection and Segmentation," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 1, pp. 142-158, 1 Jan. 2016.. DOI: 10.1109/TPAMI.2015.2437384 (in English)
C. Chen, Q. Chen, Q. Huaqi, T. Giacomo, D. Jinming, B. Wenjia, R. Daniel, "Deep Learning for Cardiac Image Segmentation: A Review," Frontiers in Cardiovascular Medicine, V. 7, 2020, p. 25. DOI: 10.3389/fcvm.2020.00025
R. Girshick, "Fast R-CNN," 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, 2015, pp. 1440-1448. DOI: 10.1109/ICCV.2015.169. (in English)
S. Ren, K. He, R. Girshick and J. Sun, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 6, pp. 1137-1149, 1 June 2017. DOI: 10.1109/TPAMI.2016.2577031 (in English)
J. Redmon, S. Divvala, R. Girshick, A. Farhadi, “ You Only Look Once: Unified, Real-Time Object Detection,”The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 779-788. DOI: 10.1109/CVPR.2016.91 (in English)
W. Liu et al., “SSD: Single Shot MultiBox Detector,” In: Leibe B., Matas J., Sebe N., Welling M. (eds) Computer Vision – ECCV 2016. ECCV 2016. Lecture Notes in Computer Science, vol 9905. Springer, Cham, 2016. DOI: 10.1007/978-3-319-46448-0_2 (in English)
T.-Yi Lin, M. MaireSerge, B. James, H. Pietro, P. Deva, R. Piotr, C. Dollár, L. Zitnick,. “Microsoft COCO: Common Objects in Context.” European Conference on Computer Vision. ECCV, Computer Vision – ECCV, 2014, pp. 740-755. DOI:10.1007/978-3-319-10602-1_48 (in English)
