THE POTENTIAL OF VARIOUS ARTIFICIAL INTELLIGENCE METHODS APPLICATION IN THE PROBLEM OF DRAWING RECOGNITION AND 2D 3D TRANSFORMATION
DOI:
https://doi.org/10.28925/2663-4023.2022.17.2130Keywords:
2D; 3D; recognition; Artificial Intelligence; artificial neural networks; drawing; two-dimensional models; convolutional neural network; CNN; three-dimensional models.Abstract
The article analyzes the main methods of artificial intelligence in the task of recognizing drawings and transforming a 2D model into a 3D model. With the rapid development of information technologies, and especially in the pursuit of the most realistic reproduction of the project of the future product/house and other objects in digital form, the question of recognizing drawings and transforming a 2D model into a 3D model is very acute. As the number and complexity of tasks arising from the digitization of existing paper-based drawing and technical documentation grows, and the parallel need to transform two-dimensional models into three-dimensional models for visualization in three-dimensional space of complex objects, researchers have drawn attention to the possibilities of applying technologies and systems of artificial intelligence in the processes of drawing recognition and transformation of two-dimensional models into three-dimensional models. The first studies devoted to the application of artificial intelligence in the tasks of recognizing images on drawings began to appear in the early 90s of the 20th century. The analysis of approaches to the recognition of drawings allows us to consider the potential of using different methods of artificial intelligence in the task of recognizing drawings and transforming two-dimensional models into three-dimensional models. To analyze the potential of improving the work of CNN, as well as its architecture, without resorting to extensive expansion of the convolutional neural network (CNN) architecture, as well as taking into account the need to solve the task related to the logical vectorization of primitives and/or conditional graphics recognized by means of a convolutional neural network markings on drawings to perform 2D to 3D transformation. In the future, this stimulates researchers to look for alternative methods and models for image recognition systems on drawings.
Downloads
References
Spitz, A. L., Dengel, A. (1995). Document Analysis Systems. У Proceedings of the International Association for Pattern Recognition Workshop. WORLD SCIENTIFIC. https://doi.org/10.1142/9789812797933
Pasternak, B. (1994). Processing Imprecise and Structural Distorted Line Drawings by and Adaptable Drawing Interpretation Kernel. In IAPR Workshop on Document Analysis Systems (pp. 349–363).
Messmer, B. T., Bunke, H. (1996). Automatic learning and recognition of graphical symbols in engineering drawings. In Graphics Recognition Methods and Applications (с. 123–134). Springer Berlin Heidelberg. https://doi.org/10.1007/3-540-61226-2_11
Castellano, G., Vessio, G. (2021). Deep learning approaches to pattern extraction and recognition in paintings and drawings: an overview. Neural Comput & Applic, 33, 12263–12282. https://doi.org/10.1007/s00521-021-05893-z.
Poprotska, D. I. (2020). Information system of drawing recognition. In Status, achievements and prospects of information systems and technologies (p. 166–168). Odessa national Acad. food. technologies, NNI computer. of systems and technologies "Industry 4.0" named after P. M. Platonova, Fac. computer. engineering, programming and cyber defense.
Kovalchuk, S., Mazurets, O. V. (2008). Analyzing the effectiveness of technology use Seo, J., Park, H., Choo, S. (2020). Inference of Drawing Elements and Space Usage on Architectural Drawings Using Semantic Segmentation. Applied Sciences, 10(20), 7347. https://doi.org/10.3390/app10207347.
Shaaban, A. M., Salem, N. M., Al-atabany, W. I. (2020) A Semantic-based Scene segmentation using convolutional neural networks. AEU - International Journal of Electronics and Communications, 125. https://doi.org/10.1016/j.aeue.2020.153364.
Fonseca, M. J., Jorge, J. A. (б. д.). Using fuzzy logic to recognize geometric shapes interactively. In Ninth IEEE International Conference on Fuzzy Systems. FUZZ-IEEE 2000. Soft Computing in the Information Age. IEEE. https://doi.org/10.1109/fuzzy.2000.838674.
Adamik, M., Goga, J., Pavlovicova, J., Babinec, A., Sekaj, I. (2022). Fast robotic pencil drawing based on image evolution by means of genetic algorithm. Robotics and Autonomous Systems, 148, 103912. https://doi.org/10.1016/j.robot.2021.103912.
Wang, Z., Latif, M. (2007). Reconstruction of 3D Solid Models Using Fuzzy Logic Recognition. Lecture Notes in Engineering and Computer Science, 2165.
Jin, B., Xu, S., Geng, W. (2018). Learning to sketch human facial portraits using personal styles by case-based reasoning. Multimed Tools Appl, 77, 5417–5441. https://doi.org/10.1007/s11042-017-4457-8
Wang, Z., Tsumura, K., Saito, Y. (1994). Recognition of Hand-written Mechanical Drawing by Multi-Level Neural Network (MLNN). Advancement of Intelligent Production, Elsevier, 1-6. https://doi.org/10.1016/B978-0-444-81901-7.50015-3.
Kubyk, O., Mazurets, O., Kovalchuk, S. (2008). Decompositional recognition of symbolic information from drawings using artificial intelligence technologies. Mathematical and computer modeling. Series: Technical sciences, 109-119.
Zehtaban, L., Elazhary, O., Roller, D. (2016). A framework for similarity recognition of CAD models. Journal of Computational Design and Engineering, 3(3), 274-285. https://doi.org/10.1016/j.jcde.2016.04.002.
Wang, Z., Latif, M. (2007). Reconstruction of 3D Solid Models Using Fuzzy Logic Recognition. Proceedings of the World Congress on Engineering, 1, 37-42.
Governi, L., Furferi, R., Palai, M., Volpe, Y. (2013). 3D Geometry Reconstruction from Orthographic Views: a Method Based on 3D Image Processing and Data Fit-ting. Computers in Industry, 64, 1290-1300.
Nagendra, I.V., Gujar, U.G. (1988). 3D Objects from 2D orthographic views – A Survey. Computer & Graphics, 12(1), 111 – 114.