(50-2) 11 * << * >> * Русский * English * Содержание * Все выпуски

Approach to the formation and analysis of a complex model based on weakly formalized heterogeneous data
S.G. Nebaba1, R.V. Meshcheryakov2, A.A. Zakharova2

1National Research Tomsk Polytechnic University, Lenina Avenue 30, Tomsk, 634050, Russia;
2V.A. Trapeznikov Institute of Control Sciences of RAS, Profsoyuznaya St. 65, Moscow, 117997, Russia

  Полный текст (PDF)

DOI: 10.18287/COJ1668

ID статьи: 1668

Abstract:
In the current study, a general approach to the formation of a storage model and development of tools for representation of multidimensional heterogeneous data that would allow real-time operation with these data, is proposed. This approach is based on the previously formulated requirements for models of representing multidimensional heterogeneous data. A functional diagram for combining heterogeneous multidimensional data and adding them to an existing data model has been created. The advantages of data analysis using such model compared to working with disparate data are discussed. Development of the tool for integrating heterogeneous data in the context of solving the problem of combining aerial photography data obtained from unmanned aerial vehicles is shown. The fundamental possibility of combining aerial photography data from different spectrums, as well as using derived data such as object detection results as an additional layer of heterogeneous data within the general model, is demonstrated.

Keywords:
unmanned aerial vehicle, data representation model, heterogeneous data, image fusion, object detection, object classification.

Citation:
Nebaba SG, Meshcheryakov RV, Zakharova AA. Approach to the formation and analysis of a complex model based on weakly formalized heterogeneous data. Computer Optics 2026; 50(2): 1668. DOI: 10.18287/COJ1668.

References:

  1. Klemenkov PA, Kuznetsov SD. Big data: modern approaches to storage and analysis [In Russian]. Proceedings of the Institute for System Programming of the RAS 2012; 23: 143-158. DOI: 10.15514/ISPRAS-2012-23-9.
  2. Averchenkov V, Budylskii D, Podvesovskii A, Averchenkov A, Rytov M, Yakimov A. Hierarchical deep learning: A promising technique for opinion monitoring and sentiment analysis in Russian-language social networks. Creativity in Intelligent Technologies and Data Science. Commun Comput Inf Sci 2015; 535: 583-592. DOI: 10.1007/978-3-319-23766-4_46.
  3. Pang Z, Hu R, Zhu W, Zhu R, Liao Y, Han X. A building extraction method for high-resolution remote sensing images with multiple attentions and parallel encoders combining enhanced spectral information. Sensors 2024; 24(3): 1006. DOI: 10.3390/s24031006.
  4. Rashinkar P, Krushnasamy VS. An overview of data fusion techniques. 2017 Int Conf on Innovative Mechanisms for Industry Applications (ICIMIA) 2017: 694-697. DOI: 10.1109/ICIMIA.2017.7975553.
  5. Istomin EP, Kolbina ON, Stepanov SYu, Sidorenko AYu. Analysis of models and systems for processing heterogeneous data for use in applied GIS [In Russian]. Scientific Bulletin 2015; 4: 53-62. DOI: 10.17117/nv.2015.04.053.
  6. Vizilter YuV, Zheltov SYu. Problems of technical vision in modern aviation systems [In Russian]. Mechanics, Control and Informatics 2011; 6: 11-44.
  7. Nebaba SG, Zakharova AA. Algorithms for obtaining, integrating and processing weakly formalized heterogeneous aerial photography data. Appl Inform 2024; 19(2): 67-82. DOI: 10.37791/2687-0649-2024-19-2-67-82.
  8. Starnes DS, Yates D, Moore DS. The practice of statistics. 4th ed. New York: W.H. Freeman; 2010. ISBN: 1-46410-873-0.
  9. Tassov KL. Methods of image pre-processing in the vehicle identification system Innovation [In Russian]. Bulletin of MSTU named after N.E. Bauman 2012; 1(1): 200-212.
  10. Titkov VV, Panin SV, Eremin AV, Lyubutin PS. Algorithm for digital image preprocessing in assessing material deformation using digital image correlation method [In Russian]. Proceedings of International Conference on Advanced Materials with Hierarchical Structure for New Technologies and Reliable Designs 2018: 508-509. DOI: 10.17223/9785946217408/327.
  11. Shklyar AV, Zakharova AA, Vekhter EV. Visualization in data reconstruction tasks. Sci Vis 2024; 16(1): 64-81. DOI: 10.26583/sv.16.1.06.
  12. Rosbag2. 2025. Source: https://ternaris.gitlab.io/rosbags/topics/rosbag2.html.
  13. Tregub AV, Tregub IV. Methodology for constructing an ARIMA model for forecasting the dynamics of time series [In Russian]. Forestry Bulletin 2011; 5: 179-183.
  14. Tisetsky AT, Kovalev DI, Mansurova TP. Review of methods for segmentation and detection of objects in an image in real time to prevent emergency situations of Russian Railways. Modern Innovations, Systems and Technologies 2022; 2(3): 101-116. DOI: 10.47813/2782-2818-2022-2-3-0101-0116.
  15. LeCun Y, Boser B, Denker JS, Henderson D, Howard RE, Hubbard W, Jackel LD. Backpropagation applied to handwritten zip code recognition. Neural Comput 1989; 1(4): 541-551. DOI: 10.1162/neco.1989.1.4.541.
  16. Girshick R, Donahue J, Darrell T, Malik J. Rich feature hierarchies for accurate object detection and semantic segmentation. 2014 IEEE Conf on Computer Vision and Pattern Recognition 2014: 580-587. DOI: 10.1109/CVPR.2014.81.
  17. He K, Gkioxari G, Dollar P, Girshick R. Mask R-CNN. 2017 IEEE Int Conf on Computer Vision (ICCV) 2017: 2980-2988. DOI: 10.1109/ICCV.2017.322.
  18. LeCun Y, Bottou L, Bengio Y, Haffner P. Gradient-based learning applied to document recognition. Proc IEEE 1998; 86(11): 2278-2324. DOI: 10.1109/5.726791.
  19. Wang A, Chen H, Liu L, Chen K, Lin Z, Han J, Ding G. YOLOv10: Real-time end-to-end object detection. arXiv preprint 2024. Source: https://arxiv.org/abs/2405.14458. DOI: 10.48550/arXiv.2405.14458.
  20. Jocher G, Qiu J. Ultralytics YOLO11. 2024. Source: https://github.com/ultralytics/ultralytics.
  21. OpenCV. Source: https://opencv.org/.
  22. Panda3D. Open Source Framework for 3D Rendering and Games. 2025. Source: https://www.panda3d.org/.
  23. Zhu P, Du D, Wen L, Bian X, Ling H, Hu Q, Peng T, Zheng J, Zhang Y, Bo L, Shi H, Zhu R, Dong B, Pailla D, Ni F, Gao G, Liu G, Xiong H, Liu Z. VisDrone-VID2019: The vision meets drone object detection in video challenge results. Technical Report. 2019. DOI: 10.13140/RG.2.2.34939.46882.
  24. PyTorch. Source: https://pytorch.org/.

Россия, 443001, Самара, ул. Молодогвардейская, 151; электронная почта: journal@computeroptics.ru; тел: +7 (846) 242-41-24 (ответственный секретарь), +7 (846) 332-56-22 (технический редактор), факс: +7 (846) 332-56-20