Prediction the yield of green crops based on monitoring morphometric

M. A. Astapova ; M. Yu. Uzdyaev ; V. M. Kondratyev

News of the Kabardin-Balkar scientific center of RAS, Tome 26 (2024) no. 3, pp. 11-20.

Résumé

Artificial intelligence (AI) and computer vision tools play an important role in automatically determining plant growth stages. The study aims to analyze modern technologies for automatic analysis and measurement of plant characteristics such as height, leaf area and other morphometric parameters. This article discusses the use of computer vision and neural networks for monitoring morphometric parameters and predicting the yield of green crops. An algorithm has been developed for determining the growth stage, which collects data about plants using a multispectral camera and then analyzes the obtained information using neural networks. Training for growth stage classification was performed on a subsample of the original dataset, consisting of 273 randomly selected images maintaining class balance (91 images in each class). The training sample size for each class is 45 images, and the test sample size is 46 images for each class. Classification of growth stage showed high results: more than 95 specimens; more than 93 (Precision, Recall, F1-score), the ResNet34 architecture performed best.

Détail

Keywords: technical vision, neural networks, yield prediction
Mots-clés : production automation

Bibliographie

[1] T. A. Shcherbina, “Digital transformation of agriculture in the Russian Federation: experience and prospects”, Russia: trends and development prospects, 2019, no. 14-1, 450–453 (In Russian) | MR

[2] C. Zhao, Y. Zhang, J. Du et al., “Crop phenomics: current status and perspectives”, Frontiers in Plant Science, 10 (2019), 714 | DOI

[3] R. Shukla, G. Dubey, P. Malik et al., “Detecting crop health using machine learning techniques in smart agriculture system”, Journal of Scientific Industrial Research, 80:08 (2021), 699–706

[4] D. Varshney, B. Babukhanwala, J. Khan et al., “Plant disease detection using machine learning techniques”, 2022 3rd International Conference for Emerging Technology (INCET), IEEE, 2022, 1–5

[5] Y. Jiang, C. Li, “Convolutional neural networks for image-based high-throughput plant phenotyping: a review”, Plant Phenomics, 2020 | DOI | MR

[6] N. D. Adhikari, I. Simko, B. Mou, “Phenomic and physiological analysis of salinity effects on lettuce”, Sensors, 19:21 (2019), 4814 | DOI

[7] I. Simko, R. J. Hayes, R. T. Furbank, “Non-destructive phenotyping of lettuce plants in early stages of development with optical sensors”, Frontiers in plant science, 7 (2016), 1985 | DOI

[8] C. M. Grahn, C. Benedict, T. Thornton, C. Miles, “Production of baby-leaf salad greens in the spring and fall seasons of northwest Washington”, HortScience, 50:10 (2015), 1467–1471 | DOI

[9] Y. Wen, L. Zha, W. Liu, “Dynamic responses of ascorbate pool and metabolism in lettuce to light intensity at night time under continuous light provided by red and blue LEDs”, Plants, 10:2 (2021), 214 | DOI

[10] J. G.A. Barbedo, “Detection of nutrition deficiencies in plants using proximal images and machine learning: A review”, Computers and Electronics in Agriculture, 162 (2019), 482–492 | DOI

[11] D. H. Jung, S. H. Park, X. Z. Han, H. J. Kim, “Image processing methods for measurement of lettuce fresh weight”, Journal of Biosystems Engineering, 40:1 (2015), 89–93 | DOI

[12] Z. Lin, R. Fu, G. Ren et al., “Automatic monitoring of lettuce fresh weight by multi-modal fusion based deep learning”, Frontiers in Plant Science, 13 (2022), 980581 | DOI

[13] M. Wang, X. Guo, “Extracting the height of lettuce by using neural networks of image recognition in deep learning”, ESS Open Archive, 2022 | DOI

[14] M. S. Gang, H. J. Kim, D. W. Kim, “Estimation of greenhouse lettuce growth indices based on a two-stage CNN using RGB-D images”, Sensors, 22:15 (2022), 5499 | DOI

[15] J. Y. Lu, C. L. Chang, Y. F. Kuo, “Monitoring growth rate of lettuce using deep convolutional neural networks”, 2019 ASABE Annual International Meeting. American Society of Agricultural and Biological Engineers, 2019, 1 | DOI

[16] A. Mokhtar, W. El-Ssawy, H. He et al., “Using machine learning models to predict hydroponically grown lettuce yield”, Frontiers in Plant Science, 13 (2022), 706042 | DOI

[17] C. Martinez-Nolasco, J. A. Padilla-Medina, J. J.M. Nolasco et al., “Non-Invasive monitoring of the thermal and morphometric characteristics of lettuce grown in an aeroponic system through multispectral image system”, Applied Sciences, 12:13 (2022), 6540 | DOI

[18] Y. Zhang, M. Wu, J. Li et al., “Automatic non-destructive multiple lettuce traits prediction based on DeepLabV3+”, Journal of Food Measurement and Characterization, 17:1 (2023), 636–652 | DOI

[19] Wada K., Image polygonal annotation with Python, Labelme, 2016 https://github.com/labelmeai/labelme

[20] K. Simonyan, A. Zisserman, Very deep convolutional networks for large-scale image recognition, 2014, arXiv: 1409.1556 | DOI

[21] K. He, X. Zhang, S. Ren, J. Sun, “Deep residual learning for image recognition”, Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, 770–778

[22] M. Tan, Q. Le, “Efficient net: Rethinking model scaling for convolutional neural networks”, International conference on machine learning, PMLR, 2019, 6105–6114 | MR

[23] V. Kumar, H. Arora, J. Sisodia, “Resnet-based approach for detection and classification of plant leaf diseases”, 2020 International conference on electronics and sustainable communication systems (ICESC), IEEE, 2020, 495–502 | DOI

[24] G. N. Elwirehardja, J. S. Prayoga, “Oil palm fresh fruit bunch ripeness classification on mobile devices using deep learning approaches”, Computers and Electronics in Agriculture, 188 (2021), 106359 | DOI

[25] J. Wang, H. Zhang, W. Zhou, “Apple automatic classification method based on improved VGG11”, Third International Conference on Computer Vision and Pattern Analysis (ICCPA 2023), Proc. SPIE, 12754, 2023, 473–478