COMBINED CONTOUR DETECTION AND POINT CLOUD OF RGB-DEPTH IMAGE FOR FOOD VOLUME ESTIMATION
DOI:
https://doi.org/10.36595/misi.v8i1.1408Keywords:
Food Volume Estimation, RGB Depth Image, Point Cloud, Food Volume, Contour DetectionAbstract
Assessing nutritional consumption entails a procedure that enables nutritionists and dietitians to track the eating habits of patients within healthcare settingsTraditionally, this measurement relies on manual observations by specialists utilizing visual analysis. However, this approach is prone to subjectivity due to the risk of expert fatigue, which can result in inaccuracies. Furthermore, the evaluations may differ among experts based on varying viewpoints. In a decision support system, a more objective analysis is necessary. Previous research has utilized the area captured in a food image to estimate the weight of food on a plate. Nonetheless, this technique still results in numerous prediction errors. To tackle this issue, we propose a novel method to calculate the volume of food from a camera image, which aims to provide a more accurate weight prediction. In this paper, we introduce a new approach that combines contour detection with a point cloud derived from RGB depth images to capture height information. The Root Mean Square Error (RMSE) for height prediction is 1.04 and 1.55 when viewed from the first and second sides, respectively, while the volume prediction reaches an RMSE of 45.08. This suggests that the differences between the predicted and actual values for volume and height are suitable for practical applications.
References
M. F. Vasiloglou et al., “The human factor in automated image-based nutrition apps: Analysis of common mistakes using the goFOOD lite app,” JMIR mHealth and uHealth, vol. 9, no. 1, p. e24467, 2021.
M. Riyazudin, M. A. Chaurasia, S. I. Ibaad, A. Lalani, and S. Fathima, “Estimation of quantity and nutritional information of food using image processing,” Contactless Healthcare Facilitation and Commodity Delivery Management During COVID 19 Pandemic, pp. 129–162, 2022.
C. Boushey, M. Spoden, F. Zhu, E. Delp, and D. Kerr, “New mobile methods for dietary assessment: review of image-assisted and image-based dietary assessment methods,” Proceedings of the Nutrition Society, vol. 76, no. 3, pp. 283–294, 2017.
K. V. Dalakleidi, M. Papadelli, I. Kapolos, and K. Papadimitriou, “Applying image-based food-recognition systems on dietary assessment: a systematic review,” Advances in Nutrition, vol. 13, no. 6, pp. 2590–2619, 2022.
A. B. Akhi, F. Akter, T. Khatun, and M. S. Uddin, “Recognition and classification of fast food images,” Global Journal of Computer Science and Technology, vol. 18, no. 1, pp. 7–13, 2018.
R. Kohila and R. Meenakumari, “Predicting calorific value for mixed food using image processing,” in 2017 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS), IEEE, 2017, pp. 1–4.
H. Li and G. Yang, “Dietary nutritional information autonomous perception method based on machine vision in smart homes,” Entropy, vol. 24, no. 7, p. 868, 2022.
H. Wang et al., “Nutritional composition analysis in food images: an innovative Swin Transformer approach,” Frontiers in Nutrition, vol. 11, p. 1454466, 2024.
Y. A. Sari, V. W. Saputra, A. Agustina, Y. A. Wani, and Y. G. Bihanda, “Comparison of image thresholding and clustering segmentation methods for understanding nutritional content of food images,” in Proceedings of the 5th International Conference on Sustainable Information Engineering and Technology, 2020, pp. 124–129.
Y. A. Sari, R. K. Dewi, J. M. Maligan, A. S. Ananta, and S. Adinugroho, “Automatic food leftover estimation in tray box using image segmentation,” in 2019 International Conference on Sustainable Information Engineering and Technology (SIET), IEEE, 2019, pp. 212–216.
S. Makhsous, H. M. Mohammad, J. M. Schenk, A. V. Mamishev, and A. R. Kristal, “A novel mobile structured light system in food 3D reconstruction and volume estimation,” Sensors, vol. 19, no. 3, p. 564, 2019.
Y. Lu et al., “goFOODTM: an artificial intelligence system for dietary assessment,” Sensors, vol. 20, no. 15, p. 4283, 2020.
F. P.-W. Lo, Y. Sun, J. Qiu, and B. Lo, “Food volume estimation based on deep learning view synthesis from a single depth map,” Nutrients, vol. 10, no. 12, p. 2005, 2018.
Intel® RealSenseTM Product Family D400 Series, “Intel Realsense Datasheet.” Apr. 13, 2022.
T. Carletti, D. Fanelli, and A. Guarino, “How to fairly share a watermelon,” Physics Education, vol. 56, no. 1, p. 015010, 2020.
Y. A. Sari, J. M. Maligan, and A. F. Prakoso, “Improving the elementary leftover food estimation algorithm by using clustering image segmentation in nutrition intake problem,” in 2020 International Conference on Computer Engineering, Network, and Intelligent Multimedia (CENIM), IEEE, 2020, pp. 435–439.
D. Wismarini and others, “Prediksi Proses Persalinan Menggunakan Algoritma Knn Berbobot Pada Monitoring Elektronik Personal Health Record Ibu Hamil,” Jurnal Manajemen Informatika Dan Sistem Informasi, vol. 5, no. 1, pp. 65–76, 2022.
R. Harun, K. C. Pelangi, and Y. Lasena, “Penerapan Data Mining untuk Menentukan Potensi Hujan Harian dengan Menggunakan Algoritma K Nearest Neighbor (KNN),” Jurnal Manajemen Informatika dan Sistem Informasi, vol. 3, no. 1, pp. 8–15, 2020.
Downloads
Additional Files
Published
How to Cite
Issue
Section
License
Semua tulisan pada jurnal ini menjadi tanggungjawab penuh penulis.
