Cross-Modal Detection and Matching of Wood Logs: Object Linking Between RGB and Laser Range Data
2025 (English)Independent thesis Advanced level (degree of Master (Two Years)), 28 HE credits
Student thesis
Abstract [en]
The adoption of computer vision and machine learning in industrial settings offers significant potential for improving productivity and efficiency. One way to realize these benefits is through methods for connecting data across different sensing modalities. This thesis investigates the detection and cross-modal linking of individual wood log ends across RGB images and laser data. RGB images capture visual characteristics such as wood type and quality, while laser data provides volumetric measurements. By linking logs between these modalities, it becomes possible to extract a more complete and detailed description of each log, thereby supporting automated inventory and quality assessment.
To achieve this, two methods were proposed. The first involved using a pre-trained feature matching model to establish correspondences between the modalities, leveraging patterns and features common to both. The second method focused on calibrating the RGB cameras to align and map the RGB images onto the laser data. For this approach, a segmentation model was trained on various types of laser data to detect individual logs.
The results revealed that the pre-trained feature matching model lacked sufficient generalization to handle the cross-modal data used in this thesis. However, training the model on the cross-modality data could potentially enhance its performance. In contrast, the second method demonstrated strong potential, achieving an 86% success rate in linking individual logs, as evaluated on a test dataset with manually annotated ground truth.
Place, publisher, year, edition, pages
2025. , p. 70
Keywords [en]
Object Linking, Feature Matching, Cross-Modal Matching, Instance Projection Log Matching, RGB and Laser Data Linking
National Category
Computer Vision and Learning Systems
Identifiers
URN: urn:nbn:se:liu:diva-214522ISRN: LiTH-ISY-EX--25/5736--SEOAI: oai:DiVA.org:liu-214522DiVA, id: diva2:1966314
External cooperation
Mabema AB
Subject / course
Computer Vision Laboratory
Presentation
2025-05-28, Visionen, Stora konferensrummet, 15:15 (English)
Supervisors
Examiners
2025-06-162025-06-102025-06-16Bibliographically approved