Sub-pixel automatic detection of GCPs coordinates in time-lapse images using a Deep Learning keypoint network
Publikation: Beitrag in Fachzeitschrift › Forschungsartikel › Beigetragen › Begutachtung
Beitragende
Abstract
In this study, we present an approach to exploit the keypoint R-CNN network structure for automated detection of ground control points (GCPs) in images acquired by optical sensors. Our deep learning methodology employs fine-tuning on three distinct datasets, thereby enabling the specific addressing of inherent variations in GCP types, including shape, size, and colour. Our approach uses an end-to-end artificial intelligence (AI)-based approach that does not require any post-processing of the data or the use of specific GCPs. Performance metrics are evaluated to compare the AI results with manually labelled data, coordinates obtained by an ellipse fitting algorithm for circular targets, and a semi-automatic optical flow algorithm for arbitrary targets (e.g. crosses). The study highlights the importance of a dataset-specific fine-tuning and data augmentation strategy to enhance the model's accuracy in locating GCPs. The results demonstrate the effectiveness of the R-CNN keypoint approach in successfully identifying GCPs with sub-pixel accuracy compared to manual labelling in all datasets. Our AI-based approach outperformed semi-automatic methods based on computer vision algorithms, identifying GCPs in images taken under adverse conditions and in cases where GCPs were partially obscured. Furthermore, the results demonstrate robust performance in a transferability test, i.e., identifying GCPs in different images obtained at different locations and with different cameras than those used for training.
Details
Originalsprache | Englisch |
---|---|
Aufsatznummer | 5601714 |
Seitenumfang | 14 |
Fachzeitschrift | IEEE Transactions on Geoscience and Remote Sensing |
Jahrgang | 63 |
Publikationsstatus | Veröffentlicht - 11 Dez. 2024 |
Peer-Review-Status | Ja |
Externe IDs
ORCID | /0000-0003-2169-8762/work/180881679 |
---|
Schlagworte
Schlagwörter
- automatic detection, ground control point, mask R-CNN keypoint, photogrammetry, ResNet50