PDF(1718 KB)
Change-aware network for damaged roads based on bi-temporal remote sensing imageries
Lingling LI, Kun YANG, Wei WANG, Chuang DENG, Zhe DONG, Zhihong WU, Weier LUO
Journal of Tsinghua University(Science and Technology) ›› 2026, Vol. 66 ›› Issue (7) : 1455-1464.
PDF(1718 KB)
PDF(1718 KB)
Change-aware network for damaged roads based on bi-temporal remote sensing imageries
Objective: Change detection is highly sensitive to differential information in target features across multitemporal images and has been widely applied in various remote-sensing domains. It plays a crucial role in disaster emergency response and post-disaster damage assessment. However, most mainstream change detection methods are primarily designed for buildings, with limited applicability to roads. These methods struggle to capture the fine-grained and continuous change characteristics of roads. Furthermore, existing road detection approaches are predominantly single-temporal. Such approaches cannot perform end-to-end reconstruction of completely damaged or destroyed roads, which limits their performance in road damage detection. Moreover, publicly available datasets rarely include annotations for road damage information. The lack of specialized benchmark datasets for damaged roads therefore remains a challenge. To address these issues, this study developed a U-shaped bi-temporal transformer (U-BiFormer) for road damage change detection and constructed a bi-temporal damaged road (BTDR) dataset as a benchmark to validate the effectiveness of the proposed method. Methods: The proposed U-BiFormer consisted of three core modules: multiscale learning (MSL), residual transformer shortcut (RTS), and multilevel dense iteration decoding (MDID). MSL used the first three layers of ResNet-18 and a standard convolutional block to generate feature maps at four different scales. These multiscale feature maps enhanced and optimized the bi-temporal features, which were then fed into the RTS module. RTS consisted of two submodules: the Trans. block and the Res. block. The Trans. block modeled spatiotemporal global information within the bi-temporal features at different stages, containing high-level semantic information. The Res. block extracted difference maps that included low-level geographical localization information. By processing information at different hierarchical levels, RTS captured contextual dependencies at both long and short ranges, thereby improving performance. Instead of standard upsampling, MDID used dense blocks, which were particularly suitable for preserving road continuity. This module integrated feature maps from all preceding stages, enabling the fusion of coarse-grained and fine-grained features to support subsequent predictions. Finally, the proposed model employed separate prediction heads for the damage classification task and the change detection task. For damage classification, the class embedding vector was concatenated with semantic tokens to form new tokens, and the class embedding was then separated to predict the road damage level. For change detection, the reconstructed features were upsampled through several convolutional layers to generate the final visualization. Regarding the loss function, a combination of focal loss and Dice loss was used to achieve an optimal balance. Results: Experiments were conducted on the proposed BTDR dataset, including single-temporal road extraction experiments and bi-temporal change detection experiments. For the bi-temporal tasks, the results demonstrated that the proposed method performed well in damaged-category detection, with all evaluation metrics exceeding 82.00%. Furthermore, the method significantly outperformed mainstream models in the change detection task, achieving a mean intersection over union of 82.30%. In the single-temporal road detection task, the model also surpassed several mainstream road detection methods. Qualitative results visually confirmed the superiority of U-BiFormer. Conclusions: By constructing the specialized BTDR dataset and developing the U-BiFormer, this study achieves outstanding performance in road damage change detection and validates the effectiveness of each module. The proposed approach provides an efficient solution for rapid post-disaster response and reconstruction and offers significant engineering value.
bi-temporal remote sensing / vision transformer / damaged road dataset / change detection
| 1 |
|
| 2 |
STASOLLA M, PETIT S, WYARD C, et al. Urban sites change detection by means of Sentinel-1 and Sentinel-2 time series[C]// Proceedings of 2021 IEEE International Geoscience and Remote Sensing Symposium. Brussels, Belgium: IEEE, 2021: 1065-1068.
|
| 3 |
|
| 4 |
|
| 5 |
TOMOWSKI D, EHLERS M, KLONUS S. Colour and texture based change detection for urban disaster analysis [C]// Proceedings of 2011 Joint Urban Remote Sensing Event. Munich, Germany: IEEE, 2011: 329-332.
|
| 6 |
LÓPEZ-FANDIÑO J, GAREA A S, HERAS D B, et al. Stacked autoencoders for multiclass change detection in hyperspectral images [C]// Proceedings of 2018 IEEE International Geoscience and Remote Sensing Symposium. Valencia, Spain: IEEE, 2018: 1906-1909.
|
| 7 |
PAPADOMANOLAKI M, VERMA S, VAKALOPOULOU M, et al. Detecting urban changes with recurrent neural networks from multitemporal sentinel-2 data [C]// Proceedings of 2019 IEEE International Geoscience and Remote Sensing Symposium. Yokohama, Japan: IEEE, 2019: 214-217.
|
| 8 |
|
| 9 |
|
| 10 |
|
| 11 |
RONNEBERGER O, FISCHER P, BROX T. U-net: Convolutional networks for biomedical image segmentation [C]// Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention. Munich, Germany: Springer, 2015: 234-241.
|
| 12 |
ZHOU L C, ZHANG C, WU M. D-LinkNet: LinkNet with pretrained encoder and dilated convolution for high resolution satellite imagery road extraction [C]// Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. Salt Lake City, USA: IEEE, 2018: 192-1924.
|
| 13 |
CHEN J, MEI J, LI X, et al. TransUNet: Rethinking the U-Net architecture design for medical image segmentation through the lens of transformers[J/OL]. arXiv. (2021-02-08)[2025-07-23]. https://arxiv.org/abs/2102.04306.
|
| 14 |
NIA K R, MORI G. Building damage assessment using deep learning and ground-level image data [C]// Proceedings of the 2017 14th Conference on Computer and Robot Vision. Edmonton, Canada: IEEE, 2017: 95-102.
|
| 15 |
|
| 16 |
DAUDT R C, LE SAUX B, BOULCH A. Fully convolutional Siamese networks for change detection [C]// Proceedings of the 2018 25th IEEE International Conference on Image Processing. Athens, Greece: IEEE, 2018: 4063-4067.
|
| 17 |
|
| 18 |
BANDARA W G C, PATEL V M. A transformer-based Siamese network for change detection [C]// Proceedings of 2022 IEEE International Geoscience and Remote Sensing Symposium. Kuala Lumpur, Malaysia: IEEE, 2022: 207-210.
|
| 19 |
LONG J, SHELHAMER E, DARRELL T. Fully convolutional networks for semantic segmentation [C]// Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, USA: IEEE, 2015: 3431-3440.
|
| 20 |
HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition [C]// Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, USA: IEEE, 2016: 770-778.
|
| 21 |
|
| 22 |
LIU Z, LIN Y T, CAO Y, et al. Swin transformer: Hierarchical vision transformer using shifted windows [C]// Proceedings of 2021 IEEE/CVF International Conference on Computer Vision. Montreal, Canada: IEEE, 2021: 9992-10002.
|
| 23 |
|
| 24 |
VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need [C]// Proceedings of the 31st International Conference on Neural Information Processing Systems. Long Beach, USA: Curran Associates Inc., 2017: 6000-6010.
|
| 25 |
DOSOVITSKIY A, BEYER L, KOLESNIKOV A, et al. An image is worth 16×16 words: Transformers for image recognition at scale [C]// Proceedings of the 9th International Conference on Learning Representations. Vienna, Australia: OpenReview. net, 2021
|
| 26 |
|
| 27 |
YUAN L, LI Y X, SI Y, et al. Multi-objects change detection based on res-UNet [C]// Proceedings of 2021 IEEE International Geoscience and Remote Sensing Symposium. Brussels, Belgium: IEEE, 2021: 4364-4367.
|
| 28 |
|
| 29 |
YANG Y M, MEHRKANOON S. AA-TransUNet: Attention augmented TransUNet for nowcasting tasks [C]// Proceedings of 2022 International Joint Conference on Neural Networks. Padua, Italy: IEEE, 2022: 1-8.
|
| 30 |
HUANG G, LIU Z, VAN DER MAATEN L, et al. Densely connected convolutional networks [C]// Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, USA: IEEE, 2017: 2261-2269.
|
| 31 |
LIN T Y, GOYAL P, GIRSHICK R, et al. Focal loss for dense object detection [C]// Proceedings of 2017 IEEE International Conference on Computer Vision. Venice, Italy: IEEE, 2017: 2999-3007.
|
| 32 |
MILLETARI F, NAVAB N, AHMADI S A. V-Net: Fully convolutional neural networks for volumetric medical image segmentation [C]// Proceedings of the 2016 Fourth International Conference on 3D Vision. Stanford, USA: IEEE, 2016: 565-571.
|
| 33 |
|
| 34 |
|
| 35 |
|
/
| 〈 |
|
〉 |