Construction progress updating method based on BIM and large language models

Xinxiang JIN, Xiao LIN, Xinru YU, Hongling GUO

Journal of Tsinghua University(Science and Technology) ›› 2025, Vol. 65 ›› Issue (1) : 35-44.

PDF(13468 KB)
PDF(13468 KB)
Journal of Tsinghua University(Science and Technology) ›› 2025, Vol. 65 ›› Issue (1) : 35-44. DOI: 10.16511/j.cnki.qhdxxb.2025.22.006
Special Section: Construction Management

Construction progress updating method based on BIM and large language models

Author information +
History +

Abstract

Objective: Progress management is an important part of construction management, which helps effectively reduce the risk of project delay. Its main objective is to monitor the actual construction progress and compare it with the construction plan. The traditional method of progress updating relies on manual checking and recording, which not only lags behind but also is prone to recording errors. Following the development of building information modeling (BIM), technologies such as the internet of things (IoT), point clouds, and visual images have been gradually applied to construction progress identification and plan comparison. However, these methods require the introduction of additional acquisition equipment, and point cloud acquisition equipment is costly. In addition, image processing is easily affected by factors such as occlusion, light, and weather. Therefore, the present study proposes a construction progress updating method based on BIM and large language models (LLMs). This approach enables construction personnel to verbally report progress information to the LLM, allowing a three-dimensional (3-D) building model to be accordingly updated. Methods: This research develops a system that automatically extracts relevant information from natural language, which identifies the corresponding component using the planned construction time in the component database and visualizes the progress status of the 3-D building model in Blender. The system does not require detailed information such as precise component IDs but completes the progress update by recognizing fuzzy information (e.g., construction section, floor, and other relevant information). Specifically, this study first parses the industry foundation classes (IFC) format BIM file and construction schedule to extract and correlate the component IDs, location information, and scheduled construction time. It then constructs a database of building components. Subsequently, the LLM is enhanced through prompt engineering so that it can generate accurate information query instructions based on natural language inputs, retrieve component information from the database, assess the progress status, and generate corresponding model update instructions to achieve dynamic updates in Blender. Results: This study tested the accuracy and consistency of the proposed method using a BIM model with 716 components and a dataset of 200 progress reports in various natural language formats. The testing results showed that after prompt fine-tuning, the LLM-based method achieved an average accuracy of 96% in progress assessment and model updating and 62.5% improvement over the non-fine-tuned model. The consistency reached 87% or an increase of 68% over the non-fine-tuned model, demonstrating the effectiveness and feasibility of this method for construction progress updating. Conclusions: This study has successfully combined BIM and LLMs to develop a construction progress updating method, including the construction of component retrieval database and schedule updating process based on LLMs. The case studies show that the method effectively improves the accuracy and consistency of the LLM in generating progress update instructions without providing additional equipment and significant computing costs. The method allows construction personnel to describe progress information in natural language and achieves accurate progress updating of the 3-D model of a building, which meets the demand for visualizing and updating progress information on construction sites. However, this study suffers from certain limitations. Due to the use of prompt fine-tuning for the LLM, consistency remains a challenge. Future work is expected to improve the model's accuracy and consistency by training a local model.

Key words

construction progress / progress updating / large language model / building information modeling (BIM)

Cite this article

Download Citations
Xinxiang JIN , Xiao LIN , Xinru YU , et al. Construction progress updating method based on BIM and large language models[J]. Journal of Tsinghua University(Science and Technology). 2025, 65(1): 35-44 https://doi.org/10.16511/j.cnki.qhdxxb.2025.22.006

References

1
MANI G F , FENIOSKY P M , SAVARESE S . D4AR: A 4-dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication[J]. Electronic Journal of Information Technology in Construction, 2009, 14, 129- 153.
2
ALSAKKA F , YU H T , EL-CHAMI I , et al. Digital twin for production estimation, scheduling and real-time monitoring in offsite construction[J]. Computers & Industrial Engineering, 2024, 191, 110173.
3
ZHAO X G , JIN Y X , SELVARAJ N M , et al. Platform-independent visual installation progress monitoring for construction automation[J]. Automation in Construction, 2023, 154, 104996.
4
PAL A , LIN J J , HSIEH S H , et al. Automated vision-based construction progress monitoring in built environment through digital twin[J]. Developments in the Built Environment, 2023, 16, 100247.
5
CHOWDHURY M , HOSSEINI M R , EDWARDS D J , et al. Comprehensive analysis of BIM adoption: From narrow focus to holistic understanding[J]. Automation in Construction, 2024, 160, 105301.
6
RANGASAMY V , YANG J B . The convergence of BIM, AI and IoT: Reshaping the future of prefabricated construction[J]. Journal of Building Engineering, 2024, 84, 108606.
7
YILMAZ G , AKCAMETE A , DEMIRORS O . BIM-CAREM: Assessing the BIM capabilities of design, construction and facilities management processes in the construction industry[J]. Computers in Industry, 2023, 147, 103861.
8
XUE J G , HOU X L , ZENG Y . Review of image-based 3D reconstruction of building for automated construction progress monitoring[J]. Applied Sciences, 2021, 11 (17): 7840.
9
KHAN S I , RAY B R , KARMAKAR N C . RFID localization in construction with IoT and security integration[J]. Automation in Construction, 2024, 159, 105249.
10
HUANG R , XU Y S , HOEGNER L , et al. Semantics-aided 3D change detection on construction sites using UAV-based photogrammetric point clouds[J]. Automation in Construction, 2022, 134, 104057.
11
BRAUN A , TUTTAS S , BORRMANN A , et al. A concept for automated construction progress monitoring using BIM-based geometric constraints and photogrammetric point clouds[J]. Journal of Information Technology in Construction, 2015, 20, 68- 79.
12
KIM S , KIM S , LEE D E . Sustainable application of hybrid point cloud and BIM method for tracking construction progress[J]. Sustainability, 2020, 12 (10): 4106.
13
VICK S , BRILAKIS I . Road design layer detection in point cloud data for construction progress monitoring[J]. Journal of Computing in Civil Engineering, 2018, 32 (5): 04018029.
14
REBOLJ D , PUČKO Z , BABIČ N Č , et al. Point cloud quality requirements for scan-vs-BIM based automated construction progress monitoring[J]. Automation in Construction, 2017, 84, 323- 334.
15
JIA S J , LIU C , WU H B , et al. Towards accurate correspondence between BIM and construction using high-dimensional point cloud feature tensor[J]. Automation in Construction, 2024, 162, 105407.
16
DIMITROV A , GOLPARVAR-FARD M . Vision-based material recognition for automated monitoring of construction progress and generating building information modeling from unordered site image collections[J]. Advanced Engineering Informatics, 2014, 28 (1): 37- 49.
17
YANG J , PARK M W , VELA P A , et al. Construction performance monitoring via still images, time-lapse photos, and video streams: Now, tomorrow, and the future[J]. Advanced Engineering Informatics, 2015, 29 (2): 211- 224.
18
WEI W , LU Y J , ZHANG X L , et al. Fine-grained progress tracking of prefabricated construction based on component segmentation[J]. Automation in Construction, 2024, 160, 105329.
19
LU Q C , LEE S . Image-based technologies for constructing as-is building information models for existing buildings[J]. Journal of Computing in Civil Engineering, 2017, 31 (4): 04017005.
20
PARK S M , LEE J H , KANG L S . A framework for improving object recognition of structural components in construction site photos using deep learning approaches[J]. KSCE Journal of Civil Engineering, 2023, 27 (1): 1- 12.
21
KIM C , KIM B , KIM H . 4D CAD model updating using image processing-based construction progress monitoring[J]. Automation in Construction, 2013, 35, 44- 52.
22
GREESHMA A S , EDAYADIYIL J B . Automated progress monitoring of construction projects using machine learning and image processing approach[J]. Materials Today: Proceedings, 2022, 65, 554- 563.
23
MENGISTE E , DE SOTO B G , HARTMANN T . Automated integration of as-is point cloud information with as-planned BIM for interior construction[J]. International Journal of Construction Management, 2024, 24 (2): 137- 150.
24
LI L H , WANG R W , ZHANG X P . A tutorial review on point cloud registrations: Principle, classification, comparison, and technology challenges[J]. Mathematical Problems in Engineering, 2021, 2021, 9953910.
25
QU T , SUN W . Usage of 3D point cloud data in BIM (building information modelling): Current applications and challenges[J]. Journal of Civil Engineering and Architecture, 2015, 9 (11): 1269- 1278.
26
GOLPARVAR-FARD M , BOHN J , TEIZER J , et al. Evaluation of image-based modeling and laser scanning accuracy for emerging automated performance monitoring techniques[J]. Automation in Construction, 2011, 20 (8): 1143- 1155.
27
RAUSCH C , HAAS C . Automated shape and pose updating of building information model elements from 3D point clouds[J]. Automation in Construction, 2021, 124, 103561.
28
TANG P B , HUBER D , AKINCI B , et al. Automatic reconstruction of as-built building information models from laser-scanned point clouds: A review of related techniques[J]. Automation in Construction, 2010, 19 (7): 829- 843.
29
SAKA A , TAIWO R , SAKA N , et al. GPT models in construction industry: Opportunities, limitations, and a use case validation[J]. Developments in the Built Environment, 2024, 17, 100300.
30
CHEN B H, ZHANG Z F, LANGRENÉ N, et al. Unleashing the potential of prompt engineering in large language models: A comprehensive review[Z]. arXiv: 2310.14735, 2024.
31
HASAN M A, DAS S, ANJUM A, et al. Zero-and few-shot prompting with LLMs: A comparative study with fine-tuned models for Bangla sentiment analysis[Z]. arXiv: 2308.10783, 2024.
32
JXX5525. Jxx5525/Kindergarten-revit-model. (2023-12-13). https://github.com/Jxx5525/Kinderg-arten-revit-model.

RIGHTS & PERMISSIONS

All rights reserved. Unauthorized reproduction is prohibited.
PDF(13468 KB)

Accesses

Citation

Detail

Sections
Recommended

/