Objective: Dimensional management is crucial in manufacturing and construction. However, compared to the manufacturing industry, the construction industry has seen considerably less research investment in this area. Traditional construction relies on passive and inefficient dimensional management methods that focus on tolerance specifications and compliance measurements, which fail to meet the demands of rapid assembly in prefabricated buildings. This adversely affects both assembly quality and efficiency. This study establishes a dimensional management process for prefabricated buildings based on the information delivery manual (IDM) standards developed in building information modeling (BIM). It specifies the information exchange processes across different disciplines, providing a standardized implementation pathway and technical guidance for proactive dimensional management starting from the project design stage onward. Methods: This study conducts a survey and analysis of the current state and deficiencies in dimensional management mechanisms in prefabricated buildings, following which it proposes improvements via integration of the design, production, and construction processes of prefabricated buildings and introduction of tolerance analysis methods derived from the manufacturing industry. To effectively combine the enhanced dimensional management process with BIM, a dimensional management process is developed as per the IDM standards specified by ISO 29481-1—2016. This study follows four key steps: (1) Identification of reference processes. (2) Creation of process diagrams. (3) Defining of exchange requirements and business rules. (4) Development of functional parts. Results: The newly developed dimensional management process comprised four stages: (1) Preliminary design stage, early in this stage, a dimensional management team was formed, comprising experts, designers, production personnel, and construction technicians. This team determined the tolerance levels for key components on the basis of the owner's requirements. (2) In the detailed design stage, the dimensional management team, working as per the BIM model, identified potential deviation risks that could affect the project's appearance, functionality, quality, and constructability. In addition, critical dimensions requiring deviation accumulation prediction were specified by the team. (3) In the design optimization stage, deviation issues were predicted and simulated by means of the tolerance analysis functional part. Through the analysis results, the design was optimized, and reasonable tolerance and measurement plans were formulated. (4) In the production and construction stage, prefabricated components were manufactured and assembled onsite following the tolerance and measurement plans, with deviation reports generated via the digital compliance measurement functional part. In addition, this study clarified the exchange requirements and business rules involved in the process, facilitating the integration of dimensional management with the existing BIM systems. Conclusions: Through the survey results and improvement of the current dimensional management mechanisms in prefabricated buildings, this study develops a standard process for collaborative dimensional management across various disciplines, with reference to the IDM standards. In addition to traditional methods focusing on tolerance specifications and compliance measurements, the process emphasizes the establishment of a dedicated dimensional management team during the design stage. This team is responsible for the selection of tolerance levels, identification of deviation risks, prediction of deviation accumulation, and further guidance of design optimizations toward manufacturing and assembly. This proactive dimensional management approach aims for higher assembly precision and quality. In addition, this study specifies the exchange requirements and functional parts of the "prefabricated building dimensional management" IDM, introduces tolerance analysis techniques from the manufacturing industry and provides an information framework for future integration of dimensional management with BIM.