PDF(11068 KB)
Multilayer and multipass automatic lane arrangement technology based on visual sensing
Xiaobing FENG, Jun ZHENG, Aiping LIU
Journal of Tsinghua University(Science and Technology) ›› 2025, Vol. 65 ›› Issue (8) : 1596-1608.
PDF(11068 KB)
PDF(11068 KB)
Multilayer and multipass automatic lane arrangement technology based on visual sensing
Objective: This research centers on the automated welding of medium and thick plates within large structural components. It is mainly focused on the in-depth exploration of the multilayer and multipass automated layout technology based on laser vision sensing. The aim is to solve a variety of crucial problems that occur during the welding process of medium and thick plates in large structural parts. By enhancing the welding quality and efficiency, it promotes the intelligent development of welding technology. Through a series of theoretical analyses, algorithm research and development, as well as experimental verifications, a multilayer and multipass automated layout technology based on laser vision sensing, along with its corresponding adjustment system, has been successfully developed. Methods: Under intricate and challenging welding conditions, the precise identification and feature extraction of weld seams were achieved, which laid a solid foundation for the automated tracking control of robots. A highly efficient solution based on a deep learning model was developed, and the end-to-end laser centerline extraction was successfully realized. This algorithm, while ensuring stable adaptation to a large number of working conditions, has a lightweight parameter scale and a relatively fast computing speed. Moreover, both its accuracy and efficiency can meet the engineering requirements, and it can accurately locate the key feature points in the laser weld images of different stages of multilayer and multipass welding of medium and thick plates. By obtaining the images of adjacent weld passes at the same position and using the laser centerline or the inflection point at the top of the groove as the matching feature to perform relevant operations, the weld pass morphology and features were extracted and served as the basis for the multilayer and multipass layout planning. Meanwhile, considering its self-correlation with the changes in welding process parameters, the real-time prediction of welding process parameters was achieved, thereby providing a basis for the rational selection of parameters at different positions of the welding path. Through an extensive analysis of welding parameters across various positions and plate thicknesses, strong correlative relationships among test plate types, plate thicknesses, process parameters, and weld bead deposition amounts were established. This enabled the effective planning of the number of welding layers and deposition quantities for medium and thick plates, providing a clear guideline for subsequent welding operations. Results: By incorporating visual sensing to identify weld seam information, the proposed technology facilitates the automatic planning of welding paths for each pass. Moreover, it determines crucial details such as the optimal position, attitude, and oscillation width of different weld beads at specific positions and times. Based on the deposition amount of each planned pass, process parameters are adaptively adjusted. Simultaneously, by combining position information and visual tracking, the position and orientation of the welding torch are adjusted accordingly, ensuring that the welding torch remains in the ideal state throughout welding. The system accounts for various influencing factors, including welding deformation, groove shape changes, and fluctuations during welding operations. Welding layout information and parameters are continuously refined and dynamically adjusted in real time. Conclusions: This adaptive mechanism ensures stable and efficient welding operations on large structural components, considerably enhancing production efficiency and product quality. Ultimately, this research plays a vital role in promoting the intelligent development of the manufacturing industry.
laser vision / multilayer and multipass / path planning / lane adjustment
| 1 |
冯消冰, 王建军, 王永科, 等. 面向大型结构件爬行机器人智能焊接技术[J]. 清华大学学报(自然科学版), 2023, 63 (10): 1608- 1625.
|
| 2 |
刘钊江, 马思乐, 戴昊飞, 等. 基于激光传感器的机器人自适应多层多道焊接[J]. 焊接, 2020 (08): 26- 32.
|
| 3 |
黄继强, 盖守新, 薛龙, 等. 坡口偏差厚板机器人多道焊接方法[J]. 焊接学报, 2020, 41 (6): 60- 66.
|
| 4 |
胡啸, 崔川, 陈纬, 等. 厚板大坡口多层多道焊接轨迹规划算法[J]. 热加工工艺, 2022, 51 (15): 102- 106.
|
| 5 |
|
| 6 |
冯消冰, 何金龙, 刘爱平. 激光中心线的提取方法: 202211044476.6[P]. 2022-08-30.
FENG X B, HE J L, LIU A P. Method for extracting laser centerlines: 202211044476.6[P]. 2022-08-30. (in Chinese)
|
| 7 |
冯消冰, 刘爱平. 焊道信息获取方法及装置、焊接系统: 202310073411.2[P], 2023-01-13.
FENG X B, LIU A P. Method and device for obtaining weld information, and welding system: 202310073411.2[P]. 2023-01-13. (in Chinese)
|
| 8 |
晏婕. 基于深度学习的视频帧序列预测算法研究[D]. 长春: 吉林大学, 2023.
YAN J. Research on video frame sequence prediction algorithm based on deep learning[D]. Changchun: Jilin University, 2023. (in Chinese)
|
| 9 |
黄喜阳, 杜庆治, 龙华, 等. 基于MFCC特征融合的语音情感识别算法[J]. 陕西理工大学学报(自然科学版), 2023, 39 (04): 17- 25.
|
| 10 |
曹学鹏, 脱帅华, 张弓, 等. 焊接机器人焊缝跟踪方法及路径规划研究[J]. 工程科学与技术, 2022, 54 (2): 196- 204.
|
| 11 |
冯消冰, 刘爱平. 多层多道焊接方法、装置、处理器和焊接系统: 202310070213.0 [P]. 2023-01-13.
FENG X B, LIU A P. Multi-layer multi-pass welding method, and device, processor and welding system: 202310070213.0 [P]. 2023-01-13. (in Chinese)
|
| 12 |
何成刚, 郑衡, 丁克, 等. 基于机械臂辅助的多视角三维点云拼接算法[J]. 激光与光电子学进展, 2023, 60 (20): 2015001.
|
| 13 |
冯消冰, 闫佳, 刘爱平. 焊接装置的控制方法、控制器以及焊接系统: 202310065726.2 [P]. 2023-01-13.
FENG X B, YAN J, LIU A P. Control method of welding device, controller and welding system: 202310065726.2 [P]. 2023-01-13. (in Chinese)
|
| 14 |
ZENG J, CAO G Z, LI W B, et al. An algorithm of hand-eye calibration for arc welding robot[C]//2019 16th International Conference on Ubiquitous Robots (UR). Jeju, Korea (South): IEEE, 2019: 1-6.
|
| 15 |
冯消冰, 刘爱平, 闫佳. 焊枪末端偏差校准方法、装置、存储介质与电子设备: 202311844658.6 [P]. 2023-12-28.
FENG X B, LIU A P, YAN J. Welding gun tail end deviation calibration method and device, storage medium and electronic equipment: 202311844658.6 [P]. 2023-12-28. (in Chinese)
|
| 16 |
|
| 17 |
王天琪, 张树浩, 龙斌, 王克宽. 中厚板多层多道焊视觉测量与工艺规划[J]. 天津工业大学学报, 2024, 43 (03): 75- 81.
|
/
| 〈 |
|
〉 |