Visual sensing image processing and feature information extraction for arc welding

doi:10.16511/j.cnki.qhdxxb.2021.21.031

Abstract
Figures/Tables
References
Related Articles
Metrics

Download: PDF(2530 KB) HTML
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks

Abstract Visual sensing is an effective means for obtaining arc-welding characteristic information, such as the position and pose of the welding torch, the shape and size of the welding groove, for closed-loop feedback control in intelligent arc welding. The paper describes a visual sensing image processing and feature extraction method for arc welding. A multi-source sensor was developed based on the fusion of visual information with the effect of gravity. The hardware and image preprocessing algorithm are optimized to reduce the interference of the strong arc light, spatter, and other effects on the CCD image. The algorithm then uses the edge extraction based on a Canny operator or the skeleton thinning algorithm based on iterative erosion. The two algorithms separately process the CCD image of the welding groove collected by the multi-source sensor to extract the laser lines, the laser line intersection coordinates and the laser line bending points coordinates caused by the welding groove. Comparison of the feature information extraction speeds and recognition accuracies of the two algorithms shows that the edge extraction algorithm based on the Canny operator can provide real-time weld seam tracking during arc welding.

Keywords image processing visual sensing edge extraction skeleton thinning feature extraction

Issue Date: 14 January 2022

	Service

	E-mail this article
	E-mail Alert
	RSS
	Articles by authors

	ZHANG Tianyi
	ZHU Zhiming
	ZHU Chuanhui
	SUN Bowen

Cite this article:

ZHANG Tianyi,ZHU Zhiming,ZHU Chuanhui, et al. Visual sensing image processing and feature information extraction for arc welding[J]. Journal of Tsinghua University(Science and Technology), 2022, 62(1): 156-162.

URL:

http://jst.tsinghuajournals.com/EN/10.16511/j.cnki.qhdxxb.2021.21.031 OR http://jst.tsinghuajournals.com/EN/Y2022/V62/I1/156

[1] 范俊峰, 景奉水, 方灶军. 基于视觉传感的焊缝跟踪技术研究现状和发展趋势[J]. 热加工工艺, 2017, 46(5):6-10, 14. FAN J F, JING F S, FANG Z J. Research status and development trend of welding seam tracking technology based on vision sensors[J]. Hot Working Technology, 2017, 46(5):6-10, 14. (in Chinese)
[2] 吴林, 陈善本. 智能化焊接技术[M]. 北京:国防工业出版社, 2000. WU L, CHEN S B. Intelligent technologies for welding[M]. Beijing:National Defense Industry Press, 2000. (in Chinese)
[3] 张瑞雪. 多线激光传感器Ⅴ型焊缝轨迹识别[D]. 南昌:南昌大学, 2018. ZHANG R X. Recognition of V-shaped weld trajectory with multi-line laser vision sensor[D]. Nanchang:Nanchang University, 2018. (in Chinese)
[4] SHEN H Y, WU J, LIN T, et al. Arc welding robot system with seam tracking and weld pool control based on passive vision[J]. The International Journal of Advanced Manufacturing Technology, 2008, 39(7-8):669-678.
[5] KONG M, CHEN S B. Al alloy weld pool control of welding robot with passive vision[J]. Sensor Review, 2009, 29(1):28-37.
[6] 刘超, 邵文军, 黄禹, 等. 激光焊接中窄拼缝被动光视觉检测算法[J]. 小型微型计算机系统, 2019, 40(4):798-801. LIU C, SHAO W J, HUANG Y, et al. Weld seam detection method based on passive vision sensor in laser welding[J]. Journal of Chinese Computer Systems, 2019, 40(4):798-801. (in Chinese)
[7] 石玗, 汪海涛, 薛诚, 等. 采用激光线光源的焊接坡口间隙视觉检测[J]. 兰州理工大学学报, 2009, 35(6):29-32. SHI Y, WANG H T, XUE C, et al. Visual detection of welding groove gap with linear laser source[J]. Journal of Lanzhou University of Technology, 2009, 35(6):29-32. (in Chinese)
[8] 李明利, 刘占民. 焊接坡口激光检测图像处理及跟踪信息的提取[J]. 焊接学报, 2005, 26(5):31-35. LI M L, LIU Z M. Image processing and tracing data collection for welding groove laser detection[J]. Transactions of the China Welding Institution, 2005, 26(5):31-35. (in Chinese)
[9] 李忠虎, 郭蕾, 闫俊红, 等. 线结构光光条中心提取算法研究[J]. 内蒙古科技大学学报, 2019, 38(3):252-257. LI Z H, GUO L, YAN J H, et al. Research on extraction algorithm of line structured light stripe center[J]. Journal of Inner Mongolia University of Science and Technology, 2019, 38(3):252-257. (in Chinese)
[10] 孙小亮, 贾剑平, 叶艳辉, 等. 结构光在阴极板焊缝自动跟踪系统中的应用[J]. 有色冶金设计与研究, 2020, 41(增刊1):13-16. SUN X L, JIA J P, YE Y H, et al. Application and practice of structured light in automatic seam tracking system of cathode plate[J]. Nonferrous Metals Engineering & Research, 2020, 41(S1):13-16. (in Chinese)
[11] 孙博文, 朱志明, 郭吉昌, 等. 基于组合激光结构光的视觉传感器检测算法及图像处理流程优化[J]. 清华大学学报(自然科学版), 2019, 59(6):445-452. SUN B W, ZHU Z M, GUO J C, et al. Detection algorithms and optimization of image processing for visual sensors using combined laser structured light[J]. Journal of Tsinghua University(Science and Technology), 2019, 59(6):445-452. (in Chinese)
[12] 齐欣. 数字图像的存储方式及传输途径[J]. 照相机, 2004(7):42-43. QI X. Storage and transmission of digital image[J]. Camera, 2004(7):42-43. (in Chinese)
[13] 张安定, 衣华鹏, 崔青春.《遥感原理》研究性教学的探索与实践[J]. 测绘通报, 2005(12):59-61. ZHANG A D, YI H P, CUI Q C. Searching and practice in the investigating teaching of remote sensing course[J]. Bulletin of Surveying and Mapping, 2005(12):59-61. (in Chinese)
[14] 高浩军, 杜宇人. 中值滤波在图像处理中的应用[J]. 电子工程师, 2004, 30(8):35-36. GAO H J, DU Y R. The application of median filtering on image processing[J]. Electronic Engineer, 2004, 30(8):35-36. (in Chinese)
[15] 丁怡心, 廖勇毅. Gauss模糊算法优化及实现[J]. 现代计算机(专业版), 2010(8):76-77, 100. DING Y X, LIAO Y Y. Optimization and implementation of Gaussian blur algorithm[J]. Modern Computer, 2010(8):76-77, 100. (in Chinese)
[16] 汪涛, 成孝刚, 李德志, 等. 基于霍夫变换与角点检测的叶脉特征提取算法[J]. 计算机技术与发展, 2019, 29(11):159-162. WANG T, CHENG X G, LI D Z, et al. A feature extraction algorithm for leaf vein based on hough transform and corner detection[J]. Computer Technology and Development, 2019, 29(11):159-162. (in Chinese)
[17] 王国宏, 李林, 于洪波. 基于点集合并的修正Hough变换TBD算法[J]. 航空学报, 2017, 38(1):203-213. WANG G H, LI L, YU H B. A modified Hough transform TBD algorithm based on point set merging[J]. Acta Aeronautica et Astronautica Sinica, 2017, 38(1):203-213. (in Chinese)

[1]	XIE Weiqiang, ZHANG Xiaoping, LIU Xiaoli, ZHOU Xiaoxiong, LIU Quansheng. Three-dimensional morphological characterization of sand particles based on a multiangle projection method[J]. Journal of Tsinghua University(Science and Technology), 2024, 64(2): 294-302.
[2]	ZHANG Mingfang, LI Guilin, WU Chuna, WANG Li, TONG Lianghao. Estimation algorithm of driver's gaze zone based on lightweight spatial feature encoding network[J]. Journal of Tsinghua University(Science and Technology), 2024, 64(1): 44-54.
[3]	ZHU Chuanhui, ZHU Zhiming, KE Zhijie, ZHANG Tianyi. Integrated calibration of internal visual sensor parameters based on combined laser structured lights[J]. Journal of Tsinghua University(Science and Technology), 2022, 62(9): 1516-1523.
[4]	YANG Hongyu, ZHANG Zixin, ZHANG Liang. Network security situation assessments with parallel feature extraction and an improved BiGRU[J]. Journal of Tsinghua University(Science and Technology), 2022, 62(5): 842-848.
[5]	SUN Yue, HE Ke, ZHANG Zhinan. Multi-source information fitting regression integrated model of coefficient of friction[J]. Journal of Tsinghua University(Science and Technology), 2022, 62(12): 1980-1988.
[6]	CHENG Shijia, ZHU Zhiming, FU Pingpo. Arc shape variations and characteristic temperatures of pulsed TIG welding arcs based on observed arc images[J]. Journal of Tsinghua University(Science and Technology), 2021, 61(9): 994-1001.
[7]	ZHU Zhiming, CHENG Shijia, YU Yingfei, FU Pingpo. Automatic recognition and control of welding arc morphology as a function of the welding current and the tungsten electrode height[J]. Journal of Tsinghua University(Science and Technology), 2020, 60(4): 285-291.
[8]	SUN Bowen, ZHU Zhiming, GUO Jichang, ZHANG Tianyi. Detection algorithms and optimization of image processing for visual sensors using combined laser structured light[J]. Journal of Tsinghua University(Science and Technology), 2019, 59(6): 445-452.
[9]	ZHANG Simin, WANG Guolei, YU Qiankun, HUA Xiaotong, SONG Libin, CHEN Ken. Image processing analyses of the factors influencing the angle of an atomizer spray cone[J]. Journal of Tsinghua University(Science and Technology), 2019, 59(2): 103-110.
[10]	XIAO Xi, ZHOU Lu. Speech recognition adaptive clustering feature extraction algorithms based on the k-means algorithm and the normalized intra-class variance[J]. Journal of Tsinghua University(Science and Technology), 2017, 57(8): 857-861.
[11]	JIAO Zhihao, YANG Jian, YE Chunmao, SONG Jianshe. Scattering component consistency based parameter for polarimetric SAR image classification[J]. Journal of Tsinghua University(Science and Technology), 2016, 56(8): 908-912.
[12]	HAN Zandong, LI Yongjie, LI Xiaoyang. Simulation and feature extraction of eddy current tests for residual austenite content[J]. Journal of Tsinghua University(Science and Technology), 2016, 56(6): 617-621.
[13]	NIE Ding, AN Xuehui. Mini-slump flow measurement tool based on self phase image processing[J]. Journal of Tsinghua University(Science and Technology), 2016, 56(12): 1249-1254.
[14]	SHI Lin, XU Ran, XU Qianghui, XU Ying, ZHENG Licai. Advanced characterization of three-dimensional pores in coking sand by micro-CT[J]. Journal of Tsinghua University(Science and Technology), 2016, 56(10): 1079-1084.
[15]	YANG Xiangdong, RUI Xiaofei, XIE Ying. Efficient Hough transform based cylinder feature detection algorithm[J]. Journal of Tsinghua University(Science and Technology), 2015, 55(8): 921-926.

Viewed

Full text

Abstract

Cited

Shared

Discussed