| Citation: | HE Chao, CHEN Guo, WANG Yuwei. Real-time detection method of aero-engine internal damage based on deep learning[J]. Journal of Aerospace Power, 2023, 38(8):1857-1864 doi: 10.13224/j.cnki.jasp.20210381 |
In view of the problem in real-time detection of aero-engine internal damage, an object detection network model based on the YOLOv4 framework was proposed. With advantages of high detection accuracy and fast reasoning speed, this network model realized real-time detection of engine internal damage. In specific implementation process, the method first classified different damage types and annotated the damage location, and then imported the image and its corresponding annotations into the improved network for training to obtain the corresponding detection model. Finally, based on the trained model, real-time detection of damage on pictures and video streams was performed. The Pascal VOC (visual object classes) standard data set and the real aero-engine borescope image data set were used to verify the method. The results showed that the proposed object detection network can improve the frame rate of detection per second more than 23.7% on the premise of ensuring accuracy compared with the original object detection network. The method could provide an effective way to solve the problems of inaccurate detection results and low detection efficiency caused by human factors in borescope damage detection, showing strong engineering practical value.
| [1] |
易中辉,李世林,李子铭. 图像识别在航空发动机维修中的应用[J]. 中国科技信息,2020,32(23): 27-28.
YI Zhonghui,LI Shilin,LI Zimin. The application of image recognition in aero-engine maintenance[J]. China Science and Technology Information,2020,32(23): 27-28. (in Chinese)
|
| [2] |
肖柏荣. 航空发动机维护中孔探检测技术的应用[J]. 中国高新科技,2019,3(15): 96-98. doi: 10.13535/j.cnki.10-1507/n.2019.15.19
XIAO Bairong. Application of borescope detection technology in aero-engine maintenance[J]. China High-Tech,2019,3(15): 96-98. (in Chinese) doi: 10.13535/j.cnki.10-1507/n.2019.15.19
|
| [3] |
王晓兵. 基于孔探检测的民航发动机维修间隔优化研究[D]. 天津: 中国民航大学, 2018.
WANG Xiaobing. Research on civil aviation engine maintenance interval optimization based on borescope detection[D]. Tianjin: Civil Aviation University of China, 2018. (in Chinese)
|
| [4] |
余佳琛. 民航发动机电子内窥镜孔探检查的管理[J]. 电子世界,2017,39(24): 190-191. doi: 10.19353/j.cnki.dzsj.2017.24.103
YU Jiachen. The management of the borescope detection of civil aviation engine electronic endoscope[J]. Electronics World,2017,39(24): 190-191. (in Chinese) doi: 10.19353/j.cnki.dzsj.2017.24.103
|
| [5] |
胡静,徐拓. 基于孔探技术的航空发动机常见损伤及案例分析[J]. 装备制造技术,2017,45(11): 183-185. doi: 10.3969/j.issn.1672-545X.2017.11.059
HU Jing,XU Tuo. The common damage and case analysis of aero-engine based on borescope technology[J]. Equipment Manufacturing Technology,2017,45(11): 183-185. (in Chinese) doi: 10.3969/j.issn.1672-545X.2017.11.059
|
| [6] |
杨晓军,王瑛琦,刘智刚. 航空发动机涡轮叶片损伤分析[J]. 机械工程与自动化,2017,46(3): 203-205. doi: 10.3969/j.issn.1672-6413.2017.03.087
YANG Xiaojun,WANG Yingqi,LIU Zhigang. Analysis of damaged blades of aero-engine turbine[J]. Mechanical Engineering & Automation,2017,46(3): 203-205. (in Chinese) doi: 10.3969/j.issn.1672-6413.2017.03.087
|
| [7] |
刘斌江,孙科. 孔探技术在航空发动机维修中的应用[J]. 国防制造技术,2016,8(3): 67-69. doi: 10.3969/j.issn.1674-5574.2016.03.020
LIU Binjiang,SUN Ke. Application of hole exploring technology in aero-engine maintenance[J]. Defense Manufacturing Technology,2016,8(3): 67-69. (in Chinese) doi: 10.3969/j.issn.1674-5574.2016.03.020
|
| [8] |
樊玮,段博坤,黄睿,等. 基于风格迁移的交互式航空发动机孔探图像扩展方法[J]. 计算机应用,2020,40(12): 3631-3636. doi: 10.11772/j.issn.1001-9081.2020040585
FAN Wei,DUAN Bokun,HUANG Rui,et al. Interactive augmentation method for aircraft engine borescope inspection images based on style transfer[J]. Journal of Computer Applications,2020,40(12): 3631-3636. (in Chinese) doi: 10.11772/j.issn.1001-9081.2020040585
|
| [9] |
张栋善,赵成. 航空发动机维修中孔探技术的应用分析[J]. 电子制作,2019,26(12): 98-99. doi: 10.3969/j.issn.1006-5059.2019.12.040
ZHANG Dongshan,ZHAO Cheng. Application analysis of hole exploring technology in aero-engine maintenance[J]. Practical Electronics,2019,26(12): 98-99. (in Chinese) doi: 10.3969/j.issn.1006-5059.2019.12.040
|
| [10] |
李华,陈果,陈新波,等. 航空发动机内部裂纹自动测量方法研究[J]. 计算机工程与应用,2016,52(11): 233-237. doi: 10.3778/j.issn.1002-8331.1407-0423
LI Hua,CHEN Guo,CHEN Xinbo,et al. Study on automatic measurement method for aero-engine inner damage crack[J]. Computer Engineering and Applications,2016,52(11): 233-237. (in Chinese) doi: 10.3778/j.issn.1002-8331.1407-0423
|
| [11] |
旷可嘉. 深度学习及其在航空发动机缺陷检测中的应用研究[D]. 广州: 华南理工大学, 2017.
KUANG Kejia. Research on deep learning and its application on the defects detection for aero-engine[D]. Guangzhou: South China University of Technology, 2017. (in Chinese)
|
| [12] |
赵烨. 基于卷积神经网络的叶片损伤识别方法研究[D]. 天津: 中国民航大学, 2019.
ZHAO Ye. Research on blade damage identification method based on convolution neural network[D]. Tianjin: Civil Aviation University of China, 2019. (in Chinese)
|
| [13] |
李龙浦. 基于孔探数据的航空发动机叶片损伤识别研究[D]. 天津: 中国民航大学, 2020.
LI Longpu. Research on damage identification of aero-engine blades based on borescope data[D]. Tianjin: Civil Aviation University of China, 2020. (in Chinese)
|
| [14] |
HUANG G,LIU Z,PLEISS G,et al. Convolutional networks with dense connectivity[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2019,44(12): 8704-8716.
|
| [15] |
LEE Y, HWANG J, LEE S, et al. An energy and gpu-computation efficient backbone network for real-time object detection[C]//CVF Conference on Computer Vision and Pattern Recognition Workshops. Piscataway: IEEE, 2019: 752-760.
|
| [16] |
HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2016: 770-778.
|
| [17] |
LEE Y, PARK J. Centermask: real-time anchor-free instance segmentation[C]//CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2020: 13906-13915.
|
| [18] |
LIU S, QI L, QIN H, et al. Path aggregation network for instance segmentation[C]//Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2018: 8759-8768.
|
| [19] |
BOCHKOVSKIY A, WANG C Y, LIAO H Y M. Yolov4: optimal speed and accuracy of object detection[EB/OL]. [2022-12-21]. https://arxiv.org/abs/2004.10934.
|
| [20] |
HE K,ZHANG X,REN S,et al. Spatial pyramid pooling in deep convolutional networks for visual recognition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(9): 1904-1916. doi: 10.1109/TPAMI.2015.2389824
|
| [21] |
ZHENG Z,WANG P,REN D,et al. Enhancing geometric factors in model learning and inference for object detection and instance segmentation[J]. IEEE Transactions on Cybernetics,2021,52(8): 8574-8586.
|