PDF(5007 KB)
PDF(5007 KB)
PDF(5007 KB)
基于联邦学习与云边协同的剩余寿命预测
Remaining useful life prediction based on federated learning and cloud-edge collaboration
剩余使用寿命(RUL)预测对于确保工业设备的安全运行和减少定期预防性维护的成本具有重大意义。然而, 对于典型的边缘设备, 其计算能力和数据存储能力有限, 较难实现设备的RUL预测, 且云和边缘之间的数据传输速率有限, 传输所有训练数据会带来较高的延迟。此外, 由于可能的利益冲突, 通常情况下很难实现所有边缘设备之间的数据共享。为此, 该文提出了一种基于联邦学习的云边协同框架。多个边缘设备和云服务器被用来训练一个基于变分自编码器(VAE)的特征提取模块和一个RUL预测模块, 无需数据共享。在每个训练周期中, 首先在所有边缘设备上使用各自的本地训练数据集训练VAE, 再将所有本地VAE上传到云端, 并根据本地训练数据的规模为所有边缘分配权重, 聚合成一个全局特征提取模块, 再发送回所有边缘设备, 以从它们的数据集中提取隐藏特征, 并将这些特征上传到云端以训练全局RUL预测器。实验结果表明:该方法可以在资源受限的条件下执行边缘设备RUL预测, 减少了数据传输延迟并能够保护数据隐私。
Objective: Predicting the remaining useful life (RUL) of industrial equipment is critical for maintaining safe operations and minimizing maintenance costs. However, RUL prediction for edge devices faces several challenges. First, edge devices often lack the computational power and storage capacity required for complex RUL prediction algorithms, making such predictions difficult. Many RUL prediction algorithms require substantial resources, which are scarce on edge devices. Second, the limited data transmission rate between the cloud and edge devices causes high latency when transmitting large data sets to the cloud, affecting real-time predictions and increasing network bandwidth usage. Additionally, data sharing among all edge devices is often impractical owing to privacy, security issues, and potential conflicts of interest, limiting models to local data and reducing their accuracy. Methods: To address these challenges, this paper proposes a cloud-edge collaboration framework for RUL prediction based on federated learning. The framework comprises two main processes. In the first process, each training device trains a variational autoencoder (VAE) using its local data set. The trained encoders are then uploaded to the cloud and aggregated using a weighted average method (FedAVG), with the number of training samples as weights. The aggregated global encoder is then downloaded to all edge devices. In the second process, the aggregated encoder extracts hidden features from the local data sets on each edge device. These features are uploaded sequentially to the cloud to train the RUL predictor. Once trained, the predictor is sent back to the edge devices, completing one training cycle. This iterative process continues until a well-trained RUL prediction model, consisting of the global encoder and predictor, is achieved. During the testing stage, the global encoder is used to extract hidden features, while the RUL predictor performs deeper feature extraction and RUL prediction. In this framework, only local encoders and hidden features are uploaded to the server, significantly reducing communication overhead. Most of the training occurs on the server, with clients only performing the basic training of the shallow VAE, thereby effectively utilizing the server's powerful computational capabilities. Data privacy is maintained since the server receives hidden features and encoders, not the original data, preventing data reconstruction. Results: To validate the proposed method's efficiency and practicality, different network structures were tested for RUL prediction on the commercial modular aero-propulsion system simulation (C-MAPSS). Although there was a slight decline in prediction performance compared to the baseline, the difference was within acceptable limits. This minor trade-off in accuracy enabled RUL prediction under resource constraints. The proposed algorithm significantly reduced data transmission time after feature extraction across various data scales consistently. In industrial scenarios with large data volumes, this reduction was even more pronounced. Further validation using nuclear power unit fault data sets showed a slight decrease in root mean square error (RMSE) on the test set without a significant drop in prediction accuracy. These results demonstrate that the proposed cloud-edge collaboration framework is promising for fault diagnosis in nuclear power units, effectively addressing edge resource limitations. Conclusions: The proposed cloud-edge collaboration framework leverages federated learning to achieve RUL prediction on resource-constrained edge devices, thereby alleviating issues related to resource constraints and data privacy. By employing VAE-based feature extraction and federated learning for model training, the framework achieves efficient model training while significantly reducing communication overhead with minimal impact on accuracy. Experimental validation on industrial simulation data sets and nuclear power unit fault data sets demonstrates the framework's practicality and effectiveness. This framework represents a useful approach to addressing challenges in fault diagnosis and URL prediction within resource-constrained settings.
剩余寿命预测 / 联邦学习 / 云边协同 / 预测性健康管理(PHM)
remaining useful life prediction / federated learning / cloud-edge collaborations / prognostics and health management (PHM)
| 1 |
|
| 2 |
|
| 3 |
|
| 4 |
|
| 5 |
|
| 6 |
|
| 7 |
GUCLU A, YILBOGA H, EKERÖ F, et al. Prognostics with autoregressive moving average for railway turnouts[C]//Annual Conference of the Prognostics and Health Management Society. Portland, USA, 2010.
|
| 8 |
|
| 9 |
SAXENA A, GOEBEL K, SIMON D, et al. Damage propagation modeling for aircraft engine run-to-failure simulation[C]//2008 International Conference on Prognostics and Health Management. Denver, USA: IEEE, 2008: 1-9.
|
| 10 |
|
| 11 |
|
| 12 |
|
| 13 |
|
| 14 |
|
| 15 |
VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems. Long Beach, USA: Curran Associates, 2017: 6000-6010.
|
| 16 |
|
| 17 |
MU H S, ZHAI X D, YIN D B, et al. A method of remaining useful life prediction of multi-source signals aero-engine based on RF-transformer-LSTM[C]//2022 IEEE International Conference on Systems, Man, and Cybernetics. Prague, Czech: IEEE, 2022: 2502-2507.
|
| 18 |
|
| 19 |
|
| 20 |
|
| 21 |
|
| 22 |
DUAN Z H, LU M, MA Z, et al. Lossy image compression with quantized hierarchical VAEs[C]//2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). Waikoloa, USA: IEEE, 2023: 198-207.
|
| 23 |
MCMAHAN B, MOORE E, RAMAGE D, et al. Communication-efficient learning of deep networks from decentralized data[C]//Proceedings of the 20th International Conference on Artificial Intelligence and Statistics. Fort Lauderdale, USA: PMLR, 2017: 1273-1282.
|
| 24 |
|
| 25 |
|
| 26 |
|
| 27 |
HAN X, YU H R, GU H S. Visual inspection with federated learning[C]//16th International Conference on Image Analysis and Recognition. Waterloo, Canada: Springer, 2019: 52-64.
|
| 28 |
|
| 29 |
ZEILER M D, KRISHNAN D, TAYLOR G W, et al. Deconvolutional networks[C]//2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco, USA: IEEE, 2010: 2528-2535.
|
| 30 |
|
| 31 |
HEIMES F O. Recurrent neural networks for remaining useful life estimation[C]//2008 International Conference on Prognostics and Health Management. Denver, USA: IEEE, 2008: 1-6.
|
| 32 |
|
| 33 |
BABU G S, ZHAO P L, LI X L. Deep convolutional neural network based regression approach for estimation of remaining useful life[C]//21st International Conference on Database Systems for Advanced Applications. Dallas, USA: Springer, 2016: 214-228.
|
| 34 |
ZHENG S, RISTOVSKI K, FARAHAT A, et al. Long short-term memory network for remaining useful life estimation[C]//2017 IEEE International Conference on Prognostics and Health Management. Dallas, USA: IEEE, 2017: 88-95.
|
/
| 〈 |
|
〉 |