Prognostics and Health Management (PHM) is critical for predicting the Remaining Useful Life (RUL) of systems, a key enabler of Predictive Maintenance (PdM). This paper reviews state-of-the-art data-driven prognostic models, emphasizing four essential characteristics: uncertainty, robustness, interpretability, and feasibility. While traditional research has focused on enhancing RUL prediction accuracy, this review argues that these additional characteristics are equally vital for addressing the demands of PHM applications.The review examines Machine Learning (ML) techniques, stochastic models, and Bayesian filters (BFs), analyzing their strengths, limitations, and trade-offs. ML models excel in accuracy but often lack robust uncertainty quantification and adaptability across varying operational conditions. Stochastic models demonstrate greater robustness and feasibility, performing reliably with limited or variable data. Bayesian filters provide high interpretability and do not require run-to-failure data but face challenges in adapting to diverse environments.To bridge these gaps, this paper proposes a structured Model Evaluation Framework that integrates users’ specific needs with key model characteristics identified in the review. By quantifying the importance of the four characteristics, the framework enables systematic evaluation and selection of prognostic models.The findings underscore the need for advancements in uncertainty quantification, adaptive methods to improve robustness, and enhanced interpretability to meet practical and regulatory requirements. While current models offer valuable insights, further improvements are necessary to unlock their full potential for PHM and PdM applications, ensuring more reliable and actionable predictions.
This paper presents the use of proportional hazards regression models for predicting the Mean Time Between Failures (MTBF) of centrifugal pumps in the oil and gas industry. To that end, a dataset collected over 8 years including both design and operational variables from 675 pumps in an oil refinery was used to fit statistical models. Parametric and non-parametric transformations and restricted cubic splines were used to fit the covariates, thereby relaxing linearity assumptions and potentiating predictors with strong nonlinear effects on the outcome. Standard Principal Component Analysis (PCA) and sparse robust PCA methods were used for data reduction to simplify the fitted models and minimize overfitting. Models fitted with sparse robust PCA on non-parametrically transformed variables using an additive variance stabilizing (AVAS) method are suggested for further investigation. The complexity of the fitted models was reduced by 85% while at the same time providing for a more robust model as indicated by an improvement of the calibration slope from 0.830 to 0.936 with an essentially stable Akaike information criterion (AIC) (0.34% increase).
Prognostic Health Management aims to predict the Remaining Useful Life (RUL) of degrading components/systems utilizing monitoring data. These RUL predictions form the basis for optimizing maintenance planning in a Predictive Maintenance (PdM) paradigm. We here propose a metric for assessing data-driven prognostic algorithms based on their impact on downstream PdM decisions. The metric is defined in association with a decision setting and a corresponding PdM policy. We consider two typical PdM decision settings, namely component ordering and/or replacement planning, for which we investigate and improve PdM policies that are commonly utilized in the literature. All policies are evaluated via the data-based estimation of the long-run expected maintenance cost per unit time, using monitored run-to-failure experiments. The policy evaluation enables the estimation of the proposed metric. We employ the metric as an objective function for optimizing heuristic PdM policies and algorithms’ hyperparameters. The effect of different PdM policies on the metric is initially investigated through a theoretical numerical example. Subsequently, we employ four data-driven prognostic algorithms on a simulated turbofan engine degradation problem, and investigate the joint effect of prognostic algorithm and PdM policy on the metric, resulting in a decision-oriented performance assessment of these algorithms.
To maximize its value, the design, development and implementation of Structural Health Monitoring (SHM) should focus on its role in facilitating decision support. In this position paper, we offer perspectives on the synergy between SHM and decision-making. We propose a classification of SHM use cases aligning with various dimensions that are closely linked to the respective decision contexts. The types of decisions that have to be supported by the SHM system within these settings are discussed along with the corresponding challenges. We provide an overview of different classes of models that are required for integrating SHM in the decision-making process to support management and operation and maintenance of structures and infrastructure systems. Fundamental decision-theoretic principles and state-of-the-art methods for optimizing maintenance and operational decision-making under uncertainty are briefly discussed. Finally, we offer a viewpoint on the appropriate course of action for quantifying, validating and maximizing the added value generated by SHM. This work aspires to synthesize the different perspectives of the SHM, Prognostic Health Management (PHM), and reliability communities, and deliver a roadmap towards monitoring-based decision support.
Accurately estimating a Health Index (HI) from condition monitoring data (CM) is essential for reliable and interpretable prognostics and health management (PHM) in complex systems. In most scenarios, complex systems operate under varying operating conditions and can exhibit different fault modes, making unsupervised inference of an HI from CM data a significant challenge. Hybrid models combining prior knowledge about degradation with deep learning models have been proposed to overcome this challenge. However, previously suggested hybrid models for HI estimation usually rely heavily on system-specific information, limiting their transferability to other systems. In this work, we propose an unsupervised hybrid method for HI estimation that integrates general knowledge about degradation into the convolutional autoencoder’s model architecture and learning algorithm, enhancing its applicability across various systems. The effectiveness of the proposed method is demonstrated in two case studies from different domains: turbofan engines and lithium batteries. The results show that the proposed method outperforms other competitive alternatives, including residual-based methods, in terms of HI quality and their utility for Remaining Useful Life (RUL) predictions. The case studies also highlight the comparable performance of our proposed method with a supervised model trained with HI labels.
Ai's role within the domain of Industrial IoT (IIoT) is somewhat obscured by other limelight-stealing feats of AI, such as the creation of convincing deep fakes featuring politicians or celebrities. However, the critical importance of IIoT in domains like consumer goods manufacturing, healthcare, power generation, and transportation mandates a closer examination of the new capabilities and pitfalls spawned by AI technologies.
PHM continues to show its value by improving operational efficiencies, increasing safety, reducing downtime, and decreasing cost of operations. PHM technologies are therefore not only being deployed as retrofit solutions but are being integrated into new systems as standard practice. Deployment covers areas such as medical equipment, nuclear power plants, aeronautics applications, oil and gas, mining, and many others. As the impact of PHM increases, it is imperative to also consider the potential vulnerabilities that are being exposed. Hackers have famously used Supervisory Control and Data Acquisition (SCADA) and Programmable Logic Controller (PLC) systems to sabotage industrial facilities. As such, it is important to understand the exposure to malfeasance to ensure that PHM does not end up being the enabling mechanism for unauthorized access to the system it is meant to keep in running order. It is also important to understand the measures that need to be taken to avoid or respond to an attack. These range from extensive penetration testing to conducting extensive counter-social engineering training, setting up a PHM-specific Computer Emergency Response Team (CERT) plan and team in place. This paper discusses various threats that are emerging and that may have to be considered when designing a PHM solution. Additionally, the National Institute of Standards and Technology (NIST) cybersecurity framework is discussed in the context of PHM. Finally, this paper looks at the diagnostic capabilities of PHM systems to detect cyber security attacks and to contain these threats.
Developing Health Indicators (HI) is a crucial aspect of prognostics and health management of complex systems. Previous research has demonstrated the benefits of accurately determining the HI, which can lead to better performance of prognostic models. However, the existing methodologies for determining HI in complex systems are mostly semi-supervised and rely on assumptions that may not hold in real-world scenarios. The existing methods usually involve using a reference set of healthy sensor readings or run-to-failure data to infer HI. But the unsupervised inference of HI from sensor readings, which is challenging in scenarios where diverse operating conditions can mask the effect of degradation on sensor readings, has not been extensively researched. In this paper, we propose a novel physics-informed unsupervised model for determining HI. Unlike previous methods, constrained by assumptions, the proposed method uses prior general knowledge about degradation to infer HI, thereby eliminating the need for a reference set of healthy sensor readings. The proposed unsupervised model is an Autoencoder that incorporates constraints on its latent space to ensure consistency with knowledge about degradation. We assess the efficacy of the proposed model by analyzing a prevalent prognostic case study, specifically the turbofan engine dataset (N-CMAPSS). Our analysis considers the model's sensitivity to data availability and the resulting Health Index's quality, including trendability and monotonicity. Additionally, we investigate the impact of incorporating the Health Index in predicting Remaining Useful Life (RUL). We demonstrate that our proposed method generates a Health Index that exhibits greater monotonicity and trendability than the current state-of-the-art semi-supervised approach. Moreover, our approach for identifying the Health Index leads to enhanced prognostic performance compared to the existing semi-supervised approach.
Physics-based and data-driven models for remaining useful lifetime (RUL) prediction typically suffer from two major challenges that limit their applicability to complex real-world domains: (1) the incompleteness of physics-based models and (2) the limited representativeness of the training dataset for data-driven models. Combining the advantages of these two approaches while overcoming some of their limitations, we propose a novel hybrid framework for fusing the information from physics-based performance models with deep learning algorithms for prognostics of complex safety-critical systems. In the proposed framework, we use physics-based performance models to infer unobservable model parameters related to a system's components health by solving a calibration problem. These parameters are subsequently combined with sensor readings and used as input to a deep neural network, thereby generating a data-driven prognostics model with physics-augmented features. The performance of the hybrid framework is evaluated on an extensive case study comprising run-to-failure degradation trajectories from a fleet of nine turbofan engines under real flight conditions. The experimental results show that the hybrid framework outperforms purely data-driven approaches by extending the prediction horizon by nearly 127%. Furthermore, it requires less training data and is less sensitive to the limited representativeness of the dataset as compared to purely data-driven approaches. Furthermore, we demonstrated the feasibility of the proposed framework on the original CMAPSS dataset, thereby confirming its superior performance.
Maintenance decisions in domains such as aeronautics are becoming increasingly dependent on being able to predict the failure of components and systems. When data-driven techniques are used for this prognostic task, they often face headwinds due to their perceived lack of interpretability. To address this issue, this paper examines how features used in a data-driven prognostic approach correlate with established metrics of monotonicity, trendability, and prognosability. In particular, we use the SHAP model (SHapley Additive exPlanations) from the field of eXplainable Artificial Intelligence (XAI) to analyze the outcome of three increasingly complex algorithms: Linear Regression, Multi-Layer Perceptron, and Echo State Network. Our goal is to test the hypothesis that the prognostics metrics correlate with the SHAP model's explanations, i.e., the SHAP values. We use baseline data from a standard data set that contains several hundred run-to-failure trajectories for jet engines. The results indicate that SHAP values track very closely with these metrics with differences observed between the models that support the assertion that model complexity is a significant factor to consider when explainability is a consideration in prognostics. (c) 2022 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
Gearbox fault diagnosis is expected to significantly improve the reliability, safety and efficiency of power transmission systems. However, planetary gearbox fault diagnosis remains a challenge due to complex responses caused by multiple planetary gears. Model-based gearbox fault diagnosis techniques extract hand-crafted features from sensor data based on underlying physics and statistical analysis, which are not effective in extracting spatial and temporal features automatically. While deep learning methods such as convolutional neural network (CNN) enable automatic feature extraction from multiple sensor sources, they are not capable of extracting spatial and temporal features simultaneously without losing critical feature information. To address this issue, we introduce a novel deep neural network based on bidirectional-convolutional long shortterm memory (BiConvLSTM) networks to determine the type, location, and direction of planetary gearbox faults by extracting spatial and temporal features from both vibration and rotational speed measurements automatically and simultaneously. In particular, a CNN determines spatial correlations between two measurements within one time step automatically by combining signals collected from three accelerometers and one tachometer. Long short-term memory (LSTM) networks identify temporal dependencies between two adjacent time steps. By replacing input-tostate and state-to-state operations in the LSTM cell with convolutional operations, the BiConvLSTM can learn spatial correlations and temporal dependencies without losing critical features. Experimental results have shown that the BiConvLSTM network can detect the type, location, and direction of gearbox faults with higher accuracy than conventional deep learning approaches such as CNN, LSTM, and CNN-LSTM.
The real-time, and accurate inference of model parameters is of great importance in many scientific and engineering disciplines that use computational models (such as a digital twin) for the analysis and prediction of complex physical processes. However, fast and accurate inference for processes of complex systems cannot easily be achieved in real-time with state-of-the-art methods under noisy real-world conditions with the requirement of a real-time response. The primary reason is that the inference of model parameters with traditional techniques based on optimization or sampling often suffers from computational and statistical challenges, resulting in a trade-off between accuracy and deployment time. In this paper, we propose a novel framework for inference of model parameters based on reinforcement learning. The proposed methodology is demonstrated and evaluated on two different physics-based models of turbofan engines. The experimental results demonstrate that the proposed methodology outperforms all other tested methods in terms of speed and robustness, with high inference accuracy.
Prognostics and health management (PHM) is becoming one of the most popular topics for research and development in the aviation industry. The reasons for this are varied, but one of the main ones is that PHM affords the operator with a way to reduce lifecycle operating costs without necessarily adding expensive accessories that might need to be certified. Many of the papers in this special issue discuss PHM techniques that are based on post flight, or off-board, data processing that adds benefits without additional regulatory constraints. On the other hand, regulators themselves are keenly looking at changing regulations to allow more PHM equipment on board and to allow suppliers and operators to gain maintenance credits from their use. All in all, it is a exciting time to be a engineering working on these topics in the aviation sector. While progress is being made in developing better sensors, models, and analytical methods, the field of aviation itself is changing rapidly. It is seeking to become more sustainable by increasing propulsion efficiencies, it has many players looking to develop and commercialize electrical systems, and it is fast undertaking a digital transformation of the entire ecosystem. In response, system developers and researchers in the field are working on a number of key technologies and methodologies to solve some of the issues that these changes have wrought. This special issue on PHM for Aerospace Systems provides a forum to discuss recent advances pertaining to papers that address topics in this field with an emphasis on Prognostics and Health Management. These topics include advances in anomaly detection and diagnostics, uncertainty management for prognostics, resilient design for fault-tolerant operations, systematic evaluation of PHM for maintenance processes, assessment of retrofit solutions for particular aircraft systems, PHM informed decision-making for safe operations of autonomous aerial systems, impact of noise on prognostic performance, and lessons learned from trends in aircraft fatigue failure accidents for Structural Health Monitoring. We hope that this special joint issue of the International Journal of PHM and SAE International Journal of Aerospace will increase the awareness about innovations in the development of PHM technologies in aerospace and believe that this inspires researchers to focus more attention on this important topic. We would like to express our sincere thanks to all the reviewers of this issue who have generously contributed their valuable time and effort to ensure that it lives up to the Journal’s high quality.
When the influence of changing operational and environmental conditions, such as temperature and external loading, is not factored out from sensor data it can be difficult to observe a clear deterioration path. This can significantly affect the task of engineering prognostics and other health management operations. To address this problem of dynamic operating regimes, it is necessary to baseline the data, typically by first finding the operating regimes and then normalizing the data within each regime. This paper describes a baselining solution based on neural networks. A self-organizing map is used to identify the regimes, and a multi-layer perceptron is used to normalize the sensor data according to the detected regimes. Tests are performed on public datasets from a turbofan simulator. The approach can produce similar results to classical methods without the need to specify in advance the number of regimes and the explicit computation of the statistical properties of a hold-out dataset. Importantly, the techniques can be integrated into a deep learning system to perform prognostics in a single pass.
A Bayesian hierarchical model (BHM) is developed to predict bearing life using envelope acceleration data in combination with a degradation model and prior knowledge of the bearing rating life. The BHM enables the inference of individual bearings, groups of bearings, or bearings operating under certain conditions. The key benefit of the BHM approach is that the relationships between the bearing model parameters and their prior distributions can be expressed at different hierarchical levels. We begin our analysis using a bearing rating life calculation L10h and an estimate of its associated failure time distribution. Realistic variations to constrain our prior distribution of the failure time are then applied before measurements are available. When data become available, estimates more representative of our specific batch and operating conditions are inferred, both on the individual bearing level and the bearing group level. The proposed prognostics methodology can be used in situations with varying amounts of data. The presented BHM approach can also be used to predict the remaining useful life (RUL) of bearings both in situations in which the bearing is considered to be in a healthy state and in situations after a defect has been detected.
Prognostics and health management (PHM) of bearings is crucial for reducing the risk of failure and the cost of maintenance for rotating machinery. Model-based prognostic methods develop closed-form mathematical models based on underlying physics. However, the physics of complex bearing failures under varying operating conditions is not well understood yet. To complement model-based prognostics, data-driven methods have been increasingly used to predict the remaining useful life (RUL) of bearings. As opposed to other machine learning methods, ensemble learning methods can achieve higher prediction accuracy by combining multiple learning algorithms of different types. The rationale behind ensemble learning is that higher performance can be achieved by combining base learners that overestimate and underestimate the RUL of bearings. However, building an effective ensemble remains a challenge. To address this issue, the impact of diversity in base learners and extracted features in different degradation stages on the performance of ensemble learning is investigated. The degradation process of bearings is classified into three stages, including normal wear, smooth wear, and severe wear, based on the root-mean-square (RMS) of vibration signals. To evaluate the impact of diversity on prediction performance, vibration data collected from rolling element bearings was used to train predictive models. Experimental results have shown that the performance of the proposed ensemble learning method is significantly improved by selecting diverse features and base learners in different degradation stages.
A key enabler of intelligent maintenance systems is the ability to predict the remaining useful lifetime (RUL) of its components, i.e., prognostics. The development of data-driven prognostics models requires datasets with run-to-failure trajectories. However, large representative run-to-failure datasets are often unavailable in real applications because failures are rare in many safety-critical systems. To foster the development of prognostics methods, we develop a new realistic dataset of run-to-failure trajectories for a fleet of aircraft engines under real flight conditions. The dataset was generated with the Commercial Modular Aero-Propulsion System Simulation (CMAPSS) model developed at NASA. The damage propagation modelling used in this dataset builds on the modelling strategy from previous work and incorporates two new levels of fidelity. First, it considers real flight conditions as recorded on board of a commercial jet. Second, it extends the degradation modelling by relating the degradation process to its operation history. This dataset also provides the health, respectively, fault class. Therefore, besides its applicability to prognostics problems, the dataset can be used for fault diagnostics.