Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “reliability prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60

Results of the Grid Friendly Appliance Project

As part of the Pacific Northwest GridWise™ Testbed Demonstration funded by the U.S. Department of Energy and others, Pacific Northwest National Laboratory (PNNL) collaborated with Whirlpool Corporation, Invensys Controls, the Bonneville Power Administration, PacifiCorp, Portland General Electric and several smaller utilities to install 150 new Sears Kenmore clothes dryers and to retrofit 50 existing electric water heaters in homes in Washington and Oregon. Each dryer and water heater was configured to respond to the Grid Friendly™ appliance controller, a small electronic circuit that sensed underfrequency grid conditions and requested that electric load be shed by the appliances. These controllers and appliances were observed for over a year in residences spread over a wide geographic area. The controllers were found to respond predictably and reliably despite their geographic separation. Over 350 minor underfrequency events were observed during the experiment. This paper presents the distributions of these events by season and by time of day. Based on measured load profiles for the dryers and water heaters, the average electrical load that can be shed by each of the two appliance types was estimated by time of day and by season. Battelle Memorial Institute and PNNL have been assembling a suite of grid-responsive functions and benefits that can be achieved through the control of relatively small, distributed loads and resources on a power grid. These controllers should eventually receive acceptance for the opportunities they offer for circuit protection, regulation services, facilitation of demand responsiveness, and even power quality.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

REACTOR PRESSURE VESSEL ISSUES FOR THE LIGHT-WATER REACTOR SUSTAINABILITY PROGRAM

The Light Water Reactor Sustainability Program Plan is a collaborative program between the U.S. Department of Energy and the private sector directed at extending the life of the present generation of nuclear power plants to enable operation to at least 80 years. The reactor pressure vessel (RPV) is one of the primary components requiring significant research to enable such long-term operation. There are significant issues that need to be addressed to reduce the uncertainties in regulatory application, such as, 1) high neutron fluence/long irradiation times, and flux effects, 2) material variability, 3) high-nickel materials, 4)specimen size effects and the fracture toughness master curve, etc. The first issue is the highest priority to obtain the data and mechanistic understanding to enable accurate, reliable embrittlement predictions at high fluences. This paper discusses the major issues associated with long-time operation of existing RPVs and the LWRSP plans to address those issues.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Laying the Foundation for a Predictive Theory of Electroweak Nuclear Phenomena

Reliable model-independent predictions of nuclear processes such as beta-decay and neutrinonucleus scattering are important for many fundamental science and mission-related investigations; For example, accurate descriptions of as beta-decay are required for modeling the anti-neutrino spectrum of nuclear reactor, whether for trying to detect new physics such as sterile neutrinos, or remotely identifying the purpose of that reactor. For these activities, we need accurate calculations, as well as careful and thorough analyses of theoretical error and uncertainty in the underlying models and the many-body methods and codes used in solving that model. Unfortunately, modern theoretical calculations of these processes are inadequate for this task. At the heart of this inadequacy is the interaction between nucleons and other particles known as nuclear currents. Historically, descriptions of nuclear currents took into account only the simplest of particle interactions. Recently, the development of an effective field theory known as chiral EFT has been used to derive large corrections to these particle interactions. However, the complex nature of these corrections inhibited their use in ab initio methods of predicting nuclear processes. We developed a novel method to address these complexities and applied it in a series of benchmark and demonstrative calculations using state-of-the-art quantum few-nucleon solvers. Specifically, we studied the role of two-nucleon currents in electroweak processes using light nuclei (i.e., nuclei containing fewer than five nucleons) as a workbench to compute these processes and quantify their uncertainties using Bayesian extensions of the EFT.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Dynamic Model Agnostic Reliability Evaluation of Machine-Learning Models Integrated in Instrumentation & Control Systems

In recent years, the field of machine learning (ML), specifically neural networks, has grown significantly and has spurred research in its applicability to digital instrumentation and control systems (DI&C). While ML models have shown promise in operational contexts, the trustworthiness of using such algorithms has not been adequately assessed. Failures of ML integrated systems are not well understood, and the lack of comprehensive risk modeling can degrade the trustworthiness in these systems. In recent reports by the National Institute for Standards and Technology (NIST) [1] and the Nuclear Regulatory Commission (NRC) [2], they indicate that trustworthiness in ML is a critical barrier and will play a vital role in the safe, accountable, and secure operation of intelligent systems. Thus, in this work, we demonstrate a dynamic model-agnostic method to quantify the relative reliability of AI/ML predictions by incorporating out-of-distribution (OOD) detection on the training dataset. It is well documented that most ML algorithms excel at interpolation (or near-interpolation) tasks but experience significant performance degradation at extrapolation. The method, referenced as the Laplacian distributed decay for reliability (LADDR), determines the difference between the operational and training datasets which can used to the relative reliability of AI/ML predictions. LADDR is then demonstrated on a feedforward neural network based digital twin used for the prediction of safety significant factors during a loss-of-flow transient. LADDR is used to demonstrate how training data can be used as evidence to support the relative reliability of ML/AI predictions enhancing the overall trustworthiness of the system.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Interconnect fatigue design for terrestrial photovoltaic modules

The results of comprehensive investigation of interconnect fatigue that has led to the definition of useful reliability-design and life-prediction algorithms are presented. Experimental data indicate that the classical strain-cycle (fatigue) curve for the interconnect material is a good model of mean interconnect fatigue performance, but it fails to account for the broad statistical scatter, which is critical to reliability prediction. To fill this shortcoming the classical fatigue curve is combined with experimental cumulative interconnect failure rate data to yield statistical fatigue curves (having failure probability as a parameter) which enable (1) the prediction of cumulative interconnect failures during the design life of an array field, and (2) the unambiguous--ie., quantitative--interpretation of data from field-service qualification (accelerated thermal cycling) tests. Optimal interconnect cost-reliability design algorithms are derived based on minimizing the cost of energy over the design life of the array field.

Mon, G. R.↗

Ecosystem biogeochemistry model parameterization: Do more flux data result in a better model in predicting carbon flux?

Reliability of terrestrial ecosystem models highly depends on the quantity and quality of thedata that have been used to calibrate the models. Nowadays, in situ observations of carbon fluxes areabundant. However, the knowledge of how much data (data length) and which subset of the time seriesdata (data period) should be used to effectively calibrate the model is still lacking. This study uses theAmeriFlux carbon flux data to parameterize the Terrestrial Ecosystem Model (TEM) with an adjoint-baseddata assimilation technique for various ecosystem types. Parameterization experiments are thus conductedto explore the impact of both data length and data period on the uncertainty reduction of the posteriormodel parameters and the quantification of site and regional carbon dynamics. We find that: the modelis better constrained when it uses two-year data comparing to using one-year data. Further, two-year datais sufficient in calibrating TEM’s carbon dynamics, since using three-year data could only marginallyimprove the model performance at our study sites; the model is better constrained with the data thathave a higher‘‘climate variability’’than that having a lower one. The climate variability is used to measurethe overall possibility of the ecosystem to experience all climatic conditions including drought and extremeair temperatures and radiation; the U.S. regional simulations indicate that the effect of calibration datalength on carbon dynamics is amplified at regional and temporal scales, leading to large discrepanciesamong different parameterization experiments, especially in July and August. Our findings areconditioned on the specific model we used and the calibration sites we selected. The optimal calibrationdata length may not be suitable for other models. However, this study demonstrates that there may exist athreshold for calibration data length and simply using more data would not guarantee a better modelparameterization and prediction. More importantly, climate variability might be an effective indicator ofinformation within the data, which could help data selection for model parameterization. As a result, we believe ourfindings will benefit the ecosystem modeling community in using multiple-year data to improve modelpredictability.

59 BASIC BIOLOGICAL SCIENCES↗

Reliability Modeling of Microelectromechanical Systems Using Neural Networks

Microelectromechanical systems (MEMS) are a broad and rapidly expanding field that is currently receiving a great deal of attention because of the potential to significantly improve the ability to sense, analyze, and control a variety of processes, such as heating and ventilation systems, automobiles, medicine, aeronautical flight, military surveillance, weather forecasting, and space exploration. MEMS are very small and are a blend of electrical and mechanical components, with electrical and mechanical systems on one chip. This research establishes reliability estimation and prediction for MEMS devices at the conceptual design phase using neural networks. At the conceptual design phase, before devices are built and tested, traditional methods of quantifying reliability are inadequate because the device is not in existence and cannot be tested to establish the reliability distributions. A novel approach using neural networks is created to predict the overall reliability of a MEMS device based on its components and each component's attributes. The methodology begins with collecting attribute data (fabrication process, physical specifications, operating environment, property characteristics, packaging, etc.) and reliability data for many types of microengines. The data are partitioned into training data (the majority) and validation data (the remainder). A neural network is applied to the training data (both attribute and reliability); the attributes become the system inputs and reliability data (cycles to failure), the system output. After the neural network is trained with sufficient data. the validation data are used to verify the neural networks provided accurate reliability estimates. Now, the reliability of a new proposed MEMS device can be estimated by using the appropriate trained neural networks developed in this work.

Perera. J. Sebastian↗

Dynamic Model Agnostic Reliability Evaluation of Machine-Learning Models Integrated in Instrumentation & Control Systems

In recent years, the field of data-driven neural network-based machine learning (ML) algorithms has grown significantly and spurred research in its applicability to instrumentation and control systems. While they are promising in operational contexts, the trustworthiness of such algorithms is not adequately assessed. Failures of ML-integrated systems are poorly understood; the lack of comprehensive risk modeling can degrade the trustworthiness of these systems. In recent reports by the National Institute for Standards and Technology, trustworthiness in ML is a critical barrier to adoption and will play a vital role in intelligent systems' safe and accountable operation. Thus, in this work, we demonstrate a real-time model-agnostic method to evaluate the relative reliability of ML predictions by incorporating out-of-distribution detection on the training dataset. It is well documented that ML algorithms excel at interpolation (or near-interpolation) tasks but significantly degrade at extrapolation. This occurs when new samples are "far" from training samples. The method, referred to as the Laplacian distributed decay for reliability (LADDR), determines the difference between the operational and training datasets, which is used to calculate a prediction's relative reliability. LADDR is demonstrated on a feedforward neural network-based model used to predict safety significant factors during different loss-of-flow transients. LADDR is intended as a "data supervisor" and determines the appropriateness of well-trained ML models in the context of operational conditions. Ultimately, LADDR illustrates how training data can be used as evidence to support the trustworthiness of ML predictions when utilized for conventional interpolation tasks.

97 MATHEMATICS AND COMPUTING↗

Software reliability studies

There are many software reliability models which try to predict future performance of software based on data generated by the debugging process. Our research has shown that by improving the quality of the data one can greatly improve the predictions. We are working on methodologies which control some of the randomness inherent in the standard data generation processes in order to improve the accuracy of predictions. Our contribution is twofold in that we describe an experimental methodology using a data structure called the debugging graph and apply this methodology to assess the robustness of existing models. The debugging graph is used to analyze the effects of various fault recovery orders on the predictive accuracy of several well-known software reliability algorithms. We found that, along a particular debugging path in the graph, the predictive performance of different models can vary greatly. Similarly, just because a model 'fits' a given path's data well does not guarantee that the model would perform well on a different path. Further we observed bug interactions and noted their potential effects on the predictive process. We saw that not only do different faults fail at different rates, but that those rates can be affected by the particular debugging stage at which the rates are evaluated. Based on our experiment, we conjecture that the accuracy of a reliability prediction is affected by the fault recovery order as well as by fault interaction.

Hoppa, Mary Ann↗

Interpolation/extrapolation technique with application to hypervelocity impact of space debris

A new technique for the interpolation/extrapolation of engineering data is described. The technique easily allows for the incorporation of additional independent variables, and the most suitable data in the data base is automatically used for each prediction. The technique provides diagnostics for assessing the reliability of the prediction. Two sets of predictions made for known 5-degree-of-freedom, 15-parameter functions using the new technique produced an average coefficient of determination of 0.949. Here, the technique is applied to the prediction of damage to the Space Station from hypervelocity impact of space debris. A new set of impact data is presented for this purpose. Reasonable predictions for bumper damage were obtained, but predictions of pressure wall and multilayer insulation damage were poor.

Rule, William K.↗

ASME V\&V challenge problem: Surrogate-based V&V

The process of verification and validation can be resource intensive. From the computational model perspective, the resource demand typically arises from long simulation run times on multiple cores coupled with the need to characterize and propagate uncertainties. In addition, predictive computations performed for safety and reliability analyses have similar resource requirements. For this reason, there is a tradeoff between the time required to complete the requisite studies and the fidelity or accuracy of the results that can be obtained. At a high level, our approach is cast within a validation hierarchy that provides a framework in which we perform sensitivity analysis, model calibration, model validation, and prediction. The evidence gathered as part of these activities is mapped into the Predictive Capability Maturity Model to assess credibility of the model used for the reliability predictions. With regard to specific technical aspects of our analysis, we employ surrogate-based methods, primarily based on polynomial chaos expansions and Gaussian processes, for model calibration, sensitivity analysis, and uncertainty quantification in order to reduce the number of simulations that must be done. The goal is to tip the tradeoff balance to improving accuracy without increasing the computational demands.

42 ENGINEERING↗

The Reliability of Hybrid Functionals for Accurate Fundamental and Optical Gap Prediction of Bulk Solids and Surfaces

Hybrid functionals have been considered insufficiently reliable for the prediction of band gaps in solids and surfaces. We revisit this issue with a new generation of optimally tuned range-separated hybrid functionals, focusing on the reconstructed Si(111)-(2×1) and Ge(111)-(2×1) surfaces. We show that certain hybrid functionals can accurately predict the surface-state and bulk fundamental and optical gaps, as well as projected band structures of these surfaces, by combining ground-state and time-dependent density functional theory.

Sagredo, Francisca↗

Enabling Efficient Surveillance, Control, and Automation of Geothermal Operations with Advanced Predictive Analytics

Automation and control of geothermal energy production and operations require reliable and efficient predictive tools. While physics-based simulation offers a comprehensive tool for predicting energy production performance in geothermal systems, predicting the behavior of geothermal reservoirs involves complex multi-physics processes with coupling effects, highly uncertain input parameters and subsurface descriptions. Moreover, building, running, and integrating simulation models into standard model calibration and optimization workflows entail significant technical and computational efforts. An emerging alternative to physics-based simulation is data-driven predictive analytics models that have gained popularity in energy industry. In this report, we develop novel predictive models for integration into real-time fault diagnosis and model predictive control algorithms to improve the efficiency of energy production operations in geothermal reservoirs. The report includes two major research Thrust Areas, that is, the surface power plant and the subsurface reservoir.

15 GEOTHERMAL ENERGY↗

A Multiphysics Multiscale Simulation Platform for Damage, Environmental Degradation, and Life Prediction of CMCs in Extreme Environments

This project successfully developed a multiphysics, multiscale computational framework to enhance the design and development of CMCs, with a focus on modeling highly nonlinear, time-dependent damage mechanisms and material degradation under extreme conditions, such as those experienced in turbine service environments. The project made significant advances in improving our understanding of progressive damage, oxidative degradation, and time-dependent inelastic deformation in CMCs, with particular attention to the role of uncertainties in predictions. Key outcomes include the integration of advanced material characterization, uncertainty quantification, and multiphysics constitutive models to predict the behavior of CMCs over their service life. A novel multiscale methodology was employed, which integrated microscale constituent behaviors with structural-scale responses, enabling the manufacturing defects in the microstructure that are prone to damage nucleation. Through the development of DL algorithms, the project advanced the prediction of damage initiation and crack propagation, taking into account the defect morphology and statistical variations across multiple scales. The framework was rigorously validated using thermomechanical experiments, which tested CMCs under various mechanical loadings at elevated temperatures, further enhancing the model's predictive capability. Overall, the research outcomes have provided a more accurate, reliable method for predicting CMC component life, significantly advancing material design, and improving component reliability in extreme environments. This work has strong implications for the optimization of turbine components and other high-performance applications where CMCs are used.

03 NATURAL GAS↗

Centralized and Decentralized Control for Demand Response

Demand response has been recognized as an essential element of the smart grid. Frequency response, regulation and contingency reserve functions performed traditionally by generation resources are now starting to involve demand side resources. Additional benefits from demand response include peak reduction and load shifting, which will defer new infrastructure investment and improve generator operation efficiency. Technical approaches designed to realize these functionalities can be categorized into centralized control and decentralized control, depending on where the response decision is made. This paper discusses these two control philosophies and compares their relative advantages and disadvantages in terms of delay time, predictability, complexity, and reliability. A distribution system model with detailed household loads and controls is built to demonstrate the characteristics of the two approaches. The conclusion is that the promptness and reliability of decentralized control should be combined with the predictability and simplicity of centralized control to achieve the best performance of the smart grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Resource allocatiion: sequential data collection for reliability analysis involving systems and component level data

In analyzing the reliability of complex systems, several types of data from full-system tests to component level tests are commonly available and are used. After a preliminary analysis, additional resources may be available to collect new data. The goal of resource allocation is to identify the best new data to collect to maximally improve the prediction of system reliability. While several possible definitions of 'maximally improve' are possible, we focus on reducing the uncertainty or the width of the uncertainty interval for the prediction of system reliability at a user-specified age(s). In this paper, we present an algorithm that allows us to estimate the anticipated improvement to the analysis with the addition of new data, based on current understanding of all of the statistical model parameters. This quantitative assessment of the anticipated improvement can be helpful to justify the benefits of collecting new data. Additionally by comparing different potential allocations, it is possible to determine what new data should be collected to improve our understanding of the response. This optimization takes into account the relative cost of different data types and can be based on flexible allocation options, or subject to logistical constraints.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Structural Life and Reliability Metrics: Benchmarking and Verification of Probabilistic Life Prediction Codes

Over the past two decades there has been considerable effort by NASA Glenn and others to develop probabilistic codes to predict with reasonable engineering certainty the life and reliability of critical components in rotating machinery and, more specifically, in the rotating sections of airbreathing and rocket engines. These codes have, to a very limited extent, been verified with relatively small bench rig type specimens under uniaxial loading. Because of the small and very narrow database the acceptance of these codes within the aerospace community has been limited. An alternate approach to generating statistically significant data under complex loading and environments simulating aircraft and rocket engine conditions is to obtain, catalog and statistically analyze actual field data. End users of the engines, such as commercial airlines and the military, record and store operational and maintenance information. This presentation describes a cooperative program between the NASA GRC, United Airlines, USAF Wright Laboratory, U.S. Army Research Laboratory and Australian Aeronautical & Maritime Research Laboratory to obtain and analyze these airline data for selected components such as blades, disks and combustors. These airline data will be used to benchmark and compare existing life prediction codes.

Litt, Jonathan S.↗

Reliability Analysis of Uniaxially Ground Brittle Materials

The fast fracture strength distribution of uniaxially ground, alpha silicon carbide was investigated as a function of grinding angle relative to the principal stress direction in flexure. Both as-ground and ground/annealed surfaces were investigated. The resulting flexural strength distributions were used to verify reliability models and predict the strength distribution of larger plate specimens tested in biaxial flexure. Complete fractography was done on the specimens. Failures occurred from agglomerates, machining cracks, or hybrid flaws that consisted of a machining crack located at a processing agglomerate. Annealing eliminated failures due to machining damage. Reliability analyses were performed using two and three parameter Weibull and Batdorf methodologies. The Weibull size effect was demonstrated for machining flaws. Mixed mode reliability models reasonably predicted the strength distributions of uniaxial flexure and biaxial plate specimens.

Salem, Jonathan A.↗