Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software reliability model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Development of Hierarchical Control for a Lunar Habitat DC Microgrid Model Using Power Hardware-in-the-Loop

As interest in space exploration grows, developing a lunar habitat has become a key component of extending missions into deep space. To guarantee reliable power management of a habitat’s DC microgrid, control schemes are needed that can manage the different assets (batteries, photovoltaics, loads) effectively. Proposed hierarchical control schemes are further developed into hardware solutions using Opal-RT’s real-time simulation software and Power Hardware-in-the-Loop platform. Experimental results of a simulated DC microgrid and physical DC/DC components can allow better realization and performance of applications such as battery discharge control.

PHIL↗

Coupled Solid Rocket Motor Ballistics and Trajectory Modeling for Higher Fidelity Launch Vehicle Design

Multi-stage launch vehicles with solid rocket motors (SRMs) face design optimization challenges, especially when the mission scope changes frequently. Significant performance benefits can be realized if the solid rocket motors are optimized to the changing requirements. While SRMs represent a fixed performance at launch, rapid design iterations enable flexibility at design time, yielding significant performance gains. The streamlining and integration of SRM design and analysis can be achieved with improved analysis tools. While powerful and versatile, the Solid Performance Program (SPP) is not conducive to rapid design iteration. Performing a design iteration with SPP and a trajectory solver is a labor intensive process. To enable a better workflow, SPP, the Program to Optimize Simulated Trajectories (POST), and the interfaces between them have been improved and automated, and a graphical user interface (GUI) has been developed. The GUI enables real-time visual feedback of grain and nozzle design inputs, enforces parameter dependencies, removes redundancies, and simplifies manipulation of SPP and POST's numerous options. Automating the analysis also simplifies batch analyses and trade studies. Finally, the GUI provides post-processing, visualization, and comparison of results. Wrapping legacy high-fidelity analysis codes with modern software provides the improved interface necessary to enable rapid coupled SRM ballistics and vehicle trajectory analysis. Low cost trade studies demonstrate the sensitivities of flight performance metrics to propulsion characteristics. Incorporating high fidelity analysis from SPP into vehicle design reduces performance margins and improves reliability. By flying an SRM designed with the same assumptions as the rest of the vehicle, accurate comparisons can be made between competing architectures. In summary, this flexible workflow is a critical component to designing a versatile launch vehicle model that can accommodate a volatile mission scope.

Ables, Brett↗

IMPROVED ALGORITHMS FOR RADAR-BASED RECONSTRUCTION OF ASTEROID SHAPES

We describe our implementation of a global-parameter optimizer and Square Root Information Filter into the asteroid-modeling software shape. We compare the performance of our new optimizer with that of the existing sequential optimizer when operating on various forms of simulated data and actual asteroid radar data. In all cases, the new implementation performs substantially better than its predecessor: it converges faster, produces shape models that are more accurate, and solves for spin axis orientations more reliably. We discuss potential future changes to improve shape's fitting speed and accuracy.

79 ASTRONOMY AND ASTROPHYSICS↗

Methods for Translating ReEDS Solutions to Production Cost Modeling Tools

Capacity expansion modeling tools are increasingly being utilized to investigate a wide range of potential future scenarios, particularly with high penetrations of variable and energy-constrained resources that may be operated differently than current dispatch paradigms. While capacity expansion models are particularly adept at making investment decisions for future years, they must make compromises in operational aspects to maintain computational tractability. However, it is of high interest to determine if such future systems would be able to maintain reliability during a variety of grid conditions, and to identify any potential operational challenges for these systems at finer temporal resolution than is typically captured in CEMs. As such, there is value in having an automated tool that can convert many CEM investment pathways into inputs for a more detailed production cost model, in this case the PLEXOS commercial software package. This paper describes the methodology used to make that translation for the NREL-developed ReEDS model, making use of two internally developed tools - PIDG and beetle - along with a set of processing scripts. We describe the current assumptions, data sets, and important operational characteristics of these translations along with an example of the extended analyses that may be done through this connection.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Software Construction and Analysis Tools for Future Space Missions

NASA and its international partners will increasingly depend on software-based systems to implement advanced functions for future space missions, such as Martian rovers that autonomously navigate long distances exploring geographic features formed by surface water early in the planet's history. The software-based functions for these missions will need to be robust and highly reliable, raising significant challenges in the context of recent Mars mission failures attributed to software faults. After reviewing these challenges, this paper describes tools that have been developed at NASA Ames that could contribute to meeting these challenges; 1) Program synthesis tools based on automated inference that generate documentation for manual review and annotations for automated certification. 2) Model-checking tools for concurrent object-oriented software that achieve memorability through synergy with program abstraction and static analysis tools.

Lowry, Michael R.↗

Problem Complexity and LLM: H-M Team Reliability in Challenging Environments

In traditional human-machine operations, the functional decomposition of actions and responsibilities among various agents is assigned a priori. For instance, in current air traffic operations, although assisted by software, human pilots have the ultimate control of aircraft. Multiagent human-machine and machine-machine systems will face problems of varying and potentially unpredicted complexity in future challenging scenarios of planetary, en route, and orbital activities. Hence, it is important to enable dynamic transfer of decision-making to appropriate team members, human or machine, depending on which agent is best equipped to solve that specific problem on a time budget. In this paper, we consider aspects of problem-solving and its modeling that affect the outcomes of decision-making as a function of solution quality and the likelihood of solving the problem on a required time budget. We focus on Large Language Models (LLM) as potential machine teammates and conclude that practical, predictive modeling of their performance, at the current stage of their development, is infeasible. Simple examples help us illustrate that current LLM will require fundamental advancements to provide reliable support in team decision-making, especially in safety-critical and time-critical domains. The study is not meant to diminish the value of the remarkable capabilities of LLM, but rather to gain a better understanding of the technology’s appropriate use and the needed additions.

function allocation↗

CARES/Life Ceramics Durability Evaluation Software Used for Mars Microprobe Aeroshell

The CARES/Life computer program, which was developed at the NASA Lewis Research Center, predicts the probability of a monolithic ceramic component's failure as a function of time in service. The program has many features and options for materials evaluation and component design. It couples commercial finite element programs-which resolve a component's temperature and stress distribution-to-reliability evaluation and fracture mechanics routines for modeling strength-limiting defects. These routines are based on calculations of the probabilistic nature of the brittle material's strength. The capability, flexibility, and uniqueness of CARES/Life has attracted many users representing a broad range of interests and has resulted in numerous awards for technological achievements and technology transfer.

Nemeth, Noel N.↗

Three-dimensional phenotyping of peach tree-crown architecture utilizing terrestrial laser scanning

Tree training systems for temperate fruit have been developed throughout history by pomologists to improve light interception, fruit yield, and fruit quality. These training systems direct crown and branch growth to specific configurations. Quantifying crown architecture could aid the selection of trees that require less pruning or that naturally excel in specific growing/training system conditions. Regarding peaches [Prunus persica (L.) Batsch], access tools such as branching indices have been developed to characterize tree-crown architecture. However, the required branching data (BD) to develop these indices are difficult to collect. Traditionally, BD have been collected manually, but this process is tedious, time-consuming, and prone to human error. These barriers can be circumnavigated by utilizing terrestrial laser scanning (TLS) to obtain a digital twin of the real tree. TLS generates three-dimensional (3D) point clouds of the tree crown, wherein every point contains 3D coordinates (x, y, z). To facilitate the use of these tools for peach, we selected 16 young peach trees scanned in 2021 and 2022. These 16 trees were then modeled and quantified using the open-source software TreeQSM. As a result, “in silico” branching and biometric data for the young peach trees were calculated to demonstrate the capabilities of TLS phenotyping of peach tree-crown architecture. The comparison and analysis of field measurements (in situ) and in silico BD, biometric data, and quantitative structural model branch uncertainty data were utilized to determine the reconstructive model’s reliability as a source substitute for field measurements. Mean average deviation when comparing young tree (YT) height was approx. 5.93%, with crown volume was approx. 13.26% across both 2021 and 2022. All point clouds of the YTs in 2022 showed residuals lower than 12 mm to cylinders fitted to all branches, and mean surface coverage greater than 40% for both the trunk and primary branching orders.

09 BIOMASS FUELS↗

The specification-based validation of reliable multicast protocol: Problem Report

Reliable Multicast Protocol (RMP) is a communication protocol that provides an atomic, totally ordered, reliable multicast service on top of unreliable IP multicasting. In this report, we develop formal models for RMP using existing automated verification systems, and perform validation on the formal RMP specifications. The validation analysis help identifies some minor specification and design problems. We also use the formal models of RMP to generate a test suite for conformance testing of the implementation. Throughout the process of RMP development, we follow an iterative, interactive approach that emphasizes concurrent and parallel progress of implementation and verification processes. Through this approach, we incorporate formal techniques into our development process, promote a common understanding for the protocol, increase the reliability of our software, and maintain high fidelity between the specifications of RMP and its implementation.

Wu, Yunqing↗

Reliability Analysis for AFTI-F16 SRFCS Using ASSIST and SURE

This paper reports the results of a study on reliability analysis of an AFTI-16 Self-Repairing Flight Control System (SRFCS) using software tools SURE (Semi-Markov Unreliability Range Evaluator and ASSIST (Abstract Semi-Markov Specification Interface to the SURE Tool). The purpose of the study is to investigate the potential utility of the software tools in the ongoing effort of the NASA Aviation Safety Program, where the class of systems must be extended beyond the originally intended serving class of electronic digital processors. The study concludes that SURE and ASSIST are applicable to reliability, analysis of flight control systems. They are especially efficient for sensitivity analysis that quantifies the dependence of system reliability on model parameters. The study also confirms an earlier finding on the dominant role of a parameter called a failure coverage. The paper will remark on issues related to the improvement of coverage and the optimization of redundancy level.

Wu, N. Eva↗

Closed-Loop Evaluation of an Integrated Failure Identification and Fault Tolerant Control System for a Transport Aircraft

Formal robustness analysis of aircraft control upset prevention and recovery systems could play an important role in their validation and ultimate certification. Such systems developed for failure detection, identification, and reconfiguration, as well as upset recovery, need to be evaluated over broad regions of the flight envelope or under extreme flight conditions, and should include various sources of uncertainty. To apply formal robustness analysis, formulation of linear fractional transformation (LFT) models of complex parameter-dependent systems is required, which represent system uncertainty due to parameter uncertainty and actuator faults. This paper describes a detailed LFT model formulation procedure from the nonlinear model of a transport aircraft by using a preliminary LFT modeling software tool developed at the NASA Langley Research Center, which utilizes a matrix-based computational approach. The closed-loop system is evaluated over the entire flight envelope based on the generated LFT model which can cover nonlinear dynamics. The robustness analysis results of the closed-loop fault tolerant control system of a transport aircraft are presented. A reliable flight envelope (safe flight regime) is also calculated from the robust performance analysis results, over which the closed-loop system can achieve the desired performance of command tracking and failure detection.

Shin, Jong-Yeob↗

Deepak Condenser Model (DeCoM)

Development of the DeCoM comes from the requirement of analyzing the performance of a condenser. A component of a loop heat pipe (LHP), the condenser, is interfaced with the radiator in order to reject heat. DeCoM simulates the condenser, with certain input parameters. Systems Improved Numerical Differencing Analyzer (SINDA), a thermal analysis software, calculates the adjoining component temperatures, based on the DeCoM parameters and interface temperatures to the radiator. Application of DeCoM is (at the time of this reporting) restricted to small-scale analysis, without the need for in-depth LHP component integrations. To efficiently develop a model to simulate the LHP condenser, DeCoM was developed to meet this purpose with least complexity. DeCoM is a single-condenser, single-pass simulator for analyzing its behavior. The analysis is done based on the interactions between condenser fluid, the wall, and the interface between the wall and the radiator. DeCoM is based on conservation of energy, two-phase equations, and flow equations. For two-phase, the Lockhart- Martinelli correlation has been used in order to calculate the convection value between fluid and wall. Software such as SINDA (for thermal analysis analysis) and Thermal Desktop (for modeling) are required. DeCoM also includes the ability to implement a condenser into a thermal model with the capability of understanding the code process and being edited to user-specific needs. DeCoM requires no license, and is an open-source code. Advantages to DeCoM include time dependency, reliability, and the ability for the user to view the code process and edit to their needs.

Patel, Deepak↗

Computational methods and software systems for dynamics and control of large space structures

The deployment, assembly and mission-oriented maneuvering of space structures in orbit will trigger large motions of flexible, truss-type structures. In addition, the presence of on-board controls both for attitude stabilization and specified vibration tolerance requirements may further complicate the dynamic behavior of the orbiting structures. Because of safety and cost considerations, the dynamic response of the combined structural and control systems must be predicted reliably. This need can only be met through the development of reliable and efficient simulation capabilities, since there is general agreement that on-orbit experiments should be limited because of cost, time and facility constraints. The long-term objective of this research effort is to develop a next-generation computer simulator for the dynamics and control of large space structures. The simulator will be based on integrating four research thrusts: a new multibody dynamics formulation methodology, modeling capabilities in long/slender truss-beam components with realistic joints, efficient computational procedures that can be implemented either in sequential or concurrent computers, and prototype simulation modules that can be easily processed into a modern large-scale engineering software system such as the NASA/Computational Structural Mechanics (CSM) testbed.

Park, K. C.↗

R&D to Ensure a Scientific Basis for Qualification Tests and Standards (Final Report)

Project return on investment in a photovoltaic (PV) system depends increasingly on maintaining high energy yields, and the system lifetime is a major factor in levelized cost of electricity (LCOE). Thus, the rate of PV deployment and the success of these assets depends upon reliable long-term power generation. The overarching objective of this program is to improve photovoltaic (PV) module reliability via development of tests and standards. Where reliability problems or risk are discovered, we can design tests to ensure that these liabilities don't affect future generations of products. Customers can use these tests to understand which products are susceptible to certain degradation mechanisms, and manufacturers can use the tests to design unwanted characteristics out of their products. The work under this program identifies PV reliability needs, performs characterization that provides scientific understanding of targeted degradation mechanisms, and translates those data into practical and predictive test protocols and standards. Major accomplishments include: A model for polarization-type potential induced degradation (PID-p) was developed and validated against experimental data. NREL is currently leading a new edition of IEC 62804-1 for PID detection. PID-p can cause large losses in current and voltage for some module designs on cloudy days. Finite element modeling (FEM) and experiment was used to determine when cells crack in a module. It was shown that cells in landscape orientation are much more likely to crack than those on portrait orientation. Shortly thereafter, the first products with portrait-oriented cells were introduced. Studies of how to test for light and elevated temperature degradation (LeTID) culminated with the publication of IEC TS 63342. Software to predict the progression of LeTID was developed, validated, and made publicly available. Field validated tests and international standards for durability of PV module coatings abrasion, backsheets, and encapsulants were developed. Examples are IEC 62788-1-1, IEC 62788-2 ED2, IEC TS 62788-7-2, IEC 62788-7-3 ED1, IEC 63209-2. NREL led the development a high-temperature testing technical specification, and published guidelines that enable installers to determine whether higher-temperature testing is needed, simply based on location and mounting configuration. In a number of our case studies, variations in the bills of materials or workmanship have been associated with variations in reliability. These observations emphasize the importance of quality assurance to reliability. A framework for criticality (i.e. Pareto) analysis was developed and published. The framework helps us and other researchers determine what problems should be addressed for reliability research to have the biggest industry impact. NREL continues to participate actively in international standards development and stakeholder engagement activities, including organizing an annual PV Reliability Workshop. These activities are important for ensuring we address issues that are relevant and timely, and that we convey our results to those who may benefit.

14 SOLAR ENERGY↗

Application of High Performance Computing for Simulating Cycle-to-Cycle Variation in Dual-Fuel Combustion Engines

Interest in operational cost reduction is driving engine manufacturers to consider lower-cost fuel substitution in heavy-duty diesel engines. These dual-fuel (DF) engines could be operated either in diesel-only mode or operated with premixed natural gas (NG) ignited by a pilot flame of compression-ignited direct-injected diesel fuel. One promising application is that of large-bore, medium-speed engines such as those used in locomotives. With realistic natural gas substitution levels in the fleet of locomotives currently in service, such fuel substitution could result in billions of dollars of savings annually in the US alone. However, under certain conditions, dual-fuel operation can result in increased cycle-to-cycle variability (CCV) during combustion, resulting in variations in cylinder pressure and work extraction. In certain situations, the CCV of dual-fuel operation can be notably higher than that of diesel-only combustion under similar operating conditions. Excessive CCV can limit the NG substitution rate and operating range of a dual-fuel engine by increasing emissions and reducing engine stability, reliability and fuel efficiency via incomplete natural-gas combustion. Running multiple engine cycles in series to simulate CCV can be quite time consuming. Hence innovative modelling techniques and large computing resources are needed to investigate the factors affecting CCV in dual-fuel engines. This paper discusses the use of the High Performance Computing resource Titan, at the Oak Ridge Leadership Computing Facility at Oak Ridge National Laboratory, to investigate cycle-to-cycle combustion variability of a dual-fuel engine. The CONVERGE CFD software was used to simulate multiple, parallel single cycles of dual-fuel combustion with perturbed operating parameters and boundary conditions. These perturbations are imposed according to a sparse grids sampling of the parameter space. The sampling scheme chosen is similar to a design of experiments method but uses functions designed to minimize the number of samples required to achieve a desired degree of accuracy. The perturbed input parameters were connected to engine performance output over a large parameter space. Additionally, the same methodology was used to perform a set of diesel-only simulations at similar operating conditions to assess the numerical capability of capturing relatively low combustion variation. Lastly, this technique is expected to be useful to understand and predict combustion stability limits (knock and misfire) which are important for designing dual-fuel engines with improved operability and reliability.

33 ADVANCED PROPULSION SYSTEMS↗

The Specification-Based Validation of Reliable Multicast Protocol

Reliable Multicast Protocol (RMP) is a communication protocol that provides an atomic, totally ordered, reliable multicast service on top of unreliable IP multicasting. In this report, we develop formal models for RMP using existing automated verification systems, and perform validation on the formal RMP specifications. The validation analysis help identifies some minor specification and design problems. We also use the formal models of RMP to generate a test suite for conformance testing of the implementation. Throughout the process of RMP development, we follow an iterative, interactive approach that emphasizes concurrent and parallel progress of the implementation and verification processes. Through this approach, we incorporate formal techniques into our development process, promote a common understanding for the protocol, increase the reliability of our software, and maintain high fidelity between the specifications of RMP and its implementation.

Wu, Yunqing↗

Credible Software and Simulation Uncertainty

The utility of software primarily depends on its reliability and performance; whereas, its significance depends solely on its credibility for intended use. The credibility of simulations confirms the credibility of software. The level of veracity and the level of validity of simulations determine the degree of credibility of simulations. The process of assessing this credibility in fields such as computational mechanics (CM) differs from that followed by the Defense Modeling and Simulation Office in operations research. Verification and validation (V&V) of CM simulations is not the same as V&V of CM software. Uncertainty is the measure of simulation credibility. Designers who use software are concerned with management of simulation uncertainty. Terminology and concepts are presented with a few examples from computational fluid dynamics.

Mehta, Unmeel B.↗

On-Board Model Based Fault Diagnosis for CubeSat Attitude Control Subsystem: Flight Data Results

Self-sufficient, robotic spacecraft require estimates of their hardware health state in order to project future system state and plan actions toward achieving mission goals. In this paper, we report on integration of a Model-Based Fault Diagnosis (MBFD) model and reasoning engine into flight software leveraging the Arcsecond Space Telescope Enabling Research in Astrophysics (ASTERIA) mission, including test results against captured flight data using the ASTERIA system testbed. Our effort integrated the Model-based Off-Nominal State Identification and Detection (MONSID) model-based reasoning system, developed by Okean Solutions, into ASTERIA flight software using the F Prime software framework. The MONSID engine was supplied with a model of the Blue Canyon Technologies XACT attitude control system (ACS) and tested against flight data and seeded fault tests. While we were unable to conduct an on-board experiment due to the premature loss of ASTERIA, our effort proved the feasibility of on-board model-based fault management, demonstrating reliable and accurate diagnosis using captured data, and further supporting a closed-loop spacecraft autonomy demonstration including autonomous navigation in off-nominal conditions.

Prather, Maurice↗