Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software reliability model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Estimation and enhancement of real-time software reliability through mutation analysis

A simulation-based technique for obtaining numerical estimates of the reliability of N-version, real-time software is presented. An extended stochastic Petri net is employed to represent the synchronization structure of N versions of the software, where dependencies among versions are modeled through correlated sampling of module execution times. Test results utilizing specifications for NASA's planetary lander control software indicate that mutation-based testing could hold greater potential for enhancing reliability than the desirable but perhaps unachievable goal of independence among N versions.

Geist, Robert↗

An Approach to Dynamic Human Reliability Analysis Using the EMRALD Dynamic Risk Assessment Tool

There is a need for research into dynamic human reliability analysis (HRA) (i.e., simulation- or computation-based HRA), as many researchers have emphasized the importance of applying dynamic approaches to probabilistic safety assessments (PSAs). This study proposes the Procedure-based Investigation Method of EMRALD Risk Assessment – Human Reliability Analysis (PRIMERA-HRA), a dynamic HRA approach based on the Event Modeling Risk Assessment Using Linked Diagram (EMRALD) software developed by Idaho National Laboratory (INL). This study suggests how this software can be used to model human actions and evaluate error probabilities. The applicability of this approach is also be investigated in light of an extended loss of AC power (ELAP) scenario. This paper then discusses the major insights derived by comparing this dynamic HRA approach against the static one.

99 GENERAL AND MISCELLANEOUS↗

Forecasting Marine Sediment Properties with Geospatial Machine Learning

Using a combination of geospatial machine learning prediction and sediment thermodynamic/physical modeling, we have developed a novel software workflow to create probabilistic maps of geoacoustic and geomechanical sediment properties of the global seabed. This new technique for producing reliable estimates of seafloor properties can better support Naval operations relying on sonar performance and seabed strength, can constrain models of shallow tomographic structure important for nuclear treaty compliance monitoring/detection, and can provide constraints on the distribution and inventory of shallow methane gas and gas hydrate accumulations on the continental shelves.

58 GEOSCIENCES↗

A Bayesian and HRA-Aided Method for the Novel Reliability Analysis of Software

Technological advancements and nuclear power plant modernization has inspired considerable research in the areas of safety and reliability, yet there remains a lack of consensus for the reliability assessment of digital instrumentation and control (I&C) systems. Motivated by the lack of consensus for reliability analysis methods, this work employs a novel framework that incorporates Bayesian, human reliability, and common-cause failure (CCF) modeling techniques. The novel framework allows the use of state-of-the-art or classical modeling techniques when accounting for human and CCF effects on system reliability. The Bayesian and HRA-Aided Method for the Reliability Analysis of Software (BAHAMAS) is demonstrated by a case study for the quantification of software hazards found in a previous analysis of a digital reactor trip system. The results demonstrate the ability of BAHAMAS to account for human activities during the software development life cycle and their influence on software reliability. BAHAMAS is a flexible tool for extending the coverage of conventional probabilistic risk assessments to include modernized digital I&C systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Rich-Text based PSA Model Transformation and Verification in RiskA

Nuclear Energy is one of the most possible alternative to fossil energy in large-scale. Nuclear safety is the lifeline of nuclear energy development, and has been an important part of national security, especially after the accident of Fukushima. On the basis of computer codes, reliability engineering and Probabilistic Risk Assessment (PSA) is effective methods to improve the safety of nuclear power plants. After many years of development, the methodologies, applications and relevant soft programs have been quite sufficient in the area of nuclear safety. However, it is still difficult for the current PSA technologies and software to meet the needs of dealing with the problems of quantitatively public risk assessment in the digital society. Especially, there are so many software that adopted different modeling and analyzing methods, which brings difficulties to the comparison, evaluation or verification for different software and models. By using its own academic advantages, the advanced nuclear energy research team, i.e., FDS Team has invested a few hundreds person-years of independent research and development of a reliability and probabilistic safety assessment software system RiskA. The system consists of three main functions: device reliability optimization management, probabilistic safety assessment and instantaneous risk monitoring, and the comprehensive public risk assessment in digital society. RiskA establishes an integrated risk evaluation system for the device reliability, nuclear power plant (NPP) risk monitoring and public risk assessment. Currently, RiskA has successfully been applied in more than 600 organizations and institutes from a variety of fields in 39 countries, involving nuclear, aerospace, defense and so on. For example, RiskA has been used in the safety analysis of International Thermonuclear Experimental Reactor (ITER), FDS series fusion reactor, and the Strategic Priority Research Program of Chinese Academy of Sciences 'the Future Advanced Nuclear Fission Energy - Accelerator Driven Sub-critical (ADS) transmutation system'. Also, RiskA has been used in public risk communication and risk assessment. Among them, Third Qinshan nuclear power plant Risk Monitor (TQRM), which is the China's first domestic nuclear safety analysis software used in the actual online operation, has been highly apprised by renowned experts in the field. Meanwhile, it has been identified as the first domestic nuclear power plant risk monitoring system with completely independent intellectual property rights, and has reached the international advanced level. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Reliability of voting in fault-tolerant software systems for small output spaces

Under a voting strategy in a fault-tolerant software system there is a difference between correctness and agreement. An independent N-version programming reliability model is proposed for treating small output spaces which distinguishes between correctness and agreement. System reliability is investigated using analytical relationships and simulation. A consensus majority voting strategy is proposed and its performance is analyzed and compared with other voting strategies. Consensus majority strategy automatically adapts the voting to different component reliability and output space cardinality characteristics. It is shown that absolute majority voting strategy provides a lower bound on the reliability provided by the consensus majority, and 2-of-n voting strategy an upper bound. If r is the cardinality of the output space it is proved the 1/r is a lower bound on the average reliability of fault-tolerant system components below which the system reliability begins to deteriorate as more versions are added.

Mcallister, David F.↗

Reliability of voting in fault-tolerant software systems for small output spaces

Under a voting strategy in a fault-tolerant software system there is a difference between correctness and agreement. An independent N-version programming reliability model is proposed for treating small output spaces which distinguishes between correctness and agreement. System reliability is investigated using analytical relationships and simulation. A consensus majority voting stratey is proposed and its performance is analyzed and compared with other voting strategies. A consensus voting strategy automatically adapts the voting to diffeerent component reliability and output space cardinality characteristics. It is shown that absolute majority voting strategy provides a lower bound on the reliability provided by the consensus majority, and the 2-of-n voting strategy an upper bound. If r is the cardinality of output space it is proved that 1/r is a lower bound on the average reliability of fault-tolerant system components below which the system reliability begins to deteriorate as more versions are added.

Mcallister, David F.↗

COSMOG: Cosmology Oriented Sub-mm Modeling of Galactic Foregrounds

With upcoming missions in mid- and far-Infrared there is a need for software packages to reliably simulate the planned observations. This would help in both planning the observation and scanning strategy and in developing the concepts of the far-off missions. As this workshop demonstrated, many of the new missions are to be in the far-IR range of the electromagnetic spectrum and at the same time will map the sky with a sub-arcsec angular resolution. We present here a computer package for simulating foreground maps for the planned sub-mm and far-IR missions. such as SPECS. The package allows to study confusion limits and simulate cosmological observations for specified sky location interactively and in real time. Most of the emission at wavelengths long-ward of approximately 50 microns is dominated by Galactic cirrus and Zodiacal dust emission. Stellar emission at these wavelengths is weak and is for now neglected. Cosmological sources (distant and not-so-distant) galaxies for specified cosmologies will be added. Briefly, the steps that the algorithm goes through is described.

Kashlinsky, A.↗

Providing Experimental Infrastructure for Accelerating Advanced Reactor Demonstrations through the National Reactor Innovation Center

A suite of experimental infrastructure projects has been developed by the National Reactor Innovation Center to accelerate advanced reactor demonstrations and facilitate their development, addressing crucial gaps in data, materials characterization, and modeling. First, the Molten Salt Thermophysical Examination Capability (MSTEC) provides a specialized platform for post-irradiation characterization of molten salt reactor fuel, coolant salts, and structural materials, essential for supporting the design and operation of advanced reactors and future commercial molten salt reactor development and licensing. The Virtual Test Bed (VTB) complements these efforts by leveraging advanced modeling and simulation tools to evaluate reactor performance and safety. Serving as a library of reference models, the VTB offers a database of multiphysics reactor models, facilitating rapid safety evaluations and includes continuous software quality assurance, crucial for accelerating deployment while maintaining reliability. Additionally, the Helium Component Test Facility (HeCTF) addresses the need for high-temperature helium-cooled reactor component testing. As the first-of-its-kind facility in the United States, HeCTF emulates high-temperature gas reactor conditions, reducing time and cost associated with component validation, thereby accelerating reactor development. Finally, In-cell Thermal Creep Frames provide a unique solution for obtaining thermal creep data from irradiated materials, critical for materials qualification and licensing. Developed by the National Reactor Innovation Center, these compact frames enable the examination of previously irradiated materials, overcoming traditional limitations and enhancing the understanding of mechanical properties crucial for reactor development. Collectively, these experimental infrastructure projects form a comprehensive framework aimed at expediting advanced reactor demonstrations, fostering innovation, and ensuring the viability of next-generation nuclear energy solutions.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Analysis of hydrogen infrastructure for the feasibility, economics, and sustainability of a fuel cell powered data center

Data centers used for internet data services, cloud computing, and/or data storage consume vast amounts of electricity and are increasing rapidly in capacity. Consequently, their power consumption has raised concerns about energy sustainability and environmental impacts. Large-scale, on-site renewable energy could help reduce data centers’ carbon footprint; however, wind and solar power alone cannot provide an uninterrupted power supply to computer servers due to their natural variability. Instead, reliable power integration can be achieved by using fuel cells powered by hydrogen from sustainable resources (e.g., wind and solar energy). Establishing a hydrogen infrastructure will be critical for realizing these benefits and establishing fuel cells as a viable power source for data centers. Here, to facilitate the development of novel carbon-free fuel cell data enters, this paper presents renewable power integrated with hydrogen infrastructures in four scenarios to provide reliable hydrogen supply from production to storage. Various paths were analyzed toward a hydrogen supply infrastructure by determining the proper component sizes and calculating the cost of meeting the server load. We used a microgrid modeling software, Hybrid Optimization of Multiple Energy Resources (HOMER), and studied the feasibility of fuel cell powered data centers employing renewable hydrogen. The modeling results show various renewable integration configurations to meet reliable and sustainable power requirement under four scenarios for a carbon-free data center.

08 HYDROGEN↗

UQpy: A general purpose Python package and development environment for uncertainty quantification

In this paper, we present the UQpy software toolbox, an open-source Python package for general uncertainty quantification (UQ) in mathematical and physical systems. The software serves as both a user-ready toolbox that includes many of the latest methods for UQ in computational modeling and a convenient development environment for Python programmers advancing the field of UQ. The paper presents an introduction to the software's architecture and existing capabilities, divided in the code in a set of modules centered around different UQ tasks such as sampling methods, generation of random processes and random fields, probabilistic inverse modeling, reliability analysis, surrogate modeling, and active learning. The paper also highlights the importance of the RunModel module, which is used to drive simulations in the uncertainty analyses performed in UQpy. This module conveniently allows the user to define computational models directly in Python, or to run simulations from a third-party software in serial or in parallel. To illustrate the various capabilities, two examples are tracked throughout the paper and analyzed repeatedly for various UQ tasks. The first is a Python model solving a nonlinear structural dynamics problem, used to illustrate UQpy's capabilities in sampling and forward propagation of high dimensional random vectors (stochastic processes), and probabilistic inference. The second model is a third-party Abaqus finite element model solving the thermomechanical response of a beam structure. This example is used to illustrate UQpy's capabilities in variance reduction sampling techniques, reliability analysis, surrogate modeling and active learning techniques.

97 MATHEMATICS AND COMPUTING↗

Microgrid Design Analysis Using Technology Management Optimization and the Performance Reliability Model

Microgrids are a focus of localized energy production that support resiliency, security, local con- trol, and increased access to renewable resources (among other potential benefits). The Smart Power Infrastructure Demonstration for Energy Reliability and Security (SPIDERS) Joint Capa- bility Technology Demonstration (JCTD) program between the Department of Defense (DOD), Department of Energy (DOE), and Department of Homeland Security (DHS) resulted in the pre- liminary design and deployment of three microgrids at military installations. This paper is focused on the analysis process and supporting software used to determine optimal designs for energy surety microgrids (ESMs) in the SPIDERS project. There are two key pieces of software, an ex- isting software application developed by Sandia National Laboratories (SNL) called Technology Management Optimization (TMO) and a new simulation developed for SPIDERS called the per- formance reliability model (PRM). TMO is a decision support tool that performs multi-objective optimization over a mixed discrete/continuous search space for which the performance measures are unrestricted in form. The PRM is able to statistically quantify the performance and reliability of a microgrid operating in islanded mode (disconnected from any utility power source). Together, these two software applications were used as part of the ESM process to generate the preliminary designs presented by SNL-led DOE team to the DOD. Acknowledgements Sandia National Laboratories and the SPIDERS technical team would like to acknowledge the following for help in the project: * Mike Hightower, who has been the key driving force for Energy Surety Microgrids * Juan Torres and Abbas Akhil, who developed the concept of microgrids for military instal- lations * Merrill Smith, U.S. Department of Energy SPIDERS Program Manager * Ross Roley and Rich Trundy from U.S. Pacific Command * Bill Waugaman and Bill Beary from U.S. Northern Command * Tarek Abdallah, Melanie Johnson, and Harold Sanborn of the U.S. Army Corps of Engineers Construction Engineering Research Laboratory * Colleagues from Sandia National Laboratories (SNL) for their reviews, suggestions, and participation in the work.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Lessons Learned from OSIRIS-Rex Autonomous Navigation Using Natural Feature Tracking

The Origins, Spectral Interpretation, Resource Identification, Security-Regolith Explorer (Osiris-REx) spacecraft is scheduled to launch in September, 2016 to embark on an asteroid sample return mission. It is expected to rendezvous with the asteroid, Bennu, navigate to the surface, collect a sample (July 20), and return the sample to Earth (September 23). The original mission design called for using one of two Flash Lidar units to provide autonomous navigation to the surface. Following Preliminary design and initial development of the Lidars, reliability issues with the hardware and test program prompted the project to begin development of an alternative navigation technique to be used as a backup to the Lidar. At the critical design review, Natural Feature Tracking (NFT) was added to the mission. NFT is an onboard optical navigation system that compares observed images to a set of asteroid terrain models which are rendered in real-time from a catalog stored in memory on the flight computer. Onboard knowledge of the spacecraft state is then updated by a Kalman filter using the measured residuals between the rendered reference images and the actual observed images. The asteroid terrain models used by NFT are built from a shape model generated from observations collected during earlier phases of the mission and include both terrain shape and albedo information about the asteroid surface. As a result, the success of NFT is highly dependent on selecting a set of topographic features that can be both identified during descent as well as reliably rendered using the shape model data available. During development, the OSIRIS-REx team faced significant challenges in developing a process conducive to robust operation. This was especially true for terrain models to be used as the spacecraft gets close to the asteroid and higher fidelity models are required for reliable image correlation. This paper will present some of the challenges and lessons learned from the development of the NFT system which includes not just the flight hardware and software but the development of the terrain models used to generate the onboard rendered images.

Navigation↗

A Vehicle Management End-to-End Testing and Analysis Platform for Validation of Mission and Fault Management Algorithms to Reduce Risk for NASA's Space Launch System

The engineering development of the new Space Launch System (SLS) launch vehicle requires cross discipline teams with extensive knowledge of launch vehicle subsystems, information theory, and autonomous algorithms dealing with all operations from pre-launch through on orbit operations. The characteristics of these spacecraft systems must be matched with the autonomous algorithm monitoring and mitigation capabilities for accurate control and response to abnormal conditions throughout all vehicle mission flight phases, including precipitating safing actions and crew aborts. This presents a large and complex system engineering challenge, which is being addressed in part by focusing on the specific subsystems involved in the handling of off-nominal mission and fault tolerance with response management. Using traditional model based system and software engineering design principles from the Unified Modeling Language (UML) and Systems Modeling Language (SysML), the Mission and Fault Management (M&FM) algorithms for the vehicle are crafted and vetted in specialized Integrated Development Teams (IDTs) composed of multiple development disciplines such as Systems Engineering (SE), Flight Software (FSW), Safety and Mission Assurance (S&MA) and the major subsystems and vehicle elements such as Main Propulsion Systems (MPS), boosters, avionics, Guidance, Navigation, and Control (GNC), Thrust Vector Control (TVC), and liquid engines. These model based algorithms and their development lifecycle from inception through Flight Software certification are an important focus of this development effort to further insure reliable detection and response to off-nominal vehicle states during all phases of vehicle operation from pre-launch through end of flight. NASA formed a dedicated M&FM team for addressing fault management early in the development lifecycle for the SLS initiative. As part of the development of the M&FM capabilities, this team has developed a dedicated testbed that integrates specific M&FM algorithms, specialized nominal and off-nominal test cases, and vendor-supplied physics-based launch vehicle subsystem models. Additionally, the team has developed processes for implementing and validating these algorithms for concept validation and risk reduction for the SLS program. The flexibility of the Vehicle Management End-to-end Testbed (VMET) enables thorough testing of the M&FM algorithms by providing configurable suites of both nominal and off-nominal test cases to validate the developed algorithms utilizing actual subsystem models such as MPS. The intent of VMET is to validate the M&FM algorithms and substantiate them with performance baselines for each of the target vehicle subsystems in an independent platform exterior to the flight software development infrastructure and its related testing entities. In any software development process there is inherent risk in the interpretation and implementation of concepts into software through requirements and test cases into flight software compounded with potential human errors throughout the development lifecycle. Risk reduction is addressed by the M&FM analysis group working with other organizations such as S&MA, Structures and Environments, GNC, Orion, the Crew Office, Flight Operations, and Ground Operations by assessing performance of the M&FM algorithms in terms of their ability to reduce Loss of Mission and Loss of Crew probabilities. In addition, through state machine and diagnostic modeling, analysis efforts investigate a broader suite of failure effects and associated detection and responses that can be tested in VMET to ensure that failures can be detected, and confirm that responses do not create additional risks or cause undesired states through interactive dynamic effects with other algorithms and systems. VMET further contributes to risk reduction by prototyping and exercising the M&FM algorithms early in their implementation and without any inherent hindrances such as meeting FSW processor scheduling constraints due to their target platform - ARINC 653 partitioned OS, resource limitations, and other factors related to integration with other subsystems not directly involved with M&FM such as telemetry packing and processing. The baseline plan for use of VMET encompasses testing the original M&FM algorithms coded in the same C++ language and state machine architectural concepts as that used by Flight Software. This enables the development of performance standards and test cases to characterize the M&FM algorithms and sets a benchmark from which to measure the effectiveness of M&FM algorithms performance in the FSW development and test processes.

Trevino, Luis↗

Development Support for NREL's System Advisor Model (SAM): Cooperative Research and Development, CRADA Number CRD-20-16998 (Final Report)

The variable nature of renewable generation, which depends on the sun shining and wind blowing for example, presents challenges for adequate and least-cost resource planning. The deployment of renewable generation assets is anticipated to increase due to various drivers, such as declining costs, favorable government policies, and increasing procurement by corporations and consumers. High levels of renewable penetration are anticipated to pose flexibility, reliability, and cost challenges to the electrical system. The development and implementation of new features into performance modeling software, such as the National Renewable Energy Laboratory's (NREL) System Advisor Model (SAM), is one way to help think through these challenges and develop appropriate strategies.

14 SOLAR ENERGY↗

Integration of Hybrids into Wholesale Power Markets

With growing commercial activity around utility-scale hybrid storage projects in the Unites States, independent system operators (ISOs) and regional transmission organizations (RTOs) are faced with making decisions on how to represent such emerging technology resources in the market clearing software through the definition of hybrid resource participation models. System operators are facing increasing uncertainties around efficient and reliable ways to operate these resources given the ambiguity around their impacts, particularly when high levels of hybrid resources are present. This study aimed to evaluate and compare the performance implications of different hybrid resource participation models in a realistic wholesale electricity market setting with significant deployment of hybrid resources, and to provide the industry with metrics that quantify the advantages and disadvantages of different participation options using realistic electricity market simulations. The different participation models are compared in terms of the impact to reliability of the overall system, the ability of the market to access the full capabilities of hybrid resources as measured by the economic efficiency, and asset profitability.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Detecting servo failures with software

Program detects hardware failure in servosystems by comparing actual servo valve position with predictions of software model. In addition, system will also pick up most computer input/output failures. Process presents faster and more reliable results than previous failure detection methods.

Lew, D.↗

Detection of faults and software reliability analysis

Multi-version or N-version programming is proposed as a method of providing fault tolerance in software. The approach requires the separate, independent preparation of multiple versions of a piece of software for some application. These versions are executed in parallel in the application environment; each receives identical inputs and each produces its version of the required outputs. The outputs are collected by a voter and, in principle, they should all be the same. In practice there may be some disagreement. If this occurs, the results of the majority are taken to be the correct output, and that is the output used by the system. A total of 27 programs were produced. Each of these programs was then subjected to one million randomly-generated test cases. The experiment yielded a number of programs containing faults that are useful for general studies of software reliability as well as studies of N-version programming. Fault tolerance through data diversity and analytic models of comparison testing are discussed.

Knight, John C.↗