Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “criticality safety evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Exponential Backoff and Its Security Implications for Safety-Critical OT Protocols over TCP/IP Networks

The convergence of Operational Technology (OT) and Information Technology (IT) networks has become increasingly prevalent with the growth of Industrial Internet of Things (IIoT) applications. This shift, while enabling enhanced automation, remote monitoring, and data sharing, also introduces new challenges related to communication latency and cybersecurity. Oftentimes, legacy OT protocols were adapted to the TCP/IP stack without an extensive review of the ramifications to their robustness, performance, or safety objectives. To further accommodate the IT/OT convergence, protocol gateways were introduced to facilitate the migration from serial protocols to TCP/IP protocol stacks within modern IT/OT infrastructure. However, they often introduce additional vulnerabilities by exposing traditionally isolated protocols to external threats. This study investigates the security and reliability implications of migrating serial protocols to TCP/IP stacks and the impact of protocol gateways, utilizing two widely used OT protocols: Modbus TCP and DNP3. Our protocol analysis finds a significant safety-critical vulnerability resulting from this migration, and our subsequent tests clearly demonstrate its presence and impact. A multi-tiered testbed, consisting of both physical and emulated components, is used to evaluate protocol performance and the effects of device-specific implementation flaws. Through this analysis of specifications and behaviors during communication interruptions, we identify critical differences in fault handling and the impact on time-sensitive data delivery. The findings highlight how reliance on lower-level IT protocols can undermine OT system resilience, and they inform the development of mitigation strategies to enhance the robustness of industrial communication networks.

DNP3↗
DOE OSTI2021

Plans for Expanded Data Testing at ORNL [Slides]

VALID expansion is on-going and should provide coverage over a wider range of systems in the future. Adding additional application types beyond critical experiments can also be used in expanded data testing. Two other test suites have been developed at ORNL for other purposes, but never waste a good test suite. These suites are more likely to be relevant to testing differences in data as compared to assessing accuracy of evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

GNDS v2.0 release and future developments [Slides]

This presentation begins by discussing the major changes in v2.0 of GNDS and that the GNDS-2.0 formatted libraries are now available. It also examines how code support for GNDS is growing with processing codes, APIs and transport codes, and evaluation/testing codes. The presentation states that while migrating to GNDS can be a major effort it worthwhile, especially for anyone who is just getting started as nuclear data creator or user. Additionally, this presentation outlines the established milestones that the EG-GNDS (the group in charge of GNDS specs) has for the next GNDS release and elaborates on the first goal, which is to migrate GNDS specifications to the new JSON schema language.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Yes, No, Maybe So: Human Factors Considerations for Fostering Calibrated Trust in Foundation Models Under Uncertainty

High-stakes analytical environments require analysts to evaluate evidence and generate conclusions to inform critical decisions often under conditions of uncertainty. Probabilistic decision-making based on incomplete or inaccurate information can reduce productivity, compromise national interests, and endanger public safety. Researchers are developing expert systems built on foundation models (FMs) to support analysts’ decision-making processes by enabling human-artificial intelligence (AI) teaming, in part through the quantification and expression of uncertainty information. As FMs continue to mature, it is imperative to correspondingly consider analysts’ needs for appropriately interpreting and using uncertainty information. However, prior research indicates that it remains unclear how analysts engage with FM-generated uncertainty information and the extent to which these interactions influence trust in, and reliance on, expert systems. We plan to review the state of the science and conduct an exploratory, qualitative study to (a) understand how properly communicated uncertainty can foster calibrated trust and appropriate reliance and (b) identify approaches for effectively conveying FM-generated uncertainty information during analytical workflows. We will administer semi-structured interviews with analysts from a specific high-stakes analytical environment to collect their current experiences with job-related uncertainty and their impressions when viewing FM-generated uncertainty information. During the interview protocol, participants will be presented with several different FM outputs and invited to discuss their thoughts and beliefs about the uncertainty information displayed. Participants may provide insights into how trust and reliance may be influenced by uncertainty. The results of this study will help us to better understand how analysts currently interpret and use uncertainty information. Our findings may inform human factors recommendations for effectively conveying uncertainty information to foster calibrated trust in, and appropriate reliance on, expert systems. Interaction designers and FM developers can use this knowledge to enhance human-AI teaming and ensure the responsible deployment of FM-based expert systems in analytical workflows.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1993

An artificial intelligence-based structural health monitoring system for aging aircraft

To reduce operating expenses, airlines are now using the existing fleets of commercial aircraft well beyond their originally anticipated service lives. The repair and maintenance of these 'aging aircraft' has therefore become a critical safety issue, both to the airlines and the Federal Aviation Administration. This paper presents the results of an innovative research program to develop a structural monitoring system that will be used to evaluate the integrity of in-service aerospace structural components. Currently in the final phase of its development, this monitoring system will indicate when repair or maintenance of a damaged structural component is necessary.

Grady, Joseph E.↗
NASA NTRS1997

Shielding Strategies for Human Space Exploration

A group of twenty-nine scientists and engineers convened a 'Workshop on Shielding Strategies for Human Space Exploration' at the Lyndon B. Johnson Space Center in Houston, Texas. The provision of shielding for a Mars mission or a Lunar base from the hazards of space radiations is a critical technology since astronaut radiation safety depends on it and shielding safety factors to control risk uncertainty appear to be great. The purpose of the workshop was to define requirements for the development and evaluation of high performance shield materials and designs and to develop ideas regarding approaches to radiation shielding. The workshop was organized to review the recent experience on shielding strategies gained in studies of the 'Space Exploration Initiative (SEI),' to review the current knowledge base for making shield assessment, to examine a basis for new shielding strategies, and to recommend a strategy for developing the required technologies for a return to the moon or for Mars exploration. The uniqueness of the current workshop arises from the expected long duration of the missions without the protective cover of the geomagnetic field in which the usually small and even neglected effects of the galactic cosmic rays (GCR) can no longer be ignored. It is the peculiarity of these radiations for which the inter-action physics and biological action are yet to be fully understood.

Wilson J. W.↗
NASA NTRS2015

Are We There Yet? Determining the Adequacy of Formalized Requirements and Test Suites

Structural coverage metrics have traditionally categorized code as either covered or uncovered. Recent work presents a stronger notion of coverage, checked coverage, which counts only statements whose execution contributes to an outcome checked by an oracle. While this notion of coverage addresses the adequacy of the oracle, for Model-Based Development of safety critical systems, it is still not enough; we are also interested in how much of the oracle is covered, and whether the values of program variables are masked when the oracle is evaluated. Such information can help system engineers identify missing requirements as well as missing test cases. In this work, we add to the idea of checked coverage an analysis of requirements coverage to help provide insight to engineers as to whether the requirements or the test suite need to be improved. We implement our approach based on a dynamic backward slicing technique and evaluate it on several systems developed in Simulink. The results of our preliminary study show that even for systems with comprehensive test suites and good sets of requirements, our approach can identify cases where more tests or more requirements are needed to improve coverage numbers.

Dynamic Slicing↗
NASA NTRS2007

Recovery of Space Shuttle Columbia and Return to Flight of Space Shuttle Discovery

NASA has come a long way in our journey to reduce the risks of operating the Spse Shuttle system. The External Tank bipod Thermal Protection System has been redesigned to eliminate the proximate cause of the Columbia accident. In all areas, we have applied the collective knowledge and capabilities of our Nation to comply with the Columbia Accident Investigation Board recommendations and to raise the bar beyond that. We have taken prudent technical action on potential threats to review and verify the material condition of all critical areas where failure could result in catastrophic loss of the crew and vehicle. We are satisfied that critical systems and elements should operate as intended-safely and reliably. While we will never eliminate all the risks from our human space flight programs, we have eliminated those we can and reduced, controlled, and/or mitigated others. The remaining identified risks will be evaluated for acceptance. Our risk reduction approach has its roots in the system safety engineering hierarchy for hazard abatement long employed in aerospace systems engineering. The components of the hierarchy are, in order of precedence, to: design/redesign; eliminate the hazard/risk; reduce the hazard/risk; and control the hazard/risk and/or mitigate the consequence of the remaining hazard/risk through warning devices, special procedures/capabilities, and/or training. This proven approach to risk reduction has been applied to potential hazards and risks in all critical areas of the Space Shuttle and has guided us through the technical challenges, failures, and successes present in return to flight endeavors. This approach provides the structured deliberation process required to verify and form the foundation for accepting any residual risk across the entire Space Shuttle Program by NASA leadership.

Rudolphi, Michael U.↗
DOE OSTI2026

Innovations in underground hydrogen storage with multiphysics simulations, optimization, and monitoring: A review

Underground Hydrogen Storage (UHS) is a promising solution for large-scale energy storage and a critical component in advancing low-carbon energy system. Ensuring the safety and efficiency of UHS necessitates a comprehensive understanding of multiphysical interactions driven by cyclic pore fluid pressure fluctuations and coupled physicochemical processes. Here, this review examines the key geomechanical responses in UHS, including rock property variations under cyclic loading, fracture evolution and propagation, reservoir stress sensitivity, and fault stability. It also explores the impact of geochemical and microbial reactions on geomechanical characteristics. We provide an in-depth analysis of Thermal-Hydraulic-Mechanical-Chemical (THMC) coupled numerical simulations, highlighting their potential for future multi-scale modeling. Limitations of current machine learning (ML) approaches in addressing UHS challenges are highlighted, emphasizing the need for innovative ML-based methodologies. Operational strategies for hydrogen injection and production are reviewed, focusing on safety, efficiency, and economic viability. The necessity for multi-objective optimization (MOO) to balance storage efficiency, risk mitigation, and cost-effectiveness is also discussed. Current monitoring technologies are evaluated to ensure safe and efficient UHS operations. Finally, this review identifies critical knowledge gaps and underscores the importance of advancing geomechanical understanding under multiphysics-coupling. We highlight the need for ML-driven multiphysics theories, enhanced modeling techniques, and robust optimization strategies to improve UHS performance. This study serves as a comprehensive reference for future research and the large-scale implementation of UHS systems.

25 ENERGY STORAGE↗
NASA NTRSDate not supplied

A Distributed Simulation-to-Flight Framework to Support Investigating Trust/Trustworthiness in Multi-Agent Systems

As autonomous systems continue to grow both in use and complexity, the necessity for robust and extensible simulation-to-flight frameworks is paramount for establishing an effective architecture for autonomous systems. Hardware test flights are time-consuming and cost prohibitive during early system design and development. Simulation environments can be useful tools to accelerate algorithm development and testing. However, transitions from simulation to flight (sim-to-flight) can be challenging, unless systems are designed with this transition in mind and with the necessary capabilities built into the architecture and framework. One of the objectives of Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) was to design and develop a distributed mixed-reality simulation environment to begin establishing a basis for certification of autonomous systems via research into trust and trustworthiness. ATTRACTOR’s objective was to construct computational concepts of trustworthiness and justifiable trust in multi-agent autonomous teams, to inform future certification of safety-critical and time-critical autonomous systems in aviation. In this paper, we present an autonomous systems architecture and development framework paired with a persistent distributed modeling and simulation (ModSim) environment for test and evaluation of autonomous systems. They were designed under ATTRACTOR in order to measure and establish trustworthiness and trust in single-and multi-agent human-machine systems whether these machines are fixed-wing general aviation, rotary-wing Unmanned Aerial Vehicles (UAVs), ground rovers, or even spacecraft. The Autonomous Entity Operational Network (AEON) framework enables autonomous system development with an easily extensible collection of libraries and plug-n-play nodes facilitated by the Data Distribution Service (DDS) communication protocol standard. The Baseline Environment for Autonomous Modeling (BEAM) simulation environment is a distributed mixed-reality Unity™-based environment built around the same DDS communication paradigm allowing for easy integration with AEON-based autonomous applications, enabling sim-to-flight with minimal configuration changes. Using AEON and BEAM, source code that runs in simulation ports directly to hardware and has successfully flown in the National Airspace System (NAS) at NASA LaRC many times over the lifetime of ATTRACTOR.

Benjamin N Kelley↗
DOE OSTI2021

LANL update to 239 Pu in the fast energy range [Slides]

Researchers are in the process of updating the Pu cross sections in the fast energy range (complementing the work of IAEA / INDEN / ORNL lower energy work in the resonance range). LANL is overhauling its evaluation tools (CoH, CGMF, DeCE, Kalman, NEXUS, PySOK, SOK) and focusing on consistency throughout evaluation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Resonance Parameter Evaluation of n + 88 Sr reactions for ENDF/B-VIII.1 Library

An evaluation of n+ 88 Sr reactions up to 950 keV was compiled from a publicly available set of resonance parameters. Starting from the repository of the ENDF/B-VIII.0 library, an evaluated nuclear data file was assembled and submitted for inclusion to the Evaluated Nuclear Data File (ENDF)/B-VIII.1 release. This evaluation features an external function representation defined by pole strengths and R ∞ parameters over the entire resolved resonance range. This work improves the modeling of the R-matrix parameterization from multi-Level Breit-Wigner resonance parameters to Reich-Moore formalism, and it also extends thrice the upper energy range of the current ENDF/B-VIII.0 resolved resonance evaluation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Multi-Mechanism Flood Hazard Assessment: Critical Review of Current Practice and Approaches

This report documents the initial findings from the Nuclear Regulatory commission (NRC)-sponsored research project Methods for Estimating Joint Probabilities of Coincident and Correlated Flooding Mechanisms for Nuclear Power Plant Flood Hazard Assessments.1 This research project is a part of NRC’s Probabilistic Flood Hazard Assessment (PFHA) Research Program and will aid the development of guidance on the use of PFHA methods to evaluate infrastructure safety for existing and proposed US nuclear power plants (NPPs). More specifically, this project intends to provide technical background for the development of flood hazard curves for multi-mechanism floods (MMFs). MMFs are flood events caused by more than one flooding mechanism (e.g., flood events due to the simultaneous occurrence of precipitation-induced river flooding and storm surge). Project activities include three main tasks: Task 1—Survey of current concepts and methods in assessing MMF hazards; Task 2—Critical assessment of selected methods and approaches for quantifying probabilistic MMF hazard risk; Task 3—Development of example case studies to illustrate best practices for quantifying probabilistic MMF hazard risk The initial findings from Tasks 1 and 2 are documented in this report. Task 1 comprised a survey of approaches and methods that have been applied to understand and assess flood hazards due to MMFs. Task 2 involved a critical review of the selected approaches and methods. To that end, the scope of this report includes documentation of (1) a reconnaissance-level survey of the current state of concepts and practice for MMF hazard assessment; (2) a generalized MMF assessment framework to address the distinctions among various types of flood-forcing phenomena, flood mechanisms (grouped into three mechanism types), and flood severity metrics; (3) a wide-ranging survey of approaches and methods that have been applied to various flooding phenomena and settings; and (4) a critical assessment of MMF hazard assessment methods. Studies were identified involving MMFs related to coastal flooding mechanisms, fluvial (rivers/streams) flooding mechanisms, and associated combinations of coastal and fluvial flooding mechanisms. Studies were also identified that address MMFs involving coastal and fluvial flooding mechanisms as well as coastal flooding mechanisms along with extreme precipitation (without specific attribution to fluvial or pluvial mechanisms). The studies identified for review in this report included assessments at varying spatial scales (from local to global) with differing geographic regions of focus using both observed and synthetic data. The majority of studies identified and reviewed were site-specific assessments focusing on relatively short return periods. Studies considered a range of flood severity metrics, made differing assumptions regarding the occurrence of extrema, and used multiple statistical techniques; the use of copulas for the development of joint distributions was a particularly popular analysis technique. The literature review highlighted the differences among existing studies relative to terminology used, means of presenting results, framework and techniques employed, and level of sophistication regarding the number and types of variables considered. Despite the significant diversity in existing studies, the review identified several promising techniques that will be considered in future work under this project, including the development of joint distributions for MMFs using copula and Bayesian-motivated approaches.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2020

Re-evaluation of the TSL for Yttrium Hydride

Yttrium hydride (YH x ) is of interest as a high-temperature moderator material in advanced nuclear reactor systems because of its superior ability to retain hydrogen at elevated temperatures. Thermal neutron scattering laws (TSL) for hydrogen bound in yttrium hydride (H-YH 2 ) and yttrium bound in yttrium hydride (Y-YH 2 ) were previously evaluated by Naval Nuclear Laboratory using the ab initio approach and released in ENDF/B-VIII.0. In that work, density functional theory, incorporating the generalized gradient approximation (GGA) for the exchange-correlation energy, was used to simulate the face-centered cubic structure of YH 2 and calculate the interatomic Hellmann-Feynman forces for a 2×2×2 supercell containing 96 atoms. Lattice dynamics calculations using PHONON were used to determine the phonon density of states. The calculated phonon density of states for H and Y in YH 2 were then used to prepare H-YH 2 and Y-YH 2 TSL evaluations, in the incoherent approximation, using the LEAPR module of NJOY. In addition, elastic scattering was assumed to be incoherent for both H and Y. While the incoherent elastic scattering approximation is appropriate for H-YH 2 , it introduces an undesirable approximation for Y-YH 2 . In this work, we re-evaluate the TSL for Y-YH 2 using FLASSH (Full Law Analysis Scattering System Hub). Y-YH 2 is evaluated using the FLASSH generalized coherent elastic scattering capability in order to capture the Bragg peaks associated with the YH 2 crystal structure which were neglected in the prior NJOY-based evaluation due to limitations in LEAPR. An experimental approach to validate the Y-YH 2 TSL using neutron transmission measurements is discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Complete Performance Comparison Between the Optimized Image Construction Algorithm (U-MBIR) and the Existing Reconstruction Algorithm for Detecting Defects and Damage in Concrete

Reinforced concrete (RC) is a composite material subjected to mechanical, thermal, and chemical loads throughout its service life. Because of these external stressors and the susceptibility of RC structural members to shrinkage and microcracking, the material degrades throughout its life cycle. This deterioration can lead to a decrease in member capacity and, ultimately, poses a threat to the structural integrity. Thus, it is crucial that the damage caused by aging and degradation be monitored and assessed at regular intervals throughout the material’s service life. Since coring of the material is typically not feasible for in-service structural systems, non-destructive evaluation (NDE) methodologies are used to assess remaining structural capacity. NDE methods enable surface and subsurface examination without damaging or degrading the medium. Moreover, RC is a critical component of nuclear power plants; thus, its safety and reliability must be thoroughly examined throughout the life cycle of the structural system. Ultrasonic measurements have been an industry standard for both surface and subsurface inspections. To this end, Oak Ridge National Laboratory (ORNL) has researched and developed advanced image reconstruction algorithms to capture internal damage. The results and discussion presented herein summarize the current state of the ultrasonic model–based iterative reconstruction (U-MBIR) algorithm developed at ORNL. More specifically, this report presents a comparison between reconstruction images produced via a widely employed ultrasonic NDE technique—the synthetic aperture focusing technique (SAFT)—and the ORNL-developed U-MBIR algorithm. These NDE methodologies are demonstrated using ultrasonic data collected from four concrete specimens. Overall, the U-MBIR algorithm eliminates artifacts and noise that are typically present within the SAFT reconstructions, and it shows defects and anomalies more clearly than the SAFT images. In conclusion, this algorithm is suitable for identifying concrete defects, although more improvements and optimization could be done to better define internal defects.

36 MATERIALS SCIENCE↗