Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “engineering software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Cell G 7606A Mockup Measurement Analysis Methods and Results

The production of research isotopes at the Radiochemical Engineering Development Center (REDC) invariably leads to the accumulation of radioactive waste. Storage of this waste onsite at ORNL serves as an interim solution prior to shipment to long term storage facilities, however onsite capacity is limited. Proper characterization of the activity of waste products is essential for determining the appropriate waste stream and, ultimately, mitigating the cost of disposal. This is typically done via gamma spectrometry and use of the In-Situ Object Counting System (ISOCS), a software package from Mirion that serves as an accepted community standard. However, variability in the contents, density, and activity distribution in waste containers can introduce large errors in ISOCS quantification. A measurement campaign using a mockup of the proposed setup in Cell G seeks to quantify the magnitude and source of these systematic errors. Analysis of this data will guide the creation of ISOCS geometry templates and measurement methods designed to minimize overall uncertainty in reported activities.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

A Large-Scale Analysis to Optimize the Control and V2V Communication Protocols for CDA Agreement-Seeking Cooperation

Cooperative driving automation (CDA) Class C, agreement-seeking cooperation, is an innovative and practical solution that can promote cooperation among general passenger vehicles on the road. However, more comprehensive studies are needed before establishing the standard protocols of agreement-seeking cooperation, such as communication frequency and the duration of cooperation. Here, this article presents an initiative study on the impacts of communication capabilities on agreement-seeking cooperation. Through a large-scale analysis by regulating vehicle-to-vehicle (V2V) communication metrics, this work suggests desirable system parameters that can maximize the benefits of cooperation and ensure reliable operability while avoiding exhaustive communication loads. As the first step, an example agreement-seeking cooperation system is created for a car-following scenario, including decision-making and control algorithms for autonomous vehicles. Then, software-in-the-loop tests explore the performance of the developed system as it encounters various communication risks, such as latency and message packet drops. The system performance metrics are evaluated from various angles, including the time consumed for the agreement-seeking process, cooperation ratio, and the ratio of faulty cooperation. Energy saving from the cooperation is assessed by using simulation software that can run multiple high-fidelity vehicle models simultaneously. Based on the analyses, this article suggests the V2V communication requirements for the reliable operation of CDA agreement-seeking, which can be referred to when developing the standard protocols of agreement-seeking cooperation.

42 ENGINEERING↗
DOE OSTI2021

Air Blast Mesh Sensitivity and Pressure Mapping Study

Nose cone structural and aerodynamic characteristics are essential for intelligent design of aircraft, spacecraft, and ballistic systems. Finite element analysis can be used to help understand the structural integrity and flight characteristics of different nose cones. A mesh sensitivity study was undertaken for a particular nose cone geometry that was used in tests at LANL facilities in order to confirm the integrity of the meshed geometry. A simple cone that best matched closed-form theoretical solutions was modeled, and received good correlation to the theory. Complexity was then added back to the nose cone. Parameters applied to the simple cone were then implemented in the nose cone geometry giving assurance of accuracy after the geometry was changed. Nose cone results averaged 6.3% error for radial displacement when compared with the theoretical. Hoop stress averaged 6.0% error and meridional stress averaged 5.7% error at the finest mesh level. Meshes showed signs of convergence when compared to all three theoretical solutions. Finally, pressure time-history data from LANL computational fluid dynamics simulations was applied to the surface of the final nose cone geometry. The pressure data was interpolated from pressure gauge locations onto nearby meshed elements, which allowed for FEA software to run simulations on the cone with the pressure data as a loading condition. The pressure mapping resulted in the ability to understand the nose cone’s rigid body motion that in turn can inform design of future nose cones.

42 ENGINEERING↗
DOE OSTI2025

Simulation Tools for Characterizing Stress Distribution in Laser Welded Dissimilar Joints

This project focuses on developing a thermo-metallurgical-mechanical modeling method to accurately predict the microstructural evolution and residual stress in laser welding between dissimilar metals, such as HSLA steel and high carbon equivalent (CE) gear steel. The method leverages a comprehensive material database to model the temperature and rate dependent phase transformations, along with their associated effects on material properties, such as thermal expansion and flow stress, throughout the welding process. A key innovation is the incorporation of phase transformation and phase-specific properties, which enhances the accuracy of residual stress predictions. The mixture material in the fusion zone due to the dissimilar metals will also be addressed in the numerical model. This is especially critical in scenarios involving phase transformations in the fusion zone and heat-affected zone (HAZ), where the phase changes can induce substantial residual stress variations. The material database has been generated using JMatPro. The modeling approach is implemented through a custom User Material (UMAT) subroutine, executed with the commercial finite element software Abaqus.

36 MATERIALS SCIENCE↗
DOE OSTI2022

National Ignition Facility. Facility and Infrastructure Systems Maintenance Plan

Ensuring the reliability of the NIF, including its support systems, laser systems, target diagnostic systems, and utilities, is essential to the availability of the NIF in its support of NNSA missions. NIF is a key capability in the DOE Stockpile Stewardship Program and supports high energy physics experiments for nuclear weapons, energy, and astrophysics applications. High system reliability provides opportunities for shots and scientific discoveries with opportunities to enhance and upgrade capabilities. This Maintenance Plan (MP) identifies the policies and procedures used to perform and support asset management of the NIF Facility and Infrastructure Systems (FInS), NIF Lasers & Alignment (LASE), NIF Target Experimental Operations (TOPS), NIF Target Area Science and Engineering (TASE), and NIF&PS Control Systems (NCS). The FInS systems include the facility, HVAC, contamination control, beampath, and Line Replaceable Units (LRUs) as well as utilities which create the beampath environments, such as vacuum, argon, or clean dry air. The LASE systems are Programmatic systems which include laser diagnostics, alignment, power conditioning, pulsed power, and input laser systems. The TOPS and TASE systems are also Programmatic systems which include target and diagnostic delivery systems and positioners, many different insertable and fixed target diagnostics, and cryogenic and target gas fill systems. Finally, the NCS systems include both software and hardware for industrial and shot operation control systems. Policies governing administrative and operational practices related to maintenance of FInS, LASE, TOPS, TASE, and NCS systems are described in this plan. In addition, the plan provides processes and procedures for managing, tracking, and documenting the work. This document, the NIF Operations Management Plan, NIF-5020544 (Ref. 1), and NIF Shot Operations Plan, NIF-5018506 (Ref. 2), together satisfy the requirements of the Conduct of Operations. Duties, responsibilities, and reporting requirements of the various positions associated with FInS, LASE, and TOPS maintenance are detailed in this plan. The FInS systems include both Real Property systems with asset management requirements specified in DOE Order 430.1C (Ref. 3) and Programmatic systems. In addition, for FInS, there is a list of the System Level Maintenance Plans (SLMPs) in NIF-1007419198 (Ref. 4) which provide the system descriptions and maintenance plan and schedule. In addition, the list includes the Reliability Centered Maintenance (RCM) and Experience Centered Maintenance (ECM) evaluations that have been performed for applicable FInS systems as well as reliability criticality per Section 3.5. The -AM version of the NIF Maintenance Plan focuses on the reliability program for FInS, LASE, TOPS, TASE, and NCS within the context of the overall NIF Reliability, Availability, and Maintainability (RAM) program and incorporates changes since the -AL version from August 2011 and has been updated to be fully consistent with the updates to Ref. 1. It also includes asset management considerations, updates to the Work Order (WO) process within the NIF Computerized Maintenance Management System (CMMS) which is EAM infor® System Maintenance and Reliability Tracking (SMaRT) (Ref. 5), and updates to metrics and key performance indicators (KPIs).

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

The Italian Summer Students Program at Fermilab and other US Laboratories: 40 years of education in particle physics and technology

Since 1983 the Italian groups collaborating with Fermilab (US) have been running a 2-month summer training program for Master students. While in the first year the program involved only 4 physics students, in the following years it was extended to engineering students. Many students have extended their collaboration with Fermilab with their Master Thesis and PhD. The program has involved more than 600 Italian students from more than 20 Italian universities. Each intern is supervised by a Fermilab Mentor responsible for the training program. Training programs spanned from Tevatron, CMS, Muon (g-2), Mu2e and SBN (MicroBooNE, Icarus, and SBND) and DUNE design and data analysis, development of particle detectors, design of electronic and accelerator components, development of infrastructures and software for tera-data handling, quantum computing and research on superconductive elements and accelerating cavities. In 2015 the University of Pisa included the program within its own educational programs. Summer Students are enrolled at the University of Pisa for the duration of the internship and at the end of the internship they write summary reports on their achievements. After positive evaluation by a University of Pisa Examining Board, interns are acknowledged 6 ECTS credits for their Diploma Supplement. The program was paused in 2020 and 2021 due to the COVID-19 pandemic, but it resumed in 2022. From 2022 to 2024, a total of 60 students participated in the nine-week training at Fermilab. We are currently organizing the 2025 program. This paper provides an overview of the program, which can serve as a model for other interested laboratories.

Barzi, Emanuela [Ohio State U.]↗
DOE OSTI2026

Sparow-Examples

SAND2026-16701O SPAROW-Examples software provides a repository of stochastic programming examples designed to demonstrate Sandia's SPAROW optimization library. This resource helps users learn to develop complex applications with SPAROW by offering reference implementations that can be used to test and enhance new optimization solvers. The library offers a diverse range of simple and complex exemplars, including those related to power grid applications such as unit commitment and expansion planning. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Hart, William [Sandia National Lab. (SNL-CA), Live↗
DOE OSTI2020

Refreshing Waste Tracking Software for the 2020's - 20059

The Waste Compliance and Tracking System (WCATS) is a software application designed to manage waste operations from cradle to grave. The system provides the support needed for characterization, generation, processing, and shipment of all waste generated or stored at Los Alamos National Laboratory (LANL). Waste is tracked with task records for containers in real-time via both desktop and mobile device applications. The software allows application administrators to configure sites with appropriate limits for Pu-239 equivalent Curies (PE-Ci), fissile gram equivalents (FGEs), volume limits, as well as custom limits for site-specific technical safety requirements (TSRs). WCATS was developed based on a need at Los Alamos National Laboratory for a modern, customizable waste tracking system that could support many different waste types. The application is built using Oracle{sup R} database and Oracle{sup R} ADF Swing application framework. The technologies and software frameworks selected for the system were finalized in 2006. Although Oracle{sup R} Database has proven to be robust, the user interface and application framework interface with the database have been deprecated and need to be replaced. The technologies selected for modernization follow the open-source model, which allows the WCATS team to more easily recruit developers, improve the speed of development, and ease the deployment and adoption of the system. The tools that support the re-engineering effort are Vue.js{sup R}, a JavaScript{sup R} framework, and Spring Boot{sup R}, an API (application programming interface) development tool written in Java{sup R}. An API allows for simplified communication from the database to the user interface of the application. In addition, legacy Crystal Reports{sup R} will be replaced with reports developed with the open source Pentaho{sup TM}f Report Designer community edition. Because the application uses HTML and JavaScript{sup R}, it builds upon tools that have been used for many years in web development. These tools have large community support and their proven track record will ensure that enhancements to WCATS can continue for years to come. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Advanced Simulation and Computing: ASC FY24 Implementation Plan

The DOE National Nuclear Security Administration (NNSA) Stockpile Stewardship Program (SSP) is an integrated technical program for maintaining the safety, security, and reliability of the U.S. nuclear stockpile. The SSP incorporates nuclear test data, computational modeling and simulation, and experimental facilities to advance understanding of nuclear weapons. The suite of data analyzed comes from activities including previous nuclear tests, stockpile surveillance, experimental research, and development and engineering programs. This integrated national program requires the continued use of experimental facilities and the computational capabilities to support the SSP missions. These component parts, in addition to an appropriately scaled production capability, enable NNSA to support stockpile requirements. The ultimate goal of the SSP, and thus of the Advanced Simulation and Computing (ASC) program, is to ensure that the U.S. maintains a safe, secure, and effective strategic deterrent. The ASC program is a cornerstone of the SSP, providing simulation capabilities and computational resources to support the annual stockpile assessment and certification process, study advanced nuclear weapons design and manufacturing processes, analyze accident scenarios and weapons aging, and provide the tools to enable stockpile Life Extension Programs (LEPs) and the resolution of Significant Finding Investigations (SFIs). This work requires a balance of resources, including technical staff, hardware, simulation software, and computer science solutions. The ASC program focuses on increasing the predictive capabilities in a three-dimensional (3D) simulation environment while maintaining support to the SSP. The Program continues to improve its unique tools for understanding and solving progressively more difficult stockpile problems (sufficient resolution, dimensionality, and scientific details), and quantifying critical margins and uncertainties. Resolving each issue requires increasingly difficult analyses because the aging process has progressively moved the stockpile further from the original test base. While the focus remains on the U.S. nuclear weapons program, where possible, the Program also enables the use of high-performance computing (HPC) and simulation tools to address broader national security needs, such as foreign nuclear weapon assessments and nuclear counterterrorism. The 2022 Nuclear Posture Review (NPR) calls for NNSA to “deliver a modern, adaptive nuclear security enterprise based on an integrated strategy for risk management, production-based resilience, science and technology innovation, and workforce initiatives.” Furthermore, “NNSA will establish a Science and Technology Innovation Initiative to accelerate the integration of science and technology (S&T) throughout its activities.” Executing this strategy necessitates the continued emphasis on developing and sustaining high-quality scientific and engineering staff, as well as supporting computational and experimental capabilities. These components constitute the foundation of the nuclear weapons program. The continued success of the SSP and LEPs is predicated upon the ability to credibly certify the stockpile, without a return to underground nuclear tests (UGTs). Shortly after the nuclear test moratorium entered into force in 1992, the Accelerated Strategic Computing Initiative (ASCI) was established to provide an extensive simulation capability to underpin stockpile certification. While computing and simulation have always been essential to the success of the nuclear weapons program, the program goal of ASCI was to execute NNSA’s vision of using these tools in support of the stockpile stewardship mission. The ASCI program was essential to the successful demonstration of the SSP, providing critical nuclear weapons simulation and modeling capabilities. ASCI officially evolved into the ASC program in fiscal year (FY) 2005, but the mission remains essentially the same: provide the simulation and computational capabilities that underpin the ability to maintain a safe, secure, effective nuclear weapon stockpile, without returning to underground nuclear testing. The capabilities that the ASC program provides at the national laboratories play a vital role in the nuclear security enterprise and are necessary for fulfilling the stockpile stewardship and life extension requirements outlined for NNSA. The Program develops modern simulation tools that provide insights into stockpile aging issues, provide the computational and simulation tools that enable designers and analysts to certify the current stockpile and life-extended nuclear weapons, and inform the decision-making process when any modifications in nuclear warheads or the associated manufacturing processes are deemed necessary. Furthermore, ASC is enhancing the predictive simulation capabilities that are essential to evaluate weapons effects, design experiments, and ensure test readiness. The ASC program continues to improve its unique tools to solve stockpile problems— with a focus on sufficient resolution, dimensionality, and scientific detail—to enable Quantification of Margins and Uncertainties (QMU) and to resolve the increasingly difficult analyses needed for stockpile stewardship. The needs of the Stockpile Management and Production Modernization programs (formerly Directed Stockpile Work) also drive the requirements for simulation and computational resources. These requirements include planned LEPs, stockpile support activities, and mitigation efforts against the potential for technical surprise. All of the weapons within the current stockpile are in some stage of the life extension process. The simulation and computational capabilities are crucial for successful execution of these life extensions and for ensuring NNSA can certify these life-extended weapons without conducting a UGT.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Narrow-line Seyfert 1 galaxies in Sloan Digital Sky Survey: a new optical spectroscopic catalogue

ABSTRACT Narrow-line Seyfert 1 (NLSy1) galaxies are an enigmatic class of active galactic nuclei (AGN) that exhibit peculiar multiwavelength properties across the electromagnetic spectrum. For example, these sources have allowed us to explore the innermost regions of the central engine of AGN using X-ray observations and have also provided clues about the origin of relativistic jets considering radio and gamma-ray bands. Keeping in mind the ongoing and upcoming wide-field, multifrequency sky surveys, we present a new catalogue of NLSy1 galaxies. This was done by carrying out a detailed decomposition of >2 million optical spectra of quasars and galaxies from the Sloan Digital Sky Survey Data Release 17 (SDSS-DR17) using the publicly available software ‘Bayesian AGN Decomposition Analysis for SDSS Spectra’. The catalogue contains 22656 NLSy1 galaxies which is more than twice the size of the previously identified NLSy1s based on SDSS-DR12. As a corollary, we also release a new catalogue of 52273 broad-line Seyfert 1 (BLSy1) galaxies. The estimated optical spectral parameters and derived quantities confirm the previously known finding of NLSy1 galaxies being AGN powered by highly accreting, low-mass black holes. We conclude that this enlarged sample of NLSy1 and BLSy1 galaxies will enable us to explore the low-luminosity end of the AGN population by effectively utilizing the sensitive, high-quality observations delivered by ongoing/upcoming wide-field sky surveys. The catalogue has been made public at https://www.ucm.es/blazars/seyfert.

Paliya, Vaidehi S. (ORCID:0000000177745308)↗
DOE OSTI2021

Co-design Center for Exascale Machine Learning Technologies (ExaLearn)

We report rapid growth in data, computational methods, and computing power is driving a remarkable revolution in what variously is termed machine learning (ML), statistical learning, computational learning, and artificial intelligence. In addition to highly visible successes in machine-based natural language translation, playing the game Go, and self-driving cars, these new technologies also have profound implications for computational and experimental science and engineering, as well as for the exascale computing systems that the Department of Energy (DOE) is developing to support those disciplines. Not only do these learning technologies open up exciting opportunities for scientific discovery on exascale systems, they also appear poised to have important implications for the design and use of exascale computers themselves, including high-performance computing (HPC) for ML and ML for HPC. The overarching goal of the ExaLearn co-design project is to provide exascale ML software for use by Exascale Computing Project (ECP) applications, other ECP co-design centers, and DOE experimental facilities and leadership class computing facilities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Developing a Supply Chain Security Program

Amid growing concerns over foreign manufacturing for components and devices deployed in critical energy infrastructure, this research from the national labs will highlight best practices for developing and maintaining a supply chain security program. Tools for asset inventory, tips for developing and maintaining software- and hardware-bills-of-materials (SBOMs and HBOMs), recommended contractual language for vendor agreements, and identification of responsibilities will be shared. We discuss the one-time requirements to enable a successful supply chain security program and the best ways to operationalize this program for maximum impact, including development of robust practices for vulnerability tracking, patch management, and workarounds, with understanding of the reliability and uptime requirements for utilities. The recommendations shared are based on a cyber-informed engineering approach to identification of high-consequence impacts and the engineering controls related to supply chain management that can best mitigate these impacts. This approach allows for prioritization of resources. Additionally, we highlight relative up-front and ongoing costs associated with recommended controls. Viewers will leave with an understanding what a supply chain security program is, and what steps, prioritized for resource-constrained organizations, can build a robust program.

14 SOLAR ENERGY↗
DOE OSTI2021

Building Performance Database API (BPD API) v2.1

The Building Performance Database (BPD) is the largest publicly-available source of measured energy performance data for buildings in the United States. It contains information about the building's energy use, location, and physical and operational characteristics. The BPD can be used by building owners, operators, architects and engineers to compare a building's energy efficiency against customized peer groups, identify energy efficiency opportunities, and set energy efficiency targets. It can also be used by energy efficiency program implementers and policymakers to analyze energy efficiency features and trends in the building stock. The BPD compiles data from various data sources, converts it into a standard format, cleanses and quality checks the data, and provides users with access to the data in a way that maintains anonymity for data providers. This software is the database and the Application Programming Interface (API). Users can utilize the BPD's data to develop their own applications using the API. Version 2.1 included a major update for multiple years of data and refactoring of code for faster queries.

Mathew, Paul↗
DOE OSTI2023

EAM-X Potential Generator

SAND2023-06608O The EAM-X Potential Generator code establishes parameters that describe interactions between atoms in pure metals and alloys. The open-source software allows for the understanding of the relationship between general properties of atoms and macroscopic properties of metals. The code reads in values for the parameters of the model and outputs a table that describes the interactions. This code will be published by Acta Materialia along with two papers describing the method. The output of this code is meant for use by the LAMMPS simulation code created by Sandia. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Chandross, Michael↗
DOE OSTI2025

Process Optimization and Modeling for Minerals Sustainability (PrOMMiS) v1.0.0

The U.S. Department of Energy's ("DOE") Process Optimization and Modeling for Minerals Sustainability project ("PrOMMiS Project") was initiated in 2023 to transform the national Critical Minerals and Rare Earth Elements (CM & REE) landscape, thereby supporting DOE's three enduring strategic objectives: security, economic competitiveness, and environmental responsibility. To address this initiative, the PrOMMiS Project will develop, demonstrate, and deploy an open-source, advanced system modeling, optimization, and analysis application ("PrOMMiS Software Application") that will support industry decision-makers by accelerating the scale-up of novel CM & REE technologies by de-risking the development and deployment of commercial scale processes and maximizing learning throughout the development cycle.

Beattie, KeithS [Lawrence Berkeley National Labora↗
DOE OSTI2021

Smart Building Start (SBS) (CRADA 480)

The idea of Smart Building Start (SBS) is to manage the on/off scheduling of HVAC equipment in buildings in an optimal way in order to achieve comfort conditions at the designated times with the minimal use of energy. This concept is also known as Optimal Start and it has typically been used in buildings to start up equipment based on predictions made for a representative (or average) zone in a building. This means that zones that could have waited longer to receive conditioned air are activated too early leading to unnecessary energy loss. The approach proposed in this project is to develop and implement a distributed version of optimal start that will consider the individual requirements of all treated zones. The developed control strategy will enable smart start of the central plant as well as further localized control over each individual zone by means of setpoint adjustment so that zones are not conditioned too early thereby reducing energy use compared to the current state of the art. This project is a collaboration between PNNL and Verdicity with the goal being to bring the research concept of SBS to commercialization. The SBS algorithm(s) will be implemented and hosted on the PNNL-developed open-platform VOLTTRON which will accelerate bringing the research to practice. It is anticipated that this project will lead to new IP surrounding the algorithm and its decentralized deployment. The project will also further demonstrate the success of VOLTRON as a flexible platform for implementation of innovative algorithms for improving energy efficiency in buildings. Previous studies on smart building start carried out by PNNL have indicated potential energy savings on the order of 10-15% for multi-zone buildings compared to conventional strategies. Verdicity currently has a number of customers who can benefit from the use of this technology. PNNL will work with Verdicity to identify any key gaps in the integrated software and jointly work to enhance and customize it for Verdicity and to integrate it with their existing products for use at their customers’ sites. The proposed work will help previously funded Federal research and development technology investments find their way into a viable commercial market.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

TChem-atm v1.0

SAND2024-11300O TChem-atm is a software library that was developed to solve complex kinetic models for atmospheric chemistry applications. TChem-atm interface employs a hierarchical parallelism design to exploit the massive parallelism available from modern computing platforms. It also supports gas atmospheric chemistry applications, e.g., the energy exascale earth system model. TChem can be used as a box model or coupled with a climate model to compute the time evolution of gas tracer species. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Safta, Cosmin↗
DOE OSTI2020

Holistic Measurement Driven Resilience: Combining Operational Fault and Failure Measurements and Fault Injection for Quantifying Fault Detection, Propagation and Impact. Final report

For HPC systems to date, application resilience to faults and failures has been accomplished by the brute- force method of checkpoint/restart, which allows an application to make forward progress in the face of system and application faults, errors, and failures independent of root cause or end result. It has remained the primary resilience mechanism because we lack a way to identify faults and anticipate consequences early enough to take meaningful mitigating action. However, checkpoint/restart implementations put a tremendous burden on system resources and on the applications themselves and is becoming less feasible at scale. Because we have not yet operated at scales at which checkpoint/restart fails to provide forward progress, despite increasing costs, vendors have had little motivation to provide the instrumentation necessary for early identification of faults and failures. However, as we move from petascale to exascale, component mean time to failure (MTTF) will render the existing techniques ineffectual and/or too expensive. Furthermore, fault recovery mechanisms such as failover and/or error correction introduce performance inconsistency. Instrumentation allowing early indication of problems and tools to enable use of such information by systems, operating systems, and applications offer an alternative, more scalable and less costly solution. In the HMDR project, we built on our experience and expertise developed and accumulated over years of research on design, monitoring, measurement, and assessment of resilient computing systems. Analysis of field data on the current and past generations of extreme-scale systems revealed several challenges that, if not addressed in increasingly larger and more complex systems, may hinder the effectiveness of future exascale computing systems. Specifically, i) file systems and interconnects in current-generation large-scale systems already operate at the margins of resiliency, including consistent performance, and may not scale to larger deployments; ii) automated, software-based failover mechanisms are frequently inadequate and can introduce wider failures, such that failures during recovery may lead to system/application failures, including system-wide outages; and iii) silent data corruption represents a critical fault mode and will require efficient detection mechanisms if next-generation applications are to take full advantage of exascale hardware. To address the above challenges, we assembled a team of world-renowned experts in resilient extreme- scale computing from the University of Illinois (Electrical and Computer Engineering, Computer Science, and NCSA), SNL, LANL, NERSC, and Cray. Our team includes representatives from centers that house many of the largest HPC resources in the world, both today and over the coming years. The team has a unique track record of research in i) system and application failure characterization based on the analysis of field data, ii) data-driven design of fault/error detection mechanisms, and iii) experimental characterization of system/application resiliency. The team includes system owners/operators who provide continuous data collection and access and ensure installation of appropriate analysis tools.

97 MATHEMATICS AND COMPUTING↗