Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Integrated assessment model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Diagnostic-free onboard battery health assessment

Diverse usage patterns induce complex and variable aging behaviors in lithiumion batteries, complicating accurate health diagnosis and prognosis. Separate diagnostic cycles are often used to untangle the battery’s current state of health from prior complex aging patterns. However, these same diagnostic cycles alter the battery’s degradation trajectory, are time-intensive, and cannot be practically performed in onboard applications. Here, in this work, we leverage portions of operational measurements in combination with an interpretable machine learning model to enable rapid, onboard battery health diagnostics and prognostics without offline diagnostic testing and the requirement of historical data. We integrate mechanistic constraints within an encoder-decoder architecture to extract electrode states in a physically interpretable latent space and enable improved reconstruction of the degradation path. The health diagnosis model framework can be flexibly applied across diverse application interests with slight fine-tuning.

battery aging reconstruction↗

The Hawaii Meteorology, Energy and Transmission (MET) Toolkit

Reliable long-term resource adequacy and grid planning in Hawaii require precise, multi-decadal meteorological records. This paper introduces the Hawaii Meteorology, Energy and Transmission (MET) Toolkit, a 26-year (2000-2025) high-fidelity atmospheric dataset developed by the National Laboratory of the Rockies (NLR). We present a validation study of the underlying WRF model configurations, comparing the legacy MYNN PBL scheme against an alternative YSU formulation. Using vertical lidar profiles and surface buoy data, our analysis identified a foundational geometric distortion in the legacy NOW-23 Hawaii dataset caused by an incorrect grid projection. When evaluated on a corrected, zero-distortion grid, the YSU scheme demonstrated superior performance in bias and cRMSE compared to the legacy setup. To address these findings, the MET Toolkit has been re-produced as a unified 26-year record using the optimized YSU setup and corrected geometry. This dataset offers the Hawaii power sector a robust, validated, and homogenous reference for future grid resilience and energy integration.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Electric Distribution System Planning with DERs - High-level Assessment of Tools and Methods

This document addresses analytical tools and methods to support electric distribution system planning with distributed energy resources (DERs) and grid modernization, drawing on leading-edge research and examples from around the United States. In this report, tools include computer models and software, as well as other analytical aids and practices that support distribution system planning. At its core, distribution system planning is about supporting investment decisions. Enhanced and integrated distribution system planning allows utilities to move from a passive reactive role to smart proactive planning with respect to DERs. Distribution system planning can increase transparency around utility distribution system investments before they are brought to the regulatory body for cost recovery, can support deferring traditional infrastructure investments, and can provide information and incentives to customers and third parties about where DERs can help the grid. A growing number of states are beginning to consider a comprehensive distribution system planning process that addresses the costs and benefits of DERs, reflects more choices coming from the customer/third-party domains, is integrated with resource and transmission planning, and incorporates planning scenarios that reflect the dynamic and changing nature of the electricity system

24 POWER TRANSMISSION AND DISTRIBUTION↗

GDSA Framework Development and Process Model Integration FY2022

The Spent Fuel and Waste Science and Technology (SFWST) Campaign of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE), Office of Spent Fuel & Waste Disposition (SFWD) is conducting research and development (R&D) on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). A high priority for SFWST disposal R&D is disposal system modeling (Sassani et al. 2021). The SFWST Geologic Disposal Safety Assessment (GDSA) work package is charged with developing a disposal system modeling and analysis capability for evaluating generic disposal system performance for nuclear waste in geologic media. This report describes fiscal year (FY) 2022 advances of the Geologic Disposal Safety Assessment (GDSA) performance assessment (PA) development groups of the SFWST Campaign. The common mission of these groups is to develop a geologic disposal system modeling capability for nuclear waste that can be used to assess probabilistically the performance of generic disposal options and generic sites. The modeling capability under development is called GDSA Framework (pa.sandia.gov). GDSA Framework is a coordinated set of codes and databases designed for probabilistically simulating the release and transport of disposed radionuclides from a repository to the biosphere for post-closure performance assessment. Primary components of GDSA Framework include PFLOTRAN to simulate the major features, events, and processes (FEPs) over time, Dakota to propagate uncertainty and analyze sensitivities, meshing codes to define the domain, and various other software for rendering properties, processing data, and visualizing results.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

GDSA Framework Development and Process Model Integration FY2023

The Spent Fuel and Waste Science and Technology (SFWST) Campaign of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE), Office of Spent Fuel & Waste Disposition (SFWD) is conducting research and development (R&D) on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). A high priority for SFWST disposal R&D is disposal system modeling (Sassani et al. 2021). The SFWST Geologic Disposal Safety Assessment (GDSA) work package is charged with developing a disposal system modeling and analysis capability for evaluating generic disposal system performance for nuclear waste in geologic media.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Assessment of Potential Dose and Environmental Impacts from Proposed Testing at the INL Radiological Response Training Range

This assessment uses screening-level models to calculate potential environmental impacts from proposed tests at the Idaho National Laboratory (INL) Radiological Response Training Range (RRTR) site. Proposed tests could be conducted using 11 different radioactive material types that include K2O, LaBr3, KBr, Cu, Zr, F, Ga, Ga2O3, NaNO2, Ga-68, and Tc-99m. The tests could potentially release radioactive material to the atmosphere and radionuclides and other contaminants to the soil, which could leach into the unsaturated zone and migrate to the aquifer. Atmospheric transport of radionuclides to potential human receptors and time-integrated air concentrations were calculated with a Gaussian plume model and three years of hourly meteorological data. Potential surface-soil impacts were calculated with the computer program mixing-cell model (MCM). Groundwater impacts were calculated with the computer programs MCM and GWSCREEN. Radiological doses from potential atmospheric releases were calculated for public receptors off the INL Site and for workers at nearby INL facilities. Results were compared to regulatory dose limits. Maximum potential groundwater concentrations were estimated in the aquifer below the NSTR site and compared to drinking water standards or risk-based screening levels for resident tap water. Soil concentrations were calculated and compared to risk-based screening levels for workers and potential future residents. All impacts were estimated assuming 12 tests are conducted annually using all 11 material types for a period of 15 years. This document provides the resources to enable a subject matter expert in the field of environmental assessments to replicate the modeling and calculations. The methodology and parameters are presented in the text. All electronic files, including computer-code input, output, executable files, batch files, scripts, and spreadsheet files are contained in a zip file that can be accessed by selecting “Additional Information” (select Native File) in the INL Electronic Document Management System (EDMS). It is highly unlikely the test scenarios evaluated in this ECAR will adversely impact human health based on comparisons of calculated dose and concentration against regulatory standards and risk-based screening levels. Conservative estimates of dose to workers and the public from atmospheric transport of possible radionuclide releases are far below federal radiation protection standards. Conservative estimates of potential contaminant concentrations in groundwater are less than federal drinking water standards or screening levels. Predicted radionuclide concentrations in surface soils are below risk-based screening levels, except for Ge-68 (material Ga-68) for the worker. The Ge-68 soil concentration can be made less than the worker PRG, if the number of annual tests using Ga-68 is reduced from 12 to 6. However, the sum of ratios still exceeds one because of the high K-40 ratio. If the EF of the worker (number of days the worker is in the contaminated testing area) is reduced from 225 days/yr (default value for full time worker) to 112 days/yr, the Ge-68 ratio is less than one and the sum of ratios is less than one. Actual radiation doses and groundwater and surface-soil concentrations are likely to be much less than those calculated because of the conservative assumptions and parameters employed in the modeling. For example, atmospheric-transport calculations assume the entire inventory of each material type is readily released to the atmosphere and no plume deposition, depletion, or radioactive decay occurs during transport. The calculations also assume the same meteorological conditions (e.g., wind velocity, wind direction, stability class) that produce the maximum 95th percentile concentration (i.e., concentration representing the 95th percentile of a distribution of concentrations derived from 3 years of hourly meteorological data) at each receptor location are the same for all 12 tests during the year, and each receptor is assumed to be present during all 12 tests. The surface-soil assessment assumes the entire inventory of each test is deposited in the top 5 cm of soil. No atmospheric dispersal is assumed, and the radionuclides are subject only to leaching and radioactive decay. The groundwater-pathway modeling is conservative in that it is one-dimensional in the unsaturated zone (no lateral spreading/dilution) and assumes the entire inventory of contaminants infiltrates into the ground at the same location for every test. This is especially conservative for particulate radionuclides because they would have to dissolve or corrode first and some would be dispersed into the atmosphere. The groundwater receptor is also assumed to consume water directly from a hypothetical well positioned in the location of maximum concentration. In addition, conservative degradation rates were used, and volatilization was not considered for the nonradioactive chemical

54 ENVIRONMENTAL SCIENCES↗

Extreme windstorms in the Northeastern USA in the contemporary and future climate

Cold-season windstorms represent an important, and potentially changing, geophysical hazard in the Northeastern United States. Here we employ an integrated research methodology including both a storyline approach, where three intense windstorms from the current climate are subjected to pseudo-global warming (PGW) experiments, and a long-term transient simulation using the Weather Research and Forecasting (WRF) model. An ensemble of WRF simulations is built for each windstorm using different planetary boundary layer and microphysical parameterizations. The fidelity assessment suggests all ensemble members capture the windstorm evolution in contemporary climate. The configuration with highest fidelity is used in the PGW experiments performed with perturbed temperature fields, constant relative humidity, and deiced Great Lakes. These perturbation simulations indicate some evidence for a reduction of sea level pressure and increases in wind speed over and downwind of the Great Lakes and over the Atlantic Ocean plus an increase in precipitation accumulation but a reduction in snow coverage. These changes are spatially inhomogeneous in terms of magnitude and sign but are consistent with changes in potential vorticity. Alberta Clippers and Colorado Lows dominate the cyclones responsible for historical windstorms and thus are sampled in the PGW simulations. However, the transient simulation suggests an increasing role for tropical cyclones that undergo transition to extratropical cyclones. Furthermore, this reinforces the value of combining information from both PGW perturbation experiments within a storyline context and transient simulations when seeking to quantify the future risk associated with cold-season windstorms under changing climate.

54 ENVIRONMENTAL SCIENCES↗

Specific iron binding to natural sphingomyelin membrane induced by non-specific co-solutes

Sphingomyelin (SPM), a crucial phospholipid in the myelin sheath, plays a vital role in insulating nerve fibers. We hypothesize that iron ions selectively bind to the phosphatidylcholine (PC) template within the SPM membrane under near-physiological conditions, resulting in disruptions to membrane organization. These interactions could potentially contribute to the degradation of the myelin sheath, thereby playing a role in the development of neurodegenerative diseases. We utilized synchrotron-based X-ray spectroscopy and diffraction techniques to study the interaction of iron ions with a bovine spinal-cord SPM monolayer (ML) at the liquid-vapor interface under physiological conditions. The SPM ML serves as a model system, representing localized patches of lipids within a more complex membrane structure. The experiments assessed iron binding to the SPM membrane both in the presence of salts and with additional evaluation of the effects of various ion species on membrane behavior. Grazing incidence X-ray diffraction was employed to analyze the impact of iron binding on the structural integrity of the SPM membrane. Furthermore, our results demonstrate that iron ions in dilute solution selectively bind to the PC template of the SPM membrane exclusively at near-physiological salt concentrations (e.g., NaCl, KCl, KI, or CaCl 2 ) and are pH-dependent. In-significant binding was detected in the absence of these salts or at near-neutral pH with salts. The surface adsorption of iron ions is correlated with salt concentration, reaching saturation at physiological levels. In contrast, multivalent ions such as La 3+ and Ca 2+ do not bind to SPM under similar conditions. Notably, iron binding to the SPM membrane disrupts its in-plane organization, suggesting that these interactions may compromise membrane integrity and contribute to myelin sheath damage associated with neurological disorders.

59 BASIC BIOLOGICAL SCIENCES↗

Adaptation to climate change through strategic integration of long fallow into cropping system in a dryland Mediterranean-type environment

The crop-growing region of Western Australia characterized by a Mediterranean-type climate is projected to become warmer and drier. Appropriate selection of crop sequences will be of importance to cope with these climatic changes for this largest grain-producing region of Australia. Through linking a widely used crop model (APSIM), 26 General Circulation Models (GCMs) with one Shared Socioeconomic Pathway (SSP585) and economic analysis, we explored how the climate change would affect dryland wheat cropping and whether/how long fallow (the practice of leaving a field out of production for an entire growing season) could be integrated into wheat cropping system in Western Australia. The potential adaptation of long fallow into wheat system was assessed with four fixed rotations (fallow-wheat, fallow-wheat-wheat, fallow-wheat-wheat-wheat, and fallow-wheat-wheat-wheat-wheat) and four flexible sowing rule-based rotations (the land was fallowed if sowing rule was not met), compared with continuous wheat. The simulation results at four representing locations show that climate change would have negative impacts on both yield and economic return of continuous wheat cropping in Western Australia. Wheat after fallow out-yielded and out-profited wheat after wheat under future climate. But integrating fallow into wheat cropping systems with the above fixed rotations would lead to yield and economic loss. By contrast, cropping systems in which fallowing took place when sowing condition could not be met at a certain time would achieve comparable yield and economic return to continuous wheat, with wheat yield being only 5% less than continuous wheat and the gross margin being $12ha -1 more than continuous wheat averaged across locations. We highlight strategic integration of long fallow into cropping system in a dryland Mediterranean-type environment would have a great potential to cope with future climate change. These findings can be extended into other Mediterranean-type cropping regions in Australia and beyond.

54 ENVIRONMENTAL SCIENCES↗

Measurement and Simulation of the Magnetic Fields from a 555 Timer Integrated Circuit Using a Quantum Diamond Microscope and Finite-Element Analysis

Quantum diamond microscope (QDM) magnetic field imaging is an emerging interrogation and diagnostic technique for integrated circuits (ICs). To date, the ICs measured with a QDM have been either too complex for us to predict the expected magnetic fields and benchmark the QDM performance or too simple to be relevant to the IC community. In this paper, we establish a 555 timer IC as a “model system” to optimize QDM measurement implementation, benchmark performance, and assess IC device functionality. To validate the magnetic field images taken with a QDM, we use a spice electronic circuit simulator and finite-element analysis (FEA) to model the magnetic fields from the 555 die for two functional states. Furthermore, we compare the advantages and the results of three IC-diamond measurement methods, confirm that the measured and simulated magnetic images are consistent, identify the magnetic signatures of current paths within the device, and discuss using this model system to advance QDM magnetic imaging as an IC diagnostic tool.

74 ATOMIC AND MOLECULAR PHYSICS↗

First-principles modeling of plasmons in aluminum under ambient and extreme conditions

The theoretical understanding of plasmon behavior is crucial for an accurate interpretation of inelastic scattering diagnostics in many experiments. In this work, we highlight the utility of linear response time-dependent density functional theory (LR-TDDFT) as a first-principles framework for consistently modeling plasmon properties. We provide a comprehensive analysis of plasmons in aluminum from ambient to warm dense matter conditions and assess typical properties such as the dynamical structure factor, the plasmon dispersion, and the plasmon lifetime. We compare our results with scattering measurements and with other TDDFT results as well as models such as the random phase approximation, the Mermin approach, and the dielectric function obtained using static local field corrections of the uniform electron gas parametrized from path-integral Monte Carlo simulations. We conclude that results for the plasmon dispersion and lifetime are inconsistent between experiment and theories and that the common practice of extracting and studying plasmon dispersion relations is an insufficient procedure to capture the complicated physics contained in the dynamic structure factor in its full breadth.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Integrating Qualitative and Quantitative Aspects of Risk Management

This topical report summarizes the integration of qualitative and quantitative aspects of the risk management workflow for the Southwest Regional Partnership on Carbon Sequestration (SWP) Phase III Demonstration Project, located near the community of Farnsworth in northernmost Texas. Detail on some aspects of this subject has been previously provided in internal project reports on qualitative risk assessment processes, in a published paper summarizing quantitative risk modeling, and in many other published papers on specific risk modeling efforts. These prior documents are cited but the details are not repeated here. The report documents work undertaken for Task 7.4.1 of U.S. Department of Energy award number DE- FC26-05NT42591.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Enhancement of PyARC for Westinghouse Electric Company’s Lead Fast Reactor Design and Modeling (Final TCF Report)

Westinghouse Electric Company is a nuclear reactor vendor headquartered in the U.S. that is developing advanced reactor technology for the U.S. and global markets. Westinghouse has been relying on the neutronics Argonne Reactor Codes (ARC) executed through the NEAMS Workbench and its PyARC module that are developed under the DOE-NE Nuclear Energy Advanced Modeling and Simulation (NEAMS) and Advanced Reactor Technology (ART) – Fast Reactor programs. Through this user experience, Westinghouse identified several enhancements that would benefit the ARC codes’ usability by the US industry and therefore its commercialization potential. The enhancements were proposed to deliver both improvements in workflow and analysis capabilities to better support effective fast reactor core design and analysis to the nuclear industry. The PyARC workflow was extended in this project by integrating non-neutronic ARC codes DASSH and NUBOW-3D. The Ducted Assembly Steady-State Heat equation (DASSH) code is developed at ANL to perform steady-state thermal hydraulic sub-channel analysis in liquid metal fast reactor assemblies to determine optimized coolant flow and temperature distributions, which in this project was updated and validated for lead fast reactor (LFR) applications. The interface between REBUS and NUBOW-3D were improved in this project to assess the impact of the core restraint design and thermal induced expansion effects on the reactivity of the core, and to model the deformations of the fuel assemblies induced by temperature and irradiation. Finally, the ARC models that were extensively verified and validated through various SFR-based modeling benchmarks are extended in this project through code-to-code comparison on relevant LFR-specific neutronics benchmarks against Monte-Carlo neutronic solutions. Overall, this work enables verification of the capability of the ARC codes for a wide range of Generation-IV reactor designs. The outcome of this project is the release of a comprehensive modeling toolkit of validated, robust and efficient codes, as well as their user interface, that enables industry to perform a wide range of fast reactor analyses for design and licensing of their concepts.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Accelerating Resilience of the Community through Holistic Engagement and use of Renewables (ARCHER) Planning Framework

The primary objective of the Accelerating Resilience of the Community through Holistic Engagement and Use of Renewables (ARCHER) initiative was to identify and incorporate the unique variations in energy burden, social vulnerability, living conditions, and access to essential services that differ across communities. By accounting for these localized factors—down to the neighborhood level—the project supports more targeted and effective investments in community resilience. The framework seeks to establish practical planning guidance, methods, and performance measures for community energy resilience, integrate community-level and electric utility system resilience planning, and assess its effectiveness through comparison with conventional and operational planning approaches. A key component of the project was its data exchange platform, which is used to evaluate and demonstrate the tools, methodologies, and planning approaches developed through ARCHER. This open-source platform enables developers and vendors of distribution and outage management systems to build upon the research by incorporating its concepts into their own tools and workflows. This capability is enabled by the transparent availability of data, functional requirements, and the underlying information model. The project yielded several important insights. First, meaningful engagement with communities is essential to achieving comprehensive resilience outcomes. Second, resilience planning is most effective when electric grid considerations and broader community needs are addressed in a coordinated manner. Third, the use of platforms that allow for real-time input from communities can enhance utility responsiveness during restoration activities. Fourth, a structured and systematic planning approach can successfully translate ARCHER concepts into practice. Fifth, the development of an integrated metric that reflects both grid performance and community impacts provides a more holistic basis for evaluating resilience. Finally, incorporating community engagement and equity considerations into grid operations is critical, particularly during severe weather events that result in extended outages.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A multi-criteria land suitability assessment of field allocation decisions for switchgrass

With the goal of evaluating biomass resource availability in certain regions in the United States, the Department of Energy, Department of Agriculture, Environmental Protection Agency, national laboratories, and Forest Service research laboratories, together with academic and industry collaborators, performed a resource analysis study, 2016 Billion-Ton Report: Advancing Domestic Resources for a Thriving Bioeconomy, Volume 1: Economic Availability of Feedstocks, using POLYSYS model to estimate biomass potential. The study provided county- and state-level biomass potential projections, with biomass feedstock production estimates and suitability assessment of lands acreage likely to transition to energy crops. For this analysis, we estimate biomass supply by year 2028, more specifically, lands acreage transition to switchgrass in the Midwest of the United States, across 50 counties in 3 states (Nebraska, Kansas, and Colorado). We propose a multi-criteria site suitability framework, to determine the potential acreage and production for switchgrass, at the field level. Site selection criteria span agronomic and ecosystem services such as previous land cover, crop rotation, soil water holding capacity, crop productivity, field efficiency, topography, soil organic matter, soil leaching propensity, distance to surface water bodies, and soil erosivity. Efficient agricultural field selection for dedicated energy crops field allocation is critical to evaluate biomass resource availability, and it is our position that estimation at the field level would provide a more accurate and useful estimation to support an emerging bioeconomy. Using field suitability scores and county-level assessments, we model land allocation decision for energy crop in the future, estimating the spatial distribution of dynamics of energy crop adoption with priority to fields scoring the highest. Additionally, compared with POLYSYS results from the report mentioned above, our method shows good performance overall, with about 2% and 1.2% of difference in switchgrass acreage allocation and crop production, respectively.

54 ENVIRONMENTAL SCIENCES↗

Electrical substation grid testbed for DLT applications of electrical fault detection, power quality monitoring, DERs use cases and cyber-events

Electrical utilities continue to deploy more intelligent electronic devices (IEDs) inside and outside electrical substation, and are associated with customer-owned distributed energy resources (DERs). The integrity and confidentiality of data from these IEDs, like power meters and protective relays, is crucial. Blockchain technology could improve the resilience of microgrids by improving the security of data sharing. The penetration of customer-owned DERs (renewable energy sources) and the increasing deployment of IEDs can lead to integrate power system applications with Distributed Ledger Technology (DLT). In this study, we implemented the electrical faulted phase detection and power quality monitoring algorithms with a Cyber Grid Guard (CGG) system using DLT. In addition, the DERs (wind turbine farms) use case and protective relay cyber-event tests were assessed, by using the CGG system with DLT. In the experimental model, the testbed was created by using a real-time simulator and CGG system with power meters/ protective relays in-the-loop. The data collected from the CGG system and IEDs were compared with the same time stamp source. These results had shown the successful assessment of protection, control and monitoring applications using a CGG system with DLT. In the future, the ESGT with DERs and the CGG system will be used in other power system applications, based on implementing smart contracts between electrical utilities with customer-owned DERs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Extratropical shortwave cloud feedbacks in the context of the global circulation and hydrological cycle

Shortwave (SW) cloud feedback ($SW_{FB}$) is the primary driver of uncertainty in the effective climate sensitivity (ECS) predicted by global climate models (GCMs). ECS for several GCMs participating in the sixth assessment report exceed 5K, above the fifth assessment report ‘likely’ maximum (4.5K) due to extratropical $SW_{FB}$’s that are more positive than those simulated in the previous generation of GCMs. Here we show that across 57 GCMs Southern Ocean $SW_{FB}$ can be predicted from the sensitivity of column-integrated liquid water mass (LWP) to moisture convergence and to surface temperature. In this work, the response of LWP to moisture convergence and the response of albedo to LWP anti-correlate across GCMs. This is because GCMs that simulate a larger response of LWP to moisture convergence tend to have higher mean-state LWPs, which reduces the impact of additional LWP on albedo. Observational constraints suggest a modestly negative Southern Ocean $SW_{FB}$— inconsistent with extreme ECS.

54 ENVIRONMENTAL SCIENCES↗

Fault Injection for TensorFlow Applications

As machine learning (ML) has seen increasing adoption in safety-critical domains (e.g., autonomous vehicles), the reliability of ML systems has also grown in importance. While prior studies have proposed techniques to enable efficient error-resilience (e.g., selective instruction duplication), a fundamental requirement for realizing these techniques is a detailed understanding of the application’s resilience. In this work, we present TensorFI 1 and TensorFI 2, high-level fault injection (FI) frameworks for TensorFlow-based applications. TensorFI 1 and 2 are able to inject both hardware and software faults in any general TensorFlow 1 and 2 program respectively. Both are configurable FI tools that are flexible, easy to use, and portable. They can be integrated into existing TensorFlow programs to assess their resilience for different fault types (e.g., bit-flips in particular operations or layers). We use the TensorFI 1 and TensorFI 2 to evaluate the resilience of 12 and 10 ML programs written in TensorFlow, including DNNs used in the autonomous vehicle domain. The results give us insights into why some of the models are more resilient. We also measure the performance overheads of the two injectors, and present 4 case studies, two for each tool, to demonstrate their utility.

97 MATHEMATICS AND COMPUTING↗