SEARCH · Engineering Papers

Results for “Evaluation Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Knowledge graph-aided Bayesian active learning for top- K genetic interaction discovery

In silico methods for predicting the effects of multi-gene perturbations hold great promise for advancing functional genomics, computational drug discovery, and disease modeling. However, the development of these predictive algorithms for mammalian systems has been hampered by limited datasets and high experimental costs. In this study, we present a Bayesian active learning framework designed to discover pairwise host gene knockdowns that effectively inhibit viral proliferation in an in vitro HIV-1 infection model. Our method leverages a biological knowledge graph as side information and employs a computationally efficient batch diversification approach. We evaluated this framework using a dataset of viral load measurements obtained from multi-day dual-gene depletion experiments, encompassing all possible pairwise knockdowns of over 350 host genes associated with HIV infection. We demonstrate that our framework rapidly identifies the most effective gene knockdown pairs for reducing viral load. Furthermore, we show that incorporating side information enhances performance during the early stages of active learning (low data regime), while our batch diversification strategy significantly boosts performance in later stages (high data regime). This framework is general and can be adapted to explore gene interactions in other contexts, such as synthetic lethality prediction and mapping epistatic effects across quantitative trait loci.

Computational biology and bioinformatics↗

DOE OSTI2026

Path-integral predictions for preasymptotic quantum tunneling

When tunneling occurs out of generic initial states, a significant fraction of probability is lost at early times, during which the dynamics is governed by excited resonance states. However, first-principles analyses based on path-integrals have only captured the leading asymptotic behavior, during which the tunneling rate is dominated by the false vacuum contribution. In this work, we discuss the behavior in the preasymptotic regime from a first-principles path-integral perspective. We demonstrate how the relevant expressions can be evaluated systematically through semiclassical methods in the recently developed steadyon picture. This approach allows one to trace the role of the relevant physical scales, making transparent the underlying assumptions and approximations, and offering a clear path to establishing a systematically improvable framework to evaluate tunneling rates nonperturbatively.

Lin, Joshua↗

DOE OSTI2021

Integrated U.S. nationwide corridor charging infrastructure planning for mass electrification of inter-city trips

This study introduces an integrated modeling framework to evaluate long-term national corridor charging infrastructure requirements in the United States to support the growing inter-city charging demand with the rapid growth in the battery electric vehicle (BEV) market. The core model is an optimization model that considers spatial and temporal dimensions and models heterogeneous behaviors between travelers. The model also introduces the travelers’ inconvenience cost function by linking travelers’ acceptance of the charging infrastructure with exogenous technology and social factors. The inconvenience cost function simulates mode choice between BEVs and alternative modes by heterogenous travelers. We applied the framework to assess the inter-regional charging infrastructure requirements for the entire U.S. mainland interstate highway network. We evaluated impacts on the infrastructure design and its public acceptance with changes in policy, technology, and demographic characteristics, and we also quantified the importance of modeling full-scale inter-regional charging infrastructure requirements compared to the conventional regional level analyses.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Data-driven Vulnerability Analysis of Networked Pipeline System

This paper introduces an attack generation framework for evaluating the vulnerability of nonlinear networked pipeline systems. The vulnerability analysis is formulated as determining the presence of feasible attack sets, defined by boundary functions representing the effectiveness and stealthiness of attack signals with respect to the objective and attack detection module. The framework utilizes three data-driven models, including two discriminative models that learn the boundary functions and a generative model that produces elements of the feasible attack set. A new loss function ensures successful attack generation with high probability.

03 NATURAL GAS↗

DOE OSTI2023

Impacts of non-residential solar on residential adoption decisions

Household decisions to adopt rooftop solar photovoltaics are partly driven by social influence. Previous research on solar adoption influence has focused on influence among residential peers. Here, we expand the framework of solar adoption influence by exploring the influence of non-residential installations on residential adoption decisions. We use staggered differences-in-differences to estimate non-residential influence effects using a large data sample of residential adoptions. We also critically evaluate prevailing frameworks for solar adoption influence. We find that non-residential installations are associated with accelerated residential adoption rates, on the order of 0.4 additional residential adoptions per quarter per non-residential installation. We show that non-residential systems exert a continuous, long-term influence on residential adoption decisions. We explore separate results and influence mechanisms for solar installed on commercial buildings, government buildings, and houses of worship. The results suggest that non-residential solar adopters could serve as partners in policies to “seed” residential adoption in underserved communities.

14 SOLAR ENERGY↗

DOE OSTI2022

Smoothed particle hydrodynamics modeling and analysis of oxide reduction process for uranium oxides

A common kinetic feature for oxide reduction chemical/electrochemical processes is oxygen transport via a porous metallic layer, which has been considered as a rate-determining step for reducing uranium oxides to metallic uranium. Accounting this kinetic behavior must involve the resolution of the moving reactive interface between shrinking oxide and expanding metal phases. This study presents a numerical model using smoothed particles hydrodynamics (SPH) to effectively deal with the evolution of the shrinking core reaction interface and oxygen transport via mass transfer of lithium oxide (Li 2 O) species in multiple mass transfer domains. We successfully validated the proposed model against a theoretical derivation for the oxide reduction process handling a shrinking oxide core with molten salt and metal ash medium on a simple planar geometry. Armed with successful validation results, the model examined a realistic reactant geometry to extend the arguments beyond the one-dimensional analyses, allowing the proposed model to apply to general application scenarios with multi-dimensional geometry. Here, this study demonstrated that the proposed model could simulate and evaluate an arbitrary reaction basket design without iterative experimental trials, which is prohibitive for a scaled high-temperature molten salt study in an inert environment. The construct potentially provides not only deep insights on multiphysics behaviors governing the process dynamics but also a robust framework for evaluating and screening candidate basket designs in the most cost-effective manner.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2022

Evaluation and Optimization of Snow Albedo Scheme in Noah-MP Land Surface Model Using In Situ Spectral Observations in the Colorado Rockies

The Biosphere-Atmosphere Transfer Scheme (BATS) ground snow albedo algorithm is commonly used in land-surface models (LSM), weather forecasting and research applications. This study addresses key uncertainties in BATS simulated ground snow albedo within the Noah-MP LSM framework through evaluation and optimization of the Noah-MP BATS ground snow albedo formulation using 2-band (visible and near-infrared (NIR)) in situ albedo observations at Rocky Mountain field stations. The Noah-MP BATS ground snow albedo scheme is extremely sensitive to its input parameters. Namely, an ensemble generated by varying BATS input parameters within potentially plausible ranges provides an average daily range (maximum ensemble member minus minimum ensemble member) of ground snow albedo exceeding 0.45 in visible and NIR bands. Parameter optimization improves agreement between simulated and in situ observed ground snow albedo in visible, NIR and broadband spectrums. Importantly, optimized parameters result in reduced biases relative to observed fresh-snow albedo and better agreement with observed albedo decay. Our analysis across different sites supports that the optimized BATS ground snow albedo parameters are appropriate to transfer in space and time, at least within the region studied (the central-southern Rocky Mountains). The primary error source remaining after parameter optimization is that observed fresh-snow albedo is highly variable, particularly in the NIR spectrum, whereas BATS fresh-snow albedo is constant, an issue which requires further investigation. This study shows significant correlations between observed fresh-snow albedo and surface meteorological conditions (e.g., downward shortwave radiation and temperature) which can support future model development that attempts to include a time-varying formulation for fresh-snow albedo.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2005

Diverse Applications of Occultation Data in Ozone Assimilation

Ozone profiles from solar occultation instruments provide invaluable information that can be used to evaluate the quality of assimilated ozone fields, from case studies to long-term phenomena. Occultation data can also be applied to include physical constraints while developing components of an assimilation system. Conversely, assimilation of occultation data can help in their validation, and it provides a framework for evaluation of the impact of occultation data on constraining global ozone fields within models. We illustrate these diverse applications by a series of examples using the ozone assimilation system at NASA/Goddard. In a case study, low ozone in the lower stratosphere due to transport of air from the Tropics to northern high latitudes that was captured by assimilation of Aura Microwave Limb Sounder (MLS) and Solar Backscatter Ultraviolet (SBUV) data, was found to agree with SAGE III data. For long-term monitoring, the quality of a multi-year SBUV-only assimilation was evaluated using monthly-mean time series of POAM, HALOE, and SAGE I1 data. We found realism in the representation of the annual cycle in ozone and in some aspects of interannual variability. Assimilation of POAM data was shown to improve the representation of lower stratospheric ozone, especially over Antarctica. More recently, we assimilated ILAS II ozone data in order to help in their validation. Solar occultation data are used to estimate parameters in a new model for forecast error variances that is being developed. These examples demonstrate the importance of occultation data for ozone assimilation, and potential of assimilation to increase the impact and the value of occultation data.

Markowitz, A.↗

DOE OSTI2023

Predicting future well performance for environmental remediation design using deep learning

Here in this study, we developed a deep learning (DL) framework with a multi-channel three-dimensional convolutional neural network (MC3D-CNN) to predict well performance and thereby assist future environmental remediation design. Such prediction of extraction well performance at designated locations is critical for configuring pump-and-treat (P&T) well network design and operation, setting reasonable target closure dates for overall remedying, and estimating remedy costs. The framework is developed with operational and monitoring data routinely collected during P&T remedy operations, including well extraction and injection rates as well as in situ contaminant concentrations. Traditionally, the collected data were rarely used for purposes other than assessing past well performance and the accuracy of the conceptual site model. However, recent advances in data-driven computational approaches enable better use of the large datasets to inform future well performance, enhance site characterization, and improve remediation planning. In this study, we established a DL framework to integrate transient three-dimensional contaminant plumes and multiple aquifer properties (e.g., hydraulic conductivity and hydrostratigraphic maps) to identify characteristic patterns controlling and representing extraction well mass recovery, aiming at providing future mass recovery estimates for existing wells and candidate wells at any proposed locations. We evaluated our framework by using a realistic synthetic dataset generated from a well-calibrated flow and transport model used in the 200 West Area of the U.S. Department of Energy’s Hanford Site in southeastern Washington state. The multi-channel feature in our framework allows integration of various types and temporal densities of training datasets for DL model development. Overall, we found that the trained DL model achieved an accuracy of over 90% in ranking extraction well performance in validation datasets, and over 80% in predicting high-performance-ranking well locations. This data-informed approach provides a flexible tool to support adaptive site management, streamline decision-making, and potentially reduce remediation time and costs. Our DL framework can be used as a filtering tool to improve the current P&T network optimization design by reducing the number of candidate well locations.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Out-of-Distribution Detection and Radiological Data Monitoring Using Statistical Process Control

Abstract Machine learning (ML) models often fail with data that deviates from their training distribution. This is a significant concern for ML-enabled devices as data drift may lead to unexpected performance. This work introduces a new framework for out of distribution (OOD) detection and data drift monitoring that combines ML and geometric methods with statistical process control (SPC). We investigated different design choices, including methods for extracting feature representations and drift quantification for OOD detection in individual images and as an approach for input data monitoring. We evaluated the framework for both identifying OOD images and demonstrating the ability to detect shifts in data streams over time. We demonstrated a proof-of-concept via the following tasks: 1) differentiating axial vs. non-axial CT images, 2) differentiating CXR vs. other radiographic imaging modalities, and 3) differentiating adult CXR vs. pediatric CXR. For the identification of individual OOD images, our framework achieved high sensitivity in detecting OOD inputs: 0.980 in CT, 0.984 in CXR, and 0.854 in pediatric CXR. Our framework is also adept at monitoring data streams and identifying the time a drift occurred. In our simulations tracking drift over time, it effectively detected a shift from CXR to non-CXR instantly, a transition from axial to non-axial CT within few days, and a drift from adult to pediatric CXRs within a day—all while maintaining a low false positive rate. Through additional experiments, we demonstrate the framework is modality-agnostic and independent from the underlying model structure, making it highly customizable for specific applications and broadly applicable across different imaging modalities and deployed ML models.

Zamzmi, Ghada↗

DOE OSTI2021

Modeling Framework for Bulk Electric Grid Impacts from HEMP E1 and E3 Effects (Tasks 3.1 Final Report)

This report presents a framework to evaluate the impact of a high-altitude electromagnetic pulse (HEMP) event on a bulk electric power grid. This report limits itself to modeling the impact of EMP E1 and E3 components. The co-simulation of E1 and E3 is presented in detail, and the focus of the paper is on the framework rather than actual results. This approach is highly conservative as E1 and E3 are not maximized with the same event characteristics and may only slightly overlap. The actual results shown in this report are based on a synthetic grid with synthetic data and a limited exemplary EMP model. The framework presented can be leveraged and used to analyze the impact of other threat scenarios, both manmade and natural disasters. This report d escribes a Monte-Carlo based methodology to probabilistically quantify the transient response of the power grid to a HEMP event. The approach uses multiple fundamental steps to characterize the system response to HEMP events, focused on the E1 and E3 components of the event. 1) Obtain component failure data related to HEMP events testing of components and creating component failure models. Use the component failure model to create component failure conditional probability density function (PDF) that is a function of the HEMP induced terminal voltage. 2) Model HEMP scenarios and calculate the E1 coupled voltage profiles seen by all system components. Model the same HEMP scenarios and calculate the transformer reactive power consumption profiles due to E3. 3) Sample each component failure PDF to determine which grid components will fail, due to the E1 voltage spike, for each scenario. 4) Perform dynamic simulations that incorporate the predicted component failures from E1 and reactive power consumption at each transformer affected by E3. These simulations allow for secondary transients to affect the relays/protection remaining in service which can lead to cascading outages. 5) Identify the locations and amount of load lost for each scenario through grid dynamic simulation. This can be an indication of the immediate grid impacts from a HEMP event. In addition, perform more detailed analysis to determine critical nodes and system trends. 6) To help realize the longer-term impacts, a security constrained alternating current optimal power flow (ACOPF) is run to maximize critical load served. This report describes a modeling framework to assess the systemic grid impacts due to a HEMP event. This stochastic simulation framework generates a large amount of data for each Monte Carlo replication, including HEMP location and characteristics, relay and component failures, E3 GIC profiles, cascading dynamics including voltage and frequency over time, and final system state. This data can then be analyzed to identify trends, e.g., unique system behavior modes or critical components whose failure is more likely to cause serious systemic effects. The proposed analysis process is demonstrated on a representative system. In order to draw realistic conclusions of the impact of a HEMP event on the grid, a significant amount of work remains with respect to modeling the impact on various grid components.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Workflow for evaluating enzyme immobilization and performance for continuous flow manufacturing

Enzymes have shown promise in various industries due to their functional specificity, catalytic efficiency, and environmental sustainability. These biological catalysts can be a pivotal component of manufacturing pipelines like continuous flow chemistry. For this, there exists a need to robustly immobilize enzymes on solid supports and assess the effects of the solid supports on catalytic performance and stability. Here, we use an industrially relevant model enzyme, C. ensiformis (Jack bean) urease, to demonstrate immobilization and assess performance in the context of continuous flow manufacturing. Various immobilization strategies were screened focusing on immobilization efficiency, protocol simplicity, and urease biocatalyst kinetics. Based on this, CDI-agarose and NHS-agarose resins were identified as the best-performing immobilization strategies for urease. CDI-agarose-urease and NHS-agarose-urease were then scaled up and applied to a large-scale continuous flow reactor to evaluate product yields, operational stability, and long-term stability. These experiments identified differences in stability and performance depending on the immobilization method tested. This highlights the importance of screening immobilization methods and subsequent enzyme performance for each candidate biocatalyst used in manufacturing to promote optimal performance and stability. As such, this work provides a framework for evaluating enzyme biocatalyst immobilization approaches to improve performance and enable transition into industrial processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

Experimental Test Bed to Enable Realistic Evaluations for Direct Transfer Trip Relaying via Private Wireless LTE Communications

Increasing penetration levels of inverter-based distributed energy resources (DERs) in distribution systems are creating challenges in system operation. Currently, wired or proprietary wireless communications are used by advanced distribution management systems (ADMS) to detect the state of the system and control the DERs for optimal operation. Wireless communications are an alternative solution that can enable connectivity between the dispersed assets used in distribution system applications. This paper demonstrates an experimental test bed to enable the realistic evaluation of communications system characteristics for direct transfer trip (DTT) relaying of a photovoltaic inverter system using a private 900-MHz spectrum wireless LTE network. Private LTE network communications can be deployed to many remote DERs and other grid-edge devices to prevent costly infrastructure upgrades across distribution systems. In addition, this paper provides a framework for evaluating the impact of signal strength and network traffic in communications systems. The results shown develop a better understanding of the best practices for using LTE communications systems across multiple utility applications, such as protective relaying, voltage regulation, and supervisory control and data acquisition system messages.

900-MHz LTE network↗

DOE OSTI2025

Expected occurrence of wildlife in US Atlantic offshore wind areas

Offshore wind energy has entered a pivotal phase of development for the U.S. Atlantic Outer Continental Shelf (OCS), a region that supports critical habitats, migratory corridors and flyways for many marine species. Assessing where and when marine wildlife occurs is a crucial first step in developing a risk assessment framework to evaluate potential risks and impacts of offshore wind development. In this study, we perform this initial assessment by evaluating the expected occurrence of marine mammal, seabird and sea turtle taxa in areas of interest to identify patterns and potential areas of concern. Specifically, this work depicts the expected monthly density of 84 marine species and taxa within each of the 29 active wind energy lease areas plus a 10 km buffer to account for nearby activity. We then compare these densities to subregional thresholds, evaluated as the 90th percentile of the subregion’s monthly density, to provide comparisons across the shelf region. This analysis synthesizes the most recent spatial distribution models of 31 marine mammal taxa (26 species and 5 guilds), 49 seabird species and 4 sea turtle species to provide a unified evaluation of the major marine wildlife in the region. Out of the 84 species and taxa analyzed, 56 exhibit levels of expected density in wind energy areas that exceed the corresponding 90th percentile subregional threshold at some point throughout the year. These results represent an initial assessment in the broader Occurrence, Exposure, Response, and Consequence (OERC) framework, originally developed by the U.S. Navy for marine species risk assessments. These results offer valuable guidance to marine spatial planners, management agencies and offshore wind developers on the expected locations and timing of interaction risk to wildlife species in or near wind energy areas across the region.

17 WIND ENERGY↗

DOE OSTI2020

Experimental Test Bed to Enable Realistic Evaluations for Direct Transfer Trip Relaying via Private Wireless LTE Communications: Preprint

900 MHz LTE network↗

DOE OSTI2021

Experimental Test Bed to Enable Realistic Evaluations for Direct Transfer Trip Relaying via Private Wireless LTE Communications

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2025

Uncertainty and Sensitivity Analysis Methods and Applications in the GDSA Framework (FY2025)

The Spent Fuel and Waste Science and Technology Campaign (SFWST) of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE) is conducting research and development on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). Two priorities for SFWST are design concept development and disposal system modeling. These priorities are directly addressed in the Geologic Disposal Safety Assessment (GDSA) control account, which is charged with developing a geologic repository system modeling and analysis capability, and the associated software, GDSA Framework, for evaluating disposal system performance for nuclear waste in geologic media. This report describes specific activities in the Fiscal Year (FY) 2025 associated with the GDSA Uncertainty and Sensitivity Analysis Methods work package. This report fulfills the GDSA Uncertainty and Sensitivity Analysis Methods work package (SF-25SN01030407) level 3 milestone, Uncertainty and Sensitivity Analysis Methods and Applications in GDSA Framework (FY2025) (M3SF-25SN010304072). This work was closely coordinated with the other Sandia National Laboratory GDSA work packages: the GDSA Framework Development work package (SF-25SN01030408), the GDSA Repository Systems Analysis work package (SF-25SN01030409), and the GDSA PFLOTRAN Development work package (SF-25SN01030410). This report builds on developments reported in previous GDSA Framework milestones, particularly M3SF-24SN010304072.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2020

Integrated hydrogeophysical modelling and data assimilation for geoelectrical leak detection

Time-lapse electrical resistivity tomography (ERT) measurements provide indirect observations of hydrological processes in the Earth's shallow subsurface at high spatial and temporal resolution. ERT has been used in the past decades to detect leaks and monitor the evolution of associated contaminant plumes. Specifically, inverted resistivity images allow visualization of the dynamic changes in the structure of the plume. However, existing methods do not allow the direct estimation of leak parameters (e.g. leak rate, location, etc.) and their uncertainties. We propose an ensemble-based data assimilation framework that evaluates proposed hydrological models against observed time-lapse ERT measurements without directly inverting for the resistivities. Each proposed hydrological model is run through the parallel coupled hydro-geophysical simulation code PFLOTRAN-E4D to obtain simulated ERT measurements. The ensemble of model proposals is then updated using an iterative ensemble smoother. In this paper, we demonstrate the proposed framework on synthetic and field ERT data from controlled tracer injection experiments. Our results show that the approach allows joint identification of contaminant source location, initial release time, and solute loading from the cross-borehole time-lapse ERT data, alongside with an assessment of uncertainties in these estimates. We demonstrate a reduction in site-wide uncertainty by comparing the prior and posterior plume mass discharges at a selected image plane. This framework is particularly attractive to sites that have previously undergone extensive geological investigation (e.g., nuclear sites). It is well suited to complement ERT imaging and we discuss practical issues in its application to field problems.

58 GEOSCIENCES↗