Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Comparative framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Coupling of the Electricity and Transportation Sectors - Part II: Risk Assessment

This comprehensive report explores the intricate interplay through “sector coupling” between the Transportation Sector, Energy Sector, and the critical infrastructure challenges faced by the United States. Aligned with the ambitious federal goal of reducing greenhouse gas emissions, the report analyzes the present vulnerabilities in the fossil fuel supply chain, highlighting instances where the dependence on this industry has been susceptible to local and global disruptions. With a focus on risk assessment, this report establishes a framework to compare the fossil fuel-based transportation sector with the burgeoning electrified sector, considering the evolving technologies in electric vehicles (EVs) and the nascent charging infrastructure. This study delves into the historical reliability of fossil fuel-based transportation and identifies opportunities for strengthening sector coupling between transportation and the electric sector. Assessments of the gasoline-diesel supply chain provide insights into both opportunities and threats, offering a roadmap for creating a more reliable and resilient electrified transportation system. We modeled sectoral coupling scenarios for the current internal combustion engine (ICE)-based and future EV-dominant landscapes, leveraging qualitative sector attributes to identify relative strengths and weaknesses in Part 1 of the report. In this report (Part 2) we continue to understand the role of the electricity sector on transportation and develop a semi-quantitative methodology is employed to evaluate and compare the risks associated with the fossil fueled and electric transportation sector during emergency scenarios, drawing from real-world events like hurricanes and geopolitical disruptions. Different operational scenarios for the fossil fuel and electrified sectors have been developed to understand the risks associated with them. This report concludes with recommendations for the architectural designs of electric charging infrastructure, underlining the need for informed decisions in the transition towards a sustainable and resilient transportation future.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Market Structure Evaluation to Support the Clean Energy Transition

One can argue that wholesale electricity markets in the United States are a grand experiment with scarcely two decades of operational experience in their current form. A wide body of literature points out short comings of these markets function today, ranging from problems of missing money to negative prices for real-time electricity prices. The purpose of this report is to outline a framework by which energy policies and market structures can be evaluated to ascertain the impact these institutions have on electricity generators. The report describes an evaluated framework to compare energy policy then it discusses fundamental differences in regulated versus deregulated electricity markets. Then the report leverages these sections to describe assessment needs for quantifying aggregate impacts to generators.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Building Datasets and Training Methods for ML Based Magnet Quench Detection

Detecting quenches in superconducting (SC) magnets during training is a challenging process that involves capturing physical events that occur at different frequencies and appear as various signal features. These events may be correlated across instrumentation type, thermal cycle, and ramp. These events together build a more complete picture of continuous processes occurring in the magnet, and may allow us to flag potential precursors for quench detection. We present our work on building an automatic machine learning (ML) based quench detection system. We build upon our existing work on unsupervised auto-encoders for acoustic sensors and quench antenna (QA) by first establishing a supervised ML training pipeline. We show the results of an event tagging, analysis, and simulation framework on our QA and acoustic data which are used concurrently to build a training dataset for a supervised implementation. We then show how this supervised training can be used as a prior in a semi-supervised framework and compare this to the unsupervised neural network auto-encoder performance.This allows us to have a more concrete understanding of the performance of our algorithms relative to physical events occurring in the magnet, and also provides a baseline software tool to generically evaluate our quench prediction autoencoders under completely unsupervised, supervised, and semi-supervised training conditions.

Khan, Maira [Fermilab]↗
DOE OSTI2025

AI Model Benchmarking for Nonproliferation Applications: Steel Thread Benchmarking Task Force Technical Report (Rev. 2)

Steel Thread is a NA-22 venture that seeks to build trustworthy, reliable AI models that can be used in a wide variety of nonproliferation tasks. A key aspect of building these models is developing appropriate benchmarks and evaluation methods, which will enable the venture to identify and adapt models to provide the most value in the nonproliferation domain. Benchmarks must be relevant to key tasks in this domain, such as question answering, information retrieval, document summarization and classification, consensus analysis, and image and data analysis. This report 1) provides an overview of benchmark design, evaluation, and challenges; 2) reviews a variety of open benchmarks, with a focus on language models and tasks; and 3) identifies benchmarks that are most relevant to Steel Thread. This report is intended to serve as a basis for further efforts to classify and evaluate benchmarks and their correlation with success on nonproliferation-specific tasks. The Steel Thread venture has defined benchmarks to be a particular combination of a dataset (or datasets) and a metric (or metrics) conceptualized as representing one or more specific tasks or sets of abilities for a specific modality. It is adopted by a research community as a shared framework for comparing methods.1 It includes 1) Data: Labeled (a designated subset not used for training, which could be all the data), 2) Metric: A way to quantify performance, 3) Task/Ability: What the benchmark is testing, 4) Protocol: A structured and repeatable evaluation process, 5) Baseline/Reference Model: For comparison; could be statistical, rule-based, SME-derived, or another model, and 6) Maintenance Plan: to update with new information over time; important for long-term utility. For further clarity, the definition includes what a benchmark, in this context, is not. It is not a corpus of training data, specific to a model (it is intended to apply to a range of models), a universal evaluation of performance, a guarantee that the ‘top’ model on the leaderboard will be the best fit for every specific use case, an all-encompassing proof of a model’s universal quality, nor is it a one-size-fits-all measure of success. It does not cover every real-world constraint (like operational, ethical, or cost considerations), a systems integration test, or a unit test. This definition was inspired by and resulted from discussions within the Steel Thread Benchmarking Task Force. This group was formed to define what we would mean as a benchmark within Steel Thread but persisted as the need to develop a thorough understanding of the large and expanding existing benchmarking space. This technical report is a result of the group’s divide and conquer approach to exploring this space. The release of benchmarks might not be progressing as quickly as model development, but it is moving very fast, as many benchmarks quickly become saturated, when state-of-the-art models score so close to the benchmark’s ceiling that their results are virtually indistinguishable. At that point, the test no longer differentiates between new systems, so researchers usually stop reporting scores as the benchmark no longer informs about improvements from the next generation of models. In the OpenAI announcement of GPT-5, they reported results on six flagship public benchmarks (AIME 2025, SWE-bench Verified, Aider Polyglot, MMMU, HealthBench Hard, GPQA) but the full system-card covers roughly thirty-five separate evaluations, comprising hundreds of test task items in total. There have been some efforts to summarize benchmarks in specific fields, like for text-to-image generation, but these surveys have had a narrow methodology scope. Therefore, a comprehensive survey of all benchmarks or even all benchmarks that could be relevant to Steel Thread is outside of the scope of this report. We chose some specific benchmarks to investigate in detail.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Systems-To-Atoms (S2A): enabling hydrogen for climate security

The project addresses a critical gap in hydrogen infrastructure by integrating system-level energy models with atomic-scale material simulations in a unified Systems-to-Atoms (S2A) framework. The motivation stems from the need to develop efficient, cost-effective, and durable hydrogen transport and utilization technologies to support decarbonization of hard-to-electrify sectors such as heavy-duty transportation. Current system models lack awareness of material performance mechanisms, while material-scale models do not account for system-level usage and variability. To bridge this divide, the team developed a co-simulation capability linking techno-economic analyses, reactor/process-flow modeling, and molecular-scale catalysis simulations. Applied to hydrogen delivery in California, the framework enabled comparative evaluations of compressed, cryogenic, and liquid organic hydrogen carrier (LOHC) pathways, highlighting how catalyst operation and unit process efficiency influence overall performance. The results demonstrate that no single material or transport mode is universally optimal; instead, heterogeneous solutions tuned to specific operational contexts deliver better performance. The project delivers a new capability for cross-scale material co-design, advancing hydrogen infrastructure readiness and informing DOE and LLNL missions in climate and energy resilience.

organic↗
DOE OSTI2023

Deep learning methods for drug response prediction in cancer: Predominant and emerging trends

Cancer claims millions of lives yearly worldwide. While many therapies have been made available in recent years, by in large cancer remains unsolved. Exploiting computational predictive models to study and treat cancer holds great promise in improving drug development and personalized design of treatment plans, ultimately suppressing tumors, alleviating suffering, and prolonging lives of patients. A wave of recent papers demonstrates promising results in predicting cancer response to drug treatments while utilizing deep learning methods. These papers investigate diverse data representations, neural network architectures, learning methodologies, and evaluations schemes. However, deciphering promising predominant and emerging trends is difficult due to the variety of explored methods and lack of standardized framework for comparing drug response prediction models. To obtain a comprehensive landscape of deep learning methods, we conducted an extensive search and analysis of deep learning models that predict the response to single drug treatments. A total of 61 deep learning-based models have been curated, and summary plots were generated. Based on the analysis, observable patterns and prevalence of methods have been revealed. This review allows to better understand the current state of the field and identify major challenges and promising solution paths.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Muon capture on deuteron using local chiral potentials

The muon capture reaction μ – + d → n + n + ν μ in the doublet hyperfine state is studied using nuclear potentials and consistent currents derived in the chiral effective field theory, which are local and expressed in coordinate space (the so-called Norfolk models). Only the largest contribution due to the 1 S 0 nn scattering state is considered. Particular attention is given to the estimate of theoretical uncertainty, for which four sources have been identified: 1) the model dependence, 2) the chiral-order convergence for the weak nuclear current, 3) the uncertainty in the single-nucleon axial form factor, and 4) the numerical technique adopted to solve the bound and scattering A = 2 systems. This last source of uncertainty has turned out to be essentially negligible. For the 1 S 0 doublet muon capture rate Γ D ( 1 S 0 ), we obtain Γ D ( 1 S 0 ) = 255.8(0.6) (4.4)(2.9) s –1 , where the three errors come from the first three sources of uncertainty. The value for Γ D ( 1 S 0 ) obtained within this local chiral framework is compared with previous calculations and found in very good agreement.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

A VECTOR ANALYTICAL FRAMEWORK FOR POPULATION MODELING

We propose a vector alternative to the typical raster based population modeling framework. When compared with rasters, vectors are more precise, have the ability to hold more information, and are more conducive to areal constructs such as building and parcel outlines. While rasters have traditionally provided computational efficiency, much of this efficiency is reduced at finer resolutions and computational resources are more plentiful today. Herein we describe the approach and implementation methodology. We also describe the output data stack for the United States and provide examples and applications.

Moehl, Jessica↗
DOE OSTI2023

BOTTLE 2 - Analysis

The use of analysis is foundational to BOTTLE. In particular, we conduct techno-economic analysis (TEA), life cycle assessment (LCA), and supply chain modeling for each new BOTTLE innovation, spanning new deconstruction and upcycling technologies to redesigned polymers. These critical analysis tools are used in parallel with laboratory research to ensure that BOTTLE technologies can ultimately meet our key metrics. The BOTTLE team used analysis early in the current 3-year project cycle to identify research priorities from a scale, energy, and economics perspective (Nicholson et al., Joule 2021), and recently we presented a comprehensive framework for comparing new circularity-focused approaches to linear, incumbent practices (Nicholson et al., Ann. Rev. Chem. Biomolec. Eng. 2022). This presentation will also review case studies in analysis for closed-loop PET recycling across a range of recycling methods, baseline studies that we have conducted for plastics pyrolysis and gasification as another comparator for BOTTLE technologies, and a comprehensive study of existing closed-loop recycling technologies from a full suite of environmental impacts and feedstock quality metrics. We have undertaken studies of circular polymers being developed in the Redesign task, and we will present an exemplary case for a bio-based acrylic polymer that can replace polymethyl methacrylate. Overall, analysis is critical to enable the BOTTLE Consortium to focus on impactful, realistic technologies.

BIOMASS FUELS↗
DOE OSTI2026

Resilience Metrics Framework for Solar Photovoltaics

This presentation was given at the Photovoltaic Specialist Conference (PVSC) 54 in New Orleans, Louisiana. Photovoltaic (PV) systems are routinely exposed to extreme weather, including wind and hail storms. Historically, most systems have proven to be resilient to such events, but some storms have damaged PV systems, leading to physical and financial loss. Storm hardening measures and specific system attributes can reduce this risk. This work introduces a set of resilience metrics and a framework for quantifying, comparing, and predicting PV system resilience. The framework is divided into two parts: 1) predictive, attribute metrics based on site and component characteristics, and 2) impact metrics that assess post-storm performance. Metrics are weighted and aggregated, producing hazard-specific resilience scores. We derive damage functions from storm-impacted PV systems, establishing a baseline against which post-storm performance can be compared. This damage was widely variable across hail and wind intensities, and field hail damage was less than predicted by laboratory tests, suggesting that system features - in addition to storm conditions - influence damage likelihood. Finally, the metrics framework is demonstrated using three case studies of storm damaged PV systems. Although additional data are needed to create attribute specific damage functions and establish metric weights, this study presents a methodology for evaluating PV resilience and contributes new damage functions to the literature.

14 SOLAR ENERGY↗
DOE OSTI2024

Synergies Between Nuclear Security and Critical Infrastructure: National Legal and Regulatory Frameworks

Nuclear reactors and other nuclear facilities are part of a nation's critical infrastructure assets. Key cross-sector interdependencies, in relation to energy, transportation systems, communications, emergency services, water, information technologies and others, result in inevitable synergies between legal frameworks for the security of nuclear facilities and legal frameworks for the protection of critical infrastructure. The protection of nuclear facilities against sabotage and other malicious acts is paramount in ensuring energy security and thus ensuring uninterrupted energy supply. The protection of other sectors, such as uninterrupted communications, secure water supply, and others, supports a safe and secure operation of nuclear facilities. Some countries rely on broader critical infrastructure frameworks to impose security requirements on nuclear facilities, or to achieve robust cybersecurity systems. This paper will analyze the interdependencies and synergies between the legal and regulatory frameworks for critical infrastructure protection and nuclear facilities' security by comparing various national frameworks. The paper will also propose modalities to leverage the best practices and requirements from each framework towards energy security goals and stronger national nuclear security regimes.

Man, Madalina-Anca↗
DOE OSTI2022

Time Sequence Machine Learning-Based Data Intrusion Detection for Smart Voltage Source Converter-Enabled Power Grid

Smart inverters of distributed energy resources can enable cloud computing, condition monitoring, result visualization, remote control, and peer-to-peer energy trading in advanced power systems. However, the advent of data injection attacks in the communication architecture can alter measurement characteristics of power grids and have devastating consequences. In this article, we propose a time sequence machine learning-based anomaly detection methodology for detecting cyber intrusion into control signal setpoints and dc voltage signal measurement bias of the voltage source converter (VSC) in wind generators. We first investigated the effects of four types of denial of service, tampering signal, and stealthy-type data intrusion attacks on smart VSCs and overall wind farms. We then proposed a novel time sequence machine learning-based intrusion detection framework that can be implemented to detect different cyberattacks in the VSCs. The performance of the proposed framework has been compared with that of autoencoder and clustering-based intrusion detection framework. The proposed framework was validated by using the IEEE 39 bus power system in the presence of four wind farms in different locations. Using several metrics for intrusion detection performance, we validated the effectiveness of the proposed framework.

42 ENGINEERING↗
DOE OSTI2023

A semi-Lagrangian method for detecting and tracking deep convective clouds in geostationary satellite observations

Automated methods for the detection and tracking of deep convective clouds in geostationary satellite imagery have a vital role in both the forecasting of severe storms and research into their behaviour. Studying the interactions and feedbacks between multiple deep convective clouds (DCC), however, poses a challenge for existing algorithms due to the necessary compromise between false detection and missed detection errors. We utilise an optical flow method to determine the motion of deep convective clouds in GOES-16 ABI imagery in order to construct a semi-Lagrangian framework for the motion of the cloud field, independently of the detection and tracking of cloud objects. The semi-Lagrangian framework allows severe storms to be simultaneously detected and tracked in both spatial and temporal dimensions. For the purpose of this framework we have developed a novel Lagrangian convolution method and a number of novel implementations of morphological image operations that account for the motion of observed objects. These novel methods allow the accurate extension of computer vision techniques to the temporal domain for moving objects such as DCCs. By combining this framework with existing methods for detecting DCCs (including detection of growing cores through cloud top cooling and detection of anvil clouds using brightness temperature), we show that the novel framework enables reductions in errors due to both false and missed detections compared to any of the individual methods, reducing the need to compromise when compared with existing frameworks. The novel framework enables the continuous tracking of anvil clouds associated with detected deep convection after convective activity has stopped, enabling the study of the entire life cycle of DCCs and their associated anvils. Furthermore, we expect this framework to be applicable to a wide range of cases including the detection and tracking of low-level clouds and other atmospheric phenomena. In addition, this framework may be used to combine observations from multiple sources, including satellite observations, weather radar and reanalysis model data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

EC-Bench: A Benchmark for Enzyme Commission Number Prediction

Enzymes are proteins that catalyze specific biochemical reactions in cells. Enzyme Commission (EC) numbers are used to annotate enzymes in a four-level hierarchy that classifies enzymes based on the specific chemical reactions they catalyze. Accurate EC number prediction is essential for understanding enzyme functions. Despite the availability of numerous methods for predicting EC numbers from protein sequences, there is no unified framework for evaluating and studying such methods systematically. This gap limits the ability of the community to identify the most effective approaches for enzyme annotation. We introduce EC-Bench, a benchmark for EC number prediction, consisting of 1) an initial representative set of existing methods (including homology-based, deep learning, contrastive learning, and language model methods), 2) existing and novel accuracy and efficiency performance metrics, and 3) selected datasets to allow for comprehensive comparative study. EC-Bench is open-source and provides a framework for researchers to not only compare among existing methods objectively under uniform conditions, but also to introduce and effectively evaluate performance of new methods in a comparative framework. To demonstrate the utility of EC-Bench, we perform extensive experimentation to compare the existing EC number prediction methods and establish their advantages and disadvantages in a variety of prediction tasks, namely “exact EC number prediction”, “EC number completion” and (partial or additional) “EC number recommendation”. We find wide variation in the performance of different methods, but also subtle but potentially useful differences in the performance of different methods across tasks and for different parts of the EC hierarchy.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning

Abstract We propose a unified data-driven reduced order model (ROM) that bridges the performance gap between linear and nonlinear manifold approaches. Deep learning ROM (DL-ROM) using deep-convolutional autoencoders (DC–AE) has been shown to capture nonlinear solution manifolds but fails to perform adequately when linear subspace approaches such as proper orthogonal decomposition (POD) would be optimal. Besides, most DL-ROM models rely on convolutional layers, which might limit its application to only a structured mesh. The proposed framework in this study relies on the combination of an autoencoder (AE) and Barlow Twins (BT) self-supervised learning, where BT maximizes the information content of the embedding with the latent space through a joint embedding architecture. Through a series of benchmark problems of natural convection in porous media, BT–AE performs better than the previous DL-ROM framework by providing comparable results to POD-based approaches for problems where the solution lies within a linear subspace as well as DL-ROM autoencoder-based techniques where the solution lies on a nonlinear manifold; consequently, bridges the gap between linear and nonlinear reduced manifolds. We illustrate that a proficient construction of the latent space is key to achieving these results, enabling us to map these latent spaces using regression models. The proposed framework achieves a relative error of 2% on average and 12% in the worst-case scenario (i.e., the training data is small, but the parameter space is large.). We also show that our framework provides a speed-up of $$7 \times 10^{6}$$ 7 × 10 6 times, in the best case, and $$7 \times 10^{3}$$ 7 × 10 3 times on average compared to a finite element solver. Furthermore, this BT–AE framework can operate on unstructured meshes, which provides flexibility in its application to standard numerical solvers, on-site measurements, experimental data, or a combination of these sources.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

TAMM: Tensor algebra for many-body methods

Tensor algebra operations such as contractions in computational chemistry consume a significant fraction of the computing time on large-scale computing platforms. The widespread use of tensor contractions between large multi-dimensional tensors in describing electronic structure theory has motivated the development of multiple tensor algebra frameworks targeting heterogeneous computing platforms. In this paper, we present Tensor Algebra for Many-body Methods (TAMM), a framework for productive and performance-portable development of scalable computational chemistry methods. TAMM decouples the specification of the computation from the execution of these operations on available high-performance computing systems. With this design choice, the scientific application developers (domain scientists) can focus on the algorithmic requirements using the tensor algebra interface provided by TAMM, whereas high-performance computing developers can direct their attention to various optimizations on the underlying constructs, such as efficient data distribution, optimized scheduling algorithms, and efficient use of intra-node resources (e.g., graphics processing units). The modular structure of TAMM allows it to support different hardware architectures and incorporate new algorithmic advances. We describe the TAMM framework and our approach to the sustainable development of scalable ground- and excited-state electronic structure methods. We present case studies highlighting the ease of use, including the performance and productivity gains compared to other frameworks.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Call for Participation: Collaborative Benchmarking of Functional-Structural Root Architecture Models. The Case of Root Water Uptake

Three-dimensional models of root growth, architecture and function are becoming important tools that aid the design of agricultural management schemes and the selection of beneficial root traits. However, while benchmarking is common in many disciplines that use numerical models, such as natural and engineering sciences, functional-structural root architecture models have never been systematically compared. The following reasons might induce disagreement between the simulation results of different models: different representation of root growth, sink term of root water and solute uptake and representation of the rhizosphere. Presently, the extent of discrepancies is unknown, and a framework for quantitatively comparing functional-structural root architecture models is required. We propose, in a first step, to define benchmarking scenarios that test individual components of complex models: root architecture, water flow in soil and water flow in roots. While the latter two will focus mainly on comparing numerical aspects, the root architectural models have to be compared at a conceptual level as they generally differ in process representation. Therefore, defining common inputs that allow recreating reference root systems in all models will be a key challenge. In a second step, benchmarking scenarios for the coupled problems are defined. We expect that the results of step 1 will enable us to better interpret differences found in step 2. This benchmarking will result in a better understanding of the different models and contribute toward improving them. Improved models will allow us to simulate various scenarios with greater confidence and avoid bugs, numerical errors or conceptual misunderstandings. This work will set a standard for future model development.

Plant Sciences↗