Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

A Pulsar-Inspired Timing Framework for Power System: Optimization and Performance Evaluation

Due to their excellent stability, neutron pulsar stars are considered promising candidate timing sources for power system applications. However, the complexity of pulsar signals necessitates advanced processing algorithms to provide accurate timing references. This paper presents the foundational framework for pulsar signal processing, serving as the basis for further optimization. To enhance the timing accuracy and computation efficiency in pulsar period searches, three algorithms are proposed as the initial optimization step: wavelet de-noising, fast folding, and cross-correlation for profile evaluation. Wavelet de-noising improves signal-to-noise ratio (SNR) by 36%–70%. Fast folding reduces computation time from hundreds of seconds to mere milliseconds. Cross-correlation works better than traditional SNR-based methods by effectively identifying the optimal period. The performance of the proposed algorithms is evaluated using observation data from telescopes. Together, these algorithms significantly improve pulsar timing performance, reducing the error of the Pulse Per Second (PPS) signal from hundreds to tens of microseconds.

Wu, Ori [ORNL] (ORCID:0000000326723410)↗
DOE OSTI2022

Deterministic modeling of hybrid nonlinear effects in epsilon-near-zero thin films

In nonlinear optics, significant effort is concentrated on improving the strength and efficiency of interactions; however, experimentally investigating nonlinear materials is a complex, time-consuming, and costly investment. Moreover, it is often challenging to isolate, study, and optimize material parameters in an experiment due to complexities in the growth process. Recently, epsilon-near-zero materials have received a great deal of attention as promising nonlinear optical materials, but like many up-and-coming materials, the ability to explore and optimize their properties has been challenging. Here, we establish a framework to rapidly evaluate the performance of nonlinear epsilon-near-zero materials for both inter- and intraband effects in silico, requiring only an energy-momentum (E-k) diagram, linear optical properties, and experimental conditions. Measured nonlinear reflection and transmission in gallium-doped zinc oxide films are compared to the numerical framework for both intra- and interband excitation to verify accuracy across wavelength and irradiance while two figures of merit (FoMs) are introduced to quickly evaluate the performance of films without a full numerical framework. This capability is used to predict the performance of highly doped gallium nitride, cadmium oxide, zinc oxide, and indium tin oxide films, and efficient intra- and interband operation conditions are identified. Through this numerical framework and the FoMs, the exploration of unstudied epsilon-near-zero materials is enabled without the need for a nonlinear experiment, thereby accelerating the search for more efficient nonlinear materials and excitation conditions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Characterizing and communicating uncertainty: lessons from NASA’s Carbon Monitoring System

Navigating uncertainty is a critical challenge in all fields of science, especially when translating knowledge into real-world policies or management decisions. However, the wide variance in concepts and definitions of uncertainty across scientific fields hinders effective communication. As a microcosm of diverse fields within Earth Science, NASA’s Carbon Monitoring System (CMS) provides a useful crucible in which to identify cross-cutting concepts of uncertainty. The CMS convened the Uncertainty Working Group (UWG), a group of specialists across disciplines, to evaluate and synthesize efforts to characterize uncertainty in CMS projects. This paper represents efforts by the UWG to build a heuristic framework designed to evaluate data products and communicate uncertainty to both scientific and non-scientific end users. We consider four pillars of uncertainty: origins, severity, stochasticity versus incomplete knowledge, and spatial and temporal autocorrelation. Using a common vocabulary and a generalized workflow, the framework introduces a graphical heuristic accompanied by a narrative, exemplified through contrasting case studies. Envisioned as a versatile tool, this framework provides clarity in reporting uncertainty, guiding users and tempering expectations. Beyond CMS, it stands as a simple yet powerful means to communicate uncertainty across diverse scientific communities.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

ARETE: Accurate Error Assessment via Machine Learning-Guided Dynamic-Timing Analysis

Nanometer circuits are increasingly prone to timing errors, escalating the need for fault injection frameworks to accurately evaluate their impact on applications. Here in this paper, we propose ARETE, a novel cross-layer, fault-injection framework that combines dynamic-binary instrumentation with machine learning-guided dynamic-timing analysis. ARETE enables accurate fault-injection into any application by estimating the location of the injecting errors via dynamic-timing analysis. To accelerate fault-injection, we develop a novel, data-aware, machine learning-based mechanism that dynamically pre-selects the error-prone instructions and limits the application of the costly dynamic-timing analysis only to them. To evaluate ARETE's accuracy, our fully automated toolflow is configured to support fault-injection based on detailed post-layout gate-level simulations as well as via existing workload-agnostic error models. Our results for various workloads, including an autonomous-driving library, show that the location and time of injected errors performed by ARETE, is 89.9% consistent with fault-injection based on full gate-level simulation. On average, ARETE executes 84.6x faster than gate-level simulation and at a cost of 3.4% loss in the program output quality estimation. When compared to the existing statistical fault-injection tools that are based on workload-agnostic error models, ARETE improves the accuracy of fault-injection rate and output quality estimation by 143.9% and 40.4% on average, respectively.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Applying energy justice metrics to photovoltaic materials research

Abstract Achieving the energy transition sustainably requires addressing how new technologies may impact justice in the energy system. The Justice Underpinning Science and Technology Research (JUST-R) metrics framework was recently proposed to aid researchers in considering justice in early-stage research on energy technologies; however, case study evaluations of the framework revealed a desire from researchers to see metrics specialized to particular fields of study. Here, we refine metrics from the JUST-R framework to enhance its applicability to photovoltaic (PV) materials research. Metrics are reorganized to align with aspects of the research process (e.g., research team or source materials). For most metrics, baseline values are suggested to enable researchers to compare their project to competing technologies or standards at their institutions. These refinements are integrated into a tool to facilitate easier understanding and evaluation of justice considerations in early-stage PV research, which can serve as a template for evaluating other energy technologies. Graphical abstract

14 SOLAR ENERGY↗
DOE OSTI2025

Multi-stage heat pump with two-phase injection for cold climate applications implementing natural refrigerants

Heat pump adoption in cold climates is limited by various technical challenges, including heat capacity degradation, compressor deterioration, and frost accumulation on the outdoor heat exchanger. Furthermore, wide-spread adoption of heat pumps with high global warming potential presents a possible environmental concern. Thus, we present a heat pump concept termed the “saturation cycle,” which uses numerous compression stages to improve energy efficiency and injects two-phase refrigerant between compression stages to dramatically reduce compressor discharge temperatures. Given the growing interest in heat pumps, there is a need for a straightforward framework for parametric evaluation of natural refrigerants in high-efficiency heat pump cycle architectures, like the saturation cycle, in adverse climates. This work develops a thermodynamic modeling framework and focuses on the application of natural refrigerants to explore the performance trends at extremely cold climates down to −25 °C. This study shows that a two-stage saturation cycle and four-stage saturation cycle can reduce the compressor discharge superheating by up to 51–57 % or 73–80 %, respectively, depending on the refrigerant. Furthermore, at −25 °C, a two-stage R-290 saturation cycle heat pump theoretically can use 25 % less power than a single-stage heat pump or can provide up to 59 % more heating capacity when using the same compressor power as the baseline single-stage heat pump. The exergetic parametric analyses show that two-phase refrigerant injection fundamentally improves the thermodynamic performance of the heat pump, reducing overall exergy destruction by 10 % compared to a vapor-injection heat pump, compared at −25 °C. Thus, the saturation cycle is a promising heat pump cycle architecture for cold climate applications due to its superior energy savings (or capacity improvement) and substantial de-superheating capabilities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Structure of iridium oxide catalysts dictates performance differences for proton exchange membrane water electrolyzers

Proton exchange membrane water electrolyzers (PEMWEs) are promising zero-emission technologies. However, their high cost remains a barrier to widespread adoption. Iridium oxide is commonly used as an oxygen evolution reaction (OER) catalyst, and its cost and scarcity make it essential to reduce its loading while increasing its activity. Evaluation of iridium oxide activity should be carried out in the membrane electrode assembly (MEA) configuration to replicate realistic operating conditions. Herein, we present a comprehensive benchmarking framework to accurately evaluate the amorphous and crystalline iridium oxides at the MEA level. By systematically varying the catalyst loading, this study confirmed that each MEA was utilized uniformly, presenting intrinsic electrochemical properties independent of the loading. Through intrinsic charge density determined by voltammetry, we established two electrochemical descriptors to evaluate catalyst redox reactions. The mass activity was evaluated by correlating current vs. loading, and the slope provides loading-independent mass activity. The effect of the porous transport layer on OER activity was discussed, identifying a ‘background’ current at zero-loading. In conclusion, this study highlights potential pitfalls in MEA-level catalyst screening and underscores the importance of the loading study for reliable results.

Kwon, Obeen [University of California, Irvine, CA ↗
DOE OSTI2022

Market Structure Evaluation to Support the Clean Energy Transition

One can argue that wholesale electricity markets in the United States are a grand experiment with scarcely two decades of operational experience in their current form. A wide body of literature points out short comings of these markets function today, ranging from problems of missing money to negative prices for real-time electricity prices. The purpose of this report is to outline a framework by which energy policies and market structures can be evaluated to ascertain the impact these institutions have on electricity generators. The report describes an evaluated framework to compare energy policy then it discusses fundamental differences in regulated versus deregulated electricity markets. Then the report leverages these sections to describe assessment needs for quantifying aggregate impacts to generators.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

LSAFE: a Lightweight Static Analysis Framework for binary Executables

Static analysis is a widely used technique for analyzing various aspects of programs. However, as programs become more complex, static analysis tools require larger resources, such as CPU time and memory, to perform the same tasks. Moreover, the source code of programs may not always be accessible, requiring static analysis to be performed on the binary executable code directly. To overcome these challenges, we propose a lightweight static analysis framework called LSAFE, which constructs control flow graphs (CFGs) and data dependency graphs (DDGs) of target programs with optimized performance in terms of CPU and memory usage. We evaluated the proposed framework using both Spec benchmark programs and real-world industrial applications, and found that it outperformed Angr, an existing state-of-the-art static analysis tool. Additionally, we demonstrate a case study that utilizes the CFG generated by LSAFE to detect memory leaks.

Qu, Guangzhi↗
DOE OSTI2023

Data-Driven Co-optimization of Energy Efficiency and Indoor Environmental Quality in Commercial Buildings

In this paper, we use publicly available data of a highly instrumented building to estimate how zonal temperature and carbon dioxide (CO2) concentration are related to some key operational and environmental measurements. Subsequently, we have developed, simulated, and evaluated an optimization framework for minimizing the energy consumption of the central heating, ventilation and air conditioning (HVAC) unit while meeting zonal temperature and indoor air quality (IAQ) standards. Finally, we have evaluated the achievable energy savings for our proposed approach as compared to a baseline approach and reported significant savings potential.

Naqvi, Syed Ahsan Raza↗
DOE OSTI2024

"Designing, simulating, and performing the 100-AV field test for the CIRCLES consortium: Methodology and Implementation of the Largest mobile traffic control experiment to date"

Previous controlled experiments on single-lane ring roads have shown that a single partially autonomous vehicle (AV) can effectively mitigate traffic waves. This naturally prompts the question of how these findings can be generalized to field operational, high-density traffic conditions. To address this question, the Congestion Impacts Reduction via CAV-in-the-loop Lagrangian Energy Smoothing (CIRCLES) Consortium conducted MegaVanderTest (MVT), a live traffic control experiment involving 100 vehicles near Nashville, TN, USA. This article is a tutorial for developing analytical and simulation-based tools essential for designing and executing a live traffic control experiment like the MVT. It presents an overview of the proposed roadmap and various procedures used in designing, monitoring, and conducting the MVT, which is the largest mobile traffic control experiment at the time. The design process is aimed at evaluating the impact of the CIRCLES AVs on surrounding traffic. The article discusses the agent-based traffic simulation framework created for this evaluation. A novel methodological framework is introduced to calibrate this microsimulation, aiming to accurately capture traffic dynamics and assess the impact of adding 100 vehicles to existing traffic. The calibration model's effectiveness is verified using data from a six-mile section of Nashville's I-24 highway. The results indicate that the proposed model establishes an effective feedback loop between the optimizer and the simulator, thereby calibrating flow and speed with different spatiotemporal characteristics to minimize the error between simulated and real-world data. Finally, We simulate AVs in multiple scenarios to assess their effect on traffic congestion. This evaluation validates the AV routes, thereby contributing to the execution of a safe and successful live traffic control experiment via AVs.

Ameli, Mostafa↗
DOE OSTI2022

Results of Re-evaluation of FEPs Related to Implementing the ABD Glass Program

The Savannah River Site plans to reprocess defense spent nuclear fuel currently stored in their L-Basin via the Accelerated Basin Deinventory (ABD) Program. The previous plan for the L-Basin spent nuclear fuel was to dispose of it directly in the federal repository without reprocessing. Implementing the ABD Program will result in final disposal of approximately 900 fewer canisters of defense spent nuclear fuel and the production of approximately 521 more canisters of vitrified high-level waste glass with some specific differences from the planned high-level waste glass. Because the 235U in the L-Basin spent nuclear fuel is not intended to be recovered, the fissile mass loading of the vitrified high-level glass waste form to be produced must be increased above the current value of 897 g/m 3 to a maximum of 2,500 g/m 3 . Therefore, implementing the ABD Program would produce a variant of high-level waste glass—the ABD glass—that needs to be evaluated for future repository licensing, which includes both preclosure safety and postclosure performance. This report describes the approach to and summarizes the results of an evaluation of the potential effects of implementing the ABD Program at the Savannah River Site on the technical basis for future repository licensing for a generic repository that is similar to Yucca Mountain and for one that is fully generic. This evaluation includes the effects on preclosure safety analyses and postclosure performance assessment for both repository settings. The license application for the proposed Yucca Mountain repository (DOE 2008), which is serving as a framework for this evaluation, concluded that the proposed Yucca Mountain repository would meet all applicable regulatory requirements. The evaluation documented in this report found that implementing the ABD Program is not expected to change that conclusion for a generic repository similar to Yucca Mountain or for a generic repository with respect to the preclosure safety analyses. With respect to the postclosure performance of a generic repository, no concerns were identified.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Developing a small participant framework: An investigation of mode choice influential factors

An in-depth comprehension of the changing impact of mode choice influencing factors is essential in planning for behavior-adaptive mode shift policies. This study developed a framework to investigate a method of evaluation of the changes in mode choice using a small participation pool. A field application in Pima County, Arizona was developed to test the developed framework to evaluate the impact of a real transit experience. Twenty-two participants were recruited and repeated measurements were taken before and after their transit trip. The results revealed that people are less susceptible to their mental biases after a transit trip and consider more objective elements such as walking time. The developed framework resulted in successful evaluation methods that are reproducible for other application study designs. Thus, the results further present that low participant recruitment in application-based field studies can be accomplished using this developed methodology, for other regions and studies.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

A multi-scale pipeline linking drug transcriptomics with pharmacokinetics predicts in vivo interactions of tuberculosis drugs

Tuberculosis (TB) is the deadliest infectious disease worldwide. The design of new treatments for TB is hindered by the large number of candidate drugs, drug combinations, dosing choices, and complex pharmaco-kinetics/dynamics (PK/PD). Here we study the interplay of these factors in designing combination therapies by linking a machine-learning model, INDIGO-MTB, which predicts in vitro drug interactions using drug transcriptomics, with a multi-scale model of drug PK/PD and pathogen-immune interactions called GranSim. We calculate an in vivo drug interaction score (iDIS) from dynamics of drug diffusion, spatial distribution, and activity within lesions against various pathogen sub-populations. The iDIS of drug regimens evaluated against non-replicating bacteria significantly correlates with efficacy metrics from clinical trials. Our approach identifies mechanisms that can amplify synergistic or mitigate antagonistic drug interactions in vivo by modulating the relative distribution of drugs. Our mechanistic framework enables efficient evaluation of in vivo drug interactions and optimization of combination therapies.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Toward a Fully Integrated Multiphysics Simulation Framework for Fusion Blanket Design

Fusion is an attractive clean-energy solution, thanks to its various advantages, such as reduced radioactivity, little high-level nuclear waste, ample fuel supplies, and increased safety. However, the harsh operating environment introduced by a complex fusion plasma system makes design and integration of fusion blankets incredibly challenging and time-consuming. This work focuses on developing a fully integrated multiphysics simulation framework based on an advanced open-source platform—the Multiphysics Object-Oriented Simulation Environment (MOOSE)—to alleviate the difficulties in fusion blanket design and integration. MOOSE is a massively parallel finite element/volume multiphysics simulation platform that has been widely adopted within the nuclear fission community. Even though fission and fusion are fundamentally different, they involve similar multiphysics phenomena. A fully integrated open-source multiphysics simulation framework tailored for the fusion blanket design will be implemented by leveraging the well-established multiphysics capabilities in MOOSE. Once successfully developed, this fully integrated framework will rapidly evaluate a blanket design concept and offer insights for subsequent iterations. As the first step, we will mainly aim to integrate neutronics analysis, system thermal hydraulics simulation, and full 3-D heat transfer calculations. The efficacy of the integrated framework will be verified using an innovative solid ceramic blanket design. While the project’s final goal is to enable a fully integrated multiphysics simulation platform for various fusion blanket concepts, here this work, as a preliminary step, will mainly focus on a solid ceramic breeder helium-cooled blanket.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Structure-aware graph neural network based deep transfer learning framework for enhanced predictive analytics on diverse materials datasets

Abstract Modern data mining methods have demonstrated effectiveness in comprehending and predicting materials properties. An essential component in the process of materials discovery is to know which material(s) will possess desirable properties. For many materials properties, performing experiments and density functional theory computations are costly and time-consuming. Hence, it is challenging to build accurate predictive models for such properties using conventional data mining methods due to the small amount of available data. Here we present a framework for materials property prediction tasks using structure information that leverages graph neural network-based architecture along with deep-transfer-learning techniques to drastically improve the model’s predictive ability on diverse materials (3D/2D, inorganic/organic, computational/experimental) data. We evaluated the proposed framework in cross-property and cross-materials class scenarios using 115 datasets to find that transfer learning models outperform the models trained from scratch in 104 cases, i.e., ≈90%, with additional benefits in performance for extrapolation problems. We believe the proposed framework can be widely useful in accelerating materials discovery in materials science.

Chemistry↗
DOE OSTI2024

A Principled Framework to Assess the Information-Theoretic Fitness of Brain Functional Sub-Circuits

In systems and network neuroscience, many common practices in brain connectomic analysis are often not properly scrutinized. One such practice is mapping a predetermined set of sub-circuits, like functional networks (FNs), onto subjects’ functional connectomes (FCs) without adequately assessing the information-theoretic appropriateness of the partition. Another practice that goes unchallenged is thresholding weighted FCs to remove spurious connections without justifying the chosen threshold. This paper leverages recent theoretical advances in Stochastic Block Models (SBMs) to formally define and quantify the information-theoretic fitness (e.g., prominence) of a predetermined set of FNs when mapped to individual FCs under different fMRI task conditions. Our framework allows for evaluating any combination of FC granularity, FN partition, and thresholding strategy, thereby optimizing these choices to preserve the important topological features of the human brain connectomes. By applying to the Human Connectome Project with Schaefer parcellations at multiple levels of granularity, the framework showed that the common thresholding value of 0.25 was indeed information-theoretically valid for group-average FCs, despite its previous lack of justification. Our results pave the way for the proper use of FNs and thresholding methods, and provide insights for future research in individualized parcellations.

Duong-Tran, Duy (ORCID:0009000944967575)↗
DOE OSTI2022

An Open-Source Framework for PV in the Circular Economy Evaluation

This open-source tool follows the dynamic Material and flows for each component and material in a PV system, from mining to end of life to evaluate the material and energy impacts of different paths. Following circularity principles, virgin material inputs can be offset by recovered materials to reduce impacts due to mining and extraction. Unlike consumer products, renewable energy technologies generate power over their useful life to quickly offset energy required for manufacturing. The model provides unique baselines of PV evolution, and allows us to evaluate the material and soon energy return on investment of decisions such as field repair, off-site refurbishment, reuse, or recycling. Energy layer and cost, as well as visual dashboard under development.

circular economy modeling↗