Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78
All sourcesNASA NTRSDOE OSTI
DOE OSTI2012

International Review of Frameworks for Standard Setting & Labeling Development

As appliance energy efficiency standards and labeling (S&L) programs reach a broader geographic and product scope, a series of sophisticated and complex technical and economic analyses have been adopted by different countries in the world to support and enhance these growing S&L programs. The initial supporting techno-economic and impact analyses for S&L development make up a defined framework and process for setting and developing appropriate appliance efficiency standards and labeling programs. This report reviews in-depth the existing framework for standards setting and label development in the well-established programs of the U.S., Australia and the EU to identify and evaluate major trends in how and why key analyses are undertaken and to understand major similarities and differences between each of the frameworks.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2019

Wootz: a compiler-based framework for fast CNN pruning via composability

Convolutional Neural Networks (CNN) are widely used for Deep Learning tasks. CNN pruning is an important method to adapt a large CNN model trained on general datasets to fit a more specialized task or a smaller device. The key challenge is on deciding which filters to remove in order to maximize the quality of the pruned networks while satisfying the constraints. It is time-consuming due to the enormous configuration space and the slowness of CNN training.The problem has drawn many efforts from the machine learning field, which try to reduce the set of network configurations to explore. This work tackles the problem distinctively from a programming systems perspective, trying to speed up the evaluations of the remaining configurations through computation reuse via a compiler-based framework. We empirically uncover the existence of composability in the training of a collection of pruned CNN models, and point out the opportunities for computation reuse. We then propose composability-based CNN pruning, and design a compression-based algorithm to efficiently identify the set of CNN layers to pre-train for maximizing their reuse benefits in CNN pruning. We further develop a compiler-based framework named Wootz, which, for an arbitrary CNN, automatically generates code that builds a Teacher-Student scheme to materialize composability-based pruning. Experiments show that network pruning enabled by Wootz shortens the state-of-art pruning process by up to 186X while producing significantly better pruning results.

Guan, Hui↗
DOE OSTI2025

Energy storage planning for enhanced resilience of power systems against wildfires and heatwaves

Extreme weather events pose significant risks to power grid stability due to their severe consequences and potential for widespread failures. Energy storage systems hold great potential for enhancing grid resilience against such events by providing reliable power during peak demand periods. However, accurately quantifying the size, location, and investment costs of new energy storage assets is a complex task, as energy storage planning decisions depend on the investment choices of other generation technologies and the integration of new transmission projects. Here, this paper presents a novel capacity expansion planning framework that simultaneously optimizes investments in energy storage, generation, and transmission, determining their optimal size, location, and type, while incorporating extreme weather events into long-term planning. More specifically, our stress-event-informed planning framework integrates the impact of heatwaves and wildfires into the planning process, identifying least-cost investment solutions that comply with policy goals and enhance grid resilience. The proposed framework employs machine-learning-based modeling to project heatwave-induced loads and performance-based risk assessment to evaluate wildfire-driven transmission line derates. Using industry-standard datasets to accurately represent the transmission topology of the Western Interconnection (WI) system, the proposed framework is applied to the WI 40-zone system, with investment decisions reported for the years 2030, 2035, and 2040. Simulation results reveal that with just a 10% increase in investment costs, resilience against extreme events can be significantly improved, with investment decisions heavily favoring energy storage, particularly 4-hour energy storage systems.

25 ENERGY STORAGE↗
DOE OSTI2020

A Conceptual Framework to Describe Energy Efficiency and Demand Response Interactions

Energy efficiency (EE) and demand response (DR) resources provide important utility systems and ratepayer benefits. At the same time, the rapid change in the amount and type of variable renewable energy, like solar and wind, is reshaping the role and economic value of EE and DR, and will likely affect the time-dependent valuation of EE and DR measures. Utilities are increasingly interested in integrating EE and DR measures as a strategic approach to improve their collective cost-effectiveness and performance. We develop a framework to identify the EE and DR attributes, system conditions, and technological factors that are likely to drive interactions between EE and DR. We apply the framework to example measures with different technology specifics in the context of different utility system conditions. We find that EE and DR interactions are likely driven by changes in discretionary load, the addition of controls or other capabilities to shift loads, and the coincidence of savings with system peak or load building periods. Our analysis suggests increasing complexity in evaluating EE and DR interactions when moving from standalone equipment to integrated systems. The framework can be applied to research on integrated building systems by grouping measures into portfolios with different likely implications for EE and DR interactions.

Satchwell, Andrew J. (ORCID:0000000244053599)↗
DOE OSTI2026

A Faster-Than-Real-Time Framework for Reliability-Oriented Simulation of PV Inverters

Physics-of-Failure (PoF) based reliability assessment for photovoltaic (PV) inverters requires long-duration electrical and electrothermal stress histories, yet generating such stress histories with high-fidelity switching models over year long mission profiles is computationally prohibitive. Conventional methods either sacrifice modeling fidelity for speed or require runtimes that are impractical for design iteration and uncertainty studies. To address this bottleneck, this paper presents a High-Performance Computing (HPC) based simulation frame work for faster-than-real-time reliability-oriented simulation. The proposed framework integrates the Average-to-Switching (A2S) method with parallel computing techniques to accelerate switching-level waveform reconstruction. We further introduce optimization strategies, including cluster merging and sensitivity based mission profile screening, to reduce the computational burden. Evaluated using real-world mission profile inputs and a MATLAB/Simulink switching-model reference, the framework reduces the simulation time for a one-year mission from an intractable multi-year duration to approximately 7.3 minutes while maintaining low waveform error. This acceleration provides a practical reliability-oriented simulation engine that can be coupled with component-specific aging models for subsequent PV inverter PoF assessment.

High-performance Computing↗
DOE OSTI2021

Detection of Outliers in LiDAR Data Acquired by Multiple Platforms over Sorghum and Maize

High-resolution point cloud data acquired with a laser scanner from any platform contain random noise and outliers. Therefore, outlier detection in LiDAR data is often necessary prior to analysis. Applications in agriculture are particularly challenging, as there is typically no prior knowledge of the statistical distribution of points, plant complexity, and local point densities, which are crop-dependent. The goals of this study were first to investigate approaches to minimize the impact of outliers on LiDAR acquired over agricultural row crops, and specifically for sorghum and maize breeding experiments, by an unmanned aerial vehicle (UAV) and a wheel-based ground platform; second, to evaluate the impact of existing outliers in the datasets on leaf area index (LAI) prediction using LiDAR data. Two methods were investigated to detect and remove the outliers from the plant datasets. The first was based on surface fitting to noisy point cloud data via normal and curvature estimation in a local neighborhood. The second utilized the PointCleanNet deep learning framework. Both methods were applied to individual plants and field-based datasets. To evaluate the method, an F-score was calculated for synthetic data in the controlled conditions, and LAI, the variable being predicted, was computed both before and after outlier removal for both scenarios. Results indicate that the deep learning method for outlier detection is more robust than the geometric approach to changes in point densities, level of noise, and shapes. The prediction of LAI was also improved for the wheel-based vehicle data based on the coefficient of determination (R2) and the root mean squared error (RMSE) of the residuals before and after the removal of outliers.

36 MATERIALS SCIENCE↗
DOE OSTI2024

FENIX: An Open-Source Multiphysics Integrated Framework Enabling Collaborative Development of Plasma Facing Component Modeling Capabilities

Advanced modeling and simulation tools have a crucial role to play in accelerating fusion energy deployment as a sustainable power source. Multiphysics, high-fidelity computational tools can help understand, model, and quantify the complex interactions between materials performance, plasma and neutron exposure, and engineering processes. As a result, they accelerate the design, safety analysis, and performance evaluation of fusion systems. This webinar introduces the Fusion ENergy Integrated multiphys-X (FENIX) framework, an open-source multiphysics tool for plasma facing component modeling. FENIX leverages the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework, which has been developed by the United States Department of Energy Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. FENIX couples various MOOSE capabilities such as heat transfer, thermomechanics, thermal hydraulics, electromagnetics, and plasma kinetics with the MOOSE-based applications Cardinal (neutronics) and TMAP8 (tritium transport). During the webinar, we will present FENIX and discuss how its modularity, openness, software quality assurance processes, and licensing approach supports effective collaborations, including public-private partnerships.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Trigger-based Incremental Data Processing with Unified Sync and Async Model

In recent years, more and more applications in the cloud have needs to process large-scale on-line datasets, which evolve over time as new entries are added and existing entries are modified. Several programming frameworks, such as Percolator and Oolong, are proposed for such incremental data processing and can achieve efficient processing with an event-driven abstraction. However, these frameworks are inherently asynchronous, leaving the heavy burden of managing synchronization to applications' developers, which further significantly restricts their usabilities. In this study, we propose a trigger-based incremental computing framework in the cloud, called Domino, with both synchronous and asynchronous mechanisms to coordinate parallel triggers. With this new framework, both synchronous and asynchronous applications can be seamlessly developed. Use cases and extensive evaluation results confirm that it can deliver sufficient performance, and also is easy to use for incremental applications in large-scale distributed computing.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Efficient Capture of Perrhenate and Pertechnetate by a Mesoporous Zr Metal–Organic Framework and Examination of Anion Binding Motifs

At the Hanford Site in southeastern Washington state, the U.S. Department of Energy intends to treat 56 million gallons of legacy nuclear waste by encasing it in borosilicate glass via vitrification. This process ineffectively captures radioactive pertechnetate (TcO 4 –) because of the ion’s volatility, thereby requiring a different remediation method for this long-lived (t 1/2 = 2.1 × 10 5 years), environmentally mobile species. Currently available sorbents lack the desired combination of high uptake capacity, fast kinetics, and selectivity. Here, we evaluate the ability of the chemically and thermally robust Zr 6 -based metal–organic framework (MOF), NU-1000, to capture perrhenate (ReO 4 –), a pertechnetate simulant, and pertechnetate. Our material exhibits an excellent perrhenate uptake capacity of 210 mg/g, reaches saturation within 5 min, and maintains perrhenate uptake in the presence of competing anions. Additionally, experiments with pertechnetate confirm perrhenate is a suitable surrogate. Single-crystal X-ray diffraction indicates both chelating and nonchelating perrhenate binding motifs are present in both the small pore and the mesopore of NU-1000. Postadsorption diffuse reflectance infrared Fourier transform spectroscopy (DRIFTS) further elucidates the uptake mechanism and powder X-ray diffraction (PXRD) and Brunauer–Emmett–Teller (BET) surface area analysis confirm the retention of crystallinity and porosity of NU-1000 throughout adsorption.

36 MATERIALS SCIENCE↗
DOE OSTI2015

Cyber Security Research Frameworks For Coevolutionary Network Defense

Several architectures have been created for developing and testing systems used in network security, but most are meant to provide a platform for running cyber security experiments as opposed to automating experiment processes. In the first paper, we propose a framework termed Distributed Cyber Security Automation Framework for Experiments (DCAFE) that enables experiment automation and control in a distributed environment. Predictive analysis of adversaries is another thorny issue in cyber security. Game theory can be used to mathematically analyze adversary models, but its scalability limitations restrict its use. Computational game theory allows us to scale classical game theory to larger, more complex systems. In the second paper, we propose a framework termed Coevolutionary Agent-based Network Defense Lightweight Event System (CANDLES) that can coevolve attacker and defender agent strategies and capabilities and evaluate potential solutions with a custom network defense simulation. The third paper is a continuation of the CANDLES project in which we rewrote key parts of the framework. Attackers and defenders have been redesigned to evolve pure strategy, and a new network security simulation is devised which specifies network architecture and adds a temporal aspect. We also add a hill climber algorithm to evaluate the search space and justify the use of a coevolutionary algorithm.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Evaluating Charge Equilibration Methods To Generate Electrostatic Fields in Nanoporous Materials

Charge equilibration (Qeq) methods can estimate the electrostatic potential of molecules and periodic frameworks by assigning point charges to each atom, using only a small fraction of the resources needed to compute density functional (DFT)-derived charges. This makes possible, for example, the computational screening of thousands of microporous structures to assess their performance for the adsorption of polar molecules. Recently, different variants of the original Qeq scheme were proposed to improve the quality of the computed point charges. One focus of this research was to improve the gas adsorption predictions in metal-organic frameworks (MOFs), for which many different structures are available. In this work, we review the evolution of the method from the original Qeq scheme, understanding the role of the different modifications on the final output. We evaluated the result of combining different protocols and set of parameters, by comparing the Qeq charges with high quality DFT-derived DDEC charges for 2338 MOF structures. We focused on the systematic errors that are attributable to specific atom types to quantify the final precision that one can expect from Qeq methods in the context of gas adsorption where the electrostatic potential plays a significant role, namely, CO 2 and H 2 S adsorption. In conclusion, both the type of algorithm and the input parameters have a large impact on the resulting charges, and we draw some guidelines to help the user to choose the proper combination of the two for obtaining a meaningful set of charges. We show that, considering this set of MOFs, the accuracy of the original Qeq scheme is often still comparable with the most recent variants, even if it clearly fails in the presence of certain atom types, such as alkali metals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Quantitative Non-Destructive Evaluation of Fatigue Damage Based on Multi-Sensor Fusion

Based on sensor fusion and machine learning, this project developed a novel non-destructive evaluation (NDE) methodology, which consists of a remaining useful life (RUL) prediction framework and regression models for predicting residual stress and full width at half maximum (FWHM). A series of fatigue testing experiments were conducted using 5052-H32 aluminum alloy specimens. All specimens were measured using linear ultrasonic (LU) and nonlinear ultrasonic (NLU) testing methods non-destructively. Machine learning models were developed to use LU and NLU measurements to predict loading condition, fatigue level, residual stress, and FWHM. It was demonstrated that the developed methodology could distinguish new and fatigue specimens with an accuracy of 97.53%. Also, the prediction errors for residual stress and FWHM were as low as 4.73% and 1.62%, respectively. An interactive database was created to publicly share the data generated from the project. It is envisioned that the developed NDE technology will equip manufacturers with a responsive screening system for incoming used metallic components, and potentially lead to a significant increase in using used metallic components for remanufacturing.

42 ENGINEERING↗
DOE OSTI2026

Multi-Semester Mentoring and GPA Trajectories in SPINS: A Longitudinal Program Evaluation of STEM Scholars

This exploratory longitudinal program evaluation examined GPA trajectories among 14 STEM scholars participating in the Scholarly Partnership in Nuclear Security (SPINS) mentoring program at an HBCU. Using de-identified administrative data (37 scholar-semester observations), the study compared baseline and latest term GPAs anchored to each scholar’s first funded semester. A Wilcoxon signed-rank test was used to assess within-student change. Mean GPA increased modestly from 3.46 (SD = 0.30) at baseline to 3.61 (SD = 0.33) at the latest observed semester, with 12 of 14 scholars (85.7%) showing net improvement (median change = +0.12). The Wilcoxon signed-rank test indicated a statistically significant positive shift (W = 18, p = 0.030). However, scholars entered the program with a high baseline GPA, and ceiling effects were evident for several participants. Grounded in Social Cognitive Career Theory, findings suggest that multi-semester participation in SPINS is associated with GPA stability and modest improvement in an already high-performing cohort. Results should be interpreted cautiously given the small sample size and single-group design. The study highlights the value of sustained, culturally responsive mentoring at an HBCU while underscoring the need for larger evaluations with comparison cohorts and broader psychosocial outcomes. An evidence-informed mentoring framework is proposed to strengthen multi-semester support.

42 ENGINEERING↗
DOE OSTI2025

Self-consistent modeling of tokamak edge plasma transport with lithium sources

Magnetic confinement fusion devices require effective heat and particle exhaust solutions on the divertor plates to operate sustainably, especially under reactor-relevant conditions. Liquid lithium divertors have been proposed to address two major challenges: control of excessive heat flux to plasma-facing components through vapor shielding and minimization of core plasma contamination from impurities. The National Spherical Torus Experiment-Upgrade (NSTX-U) will explore lithium as a divertor material due to its potential to meet both objectives. We present a self-consistent coupling framework between the plasma boundary transport code UEDGE and the lithium wall transport code Wall–Li to evaluate the feasibility and operational limits of lithium-based divertors. The model aims to optimize lithium sourcing levels to prevent core plasma contamination via fuel dilution while ensuring divertor protection through vapor shielding. This integrated framework, applicable to any tokamak with lithium sources, dynamically adjusts lithium sourcing based on local plasma conditions and surface temperature. The coupled model is tested using NSTX-like geometry and plasma conditions to assess its performance and reliability. Wall–Li calculates lithium fluxes from plasma-facing components, incorporating physical sputtering, thermally enhanced sputtering, and evaporation driven by surface temperature and ion flux. These fluxes are reintroduced into UEDGE as neutral lithium atoms, enabling simulation of their transport and distribution within the plasma. UEDGE computes plasma and neutral transport, surface heat flux, and iteratively feeds this information back to Wall–Li. A small time step is employed to ensure numerical stability and convergence, enabling accurate simulations over typical tokamak discharge durations. This integrated modeling approach provides a robust tool for identifying operational regimes that balance effective lithium sourcing with minimal core plasma contamination, offering critical insights for optimizing lithium-based divertor systems in current and future fusion devices.

Magnetic confinement fusion↗
DOE OSTI2024

Implementation of a realistic artificial data generator for crash data generation

In this paper, a framework is outlined to generate realistic artificial data (RAD) as a tool for comparing different models developed for safety analysis. The primary focus of transportation safety analysis is on identifying and quantifying the influence of factors contributing to traffic crash occurrence and its consequences. The current framework of comparing model structures using only observed data has limitations. With observed data, it is not possible to know how well the models mimic the true relationship between the dependent and independent variables. Further, real datasets do not allow researchers to evaluate the model performance for different levels of complexity of the dataset. RAD offers an innovative framework to address these limitations. Hence, we propose a RAD generation framework embedded with heterogeneous causal structures that generates crash data by considering crash occurrence as a trip level event impacted by trip level factors, demographics, roadway and vehicle attributes. Within our RAD generator we employ three specific modules: (a) disaggregate trip information generation, (b) crash data generation and (c) crash data aggregation. For disaggregate trip information generation, we employ a daily activity-travel realization for an urban region generated from an established activity-based model for the Chicago region. We use this data of more than 2 million daily trips to generate a subset of trips with crash data. For trips with crashes crash location, crash type, driver/vehicle characteristics, and crash severity. The daily RAD generation process is repeated for generating crash records at yearly or multi-year resolution. In conclusion, the crash databases generated can be employed to compare frequency models, severity models, crash type and various other dimensions by facility type - possibly establishing a universal benchmarking system for alternative model frameworks in safety literature.

42 ENGINEERING↗
DOE OSTI2024

Computational Investigation of Fuel Dispersal Phenomena during Large-Break Loss of Coolant Accident in Light-Water Reactors

In the event of cladding rupture, which could occur in light water reactor fuel assemblies during a loss-of-coolant accident (LOCA), fuel particles, along with fission gases, can be expelled into the reactor core from the fractured fuel rod. This expulsion of fragmented fuel particles, referred as fuel dispersal, is the subject of investigation to evaluate the safety implications of increasing fuel burnup in light water reactors, with a specific focus on fuel fragmentation, relocation, and dispersal. Particle trajectories and the resulting mass distribution of the settled particles within the reactor pressure vessel can pose a long-term cooling challenge for the reactor core. The fuel dispersal phenomenon is significantly influenced by the ejection characteristics of the fuel fragments, as well as the size and shape of the cladding rupture and fuel rod depressurization history during LOCA transients. In this study, the transport of fuel particles within a scaled 5 × 5 lattice of a pressurized water reactor rod bundle geometry is modeled through a two-fluid Eulerian framework that treats the gas and solid phases as interpenetrating continua. The required boundary conditions are evaluated from the fuel performance code BISON in a postulated large-break LOCA scenario. The modeling framework considers solid fuel particles as granular matter, interacting with the gaseous dry steam phase and fission gases through the governing interfacial momentum and energy exchange between the gas and solid phases. The simulation results provide the volume fraction of the solids settled on the bottom surface of the fuel bundle, quantifying the deposition within the bundle geometry.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Bounds on Lorentz Violation Parameters in the DUNE Experiment

The Standard Model (SM) has been highly successful in describing fundamental interactions, yet phenomena like neutrino oscillations point to physics beyond its framework. Among the proposed extensions, Lorentz invariance violation (LIV) stands out as a compelling possibility. Long-baseline neutrino experiments such as DUNE, with its 1300 km baseline, offer a promising setting to test LIV effects with high precision. In this work, we evaluate DUNE s sensitivity to LIV by analyzing event rates and oscillation probabilities using the GLoBES framework. A custom implementation of LIV parameters was employed to derive bounds on the aa and cc matrices, identifying the parameter values that lead to a 10% deviation from the standard oscillation probability. Our results show partial agreement with previous studies for the aa parameters, while deviations in the cc parameters highlight the impact of differing methodologies and sensitivities. These findings reinforce the relevance of LIV searches and motivate further theoretical and experimental efforts in this direction.

Cruz, Thiago. [Tech. Fed. Parana U.]↗