Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

CGSim: A Simulation Framework for Large Scale Distributed Computing Environment

Large-scale distributed computing infrastructures such as the Worldwide LHC Computing Grid (WLCG) require comprehensive simulation tools for evaluating performance, testing new algorithms, and optimizing resource allocation strategies. However, existing simulators suffer from limited scalability, hardwired algorithms, lack of real-time monitoring, and inability to generate datasets suitable for modern machine learning approaches. We present CGSim, a simulation framework for large-scale distributed computing environments that addresses these limitations. Built upon the validated SimGrid simulation framework, CGSim provides high-level abstractions for modeling heterogeneous grid environments while maintaining accuracy and scalability. Key features include a modular plugin mechanism for testing custom workflow scheduling and data movement policies, interactive real-time visualization dashboards, and automatic generation of event-level datasets suitable for AI-assisted performance modeling. We demonstrate CGSim’s capabilities through a comprehensive evaluation using production ATLAS PanDA workloads, showing significant calibration accuracy improvements across WLCG computing sites. Scalability experiments show near-linear scaling for multi-site simulations, with distributed workloads achieving 6 × better performance compared to single-site execution. The framework enables researchers to simulate WLCG-scale infrastructures with hundreds of sites and thousands of concurrent jobs within practical time budget constraints on commodity hardware.

Vatsavai, Sairam Sri [Brookhaven National Laborato↗
DOE OSTI2025

Energy storage planning for enhanced resilience of power systems against wildfires and heatwaves

Extreme weather events pose significant risks to power grid stability due to their severe consequences and potential for widespread failures. Energy storage systems hold great potential for enhancing grid resilience against such events by providing reliable power during peak demand periods. However, accurately quantifying the size, location, and investment costs of new energy storage assets is a complex task, as energy storage planning decisions depend on the investment choices of other generation technologies and the integration of new transmission projects. Here, this paper presents a novel capacity expansion planning framework that simultaneously optimizes investments in energy storage, generation, and transmission, determining their optimal size, location, and type, while incorporating extreme weather events into long-term planning. More specifically, our stress-event-informed planning framework integrates the impact of heatwaves and wildfires into the planning process, identifying least-cost investment solutions that comply with policy goals and enhance grid resilience. The proposed framework employs machine-learning-based modeling to project heatwave-induced loads and performance-based risk assessment to evaluate wildfire-driven transmission line derates. Using industry-standard datasets to accurately represent the transmission topology of the Western Interconnection (WI) system, the proposed framework is applied to the WI 40-zone system, with investment decisions reported for the years 2030, 2035, and 2040. Simulation results reveal that with just a 10% increase in investment costs, resilience against extreme events can be significantly improved, with investment decisions heavily favoring energy storage, particularly 4-hour energy storage systems.

25 ENERGY STORAGE↗
DOE OSTI2020

A Conceptual Framework to Describe Energy Efficiency and Demand Response Interactions

Energy efficiency (EE) and demand response (DR) resources provide important utility systems and ratepayer benefits. At the same time, the rapid change in the amount and type of variable renewable energy, like solar and wind, is reshaping the role and economic value of EE and DR, and will likely affect the time-dependent valuation of EE and DR measures. Utilities are increasingly interested in integrating EE and DR measures as a strategic approach to improve their collective cost-effectiveness and performance. We develop a framework to identify the EE and DR attributes, system conditions, and technological factors that are likely to drive interactions between EE and DR. We apply the framework to example measures with different technology specifics in the context of different utility system conditions. We find that EE and DR interactions are likely driven by changes in discretionary load, the addition of controls or other capabilities to shift loads, and the coincidence of savings with system peak or load building periods. Our analysis suggests increasing complexity in evaluating EE and DR interactions when moving from standalone equipment to integrated systems. The framework can be applied to research on integrated building systems by grouping measures into portfolios with different likely implications for EE and DR interactions.

Satchwell, Andrew J. (ORCID:0000000244053599)↗
DOE OSTI2026

A Faster-Than-Real-Time Framework for Reliability-Oriented Simulation of PV Inverters

Physics-of-Failure (PoF) based reliability assessment for photovoltaic (PV) inverters requires long-duration electrical and electrothermal stress histories, yet generating such stress histories with high-fidelity switching models over year long mission profiles is computationally prohibitive. Conventional methods either sacrifice modeling fidelity for speed or require runtimes that are impractical for design iteration and uncertainty studies. To address this bottleneck, this paper presents a High-Performance Computing (HPC) based simulation frame work for faster-than-real-time reliability-oriented simulation. The proposed framework integrates the Average-to-Switching (A2S) method with parallel computing techniques to accelerate switching-level waveform reconstruction. We further introduce optimization strategies, including cluster merging and sensitivity based mission profile screening, to reduce the computational burden. Evaluated using real-world mission profile inputs and a MATLAB/Simulink switching-model reference, the framework reduces the simulation time for a one-year mission from an intractable multi-year duration to approximately 7.3 minutes while maintaining low waveform error. This acceleration provides a practical reliability-oriented simulation engine that can be coupled with component-specific aging models for subsequent PV inverter PoF assessment.

High-performance Computing↗
DOE OSTI2021

Detection of Outliers in LiDAR Data Acquired by Multiple Platforms over Sorghum and Maize

High-resolution point cloud data acquired with a laser scanner from any platform contain random noise and outliers. Therefore, outlier detection in LiDAR data is often necessary prior to analysis. Applications in agriculture are particularly challenging, as there is typically no prior knowledge of the statistical distribution of points, plant complexity, and local point densities, which are crop-dependent. The goals of this study were first to investigate approaches to minimize the impact of outliers on LiDAR acquired over agricultural row crops, and specifically for sorghum and maize breeding experiments, by an unmanned aerial vehicle (UAV) and a wheel-based ground platform; second, to evaluate the impact of existing outliers in the datasets on leaf area index (LAI) prediction using LiDAR data. Two methods were investigated to detect and remove the outliers from the plant datasets. The first was based on surface fitting to noisy point cloud data via normal and curvature estimation in a local neighborhood. The second utilized the PointCleanNet deep learning framework. Both methods were applied to individual plants and field-based datasets. To evaluate the method, an F-score was calculated for synthetic data in the controlled conditions, and LAI, the variable being predicted, was computed both before and after outlier removal for both scenarios. Results indicate that the deep learning method for outlier detection is more robust than the geometric approach to changes in point densities, level of noise, and shapes. The prediction of LAI was also improved for the wheel-based vehicle data based on the coefficient of determination (R2) and the root mean squared error (RMSE) of the residuals before and after the removal of outliers.

36 MATERIALS SCIENCE↗
DOE OSTI2024

FENIX: An Open-Source Multiphysics Integrated Framework Enabling Collaborative Development of Plasma Facing Component Modeling Capabilities

Advanced modeling and simulation tools have a crucial role to play in accelerating fusion energy deployment as a sustainable power source. Multiphysics, high-fidelity computational tools can help understand, model, and quantify the complex interactions between materials performance, plasma and neutron exposure, and engineering processes. As a result, they accelerate the design, safety analysis, and performance evaluation of fusion systems. This webinar introduces the Fusion ENergy Integrated multiphys-X (FENIX) framework, an open-source multiphysics tool for plasma facing component modeling. FENIX leverages the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework, which has been developed by the United States Department of Energy Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. FENIX couples various MOOSE capabilities such as heat transfer, thermomechanics, thermal hydraulics, electromagnetics, and plasma kinetics with the MOOSE-based applications Cardinal (neutronics) and TMAP8 (tritium transport). During the webinar, we will present FENIX and discuss how its modularity, openness, software quality assurance processes, and licensing approach supports effective collaborations, including public-private partnerships.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Trigger-based Incremental Data Processing with Unified Sync and Async Model

In recent years, more and more applications in the cloud have needs to process large-scale on-line datasets, which evolve over time as new entries are added and existing entries are modified. Several programming frameworks, such as Percolator and Oolong, are proposed for such incremental data processing and can achieve efficient processing with an event-driven abstraction. However, these frameworks are inherently asynchronous, leaving the heavy burden of managing synchronization to applications' developers, which further significantly restricts their usabilities. In this study, we propose a trigger-based incremental computing framework in the cloud, called Domino, with both synchronous and asynchronous mechanisms to coordinate parallel triggers. With this new framework, both synchronous and asynchronous applications can be seamlessly developed. Use cases and extensive evaluation results confirm that it can deliver sufficient performance, and also is easy to use for incremental applications in large-scale distributed computing.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Quantitative Non-Destructive Evaluation of Fatigue Damage Based on Multi-Sensor Fusion

Based on sensor fusion and machine learning, this project developed a novel non-destructive evaluation (NDE) methodology, which consists of a remaining useful life (RUL) prediction framework and regression models for predicting residual stress and full width at half maximum (FWHM). A series of fatigue testing experiments were conducted using 5052-H32 aluminum alloy specimens. All specimens were measured using linear ultrasonic (LU) and nonlinear ultrasonic (NLU) testing methods non-destructively. Machine learning models were developed to use LU and NLU measurements to predict loading condition, fatigue level, residual stress, and FWHM. It was demonstrated that the developed methodology could distinguish new and fatigue specimens with an accuracy of 97.53%. Also, the prediction errors for residual stress and FWHM were as low as 4.73% and 1.62%, respectively. An interactive database was created to publicly share the data generated from the project. It is envisioned that the developed NDE technology will equip manufacturers with a responsive screening system for incoming used metallic components, and potentially lead to a significant increase in using used metallic components for remanufacturing.

42 ENGINEERING↗
DOE OSTI2026

Multi-Semester Mentoring and GPA Trajectories in SPINS: A Longitudinal Program Evaluation of STEM Scholars

This exploratory longitudinal program evaluation examined GPA trajectories among 14 STEM scholars participating in the Scholarly Partnership in Nuclear Security (SPINS) mentoring program at an HBCU. Using de-identified administrative data (37 scholar-semester observations), the study compared baseline and latest term GPAs anchored to each scholar’s first funded semester. A Wilcoxon signed-rank test was used to assess within-student change. Mean GPA increased modestly from 3.46 (SD = 0.30) at baseline to 3.61 (SD = 0.33) at the latest observed semester, with 12 of 14 scholars (85.7%) showing net improvement (median change = +0.12). The Wilcoxon signed-rank test indicated a statistically significant positive shift (W = 18, p = 0.030). However, scholars entered the program with a high baseline GPA, and ceiling effects were evident for several participants. Grounded in Social Cognitive Career Theory, findings suggest that multi-semester participation in SPINS is associated with GPA stability and modest improvement in an already high-performing cohort. Results should be interpreted cautiously given the small sample size and single-group design. The study highlights the value of sustained, culturally responsive mentoring at an HBCU while underscoring the need for larger evaluations with comparison cohorts and broader psychosocial outcomes. An evidence-informed mentoring framework is proposed to strengthen multi-semester support.

42 ENGINEERING↗
DOE OSTI2025

Self-consistent modeling of tokamak edge plasma transport with lithium sources

Magnetic confinement fusion devices require effective heat and particle exhaust solutions on the divertor plates to operate sustainably, especially under reactor-relevant conditions. Liquid lithium divertors have been proposed to address two major challenges: control of excessive heat flux to plasma-facing components through vapor shielding and minimization of core plasma contamination from impurities. The National Spherical Torus Experiment-Upgrade (NSTX-U) will explore lithium as a divertor material due to its potential to meet both objectives. We present a self-consistent coupling framework between the plasma boundary transport code UEDGE and the lithium wall transport code Wall–Li to evaluate the feasibility and operational limits of lithium-based divertors. The model aims to optimize lithium sourcing levels to prevent core plasma contamination via fuel dilution while ensuring divertor protection through vapor shielding. This integrated framework, applicable to any tokamak with lithium sources, dynamically adjusts lithium sourcing based on local plasma conditions and surface temperature. The coupled model is tested using NSTX-like geometry and plasma conditions to assess its performance and reliability. Wall–Li calculates lithium fluxes from plasma-facing components, incorporating physical sputtering, thermally enhanced sputtering, and evaporation driven by surface temperature and ion flux. These fluxes are reintroduced into UEDGE as neutral lithium atoms, enabling simulation of their transport and distribution within the plasma. UEDGE computes plasma and neutral transport, surface heat flux, and iteratively feeds this information back to Wall–Li. A small time step is employed to ensure numerical stability and convergence, enabling accurate simulations over typical tokamak discharge durations. This integrated modeling approach provides a robust tool for identifying operational regimes that balance effective lithium sourcing with minimal core plasma contamination, offering critical insights for optimizing lithium-based divertor systems in current and future fusion devices.

Magnetic confinement fusion↗
DOE OSTI2024

Implementation of a realistic artificial data generator for crash data generation

In this paper, a framework is outlined to generate realistic artificial data (RAD) as a tool for comparing different models developed for safety analysis. The primary focus of transportation safety analysis is on identifying and quantifying the influence of factors contributing to traffic crash occurrence and its consequences. The current framework of comparing model structures using only observed data has limitations. With observed data, it is not possible to know how well the models mimic the true relationship between the dependent and independent variables. Further, real datasets do not allow researchers to evaluate the model performance for different levels of complexity of the dataset. RAD offers an innovative framework to address these limitations. Hence, we propose a RAD generation framework embedded with heterogeneous causal structures that generates crash data by considering crash occurrence as a trip level event impacted by trip level factors, demographics, roadway and vehicle attributes. Within our RAD generator we employ three specific modules: (a) disaggregate trip information generation, (b) crash data generation and (c) crash data aggregation. For disaggregate trip information generation, we employ a daily activity-travel realization for an urban region generated from an established activity-based model for the Chicago region. We use this data of more than 2 million daily trips to generate a subset of trips with crash data. For trips with crashes crash location, crash type, driver/vehicle characteristics, and crash severity. The daily RAD generation process is repeated for generating crash records at yearly or multi-year resolution. In conclusion, the crash databases generated can be employed to compare frequency models, severity models, crash type and various other dimensions by facility type - possibly establishing a universal benchmarking system for alternative model frameworks in safety literature.

42 ENGINEERING↗
DOE OSTI2024

Computational Investigation of Fuel Dispersal Phenomena during Large-Break Loss of Coolant Accident in Light-Water Reactors

In the event of cladding rupture, which could occur in light water reactor fuel assemblies during a loss-of-coolant accident (LOCA), fuel particles, along with fission gases, can be expelled into the reactor core from the fractured fuel rod. This expulsion of fragmented fuel particles, referred as fuel dispersal, is the subject of investigation to evaluate the safety implications of increasing fuel burnup in light water reactors, with a specific focus on fuel fragmentation, relocation, and dispersal. Particle trajectories and the resulting mass distribution of the settled particles within the reactor pressure vessel can pose a long-term cooling challenge for the reactor core. The fuel dispersal phenomenon is significantly influenced by the ejection characteristics of the fuel fragments, as well as the size and shape of the cladding rupture and fuel rod depressurization history during LOCA transients. In this study, the transport of fuel particles within a scaled 5 × 5 lattice of a pressurized water reactor rod bundle geometry is modeled through a two-fluid Eulerian framework that treats the gas and solid phases as interpenetrating continua. The required boundary conditions are evaluated from the fuel performance code BISON in a postulated large-break LOCA scenario. The modeling framework considers solid fuel particles as granular matter, interacting with the gaseous dry steam phase and fission gases through the governing interfacial momentum and energy exchange between the gas and solid phases. The simulation results provide the volume fraction of the solids settled on the bottom surface of the fuel bundle, quantifying the deposition within the bundle geometry.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Bounds on Lorentz Violation Parameters in the DUNE Experiment

The Standard Model (SM) has been highly successful in describing fundamental interactions, yet phenomena like neutrino oscillations point to physics beyond its framework. Among the proposed extensions, Lorentz invariance violation (LIV) stands out as a compelling possibility. Long-baseline neutrino experiments such as DUNE, with its 1300 km baseline, offer a promising setting to test LIV effects with high precision. In this work, we evaluate DUNE s sensitivity to LIV by analyzing event rates and oscillation probabilities using the GLoBES framework. A custom implementation of LIV parameters was employed to derive bounds on the aa and cc matrices, identifying the parameter values that lead to a 10% deviation from the standard oscillation probability. Our results show partial agreement with previous studies for the aa parameters, while deviations in the cc parameters highlight the impact of differing methodologies and sensitivities. These findings reinforce the relevance of LIV searches and motivate further theoretical and experimental efforts in this direction.

Cruz, Thiago. [Tech. Fed. Parana U.]↗
DOE OSTI2021

CELAVI (Circular Economy Lifecycle Assessment and VIsualization) [SWR-20-87]

A circular economy emphasizes the efficient use of all resources (e.g., materials, land, water). Despite anticipated overall benefits to society, the transition to a circular economy is likely to create regional differences in impacts. Current tools are unable to fully evaluate these potential externalities, which will be important for informing research prioritization and regional decision making. The Circular Economy Lifecycle Assessment and VIsualization (CELAVI) framework allows stakeholders to quantify and visualize potential regional and sectoral transfers of impacts that could result from transitioning to a circular economy, with particular focus on energy materials. The framework uses system dynamics to model material flows for multiple circular economy pathways and decisions are based on learning-by-doing and are implemented via cost and strategic value of different circular economy pathways. It uses network theory to track the spatial and sectoral flow of functional units across a graph and discrete event simulation to to step through time and evaluate lifecycle assessment data at each time step. The framework is designed to be flexible and scalable to accommodate multiple energy materials and multiple energy technologies. The primary goal of CELAVI is to help answer questions about how material flows and environmental and economic impacts of energy systems might change if the circularity of energy systems increases.

Eberle, Annika↗
DOE OSTI2022

CELAVI (Circular Economy Lifecycle Assessment and VIsualization) v.1.3.1 9/30/2022 [SWR-20-87]

A circular economy emphasizes the efficient use of all resources (e.g., materials, land, water). Despite anticipated overall benefits to society, the transition to a circular economy is likely to create regional differences in impacts. Current tools are unable to fully evaluate these potential externalities, which will be important for informing research prioritization and regional decision making. The Circular Economy Lifecycle Assessment and VIsualization (CELAVI) framework allows stakeholders to quantify and visualize potential regional and sectoral transfers of impacts that could result from transitioning to a circular economy, with particular focus on energy materials. The framework uses system dynamics to model material flows for multiple circular economy pathways and decisions are based on learning-by-doing and are implemented via cost and strategic value of different circular economy pathways. It uses network theory to track the spatial and sectoral flow of functional units across a graph and discrete event simulation to to step through time and evaluate lifecycle assessment data at each time step. The framework is designed to be flexible and scalable to accommodate multiple energy materials and multiple energy technologies. The primary goal of CELAVI is to help answer questions about how material flows and environmental and economic impacts of energy systems might change if the circularity of energy systems increases.

Eberle, Annika↗
DOE OSTI2024

Soil Desiccation Treatability Testing at BC Waste Disposal Cribs

During Hanford’s production period, low-level waste products generated from chemical processing of uranium fuel rods were discharged directly to the ground through a system of cribs and trenches located in the 200-BC-1 Operable Unit (OU). The site consists of 6 cribs and 20 trenches that received more than 117,000 m3 of radioactive liquid waste discharged to the soil. These unlined infiltration galleries held volumes of liquid waste while it seeped into the ground, with the understanding that the 100 m (330 ft) thick vadose zone in the area would effectively capture the effluent and prevent groundwater impacts. A conceptual model showing the operation of cribs and trenches is shown in Figure 1. Data show effluent from the 26 cribs and trenches containing about 410 curies of Technetium-99 (Tc-99) is primarily located between 30 m and 70 m (98 ft and 230 ft) depth (Corbin et al., 2005; Ward et al., 2004). Despite no evidence indicating that the contamination has reached the groundwater at BC cribs and trenches, the mobility of Tc-99 had been demonstrated in laboratory tests and was recognized as a threat to groundwater at the site. Using data from numerical models, laboratory analyses, field investigations, and information on historical discharges, the EPA and Ecology identified Tc-99 and U contamination of the vadose zone as a remediation priority. The U.S. DOE was notified by EPA and Ecology regarding risks associated with Tc-99 contamination in a letter requesting development of a strategy for improved methods to understand the nature and extent of vadose zone contamination, specifically Tc-99, and to develop remedial options for addressing such contamination. To develop the appropriate technology for characterizing, remediating, and monitoring the deep vadose zone Tc-99 contamination, the U.S. DOE worked with the EPA and Ecology to create a Treatability Test Plan under a Remedial Investigation/Feasibility Study (RI/FS) for the Hanford 200 Areas. Under this RI/FS, it was determined that a treatability test for soil desiccation should be carried out as it was identified as a promising in-situ treatment technology for mitigating risks posed by Tc-99 contamination to the groundwater table. The BC Cribs and Trenches site was identified as a representative site for Tc-99 and U contamination and selected for the soil desiccation treatability test. In this chapter, we summarize the overlying regulatory framework of RI/FS and treatability tests and illustrate how development and experimentation supported the evaluation of selected remedies. We briefly discuss the RI/FS for the 200 Areas of the Hanford Site and focus on the soil desiccation treatability testing performed at the BC cribs and trenches site under the Deep Vadose Zone Treatability Test Plan for the Hanford Central Plateau (DVZ-TT). The DVZ-TT is one component of the remedial investigation/feasibility study for the Hanford 200 Areas and represents the underlying regulatory framework that drives site operations towards records of decision and site closure.

Mangel, Adam R.↗
DOE OSTI2021

Autotuning PolyBench benchmarks with LLVM Clang/Polly loop optimization pragmas using Bayesian optimization

Here, we develop a ytopt autotuning framework that leverages Bayesian optimization to explore the parameter space search and compare four different supervised learning methods within Bayesian optimization and evaluate their effectiveness. We select six of the most complex PolyBench benchmarks and apply the newly developed LLVM Clang/Polly loop optimization pragmas to the benchmarks to optimize them. We then use the autotuning framework to optimize the pragma parameters to improve their performance. The experimental results show that our autotuning approach outperforms the other compiling methods to provide the smallest execution time for the benchmarks syr2k, 3mm, heat-3d, lu, and covariance with two large datasets in 200 code evaluations for effectively searching the parameter spaces with up to 170,368 different configurations. We find that the Floyd-Warshall benchmark did not benefit from autotuning. To cope with this issue, we provide some compiler option solutions to improve the performance. Then we present loop autotuning without a user's knowledge using a simple mctree autotuning framework to further improve the performance of the Floyd-Warshall benchmark. We also extend the ytopt autotuning framework to tune a deep learning application.

79 ASTRONOMY AND ASTROPHYSICS↗