Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Automated Resonance Fitting for Nuclear Data Evaluation

Global and national efforts to deliver high-quality nuclear data to users have a wide-ranging impact, affecting applications in national security, reactor operations, basic science, medicine, and more. Cross section evaluation is a major part of this effort, combining theory and experimentation to produce recommended values and uncertainties for reaction probabilities. Resonance region evaluation is a specialized type of nuclear data evaluation that can require significant manual effort and months of time from expert scientists. In this article, non-convex non-linear optimization methods are combined with concepts of inferential statistics to infer a resonance model from experimental data in an automated manner that is not dependent on prior evaluation(s). This methodology aims to enhance the workflow of a resonance evaluator by minimizing time, effort, and the potential for bias from prior assumptions, while enhancing reproducibility and documentation, thereby addressing well-known challenges in the field.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

An Observational Evaluation of RKW Theory over the U.S. Southern Great Plains

The theory of Rotunno et al. (“RKW” theory) addresses the behavior of squall-line cold pools in vertically sheared flows. It predicts that, within a given thermodynamic environment, a balance between baroclinic vorticity generation by the cold pool and low-level environmental vertical wind shear induces an upright updraft along the gust front that maximizes the initiation of new convective cells. Although this theory has been evaluated numerically, its applicability to observed systems remains unclear and is limited by a lack of critical measurements, including high-frequency thermodynamic and wind profiles across the gust front. Herein, observations from the Atmospheric Radiation Measurement Southern Great Plains (ARM-SGP) observatory near Lamont, Oklahoma, are used to evaluate RKW theory for 10 well-observed squall lines over a 11-yr period. For this evaluation, RKW parameters including cold-pool intensity (c), low-level ambient, line-normal vertical shear (ΔV n ), subcloud and cloud-layer updraft tilts, and multiple measures of system intensity are estimated. Furthermore, the c estimates rely on thermodynamic retrievals from the Atmosphere Emitted Radiance Interferometer (AERI), which are uncertain but verify reasonably well against independent observations. As predicted by the theory, for c/ΔV n ≥ 1, c/ΔV n correlates positively with updraft tilt and negatively with system intensity, but these results are not always statistically significant and are also sensitive to the method by which ΔV n is evaluated. Specifically, ΔV n evaluations that extend above the cold-pool top yield greater consistency with RKW predictions. Also, some measures of intensity correlate more strongly with standard moist instability metrics than with RKW parameters.

Cold pools↗
DOE OSTI2025

Field Evaluation of the High Efficiency Dehumidification System (HEDS) at the Timken Museum of Art - Measurement and Verification (M&V) Results from Summer, Winter and Spring Evaluation Periods

The High Efficiency Dehumidification System (HEDS) technology from Conservant Systems Inc., installed at the Timken Museum of Art in San Diego, California, was evaluated to determine its performance relative to appropriate baseline operation. Data was collected for measurement and verification for several weeks during three evaluation periods: Summer (Aug-Sep 2023), Winter (Dec 2023-Feb 2024) and Spring (May-Jun 2024). The evaluation included operating the heating, ventilation and air conditioning (HVAC) system in both constant air volume (CAV) and variable air volume (VAV) modes, with and without the HEDS energy recovery and HVAC system optimization technology enabled. The electricity consumption of the chiller and the gas-supplied reheat energy were measured to characterize savings achieved by the HEDS operation. Based on these measurements, the HEDS was responsible for chiller electrical load savings during the summer evaluation period of 39% and 42% for the CAV and VAV operating modes, respectively; 97% and 100% chiller electrical load reductions were observed during the winter evaluation for the CAV and VAV operating modes, respectively; and the corresponding reductions during the spring evaluation were 42% and 52% for CAV and VAV operation, respectively. The measured reheat energy reductions, which are typically provided by natural gas, due to the HEDS during summer were 64% and 97% in CAV and VAV operating modes, respectively, while the corresponding values were 99% and 78% during the winter evaluation, and 59% and 56% during the spring evaluation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Upcycling of post-consumer mixed polyolefin feedstock: An economic and technical evaluation

Here, this study reports techno-economic and life cycle analyses to evaluate the economic and environmental impacts of mechanically recycled PE/PP blends in the presence of rheology modifiers. Additionally, fiber-reinforced composites derived from the compatibilized blends were prepared and evaluated for their performance compared with virgin plastics. Results suggest that compatibilized PE/PP blends exhibit a 70% lower selling price compared to virgin PE. Furthermore, these blends achieved a 74% reduction in greenhouse gas emissions or climate change impact compared to the virgin counterpart. Fiber-reinforced composites from compatibilized PE/PP blends demonstrated improved or comparable mechanical properties relative to composites made from virgin PE/PP blends. Based on their favorable cost and environmental impact, along with performance comparable to virgin composites, compatibilized PP/PE composites made from post-consumer plastics can find applications in large-scale composite manufacturing.

Fiber reinforced plastics (FRP)↗
DOE OSTI2026

Evaluating isoprenol production using the IPP-bypass pathway in the oleaginous yeast Rhodosporidium toruloides

Background To strengthen the national energy supply, there is an increasing demand for domestically generated aviation fuels. Bio-derived advanced aviation fuels offer the opportunity to meet this domestic need while presenting a unique opportunity to investigate the production of novel aviation fuels. Isoprenol, a chemical precursor to such novel fuels, has been shown to be a biologically producible compound in model organisms, but its bio-producibility needs to be further explored in organisms more compatible with industrial bioproduction. Results In this work, we evaluate isoprenol production using the promising bioproduction yeast, Rhodosporidium toruloides. First, we show successful isoprenol production using the IPP-bypass pathways most successful in laboratory strains of E. coli and S. cerevisiae. Next, we demonstrate that increased flux through the mevalonate pathway only modestly increases isoprenol titers. Using proteomics, we identified a potential bottleneck in production at the final step in the IPP-bypass pathway and explored alternative enzymes for this step. Finally, the top three strains of R. toruloides were evaluated in sorghum hydrolysates generated using cholinium lysinate. Through this work, 93.1 mg/L of isoprenol was produced in mock medium and 27.3 mg/L in sorghum hydrolysates. Conclusion Together these results lay the foundation for future work for the production of isoprenol from bioproduction crops.

Advanced aviation fuel↗
DOE OSTI2026

Adaptive Cybersecurity for Distributed Energy Resources (AdCyDER): Online Reinforcement Learning with Stackelberg-Optimized Defenses — Pipeline Architecture, Evaluation Methodology, and Findings from a Synthetic-Data Evaluation

This report documents the design and evaluation of an integrated online-learning pipeline developed within the AdCyDER project for Distributed Energy Resource (DER) cybersecurity. The pipeline couples a Reinforcement Learning (RL) attack classifier — which produces an attack-type probability distribution — with a Stackelberg game-theoretic (GT) defense selector that consumes those distributions alongside SME-encoded priors over (defense, attack) effectiveness pairings and perdefense costs to choose grid-health-preserving defenses. The objective is not attack classification per se but production of distributions that drive effective defense selection through the Stackelberg layer, learned from delayed grid-health feedback rather than labeled attack data. AdCyDER as a whole is broader than the work presented here; this report covers the specific RL/GT loop integration and its evaluation. We present the integrated pipeline (SCADA telemetry with Fronius inverter physics, Suricata IDS, time-windowed aggregation, per-facility LSTM classifier, Stackelberg optimizer, OpenC2 actuators), an experimental campaign of 28 eight-hour iterations across three baseline modes, and a pipeline-ordered diagnostic protocol. The protocol identifies two distinct failure modes within the loop: paired supervised ceilings on the same features establish that the deployed online RL classifier (macro F1 ≈ 0.07) sits at least 4.7× below a same-architecture supervised LSTM (≈ 0.34) and 10–11× below a linear feature-signal ceiling (≈ 0.70–0.79 depending on per-facility isolation), localizing the dominant failure to the training procedure; and the reward signal driving online updates carries weak directional coupling with classifier correctness in the methodology-expected direction (multi-lens convergent: top-decile P(true) records produce more frequent state changes and slightly larger improvements, top-vs-bot Cohen’s 𝑑 ≈ −0.19), but at effect magnitudes too small to drive gradient-based learning at the campaign sample size. The original learning hypothesis is not supported by the data. The primary contributions are the diagnostic methodology — proposed as a transferable falsification protocol for online RL/GT defense pipelines learning from delayed environmental reward — and the open, reproducible experimental infrastructure. We outline reward reformulation as the highest-priority aspirational next step given the underpowered-but-aligned Q6 reading, with hardware-in-the-loop evaluation as the broadest scope-expansion option.

Blakely, Benjamin [Argonne National Laboratory (AN↗
DOE OSTI2026

GPM IMERG V07B and V06B: Evaluation Using Ground-Based Radar Observations and Application in Global Mesoscale Convective System Tracking

This study evaluates the latest Global Precipitation Measurement (GPM) Integrated Multi-satellitE Retrievals for GPM (IMERG V07B) against its predecessor V06B, for studying mesoscale convective systems (MCSs). Both versions are compared using ground-based radar and rain gauge data from five meteorologically diverse regions: the contiguous United States (including eastern coastlines), Amazon rainforest, central Argentina mountains, equatorial Indian Ocean, and northern Australia across multiple temporal (0.5–6 hours) and spatial scales (0.1°–0.25°). An updated global MCS tracking dataset is developed by integrating satellite-observed infrared brightness temperature with IMERG V07B. Comparation of IMERG against radar observations reveals that IMERG demonstrates better performance in capturing the probability distribution and quantitative contributions of rainfall (from no-rain to intense-rain conditions) over tropical oceans than over land, with marked improvements in IMERG V07B for heavy-to-intense rain (> 10 mm h-1). Over land, systematic biases persist: IMERG tends to overestimate light-to-moderate rain (1–10 mm h-1) while underestimating heavy-to-intense rain. Additionally, aggregating IMERG to coarser resolutions (3-hourly or 0.25°) improves consistency with radar observations, outperforming the 1-hourly/0.1° resolution. The new IMERG V07B-based global MCS dataset exhibits consistent statistical characteristics with the V06B-based dataset, despite lower mean rain rates and reduced heavy precipitation contributions. These findings offer valuable insights for utilizing IMERG V07B in global precipitation studies, MCS characterization, and model evaluation.

Zhang, Sihan↗
DOE OSTI2025

Performance Evaluation of Vertical Federated Machine Learning Against Adversarial Threats on Wide-Area Control System: Preprint

Federated machine learning (FL) is gaining significant popularity to develop cybersecurity solutions in power grids because of its advanced capability to support decentralized data handing at local devices, its privacy preservation, and its low-bandwidth requirement. However, the evolving adversarial machine learning (AML) threats raise significant concerns for the cybersecurity of FL architectures. The FL-based split neural network (SplitNN) achieves high performance through the decentralized training of local neural network models while preserving data privacy across multiple entities. In this paper, we propose a methodology for evaluating the performance of a vertical FLbased anomaly detector against different types of AML attacks, including denial-of-service attacks, adversarial data injection attacks, and replay attacks on the trained local models deployed in the grid network. For a case study, we consider the modified IEEE 13-bus system, and we develop SplitNN-based binary and multiclass classification models to detect, locate, and identify different types of data integrity attacks on the volt-watt control with two pooling layers: maximum pooling and AvgPool. Our experimental results, computed through performance metrics, reveal that the severity of these AML attacks varies with the integrated pooling mechanism, the type of classification model, and the nature of the cyberattack. Further, the AML attacks negatively impacted the prediction time per sample for the pretrained SplitNN during the online testing.

adversarial threats↗
DOE OSTI2026

Data for Multisite Field Evaluation of Oil Accumulation and Agronomic Performance in Grain and Sweet Sorghums Engineered for Lipid Hyperaccumulation

Oil sorghum (OS) has been developed by engineering grain (TX430) and sweet (Ramada) genetic backgrounds to accumulate triacylglycerols (TAG) in vegetative tissues as an energy-dense feedstock for sustainable aviation fuel (SAF) and other biofuels. This study evaluated two TX430 OS lines (TxHO-2, TxHO-3) and two Ramada OS lines (RmHO-1, RmHO-2) alongside wild-type (WT) lines in NE and IL over 2 years (2023–2024) to quantify genotype × environment effects on agronomic performance and TAG accumulation. Across four environments, TX430 OS lines showed average TAG concentrations of 15.0 g kg−1 in leaves and 12.8 g kg−1 in stems, approximately 19-fold higher than WT. Ramada OS lines accumulated 26.1 g kg−1 in leaves and 12.3 g kg−1 in stems, approximately 25-fold and 13-fold increases over WT, respectively. OS lines in TX430 exhibited an 18% reduction in biomass (8.4 vs. 9.9 Mg ha−1 for WT), while Ramada OS lines had similar WT biomass (18.3 vs. 19.9 Mg ha−1 for WT). Among TX430 OS lines, TxHO-2 achieved the highest TAG yield (190 kg ha−1), while RmHO-1 led the Ramada lines (335 kg ha−1) due to higher biomass and similar TAG concentration. Enhanced TAG accumulation increased N, P, and K removal in TX430 lines but not in Ramada lines. Structural carbohydrate and ash concentration were unaffected. Overall, results confirm vegetative lipid accumulation as a viable strategy for high-biomass sorghum, supporting its potential as a dual-purpose feedstock for SAF. Future work should focus on minimizing biomass yield penalties and improving nutrient use efficiency in oil sorghum systems.

Agronomy↗
DOE OSTI2026

Data for Clumping Index Estimation With 30°-tilted Cameras in Row Crops: Evaluation of Methods and Segment Size Effects

The clumping index (CI) quantifies the spatial distribution of foliage elements and is essential for accurately estimating the plant area index (PAI), canopy radiative transfer, and photosynthesis. Traditionally, the finite-length averaging method (LX), the gap size distribution method (CC), and a combined approach of CC and LX (CLX) have been applied to instruments like TRAC and digital hemispherical photography to estimate CI. However, a comprehensive evaluation of these methods in row crops remains limited, especially regarding the influence of segment size on CI. Meanwhile, digital cameras offer a cost-effective and user-friendly solution for canopy measurements in row crops, yet their application in this context remains underexplored. In this study, we employed a new approach using a 30°-tilted digital camera to estimate CI in corn and soybean fields, applying the LX, CC, and CLX methods. We systematically assessed the performance of these three methods by combining field measurements in real-world fields with simulations using the LESS 3D radiative transfer model. Our results showed that CLX applied to the whole image and 45° segment offered accurate estimation of CI (bias within ±0.1, RMSE < 0.2) and PAI (bias within ±0.4, RMSE < 1) in real-world fields and LESS simulations. The accuracy of the LX method was highly sensitive to segment size, with the best performance observed at the 15° segment (PAI bias within ±0.4). In contrast, the CC method remained stable across different segment sizes, and its performance was generally comparable to that of LX, except at the 15° segment. Across view zenith angles, CI derived from CC generally showed a continuous increase, while those from LX and CLX followed a rising trend at small zenith angles but began to decline at 68°, likely due to an increasing proportion of no-gap segments. Seasonally, LX tended to show decreasing CI during early growth stages but increased as the canopy matured, whereas CC and CLX showed gradually increasing CI before plateauing at peak PAI. The 30°-tilted camera effectively captured CI variations across different angles and growth stages, making it a practical and robust instrument for row crop canopy structure analysis. Applying these CI methods to digital cameras offers a low-cost and accessible CI estimation alternative, improving canopy structure monitoring accuracy in row crops.

Modeling↗
DOE OSTI2026

Evaluation of accuracy and resolution of the electron beam profile scanner at the Fermilab Main Injector

The objective of this work is to assess the accuracy of measurements made by the Electron Beam Profile Scanner (EBPS), which captures the trajectory of an electron beam with and without a proton beam present. The proton beam induces deflection in the electron beam, which is influenced by proton charges.For high-resolution images, the probe beam needs to be of high intensity, small diameter, and small divergence, evaluated using a YAG screen and an optical transition radiation (OTR) screen. Additionally, the point spread function (PSF) will be calculated to characterize the optical system's properties using ZEMAX software. The capabilities of the Hamamatsu Charge-Injection Device (CID) camera and Kimball Physics electron gun (e-gun) will be considered for accuracy.

Mwaniki, Matilda [IIT, Chicago; Fermilab]↗
DOE OSTI2025

Evaluate data lake design for the accelerator control system

Increasing precision in automation for modern particle accelerators not only creates a requirement to gather data from all devices but also demands scalable and high-performance data infrastructure with the capability of handling vast incoming device data. A well architected data lake is suitable for such a system which integrates real-time data acquisition, transient data caching, and long-term storage. This paper evaluates data lake architecture for an Accelerator Control System (ACS), focusing on two critical components of a data lake, data cache and long-term storage.

Jaikar, Amol [Fermilab]↗
DOE OSTI2025

Evaluation of E3SM Simulated Aerosols and Aerosol‐Cloud Interactions Across GCM and Convection‐Permitting Scales

This paper introduces an Earth system modeling testbed for predicting aerosols and aerosol‐cloud interactions (ACIs) at convection‐permitting scales. Using the Energy Exascale Earth System Model (E3SM) version 2 with a four‐mode Modal Aerosol Module, we conduct simulations at 3.25 km resolution on a regionally refined mesh (RRM) across four regions with distinct aerosol and cloud regimes. Results are compared with the standard 100 km E3SM configuration and evaluated against satellite, aircraft, and ground‐based observations. We find that increasing model resolution improves heavy precipitation simulation but amplifies positive bias in light drizzle at coarse resolution. These resolution‐induced changes affect cloud and aerosol properties to varying degrees across regions. Generally, cloud cover and liquid water path (LWP) show better agreement with satellite retrievals at 3.25 km, though surface‐based comparisons suggest otherwise. Aerosol composition remains poorly represented at both resolutions. The RRM increases Aitken mode aerosol number concentrations via enhanced new particle formation. However, accumulation mode aerosols are decreased at higher resolution as aerosol removals become more efficient. This partially contributes to fewer cloud condensation nuclei (CCN) and lower cloud droplet number concentrations (N d ), which produces larger model biases in some scenarios. These findings suggest that solely increasing horizontal resolution to kilometer scales is insufficient to broadly improve aerosol and cloud predictions without concurrent advancements in physical and chemical process representations. Nonetheless, the RRM moderately improves key ACI relationships such as CCN‐N d correlation, reflecting enhanced aerosol activation representation. The LWP‐N d relationship is also better captured by RRM, suggesting a better characterization of LWP adjustment.

Huang, Meng [Pacific Northwest National Laboratory↗
DOE OSTI2025

Evaluating Entrainment–Mixing Characteristics through Direct Comparisons of Drop Size Distributions Using In Situ Observations from ACE-ENA

Abstract Constraining the impacts of entrainment and associated mixing (i.e., entrainment–mixing) on cloud properties continues to be difficult, partly due to observational uncertainties as well as a lacking consensus of which methodologies for diagnosing entrainment–mixing are most appropriate. This study introduces a novel method to evaluate the presence and degree of inhomogeneous and homogeneous mixing using ∼100 h of in situ observations from a research aircraft over the northeastern Atlantic. Specifically, drop size distributions are compared between regions containing negligible and significant entrainment for select flight legs, making a direct characterization of the degree of homogeneous and inhomogeneous mixing possible. A measure of drop concentration variance is used as a proxy variable to diagnose entrainment–mixing. Results correspond well with entrainment–mixing metrics, showing lower Damköhler numbers where drop size distributions shift toward smaller drop sizes (i.e., inhomogeneous mixing) and greater transition length scales where drop size distributions do not (i.e., homogeneous mixing). Inhomogeneous mixing occurs in most samples from Aerosol and Cloud Experiment in the Eastern North Atlantic (ACE-ENA) (regardless of homogeneous mixing frequencies increasing with increasing spatial resolution from ∼100 to ∼10 m) and is associated with decreased drop size relative dispersion and both greater aerosol and drop concentrations compared with homogeneous mixing. Precipitating clouds have a greater frequency of homogeneous mixing compared with nonprecipitating clouds. The proposed methodology is similarly applied to in situ observations of southeast Pacific stratocumulus, shallow convective clouds over central Oklahoma and low-level clouds over the Southern Ocean. All four locations are primarily dominated by inhomogeneous mixing with minimal variability among each region.

Clouds↗
DOE OSTI2025

Evaluations for medium- and high-mass nuclei for FUSION applications

There is a renewed attention to nuclear fusion as a commercial source of carbon-free energy, however there are many scientific needs that must be addressed to enable the future success of fusion as an economical energy option. Among these is the proper description of the impact of radiation produced in the fusion vessel chamber and all other components of the reactor. In this work we will focus on the nuclear data needs to describe the interaction between primary and secondary neutron radiation and the medium- and high-mass nuclei commonly present in structural (such as stainless steel) and superconducting (e.g., electromagnets) materials.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Freeze It or Leave It? Evaluating the Role of Cryo-Electron Microscopy in Battery Research

Cryogenic electron microscopy (cryo-EM) continues to gain prominence in materials science, particularly in battery research where it has enabled high-resolution, multimodal characterization of electrode materials and interfaces that otherwise degrade quickly under electron beam irradiation. But as anyone who has attempted cryo-EM techniques knows, freezing comes at a cost; cryo-EM experiments are time-consuming, highly sensitive, and carry an increased risk of artifacts due to issues such as frost contamination. Thus, when planning new characterization of battery materials or other beam-sensitive samples, it is critical to consider whether (and which) cryo-EM techniques are appropriate, based on study goals and an understanding of electron beam-sample interactions. Here we review such considerations for battery materials to elucidate the questions of when, why, and how to freeze to achieve high-quality characterization.

25 ENERGY STORAGE↗
DOE OSTI2025

Consistent $\overline{ν}$ evaluation for minor U isotopes with $\tt{CGMF}$

Following several successful prompt $\overline{ν}$ evaluations using $\tt{CGMF}$, including consistent evaluations for minor Pu isotopes, we detail in this report our efforts to perform a consistent $\overline{ν}$ evaluation for minor U isotopes during FY25. Although we have not yet produced a finalized evaluation, we present the progress that we have made towards such an evaluation for 232,233,234,236,237,239 U prompt $\overline{ν}$. Our milestone explicitly calls out evaluations for 233 U, 234 U, and 236 U, however, to better constrain the model with reliable experimental $\overline{ν}$ data, we also include 235 U and 238 U in the evaluation procedure. Then, we additionally produce evaluations for 232 U, 237 U and 239 U $\overline{ν}$ as a byproduct. Elsewhere, we will report our efforts on a stand-alone 233 U $\overline{ν}$ evaluation. This report is organized in the following manner. In Sec. 2, we briefly outline the updates to CGMF that were needed to be able to calculate all of these minor U fission reactions. The experimental data overview is given in Sec. 3. The evaluation methodology and results are presented in Secs. 4 and 5, respectively. Finally, we conclude and outline work for FY26 in Sec. 6.

07 ISOTOPE AND RADIATION SOURCES↗