Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Short-Term Load Forecasting Considering EV Charging Loads with Prediction Interval Evaluation

Short-term load forecasting plays a critical role in power system planning and operation. Along with the electrification of various loads, electricity demands are becoming increasingly hard to predict. Notably, the recent rise in electric vehicles (EVs) has further contributed to this unpredictability. To address this issue, this paper proposes a probabilistic load forecasting strategy utilizing Gaussian process regression, structured in a day-ahead manner. While many works focus on deterministic prediction, probabilistic forecasting offers additional insights into variability and uncertainty, enabling more flexible and reliable operation for power systems. To enhance the accuracy of the load forecasting model, the inputs include features related to EV charging habits as well as commonly used weather information. The load forecasting results are evaluated using various metrics, including conventional ones that assess the accuracy of point forecasts, as well as additional metrics that test the reliability of prediction intervals. The proposed load forecasting method is finally tested on real residential power consumption data and EV charging data sampled from real-world sources. The results prove that the new features can greatly improve the performance of the load forecasting method.

electrical vehicle↗
DOE OSTI2025

Performance Evaluation of Vertical Federated Machine Learning Against Adversarial Threats on Wide-Area Control System: Preprint

Federated machine learning (FL) is gaining significant popularity to develop cybersecurity solutions in power grids because of its advanced capability to support decentralized data handing at local devices, its privacy preservation, and its low-bandwidth requirement. However, the evolving adversarial machine learning (AML) threats raise significant concerns for the cybersecurity of FL architectures. The FL-based split neural network (SplitNN) achieves high performance through the decentralized training of local neural network models while preserving data privacy across multiple entities. In this paper, we propose a methodology for evaluating the performance of a vertical FLbased anomaly detector against different types of AML attacks, including denial-of-service attacks, adversarial data injection attacks, and replay attacks on the trained local models deployed in the grid network. For a case study, we consider the modified IEEE 13-bus system, and we develop SplitNN-based binary and multiclass classification models to detect, locate, and identify different types of data integrity attacks on the volt-watt control with two pooling layers: maximum pooling and AvgPool. Our experimental results, computed through performance metrics, reveal that the severity of these AML attacks varies with the integrated pooling mechanism, the type of classification model, and the nature of the cyberattack. Further, the AML attacks negatively impacted the prediction time per sample for the pretrained SplitNN during the online testing.

adversarial threats↗
DOE OSTI2026

Data for Multisite Field Evaluation of Oil Accumulation and Agronomic Performance in Grain and Sweet Sorghums Engineered for Lipid Hyperaccumulation

Oil sorghum (OS) has been developed by engineering grain (TX430) and sweet (Ramada) genetic backgrounds to accumulate triacylglycerols (TAG) in vegetative tissues as an energy-dense feedstock for sustainable aviation fuel (SAF) and other biofuels. This study evaluated two TX430 OS lines (TxHO-2, TxHO-3) and two Ramada OS lines (RmHO-1, RmHO-2) alongside wild-type (WT) lines in NE and IL over 2 years (2023–2024) to quantify genotype × environment effects on agronomic performance and TAG accumulation. Across four environments, TX430 OS lines showed average TAG concentrations of 15.0 g kg−1 in leaves and 12.8 g kg−1 in stems, approximately 19-fold higher than WT. Ramada OS lines accumulated 26.1 g kg−1 in leaves and 12.3 g kg−1 in stems, approximately 25-fold and 13-fold increases over WT, respectively. OS lines in TX430 exhibited an 18% reduction in biomass (8.4 vs. 9.9 Mg ha−1 for WT), while Ramada OS lines had similar WT biomass (18.3 vs. 19.9 Mg ha−1 for WT). Among TX430 OS lines, TxHO-2 achieved the highest TAG yield (190 kg ha−1), while RmHO-1 led the Ramada lines (335 kg ha−1) due to higher biomass and similar TAG concentration. Enhanced TAG accumulation increased N, P, and K removal in TX430 lines but not in Ramada lines. Structural carbohydrate and ash concentration were unaffected. Overall, results confirm vegetative lipid accumulation as a viable strategy for high-biomass sorghum, supporting its potential as a dual-purpose feedstock for SAF. Future work should focus on minimizing biomass yield penalties and improving nutrient use efficiency in oil sorghum systems.

Agronomy↗
DOE OSTI2026

Data for Clumping Index Estimation With 30°-tilted Cameras in Row Crops: Evaluation of Methods and Segment Size Effects

The clumping index (CI) quantifies the spatial distribution of foliage elements and is essential for accurately estimating the plant area index (PAI), canopy radiative transfer, and photosynthesis. Traditionally, the finite-length averaging method (LX), the gap size distribution method (CC), and a combined approach of CC and LX (CLX) have been applied to instruments like TRAC and digital hemispherical photography to estimate CI. However, a comprehensive evaluation of these methods in row crops remains limited, especially regarding the influence of segment size on CI. Meanwhile, digital cameras offer a cost-effective and user-friendly solution for canopy measurements in row crops, yet their application in this context remains underexplored. In this study, we employed a new approach using a 30°-tilted digital camera to estimate CI in corn and soybean fields, applying the LX, CC, and CLX methods. We systematically assessed the performance of these three methods by combining field measurements in real-world fields with simulations using the LESS 3D radiative transfer model. Our results showed that CLX applied to the whole image and 45° segment offered accurate estimation of CI (bias within ±0.1, RMSE < 0.2) and PAI (bias within ±0.4, RMSE < 1) in real-world fields and LESS simulations. The accuracy of the LX method was highly sensitive to segment size, with the best performance observed at the 15° segment (PAI bias within ±0.4). In contrast, the CC method remained stable across different segment sizes, and its performance was generally comparable to that of LX, except at the 15° segment. Across view zenith angles, CI derived from CC generally showed a continuous increase, while those from LX and CLX followed a rising trend at small zenith angles but began to decline at 68°, likely due to an increasing proportion of no-gap segments. Seasonally, LX tended to show decreasing CI during early growth stages but increased as the canopy matured, whereas CC and CLX showed gradually increasing CI before plateauing at peak PAI. The 30°-tilted camera effectively captured CI variations across different angles and growth stages, making it a practical and robust instrument for row crop canopy structure analysis. Applying these CI methods to digital cameras offers a low-cost and accessible CI estimation alternative, improving canopy structure monitoring accuracy in row crops.

Modeling↗
DOE OSTI2026

Evaluation of accuracy and resolution of the electron beam profile scanner at the Fermilab Main Injector

The objective of this work is to assess the accuracy of measurements made by the Electron Beam Profile Scanner (EBPS), which captures the trajectory of an electron beam with and without a proton beam present. The proton beam induces deflection in the electron beam, which is influenced by proton charges.For high-resolution images, the probe beam needs to be of high intensity, small diameter, and small divergence, evaluated using a YAG screen and an optical transition radiation (OTR) screen. Additionally, the point spread function (PSF) will be calculated to characterize the optical system's properties using ZEMAX software. The capabilities of the Hamamatsu Charge-Injection Device (CID) camera and Kimball Physics electron gun (e-gun) will be considered for accuracy.

Mwaniki, Matilda [IIT, Chicago; Fermilab]↗
DOE OSTI2025

Evaluate data lake design for the accelerator control system

Increasing precision in automation for modern particle accelerators not only creates a requirement to gather data from all devices but also demands scalable and high-performance data infrastructure with the capability of handling vast incoming device data. A well architected data lake is suitable for such a system which integrates real-time data acquisition, transient data caching, and long-term storage. This paper evaluates data lake architecture for an Accelerator Control System (ACS), focusing on two critical components of a data lake, data cache and long-term storage.

Jaikar, Amol [Fermilab]↗
DOE OSTI2024

Status of the CERBERUS Evaluation for the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook

Modeling & Simulation (M&S) tools are used to analyze advanced reactor designs and the safety of current nuclear operations. As computers continue to improve, we are able to enhance resolution in our calculations. Therefore, the limitations of simulation capability are in the quality of data that is being used, including our ability to quantify the uncertainty and sensitivity of that data. In order to model systems of interest with increasing accuracy, the industry must improve key nuclear data measurements. The International Criticality Safety Benchmark Evaluation Project (ICSBEP) compiles and evaluates experiment data in a handbook that can be used by criticality safety engineers and others to validate computer codes and cross section libraries at nuclear facilities. Both critical and subcritical experiments are included in the handbook. These experiments, along with differential measurements, can help improve the quality of nuclear data. Concerns regarding the accuracy of Cu nuclear data have been published. The large values and trend of C-E for the Zeus intermediate energy benchmark, being one of the primary examples. Furthermore, very few experiments have been designed to be sensitive to Cu (as shown in Figure 1), so an integral, critical experiment is needed to help resolve these differences.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Evaluation of darunavir-derived HIV-1 protease inhibitors incorporating P2' amide-derivatives: Synthesis, biological evaluation and structural studies

Here, we report here the synthesis and biological evaluation of darunavir derived HIV-1 protease inhibitors and their functional effect on enzyme inhibition and antiviral activity in MT-2 cell lines. The P2' 4-amino functionality was modified to make a number of amide derivatives to interact with residues in the S2' subsite of the HIV-1 protease active site. Several compounds exhibited picomolar enzyme inhibitory and low nanomolar antiviral activity. The X-ray crystal structure of the chloroacetate derivative bound to HIV-1 protease was determined. Interestingly, the active chloroacetate group converted to the acetate functionality during X-ray exposure. The structure revealed that the P2' carboxamide functionality makes enhanced hydrogen bonding interactions with the backbone atoms in the S2'-subsite.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Evaluation of E3SM Simulated Aerosols and Aerosol‐Cloud Interactions Across GCM and Convection‐Permitting Scales

This paper introduces an Earth system modeling testbed for predicting aerosols and aerosol‐cloud interactions (ACIs) at convection‐permitting scales. Using the Energy Exascale Earth System Model (E3SM) version 2 with a four‐mode Modal Aerosol Module, we conduct simulations at 3.25 km resolution on a regionally refined mesh (RRM) across four regions with distinct aerosol and cloud regimes. Results are compared with the standard 100 km E3SM configuration and evaluated against satellite, aircraft, and ground‐based observations. We find that increasing model resolution improves heavy precipitation simulation but amplifies positive bias in light drizzle at coarse resolution. These resolution‐induced changes affect cloud and aerosol properties to varying degrees across regions. Generally, cloud cover and liquid water path (LWP) show better agreement with satellite retrievals at 3.25 km, though surface‐based comparisons suggest otherwise. Aerosol composition remains poorly represented at both resolutions. The RRM increases Aitken mode aerosol number concentrations via enhanced new particle formation. However, accumulation mode aerosols are decreased at higher resolution as aerosol removals become more efficient. This partially contributes to fewer cloud condensation nuclei (CCN) and lower cloud droplet number concentrations (N d ), which produces larger model biases in some scenarios. These findings suggest that solely increasing horizontal resolution to kilometer scales is insufficient to broadly improve aerosol and cloud predictions without concurrent advancements in physical and chemical process representations. Nonetheless, the RRM moderately improves key ACI relationships such as CCN‐N d correlation, reflecting enhanced aerosol activation representation. The LWP‐N d relationship is also better captured by RRM, suggesting a better characterization of LWP adjustment.

Huang, Meng [Pacific Northwest National Laboratory↗
DOE OSTI2025

Evaluating Entrainment–Mixing Characteristics through Direct Comparisons of Drop Size Distributions Using In Situ Observations from ACE-ENA

Abstract Constraining the impacts of entrainment and associated mixing (i.e., entrainment–mixing) on cloud properties continues to be difficult, partly due to observational uncertainties as well as a lacking consensus of which methodologies for diagnosing entrainment–mixing are most appropriate. This study introduces a novel method to evaluate the presence and degree of inhomogeneous and homogeneous mixing using ∼100 h of in situ observations from a research aircraft over the northeastern Atlantic. Specifically, drop size distributions are compared between regions containing negligible and significant entrainment for select flight legs, making a direct characterization of the degree of homogeneous and inhomogeneous mixing possible. A measure of drop concentration variance is used as a proxy variable to diagnose entrainment–mixing. Results correspond well with entrainment–mixing metrics, showing lower Damköhler numbers where drop size distributions shift toward smaller drop sizes (i.e., inhomogeneous mixing) and greater transition length scales where drop size distributions do not (i.e., homogeneous mixing). Inhomogeneous mixing occurs in most samples from Aerosol and Cloud Experiment in the Eastern North Atlantic (ACE-ENA) (regardless of homogeneous mixing frequencies increasing with increasing spatial resolution from ∼100 to ∼10 m) and is associated with decreased drop size relative dispersion and both greater aerosol and drop concentrations compared with homogeneous mixing. Precipitating clouds have a greater frequency of homogeneous mixing compared with nonprecipitating clouds. The proposed methodology is similarly applied to in situ observations of southeast Pacific stratocumulus, shallow convective clouds over central Oklahoma and low-level clouds over the Southern Ocean. All four locations are primarily dominated by inhomogeneous mixing with minimal variability among each region.

Clouds↗
DOE OSTI2024

SMART Task 6: Evaluation of the Costs of Geologic CO2 Storage for the Illinois Basin Decatur Project Site Using the NRAP/SMART Technoeconomic and Liability Evaluation for Storage (TALES) Model

This is a presentation featuring an analysis related to SMART Task 6 in which CO2 storage costs are presented. The National Energy Technology Laboratory has developed the NRAP/SMART Technoeconomic and Liability Evaluation for Storage (TALES) model to provide quantitative cost-based insights to support developers planning CO2 injection and storage projects. TALES calculates the revenues, costs, and financial performance of candidate CO2 saline storage project based on site-specific activity costs and financial parameters. TALES is being integrated as a module pertaining to storage cost as part of the broader SMART Visualization and Decision Support Platform (SVDSP). In this study, the TALES model was applied using real activity cost data associated with the development and operations at the Illinois Basin Decatur Project (IBDP) CO2 storage project site. Scenario analysis was implemented in which crucial operational and cost attributes were varied and the associated cost implications observed. Key results data and project cost summary metrics like first-year breakeven price of CO2 ($/tonne) and net present value (NPV) are presented in similar fashion to how they will appear in the SVDSP.

Vikara, Derek↗
DOE OSTI2022

Evaluating Grid Strength under Uncertain Renewable Generation

The increasing displacement of synchronous generators with renewable resources such as wind and solar via power electronic interfaces causes a reduction in short-circuit strength and weak grid issues. The variation and uncertainty of renewable energy increase challenges for identifying weak grid conditions. This paper proposes an efficient method to analyze the impact of uncertain renewable energy on grid strength. The proposed method uses the probabilistic collocation method (PCM) to approximate the results of grid strength assessment under uncertain renewable generation, in order to reduce computational burden without compromising result accuracy when compared with traditional Monte Carlo simulation (MCS). To improve the accuracy of the approximation results, the proposed method integrates the K-means clustering technique with PCM to select the approximation samples of input variables. The efficacy of the proposed method is demonstrated by comparison with MCS on the modified IEEE 9-bus system and modified IEEE 39-bus system with multiple renewable generators.

grid strength↗
DOE OSTI2023

Evaluation of HPK n + - p planar pixel sensors for the CMS Phase-2 upgrade

To cope with the challenging environment of the planned high luminosity upgrade of the Large Hadron Collider (HL-LHC), scheduled to start operation in 2029, CMS will replace its entire tracking system. The requirements for the tracker are largely determined by the long operation time of 10 years with an instantaneous peak luminosity of up to 7.5 × 10 34 cm –2 s –1 in the ultimate performance scenario. Depending on the radial distance from the interaction point, the silicon sensors will receive a particle fluence corresponding to a non-ionizing energy loss of up to $\Phi_{\text {eq}}$ = 3.5 × 10 16 cm –2 . Here this paper focuses on planar pixel sensor design and qualification up to a fluence of $\Phi_{\text {eq}}$ = 1.4 × 10 16 cm –2 . For the development of appropriate planar pixel sensors an R&D program was initiated, which includes $n^+ -p$ sensors on 150 mm (6”) wafers with an active thickness of 150 μm with pixel sizes of 100 × 25 μm 2 and 50 × 50 μm 2 manufactured by Hamamatsu. Single chip modules with ROC4Sens and RD53A readout chips were made. Irradiation with protons and neutrons, as well was an extensive test beam campaign at DESY were carried out. This paper presents the investigation of various assemblies mainly with ROC4Sens readout chips. It demonstrates that multiple designs fulfill the requirements in terms of breakdown voltage, leakage current and efficiency. The single point resolution for 50 × 50 μm 2 pixels is measured as 4.0 μm for non-irradiated samples, and 6.3 μm after irradiation to $\Phi_{\text {eq}}$ = 7.2 × 10 15 cm –2 .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

A Spectroscopic and Computational Evaluation of Uranyl Oxo Engagement with Transition Metal Cations

Here, we report the synthesis and characterization of five novel Cd 2+ /UO 2 2+ heterometallic complexes that feature Cd-oxo distances ranging from 78 to 171% of the sum of the van der Waals radii for these atoms. This work marks an extension of our previously reported Pb 2+ /UO 2 2+ and Ag + /UO 2 2+ complexes, yet with much more pronounced structural and spectroscopic effects resulting from Cd-oxo interactions. We observe a major shift in the U═O symmetric stretch and significant uranyl bond length asymmetry. The ρbcp values calculated using Quantum Theory of Atoms in Molecules (QTAIM) support the asymmetry displayed in the structural data and indicate a decrease in covalent character in U═O bonds with close Cd-oxo contacts, more so than in related compounds containing Pb 2+ and Ag + . Second-order perturbation theory (SOPT) analysis reveals that O sp x → Cd s is the most significant orbital overlap and U═O bonding and antibonding orbitals also contribute to the interaction (U═O σ/π → Cd d and Cd s → U═O σ/π*). The overall stabilization energies for these interactions were lower than those in previously reported Pb 2+ cations, yet larger than related Ag + compounds. Analysis of the equatorial coordination sphere of the Cd 2+ /UO 2 2+ compounds (along with Pb 2+ /UO 2 2+ complexes) reveals that 7-coordinate uranium favors closer, stronger M n+ -oxo contacts. These results indicate that U═O bond strength tuning is possible with judicious choice of metal cations for oxo interactions and equatorial ligand coordination.

cations↗