Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,567 records · Page 87
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Validating Protection System Behavior with Machine Learning in a Master State Overseer

As power system protection devices continue the widespread transition from analog to digital, they become increasingly intricate. The internal functions and communication between critical grid components must now be significantly more complex to keep up with the demands of the modern smart grid. This brings increased difficulty in maintenance and monitoring, making it harder to identify potential misoperation, power anomalies, and cyber threats. Such issues are often only pinpointed after an exhaustive and costly post-mortem analysis, when a major outage or damage has already occurred. A solution is needed for validating protection systems as they operate, independently evaluating grid state and confirming whether the protection system is behaving accordingly. As opposed to incident response, this acts as a constant verification mechanism that raises a flag when subtler issues are noticed, catching them earlier and preventing larger incidents. This work presents the implementation of such a system, expanding on the prototype developed by the authors in a previous paper. This is accomplished with a machine learning (ML) system capable of validating the performance of protection systems by classifying anomalous events and characterizing protection system responses based solely on available current and voltage measurements. Additionally, this system is contextualized within a larger, modular Master State awareness Overseer (MSO) framework, responsible for monitoring, analyzing, and managing an electric grid.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

CoLoRe-2LPT: Lyman-$α$ mock catalogues for the validation of DESI cosmological analyses

The Lyman-$α$ (Ly$α$) forest has become a crucial probe for studying the large-scale structure of the universe at high redshift ($z > 2$), providing powerful constraints on Baryon Acoustic Oscillations (BAO) and the full-shape (FS) clustering of matter. As a key ingredient for upcoming BAO and FS analyses, we present a new generation of fast cosmological Ly$α$ mocks based on second-order Lagrangian perturbation theory (2LPT). These new mocks significantly improve upon previous log-normal approaches, both at accurately capturing small scale clustering and at recovering the non-linear broadening of the BAO peak. They are able to reproduce Ly$α$ statistics within $10\%$ of the latest DESI measurement; including the Ly$α$ bias and the redshift-space distortion $β$ parameter, mean transmitted flux, and 1D power spectrum. The corresponding quasar (QSO) clustering is also improved with respect to previous approaches, calibrated against high-resolution Abacus simulations, recovering the observational QSO linear bias to less than $5\%$ and improving redshift-space distortions via 2LPT velocities and the addition of Fingers-of-God effects. Furthermore, these mocks incorporate high column density systems and metal lines, allowing us to explore the effects and systematics induced by these astrophysical contaminants. This new set of mocks has been key for enhancing the modeling and validation of the DESI DR2 Ly$α$ full shape cosmological analysis. This work provides a physically motivated and computationally efficient tool for simulating current and next-generation Ly$α$ surveys and validating FS and BAO analysis.

Bernal, M.F. Ruiz-Herrera [Madrid, CIEMAT] (ORCID:↗
DOE OSTI2026

Validating a Dynamic PWR Safety and Security Model?

Nuclear power plants (NPPs) are assessed for safety and security using separate models that cannot capture how an attacker's decisions and a plant's response unfold together in real time, leaving regulators and operators without a complete picture of true plant vulnerability. Traditional probabilistic risk assessment (PRA) methods treat adversarial events as fixed initiators with predetermined outcomes, and are structurally incapable of representing the time-dependent interplay between physical security events, safety system response, and operator mitigative actions. At Idaho National Laboratory (INL), I contributed to the development and validation of Modeling and Analysis for Safety and Security using the Dynamic EMRALD Framework (MASS-DEF). Where static PRA relies on event-tree logic that cannot evolve mid-scenario, MASS-DEF couples a time-dependent dynamic PRA tool EMRALD (Event Modeling Risk Assessment using Linked Diagrams) with attack simulation software, allowing attacker behavior, plant system states, and operator actions to interact across time. My work focused on validating a general Pressurized Water Reactor (PWR) model. I traced model logic against PWR plant to identified errors in logic and confirm accuracy. I then built and tested attack scenarios against a general PWR model to verify that the model produced expected outcomes across all logical pathways. I also contributed a section to a related technical paper applying the same EMRALD platform to radiation dose modeling. Results show that MASS-DEF can quantitatively demonstrate that many plants exceed their regulatory security thresholds. This demonstrated margin provides a technically defensible basis for reducing the number of guards without compromising regulatory compliance. Physical security costs represent roughly 10% of annual operating budgets, making such reductions directly meaningful to INL's mission of sustaining existing commercial NPPs. This internship strengthened my understanding of nuclear systems, probabilistic modeling, and technical writing, and has solidified my pursuit of a career at a national laboratory.

98 - NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL↗
DOE OSTI2022

Data Validation for Hosting Capacity Analyses [Slides]

The National Renewable Energy Laboratory (NREL), in partnership with the Interstate Renewable Energy Council (IREC), has recently released a report which identifies a suite of best practices for producing trusted, validated hosting capacity analysis results reflecting real-world grid conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Leveraging a Southern California Energy Innovation Cluster to Pilot and Validate Emerging Energy Technologies

The EPIC Pilot Program, led by the Los Angeles Cleantech Incubator (LACI), was designed to help early-stage clean technology startups accelerate technical validation, investment readiness, and market entry. The project focused on supporting startups in designing and deploying small-scale pilots with the guidance of EPIC Partners, a network of regional stakeholders in the Southern California energy ecosystem, including but not limited to: the Los Angeles Department of Water and Power (LADWP), the California Energy Commission (CEC), Los Angeles County Metropolitan Transportation Authority (LA Metro), and Edison International, among others. Through mentorship, funding, and site access for technology deployments, the program provided a structured pathway for startups to test and refine their technologies in real-world settings.

14 SOLAR ENERGY↗
DOE OSTI2020

Validation of (not-historical) large-event near-fault ground-motion simulations for use in civil engineering applications

Ground-motion simulations generated from physics-based wave propagation models are gaining increasing interest in the engineering community for their potential to inform the performance-based design and assessment of infrastructure residing in active seismic areas. A key prerequisite before the ground-motion simulations can be used with confidence for application in engineering domains is their comprehensive and rigorous investigation and validation. This article provides a four-step methodology and acceptance criteria to assess the reliability of simulated ground motions of not historical events, which includes (1) the selection of a population of real records consistent with the simulated scenarios, (2) the comparison of the distribution of Intensity Measures (IMs) from the simulated records, real records, and Ground-Motion Prediction Equations (GMPEs), (3) the comparison of the distribution of simple proxies for building response, and (4) the comparison of the distribution of Engineering Demand Parameters (EDPs) for a realistic model of a structure. Specific focus is laid on near-field ground motions (<10km) from large earthquakes (M w 7), for which the database of real records for potential use in engineering applications is severely limited. The methodology is demonstrated through comparison of (2490) near-field synthetic records with 5 Hz resolution generated from the Pitarka et al (2019) kinematic rupture model with a population of (38) pulse-like near-field real records from multiple events and, when applicable, with NGA-W2 GMPEs. Lastly, the proposed procedure provides an effective method for informing and advancing the science needed to generate realistic ground-motion simulations, and for building confidence in their use in engineering domains.

42 ENGINEERING↗
DOE OSTI2021

Progress on the reevaluation and validation of the n+233U neutron cross sections

The set of 233 U resonance parameters of the ENDF/B-VIII.0 nuclear data library was adopted from the previous ENDF/B-VII.1 evaluation using the external levels to update the thermal values. Adoption of IAEA 2017 thermal standards ( &#x3C3; f = 533.0 &#xB1; 2.2 b, &#x3C3; c = 44.9 &#xB1; 0.9 b, and &#x3BD; &#x203E; tot = 2.487 &#xB1; 0.011 ) and of the IAEA-recommended thermal-neutron induced prompt fission neutron spectrum (PFNS) with average PFNS energy of 2.030 &#xB1; 0.013 MeV requires a re-evaluation of 233 U neutron cross sections in the resolved resonance region. A newly produced evaluation is being tested on benchmarks carefully selected from the Handbook of International Criticality Safety Benchmark Experiments (ICSBEP) which are highly sensitive to 233 U data. An important goal of this work was to eliminate the strong negative gradient of the calculated effective multiplication factors with respect to the epithermal fission fraction observed in the validation of the ENDF/B-VIII.0 library for those assemblies. A significant improvement in integral performance of critical 233 U solutions is observed for the newly proposed evaluation. Further work addressing the fast neutron region is needed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

A novel shallow bore ground heat exchanger for ground source heat pump applications—Model development and validation

A novel ground heat exchanger design, the Underground Thermal Battery (UTB), was proposed as a low-cost alternative to the conventional vertical bore ground heat exchanger (VBGHE) for the application of ground source heat pumps (GSHPs). The UTB is designed to be installed in a shallow borehole (less than 6 m deep) and thus could cost much less than the conventional VBGHE, which usually is installed in vertical bores 60 m deep. By utilizing natural convection of water and phase change materials, the UTB tempers its temperature change in response to thermal loads, which helps improve the efficiency of GSHPs. A one-dimensional (1D) model of the UTB has been developed and validated with the measured performance data of a small-scale UTB, as well as the simulation results of a more detailed three dimensional (3D) numerical model, which accounts for both heat transfer and fluid dynamics in the UTB. Further, this 1D model is computationally much more efficient than the 3D model and thus can simulate the annual performance of the UTB with acceptable computation time. The 1D model has been used to evaluate the performance of the UTB so that it can be compared with the conventional VBGHE.

42 ENGINEERING↗
DOE OSTI2022

Multi-scale and multi-physics analysis, design optimization, and experimental validation of heat exchangers utilizing high performance, non-round tubes

Air-to-refrigerant heat exchangers (HXs) are fundamental components in HVAC&R systems, and considerable research has been dedicated designing continually smaller, lighter, and more efficient HX designs. In recent years, researchers have leveraged advancements in Computational Fluid Dynamics (CFD), Finite Element Analysis (FEA), and optimization algorithms to consider primary tube shape and topology optimization to design highly compact, high performance HXs for a multitude of applications. In this research, we present a computationally efficient, comprehensive, multi-scale, and multi-physics analysis and optimization method for air-to-refrigerant HXs featuring automated CFD and FEA simulations and approximation-assisted optimization. This methodology was utilized to design HXs with shape-optimized, non-round tubes which outperform current state-of-the-art tube-fin HXs without compromising structural integrity. The optimal HXs were shown to deliver similar thermal performance to the baseline HXs while also achieving more than 20% reductions in airside pressure drop and core envelope volume and more than 30% reduction in internal volume. Comprehensive experimental validation of the optimization methodology was conducted through the testing of two prototypes in a standardized wind tunnel facility under multiple operating conditions. For prototype #1 under dry evaporator conditions, the predicted heat load agreed within ± 10% of measured values and the predicted airside pressure drop agreed within ± 30%, while for dehumidifying conditions, the predicted sensible and latent heat loads agreed within ± 10% and ± 20% of the measured values, respectively. For prototype #2, the predicted condenser heat load agreed within ± 3.0% of measured values, and the predicted airside pressure drop agreed within ± 27%. The acceptable agreement between simulation and experimental results for the present application highlights the flexibility of the novel optimization methodology to design next generation HXs with improved performance and reduced volume, weight, and environmental impact.

42 ENGINEERING↗
DOE OSTI2024

Validation of NSFsim as a Grad-Shafranov equilibrium solver at DIII-D

Plasma shape is a significant factor that must be considered for any Fusion Pilot Plant (FPP) as it has significant consequences for plasma stability and core confinement. A new simulator, NSFsim, has been developed based on a historically successful code, DINA [1], offering tools to simulate both transport and plasma shape. Specifically, NSFsim is a free boundary equilibrium and transport solver and has been configured to match the properties of the DIII-D tokamak. This paper is focused on validating the Grad-Shafranov (GS) solver of NSFsim by analyzing its ability to recreate the plasma shape, the poloidal flux distribution, and the measurements of the simulated diagnostic signals originating from flux loops and magnetic probes in DIII-D. Five different plasma shapes are simulated to show the robustness of NSFsim to different plasma conditions; these shapes are Lower Single Null (LSN), Upper Single Null (USN), Double Null (DN), Inner Wall Limited (IWL), and Negative Triangularity (NT). The NSFsim results are compared against real measured signals, magnetic profile fits from EFIT [2], and another plasma equilibrium simulator, GSevolve [3]. EFIT reconstructions of shots are readily available at DIII-D, but GSevolve was manually ran by us to provide simulation data to compare against.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

A method for bounding high-order finite element functions: Applications to mesh validity and bounds-preserving limiters

We introduce a novel method for bounding high-order multi-dimensional polynomials in finite element approximations. The method involves precomputing optimal piecewise-linear bounding boxes for polynomial basis functions, which can then be used to locally bound any combination of these basis functions. This approach can be applied to any element/basis type at any approximation order, can provide local (i.e., subcell) extremum bounds to a desired level of accuracy, and can be evaluated efficiently on-the-fly in simulations. Furthermore, we show that this approach generally yields more accurate bounds in comparison to traditional methods based on convex hull properties (e.g., Bernstein polynomials). Furthermore, the efficacy of this technique is shown in applications such as mesh validity checks and optimization for high-order curved meshes, where positivity of the element Jacobian determinant can be ensured throughout the entire element, and continuously bounds-preserving limiters for hyperbolic systems, which can enforce maximum principle bounds across the entire solution polynomial.

Bounding box↗
DOE OSTI2022

Thermal-shock experiments for separate-effects validation of UO 2 fuel fracture models

Because of the important role that fracture plays in the behavior of ceramic UO2 fuel in a nuclear reactor environment, fracture models are a major component of fuel performance codes. As with any aspect of fuel performance, it is crucial to validate these fracture models against experimental data; however, obtaining well-controlled data for conditions representative of a reactor environment is difficult. Quenching is proposed here as a relatively simple approach for using a laboratory environment to achieve conditions that approximate those of a reactor environment. In this paper, an experimental apparatus containing a single instrumented fuel pellet in a sealed section of copper tubing is developed. It is then applied to a series of seven experiments in which the apparatus is first heated to a high temperature (580-680°C) by immersion in a molten salt bath, then quenched in a cold bath (-10-4 °C). Development of these experiments was guided by numerical simulations, and post-test simulations were performed to aid in understanding the experimental behavior and assessing the accuracy of the predictions of fracture initiation and propagation. In addition, similar experiments were performed on solid copper rods to provide temperature-dependent heat transfer coefficients for use in simulations of these experiments. Here, this study demonstrates that quenching is a viable approach for generating thermal gradients representative of those in prototypical light-water reactor conditions at powers of about 5–10 kW/m. Fracture is expected to begin at these power levels, and moderate amounts of radial and axial cracking was observed in these quenching tests.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Scalable phononic metamaterials: Tunable bandgap design and multi-scale experimental validation

Phononic metamaterials offer unprecedented control over wave propagation, making them essential for applications such as vibration isolation, waveguiding, and acoustic filtering. However, achieving scalable and precisely tunable bandgap properties across different length scales remains challenging. This study presents a user-friendly design framework for phononic metamaterials, enabling ultra-wide bandgap tunability (B/ω c ratios up to 172 %) across multiple frequency ranges and scales. Using finite element simulations of a Yablonovite-inspired unit cell, we establish a comprehensive parametric design space that illustrates how geometric parameters, such as sphere size and beam diameter, controls bandgap width and frequency. The scalability and robustness of the framework are validated through experimental testing on additively manufactured structures at both macro (10 mm) and micro (80 µm) scales, fabricated using Stereolithography and Two-Photon Polymerization. Transmission loss measurements, conducted with piezoelectric transducers and laser vibrometry, closely match simulations in the kHz and MHz frequency ranges, confirming the reliability and consistency of the bandgap behavior across scales. This work bridges theory and experiments at multiple scales, offering a practical methodology for the rapid design of phononic metamaterials and expanding their potential for diverse applications across a broad range of frequencies.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Validation of the two-region Rossi-alpha model for reflected assemblies

Nuclear criticality safety, nonproliferation and safeguards, emergency response, and stockpile stewardship utilize estimates of the k eff multiplication factor. The value of k eff cannot be directly measured, but it can be inferred from the prompt neutron period. One modality of measuring the prompt neutron period is the Rossi-alpha method, which is predicated on fitting a histogram of detection time differences due to the nonrandom temporal distribution of same-fission-chain neutrons. Recent works have developed the motivation and theory to expand traditional one-region point kinetic models resulting in one-exponential histogram fits to two-region models that result in two-exponential fits. This paper validates the new two-region model using organic scintillator measurements of copper-reflected weapons-grade plutonium (0:83 ≤ k eff ≤ 0:94) and high-density- polyethylene-reflected highly enriched uranium (0:73 ≤ k eff ≤ 0:95). Furthermore, the results show that more thermal systems have shorter prompt neutron periods in the core region due to increased induced-fission probabilities for moderated neutrons. Here, a new parameter introduced by the two- region model is also shown to be correlated to the amount of reflection, and may be used to infer assembly properties such as type and amount of reflector.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

A comparison of model validation approaches for echo state networks using climate model replicates

As global temperatures continue to rise, climate mitigation strategies such as stratospheric aerosol injections (SAI) are increasingly discussed, but the downstream effects of these strategies are not well understood. As such, there is interest in developing statistical methods to quantify the evolution of climate variable relationships during the time period surrounding an SAI. Feature importance applied to echo state network (ESN) models has been proposed as a way to understand the effects of SAI using a data-driven model. This approach depends on the ESN fitting the data well. If not, the feature importance may place importance on features that are not representative of the underlying relationships. Typically, time series prediction models such as ESNs are assessed using out-of-sample performance metrics that divide the times series into separate training and testing sets. However, this model assessment approach is geared towards forecasting applications and not scenarios such as the motivating SAI example where the objective is using a data driven model to capture variable relationships. Here, in this paper, we demonstrate a novel use of climate model replicates to investigate the applicability of the commonly used repeated hold-out model assessment approach for the SAI application. Simulations of an SAI are generated using a simplified climate model, and different initialization conditions are used to provide independent training and testing sets containing the same SAI event. The climate model replicates enable out-of-sample measures of model performance, which are compared to the single time series hold-out validation approach. For our case study, it is found that the repeated hold-out sample performance is comparable, but conservative, to the replicate out-of-sample performance when the training set contains enough time after the aerosol injection.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Validation of Continuous-Energy ENDF/B-VIII.0 16 O, 56 Fe, and 63,65 Cu Cross Sections for Nuclear Criticality Safety Applications

Recently completed cross-section evaluations sponsored in part by the Nuclear Criticality Safety Program were incorporated into the 2018 release of the ENDF/B-VIII.0 cross-section library. Evaluated isotopes of interest to the nuclear data and criticality safety community include 16 O, 56 Fe, and 63,65 Cu. For performance validation, benchmark models defined in the International Criticality Safety Benchmark Evaluation Project Handbook were selected based on energy-integrated k eff sensitivities to total cross sections of interest and compared with experimental values. Of the 102 benchmark configurations that were utilized, 63 are sensitive to 16 O, 32 sensitive to 63,65 Cu, and 25 sensitive to 56 Fe. Selected benchmarks were modeled in SCALE 6.2.3 Criticality Safety Analysis Sequence (CSAS) continuous-energy Monte Carlo k eff calculations with ENDF/B-VII.1, with a hybrid ENDF/B-VII.1 with ENDF/B-VIII.0 data substituted for individual isotopes of interest, and with ENDF/B-VIII.0. ENDF/B-VIII.0 showed improved agreement with experimental k eff for 56 Fe, 63 Cu, elemental copper, and full library substitution while producing lessened agreement for 16 O and 65 Cu. Furthermore, with full library and isotope-specific ENDF/B-VIII.0 performance, a best-case ENDF library was formed by excluding underperforming isotopes’ ENDF/B-VIII.0 data, reverting 16 O and 65 Cu cross sections to ENDF/B-VII.1. This resulted in the average relative deviation between calculated and experimental data improving from 1.45σ for the ENDF/B-VIII.0 library to 1.32σ for the best-case library, relative to benchmark uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Validation of IMEP on Alcator C-Mod and JET-ILW ELMy H-mode plasmas

Abstract The recently developed integrated model based on engineering parameters (IMEP) (Luda et al 2020 Nucl. Fusion 61 126048; Luda et al 2021 Nucl. Fusion 60 036023), so far validated on ASDEX Upgrade, has been tested on a database of 3 Alcator C-Mod and 55 JET-ILW ELMy (type I) H-mode stationary phases. The empirical pedestal transport model included in IMEP, consisting now of imposing a fixed value of R < ∇ T e > / T e , t o p = − 82.5 , allows an accurate prediction of the pedestal top temperature (when the pedestal top density is fixed to the experimental measurements) across these three machines with different sizes, when the pedestal is peeling–ballooning (PB) limited. Cases far from the ideal PB boundary, corresponding to high edge Spitzer resistivity, are instead strongly overpredicted by IMEP. A comparison between the predictions of Europed and IMEP for a subset of JET-ILW cases shows that IMEP can more accurately reproduce the experimental pedestal width. This allows IMEP to better capture profile effects on the pedestal stability, and therefore to correctly describe the negative effect of fueling on the pedestal pressure for PB limited cases. A strong correlation between the separatrix density and the fueling rate has been identified for a subset of JET-ILW cases, when taking into account different divertor configurations. Overall, these promising results encourage further developments of integrated models to obtain reliable predictions of pedestal and global confinement using only engineering parameters for present and future machines.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗