Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

An Experimental and Computational Investigation of Oscillating Airfoil Unsteady Aerodynamics at Large Mean Incidence

A major challenge in the design and development of turbomachine airfoils for gas turbine engines is high cycle fatigue failures due to flutter and aerodynamically induced forced vibrations. In order to predict the aeroelastic response of gas turbine airfoils early in the design phase, accurate unsteady aerodynamic models are required. However, accurate predictions of flutter and forced vibration stress at all operating conditions have remained elusive. The overall objectives of this research program are to develop a transition model suitable for unsteady separated flow and quantify the effects of transition on airfoil steady and unsteady aerodynamics for attached and separated flow using this model. Furthermore, the capability of current state-of-the-art unsteady aerodynamic models to predict the oscillating airfoil response of compressor airfoils over a range of realistic reduced frequencies, Mach numbers, and loading levels will be evaluated through correlation with benchmark data. This comprehensive evaluation will assess the assumptions used in unsteady aerodynamic models. The results of this evaluation can be used to direct improvement of current models and the development of future models. The transition modeling effort will also make strides in improving predictions of steady flow performance of fan and compressor blades at off-design conditions. This report summarizes the progress and results obtained in the first year of this program. These include: installation and verification of the operation of the parallel version of TURBO; the grid generation and initiation of steady flow simulations of the NASA/Pratt&Whitney airfoil at a Mach number of 0.5 and chordal incidence angles of 0 and 10 deg.; and the investigation of the prediction of laminar separation bubbles on a NACA 0012 airfoil.

Capece, Vincent R.↗
DOE OSTI2025

Benchmarking Operators in Deep Neural Networks for Improving Performance Portability of SYCL

SYCL is a portable programming model for heterogeneous computing, so it is important to obtain reasonable performance portability of SYCL. Towards the goal of better understanding and improving performance portability of SYCL for machine learning workloads, we have been developing benchmarks for basic operators in deep neural networks (DNNs). These operators could be offloaded to heterogeneous computing devices such as graphics processing units (GPUs) to speed up computation. In this paper, we introduce the benchmarks, evaluate the performance of the operators on GPU-based systems, and describe the causes of the performance gap between the SYCL and Compute Unified Device Architecture (CUDA) kernels. We find that the causes are related to the utilization of the texture cache for read-only data, optimization of the memory accesses with strength reduction, use of local memory, and register usage per thread. We hope that the efforts of developing benchmarks for studying performance portability will stimulate discussion and interactions within the community.

Jin, Zheming [ORNL] (ORCID:000000027197780X)↗
DOE OSTI2023

Review of multi-fidelity models

Multi-fidelity models provide a framework for integrating computational models of varying complexity, allowing for accurate predictions while optimizing computational resources. These models are especially beneficial when acquiring high-accuracy data is costly or computationally intensive. This review offers a comprehensive analysis of multi-fidelity models, focusing on their applications in scientific and engineering fields, particularly in optimization and uncertainty quantification. It classifies publications on multi-fidelity modeling according to several criteria, including application area, surrogate model selection, types of fidelity, combination methods and year of publication. The study investigates techniques for combining different fidelity levels, with an emphasis on multi-fidelity surrogate models. Here this work discusses reproducibility, open-sourcing methodologies and benchmarking procedures to promote transparency. The manuscript also includes educational toy problems to enhance understanding. Additionally, this paper outlines best practices for presenting multi-fidelity-related savings in a standardized, succinct and yet thorough manner. The review concludes by examining current trends in multi-fidelity modeling, including emerging techniques, recent advancements, and promising research directions.

42 ENGINEERING↗
DOE OSTI2024

Quapprox: A Framework for Benchmarking the Approximability of Variational Quantum Circuit

Most of the existing quantum neural network models, such as variational quantum circuits (VQCs), are limited in their ability to explore the non-linear relationships in input data. This gradually becomes the main obstacle for it to tackle realistic applications, such as natural language processing, medical image processing, and wireless communications. Recently, there have emerged research efforts that enable VQCs to perform non-linear operations. However, it is still unclear on the approximability of a given VQC (i.e., the order of non-linearity that can be handled by a specified design). In response to this issue, we developed an automated tool designed to benchmark the approximation of a given VQC. The proposed tool will generate a set of synthetic datasets with different orders of non-linearity and train the given VQC on these datasets to estimate their approximability. Our experiments benchmark VQCs with different designs, where we know their theoretic approximability. We then show that the proposed tool can precisely estimate the approximability, which is consistent with the theoretic value, indicating that the proposed tool can be used for benchmarking the approximability of a given quantum circuit for learning tasks.

artificial intelligence↗
DOE OSTI2022

When physics-informed data analytics outperforms black-box machine learning: A case study in thickness control for additive manufacturing

Aerosol jet printing (AJP) has emerged as a promising noncontact additive manufacturing method for high-resolution printing for a wide range of material systems. A key challenge limiting the broader adoption of AJP in the material science community is the lack of methods to precisely control thickness. Herein, we develop a model-based design of experiment (MBDoE) framework that integrates physics-informed models, nonlinear regression, and information criteria to postulate, select and calibrate the best model to describe and optimize the AJP manufacturing process. Starting with already available data from system commissioning (e.g., prior single variable sensitivity analysis), four candidate physics-informed models are postulated and trained. MBDoE identifies a single additional optimal experiment to validate these predictive models with quantified uncertainties, which are then used to determine the best experimental conditions to control printed film thickness. As a comparative benchmark, the analysis is repeated using the same dataset with nonparametric Gaussian process regression (GPR) model that does not incorporate physical information. Using MBDoE principles, we find that only five experiments are necessary to calibrate the nonlinear physics-informed parametric model, and with said limited data, this model outperforms the black-box machine learning GPR model. This key result underscores an emerging trend in the data science community: incorporating physical information into predictive models often drastically reduces the data requirements. Leveraging MBDoE further increased the data efficiency. By design, the proposed data science framework is general in nature and can be easily extended to other experimental and additive manufacturing systems beyond AJP.

Aerosol jet printing↗
NASA NTRS1985

Constitutive modeling for isotropic materials (HOST)

This report presents the results of the second year of work on a problem which is part of the NASA HOST Program. Its goals are: (1) to develop and validate unified constitutive models for isotropic materials, and (2) to demonstrate their usefulness for structural analyses of hot section components of gas turbine engines. The unified models selected for development and evaluation are that of Bodner-Partom and Walker. For model evaluation purposes, a large constitutive data base is generated for a B1900 + Hf alloy by performing uniaxial tensile, creep, cyclic, stress relation, and thermomechanical fatigue (TMF) tests as well as biaxial (tension/torsion) tests under proportional and nonproportional loading over a wide range of strain rates and temperatures. Systematic approaches for evaluating material constants from a small subset of the data base are developed. Correlations of the uniaxial and biaxial tests data with the theories of Bodner-Partom and Walker are performed to establish the accuracy, range of applicability, and integability of the models. Both models are implemented in the MARC finite element computer code and used for TMF analyses. Benchmark notch round experiments are conducted and the results compared with finite-element analyses using the MARC code and the Walker model.

Lindholm, U. S.↗
NASA NTRS2014

Three-Dimensional Cellular Structures Enhanced By Shape Memory Alloys

This research effort explored lightweight structural concepts married with advanced smart materials to achieve a wide variety of benefits in airframe and engine components. Lattice block structures were cast from an aerospace structural titanium alloy Ti-6Al-4V and a NiTi shape memory alloy (SMA), and preliminary properties have been measured. A finite element-based modeling approach that can rapidly and accurately capture the deformation response of lattice architectures was developed. The Ti-6-4 and SMA material behavior was calibrated via experimental tests of ligaments machined from the lattice. Benchmark testing of complete lattice structures verified the main aspects of the model as well as demonstrated the advantages of the lattice structure. Shape memory behavior of a sample machined from a lattice block was also demonstrated.

nitinol alloys↗
DOE OSTI2022

Machine Learning Moment Closure Models for the Radiative Transfer Equation III: Enforcing Hyperbolicity and Physical Characteristic Speeds

This is the third paper in a series in which we develop machine learning (ML) moment closure models for the radiative transfer equation. In our previous work (Huang et al. in J Comput Phys 453:110941, 2022), we proposed an approach to learn the gradient of the unclosed high order moment, which performs much better than learning the moment itself and the conventional $P_N$ closure. However, while the ML moment closure has better accuracy, it is not able to guarantee hyperbolicity and has issues with long time stability. In our second paper (Huang et al., in: Machine learning moment closure models for the radiative transfer equation II: enforcing global hyperbolicity in gradient based closures, 2021. arXiv:2105.14410), we identified a symmetrizer which leads to conditions that enforce that the gradient based ML closure is symmetrizable hyperbolic and stable over long time. The limitation of this approach is that in practice the highest moment can only be related to four, or fewer, lower moments. In this paper, we propose a new method to enforce the hyperbolicity of the ML closure model. Motivated by the observation that the coefficient matrix of the closure system is a lower Hessenberg matrix, we relate its eigenvalues to the roots of an associated polynomial. Here, we design two new neural network architectures based on this relation. The ML closure model resulting from the first neural network is weakly hyperbolic and guarantees the physical characteristic speeds, i.e., the eigenvalues are bounded by the speed of light. The second model is strictly hyperbolic and does not guarantee the boundedness of the eigenvalues. Several benchmark tests including the Gaussian source problem and the two-material problem show the good accuracy, stability and generalizability of our hyperbolic ML closure model.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Understanding water and energy fluxes in the Amazonia: Lessons from an observation‐model intercomparison

Abstract Tropical forests are an important part of global water and energy cycles, but the mechanisms that drive seasonality of their land‐atmosphere exchanges have proven challenging to capture in models. Here, we (1) report the seasonality of fluxes of latent heat (LE), sensible heat ( H ), and outgoing short and longwave radiation at four diverse tropical forest sites across Amazonia—along the equator from the Caxiuanã and Tapajós National Forests in the eastern Amazon to a forest near Manaus, and from the equatorial zone to the southern forest in Reserva Jaru; (2) investigate how vegetation and climate influence these fluxes; and (3) evaluate land surface model performance by comparing simulations to observations. We found that previously identified failure of models to capture observed dry‐season increases in evapotranspiration (ET) was associated with model overestimations of (1) magnitude and seasonality of Bowen ratios (relative to aseasonal observations in which sensible was only 20%–30% of the latent heat flux) indicating model exaggerated water limitation, (2) canopy emissivity and reflectance (albedo was only 10%–15% of incoming solar radiation, compared to 0.15%–0.22% simulated), and (3) vegetation temperatures (due to underestimation of dry‐season ET and associated cooling). These partially compensating model‐observation discrepancies (e.g., higher temperatures expected from excess Bowen ratios were partially ameliorated by brighter leaves and more interception/evaporation) significantly biased seasonal model estimates of net radiation ( R n ), the key driver of water and energy fluxes (LE ~ 0.6 R n and H ~ 0.15 R n ), though these biases varied among sites and models. A better representation of energy‐related parameters associated with dynamic phenology (e.g., leaf optical properties, canopy interception, and skin temperature) could improve simulations and benchmarking of current vegetation–atmosphere exchange and reduce uncertainty of regional and global biogeochemical models.

Restrepo‐Coupe, Natalia↗
DOE OSTI2020

DDxNet: a deep learning model for automatic interpretation of electronic health records, electrocardiograms and electroencephalograms

Effective patient care mandates rapid, yet accurate, diagnosis. With the abundance of non-invasive diagnostic measurements and electronic health records (EHR), manual interpretation for differential diagnosis has become time-consuming and challenging. This has led to wide-spread adoption of AI-powered tools, in pursuit of improving accuracy and efficiency of this process. While the unique challenges presented by each modality and clinical task demand customized tools, the cumbersome process of making problem-specific choices has triggered the critical need for a generic solution to enable rapid development of models in practice. In this spirit, we develop DDxNet, a deep architecture for time-varying clinical data, which we demonstrate to be well-suited for diagnostic tasks involving different modalities (ECG/EEG/EHR), required level of characterization (abnormality detection/phenotyping) and data fidelity (single-lead ECG/22-channel EEG). Using multiple benchmark problems, we show that DDxNet produces high-fidelity predictive models, and sometimes even provides significant performance gains over problem-specific solutions.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Experimental error mitigation using linear rescaling for variational quantum eigensolving with up to 20 qubits

Quantum computers have the potential to help solve a range of physics and chemistry problems, but noise in quantum hardware currently limits our ability to obtain accurate results from the execution of quantum-simulation algorithms. Various methods have been proposed to mitigate the impact of noise on variational algorithms, including several that model the noise as damping expectation values of observables. In this work, we benchmark various methods, including a new method proposed here. Here, we compare their performance in estimating the ground-state energies of several instances of the 1D mixed-field Ising model using the variational-quantum-eigensolver algorithm with up to 20 qubits on two of IBM's quantum computers. We find that several error-mitigation techniques allow us to recover energies to within 10% of the true values for circuits containing up to about 25 ansatz layers, where each layer consists of CNOT gates between all neighboring qubits and Y-rotations on all qubits.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Expert perspectives on the wind plant of the future

Abstract Wind power technology has changed rapidly in recent years. Technology innovation, evolving power markets, and competing land and ocean uses continue to influence the design and operation of wind turbines and plants. Anticipating these trends and their impact on future facilities can inform commercial strategies and research priorities. Drawing from a recent survey of 140 of the world's foremost wind experts, we identify expectations of future wind plant design in 2035, both for onshore and offshore wind. Experts anticipate continued growth in turbine size, to 5.5 (onshore) and 17 MW (offshore), with plants located in increasingly less favorable wind and siting regimes. They expect plant sizes of 1,100 MW for fixed‐bottom and 600 MW for floating offshore wind. Experts forecast enhanced grid‐system value from wind through significant to widespread use of larger rotors, hybrid projects with batteries and hydrogen production, and more. To explain experts' perspectives on future plant design and operation, we identify five mechanisms: economies of unit, plant, and resource scale; grid‐system value economies; and production efficiencies. We characterize learning effects as a moderating influence on the strength of these mechanisms. In combination, experts predict that these design choices support levelized cost of energy reductions of 27% (onshore) and 17%–35% (floating and fixed‐bottom offshore) by 2035 compared to today, while enhancing wind energy's grid service offerings. Our findings provide a much‐needed benchmark for representing future wind technologies in power sector models and address a critical research gap by explaining the economics behind wind energy design choices.

17 WIND ENERGY↗
DOE OSTI2025

Phenomenology of electroweak portal dark showers: high energy direct probes and low energy complementarity

We investigate the phenomenology of a dark QCD sector interacting with the Standard Model (SM) via the electroweak (EW) portals. The portal interactions allow SM bosons, such as Z and h, or additional bosons that mix with them, to decay into dark quarks, producing dark showers. The light dark mesons are expected to be long-lived particles (LLPs), as their decays back to the SM states through the EW-portal interactions typically have macroscopic decay lengths. We focus on dark shower events initiated by various bosons at the Large Hadron Collider (LHC). The most prominent signal is the displaced decay of GeV-scale dark pions as LLPs. Current limits on dark shower signals at LHC detectors are recast from public data to provide simplified limits insensitive to UV physics details. Future limits in the high-luminosity phase and proposed auxiliary detectors are also projected. Additionally, we study the flavor-changing neutral current (FCNC) B decays into dark pions, obtaining both current and projected constraints at the LHC and other facilities. These constraints can be combined for specific models, which are illustrated in two EW-portal benchmarks: one with the heavy doublet fermion mediation and another with the Z′ mediator including a mass mixing. The collider reach shows significant potential to probe the parameter space unconstrained by EW precision tests, highlighting the necessity of dedicated LLP search strategies and facilities.

Dark Matter at Colliders↗
DOE OSTI2022

Experimental validation of the mechanistic scale-up methodology of gas–solid spouted beds using radioactive particle tracking (RPT)

The very high-temperature reactors (VHTRs) are highly ranked among candidates of Generation IV of nuclear reactors due to their high efficiency, safety, the resistance to proliferation, and reliability. The VHTRs are preferentially fueled by Tristructural-isometric (TRISO) coated fuel particles which has fuel kernels of fissile material coated by four coating layers: a porous buffer pyrolysis carbon layer (buffer PyC), an inner dense pyrolysis carbon layer (IPyC), a silicon carbide layer (SiC) and an outer dense pyrolysis carbon layer (OPyC). The heart of the operation and safety of the VHTRs significantly depends on the reliability of the coating layers of TRISO particles to retain metallic and gaseous fission products within the particles. The technique used for coating TRISO particles are gas-solids spouted beds via chemical vapor deposition (CVD). Fabrication of high-quality low-defect TRISO fuel particles fuel at larger scale spouted beds is required to support the commercialization of the VHTRs. In this work, our new developed mechanistic scale-up methodology of gas-solids spouted beds based on matching the radial profile of gas-holdup has been demonstrated and validated using radioactive particle tracking (RPT). Two spouted beds of small and larger scales were used in the study. Three sets of conditions were carried out which include the conditions of the reference case in the large scale, conditions that provide similar gas holdup radial profile to that of the reference case and conditions that provided dissimilar gas holdup radial in the small-scale spouted beds. The results confirm the validation of the scale-up methodology in terms of the dimensionless values of the spout diameter, cumulative probability distribution of the solids particles penetration into the spout, fraction of cycle time in each region of the bed, the radial profiles of the dimensionless values of the root-mean-square particle velocities and solids eddy diffusivity. Finally, the results further advance the knowledge and understanding of the gas-solids spouted beds provide deeper insight into their solids dynamics and presenting important benchmarking data for validating computational fluid dynamics codes and models. At last, procedures are established for the implementation of the new scale-up methodology.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Decarbonization of heat pump dual fuel systems using a practical model predictive control: Field demonstration in a small commercial building

In the transition from fossil fuel to electrified heating, a concerning trend is emerging in certain regions of the US. Owners of buildings with gas-based systems leave them in place after adding heat pumps (HPs). Existing control solutions for these hybrid (dual fuel) systems are rudimentary and fall short of realizing the full carbon reduction potential of these systems. Model predictive control (MPC) is often regarded as the benchmark for achieving optimal control in integrated systems. However, in the case of small-medium commercial buildings (SMCBs), the control and communication infrastructure required to facilitate the implementation of such advanced controls is often lacking. This paper presents a field implementation of easy-to-deploy MPC for a dual fuel heating system consisting of HPs and a gas-fired furnace (GF) for SMCBs. The control system is deployed on an open-source middleware platform and utilizes low-cost sensor devices to be used for real SMCBs without major retrofits. Here, we demonstrated this MPC in a real office building with 5 HPs and 1 GF for 2 months. The test results showed that MPC reduced 27% of cost while completely eliminating GF usage by shifting 23% of the thermal load from occupied-peak time to non-occupied-non-peak times.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Assessing and advancing the potential of quantum computing: A NASA case study

Quantum computing is one of the most enticing computational paradigms with the potential to revolutionize diverse areas of future-generation computational systems. While quantum computing hardware has advanced rapidly, from tiny laboratory experiments to quantum chips that can outperform even the largest supercomputers on specialized computational tasks, these noisy-intermediate scale quantum (NISQ) processors are still too small and non-robust to be directly useful for any real-world applications. In this paper, we describe NASA’s work in assessing and advancing the potential of quantum computing. We discuss advances in algorithms, both near- and longer-term, and the results of our explorations on current hardware as well as with simulations, including illustrating the benefits of algorithm-hardware co-design in the NISQ era. This work also includes physics-inspired classical algorithms that can be used at application scale today. We discuss innovative tools supporting the assessment and advancement of quantum computing and describe improved methods for simulating quantum systems of various types on high-performance computing systems that incorporate realistic error models. We provide an overview of recent methods for benchmarking, evaluating, and characterizing quantum hardware for error mitigation, as well as insights into fundamental quantum physics that can be harnessed for computational purposes.

Rieffel, Eleanor G.↗
DOE OSTI2022

A cycle-jump acceleration method for the crystal plasticity simulation of high cycle fatigue of the metallic microstructure

For metallic materials, high-cycle fatigue life is sensitive to underlying microstructure features including secondary phases, textures, grains morphology, etc. The traditional, data-based safe-life approaches for modeling fatigue don’t explicitly consider the microstructure and can’t guide study in microstructure modification for improved fatigue property. Crystal plasticity-based simulation provides increased model fidelity at the expense of immense computation time, making it inapplicable for high cycle fatigue. In this work, an acceleration method based on cycle-jump approach (Lesne and Savalle, 1989) was developed for microstructure-based high-cycle FE simulation using crystal plasticity constitutive-model. We report this method demonstrated high efficiency in benchmark tests of various conditions.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Beyond interpolation: Physics-inspired gating transformers for extrapolating irradiation conditions to novel nuclear fuels

The qualification of advanced nuclear fuels relies on irradiation experiments in test reactors that emulate commercial conditions. Designing these tests requires accurate prediction of key irradiation quantities, particularly heat generation rate and burnup, yet obtaining them typically involves computationally expensive multi-step simulation workflows. We propose a physics-inspired gating transformer (PIGT) that integrates an inverse-square, distance-based attenuation into the encoder representation to bias attention toward physically relevant spatial relationships while retaining data-driven flexibility. Using MiniFuel irradiation data from the High Flux Isotope Reactor at Oak Ridge National Laboratory, we benchmark against ensemble methods, feedforward and recurrent networks, convolutional models, and standard transformers. While baseline models perform well under interpolation, they exhibit a pronounced generalization gap when evaluated on fuels not included in the training set. The proposed model consistently improves extrapolative accuracy and stability, yielding the strongest performance on unseen fuel configurations. These results indicate that a lightweight physics structure embedded within attention mechanisms can substantially improve robustness, enabling more reliable surrogate predictions to accelerate the design of nuclear fuel irradiation experiments.

Fuel qualification↗