SEARCH · Engineering Papers

Results for “benchmark correlations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Hydrogen Bond Benchmark: Focal‐Point Analysis and Assessment of DFT Functionals

We performed a hierarchical, convergent ab initio benchmark study and systematically analyzed the performance of density functional approximations for describing hydrogen bonds in small neutral, cationic, and anionic complexes, as well as in larger systems involving amide, urea, deltamide, and squaramide moieties. Focal point analyses (FPA), extrapolating to the ab initio limit, were carried out using correlated wave function methods up to CCSDT(Q) for the small complexes and CCSD(T) for the larger systems, together with correlation-consistent Gaussian basis sets up to the complete basis set limit. Optimized geometries and vibrational frequencies were obtained at the CCSD(T) level. The resulting FPA hydrogen-bond energies converge within a few tenths of a kcal mol −1 . These reference data were used to evaluate 60 density functionals (including 12 dispersion-corrected), spanning the local-density approximation (LDA), generalized gradient approximations (GGAs), meta-GGAs, hybrids, meta-hybrids, double-hybrids, and range-separated hybrids. Overall, the meta-hybrid M06-2X provides the best performance for both hydrogen bond energies and geometries, while the dispersion-corrected GGAs BLYP-D3(BJ) and BLYP-D4 also yield accurate hydrogen-bond data and can serve as cost-effective options for studying large and complex systems.

coupled cluster theory↗

DOE OSTI2024

Identifying Topological Defects in Lamellar Phases through Contour Analysis of Complex Wave Fields

Lamellar phases frequently contain structural imperfections that significantly affect their behaviors and properties. Our previous research successfully reconstructed real-space configurations of defective lamellar phases from diffuse scattering patterns, indicating the presence of phase vortices as a potential method for identifying topological defects disrupting the smectic ordering. Here, this report presents a mathematical framework using regularized wave fields to represent defective lamellar structures in real space. Phase singularities, resulting from the interference of random waves and indicating lamellar order disruption, are identified through a contour integral. These wave fields, derived from coherent scattering in reciprocal space, were validated via computational benchmarks analyzing small-angle neutron scattering data from AOT surfactant solutions, facilitating further statistical analysis of the defects. Our study highlights the potential to extract meaningful information about topological defects in lyotropic phases by inversely analyzing experimentally measured two-point static correlations. Our method allows for detailed structural analysis of various lyotropic phases, both particulate and nonparticulate, in their quiescent states and facilitates quantitative investigation of defects’ role in phase transitions. By integrating small-angle scattering, deep learning, and vortex tangle analysis, our comprehensive approach shows promise in addressing complex challenges in the structural analysis of soft matter systems.

36 MATERIALS SCIENCE↗

NASA NTRS2008

Statistical Estimation of Orbital Debris Populations with a Spectrum of Object Size

Orbital debris is a real concern for the safe operations of satellites. In general, the hazard of debris impact is a function of the size and spatial distributions of the debris populations. To describe and characterize the debris environment as reliably as possible, the current NASA Orbital Debris Engineering Model (ORDEM2000) is being upgraded to a new version based on new and better quality data. The data-driven ORDEM model covers a wide range of object sizes from 10 microns to greater than 1 meter. This paper reviews the statistical process for the estimation of the debris populations in the new ORDEM upgrade, and discusses the representation of large-size (greater than or equal to 1 m and greater than or equal to 10 cm) populations by SSN catalog objects and the validation of the statistical approach. Also, it presents results for the populations with sizes of greater than or equal to 3.3 cm, greater than or equal to 1 cm, greater than or equal to 100 micrometers, and greater than or equal to 10 micrometers. The orbital debris populations used in the new version of ORDEM are inferred from data based upon appropriate reference (or benchmark) populations instead of the binning of the multi-dimensional orbital-element space. This paper describes all of the major steps used in the population-inference procedure for each size-range. Detailed discussions on data analysis, parameter definition, the correlation between parameters and data, and uncertainty assessment are included.

Xu, Y. -l↗

NASA NTRS2019

Diagnosing Bias in Modeled Soil Moisture/runoff Coefficient Correlation Using the SMAP Level 4 Soil Moisture Product

The physical parameterization of key processes in land surface models (LSMs) remains uncertain, and new techniques are required to evaluate LSM accuracy over coarse spatial scales. Given the role of soil moisture in the partitioning of surface water fluxes (between infiltration, runoff and evapotranspiration), surface soil moisture (SSM) estimates represent an important observational benchmark for such evaluations. Here, we apply SSM estimates from the NASA Soil Moisture Active Passive Level 4 product (SMAP_L4) to diagnose bias in the coupling between SSM and surface runoff for multiple Noah-Multiple Physics (Noah-MP) LSM parameterization cases. Results demonstrate that Noah-MP surface runoff parameterizations often underestimate the coupling strength between pre-storm SSM and the event-scale runoff coefficient (RC; defined as the ratio between event-scale streamflow and precipitation volumes). This bias squanders RC information contained in pre-storm SSM and reduces RC estimation skill. Such bias can be quantified against an observational benchmark calculated using streamflow observations and SMAP_L4 SSM and applied to explain a substantial fraction of the observed basin-to-basin (and case-to-case) variability in the skill of event-scale Noah-MP RC estimates. Based on this concept, a novel case selection strategy for ungauged basins is introduced and demonstrated to successfully identify poorly performing Noah-MP parameterization cases.

SSM↗

DOE OSTI2024

Towards efficient light emitters via computational design of molecules with inverted singlet-triplet gaps

To move toward rational design of efficient organic light emitting diodes based on the radical idea of inverted singlet-triplet gap (INVEST) systems, we propose a set of novel quantum chemical approaches, predictive but low-cost, to unveil a set of structural-property relationships. We perform a computational study of a series of substituted molecules based on a small set of known INVEST molecules. Our study demonstrates a high degree of correlation between the intramolecular charge transfer and the singlet-triplet energy gap and hints towards the use of a quantitative estimate of charge transfer to predict and modulate these energy gaps. We aim to create a database of INVEST molecules that includes accurate benchmarks of singlet-triplet energy gaps. Furthermore, we aim to link structural features and molecular properties, enabling a control knob for rational design.

42 ENGINEERING↗

NASA NTRS1994

On the vortical-flow-prediction capability of an unstructured-grid Euler solver

The results from a concentrated computational effort are presented with the primary objective being directed at evaluating the vortical-flow-prediction capability of an unstructured-grid Euler solver. Both viscous and inviscid solutions, obtained from an established structured-grid method, along with experimental wind-tunnel data are used as benchmark measures to assess the validity of the unstructured-grid Euler results. Viscous effects on vortical flows are first identified by comparing the viscous and inviscid solutions obtained from the structured-grid method. Computational data analysis is then presented which reveals excellent correlations between the inviscid structured and unstructured-grid results in terms of off-surface flow structures, surface pressure distribution, and the predicted longitudinal aerodynamic characteristics. The sensitivity of the unstructured-grid inviscid solutions to grid refinement is also discussed along with an analysis of the convergence and performance characteristics for each method.

Unstructured grid↗

NASA NTRS2010

An Experimental Investigation of Silicone-to-Metal Bond Strength in Composite Space Docking System Seals

The National Aeronautics and Space Administration (NASA) is currently developing a new universal docking mechanism for future space exploration missions called the Low Impact Docking System (LIDS). A candidate LIDS main interface seal design is a composite assembly of silicone elastomer seals vacuum molded into grooves in an electroless nickel plated aluminum retainer. The strength of the silicone-tometal bond is a critical consideration for the new system, especially due to the presence of small areas of disbond created during the molding process. In the work presented herein, seal-to-retainer bonds of subscale seal specimens with different sizes of intentional disbond were destructively tensile tested. Nominal specimens without intentional disbonds were also tested. Tension was applied either uniformly on the entire seal circumference or locally in one short circumferential length. Bond failure due to uniform tension produced a wide scatter of observable failure modes and measured load-displacement behaviors. Although the preferable failure mode for the seal-to-retainer bond is cohesive failure of the elastomer material, the dominant observed failure mode under the uniform loading condition was found to be the less desirable adhesive failure of the bond in question. The uniform tension case results did not show a correlation between disbond size and bond strength. Localized tension was found to produce failure either as immediate tearing of the elastomer material outside the bond region or as complete peel-out of the seal in one piece. The obtained results represent a valuable benchmark for comparison in the future between adhesion loads under various separation conditions and composite seal bond strength.

Gaier, James R.↗

NASA NTRS2010

Aeroelasticity Benchmark Assessment: Subsonic Fixed Wing Program

The fundamental technical challenge in computational aeroelasticity is the accurate prediction of unsteady aerodynamic phenomena and the effect on the aeroelastic response of a vehicle. Currently, a benchmarking standard for use in validating the accuracy of computational aeroelasticity codes does not exist. Many aeroelastic data sets have been obtained in wind-tunnel and flight testing throughout the world; however, none have been globally presented or accepted as an ideal data set. There are numerous reasons for this. One reason is that often, such aeroelastic data sets focus on the aeroelastic phenomena alone (flutter, for example) and do not contain associated information such as unsteady pressures and time-correlated structural dynamic deflections. Other available data sets focus solely on the unsteady pressures and do not address the aeroelastic phenomena. Other discrepancies can include omission of relevant data, such as flutter frequency and / or the acquisition of only qualitative deflection data. In addition to these content deficiencies, all of the available data sets present both experimental and computational technical challenges. Experimental issues include facility influences, nonlinearities beyond those being modeled, and data processing. From the computational perspective, technical challenges include modeling geometric complexities, coupling between the flow and the structure, grid issues, and boundary conditions. The Aeroelasticity Benchmark Assessment task seeks to examine the existing potential experimental data sets and ultimately choose the one that is viewed as the most suitable for computational benchmarking. An initial computational evaluation of that configuration will then be performed using the Langley-developed computational fluid dynamics (CFD) software FUN3D1 as part of its code validation process. In addition to the benchmarking activity, this task also includes an examination of future research directions. Researchers within the Aeroelasticity Branch will examine other experimental efforts within the Subsonic Fixed Wing (SFW) program (such as testing of the NASA Common Research Model (CRM)) and other NASA programs and assess aeroelasticity issues and research topics.

Florance, Jennifer P.↗

NASA NTRS2017

Global Gridded Crop Model Evaluation: Benchmarking, Skills, Deficiencies and Implications.

Crop models are increasingly used to simulate crop yields at the global scale, but so far there is no general framework on how to assess model performance. Here we evaluate the simulation results of 14 global gridded crop modeling groups that have contributed historic crop yield simulations for maize, wheat, rice and soybean to the Global Gridded Crop Model Intercomparison (GGCMI) of the Agricultural Model Intercomparison and Improvement Project (AgMIP). Simulation results are compared to reference data at global, national and grid cell scales and we evaluate model performance with respect to time series correlation, spatial correlation and mean bias. We find that global gridded crop models (GGCMs) show mixed skill in reproducing time series correlations or spatial patterns at the different spatial scales. Generally, maize, wheat and soybean simulations of many GGCMs are capable of reproducing larger parts of observed temporal variability (time series correlation coefficients (r) of up to 0.888 for maize, 0.673 for wheat and 0.643 for soybean at the global scale) but rice yield variability cannot be well reproduced by most models. Yield variability can be well reproduced for most major producing countries by many GGCMs and for all countries by at least some. A comparison with gridded yield data and a statistical analysis of the effects of weather variability on yield variability shows that the ensemble of GGCMs can explain more of the yield variability than an ensemble of regression models for maize and soybean, but not for wheat and rice. We identify future research needs in global gridded crop modeling and for all individual crop modeling groups. In the absence of a purely observation-based benchmark for model evaluation, we propose that the best performing crop model per crop and region establishes the benchmark for all others, and modelers are encouraged to investigate how crop model performance can be increased. We make our evaluation system accessible to all crop modelers so that other modeling groups can also test their model performance against the reference data and the GGCMI benchmark.

wheat↗

DOE OSTI2024

Exploiting a derivative discontinuity estimate for accurate G0W0 ionization potentials and electron affinities

Abstract The GW approximation has become an important tool for predicting charged excitations of isolated molecules and condensed systems. Its popularity can be attributed to many factors, including a favorable scaling and relatively good accuracy. In practical applications, the GW is often performed as a one-shot perturbation known as G 0 W 0 . Unfortunately, G 0 W 0 suffers from a strong starting point dependence and is often not as accurate as one would need. Self-consistent GW methodologies alleviate these problems but come with a marked increase in computational cost. In this manuscript, we propose the use of an estimate of the exchange-correlation derivative discontinuity to provide a remarkably good starting point for G 0 W 0 calculations, yielding ionization potentials and electron affinities with eigenvalue self-consistent GW quality at no additional cost. We assess the quality of the resulting methodology with the GW 100 benchmark set and compare its advantages over other similar methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2019

Sparse Bayesian mass mapping with uncertainties: local credible intervals

ABSTRACT Until recently, mass-mapping techniques for weak gravitational lensing convergence reconstruction have lacked a principled statistical framework upon which to quantify reconstruction uncertainties, without making strong assumptions of Gaussianity. In previous work, we presented a sparse hierarchical Bayesian formalism for convergence reconstruction that addresses this shortcoming. Here, we draw on the concept of local credible intervals (cf. Bayesian error bars) as an extension of the uncertainty quantification techniques previously detailed. These uncertainty quantification techniques are benchmarked against those recovered via Px-MALA – a state-of-the-art proximal Markov chain Monte Carlo (MCMC) algorithm. We find that, typically, our recovered uncertainties are everywhere conservative (never underestimate the uncertainty, yet the approximation error is bounded above), of similar magnitude and highly correlated with those recovered via Px-MALA. Moreover, we demonstrate an increase in computational efficiency of $\mathcal {O}(10^6)$ when using our sparse Bayesian approach over MCMC techniques. This computational saving is critical for the application of Bayesian uncertainty quantification to large-scale stage IV surveys such as LSST and Euclid.

Price, M. A.↗

DOE OSTI2023

Two-photon double ionization with finite pulses: Application of the virtual sequential model to helium

As a step toward the full ab initio description of two-photon double ionization processes, we present a finite-pulse version of the virtual-sequential model for polyelectronic atoms. The model relies on the ab initio description of the single ionization scattering states of both the neutral and ionized target system. As a proof of principle and a benchmark, the model is applied to the helium atom using the newstock atomic photoionization code. The results of angularly integrated observables, which are in excellent agreement with existing time-dependent Schrödinger equation (TDSE) simulations, show how the model is able to capture the role of electron correlation in the nonsequential regime, and the influence of autoionizing states in the sequential regime, at a comparatively modest computational cost. The model also reproduces the two-particle interference with ultrashort pulses, which is within reach of current experimental technologies. Furthermore, the model shows the modulation of the joint energy distribution in the vicinity of autoionizing states, which can be probed with extreme-ultraviolet pulses of duration much longer than the characteristic lifetime of the resonance. Furthermore, the formalism discussed here applies also to polyelectronic atoms and molecules, thus opening a window on nonsequential and sequential double ionization in these more complex systems.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2024

In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions

The popularity of ready-to-eat (RTE) salads has prompted novel technology to prolong the shelf life of their ingredients. Fresh-cut romaine lettuce is widely used in RTE salads; however, its tendency to quickly discolor continues to be a challenge for the industry. Selecting the ideal lettuce accessions for use in RTE salads is essential to ensure maximum shelf life, and it is critical to have a practical way to assess and compare the quality of multiple lettuce accessions that are being considered for use in fresh-cut applications. Thus, in this work we aimed to determine whether a computer vision system (CVS) composed of image acquisition, processing, and analysis could be effective to detect visual quality differences among 16 accessions of fresh-cut romaine lettuce during postharvest storage. The CVS involved a post-capturing color correction, effective image segmentation, and calculation of a browning index, which was tested as a predictor of quality and shelf life of fresh-cut romaine lettuce. The results demonstrated that machine vision software can be implemented to replace or supplement the scoring of a trained panel and instrumental quality measurements. Overall visual quality, a key sensory parameter that determines food preferences and consumer behavior, was highly correlated with the browning index, with a Pearson correlation coefficient of −0.85. Other important sensory decision parameters were also strongly or moderately correlated with the browning index, with Pearson correlation coefficients of −0.84 for freshness, 0.79 for off odor, and 0.57 for browning. The ranking of the accessions according to quality acceptability from the sensory evaluation produced a similar pattern to those obtained with the CVS. This study revealed that multiple lettuce accessions can be effectively benchmarked for their performance as fresh-cut sources via a CVS-based method. Future opportunities and challenges in using machine vision image processing to predict consumer preferences for RTE salad greens is also discussed.

Agriculture↗

NASA NTRS1985

Constitutive modeling for isotropic materials (HOST)

This report presents the results of the second year of work on a problem which is part of the NASA HOST Program. Its goals are: (1) to develop and validate unified constitutive models for isotropic materials, and (2) to demonstrate their usefulness for structural analyses of hot section components of gas turbine engines. The unified models selected for development and evaluation are that of Bodner-Partom and Walker. For model evaluation purposes, a large constitutive data base is generated for a B1900 + Hf alloy by performing uniaxial tensile, creep, cyclic, stress relation, and thermomechanical fatigue (TMF) tests as well as biaxial (tension/torsion) tests under proportional and nonproportional loading over a wide range of strain rates and temperatures. Systematic approaches for evaluating material constants from a small subset of the data base are developed. Correlations of the uniaxial and biaxial tests data with the theories of Bodner-Partom and Walker are performed to establish the accuracy, range of applicability, and integability of the models. Both models are implemented in the MARC finite element computer code and used for TMF analyses. Benchmark notch round experiments are conducted and the results compared with finite-element analyses using the MARC code and the Walker model.

Lindholm, U. S.↗

DOE OSTI2021

Deep-Learning-Derived Evaluation Metrics Enable Effective Benchmarking of Computational Tools for Phosphopeptide Identification

Tandem mass spectrometry (MS/MS)-based phosphoproteomics is a powerful technology for global phosphorylation analysis. However, applying four computational pipelines to a typical mass spectrometry (MS)-based phosphoproteomic dataset from a human cancer study, we observed a large discrepancy among the reported phosphopeptide identification and phosphosite localization results, underscoring a critical need for benchmarking. While efforts have been made to compare performance of computational pipelines using data from synthetic phosphopeptides, evaluations involving real application data have been largely limited to comparing the numbers of phosphopeptide identifications due to the lack of appropriate evaluation metrics. We investigated three deep learning-derived features as potential evaluation metrics: phosphosite probability, Delta RT and spectral similarity. Predicted phosphosite probability is computed by MusiteDeep, which provides high accuracy as previously reported; Delta RT is defined as the absolute retention time (RT) difference between RTs observed and predicted by AutoRT; and spectral similarity is defined as the Pearson’s correlation coefficient between spectra observed and predicted by pDeep2. Using a synthetic peptide dataset, we found that both Delta RT and spectral similarity provided excellent discrimination between correct and incorrect peptide-spectrum matches (PSMs) both when incorrect PSMs involved wrong peptide sequences and even when incorrect PSMs were caused by only incorrect phosphosite localization. Based on these results, we used all the three deep learning-derived features as evaluation metrics to compare different computational pipelines on diverse set of phosphoproteomic datasets and showed their utility in benchmarking performance of the pipelines. The benchmark metrics demonstrated in this study will enable users to select computational pipelines and parameters for routine analysis of phosphoproteomics data and will offer guidance for developers to improve computational methods.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Symmetry-projected spin-AGP methods applied to spin systems

Symmetry-projected wave function methods capture static correlation by breaking and restoring the symmetries of a system. In this article, we present the symmetry-projected spin antisymmetrized geminal power (spin-AGP) state projected onto space group symmetry as well as complex conjugation, spin-flip, and time-reversal symmetries. The method is benchmarked on the 1D XXZ model and the 2D J 1 − J 2 model with square and triangular lattices. Our results indicate that symmetry projection methods provide a powerful tool for frustrated spin systems.

Antisymmetrized geminal power↗

DOE OSTI2021

Moiré metrology of energy landscapes in van der Waals heterostructures

The emerging field of twistronics, which harnesses the twist angle between two-dimensional materials, represents a promising route for the design of quantum materials, as the twist-angle-induced superlattices offer means to control topology and strong correlations. At the small twist limit, and particularly under strain, as atomic relaxation prevails, the emergent moiré superlattice encodes elusive insights into the local interlayer interaction. Here we introduce moiré metrology as a combined experiment-theory framework to probe the stacking energy landscape of bilayer structures at the 0.1 meV/atom scale, outperforming the gold-standard of quantum chemistry. Through studying the shapes of moiré domains with numerous nano-imaging techniques, and correlating with multi-scale modelling, we assess and refine first-principle models for the interlayer interaction. We document the prowess of moiré metrology for three representative twisted systems: bilayer graphene, double bilayer graphene and H-stacked MoSe 2 /WSe 2 . Moiré metrology establishes sought after experimental benchmarks for interlayer interaction, thus enabling accurate modelling of twisted multilayers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2026

New correlated numerical methods for attosecond molecular single and double ionization

This project resulted in the development of ASTRA, a new molecular ionization code capable of describing single and double ionization processes in polyatomic molecules with correlated electrons and time-dependent fields. Key achievements include: (i) the development of the PRISM hybrid-integral library enabling core-ionization and high-angular-momentum convergence; (ii) implementation of time-dependent Schrödinger equation solvers for pump–probe spectroscopies; (iii) validation against experimental and theoretical benchmarks for atoms and molecules; and (iv) extension to two-photon double ionization using the finite-pulse virtual-sequential model. These developments establish ASTRA as a versatile platform for attosecond molecular dynamics.

74 ATOMIC AND MOLECULAR PHYSICS↗