Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Benchmarking Real-Time Control Platforms Using a Matlab/Simulink Coder with Applications in the Control of DC/AC Switched Power Converters

In the control of DC/AC switched power converters (SPC), one of the most important aspects to be considered is the selection of the real-time control platform. The real-time control platform must be able to meet the high performance efficiency and regulation requirements of the DC/AC SPC, as these typically operate at switching frequencies in the order of kHz to MHz. For this reason, the hardware characteristics of the ADC and PWM, and the processing capacity of the real-time control platform are of vital importance when implementing advanced digital controllers that maintain voltage and current levels within regulatory standards. In this context, we aimed to perform a comparative study of the computation times of different real-time control platforms when implementing different control strategies for DC/AC switched power converters. We also analyzed the impact of the real-time control platforms on the THD of the voltages generated by the DC/AC switched power converters. With the help of this paper, researchers and developers will have criteria to select which real-time control platform to use in real-time control for DC/AC SPC applications.

42 ENGINEERING↗
DOE OSTI2022

Detailed Chemical Abundances for a Benchmark Sample of M Dwarfs from the APOGEE Survey

Individual chemical abundances for 14 elements (C, O, Na, Mg, Al, Si, K, Ca, Ti, V, Cr, Mn, Fe, and Ni) are derived for a sample of M dwarfs using high-resolution, near-infrared H-band spectra from the Sloan Digital Sky Survey-IV/Apache Point Observatory Galactic Evolution Experiment (APOGEE) survey. The quantitative analysis included synthetic spectra computed with 1D LTE plane-parallel MARCS models using the APOGEE Data Release 17 line list to determine chemical abundances. The sample consists of 11 M dwarfs in binary systems with warmer FGK dwarf primaries and 10 measured interferometric angular diameters. To minimize atomic diffusion effects, [X/Fe] ratios are used to compare M dwarfs in binary systems and literature results for their warmer primary stars, indicating good agreement (<0.08 dex) for all studied elements. The mean abundance difference in primaries minus this work's M dwarfs is –0.05 ± 0.03 dex. It indicates that M dwarfs in binary systems are a reliable way to calibrate empirical relationships. A comparison with abundance, effective temperature, and surface gravity results from the APOGEE Stellar Parameter and Chemical Abundances Pipeline (ASPCAP) Data Release 16 finds a systematic offset of [M/H], T eff , log g = +0.21 dex, –50 K, and 0.30 dex, respectively, although ASPCAP [X/Fe] ratios are generally consistent with this study. The metallicities of the M dwarfs cover the range of [Fe/H] = –0.9 to +0.4 and are used to investigate Galactic chemical evolution via trends of [X/Fe] as a function of [Fe/H]. The behavior of the various elemental abundances [X/Fe] versus [Fe/H] agrees well with the corresponding trends derived from warmer FGK dwarfs, demonstrating that the APOGEE spectra can be used to examine Galactic chemical evolution using large samples of selected M dwarfs.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Window observables for benchmarking parton distribution functions

Global analysis of collider and fixed-target experimental data and calculations from lattice quantum chromodynamics (QCD) are used to gain complementary information on the structure of hadrons. We propose novel ``window observables'' that allow for higher precision cross-validation between the different approaches, a critical step for studies that wish to combine the datasets. Global analyses are limited by the kinematic regions accessible to experiment, particularly in a range of Bjorken-x, and lattice QCD calculations also have limitations requiring extrapolations to obtain the parton distributions. We provide two different ``window observables'' that can be defined within a region of x where extrapolations and interpolations in global analyses remain reliable and where lattice QCD results retain sensitivity and precision.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Leveraging the signature of heterotrophic respiration on atmospheric CO 2 for model benchmarking

Spatial and temporal variations in atmospheric carbon dioxide (CO 2 ) reflect large-scale net carbon exchange between the atmosphere and terrestrial ecosystems. Soil heterotrophic respiration (HR) is one of the component fluxes that drive this net exchange, but, given observational limitations, it is difficult to quantify this flux or to evaluate global-scale model simulations thereof. Here, we show that atmospheric CO 2 can provide a useful constraint on large-scale patterns of soil heterotrophic respiration. We analyze three soil model configurations (CASA-CNP, MIMICS, and CORPSE) that simulate HR fluxes within a biogeochemical test bed that provides each model with identical net primary productivity (NPP) and climate forcings. We subsequently quantify the effects of variation in simulated terrestrial carbon fluxes (NPP and HR from the three soil test-bed models) on atmospheric CO 2 distributions using a three-dimensional atmospheric tracer transport model. Our results show that atmospheric CO 2 observations can be used to identify deficiencies in model simulations of the seasonal cycle and interannual variability in HR relative to NPP. In particular, the two models that explicitly simulated microbial processes (MIMICS and CORPSE) were more variable than observations at interannual timescales and showed a stronger-than-observed temperature sensitivity. Our results prompt future research directions to use atmospheric CO 2 , in combination with additional constraints on terrestrial productivity or soil carbon stocks, for evaluating HR fluxes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Benchmarking and parameter sensitivity of physiological and vegetation dynamics using the Functionally Assembled Terrestrial Ecosystem Simulator (FATES) at Barro Colorado Island, Panama

Plant functional traits determine vegetation responses to environmental variation, but variation in trait values is large, even within a single site. Likewise, uncertainty in how these traits map to Earth system feedbacks is large. We use a vegetation demographic model (VDM), the Functionally Assembled Terrestrial Ecosystem Simulator (FATES), to explore parameter sensitivity of model predictions, and comparison to observations, at a tropical forest site: Barro Colorado Island in Panama. We define a single 12-dimensional distribution of plant trait variation, derived primarily from observations in Panama, and define plant functional types (PFTs) as random draws from this distribution. We compare several model ensembles, where individual ensemble members vary only in the plant traits that define PFTs, and separate ensembles differ from each other based on either model structural assumptions or non-trait, ecosystem-level parameters, which include (a) the number of competing PFTs present in any simulation and (b) parameters that govern disturbance and height-based light competition. While single-PFT simulations are roughly consistent with observations of productivity at Barro Colorado Island, increasing the number of competing PFTs strongly shifts model predictions towards higher productivity and biomass forests. Different ecosystem variables show greater sensitivity than others to the number of competing PFTs, with the predictions that are most dominated by large trees, such as biomass, being the most sensitive. Changing disturbance and height-sorting parameters, i.e., the rules of competitive trait filtering, shifts regimes of dominance or coexistence between early- and late-successional PFTs in the model. Increases to the extent or severity of disturbance, or to the degree of determinism in height-based light competition, all act to shift the community towards early-successional PFTs. In turn, these shifts in competitive outcomes alter predictions of ecosystem states and fluxes, with more early-successional-dominated forests having lower biomass. It is thus crucial to differentiate between plant traits, which are under competitive pressure in VDMs, from those model parameters that are not and to better understand the relationships between these two types of model parameters to quantify sources of uncertainty in VDMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Observational benchmarks inform representation of soil organic carbon dynamics in land surface models

Abstract. Representing soil organic carbon (SOC) dynamics in Earth system models (ESMs) is a key source of uncertainty in predicting carbon–climate feedbacks. Machine learning models can help identify dominant environmental controllers and establish their functional relationships with SOC stocks. The resulting knowledge can be integrated into ESMs to reduce uncertainty and improve predictions of SOC dynamics over space and time. In this study, we used a large number of SOC field observations (n=54 000), geospatial datasets of environmental factors (n=46), and two machine learning approaches (namely random forest, RF, and generalized additive modeling, GAM) to (1) identify dominant environmental controllers of global and biome-specific SOC stocks, (2) derive functional relationships between environmental controllers and SOC stocks, and (3) compare the identified environmental controllers and predictive relationships with those in models used in Phase 6 of the Coupled Model Intercomparison Project (CMIP6). Our results showed that the diurnal temperature, drought index, cation exchange capacity, and precipitation were important observed environmental predictors of global SOC stocks. While the RF model identified 14 environmental factors that describe climatic, vegetation, and edaphic conditions as important predictors of global SOC stocks (R2=0.61, RMSE = 0.46 kg m−2), current ESMs oversimplify the relationships between environmental factors and SOC, with precipitation, temperature, and net primary productivity explaining > 96 % of the variability in ESM-modeled SOC stocks. Further, our study revealed notable disparities among the functional relationships between environmental factors and SOC stocks simulated by ESMs compared with observed relationships. To improve SOC representations in ESMs, it is imperative to incorporate additional environmental controls, such as the cation exchange capacity, and refine the functional relationships to align more closely with observations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Evaluating precipitation distributions at regional scales: a benchmarking framework and application to CMIP5 and 6 models

Abstract. As the resolution of global Earth system models increases, regional-scale evaluations are becoming ever more important. This study presents a framework for quantifying precipitation distributions at regional scales and applies it to evaluate Coupled Model Intercomparison Project (CMIP) 5 and 6 models. We employ the Intergovernmental Panel on Climate Change (IPCC) sixth assessment report (AR6) climate reference regions over land and propose refinements to the oceanic regions based on the homogeneity of precipitation distribution characteristics. The homogeneous regions are identified as heavy-, moderate-, and light-precipitating areas by K-means clustering of Integrated Multi-satellitE Retrievals for Global Precipitation Measurement (GPM) version 6 final run product (IMERG) precipitation frequency and amount distributions. With the global domain partitioned into 62 regions, including 46 land and 16 ocean regions, we apply 10 established precipitation distribution metrics. The collection includes metrics focused on the maximum peak, lower 10th percentile, and upper 90th percentile in precipitation amount and frequency distributions; the similarity between observed and modeled frequency distributions; an unevenness measure based on cumulative amount; average total intensity on all days with precipitation; and number of precipitating days each year. We apply our framework to 25 CMIP5 and 41 CMIP6 models, as well as six observation-based products of daily precipitation. Our results indicate that many CMIP5 and 6 models substantially overestimate the observed light-precipitation amount and frequency, as well as the number of precipitating days, especially over midlatitude regions outside of some land regions in the Americas and Eurasia. Improvement from CMIP5 to 6 is shown in some regions, especially in midlatitude regions, but it is not evident globally, and over the tropics most metrics point toward degradation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization

Reliable climate predictions across multiple timescales are increasingly critical as climate-related risks continue to rise. With the growing number and diversity of climate prediction systems, systematic intercomparison has become essential. Here, we present a comprehensive evaluation framework based on the PCMDI Metric Package to assess the performance of multiple decadal climate prediction systems. Unlike uninitialized simulations, initialized predictions exhibit bias and predictive skill that evolve with forecast lead time. To address this, we introduce (1) model-by-lead-time portrait plots, which efficiently summarize metrics of global temperature, precipitation, and Arctic/Antarctic sea-ice extent, and (2) an HTML-based interactive visualization platform that provides detailed regional and seasonal diagnostics of model bias, skill scores, and ensemble spread for each model and lead time. Comparisons with uninitialized simulations further quantify the relative impacts of initialization and external forcing on prediction skill. The proposed framework provides a scalable and transparent approach for multi-model climate prediction assessments and can be readily extended to a wide range of operational and research forecasting systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Replication Data for: Toward benchmarking theoretical computations of elementary rate constants on catalytic surfaces: formate decomposition on Au and Cu

The data underlying this published work have been made publicly available in this repository as part of the IMASC Data Management Plan. This work was supported as part of the Integrated Mesoscale Architectures for Sustainable Catalysis (IMASC), an Energy Frontier Research Center funded by the U.S. Department of Energy, Office of Science, Basic Energy Sciences under Award # DE-SC0012573.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1970

The Benchmark satellite Final report

Methods for satellite measurement of continental drift with earth rotation and mathematical logic for active attitude control of spin stabilized spacecraft

Winn, C. B.↗
NASA NTRS1972

Benchmark gas core critical experiment.

A critical experiment with spherical symmetry has been conducted on the gas core nuclear reactor concept. The nonspherical perturbations in the experiment were evaluated experimentally and produce corrections to the observed eigenvalue of approximately 1% delta k. The reactor consisted of a low density, central uranium hexafluoride gaseous core, surrounded by an annulus of void or low density hydrocarbon, which in turn was surrounded with a 97-cm-thick heavy water reflector.

Kunze, J. F.↗
NASA NTRS1978

Planetary benchmarks

Design criteria and technology requirements for a system of radar reference devices to be fixed to the surfaces of the inner planets are discussed. Offshoot applications include the use of radar corner reflectors as landing beacons on the planetary surfaces and some deep space applications that may yield a greatly enhanced knowledge of the gravitational and electromagnetic structure of the solar system. Passive retroreflectors with dimensions of about 4 meters and weighing about 10 kg are feasible for use with orbiting radar at Venus and Mars. Earth-based observation of passive reflectors, however, would require very large and complex structures to be delivered to the surfaces. For Earth-based measurements, surface transponders offer a distinct advantage in accuracy over passive reflectors. A conceptual design for a high temperature transponder is presented. The design appears feasible for the Venus surface using existing electronics and power components.

Uphoff, C.↗
NASA NTRS1982

Benchmark notch test for life prediction

Aircraft gas turbine engine components are subjected to severe stress, temperature, and environmental conditions. Economic and reliabilty demands have prompted inordinate effort in development of analytic methods to predict stresses and strains in aircraft engines. There remains, however, the need to check or verify these analytical methodologies against actual experimental data measurements. The laser interferometric strain displacement gage was recognized as having the potential to accomplish this task and was employed in this program. The actual strains incurred at the root of a discontinuity in cyclically loaded test samples subjected to inelastic deformation at high temperature where creep deformation readily occur were measured. The steady-state, cyclic stress-strain response at the root of the discontinuity in the tested samples was analyzed for comparison with the measured results. A comprehensive set of local notch root strain measurements for a variety of load patterns in an Inconel 718 notch specimen at 649 C (1200 F) was obtained and documented using the laser interferometric strain displacement gage.

Domas, P. A.↗
NASA NTRS1984

Benchmark data on the separability among crops in the southern San Joaquin Valley of California

Landsat MSS data were input to a discriminant analysis of 21 crops on each of eight dates in 1979 using a total of 4,142 fields in southern Fresno County, California. The 21 crops, which together account for over 70 percent of the agricultural acreage in the southern San Joaquin Valley, were analyzed to quantify the spectral separability, defined as omission error, between all pairs of crops. On each date the fields were segregated into six groups based on the mean value of the MSS7/MSS5 ratio, which is correlated with green biomass. Discriminant analysis was run on each group on each date. The resulting contingency tables offer information that can be profitably used in conjunction with crop calendars to pick the best dates for a classification. The tables show expected percent correct classification and error rates for all the crops. The patterns in the contingency tables show that the percent correct classification for crops generally increases with the amount of greenness in the fields being classified. However, there are exceptions to this general rule, notably grain.

Morse, A.↗
NASA NTRS1984

Automated benchmark generation based upon a specification language

The problem of validating and verifying digital flight control system (DFCS) software is addressed in this paper. A new specification language DIVERS is proposed, and is the keystone of the approach. This language consists of keywords where each keyword represents an element in the block diagram of a DFCS. DIVERS has a dictionary which contains all the keywords a DFCS designer might need. Translator programs convert the system specifications into an executable, high-level language program. The features of translators are discussed and are elucidated by examples. This language is used to describe a typical flight software module.

Rajan, N.↗
NASA NTRS1985

Comparison of GSFC and JPL VLBI modeling software: Benchmark

The Very Long Base Interferometry. The VLBI modeling software packages CALC 6.0 (GSFC) and MASTERFIT (JPL) are compared in some detail. Theoretical model delays are calculated for a set of 120 fictitious observations which involve a variety of sources, baselines, and antennas. Discrepancies between the total delays given by the two programs are of the order of 2 cm (RMS). The modeling of antenna offsets appears to account for approximately half of this difference. Relativistic bending contributions to the delay differ by 3 cm (RMS), and the there appears to be some mutual cancellation of errors involving antenna offsets, bending, and the effects of the two different Solar System ephemerides employed by CALC and MASTERFIT. This cancellation has not been completely characterized here.

Sovers, O. J.↗