SEARCH · Engineering Papers

Results for “error metric”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Characterizing the Reproducibility of Noisy Quantum Circuits

The ability of a quantum computer to reproduce or replicate the results of a quantum circuit is a key concern for verifying and validating applications of quantum computing. Statistical variations in circuit outcomes that arise from ill-characterized fluctuations in device noise may lead to computational errors and irreproducible results. While device characterization offers a direct assessment of noise, an outstanding concern is how such metrics bound the reproducibility of a given quantum circuit. Here, we first directly assess the reproducibility of a noisy quantum circuit, in terms of the Hellinger distance between the computational results, and then we show that device characterization offers an analytic bound on the observed variability. We validate the method using an ensemble of single qubit test circuits, executed on a superconducting transmon processor with well-characterized readout and gate error rates. The resulting description for circuit reproducibility, in terms of a composite device parameter, is confirmed to define an upper bound on the observed Hellinger distance, across the variable test circuits. This predictive correlation between circuit outcomes and device characterization offers an efficient method for assessing the reproducibility of noisy quantum circuits.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Aboveground woody biomass estimation of young bioenergy plantations of Populus and its hybrids using mobile (backpack) LiDAR remote sensing

Woody aboveground biomass (AGB) including short-rotation Populus is used as a feedstock for renewable and carbon-neutral bioenergy. While woody AGB can be estimated with allometric equations requiring labor-intensive field data, remote sensing technologies like mobile terrestrial light detection and ranging (LiDAR) can estimate woody AGB quickly and accurately. Therefore, the goals of this study were to develop a model to predict woody AGB of 2-year-old Populus spp. from three taxa (P. deltoides, P. deltoides × P. maximowiczii and P. deltoides × P. trichocarpa) using allometric (height and diameter at breast height (DBH)) or LiDAR-derived metrics from a mobile terrestrial (backpack) system. Likewise, we sought to compare LiDAR-estimated tree height and DBH with field-measured values. We found that a taxa-specific model containing LiDAR-measured tree height, crown volume, and taxa interactions with the height of the 10 th percentile, and the density of the lowest interval (density metric 0) explained 84 % of the variation in woody AGB with a root mean square error (RMSE) of 28.7 % and performed slightly better than the allometric model. The best model excluding taxa had a slightly higher RMSE but lower bias than the allometric model. LiDAR-derived tree heights were highly correlated with field-measured heights, but DBH could not be estimated accurately. Therefore, terrestrial mobile LiDAR systems can accurately estimate woody AGB and tree height of Populus in short rotation systems to aid in the fast and efficient quantification of woody bioenergy production and renewable energy resources.

AGB↗

DOE OSTI2026

Tracing U.S. fuel life-cycle greenhouse gas emissions in a multi-sector dynamics model using LC-GCAM

Model-based analysis of fuel pathways is essential for informing energy and environmental policy. Two major model types are typically used: multi-sector dynamics models, which capture the broader energy-economy, such as GCAM (Global Change Analysis Model), and life cycle assessment models, such as GREET (Greenhouse Gases, Regulated Emissions, and Energy Use in Transportation). Each has distinct strengths and limitations, and recent studies increasingly adopt hybrid approaches to harness the advantages of both. However, such integration is often time-consuming and complicated by inconsistencies in system boundaries and technology definitions. We present LC-GCAM, a new tool that enables estimation of life-cycle greenhouse gas emissions and primary energy use for any fuel pathway represented in GCAM. We apply LC-GCAM to 300 scenarios designed to explore key uncertainties affecting the life-cycle performance of future fuel options in the U.S. freight sector. To evaluate LC-GCAM, we compare its results with those from GREET for nine fuel types in a 2030 reference scenario. When input assumptions are modestly aligned, LC-GCAM and GREET estimates typically agree within 10% (absolute sum-based mean absolute percentage error). LC-GCAM offers a flexible and efficient approach to generating life-cycle metrics within an integrated modeling framework, supporting robust policy analysis across a wide range of interacting energy system uncertainties.

Wolfram, Paul↗

DOE OSTI2023

Probing Accuracy-Speedup Tradeoff in Machine Learning Surrogates for Molecular Dynamics Simulations

The performance promise of machine learning surrogates of molecular dynamics simulations of soft materials is significant but generally comes at the cost of acquiring large training datasets to learn the complex relationships between input soft material attributes and output properties. Under the constraint of limited high-performance computing resources, optimizing the size of the training datasets becomes paramount. Using an artificial neural network based surrogate for molecular dynamics simulations of confined electrolytes, we explore the tradeoff between surrogate accuracy and computational gains. Accuracy is assessed by computing the root-mean-square errors between the surrogate predictions and the ground truth results obtained via molecular dynamics simulations. The computational performance is judged by evaluating the speedup which incorporates the training dataset creation time. Improvement in accuracy occurs with a loss of speedup, which scales as the inverse of the training dataset size. Furthermore, the link between surrogate generalizability and the accuracy-speedup tradeoff is assessed by examining the errors incurred in surrogate predictions on unseen, interpolated input variables and developing a net speedup metric to capture the associated gains.

Anions↗

DOE OSTI2021

CONSTAX2: improved taxonomic classification of environmental DNA markers

Abstract Summary CONSTAX—the CONSensus TAXonomy classifier—was developed for accurate and reproducible taxonomic annotation of fungal rDNA amplicon sequences and is based upon a consensus approach of RDP, SINTAX and UTAX algorithms. CONSTAX2 extends these features to classify prokaryotes as well as eukaryotes and incorporates BLAST-based classifiers to reduce classification errors. Additionally, CONSTAX2 implements a conda-installable command-line tool with improved classification metrics, faster training, multithreading support, capacity to incorporate external taxonomic databases and new isolate matching and high-level taxonomy tools, replete with documentation and example tutorials. Availability and implementation CONSTAX2 is available at https://github.com/liberjul/CONSTAXv2, and is packaged for Linux and MacOS from Bioconda with use under the MIT License. A tutorial and documentation are available at https://constax.readthedocs.io/en/latest/. Data and scripts associated with the manuscript are available at https://github.com/liberjul/CONSTAXv2_ms_code. Supplementary information Supplementary data are available at Bioinformatics online.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS1985

Performance of a normalized energy metric without jammer state information for an FH/MFSK system in worst case partial band jamming

For a frequency-hopped noncoherent MFSK communication system without jammer state information (JSI) in a worst case partial band jamming environment, it is well known that the use of a conventional unquantized metric results in very poor performance. In this paper, a 'normalized' unquantized energy metric is suggested for such a system. It is shown that with this metric, one can save 2-3 dB in required signal energy over the system with hard decision metric without JSI for the same desired performance. When this very robust metric is compared to the conventional unquantized energy metric with JSI, the loss in required signal energy is shown to be small. Thus, the use of this normalized metric provides performance comparable to systems for which JSI is known. Cutoff rate and bit error rate with dual-k coding are used for the performance measures.

Lee, P. J.↗

NASA NTRS2017

Validation and Scaling of Soil Moisture in a Semi-Arid Environment: SMAP Validation Experiment 2015 (SMAPVEX15)

The NASA SMAP (Soil Moisture Active Passive) mission conducted the SMAP Validation Experiment 2015 (SMAPVEX15) in order to support the calibration and validation activities of SMAP soil moisture data products. The main goals of the experiment were to address issues regarding the spatial disaggregation methodologies for improvement of soil moisture products and validation of the in situ measurement upscaling techniques. To support these objectives high-resolution soil moisture maps were acquired with the airborne PALS (Passive Active L-band Sensor) instrument over an area in southeast Arizona that includes the Walnut Gulch Experimental Watershed (WGEW), and intensive ground sampling was carried out to augment the permanent in situ instrumentation. The objective of the paper was to establish the correspondence and relationship between the highly heterogeneous spatial distribution of soil moisture on the ground and the coarse resolution radiometer-based soil moisture retrievals of SMAP. The high-resolution mapping conducted with PALS provided the required connection between the in situ measurements and SMAP retrievals. The in situ measurements were used to validate the PALS soil moisture acquired at 1-km resolution. Based on the information from a dense network of rain gauges in the study area, the in situ soil moisture measurements did not capture all the precipitation events accurately. That is, the PALS and SMAP soil moisture estimates responded to precipitation events detected by rain gauges, which were in some cases not detected by the in situ soil moisture sensors. It was also concluded that the spatial distribution of the soil moisture resulted from the relatively small spatial extents of the typical convective storms in this region was not completely captured with the in situ stations. After removing those cases (approximately10 of the observations) the following metrics were obtained: RMSD (root mean square difference) of0.016m3m3 and correlation of 0.83. The PALS soil moisture was also compared to SMAP and in situ soil moisture at the 36-km scale, which is the SMAP grid size for the standard product. PALS and SMAP soil moistures were found to be very similar owing to the close match of the brightness temperature measurements and the use of a common soil moisture retrieval algorithm. Spatial heterogeneity, which was identified using the high-resolution PALS soil moisture and the intensive ground sampling, also contributed to differences between the soil moisture estimates. In general, discrepancies found between the L-band soil moisture estimates and the 5-cm depth in situ measurements require methodologies to mitigate the impact on their interpretations in soil moisture validation and algorithm development. Specifically, the metrics computed for the SMAP radiometer-based soil moisture product over WGEW will include errors resulting from rainfall, particularly during the monsoon season when the spatial distribution of soil moisture is especially heterogeneous.

SMAPVEX15↗

NASA NTRSDate not supplied

Nearfield Anisotropic Mesh Adaptation for the Third AIAA Sonic Boom Workshop

Sonic boom prediction is critical for the development of low-boom supersonic aircraft and encouraging a replacement of the overland commercial supersonic ban with a certification standard. The Third AIAA Sonic Boom Workshop nearfield test cases provide a unique opportunity to review anisotropic adaptive-mesh strategies for complex geometries with important propulsion interaction effects. Anisotropic metrics formulated to control estimated Mach interpolation and integrated nearfield pressure signature (goal-oriented) errors are compared with the results obtained on workshop-provided meshes. Detailed flow solutions and mesh renderings are combined with computational schlieren images to reveal the complex interactions present in a shock-plume interaction wind tunnel model and a prototype of the Low-Boom Flight Demonstrator. A favorable comparison of independent implementations of the entire simulation process provides evidence that each process is implemented correctly and sets a solid foundation for confidence in the nearfield prediction of each method.

sonic boom↗

NASA NTRSDate not supplied

Evaluating GXS Impact in the Context of International Coordination

The proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) program plans to include a hyperspectral infrared (IR) sounder on its central satellite. Expected to launch in the mid-2030s, the GeoXO Sounder (GXS) will join international counterparts in a geostationary orbit. Ahead of launch, the NASA Global Modeling and Assimilation Office (GMAO) assessed the potential effectiveness of GXS both as a single GEO IR sounder and as part of a global ring of such instruments, including those already being built by international agencies. Using an observing system simulation experiment (OSSE) framework, GXS was assessed from a global numerical weather prediction (NWP) perspective. The ability of GXS, both alone and as part of a global ring of GEO sounders, to improve weather prediction of thermodynamic variables was evaluated globally and regionally. Compared to a control, GXS dominated regional analysis and forecast improvements, and contributed significantly to global increases in forecast skill. However, more sustained global improvements on the order of 4 days rely on international partnerships. Using the FSOI metric over CONUS, the GXS observations provide the strongest radiance impact on the moist energy error norm reduction. Additionally, GXS shows the capability to improve hurricane forecast track errors, resulting in improved forecast warnings. Overall, the persistent atmospheric profile information from GXS over much of the western hemisphere provide an opportunity to improve the representation of weather systems and their forecasts.

Erica McGrath-Spangler↗

NASA NTRSDate not supplied

Evaluating GXS Impact in the Context of International Coordination

Erica McGrath-Spangler↗

DOE OSTI2023

The Effects of Gamma Ray Integrated Dose on a Commercial 65-nm SRAM Device

Here this work shows that the static random access memory (SRAM) error rate for a commercial 65-nm device in a dose rate environment can be highly dependent upon the integrated dose (dose rate × pulse duration). While the typical metric for such testing is dose rate upset (DRU) level in rad(Si)/s, a series of dose rate experiments at Little Mountain Test Facility (LMTF) shows dependence on the integrated dose. The error rate is also found to be dependent on the core voltage, and the preradiation value of the bits. We believe that these effects are explained by a well charge depletion caused by gamma ray photocurrent.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

NASA NTRS1998

Radial Velocity Detection of Extra-Solar Planetary Systems

The McDonald Observatory Planetary Search (MOPS) was designed to search for Jovian-mass planets in orbit around solar-type stars by making high-precision measurements of the Radial Velocity (RV) of a star, to attempt to detect the reflex orbital motion of the star around the star-planet barycenter. In our solar system, the velocity of the Sun around the Sun-Jupiter barycenter averages 12.3 m/ s. The MOPS survey started operation in September 1987, and searches 36 bright, nearby, solar-type dwarfs to 10 m/s precision. The survey was started using telluric O2 absorption lines as the velocity reference metric. Observations use the McDonald Observatory 2.7-m Harlan Smith Telescope coude spectrograph with the six-foot camera. This spectrograph configuration isolates a single order of the echelle grating on a Texas Instruments 800 x 800 CCD. The telluric line method gave us a routine radial velocity precision of about 15 m/s for stars down to about 5-th magnitude. However, the data obtained with this technique suffered from some source of long-term systematic errors, which was probably the intrinsic velocity variability of the terrestrial atmosphere, i.e. winds. In order to eliminate this systematic error and to improve our overall measurement precision, we installed a stabilized I2 gas absorption cell as the velocity metric for the MOPS in October 1990. In use at the telescope, the cell is placed directly in front of the spectrograph entrance slit, with starlight passing through the cell. The use of this sealed stabilized I2 cell removes potential problems with possible long-term drifts in the velocity metric. The survey now includes a sample of 36 nearby F, G, and K type stars of luminosity class V or IV-V.

Cochran, William D.↗

NASA NTRS2019

User Manual for Physical Scalars and Plotting Tools in Scala

An open-source scalar package and associated software tools have been developed in the Scala programming language, including plotting tools based on the free GRACE plotting package. The scalar package represents physical scalars and can help to prevent errors involving physical units in engineering and scientific computation. The scalar package includes a complete implementation of the standard SI metric system of units and many common non-metric units. The design also allows users to easily de ne a specialized or reduced set of physical units for any particular application or domain. The scalar package can be used in two different modes: one mode provides unit compatibility checking but is slower, and the other mode bypasses the compatibility checks but is much faster and still prevents the most common type of unit error. Switching between the two modes requires no changes in the user's code, making it convenient and usable with no significant performance penalty for even the most computationally intensive applications.

Paielli, Russell A.↗

NASA NTRS2016

Field Test: Results of Tandem Walk Performance Following Long-Duration Spaceflight

BACKGROUND: Coordinated locomotion has proven to be challenging for many astronauts following long duration spaceflight. As NASA's vision for spaceflight points toward interplanetary travel, we must prepare for unassisted landings, where crewmembers may need to perform mission critical tasks within minutes of landing. Thus, it is vital to develop a knowledge base from which operational guidelines can be written that define when astronauts can be expected to safely perform certain tasks. Data obtained during the Field Test experiment (FT) will add important insight to this knowledge base. Specifically, we aim to develop a recovery timeline of functional sensorimotor performance during the first 24 hours and several days after landing. METHODS: FT is an ongoing study of 30 long-duration ISS crewmembers. Thus far, 9 have completed the full FT (5 U.S. Orbital Segment [USOS] astronauts and 4 Russian cosmonauts) and 4 more consented and launching within the next year. This is in addition to the eighteen crewmembers that participated in the pilot FT (11 USOS and 7 Russian crewmembers). The FT is conducted three times preflight and three times during the first 24 hours after landing. All crewmembers were tested in Kazakhstan in either the medical tent at the Soyuz landing site (~one hour post-landing), or at the airport (~four hours post-landing). The USOS crewmembers were also tested at the refueling stop (~12 hours post-landing) and at the NASA Johnson Space Center (~24 hours post-landing) and a final session 7 days post-landing. Crewmembers are instrumented with 9 inertial measurement unit sensors that measure acceleration and angular displacement (APDM's Emerald Sensors) and foot pressure-sensing insoles that measure force, acceleration, and center of pressure (Moticon GmbH, Munich, Germany) along with heart rate and blood pressure recording instrumentation. The FT consists of 12 tasks, but here we will focus on the most challenging task, the Tandem Walk, which was also performed as part of pilot FT. To perform the Tandem Walk, subjects begin with their feet together, their arms crossed at their chest and eyes closed. When ready, they brought one foot forward and touched the heel of their foot to their toe, repeating with the other foot, and continuing for about 10 steps. Three trials were collected with the eyes closed and a fourth trial was collected with eyes open. There are four metrics which are used to determine the performance level of the Tandem Walk. The first is percent correct steps. For a step to be counted as correct, the foot could not touch the ground while bringing it forward (no side stepping), eyes must stay closed during the eyes closed trials, the heel and toe should be touching, or almost touching (no large gaps) and there shouldn't be more than a three second pause between steps. Three judges score each step and the median of the three scores is kept. The second metric is the average step speed, or the number of steps/time to complete them. Thirdly, the root mean squared (RMS) error in the resultant trunk acceleration is used to determine the amount of upper body instability observed during the task. Finally, the RMS error of the mediolateral center of pressure as measured by the Moticon insoles is used to determine the mediolateral instability at the foot level. These four parameters are combined into a new overall Tandem Walk Parameter. RESULTS: Preliminary results show that crewmembers perform the Tandem Walk significantly worse the first 24 hours after landing as compared to their baseline performance. We find that each of the four performance metrics is significantly worse immediately after landing. We will present the results of tandem walk performance during the FT thus far. We will also combine these with the 18 crewmembers that participated in the pilot FT, concentrating on the level of performance and recovery rate. CONCLUSION: The Tandem Walk data collected as part of the FT experiment will provide invaluable information on the performance capabilities of astronauts during the first 24 hours after returning from long-duration spaceflight that can be used in planning future Mars, or other deep-space missions with unassisted landings. FT will determine the average sensorimotor recovery timeline and inform return-to-duty guidelines for unassisted landings.

Rosenberg, M. J. F.↗

NASA NTRS2012

Achieving Accuracy Requirements for Forest Biomass Mapping: A Spaceborne Data Fusion Method for Estimating Forest Biomass and Lidar Sampling Error

The synergistic use of active and passive remote sensing (i.e., data fusion) demonstrates the ability of spaceborne light detection and ranging (LiDAR), synthetic aperture radar (SAR) and multispectral imagery for achieving the accuracy requirements of a global forest biomass mapping mission (+/-20 Mg/ha or 20%, the greater of the two, for at least 80% of grid cells). A data fusion approach also provides a means to extend 3D information from discrete spaceborne LiDAR measurements of forest structure across scales much larger than that of the LiDAR footprint. For estimating biomass, these measurements mix a number of errors including those associated with LiDAR footprint sampling over regional-global extents. A general framework for mapping above ground live forest biomass density (AGB) with a data fusion approach is presented and verified using data from NASA field campaigns near Howland, ME, USA, to assess AGB and LiDAR sampling errors across a regionally representative landscape. We combined SAR and Landsat-derived optical (passive optical) image data to identify contiguous areas (>0.5 ha) that are relatively homogenous in remote sensing metrics (forest patches). We used this image-derived data with simulated spaceborne LiDAR derived from orbit and cloud cover simulations and airborne data from NASA's Laser Vegetation Imaging Sensor (LVIS) to compute AGB and estimate LiDAR sampling error for forest patches and 100 m, 250 m, 500 m, and 1 km grid cells. At both the patch and grid scales, we evaluated differences in AGB estimation and sampling error from the combined use of LiDAR with both SAR and passive optical and with either SAR or passive optical alone. First, this data fusion approach demonstrates that incorporating forest patches into the AGB mapping framework can provide sub-grid forest information for coarser grid-level AGB reporting. Second, a data fusion approach for estimating AGB using simulated spaceborne LiDAR with SAR and passive optical image combinations reduced forest AGB sampling errors 12%-38% from those where LiDAR is used with SAR or passive optical alone. In absolute terms, sampling errors were reduced from 14-40 Mg/ha to 11-28 Mg/ha across all grid scales and prediction methods, where minimum sampling errors were 11, 15, 18, and 22 Mg/ha for 1 km, 500 m, 250 m, and 100 m grid scales, respectively. Third, spaceborne global scale accuracy requirements were achieved whereby at least 80% of the grid cells at 100 m, 250 m, 500 m, and 1 km grid levels met AGB accuracy requirements using a combination of passive optical and SAR along with machine learning methods to predict vegetation structure metrics for forested areas without LiDAR samples. Finally, using either passive optical or SAR, accuracy requirements were met at the 500 m and 250 m grid level, respectively..

LiDAR↗

NASA NTRS2003

Early Mission Orbit Determination Error Analysis Results for Low-Earth Orbiting Missions using TDRSS Differenced One-way Doppler Tracking Data

Differencing multiple, simultaneous Tracking and Data Relay Satellite System (TDRSS) one-way Doppler passes can yield metric tracking data usable for orbit determination for (low-cost) spacecraft which do not have TDRSS transponders or local oscillators stable enough to allow the one-way TDRSS Doppler tracking data to be used for early mission orbit determination. Orbit determination error analysis results are provided for low Earth orbiting spacecraft for various early mission tracking scenarios.

Marr, Greg C.↗

NASA NTRS1989

Quantization effects in Viterbi decoding rate 1/n convolutional codes

A Viterbi decoder's performance loss due to quantizing data from the additive white Gaussian noise (AWGN) channel is studied. An optimal quantization scheme and branch metric calculation method are presented. The uniformly quantized channel capacity C(sub u)(q) is used to determine the smallest number of quantization bits q that does not cause a significant loss. The quantizer stepsize which maximizes C(sub u)(q) almost minimizes the decoder bit error rate (BER). However, a slightly larger stepsize is better, like the value that minimizes the Bhattacharyya bound. The range and renormalization of state metrics is analyzed, in particular for K = 15 decoders such as the Big Viterbi Decoder (BVD) for the Galileo mission. These results are required to design reduced hardware complexity Viterbi decoders with a negligible quantization loss.

Onyszchuk, I. M.↗

DOE OSTI2022

Numerical Modeling of the Effects of Coating Plates on Terminal Ballistic Performance

This report deals with the development and evaluation of a numerical model to examine applied coating to a metal substrate subjected to a ballistic impact. The numerical model will be used to examine the benefit of the coating in resisting penetration due to the impact. For a detailed examination the Retch-Ipson curve is used as a metric. The numerical data is plotted and then fit to the Retch-Ipson curve and error calculations are used to compare the difference between the numerical output and the experimental data. This initial study is an examination of a few shortcomings of the standard material models used, and demonstrate the future work that is needed to understand the ballistic behavior of materials.

36 MATERIALS SCIENCE↗