Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Rapid and flexible segmentation of electron microscopy data using few-shot machine learning

Abstract Automatic segmentation of key microstructural features in atomic-scale electron microscope images is critical to improved understanding of structure–property relationships in many important materials and chemical systems. However, the present paradigm involves time-intensive manual analysis that is inherently biased, error-prone, and unable to accommodate the large volumes of data produced by modern instrumentation. While more automated approaches have been proposed, many are not robust to a high variety of data, and do not generalize well to diverse microstructural features and material systems. Here, we present a flexible, semi-supervised few-shot machine learning approach for segmentation of scanning transmission electron microscopy images of three oxide material systems: (1) epitaxial heterostructures of SrTiO 3 /Ge, (2) La 0.8 Sr 0.2 FeO 3 thin films, and (3) MoO 3 nanoparticles. We demonstrate that the few-shot learning method is more robust against noise, more reconfigurable, and requires less data than conventional image analysis methods. This approach can enable rapid image classification and microstructural feature mapping needed for emerging high-throughput characterization and autonomous microscope platforms.

36 MATERIALS SCIENCE↗
DOE OSTI2014

THE SPIN OF THE BLACK HOLE 4U 1543-47

We present a new analysis of Rossi X-Ray Timing Explorer observations of the 2002 outburst of the transient X-ray nova 4U 1543-47. We focus on observations in the high/soft state, and attempt to measure the ''spin'' of the black hole by simultaneously fitting the thermal disk continuum and by modeling the broadened iron k-shell emission lines and additional blurred reflection features. Previous works have found that use of these methods individually returns contradictory values for the dimensionless spin parameter a {sub *} = cJ/GM {sup 2}. We find that when used in conjunction with each other, a moderate spin is obtained (a{sub ∗}=0.43{sub −0.31}{sup +0.22}) that is actually consistent with both other values within errors. We discuss limitations of our analysis, systematic uncertainties, and implications of this measurement, and compare our result to those previously claimed for 4U 1543-47.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

STELLAR LOCI. I. METALLICITY DEPENDENCE AND INTRINSIC WIDTHS

Stellar loci are widely used for selection of interesting outliers, reddening determinations, and calibrations. However, until now, the dependence of stellar loci on metallicity has not been fully explored, and their intrinsic widths are unclear. In this paper, by combining the spectroscopic and recalibrated imaging data of the Sloan Digital Sky Survey (SDSS) Stripe 82, we have built a large, clean sample of dwarf stars with accurate colors and well-determined metallicities to investigate the metallicity dependence and intrinsic widths of the SDSS stellar loci. Typically, 1 dex decrease in metallicity causes 0.20 and 0.02 mag decrease in colors u – g and g – r and 0.02 and 0.02 mag increase in colors r – i and i – z, respectively. The variations are larger for metal-rich stars than for metal-poor ones, and larger for F/G/K stars than for A/M ones. Using the sample, we have performed two-dimensional polynomial fitting to the u – g, g – r, r – i, and i – z colors as a function of color g – i and metallicity [Fe/H]. The residuals, at the level of 0.029, 0.008, 0.008, and 0.011 mag for the u – g, g – r, r – i, and i – z colors, respectively, can be fully accounted for by the photometric errors and metallicity uncertainties, suggesting that the intrinsic widths of the loci are at maximum a few millimagnitudes. The residual distributions are asymmetric, revealing that a significant fraction of stars are binaries. In a companion paper, we will present an unbiased estimate of the binary fraction for field stars. Other potential applications of the metallicity-dependent stellar loci are briefly discussed.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

A quantitative assessment of the model form error of friction models across different interface representations for jointed structures

Hysteretic models are widely used to model frictional interactions in joints to recreate experimental behavior. However, it is unclear which models are best suited for fitting or predicting the responses of structures. Here, the present study evaluates 26 friction model/interface representation combinations to quantify the model form error. A Quasi-Static Modal Analysis approach (termed Rayleigh Quotient Nonlinear Modal Analysis) is adopted to calculate the nonlinear system response, and a Multi-Objective Optimization is solved to fit experimental data of the first mode of the Brake-Reuß Beam. Optimized parameters from the first mode are applied to the second and third bending modes to quantify the predictive ability of the models. Formulations for both tracing full hysteresis loops and recreating hysteresis loops from a single loading curve (Masing assumptions) are considered. Smoothly varying models applied to a five patch representation showed the highest flexibility (for fitting mode 1) and good predictive potential (for modes 2 and 3). For a second formulation, which uses 152 frictional elements to represent the interface, the physically motivated spring in series with a Coulomb slip model (elastic dry friction) has high error for fitting mode 1 and performs near the middle for predicting higher modes. For both interface representation, the best fit models are not the most physical, but rather the ones with the most parameters (as expected); however, the more physical models perform somewhat better for predicting the higher modes.

42 ENGINEERING↗
DOE OSTI2025

Demonstration of TOFFEE: A Response Uncertainty Quantification Tool

A key characteristic in neutron transport is nuclear data. Cross-section uncertainty is not used in MCNP6.3 to propagate response uncertainty without external analysis. Here, the TOol For Fast Error Estimation (TOFFEE) is a Python-based code developed to automate the propagation of cross-section uncertainty for MCNP evaluations. TOFFEE implements the sandwich rule to calculate the uncertainty from cross sections with sensitivity coefficients from MCNP6.3 and ENDF/B covariance data. In this paper, TOFFEE has been tested with benchmark experiments, and it has been compared to the uncertainty quantification capabilities of Sampler and TSUNAMI, within SCALE, to verify the application’s capabilities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Multiresolution Quantum Chemistry: Nonlinear Response Properties at the Basis Set Limit

We benchmark the accuracy of Dunning correlation-consistent Gaussian basis sets for computing frequencydependent second-order hyperpolarizabilities relevant to second-harmonic generation (SHG), using multiresolution analysis (MRA) as a reference. Basis set errors are analyzed using a unit-sphere representation of the effective hyperpolarizability vector, enabling direct assessment of directional error structure. We introduce a relative RMS total error metric that integrates directional deviations over the unit sphere and complement it with signed projection errors that distinguish over- and underestimation. Unsupervised clustering based on these signed directional metrics reveals four distinct convergence behaviors across a set of 68 molecules. Unitsphere visualizations of representative systems show that basis set errors are often highly anisotropic and localized along specific bond directions, even when global error measures appear small. Doubly augmented basis sets consistently outperform singly augmented ones, and core-polarization functions are required for uniform convergence in second-row systems. Overall, this work demonstrates that directional analysis combined with clustering provides a robust framework for understanding basis set convergence in nonlinear optical response properties.

Basis sets↗
DOE OSTI2015

STELLAR COLOR REGRESSION: A SPECTROSCOPY-BASED METHOD FOR COLOR CALIBRATION TO A FEW MILLIMAGNITUDE ACCURACY AND THE RECALIBRATION OF STRIPE 82

In this paper we propose a spectroscopy-based stellar color regression (SCR) method to perform accurate color calibration for modern imaging surveys, taking advantage of millions of stellar spectra now available. The method is straightforward, insensitive to systematic errors in the spectroscopically determined stellar atmospheric parameters, applicable to regions that are effectively covered by spectroscopic surveys, and capable of delivering an accuracy of a few millimagnitudes for color calibration. As an illustration, we have applied the method to the Sloan Digital Sky Survey (SDSS) Stripe 82 data. With a total number of 23,759 spectroscopically targeted stars, we have mapped out the small but strongly correlated color zero-point errors present in the photometric catalog of Stripe 82, and we improve the color calibration by a factor of two to three. Our study also reveals some small but significant magnitude dependence errors in the z band for some charge-coupled devices (CCDs). Such errors are likely to be present in all the SDSS photometric data. Our results are compared with those from a completely independent test based on the intrinsic colors of red galaxies presented by Ivezić et al. The comparison, as well as other tests, shows that the SCR method has achieved a color calibration internally consistent at a level of about 5 mmag in u – g, 3 mmag in g – r, and 2 mmag in r – i and i – z. Given the power of the SCR method, we discuss briefly the potential benefits by applying the method to existing, ongoing, and upcoming imaging surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Toward Accurate Modeling of Galaxy Clustering on Small Scales: Constraining the Galaxy-halo Connection with Optimal Statistics

Applying halo models to analyze the small-scale clustering of galaxies is a proven method for characterizing the connection between galaxies and their host halos. Such works are often plagued by systematic errors or limited to clustering statistics that can be predicted analytically. In this work, we employ a numerical mock-based modeling procedure to examine the clustering of Sloan Digital Sky Survey DR7 galaxies. We apply a standard halo occupation distribution (HOD) model to dark matter only simulations with a ΛCDM cosmology. To constrain the theoreStical models, we utilize a combination of galaxy number density and selected scales of the projected correlation function, redshift-space correlation function, group multiplicity function, average group velocity dispersion, mark correlation function, and counts-in-cells statistics. We design an algorithm to choose an optimal combination of measurements that yields tight and accurate constraints on our model parameters. Compared to previous work using fewer clustering statistics, we find a significant improvement in the constraints on all parameters of our halo model for two different luminosity-threshold galaxy samples. Most interestingly, we obtain unprecedented high-precision constraints on the scatter in the relationship between galaxy luminosity and halo mass. However, our best-fit model results in significant tension (>4σ) for both samples, indicating the need to add second-order features to the standard HOD model. To guarantee the robustness of these results, we perform an extensive analysis of the systematic and statistical errors in our modeling procedure, including a first of its kind study of the sensitivity of our constraints to changes in the halo mass function due to baryonic physics.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Capturing Maize Stand Heterogeneity Across Yield-Stability Zones Using Unmanned Aerial Vehicles (UAV)

Despite the new equipment capabilities, uneven crop stands are still common occurrences in crop fields, mainly due to spatial heterogeneity in soil conditions, seedling mortality due to herbivore predation and disease, or human error. Non-uniform plant stands may reduce grain yield in crops like maize. Thus, detecting signs of variability in crop stand density early in the season provides critical information for management decisions and crop yield forecasts. Processing techniques applied on images captured by unmanned aerial vehicles (UAVs) has been used successfully to identify crop rows and estimate stand density and, most recently, to estimate plant-to-plant interval distance. Here, we further test and apply an image processing algorithm on UAV images collected from yield-stability zones in a commercial crop field. Our objective was to implement the algorithm to compare variation of plant-spacing intervals to test whether yield differences within these zones are related to differences in crop stand characteristics. Our analysis indicates that the algorithm can be reliably used to estimate plant counts (precision >95% and recall >97%) and plant distance interval (R2 ~0.9 and relative error <10%). Analysis of the collected data indicated that plant spacing variability differences were small among plots with large yield differences, suggesting that it was not a major cause of yield variability across zones with distinct yield history. This analysis provides an example of how plant-detection algorithms can be applied to improve the understanding of patterns of spatial and temporal yield variability.

47 OTHER INSTRUMENTATION↗
DOE OSTI2014

Stellar chemical abundances: in pursuit of the highest achievable precision

The achievable level of precision on photospheric abundances of stars is a major limiting factor on investigations of exoplanet host star characteristics, the chemical histories of star clusters, and the evolution of the Milky Way and other galaxies. While model-induced errors can be minimized through the differential analysis of spectrally similar stars, the maximum achievable precision of this technique has been debated. As a test, we derive differential abundances of 19 elements from high-quality asteroid-reflected solar spectra taken using a variety of instruments and conditions. We treat the solar spectra as being from unknown stars and use the resulting differential abundances, which are expected to be zero, as a diagnostic of the error in our measurements. Our results indicate that the relative resolution of the target and reference spectra is a major consideration, with use of different instruments to obtain the two spectra leading to errors up to 0.04 dex. Use of the same instrument at different epochs for the two spectra has a much smaller effect (∼0.007 dex). The asteroid used to obtain the solar standard also has a negligible effect (∼0.006 dex). Assuming that systematic errors from the stellar model atmospheres have been minimized, as in the case of solar twins, we confirm that differential chemical abundances can be obtained at sub-0.01 dex precision with due care in the observations, data reduction, and abundance analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

A non-intrusive optical (NIO) approach to characterize heliostats in utility-scale power tower plants: Sensitivity study

Power towers, a type of concentrating power tower technology, use a large number of heliostats to concentrate sunlight and produce renewable energy. Optical errors of heliostats can cause drastic losses in the efficiency of power-tower plants. Accurately measuring optical errors is crucial to assessing and improving plant performance. This analysis discusses an innovate non-intrusive optical (NIO) approach to measure slope, canting, and tracking errors by detecting distortions in the reflected tower structure in heliostat images. Further in this work a sensitivity study is carefully conducted to determine the uncertainty requirements to allow the method to calculate slope errors with an accuracy of 0.25 mrad. Measurement uncertainty sources include camera resolution and position uncertainty, tower position uncertainty, and number of collected images. Each uncertainty source is investigated to determine its impact on the accuracy of the slope-error calculation. A combination of theoretical results and experimental results obtained from data collected on a heliostat at Sandia National Laboratories is used to determine and validate uncertainty requirements. The analysis shows that a measurement uncertainty of 0.25 mrad can be realized by realistically controlling uncertainty sources when implementing the NIO method. It demonstrates the superior performance of NIO in performing in-situ optical characterization.

14 SOLAR ENERGY↗
DOE OSTI2020

Construction of a Code Verification Matrix for Heat Conduction With Finite Element Code Applications

When establishing the pedigree of a simulation tool, code verification is used to ensure that the implemented numerical algorithm is a faithful representation of its underlying mathematical model. During this process, numerical results on various meshes are systematically compared to a reference analytic solution. The selection of analytic solutions can be a laborious process, as it is difficult to establish adequate code confidence without performing redundant work. In this report we address this issue by applying a physics-based process that establishes a set of reference problems. In this process, code simulation options are categorized and systematically tested, which ensures that gaps in testing are easily identified and addressed. The resulting problems are primarily intended for code verification analysis but may also be useful for comparison to other simulation codes, troubleshooting activities, or training exercises. The process is used to select fifteen code verification problems relevant for the one-dimensional steady-state heat conduction equation. These problems are applicable to a wide variety of simulation tools, but, in this work, a demonstration is performed using the finite element-based nuclear fuel performance code BISON. Convergence to the analytic solution at the theoretical rate is quantified for a selection of the problems, which establishes a baseline pedigree for the code. Not only can this standard set of conduction solutions be used for verification of other codes, but also the physics-based process for selecting problems can be utilized to quantify and expand testing for any simulation tool.

42 ENGINEERING↗
DOE OSTI2020

Measurement Uncertainty in One-Of-A-Kind Event Data Analysis

A golden standard in science is to repeat an experiment a statistically significant number of times, recording data using the same set of detectors and the same data analysis methodology. In such case experimental error includes both the range of true values generated by repetitions of the experiment, and measurement uncertainty caused by the detector. They are independent. It is a huge and too frequently used simplification, to assume that one can measure multiple repetitions of an identical experiment, resulting in identical true experimental value. Repetitions, as similar is it is experimentally achievable, have unavoidable built-in differences resulting in a range of the true values rather than in a single value. When modern, very sensitive and well calibrated measurement systems are used, this range is not negligible, and sometimes dominates over the measurement uncertainty. Range of true values depends on built-in differences in physics of the experiment. Stochastic physical processes result typically in a broader range of true values than non-stochastic processes do. Measurement uncertainty depends on a measurement method (properties of the detector not of the experiment). Modern measurement methods, including digital ones, frequently make the measurement uncertainty very small. When data from one–of –a kind experiment are analyzed, only the measurement uncertainty is reported. It provides no information about the range of true experimental values, neither about reliability of a reported data point. Reliability of a data point is in general independent from its measurement uncertainty. However, in practice reliable measurement methods frequently have high measurement uncertainty, while low reliability methods are applied to limit measurement uncertainty. Comparison of reliable data with high measurement uncertainty to not so reliable data measured with low uncertainty is discussed – in different scenarios different data analysis methods are applicable. Methods for data analysis from an experiment repeated statistically significant number of times are very well developed. They do not require a detailed expertise in physics of an experiment, nor in the properties of the measurement system used, and meaning of the reported uncertainty is well understood in any scientific community. It all changes when data from one-of-a-kind experiment is analyzed. Analyst’s expertise is required both in the physics of the experiment and in all aspects of the measurement system, all possible malfunctions. Data users must remember that only measurement uncertainty is reported from any one-of-a-kind experiment. Theory with simulations may provide estimation of expected built-in differences in the experiment, and by this of expected range of true values for a given experiment; yet measurement uncertainty can never be used in place of the range of true experimental values.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Comparison of chamber beam geometry robustness to mispointing, imbalance and target offset for direct-drive laser fusion facilities

This study focuses on the optimization of beam chamber geometry designs for future direct-drive laser facilities. It provides a review of leading target chamber geometries, with a particular emphasis on random errors. Through comprehensive solid-sphere illuminations and analysis, we identify an optimized beam geometry design, highlighting its robustness and performance under realistic experimental conditions. Three major sources of random errors are evaluated, closely linked to experimental evaluations at OMEGA. The findings underscore the importance of optimizing the irradiation system alongside beam pattern considerations to enhance the efficiency and reliability of inertial confinement fusion experiments. We conclude that for a desired illumination uniformity of 1% in the presence of system errors, the split icosahedron design is the most robust. However, for a 0.3% uniformity goal, the charged-particle, icosahedron, and t-sphere methods exhibit similar performance.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Uncertainty about the Uncertainty [Slides]

A golden standard in science is to repeat an experiment a statistically significant number of times, recording data using the same set of detectors and the same data analysis methodology. In such case experimental error includes both the range of true values generated by repetitions of the experiment, and measurement uncertainty caused by the detector. They are independent. It is a huge and too frequently used simplification, to assume that one can measure multiple repetitions of an identical experiment, resulting in identical true experimental value. Repetitions, as similar is it is experimentally achievable result in a range of the true values rather than in a single value. When modern, very sensitive and well calibrated measurement systems are used, this range is not negligible, and sometimes dominates, in comparison to the measurement uncertainty. Range of true values depends on the physics of the experiment, while measurement uncertainty depends on the measurement method (properties of the detector not of the experiment). When data from one–of–a kind experiment are analyzed, only the measurement uncertainty is reported. It gives no information about the range, in which the true values of experiment would spread if the experiment was repeated. A frequently used approximation, that if a physical quantity is measured as a function of time, only measurement of this quantity, produces uncertainty is also in some real experiments fare to strong. Example: In reaction history time measurement uncertainty propagated to alpha dominated under certain conditions over the flux measurement uncertainty propagated to alpha. Reliability of a data point is in general independent from its measurement uncertainty. However, in practice reliable measurement methods frequently have high measurement uncertainty, while low reliability methods are applied to limit measurement uncertainty. Comparison of reliable data with high measurement uncertainty to not so reliable data measured with low uncertainty is discussed – in different scenarios different data analysis methods are applicable.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Dark energy survey internal consistency tests of the joint cosmological probes analysis with posterior predictive distributions

Beyond ΛCDM, physics or systematic errors may cause subsets of a cosmological data set to appear inconsistent when analysed assuming ΛCDM. Here, we present an application of internal consistency tests to measurements from the Dark Energy Survey Year 1 (DES Y1) joint probes analysis. Our analysis relies on computing the posterior predictive distribution (PPD) for these data under the assumption of ΛCDM. We find that the DES Y1 data have an acceptable goodness of fit to ΛCDM, with a probability of finding a worse fit by random chance of p = 0.046. Using numerical PPD tests, supplemented by graphical checks, we show that most of the data vector appears completely consistent with expectations, although we observe a small tension between large- and small-scale measurements. A small part (roughly 1.5 per cent) of the data vector shows an unusually large departure from expectations; excluding this part of the data has negligible impact on cosmological constraints, but does significantly improve the p-value to 0.10. The methodology developed here will be applied to test the consistency of DES Year 3 joint probes data sets.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Calibration of reactive burn and Jones-Wilkins-Lee parameters for simulations of a detonation-driven flow experiment with uncertainty quantification

Here, uncertainties in the explosive-specific parameters of the Jones-Wilkins-Lee (JWL) equation of state (EOS) are carefully considered in hydrodynamic simulations of an explosive experiment to minimize the error in the flow prediction. Experimental data of the leading shock position in the transverse direction over time serves as the prediction metric for quantifying simulation prediction error. The uncertainty quantification technique, global sensitivity analysis, is utilized to determine the JWL parameters to which the transverse shock propagation is most sensitive. A polynomial response surface (PRS) is constructed in the space of the most influential JWL parameters, and the point of minimum error between the experimental data and the PRS yields calibrated JWL parameters for the experimental flow. The simulation results following the parameter calibration show good agreement with the experimental data. It was found that two significant parameters, the heat release per unit mass of reactant Q and JWL model exponent R 1 are strongly related, which makes it difficult to identify accurate values.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Processing Aleatory and Epistemic Uncertainties in Experimental Data From Sparse Replicate Tests of Stochastic Systems for Real-Space Model Validation

This paper presents a practical methodology for propagating and processing uncertainties associated with random measurement and estimation errors (that vary from test-to-test) and systematic measurement and estimation errors (uncertain but similar from test-to-test) in inputs and outputs of replicate tests to characterize response variability of stochastically varying test units. Also treated are test condition control variability from test-to-test and sampling uncertainty due to limited numbers of replicate tests. These aleatory variabilities and epistemic uncertainties result in uncertainty on computed statistics of output response quantities. The methodology was developed in the context of processing experimental data for “real-space” (RS) model validation comparisons against model-predicted statistics and uncertainty thereof. The methodology is flexible and sufficient for many types of experimental and data uncertainty, offering the most extensive data uncertainty quantification (UQ) treatment of any model validation method the authors are aware of. It handles both interval and probabilistic uncertainty descriptions and can be performed with relatively little computational cost through use of simple and effective dimension- and order-adaptive polynomial response surfaces in a Monte Carlo (MC) uncertainty propagation approach. A key feature of the progressively upgraded response surfaces is that they enable estimation of propagation error contributed by the surrogate model. Sensitivity analysis of the relative contributions of the various uncertainty sources to the total uncertainty of statistical estimates is also presented. Finally, the methodologies are demonstrated on real experimental validation data involving all the mentioned sources and types of error and uncertainty in five replicate tests of pressure vessels heated and pressurized to failure. Simple spreadsheet procedures are used for all processing operations.

97 MATHEMATICS AND COMPUTING↗