Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

Evidence for Universality in the Initial Planetesimal Mass Function

Planetesimals may form from the gravitational collapse of dense particle clumps initiated by the streaming instability. We use simulations of aerodynamically coupled gas–particle mixtures to investigate whether the properties of planetesimals formed in this way depend upon the sizes of the particles that participate in the instability. Based on three high-resolution simulations that span a range of dimensionless stopping times 6×10{sup −3}⩽τ⩽2, no statistically significant differences in the initial planetesimal mass function are found. The mass functions are fit by a power law, dN/dM{sub p}∝M{sub p}{sup −p}, with p = 1.5–1.7 and errors of Δp≈0.1. Comparing the particle density fields prior to collapse, we find that the high-wavenumber power spectra are similarly indistinguishable, though the large-scale geometry of structures induced via the streaming instability is significantly different between all three cases. We interpret the results as evidence for a near-universal slope to the mass function, arising from the small-scale structure of streaming-induced turbulence.

79 ASTRONOMY AND ASTROPHYSICS↗

Data Collection and Analysis Challenges and Mitigation Strategies for Quantitative Human Factors Research Studies in Nuclear Power Plant Modernization

The United States (U.S.) Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) program Plant Modernization Pathway is conducting targeted research and development (R&D) to address aging and reliability concerns with the legacy instrumentation and control and related information systems of the U.S. LWR fleet. In this effort, the application of human factors engineering (HFE) provides an important role in ensuring new digital plant technologies enable broad innovation and business improvement with continued operational safety. Evaluation is a key activity in HFE, which often occurs iteratively through the system design lifecycle. While qualitative methods are important in collecting information of how users perform tasks through observations, quantitative methods are equally important in assessing system design based on performance. In collecting and analyzing this quantitative data, there are notable challenges in the nuclear HFE domain that may threaten the validity and reliability of the inferences made in these studies. Notable challenges include small sample size and limited resources, large error variance and small effect size, an “adding test features to losing degrees of freedom” dilemma, non-normal distribution, and heterogeneity of variance. The results in control room usability studies are often statistically non-significant, which makes it hard to interpret. This work discusses these challenges across different scientific viewpoints and provides real-world examples of these challenges in practice. Collectively, the objective of this work is to position these challenges to the larger data science community as a means of identifying future opportunities to address these issues.

99 GENERAL AND MISCELLANEOUS↗

Quantitative assessment of fitting errors associated with streak camera noise in Thomson scattering data analysis

Thomson scattering measurements in high energy density experiments are often recorded using optical streak cameras. In the low-signal regime, noise introduced by the streak camera can become an important and sometimes the dominant source of measurement uncertainty. In this paper, we present a formal method of accounting for the presence of streak camera noise in our measurements. We present a phenomenological description of the noise generation mechanisms and present a statistical model that may be used to construct the covariance matrix associated with a given measurement. This model is benchmarked against simulations of streak camera images. We demonstrate how this covariance may then be used to weight fitting of the data and provide quantitative assessments of the uncertainty in the fitting parameters determined by the best fit to the data and build confidence in the ability to make statistically significant measurements in the low-signal regime, where spatial correlations in the noise become apparent. These methods will have general applicability to other measurements made using optical streak cameras.

47 OTHER INSTRUMENTATION↗

Evaluation of reconstruction errors and identification of artefacts for JET gamma and neutron tomography

The Joint European Torus (JET) neutron profile monitor ensures 2D coverage of the gamma and neutron emissive region that enables tomographic reconstruction. Due to the availability of only two projection angles and to the coarse sampling, tomographic inversion is a limited data set problem. Several techniques have been developed for tomographic reconstruction of the 2-D gamma and neutron emissivity on JET, but the problem of evaluating the errors associated with the reconstructed emissivity profile is still open. The reconstruction technique based on the maximum likelihood principle, that proved already to be a powerful tool for JET tomography, has been used to develop a method for the numerical evaluation of the statistical properties of the uncertainties in gamma and neutron emissivity reconstructions. The image covariance calculation takes into account the additional techniques introduced in the reconstruction process for tackling with the limited data set (projection resampling, smoothness regularization depending on magnetic field). The method has been validated by numerically simulations and applied to JET data. Different sources of artefacts that may significantly influence the quality of reconstructions and the accuracy of variance calculation have been identified.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

GPS Data Filtration Method for Drive Cycle Analysis Applications

When employing GPS data acquisition systems to capture vehicle drive-cycle information, a number of errors often appear in the raw data samples, such as sudden signal loss, extraneous or outlying data points, speed drifting, and signal white noise, all of which limit the quality of field data for use in downstream applications. Unaddressed, these errors significantly impact the reliability ofsource data and limit the effectiveness of traditional drive-cycle analysis approaches and vehicle simulation software. Without reliable speed and time information, the validity of derived metrics for drive cycles, such as acceleration, power, and distance, become questionable. This study explores some of the common sources of error present in raw onboard GPS data and presents a detailedfiltering process designed to correct for these issues. Test data from both light and medium/heavy duty applications are examined to illustrate the effectiveness of the proposed filtration process across the range of vehicle vocations. Graphical comparisons of raw and filtered cycles are presented, and statistical analyses are performed to determine the effects of the proposed filtration processon raw data. Finally, an evaluation of the overall benefits of data filtration on raw GPS data and present potential areas for continued research is presented.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Collaborative Project: The problem of bias in defining uncertainty in computationally enabled strategies for data-driven climate model development. Final Technical Report.

The objective of the project is to develop strategies for better representing scientific sensibilities within statistical measures of model skill that then can be used within a Bayesian statistical framework for data-driven climate model development and improved measures of model scientific uncertainty. One of the thorny issues in model evaluation is quantifying the effect of biases on climate projections. While any bias is not desirable, only those biases that affect feedbacks affect scatter in climate projections. The effort at the University of Texas is to analyze previously calculated ensembles of CAM3.1 with perturbed parameters to discover how biases affect projections of global warming. The hypothesis is that compensating errors in the control model can be identified by their effect on a combination of processes and that developing metrics that are sensitive to dependencies among state variables would provide a way to select version of climate models that may reduce scatter in climate projections. Gabriel Huerta at the University of New Mexico is responsible for developing statistical methods for evaluating these field dependencies. The UT effort will incorporate these developments into MECS, which is a set of python scripts being developed at the University of Texas for managing the workflow associated with data-driven climate model development over HPC resources. This report reflects the main activities at the University of New Mexico where the PI (Huerta) and the Postdocs (Nosedal, Hattab and Karki) worked on the project.

58 GEOSCIENCES↗

Hydrologic investigations of radar-rainfall error propagation to rainfall-runoff model hydrographs

Rainfall is arguably the most important yet most variable input for rainfall-runoff hydrologic models. In this study, the authors search for the characteristics of radar-rainfall estimates that are most important for skillful streamflow predictions. They perform comprehensive hydrologic investigations of radar-rainfall characteristics, including spatiotemporal resolution, radar range visibility, statistical characterization of rainfall variability, all vis-a-vis basin characteristics such as size and river network topology. Since the true rainfall fields are unknown, the authors exploit a paradigm of using two independently constructed radar-rainfall products i.e., Multi-Radar Multi-Sensor and IFC-ZR used operationally by the Iowa Flood Center (IFC). Using the distributed hydrologic model called the Hillslope-Link Model for the domain of the state of Iowa, they evaluate streamflow prediction at 140 USGS gauge stations that monitor rivers in Iowa. Through spatial and temporal rainfall aggregation experiments, the authors show that the impact of spatial and temporal resolution of rainfall is significant typically for smaller basins while starts reducing significantly for basins larger than 1,000 km 2 . Other rainfall characteristics they explored do not reveal a strong signature in the relationship of rainfall differences between the two products and hydrograph errors. However, exploring the product similarities rather than differences reveals that the basin-wide rainfall volume has the most significant effect on streamflow prediction. The results from this study are generalizable for all rainfall observing systems.

54 ENVIRONMENTAL SCIENCES↗

Toward Predictive RANS and SRS Computations of Turbulent External Flows of Practical Interest

In this work, we investigate the main challenges to prediction of turbulent external flows of practical interest with Reynolds-Averaged Navier–Stokes equations (RANS) and Scale-Resolving Simulation (SRS) models. This represents a crucial step toward further developing and establishing these formulations so they can be confidently utilized in engineering problems without reference data. The study initiates by identifying the major challenges to prediction. A literature review is performed to illustrate their effects in RANS and SRS computations. Afterward, we evaluate the impact of the challenges to prediction by analyzing representative statistically steady and unsteady flows with prominent RANS and SRS methods. These include multiple turbulent viscosity and second-moment RANS closures, and hybrid and bridging SRS models. The results demonstrate the potential of the selected SRS models to predict engineering flows. Yet, they also show the importance of considering the challenges to prediction during the setup and conduction of numerical experiments. These can suppress the advantages of using SRS formulations. The data also indicate that only SRS models can confidently predict statistically unsteady flows. In contrast, the results demonstrate that mean-flow quantities of statistically steady flows can be efficiently calculated with RANS closures, especially second-moment closures. Among the selected SRS methods, bridging models reveal better suited for prediction due to their ability to prevent commutation errors and enable the robust evaluation of numerical and modeling errors. This last property allows the use of a new validation technique that does not require reference data.

42 ENGINEERING↗

Design of experiments and data analysis challenges in calibration for forensics applications

Forensic science aims to infer characteristics of source terms using measured observables. Our focus is on statistical design of experiments and data analysis challenges arising in nuclear forensics. More specifically, we focus on inferring aspects of experimental conditions (of a process to produce product Pu oxide powder), such as temperature, nitric acid concentration, and Pu concentration, using measured features of the product Pu oxide powder. The measured features, Y, include trace chemical concentrations and particle morphology such as particle size and shape of the produced Pu oxide power particles. Making inferences about the nature of inputs X that were used to create nuclear materials having particular characteristics, Y, is an inverse problem. Therefore, statistical analysis can be used to identify the best set (or sets) of Xs for a new set of observed responses Y. One can fit a model (or models) such as Υ = f(Χ) + error , for each of the responses, based on a calibration experiment and then “invert” to solve for the best set of Xs for a new set of Ys. This perspectives paper uses archived experimental data to consider aspects of data collection and experiment design for the calibration data to maximize the quality of the predicted Ys in the forward models; that is, we assume that well-estimated forward models are effective in the inverse problem. In addition, we consider how to identify a best solution for the inferred X, and evaluate the quality of the result and its robustness to a variety of initial assumptions, and different correlation structures between the responses. In addition, we also briefly review recent advances in metrology issues related to characterizing particle morphology measurements used in the response vector, Y.

36 MATERIALS SCIENCE↗

POSSIBLE DETECTION OF AN EMISSION CYCLOTRON RESONANCE SCATTERING FEATURE FROM THE ACCRETION-POWERED PULSAR 4U 1626-67

We present analysis of 4U 1626-67, a 7.7 s pulsar in a low-mass X-ray binary system, observed with the hard X-ray detector of the Japanese X-ray satellite Suzaku in 2006 March for a net exposure of {approx}88 ks. The source was detected at an average 10-60 keV flux of {approx}4 Multiplication-Sign 10{sup -10} erg cm{sup -2} s{sup -1}. The phase-averaged spectrum is reproduced well by combining a negative and positive power-law times exponential cutoff (NPEX) model modified at {approx}37 keV by a cyclotron resonance scattering feature (CRSF). The phase-resolved analysis shows that the spectra at the bright phases are well fit by the NPEX with CRSF model. On the other hand, the spectrum in the dim phase lacks the NPEX high-energy cutoff component, and the CRSF can be reproduced by either an emission or an absorption profile. When fitting the dim phase spectrum with the NPEX plus Gaussian model, we find that the feature is better described in terms of an emission rather than an absorption profile. The statistical significance of this result, evaluated by means of an F test, is between 2.91 Multiplication-Sign 10{sup -3} and 1.53 Multiplication-Sign 10{sup -5}, taking into account the systematic errors in the background evaluation of HXD-PIN. We find that the emission profile is more feasible than the absorption one for comparing the physical parameters in other phases. Therefore, we have possibly detected an emission line at the cyclotron resonance energy in the dim phase.

79 ASTRONOMY AND ASTROPHYSICS↗

THE FORTUITOUS LATITUDE OF THE PIERRE AUGER OBSERVATORY AND TELESCOPE ARRAY FOR RECONSTRUCTING THE QUADRUPOLE MOMENT

Determining anisotropies in the arrival directions of cosmic rays at the highest energy is an important task in astrophysics. It is common and useful to partition the sky into spherical harmonics as a measure of anisotropy. The two lowest nontrivial spherical harmonics, the dipole and the quadrupole, are of particular interest, since these distributions encapsulate a dominant single source and a plane of sources, as well as offering relatively high statistics. The best experiments for the detection of ultra high energy cosmic rays currently are all ground-based, with highly nonuniform exposures on the sky resulting from the fixed experimental locations on the Earth. This nonuniform exposure increases the complexity and error in inferring anisotropies. It turns out that there is an optimal latitude for an experiment at which nonuniform exposure does not diminish the inference of the quadrupole moment. We derive the optimal latitude and find that (presumably by a fortuitous coincidence) this optimal latitude runs through the largest cosmic ray experiment, the Pierre Auger Observatory (PAO) in the Southern Hemisphere, and close to the largest cosmic ray experiment in the Northern Hemisphere, the Telescope Array (TA). Consequently, assuming a quadrupole distribution, PAO and TA can reconstruct the cosmic ray quadrupole distribution to a high precision without concern for their partial sky exposure.

79 ASTRONOMY AND ASTROPHYSICS↗

Quantifying Rates of Erosion Using Historical Aerial Photos - 19478

Erosion can play an important role in the fate and transport of waste at sites where disposal of long-lived waste is anticipated. The statistical characterization of key processes related to erosion is essential to the understanding of site stability through time. In this work multi-temporal historical aerial images are analyzed in conjunction with orthophotography and Lidar data to develop probability distributions for variables representing important erosion processes. Scans of photographic negatives were obtained for multiple photographs and several negatives were scanned with a calibrated photogrammetric scanner by Geomni (formerly Blue Skies Consulting) in Belen, New Mexico. Other negatives were provided by USDA or scanned on a high-resolution, large format media scanner in the United States National Archives Cartographic Research Room, College Park, Maryland (1939). An additional set of aerial photographs was obtained from the USGS EROS Data Center web site. For other years, photographic prints were available for aerial photography. Several prints were scanned with a large-format media scanner at 1200 dpi. Ground control points for selected digital images used in the stereoscopic analyses were identified in ArcMap. Ground control points were collected by matching features which could be identified in the aerial photography as well as the orthophotography or shaded relief imagery from the Lidar dataset. Such features included fence line intersections, road intersections, railroad bridges, and structures, depending on the age of the photography. Many old fence lines and abandoned roads remained visible in the shaded relief imagery while they were completely obscured by tree canopy in modern photography. Ground control elevations were sampled from the Lidar-based DEM or directly from point clouds. The image coordinates and matching three-dimensional projected coordinates of the ground control points were exported to IDL where parameters for a three-dimensional direct linear transformation (DLT) were obtained. Built-in singular value decomposition routines were used to solve an overdetermined set of equations for the eleven parameters of the DLT for a particular historical photograph. A solution to the DLT parameters was obtained for each historical aerial photograph in which features of interest were identified using the stereoscope. Ultimately, this process resulted in the identification of locations for features like gully heads using both the Lidar dataset and projection of the estimated location from the historical aerial photo under consideration back to the Lidar dataset. The distance between the estimate of the location from the historical image and that of the Lidar dataset was the estimated distance the feature has moved. This distance was then divided by the number of years between the Lidar dataset and the year of the historical aerial image of interest to get a rate of movement through time. This was done for several dozen points on each historical aerial image. There was inevitable uncertainty associated with the estimation of points from the historical aerial imagery. This includes estimation of changes in locations of features like gully heads through time. In this work a method to estimate the uncertainty associated with measurements of locations of features using the stereoscopic analysis is developed and applied. For features with locations in space that do not change (e.g., road intersections, etc.) the difference in measurements of locations from the Lidar dataset and that of the estimate from the historical aerial image provides an observation of the measurement error. These points used to estimate the measurement error are referred to as control points. For each of the historical aerial images, a different measurement error distribution is estimated using control points. These measurement errors are combined with the estimated distances from the stereoscopic analyses to produce distributions of gully retreat rates and hillslope erosion rates used along with output from Erosion Working Group (EWG) Landscape Evolution Models (LEMs) to provide statistical probability distributions for input into the PPA Model. Specifically, gully head retreat rate and gully widening rate were characterized using statistical probability distributions. The central limit theorem was then applied to develop rates that represent long-term averages that are used to inform a PPA Model built in GoldSim. The importance of these rates with respect to characterization of future risk can then assessed using sensitivity analyses. This provides an approach to determine if subsequent reduction of the uncertainty associated with the probability distributions of erosion rates will correspond to meaningful reduction in the estimation of future risk from the site. Ultimately this is a general method that utilizes historical aerial imagery to estimate rates of erosion with uncertainty. This information can be used to inform PPA models to project future risks from a given site. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Emulation of radiation transport in 3D stochastic media using 1D planar Monte Carlo stochastic media radiation transport algorithms

A subset of stochastic media radiation transport problems involves those in which radiation is incident on a thin slab of stochastic material. Particle tracking in 3D for such problems is expensive, and 1D planar models lack accuracy because they only allow the material to change in one dimension. Therefore, we propose dimensional emulation, which through a slight modification allows existing 1D planar geometry stochastic media radiation transport models to reproduce results from the equivalent 3D models by allowing the material to change in all three dimensions, reproducing the fidelity of the 3D model for the low computational cost of the 1D planar model. In this work, we apply dimensional emulation to three Monte Carlo stochastic media radiation transport models: Chord Length Sampling (CLS), the Local Realization Preserving method (LRP), and a variant of Conditional Point Sampling (CoPS). For a common Markovian benchmark set, the 3D emulation variants of these algorithms are numerically verified to reproduce the results of the 3D variants within statistics while running 1.3 to 2 times faster in the implementation within Sandia National Laboratories open-source research code PlaybookMC. The 3D emulation variants are also shown to yield a 72%–92% reduction in error for the thin slab problems in comparison to the 1D benchmark. As a result, the 3D emulation variant of CLS and CoPS-1 are shown to reproduce 3D CLS results that were used to approximate results for a 3D spherical inclusion geometry benchmark set.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Evaluating Retention Index Score Assumptions to Refine GC–MS Metabolite Identification

As metabolomics grows into a high-throughput and high demand research field, current metrics for the identification of small molecules in gas chromatography–mass spectrometry (GC–MS) still require manual verification. Though steps have been taken to improve scoring metrics by combining spectral similarity (SS) and retention index (RI), the problem persists. A large body of literature has analyzed and refined SS scores, but few studies have explicitly studied improvements to RI scores. Here, in this study, we examined whether uninvestigated assumptions of the RI score are valid and propose ways to improve them. Query RIs were matched to library RI with a generous window of ±35 to avoid unintentional removal of valid compound identifications. Each match was manually verified as a true positive (TP), true negative, or unknown. Metabolites with at least 30 TP identifications were included in downstream analyses, resulting in a total of 87 metabolites from samples of varying complexity and type (e.g., amino acid mixtures, human urine, fungal species, and so on.). Our results showed that the RI score assumptions of normality, consistent variance across metabolites, and a mean error centered at 0 are often violated. We demonstrated through a cross-validation analysis that modifying these underlying assumptions according to empirical metabolite-specific distributions improved the TP and negative rankings. Further, we statistically determined the minimum number of samples required to estimate distributional parameters for scoring metrics. Overall, this work proposes a robust statistical pipeline to reduce the time bottleneck of metabolite identification by improving RI scores and thus minimize the effort to complete manual verification.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Precise Measurement of the e + e - → π + π - J / ψ Cross Section at Center-of-Mass Energies from 3.77 to 4.60 GeV

The statistical significance of this resonance is estimated to be larger than 7.6 σ . The mass and width of the second resonance agree with the Y(4360) resonance reported by the BABAR and Belle experiments within errors. Finally, the Y ( 4008 ) resonance previously observed by the Belle experiment is not confirmed in the description of the BESIII data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Predicting September Arctic Sea Ice: A Multimodel Seasonal Skill Comparison

This study quantifies the state of the art in the rapidly growing field of seasonal Arctic sea ice prediction. A novel multimodel dataset of retrospective seasonal predictions of September Arctic sea ice is created and analyzed, consisting of community contributions from 17 statistical models and 17 dynamical models. Prediction skill is compared over the period 2001–20 for predictions of pan-Arctic sea ice extent (SIE), regional SIE, and local sea ice concentration (SIC) initialized on 1 June, 1 July, 1 August, and 1 September. This diverse set of statistical and dynamical models can individually predict linearly detrended pan-Arctic SIE anomalies with skill, and a multimodel median prediction has correlation coefficients of 0.79, 0.86, 0.92, and 0.99 at these respective initialization times. Regional SIE predictions have similar skill to pan-Arctic predictions in the Alaskan and Siberian regions, whereas regional skill is lower in the Canadian, Atlantic, and central Arctic sectors. The skill of dynamical and statistical models is generally comparable for pan-Arctic SIE, whereas dynamical models outperform their statistical counterparts for regional and local predictions. The prediction systems are found to provide the most value added relative to basic reference forecasts in the extreme SIE years of 1996, 2007, and 2012. SIE prediction errors do not show clear trends over time, suggesting that there has been minimal change in inherent sea ice predictability over the satellite era. Overall, this study demonstrates that there are bright prospects for skillful operational predictions of September sea ice at least 3 months in advance.

54 ENVIRONMENTAL SCIENCES↗

Muon g-2: An Interplay between Beam Dynamics and a Muon Decay Experiment at the Precision Frontier

The Muon g-2 Experiment at Fermilab (E989) will use the higher proton flux delivered by the Fermilab accelerator complex and improvements to the experimental apparatus to measure the anomalous magnetic moment of the muon to unprecedented precision. In addition to the increased statistics beyond the most recent measurement, the experiment relies on detailed understanding of the beam dynamics in the experiment’s storage ring as well as the incoming muon beam properties for proper assessments of systematic errors in the data analysis. Modeling and measurements of beam and storage ring properties, from proton targeting to muon storage, produce a unique unification of particle beam physics with a high energy physics experiment. Here the beam dynamics issues and analysis techniques essential to the g-2 experiment are presented and discussed.

43 PARTICLE ACCELERATORS↗