Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

Theorizing Land Cover and Land Use Change: The Peasant Economy of Colonization in the Amazon Basin

This paper addresses deforestation processes in the Amazon basin. It deploys a methodology combining remote sensing and survey-based fieldwork to examine, with regression analysis, the impact household structure and economic circumstances on deforestation decisions made by colonist farmers in the forest frontiers of Brazil. Unlike most previous regression-based studies, the methodology implemented analyzes behavior at the level of the individual property. The regressions correct for endogenous relationships between key variables, and spatial autocorrelation, as necessary. Variables used in the analysis are specified, in part, by a theoretical development integrating the Chayanovian concept of the peasant household with spatial considerations stemming from von Thuenen. The results from the empirical model indicate that demographic characteristics of households, as well as market factors, affect deforestation in the Amazon. Thus, statistical results from studies that do not include household-scale information may be subject to error. From a policy perspective, the results suggest that environmental policies in the Amazon based on market incentives to small farmers may not be as effective as hoped, given the importance of household factors in catalyzing the demand for land. The paper concludes by noting that household decisions regarding land use and deforestation are not independent of broader social circumstances, and that a full understanding of Amazonian deforestation will require insight into why poor families find it necessary to settle the frontier in the first place.

Caldas, Marcellus↗

The Development of a Long-Term, Continually Updated Global Solar Resource at 10 km Resolution: Preliminary Results From Test Processing and Continuing Plans

Background: Considering the likelihood of global climatic weather pattern changes and the global competition for energy resources, there is an increasing need to provide improved and continuously updated global Earth surface solar resource information. Toward this end, a project was funded under the NASA Applied Science program involving the National Aeronautics and Space Administration (NASA) Langley Research Center (LaRC), National Renewable Energy Laboratory (NREL), the State University of New York/Albany (SUNY) and the NOAA National Climatic Data Center (NCDC) to provide NREL with a global long-term advanced global solar mapping production system for improved depiction of historical solar resources and variability and to provide a mechanism for continual updates of solar resource information. This new production system is made possible by the efforts of NOAA and NASA to completely reprocess the International Satellite Cloud Climatology Project (ISCCP) data set that provides satellite visible and infrared radiances together with retrieved cloud and surface properties on a 3-hourly basis beginning from July 1983. The old version of the ISCCP data provided this information for all the world TMs available geosynchronous satellite systems and NOAA TMs AVHRR data sets at a 30 km effective resolution. This new version aims to provide a new and improved satellite calibration at an effective 10 km resolution. Thus, working with SUNY, NASA will develop and test an improved production system that will enable NREL to continually update the Earth TM solar resource. Objective and Methods: In this presentation, we provide a general overview of this project together with samples of the new solar irradiance mapped data products and comparisons to surface measurements at various locations across the world. An assessment of the solar resource values relative to calibration uncertainty and assumptions are presented. Errors resulting assumptions in snow cover and background aerosol amount are described. These uncertainties and the statistics of the agreement between the measurements and new satellite estimates are also reviewed and compared to other solar data sets. Findings and Conclusions: Preliminary results show that insolation values show an overall small bias (less than 1%) with a RMS of 25% relative to surface measurements. Exceptions at certain locations were found and will be discussed relative to the uncertainties identified above. Lastly, we will identify the next steps in the development and improvement of this production system including some accuracy goals in preparation for ultimate delivery to NREL.

Stackhouse, P.↗

Validation Practices for Satellite Soil Moisture retrievals: What are (the) errors?

This paper presents a community effort to develop good practice guidelines for the validation of global coarse-scale satellite soil moisture products. We provide theoretical background, a review of state-of-the-art methodologies for estimating errors in soil moisture data sets, practical recommendations on data pre-processing and presentation of statistical results, and a recommended validation protocol that is supplemented with an example validation exercise focused on microwave-based surface soil moisture products. We conclude by identifying research gaps that should be addressed in the near future.

A. Gruber↗

Estimation of Snow Mass Information via Assimilation of C-Band Synthetic Aperture Radar Backscatter Observations Into an Advanced and Surface Model

This study assimilated Sentinel-1 C-band backscatter observations over snow-covered terrain into the Noah-Multiparameterization land surface model using support vector machine (SVM) regression and an ensemble Kalman filter to improve the modeled terrestrial snow mass estimates. The data assimilation (DA) experiment was conducted across Western Colorado from September 2016 to August 2017. As part of the DA experiments, the impact of a rule-based update was evaluated by comparing snow water equivalent (SWE) estimates via DA (with [ DAv1 ] and without [ DAv2 ] the rule-based update) against SNOTEL SWE measurements. Results confirmed that rule-based update helped minimize SVM controllability issues, and in turn, improved the accuracy of SWE estimates relative to both open loop (OL) and DAv2 . Comparison of SWE estimates from Sentinel-1 DAv1 against SNOTEL SWE revealed that 75% of stations showed improvements in bias and correlation coefficient relative to the OL. Assimilated SWE estimates also showed statistical improvements during both the snow accumulation and snow ablation periods. However, unbiased root mean square error showed a slight increase during the snow ablation period due to the large variability in the electromagnetic response of C-band backscatter over deep and/or wet snow. Improvement of the SWE estimates also resulted in improving river discharge estimates compared to in situ measurements. River discharge using Sentinel-1 DAv1 improved the Nash–Sutcliffe efficiency at all available stations. These results suggest that physically constrained SVM can serve as an efficient observation operator for snow mass DA through explicit consideration of the first-order C-band scattering mechanisms over different terrestrial snow conditions.

Jongmin Park↗

Validation of Self-Scheduling Countermeasures in NASA's HERA Campaign 6

Enhancing crew capabilities for planning and scheduling activities is critical for periods of increased crew autonomy in future long-duration missions where communication delays preclude real-time ground support from Earth. Our study focuses on how to empower astronauts to manage their timelines independently from the experts in the mission control center (MCC). Our objective was to evaluate the impact of scheduling countermeasures on crew scheduling performance, workload, and usability in an analog mission environment. The study involved 16 crew members across four missions in the Limited Autonomy phase of Human Exploration Research Analog (HERA) Campaign 6. Crew members used Playbook to schedule one operational day for the entire crew. Half the participants accessed scheduling aids, and we compared their performance to a control group with no aids. Performance, workload, and usability were assessed using time on task, violation counts, NASA Task Load Index (NASA-TLX), and System Usability Scale (SUS). Participants using scheduling aids completed sessions 20% faster and committed 33% fewer violations. While these differences were not statistically significant due to the study’s operational limitations, trends indicate that scheduling aids may reduce errors and improve efficiency. These results can inform the design of scheduling tools to enhance astronauts’ autonomy in long-duration space missions, contributing to improved crew performance and reduced reliance on ground support.

space robotics↗

Copula-based Method to Generate Consistent Surface Pressures Under Uncertainty

This paper establishes a method to create surface pressure databases that allow for uncertainty quantification. Aerodynamic databases are critical products for launch vehicles and other aeronautical systems, and surface pressure databases are one such database that constains large quantities of data. The focus of this work is the relationship between the integrated force and moment data base and the surface pressure database. In particular, the work attempts to provide a method that maintains consistency between these two databases when accounting for uncertainty. The integrated force and moment database and surface pressure databases are constructed from CFD data which is high-density but low-trust. However, the force and moment database will often also include data from high-trust but low-density sources such as from wind tunnel experiments. This means that the quantified uncertainty of the force and moment database is higher quality as it includes this high fidelity wind tunnel data. This motivates the idea to use the force and moment database uncertainty when constructing the surface pressure database uncertainty. The method utilizes the statistical idea of a copula in order to generate surface pressures that match with uncertain integrated force and moment distributions as well as being consistent with known CFD data. This statistical consistency is quantified by using the Maximum Mean Discrepancy two-sample test. The predictive error of the method is also approximated using leave-one-out error estimation and the good overall performance of the method is presented using probability boxes in a simulated uncertainty scenario.

SLS↗

Validation of Self-Scheduling Countermeasures in NASA's HERA Campaign 6

Enhancing crew capabilities for planning and scheduling activities is critical for periods of increased crew autonomy in future long-duration missions where communication delays preclude real-time ground support from Earth. Our study focuses on how to empower astronauts to manage their timelines independently from the experts in the mission control center (MCC). Our objective was to evaluate the impact of scheduling countermeasures on crew scheduling performance, workload, and usability in an analog mission environment. The study involved 16 crew members across four missions in the Limited Autonomy phase of Human Exploration Research Analog (HERA) Campaign 6. Crew members used Playbook to schedule one operational day for the entire crew. Half the participants accessed scheduling aids, and we compared their performance to a control group with no aids. Performance, workload, and usability were assessed using time on task, violation counts, NASA Task Load Index (NASA-TLX), and System Usability Scale (SUS). Participants using scheduling aids completed sessions 20% faster and committed 33% fewer violations. While these differences were not statistically significant due to the study’s operational limitations, trends indicate that scheduling aids may reduce errors and improve efficiency. These results can inform the design of scheduling tools to enhance astronauts’ autonomy in long-duration space missions, contributing to improved crew performance and reduced reliance on ground support.

space robotics↗

The muon g-2 experiment at FERMILAB

The muon anomaly, a µ = $\frac{g-2}{2}$, is a low energy observable that can be both measured and computed with high precision. Therefore it provides an important test of the Standard Model (SM) and it is a sensitive probe for new physics. The a µ value has been measured to a precision of 0.54 ppm by the E821 experiment at the Brookhaven National Laboratory (BNL). This result shows a difference greater than 3 σ compared to the SM prediction. In an effort to clarify this discrepancy between experimental measurement and theoretical calculation, the Muon g-2(E989) experiment at Fermilab aims to reduce the experimental error on a µ by a factor of four. E989 collected a dataset with the same statistical power of the BNL experiment during the Run 1 data taking (2018). The analysis of data is ongoing and the first result should become available in early 2020. In this paper, I will discuss the experimental setup and report on the status of the Run1 analysis.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Low-Cost Sensor Performance Intercomparison, Correction Factor Development, and 2+ Years of Ambient PM2.5 Monitoring in Accra, Ghana

Particulate matter air pollution is a leading cause of global mortality, particularly in Asia and Africa. Addressing the high and wide-ranging air pollution levels requires ambient monitoring, but many low- and middle-income countries (LMICs) remain scarcely monitored. To address these data gaps, recent studies have utilized low-cost sensors. These sensors have varied performance, and little literature exists about sensor intercomparison in Africa. By colocating 2 QuantAQ Modulair-PM, 2 PurpleAir PA-II SD, and 16 Clarity Node-S Generation II monitors with a reference-grade Teledyne monitor in Accra, Ghana, we present the first intercomparisons of different brands of low-cost sensors in Africa, demonstrating that each type of low-cost sensor PM2.5 is strongly correlated with reference PM2.5, but biased high for ambient mixture of sources found in Accra. When compared to a reference monitor, the QuantAQ Modulair-PM has the lowest mean absolute error at 3.04 μg/m3, followed by PurpleAir PA-II (4.54 μg/m3) and Clarity Node-S (13.68 μg/m3). We also compare the usage of 4 statistical or machine learning models (Multiple Linear Regression, Random Forest, Gaussian Mixture Regression, and XGBoost) to correct low-cost sensors data, and find that XGBoost performs the best in testing (R2: 0.97, 0.94, 0.96; mean absolute error: 0.56, 0.80, and 0.68 μg/m3 for PurpleAir PA-II, Clarity Node-S, and Modulair-PM, respectively), but tree-based models do not perform well when correcting data outside the range of the colocation training. Therefore, we used Gaussian Mixture Regression to correct data from the network of 17 Clarity Node-S monitors deployed around Accra, Ghana, from 2018 to 2021. We find that the network daily average PM2.5 concentration in Accra is 23.4 μg/m3, which is 1.6 times the World Health Organization Daily PM2.5 guideline of 15 μg/m3. While this level is lower than those seen in some larger African cities (such as Kinshasa, Democratic Republic of the Congo), mitigation strategies should be developed soon to prevent further impairment to air quality as Accra, and Ghana as a whole, rapidly grow.

Humidity↗

Spectral Analysis of Forecast Error Investigated with an Observing System Simulation Experiment

The spectra of analysis and forecast error are examined using the observing system simulation experiment (OSSE) framework developed at the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASAGMAO). A global numerical weather prediction model, the Global Earth Observing System version 5 (GEOS-5) with Gridpoint Statistical Interpolation (GSI) data assimilation, is cycled for two months with once-daily forecasts to 336 hours to generate a control case. Verification of forecast errors using the Nature Run as truth is compared with verification of forecast errors using self-analysis; significant underestimation of forecast errors is seen using self-analysis verification for up to 48 hours. Likewise, self analysis verification significantly overestimates the error growth rates of the early forecast, as well as mischaracterizing the spatial scales at which the strongest growth occurs. The Nature Run-verified error variances exhibit a complicated progression of growth, particularly for low wave number errors. In a second experiment, cycling of the model and data assimilation over the same period is repeated, but using synthetic observations with different explicitly added observation errors having the same error variances as the control experiment, thus creating a different realization of the control. The forecast errors of the two experiments become more correlated during the early forecast period, with correlations increasing for up to 72 hours before beginning to decrease.

OSSE↗

Statistical Approaches to Aerosol Dynamics for Climate Simulation

In this work, we introduce two general non-parametric regression analysis methods for errors-in-variable (EIV) models: the compound regression, and the constrained regression. It is shown that these approaches are equivalent to each other and, to the general parametric structural modeling approach. The advantages of these methods lie in their intuitive geometric representations, their distribution free nature, and their ability to offer a practical solution when the ratio of the error variances is unknown. Each includes the classic non-parametric regression methods of ordinary least squares, geometric mean regression, and orthogonal regression as special cases. Both methods can be readily generalized to multiple linear regression with two or more random regressors.

Compound regression↗

Computationally efficient zero-noise extrapolation for quantum-gate-error mitigation

Zero noise extrapolation (ZNE) is a widely used technique for gate error mitigation on near term quantum computers because it can be implemented in software and does not require knowledge of the quantum computer noise parameters. Traditional ZNE requires a significant resource overhead in terms of quantum operations. A recent proposal using a targeted (or random) instead of fixed identity insertion method (riim versus fiim) requires significantly fewer quantum gates for the same formal precision. We start by showing that riim can allow for ZNE to be deployed on deeper circuits than fiim but requires many more measurements to maintain the same statistical uncertainty. We develop two extensions to fiim and riim. The List Identity Insertion Method (liim) allows to mitigate the error from certain cnot gates, typically those with the largest error. Set Identity Insertion Method (siim) naturally interpolates between the measurement-efficient fiim and the gate-efficient riim allowing to trade off fewer cnot gates for more measurements. Finally, we investigate a way to boost the number of measurements, namely to run ZNE in parallel, utilizing as many quantum devices as are available. We explore the performance of riim in a parallel setting where there is a non-trivial spread in noise across sets of qubits within or across quantum computers.

97 MATHEMATICS AND COMPUTING↗

The velocity distribution function of galaxy clusters as a cosmological probe

We present a new approach for quantifying the abundance of galaxy clusters and constraining cosmological parameters using dynamical measurements. In the standard method, galaxy line-of-sight velocities, v, or velocity dispersions are used to infer cluster masses, M, to quantify the halo mass function (HMF), dn(M)/dlog(M), which is strongly affected by mass measurement errors. In our new method, the probability distributions of velocities for each cluster in the sample are summed to create a new statistic called the velocity distribution function (VDF), dn(v)/dv. The VDF can be measured more directly and precisely than the HMF and can be robustly predicted with cosmological simulations that capture the dynamics of subhalos or galaxies. We apply these two methods to realistic (ideal) mock cluster catalogs with (without) interlopers and forecast the bias and constraints on the matter density parameter Ω{sub m} and the amplitude of matter fluctuations σ{sub 8} in flat ΛCDM cosmologies. For an example observation of 200 massive clusters, the VDF with (without) interloping galaxies constrains the parameter combination σ{sub 8} Ω{sub m}{sup 0.29(0.29)}=0.589±0.014 (0.584±0.011) and shows only minor bias. However, the HMF with interlopers is biased to low Ω{sub m} and high σ{sub 8} and the fiducial model lies well outside of the forecast constraints, prior to accounting for Eddington bias. When the VDF is combined with constraints from the cosmic microwave background, the degeneracy between cosmological parameters can be significantly reduced. Upcoming spectroscopic surveys that probe larger volumes and fainter magnitudes will provide clusters for applying the VDF as a cosmological probe.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluating soil moisture feedback on convective triggering: Roles of convective and land–model parameterizations

Feedbacks between soil moisture and convective precipitation are not well represented in current Earth system models, and can affect projections of drought and heavy-precipitation extremes. To explore the atmospheric and land-surface influences on the initiation (triggering) of daytime deep convection, single-column model experiments were performed using the NCAR Community Earth System Model (CESM1.2), over the U.S. Southern Great Plains. The results indicate that the positive and negative feedback mechanisms found in earlier studies (using simplified boundary-layer models) are robust to large-scale forcing and interactions between boundary-layer turbulence, cloud dynamics, and radiation. However, systematic responses of convective triggering to soil moisture emerged only after switching from a convective available potential energy-based to a convective inhibition energy-based convective parameterization. This suggests that the choice of convective mass-flux closure largely determines the sensitivity of parameterized convective clouds to land-surface state. Errors in land-model parameterizations of evapotranspiration also affect the probability of deep convection, with vegetation (transpiration) playing an important role in linking soil moisture to surface energy partitioning and clouds. Parameterizations that permit the triggering feedback mechanism better predict the statistics of daytime shallow and deep convection, with respect to observations from the Atmospheric Radiation Measurement site in the Southern Great Plains. Here, the results illustrate how errors in the representation of evapotranspiration in land-surface models can propagate through the chain of coupled land-atmosphere processes to affect convective clouds.

54 ENVIRONMENTAL SCIENCES↗

Error analysis of a hybrid control drum worth model

This paper presents a perturbation-based model for control drum worth prediction which employs both physics-based and statistics-based components. Control drums, or control shims, are cylindrical in shape and span the axial length of the core. A portion of the cylinder is coated in neutron absorbing material and the drum can rotate to introduce the absorbing material to the body of the core to reduce reactivity. The model can be expensive to create due to the requirement for full-core Monte Carlo eigenvalue calculations. Therefore, it is important to analyze how the errors in Monte Carlo calculated k{sub eff} used for model training affect model performance. It was found that the error in predicted criticalities could average to 70 pcm in the most complex form of the model and 215 pcm in the simplest form of the model. Furthermore, it was found that the Monte Carlo uncertainty in quantities calculated with Serpent used to train the models had minimal impact on the error observed from the model. Lastly, one of the forms of the hybrid model could be trained in considerably less computational time if the Monte Carlo calculations were run to higher uncertainty in k{sub eff} with a small penalty to model performance.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Sensitivity of Lower Stratospheric Assimilated Ozone on Error Covariance Modeling and Data Selection

Assimilated ozone is produced at the NASA/Goddard Data Assimilation Office by blending ozone retrieved from the Solar Backscatter UltraViolet/2 (SBUV/2) instrument and the Earth Probe Total Ozone Mapping Spectrometer (EP TOMS) measurements into an off-line transport model. The current system tends to overestimate the amount of lower stratospheric ozone. This is a region where ozone plays a key role in the forcing of climate. A biased ozone field in this region will adversely impact calculations of the stratosphere-troposphere exchange and, when used as a first guess in retrievals, the values determined from satellite observations. Since these are all important applications of assimilated ozone products, effort is being directed towards reducing this bias. The SBUV ozone data have a coarse vertical resolution with increased uncertainty below the ozone maximum, and TOMS provides only total ozone columns. Thus, the assimilated ozone in the lower stratosphere, and its vertical distribution in particular, are only weakly constrained by the incoming SBUV and TOMS data. Consequently, the assimilated ozone distribution should be sensitive to changes in inputs to the statistical analysis scheme. Accordingly, the sensitivity of the assimilated lower stratospheric ozone fields to changes in the TOMS error-covariance modeling and the SBUV data selection has been investigated. The use of a spatially correlated TOMS error covariance model led to improvements in the product. However, withholding the SBUV/2 data for the layer between 63 and 126 hPa typically degraded the product, a result which vindicates the use of this layer ozone product, despite its known errors. These efforts to improve the lower stratospheric distribution will be extended to include a more advanced forecast error covariance model, and by assimilating ozone products from new instruments on Envisat and EOS Aura.

Stajner, Ivanka↗

Evaluation of NMME temperature and precipitation bias and forecast skill for South Asia

Systematic error and forecast skill for temperature and precipitation in two regions of Southern Asia are investigated using hindcasts initialized May 1 from the North American Multi-Model Ensemble. We focus on two contiguous but geographically and dynamically diverse regions: the Extended Indian Monsoon Rainfall (70–100E, 10–30 N) and the nearby mountainous area of Pakistan and Afghanistan (60–75E, 23–39 N). Forecast skill is assessed using the Sign test framework, a rigorous statistical method that can be applied to non-Gaussian variables such as precipitation and to different ensemble sizes without introducing bias. We find that models show significant systematic error in both precipitation and temperature for both regions. The multi-model ensemble mean (MMEM) consistently yields the lowest systematic error and the highest forecast skill for both regions and variables. However, we also find that the MMEM consistently provides a statistically significant increase in skill over climatology only in the first month of the forecast. While the MMEM tends to provide higher overall skill than climatology later in the forecast, the differences are not significant at the 95% level. We also find that MMEMs constructed with a relatively small number of ensemble members per model can equal or outperform MMEMs constructed with more members in skill. This suggests some ensemble members either provide no contribution to overall skill or even detract from it.

54 ENVIRONMENTAL SCIENCES↗

0.94-2.42 μm ground-based transmission spectra of the hot Jupiter HD-189733b

We present here new transmission spectra of the hot Jupiter HD-189733b using the SpeX instrument on the NASA Infrared Telescope Facility. We obtained two nights of observations where we recorded the primary transit of the planet in the J, H, and K bands simultaneously, covering a spectral range from 0.94 to 2.42 μm. We used Fourier analysis and other detrending techniques validated previously on other data sets to clean the data. We tested the statistical significance of our results by calculating the autocorrelation function, and we found that, after the detrending, autocorrelative noise is diminished at most frequencies. Additionally, we repeated our analysis on the out-of-transit data only, showing that the residual telluric contamination is well within the error bars. While these techniques are very efficient when multiple nights of observations are combined together, our results prove that even one good night of observations is enough to provide statistically meaningful data. Our observed spectra are consistent with space-based data recorded in the same wavelength interval by multiple instruments, indicating that ground-based facilities are becoming a viable and complementary option to spaceborne observatories. The best fit to the features in our data was obtained with water vapor. Our error bars are not small enough to address the presence of additional molecules; however, by combining the information contained in other data sets with our results, it is possible to explain all the available observations with a modeled atmospheric spectrum containing water vapor, methane, carbon monoxide, and hazes/clouds.

79 ASTRONOMY AND ASTROPHYSICS↗