Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Measurement uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

Optimal Redundancy Management in Reconfigurable Control Systems Based on Normalized Nonspecificity

In this paper the notion of normalized nonspecificity is introduced. The nonspecifity measures the uncertainty of the estimated parameters that reflect impairment in a controlled system. Based on this notion, a quantity called a reconfiguration coverage is calculated. It represents the likelihood of success of a control reconfiguration action. This coverage links the overall system reliability to the achievable and required control, as well as diagnostic performance. The coverage, when calculated on-line, is used for managing the redundancy in the system.

Wu, N.Eva↗

A Climatology of Midlatitude Continental Clouds from the ARM SGP Site: Cloud Fraction and Surface Radiative Forcing - Part II

Data collected at the Department of Energy Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) Central Facility (SCF) are analyzed to determine the monthly and hourly variations of cloud fraction and radiative forcing between January 1997 and December 2002. Cloud fractions are estimated for total cloud cover and for single-layered low (0-3 km), middle (3-6 km), and high clouds (more than 6 km) using ARM SCG ground-based paired lidar-radar measurements. Shortwave (SW) and longwave (LW) fluxes are derived from up- and down-looking standard precision spectral pyranometers and precision infrared radiometer measurements with uncertainties of approximately 10 Wm(exp -2). The annual averages of total, and single-layered low, middle and high cloud fractions are 0.49, 0.11, 0.03, and 0.17, respectively. Both total and low cloud amounts peak during January and February and reach a minimum during July and August, high clouds occur more frequently than other types of clouds with a peak in summer. The average annual downwelling surface SW fluxes for total and low clouds (151 and 138 Wm(exp-2), respectively) are less than those under middle and high clouds (188 and 201 Wm(exp -2), respectively), but the downwelling LW fluxes (349 and 356 Wm(exp -2)) underneath total and low clouds are greater than those from middle and high clouds (337 and 333 Wm(exp -2)). Low clouds produce the largest LW warming (55 Wm(exp -2) and SW cooling (-91 Wm(exp -2)) effects with maximum and minimum absolute values in spring and summer, respectively. High clouds have the smallest LW warming (17 Wm(exp -2)) and SW cooling (-37 Wm(exp -2)) effects at the surface. All-sky SW CRF decreases and LW CRF increases with increasing cloud fraction with mean slopes of -0.984 and 0.616 Wm(exp -2)%(exp -1), respectively. Over the entire diurnal cycle, clouds deplete the amount of surface insolation more than they add to the downwelling LW flux. The calculated CRFs do not appear to be significantly affected by uncertainties in data sampling and clear-sky screening. Traditionally, cloud radiative forcing includes, not only the radiative impact of the hydrometeors, but also the changes in the environment. Taken together over the ARM SCF, changes in humidity and surface albedo between clear and cloudy conditions offset approximately 20% of the NET radiative forcing caused by the cloud hydrometeors alone. Variations in water vapor, on average, account for 10% and 83% of the SW and LW CRFs, respectively, in total cloud cover conditions. The error analysis further reveals that the cloud hydrometeors dominate the SW CRF, while water vapor changes are most important for LW flux changes in cloudy skies. Similar studies over other locales are encouraged where water and surface albedo changes from clear to cloudy conditions may be much different than observed over the ARM SCF.

Xi, B.↗

Adaptive Fault Detection on Liquid Propulsion Systems with Virtual Sensors: Algorithms and Architectures

Prior to the launch of STS-119 NASA had completed a study of an issue in the flow control valve (FCV) in the Main Propulsion System of the Space Shuttle using an adaptive learning method known as Virtual Sensors. Virtual Sensors are a class of algorithms that estimate the value of a time series given other potentially nonlinearly correlated sensor readings. In the case presented here, the Virtual Sensors algorithm is based on an ensemble learning approach and takes sensor readings and control signals as input to estimate the pressure in a subsystem of the Main Propulsion System. Our results indicate that this method can detect faults in the FCV at the time when they occur. We use the standard deviation of the predictions of the ensemble as a measure of uncertainty in the estimate. This uncertainty estimate was crucial to understanding the nature and magnitude of transient characteristics during startup of the engine. This paper overviews the Virtual Sensors algorithm and discusses results on a comprehensive set of Shuttle missions and also discusses the architecture necessary for deploying such algorithms in a real-time, closed-loop system or a human-in-the-loop monitoring system. These results were presented at a Flight Readiness Review of the Space Shuttle in early 2009.

Matthews, Bryan L.↗

Space-Time Data fusion for Remote Sensing Applications

NASA has been collecting massive amounts of remote sensing data about Earth's systems for more than a decade. Missions are selected to be complementary in quantities measured, retrieval techniques, and sampling characteristics, so these datasets are highly synergistic. To fully exploit this, a rigorous methodology for combining data with heterogeneous sampling characteristics is required. For scientific purposes, the methodology must also provide quantitative measures of uncertainty that propagate input-data uncertainty appropriately. We view this as a statistical inference problem. The true but notdirectly- observed quantities form a vector-valued field continuous in space and time. Our goal is to infer those true values or some function of them, and provide to uncertainty quantification for those inferences. We use a spatiotemporal statistical model that relates the unobserved quantities of interest at point-level to the spatially aggregated, observed data. We describe and illustrate our method using CO2 data from two NASA data sets.

carbon dioxide↗

Understanding Differences in Upper Stratospheric Ozone Response to Changes in Chlorine and Temperature as Computed Using CCMVal Models

Projections of future ozone levels are made using models that couple a general circulation model with a representation of atmospheric photochemical processes, allowing interactions among photochemical processes, radiation, and dynamics. Such models are known as chemistry and climate models (CCMs). Although developed from common principles and subject to the same boundary conditions, simulated ozone time series vary for projections of changes in ozone depleting substances (ODSs) and greenhouse gases. In the upper stratosphere photochemical processes control ozone level, and ozone increases as ODSs decrease and temperature decreases due to greenhouse gas increase. Simulations agree broadly but there are quantitative differences in the sensitivity of ozone to chlorine and to temperature. We obtain insight into these differences in sensitivity by examining the relationship between the upper stratosphere annual cycle of ozone and temperature as produced by a suite of models. All simulations conform to expectation in that ozone is less sensitive to temperature when chlorine levels are highest because chlorine catalyzed loss is nearly independent of temperature. Differences in sensitivity are traced to differences in simulated temperature, ozone and reactive nitrogen when chlorine levels are close to background. This work shows that differences in the importance of specific processes underlie differences in simulated sensitivity of ozone to composition change. This suggests a) the multi-model mean is not a best estimate of the sensitivity of upper ozone to changes in ODSs and temperature; b) the spread of values is not an appropriate measure of uncertainty.

Douglass, A. R.↗

Calibration Uncertainty in Ocean Color Satellite Sensors and Trends in Long-term Environmental Records

Launched in late 2011, the Visible Infrared Imaging Radiometer Suite (VIIRS) aboard the Suomi National Polar-orbiting Partnership (NPP) spacecraft is being evaluated by NASA to determine whether this sensor can continue the ocean color data record established through the Sea-Viewing Wide Field-of-view Sensor (SeaWiFS) and the MODerate resolution Imaging Spectroradiometer (MODIS). To this end, Goddard Space Flight Center generated evaluation ocean color data products using calibration techniques and algorithms established by NASA during the SeaWiFS and MODIS missions. The calibration trending was subjected to some initial sensitivity and uncertainty analyses. Here we present an introductory assessment of how the NASA-produced time series of ocean color is influenced by uncertainty in trending instrument response over time. The results help quantify the uncertainty in measuring regional and global biospheric trends in the ocean using satellite remote sensing, which better define the roles of such records in climate research.

environment↗

Influence of Mid-Latitude Cyclones on European Background Surface Ozone Investigated in Observations, MACC and MERRA-2 Reanalyses

The relationship between springtime mid-latitude cyclones and background ozone at two rural monitoring sites on the west coast of Europe -- Mace Head, Ireland and Monte Velho, Portugal -- is explored using a combination of observations and three reanalyses: 1) the European Centre for Medium-Range Weather Forecasts' (ECMWF) ERA-Interim reanalysis, 2) the Monitoring Atmospheric Composition and Climate (MACC) reanalysis and 3) NASA's Modern-Era Retrospective Analysis for Research and Applications Version-2 (MERRA-2) reanalysis. The ERA-Interim cyclone tracks are used here to establish the long-term relationship between cyclones and ozone observations (since 1988). The MACC reanalysis data set, which covers the period 2003-2012, is produced with the ECMWF integrated forecast system (IFS) model two-way coupled to a chemistry transport model (CTM). Since the MACC reanalysis uses a similar atmospheric model to ERA-Interim, MACC is used to explore the mechanisms within the case study cyclones that can influence surface ozone concentrations at Mace Head and Monte Velho. The MERRA-2 reanalysis also provides 3D distributions of ozone, although less ideal for analysis of surface ozone concentrations since MERRA-2 ozone under represents ozone variability outside the stratosphere as it does not have a detailed chemistry scheme or emission sources for the troposphere. The MERRA-2 reanalysis, which has the potential to identify more features within the cyclones as the resolution is higher than the MACC reanalysis, is used in conjunction with the MACC reanalysis to provide a measure of uncertainty to the case study analysis. We found the main source of high ozone to these two sites is from the stratosphere, which is well represented in both the MERRA-2 and the MACC reanalyses, either from direct injection into the cyclone or associated with aged airstreams from decaying downstream cyclones that can become entrained and descend toward the surface within new cyclones over the NA region.

MERRA-2↗

Progress of the NASA ACE Mission Polarimeter Working Group Instrument Inter-Comparison

The NASA Aerosol-Cloud-Ecosystem (ACE) mission is a National Research Council Decadal Survey recommended mission that will contain an imaging polarimeter for remote sensing of aerosols and clouds. A variety of airborne polarimeter prototypes exist, so the ACE Polarimeter Working Group (ACEPWG) was formed to share information between groups and collectively work for improved measurement techniques, uncertainty characterization, and algorithm development. The initial focus has been on observations made during the Polarimeter Definition Experiment (PODEX), conducted in early 2013 in Southern California. Three ACE mission supported polarimeters were deployed on the high altitude ER-2 aircraft as it flew over a variety of targets. Two of those instruments to date have successfully produced Level 1 (geolocated radiance and polarization) data. Initial matched scene inter-comparisons found little radiometric, but significant polarimetric, bias. After improvement to geolocation in one instrument, and calibration in the other, polarimetric comparisons have improved significantly. We will describe these results, remaining unresolved issues, and future plans.

Polarimeter↗

Ultrastable environment control for the NEID spectrometer: design and performance demonstration

Two key areas of emphasis in contemporary experimental exoplanet science are the detailed characterization of transiting terrestrial planets and the search for Earth analog planets to be targeted by future imaging missions. Both of these pursuits are dependent on an order-of-magnitude improvement in the measurement of stellar radial velocities (RV), setting a requirement on single-measurement instrumental uncertainty of order 10 cm∕s. Achieving such extraordinary precision on a high-resolution spectrometer requires thermomechanically stabilizing the instrument to unprecedented levels. We describe the environment control system (ECS) of the NEID spectrometer, which will be commissioned on the 3.5-m WIYN Telescope at Kitt Peak National Observatory in 2019, and has a performance specification of on-sky RV precision <50 cm/s. Because NEID’s optical table and mounts are made from aluminum, which has a high coefficient of thermal expansion, sub-milliKelvin temperature control is especially critical. NEID inherits its ECS from that of the Habitable-Zone Planet Finder (HPF), but with modifications for improved performance and operation near room temperature. Our full-system stability test shows the NEID system exceeds the already impressive performance of HPF, maintaining vacuum pressures below 10(exp −6) Torr and a root mean square (RMS) temperature stability better than 0.4 mK over 30 days. Our ECS design is fully open-source; the design of our temperature-controlled vacuum chamber has already been made public, and here we release the electrical schematics for our custom temperature monitoring and control system.

Paul Robertson↗

Predicting near-saturated hydraulic conductivity in urban soils

Pedotransfer functions (PTFs) provide point predictions of soil hydraulic properties from more readily measured soil characteristics, yet uncertainties and biases in measurement methods, sampling distributions, and boundary conditions can limit accuracy when estimating near-saturated hydraulic conductivity (K(n)). These limitations may be particularly problematic in understudied urban landscapes that often contain altered hydraulic properties. To better treat deficiencies in PTF performance, we addressed three objectives, which were to: 1) develop PTFs to predict urban K(n), 2) assess bulk density and coarse fragments as explanatory variables; and 3) evaluate the predictive capability of these PTFs by comparing their output to measured hydraulic conductivity values from three other studies of urban soil hydraulics. We used artificial neural networks (ANN) and random forest (RF) approaches to predict urban K(n), with the training dataset including 307 tension infiltrometer tests and other measurements drawn from urban soil assessments in 11 U.S. cities. The PTFs utilized a hierarchy of inputs, starting with percentage sand, silt, clay, and then adding percentage coarse fragments and bulk density. The ANN models performed similar to the RF models, and all models exhibited similar or better predictive performance as models results collected from published articles. The inclusion of bulk density or coarse fragments did not improve accuracy over soil texture alone. Possible reasons for this result include low correlation between K(n) and bulk density and the exclusion of large voids during flow measurements with tension infiltrometers. The models have been made available as an open-source software package to encourage adoption by users working in urban systems.

Jinshi Jian↗

Dose-Response Data Considerations for the NASA Quesst Community Test Campaign

Key outcomes for NASA's Quesst mission are noise dose and perceptual response data to inform regulators on their decisions regarding noise certification standards for the future of overland commercial supersonic flight. Dose-response curves are commonly utilized in community noise studies to describe the annoyance of a community to a particular noise source. The X-59 aircraft utilizes shaped-boom technology to demonstrate low noise supersonic flight. For X-59 community studies, the sound level from X-59 overflights constitutes the dose, while the response is an annoyance rating selected from a verbal scale, e.g., “slightly annoyed” and “very annoyed.” Dose-response data will be collected from individual flyovers (single event dose) and an overall response to the accumulation of single events at the end of the day (cumulative dose). There are quantifiable sources of error in the noise dose due to uncertainty in microphone measurements of the sonic thumps and uncertainty in predicted noise levels at survey participant locations. Assessing and accounting for error in the noise dose is essential to obtain an accurate dose-response model. There is also a potential for error in the perceptual response. This error is due to the ability of participants to provide their response in a timely manner and participant fatigue after responding to up to one hundred surveys over the course of a month. This talk outlines various challenges in estimating noise dose and perceptual response and the methods considered in preparation for X-59 community tests.

dose-response↗

Robust Controller Synthesis for Vision-based Spacecraft Guidance and Control

This work develops a method for Robust Controller for Vision-based Spacecraft (RCVS) guidance and control, integral to the robust autonomy framework for multi-spacecraft for- mation control and reconfiguration applications. The method is built around the use of a photo-realistic simulator, where a camera is deployed on a tracking spacecraft (ego) in order to observe an uncontrolled spacecraft (target) in a Low Earth Orbit (LEO). In this direction, the proposed approach performs the relative state (attitude and position) estimation of the target spacecraft using Convolutional Neural Network (CNN). The state estimation error is then modeled and the corresponding error-bounds are obtained around a nominal trajectory of the ego and target spacecraft. Next, this work proposes a linear matrix inequalities (LMIs) based approach to controller synthesis, guaranteed to be robust against both model uncertainties and measurement errors, resulting from vision-based estimation. This controller is comprised of two distinct components, one synthesized based on the nominal trajectory, while the “robust” component corrects for deviations from the nominal trajectory. Finally, a tracking scenario that directly utilize the image data for spacecraft guidance and control, is presented to showcase the performance of the proposed robust autonomy framework.

Rahmani, Amir↗

Probabilistic Forecasting of Ground Magnetic Perturbation Spikes at Mid-Latitude Stations

The prediction of large fluctuations in the ground magnetic field (dB/dt) is essential for preventing damage from Geomagnetically Induced Currents. Directly forecasting these fluctuations has proven difficult, but accurately determining the risk of extreme events can allow for the worst of the damage to be prevented. Here we trained Convolutional Neural Network models for eight mid-latitude magnetometers to predict the probability that dB/dt will exceed the 99th percentile threshold 30–60 min in the future. Two model frameworks were compared, a model trained using solar wind data from the Advanced Composition Explorer (ACE) satellite, and another model trained on both ACE and SuperMAG ground magnetometer data. The models were compared to examine if the addition of current ground magnetometer data significantly improved the forecasts of dB/dt in the future prediction window. A bootstrapping method was employed using a random split of the training and validation data to provide a measure of uncertainty in model predictions. The models were evaluated on the ground truth data during eight geomagnetic storms and a suite of evaluation metrics are presented. The models were also compared to a persistence model to ensure that the model using both datasets did not over-rely on dB/dt values in making its predictions. Overall, we find that the models using both the solar wind and ground magnetometer data had better metric scores than the solar wind only and persistence models, and was able to capture more spatially localized variations in the dB/dt threshold crossings.

Michael Coughlan↗

Applied Uses of MERRA Reanalyses: Current and Future Prospects

During the initial planning of the Modern Era Retrospective-analysis for Research and Applications (MERRA), the project was envisioned to become a tool for applied sciences and decision makers, as well as weather and climate research. MERRA was the first reanalysis to provide data at 1 hourly frequencies. After discussions with wind energy users, 50m above the surface winds were included in the data collection to begin to represent the environment at the turbine height. MERRA-2 was the first reanalysis to include interactive and assimilated aerosols. From these, PM 1, 2.5 and 10 records have been computed and contribute to the climate and health sector. The US Center for Disease Control is accessing MERRA-2 data for comparison along with their health data. MERRA-2 Extreme Indices have been computed from the high frequency data (e.g. precipitation maxima, heat waves and fire weather). These have been used to characterize the changing extremes in the United States and around the globe as well as the weather associated with the extremes. The next-generation, MERRA-21C, includes increased resolution (25km) and continues to provide innovative Earth system data. For example, a boundary layer collection will provide constant height level data starting at 100m, continuing up to 4000m. This will provide detailed information about the boundary layer processes that greatly affect the biosphere. Chemical tracers for constituents are included in the system. The ensemble data assimilation is run with 32 members, and the variance for critical variables are stored. We will explore the use of this variance as one measure of uncertainty relevant for applied uses, which has not been included in any MERRA reanalysis. We will discuss use case scenarios developed to engage with the energy and financial sectors, to better understand their needs for climate data. Prospects for further downscaling of reanalyses will also be explored.

Michael Bosilovich↗

Evaluating the Global Water and Energy Cycles in Reanalyses Using Ensemble Spread

Reanalyses provide continuous observation based global data over weather and climate time scales through observational assimilation. Ensemble forecasts are a component of modern data assimilation systems, providing information to the analysis process. Storing this spread over the duration of a climate reanalysis will provide insight to the variations of the model that underlies the reanalysis data. Global water and energy cycles (WECs) are a critical aspect of both weather and climate, yet there are some large gaps in the observation of key components as well as their representation in models and reanalyses. NASA’s Water and Energy cycle Studies (NEWS) program is developing a corrected and balanced budget data set that is closed at monthly and regional scales during the 21st century, so far. In this paper, we will evaluate reanalysis WEC components against the initial NEWS collection of observation, but integrate the analysis spread from the reanalysis data assimilation as a new perspective on the evaluation. The initial evaluation will cover a few more recent years using ERA5 10 member spread. As the GMAO’s production of the Modern-Era Retrospective analysis for Research and Applications 21st Century (MERRA-21C) progresses, the effort will include the MERRA-21C 32 member spread. Ultimately, we will explore the potential of the ensemble spread as a measure of uncertainty in the reanalysis.

Michael Bosilovich↗

Quantifying replication through repeated analysis of UVM-A, a liquid reference material for cosmogenic 10 Be and 26 Al studies

In this study, in-situ produced cosmogenic nuclide sample preparation and analysis is a complicated, multi-step process with numerous possible sources of error, many of which have not been robustly quantified. Here, we use a liquid reference material (UVM-A) to test whether the analytic precision associated with individual isotopic ratios (n = 96) measured at two Accelerator Mass Spectrometry facilities (Lawrence Livermore National Laboratory and Purdue Rare Isotope Measurement Laboratory) accurately represents the range of values determined for aliquots prepared in a single laboratory over a period of five years. We find that 10 Be/ 9 Be ratios measured at the different accelerator facilities (n = 26 and n = 70) have statistically indistinguishable central tendencies, matching to within 0.1 %. Based on this large dataset, we suggest preliminary consensus values for UVM-A of 1.45 ± 0.06 x 10 -13 for 10 Be/ 9 Be (mean, one standard deviation, n = 96) and 4.47 ± 0.22 x 10 -13 for 26 Al/ 27 Al (mean, one standard deviation, n = 27). For both 10 Be/ 9 Be and 26 Al/ 27 Al, the relative standard deviations of the measured ratios are similar to the reported analytic uncertainties of sample measurement, suggesting that sample preparation introduced little if any additional scatter beyond the uncertainty of isotopic analysis. This dataset demonstrates that robust sample preparation and measurement can generate isotope ratio data reproducible at the level of counting statistics.

58 GEOSCIENCES↗