Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error estimation and analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Version 3 of the SMAP Level 4 Soil Moisture Product

The NASA Soil Moisture Active Passive (SMAP) Level 4 Soil Moisture (L4_SM) product provides 3-hourly, 9-km resolution, global estimates of surface (0-5 cm) and root zone (0-100 cm) soil moisture as well as related land surface states and fluxes from 31 March 2015 to present with a latency of 2.5 days. The ensemble-based L4_SM algorithm is a variant of the Goddard Earth Observing System version 5 (GEOS-5) land data assimilation system and ingests SMAP L-band (1.4 GHz) Level 1 brightness temperature observations into the Catchment land surface model. The soil moisture analysis is non-local (spatially distributed), performs downscaling from the 36-km resolution of the observations to that of the model, and respects the relative uncertainties of the modeled and observed brightness temperatures. Prior to assimilation, a climatological rescaling is applied to the assimilated brightness temperatures using a 6 year record of SMOS observations. A new feature in Version 3 of the L4_SM data product is the use of 2 years of SMAP observations for rescaling where SMOS observations are not available because of radio frequency interference, which expands the impact of SMAP observations on the L4_SM estimates into large regions of northern Africa and Asia. This presentation investigates the performance and data assimilation diagnostics of the Version 3 L4_SM data product. The L4_SM soil moisture estimates meet the 0.04 m3m3 (unbiased) RMSE requirement. We further demonstrate that there is little bias in the soil moisture analysis. Finally, we illustrate where the assimilation system overestimates or underestimates the actual errors in the system.

GEOS-↗

Description of the GMAO OSSE for Weather Analysis Software Package: Version 3

The Global Modeling and Assimilation Office (GMAO) at the NASA Goddard Space Flight Center has developed software and products for conducting observing system simulation experiments (OSSEs) for weather analysis applications. Such applications include estimations of potential effects of new observing instruments or data assimilation techniques on improving weather analysis and forecasts. The GMAO software creates simulated observations from nature run (NR) data sets and adds simulated errors to those observations. The algorithms employed are much more sophisticated, adding a much greater degree of realism, compared with OSSE systems currently available elsewhere. The algorithms employed, software designs, and validation procedures are described in this document. Instructions for using the software are also provided.

OSSE↗

Pulsed Lidar Measurements of Atmospheric CO2 Column Absorption in the ASCENDS 2011 Airborne Campaign

We have previously demonstrated an efficient pulsed, wavelength-resolved IPDA lidar technique for measuring the tropospheric CO2 concentrations as a candidate for NASA's ASCENDS mission. Our team participated in the 2010 ASCENDS airborne campaigns we flew airborne version of the CO2 and O2 lidar on the NASA DC-8. The CO2 lidar measures the atmospheric backscatter profiles and shape of the 1572.33 nm absorption line using 250 mW average laser power, 30 wavelength samples per scan and 300 scans per second. Most flights had 5-6 altitude steps to greater than 12 km, and clear CO2 line shapes were observed at all altitudes. Our post-flight analysis estimated the Iidar range and pulse energies at each wavelength every second. We then solved for the best-fit CO2 absorption line shape, and calculated the Differential Optical Depth (DOD) at the line peak. We compared these to CO2 DODs calculated from spectroscopy based on HITRAN 2008 and the conditions from airborne in-situ readings. Analysis of the 2010 measurements over the Pacific Ocean and Lamont OK shows the expected -linear change of the peak DOD with altitude. For measurements at altitudes greater than 6 km the random errors were approximately 0.3 ppm for 80 sec averaging times. After the 2010 flights we improved the airborne lidar's scan uniformity, calibration and receiver sensitivity. Our team participated in the seven ASCENDS science flights during late July and August 2011. These flights were made over a wide variety of surface and cloud conditions near the US, including over the central valley of California, over several mountain ranges, over both broken and solid stratus cloud deck over the Pacific Ocean, snow patches on mountain tops, over thin and broken clouds above the US Southwest and Iowa, and over forests near the WLEF tower in Wisconsin. Analyses show the retrievals of lidar range and CO2 column absorption, as wen as estimates of CO2 mixing ratio worked well when measuring over topography with rapidly changing height and reflectivity, through thin clouds and to stratus cloud tops. For regions where the CO2 concentration was relatively constant, the measured CO2 absorption profile (averaged for 50 sec) matched the predicted profile to better than 1% RMS error for all flight altitudes. For 1 & 10 second averaging, the scatter in the retrievals was limited by signal shot noise (i.e. the sigual photon count). Analysis to date shows the decrease in CO2 due to vegetation when flying easterward over the Great Plains as well as the increase in CO2 concentration in the vicinity ofthe coal-fired power plant in New Mexico. Examples of these and other results will be presented.

Abshire, James B.↗

Generating Accurate and Consistent Top-Of-Atmosphere Reflectance Products from the New Generation Geostationary Satellite Sensors

GeoNEX is a collaborative project by scientists from NASA, NOAA, JAXA, and other organizations around the world with the purpose of generating a suite of Earth-monitoring products using data streams from the latest geostationary (GEO) sensors including the GOES-16/17 ABI and the Himawari-8/9 AHI. An accurate and consistent top-of-atmosphere (TOA) reflectance product, in particular the bidirectional reflectance factor (BRF), is the starting point in the scientific processing chain. We describe the main considerations and corresponding algorithms in generating the GeoNEX TOA BRF product. First, a special advantage of geostationary data streams is their high temporal resolution (~10 minutes per full-disk scan), providing a key source of information for many downstream products. To fully utilize this high temporal frequency demands a high georegistration accuracy for every acquired image. Our analysis shows that there can be substantial georegistration uncertainties in both GOES and Himawari L1b data which we addressed by implementing a phase-based correction algorithm to remove residual errors. Second, geostationary sensors have distinct illumination-view geometry features in that the solar angle changes for every pixel. Therefore, to accurately derive a BRF requires a solar position algorithm and the estimation of the pixel-wise acquisition time within an uncertainty of 10 seconds. Third, we discuss the measures we adopted to check and correct residual radiometric calibration issues of individual sensors to enable time-series analysis as well as the cross calibration between different satellite sensors (including those from low-Earth orbit). Finally, we also explain the rationale for the choice of the global grid/tile system of the GeoNEX TOA BRF product.

Wang, Weile↗

Airborne Measurements of Atmospheric Pressure made Using an IPDA Lidar Operating in the Oxygen A-Band

We report airborne measurements of atmospheric pressure made using an integrated path differential absorption (IPDA) lidar that operates in the oxygen A-band near 765 nm. Remote measurements of atmospheric temperature and pressure are needed for NASA s Active Sensing of CO2 Emissions Over Nights, Days, and Seasons (ASCENDS) mission to measure atmospheric CO2. Accurate measurements of tropospheric CO2 on a global scale are very important in order to better understand its sources and sinks and to improve our predictions of climate change. The goal of ASCENDS is to determine the CO2 dry mixing ratio with lidar measurements from space at a level of ~1 ppm. Analysis to date shows that with current weather models, measurements of both the CO2 column density and the column density of dry air are needed. Since O2 is a stable molecule that uniformly mixed in the atmosphere, measuring O2 absorption in the atmosphere can be used to infer the dry air density. We have developed an airborne (IPDA) lidar for Oxygen, with support from the NASA ESTO IIP program. Our lidar uses DFB-based seed laser diodes, a pulsed modulator, a fiber laser amplifier, and a non-linear crystal to generate wavelength tunable 765 nm laser pulses with a few uJ/pulse energy. The laser pulse rate is 10 KHz, and average transmitted laser power is ~20 mW. Our lidar steps laser pulses across a selected line O2 doublet near 764.7 nm in the Oxygen A-band. The direct detection lidar receiver uses a 20 cm diameter telescope, a Si APD detector in Geiger mode, and a multi-channel scalar to detect and record the time resolved laser backscatter in 40 separate wavelength channels. Subsequent analysis is used to estimate the transmission line shape of the doublet for the laser pulses reflected from the ground. Ground based data analysis allows averaging from 1 to 60 seconds to increase SNR in the transmission line shape of the doublet. Our retrieval algorithm fits the expected O2 lineshapes against the measurements and determines the atmospheric pressure by minimizing the error between the observations and model. We first demonstrated our airborne lidar during flights during summer 2010. We made several improvements and made measurements during the Ascends flights during July 2011. More information about the technique, lidar instrument, airborne measurements, and pressure estimates will be described in the presentation.

Riris, Haris↗

Verification of the SMAP Level-4 Soil Moisture Analysis Using Rainfall Observations in Australia

Global, 3-hourly, 9-km resolution soil moisture estimates are available with a mean latency of ~2.5 days from the NASA Soil Moisture Active Passive (SMAP) mission Level-4 Soil Moisture (L4_SM) product. These estimates are based on the assimilation of SMAP radiometer brightness temperature (Tb) observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter. Routine monitoring of the L4_SM system's assimilation diagnostics revealed occasionally large observation-minus-forecast Tb differences across eastern central Australia that resulted in large analysis increments (or adjustments) of the model forecast soil moisture. Because this region lacks in situ soil moisture measurements, we developed an alternative approach to assess the veracity of the soil moisture analysis increments in the L4_SM system. Using regional gauge-based precipitation data, we demonstrate that the L4_SM soil moisture increments are correlated with errors in the L4_SM precipitation forcing, suggesting that the SMAP Tb observations contribute valuable information to the L4_SM soil moisture estimates.

Reichle, R.↗

Analysis of subpixel registration

The area of subpixel accuracy in image registration and edge detection was studied. Two main directions of research were pursued, edge detection and matching based on the digital geometry of edges, and random field models for probablistic analysis of registration error. In the edge detection approach, error bounds and error probabilities were computed using theoretical models. Algorithms were developed and tests on simulated imagery. The methods appear promising for high accuracy edge position estimation and registration, though further refinement of the procedures is required. Using random field models, a statistical measure of the quality of the cross correlation peak as an estimate of the offset between a sensed and a reference image was developed. Simulations were performed to determine the validity of this estimte with real imagery and to study the results of interpolating digital correlation functions to estimate the translation offset to subpixel accuracy.

Berenstein, C. A.↗

An experiment in software reliability

The results of a software reliability experiment conducted in a controlled laboratory setting are reported. The experiment was undertaken to gather data on software failures and is one in a series of experiments being pursued by the Fault Tolerant Systems Branch of NASA Langley Research Center to find a means of credibly performing reliability evaluations of flight control software. The experiment tests a small sample of implementations of radar tracking software having ultra-reliability requirements and uses n-version programming for error detection, and repetitive run modeling for failure and fault rate estimation. The experiment results agree with those of Nagel and Skrivan in that the program error rates suggest an approximate log-linear pattern and the individual faults occurred with significantly different error rates. Additional analysis of the experimental data raises new questions concerning the phenomenon of interacting faults. This phenomenon may provide one explanation for software reliability decay.

Dunham, J. R.↗

Experiments in software reliability - Life-critical applications

The paper discusses four reliability data gathering experiments which were conducted using a small sample of programs for two problems having ultrareliability requirements, n-version programming for fault detection, and repetitive run modeling for failure and fault rate estimation. The experimental results agree with those of Nagel and Skrivan in that the program error rates suggest an approximate log-linear pattern and the individual faults occurred with significantly different error rates. Additional analysis of the experimental data raises new questions concerning the phenomenon of interacting faults. This phenomenon may provide one explanation for software reliability decay. The fourth experiment underscored the difficulty in distinguishing between observations of deficiencies in the design of the algorithm and observations of software faults for real-time process control software. These experiments are a part of a program of serial experiments being pursued by the System Validation Methods of NASA-Langley Research Center to find a means of credibly performing reliability evaluations of flight control software.

Dunham, J. R.↗

Angular Distribution Models for Top-of-Atmosphere Radiative Flux Estimation from the Clouds and the Earth's Radiant Energy System Instrument on the Tropical Rainfall Measuring Mission Satellite: Validation - Part II

Top-of-atmosphere (TOA) radiative fluxes from the Clouds and the Earth s Radiant Energy System (CERES) are estimated from empirical angular distribution models (ADMs) that convert instantaneous radiance measurements to TOA fluxes. This paper evaluates the accuracy of CERES TOA fluxes obtained from a new set of ADMs developed for the CERES instrument onboard the Tropical Rainfall Measuring Mission (TRMM). The uncertainty in regional monthly mean reflected shortwave (SW) and emitted longwave (LW) TOA fluxes is less than 0.5 W/sq m, based on comparisons with TOA fluxes evaluated by direct integration of the measured radiances. When stratified by viewing geometry, TOA fluxes from different angles are consistent to within 2% in the SW and 0.7% (or 2 W/sq m) in the LW. In contrast, TOA fluxes based on ADMs from the Earth Radiation Budget Experiment (ERBE) applied to the same CERES radiance measurements show a 10% relative increase with viewing zenith angle in the SW and a 3.5% (9 W/sq m) decrease with viewing zenith angle in the LW. Based on multiangle CERES radiance measurements, 18 regional instantaneous TOA flux errors from the new CERES ADMs are estimated to be 10 W/sq m in the SW and, 3.5 W/sq m in the LW. The errors show little or no dependence on cloud phase, cloud optical depth, and cloud infrared emissivity. An analysis of cloud radiative forcing (CRF) sensitivity to differences between ERBE and CERES TRMM ADMs, scene identification, and directional models of albedo as a function of solar zenith angle shows that ADM and clear-sky scene identification differences can lead to an 8 W/sq m root-mean-square (rms) difference in 18 daily mean SW CRF and a 4 W/sq m rms difference in LW CRF. In contrast, monthly mean SW and LW CRF differences reach 3 W/sq m. CRF is found to be relatively insensitive to differences between the ERBE and CERES TRMM directional models.

Loeb, N. G.↗

Performance and Mass Modeling Subtleties in Closed-Brayton-Cycle Space Power Systems

A number of potential NASA missions could benefit from closed-Brayton-cycle (CBC) power conversion systems. The human and robotic mission power applications include spacecraft, surface base, and rover scenarios. Modeling of CBC subsystems allows system engineers, mission planners and project managers to make informed decisions regarding power conversion system characteristics and capabilities. To promote thorough modeling efforts, a critical review of CBC modeling techniques is presented. Analysis of critical modeling elements, component influences and cycle sensitivities is conducted. The analysis leads to quantitative results addressing projections on converter efficiency and overall power conversion system mass. Even moderate modeling errors are shown to easily over-predict converter efficiencies by 30% and underestimate mass estimates by 20%. Both static and dynamic modeling regimes are evaluated. Key considerations in determining model fidelity requirements are discussed. Conclusions and recommendations are presented that directly address ongoing modeling efforts in solar and nuclear space power systems.

Barrett, Michael J.↗

Validation of OCO-2 and ACOS-GOSAT using HIPPO and TCCON

Consistent validation of satellite CO2 estimates is a prerequisite for using multiple satellite CO2measurements for joint flux inversion and establishing a long-term atmospheric CO2 data record. Wevalidate recent satellite observation of OCO-2 v7 and ACOS-GOSAT v7.3 using similar analysis as previouswork (Kulawik et al. (2016) and Frankenberg et al. (2106)) through comparisons to the HIAPER Pole-to-Pole Observations (HIPPO) and the Total Carbon Column Observing Network (TCCON) to estimate biasesand errors affecting the understanding of carbon cycle science. CarbonTracker RT is also compared tothe validation data, and additionally used to evaluate the mismatch between the HIPPO observationtimeframe and the OCO-2 record, which are offset by 3-7 years. Some key metrics that are validatedinclude the seasonal cycle phase and amplitude, latitudinal gradient by season, regional biases, anderrors with respect to averaging.

Kulawik, Susan S.↗

Recent Improvements and Verification of A Full Body Model in Opensim

BACKGROUND: The dynamic feasibility [1,2] criterion, that the subject’s Center of Pressure (COP) be located within the Base of Support (BOS) which outlines the feet, has aided in assessing the stability of human motion recorded on earth while performing the recorded tasks in lunar gravity or as countermeasures exercises on a vibration isolation and stabilization system in microgravity. The convex hull of the BOS on the platform under the subject’s feet was estimated using virtual markers on the feet of the scaled subject model. The COP was calculated using the ground reaction forces and moments determined from motion capture data with biomechanical modeling tools [3]. Occasionally, large-amplitude oscillatory spikes or “artifacts” were observed in the subject’s linear and angular momentum derivatives, affecting some COP data derived from motion capture. The purpose of this investigation was to assess and improve the accuracy of model scaling and BOS estimation as well as to determine the efficacy of model adjustments in mitigating artifacts influencing motion capture-derived ground reaction force and COP results. METHODS: To aid evaluation of proposed process and model updates, motion capture data were collected for two subjects during unit test and range of motion trials, lunar tasks, and countermeasures exercise motions. Markers were added to the full body Plug-in Gait marker set [4] during data collection. New markers were placed on the front, back, sides, and top of the head to improve scaling using distances between marker pairs. Medial elbow markers were added to stabilize the upper arm during OpenSim Inverse Kinematics (IK) [5]. Finally, markers were added on the outer edge of the heels and on the outside edges of the first and last toes on each foot. These additional foot markers were made available to test new automated foot scaling techniques and to calculate the error between the subject’s estimated and recorded BOS. The modified unscaled OpenSim Full Body Rajagopal Model [6,7] was adjusted using some previously investigated techniques [8] to mitigate rapid shifts in joint angles occurring during IK, as these were found to cause the spike artifacts observed in subsequent stages of analysis. Since OpenSim models use Euler angles and rotation sequences, the arm axes of rotation were adjusted, and the pelvis order of rotation was changed to minimize the likelihood of encountering “gimbal lock” during common human motion. The model clavicle, arm, elbow, wrist, pelvis, and ankle angle limits were adjusted to better accommodate the full human range of motion seen in exercise and lunar data. The shoulder joint center was calculated using a “pivoting” algorithm [9], and both shoulder joint center and upper arm markers were included during IK to provide additional shoulder stability on a case-by-case basis. The quality of IK results was assessed by three criteria: minimizing error between recorded motion capture markers and model markers, checking for reasonable rates of change in joint angles between fames (i.e., no IK artifacts), and ensuring the absence of spikes in the inertial forces and angular momentum derivatives calculated using a custom OpenSim plugin [10]. RESULTS: The additional markers placed on the subject during data collection allowed the head and feet to be scaled more accurately using distances between new marker pairs. Scaling with BOS markers placed on the subject and removing the limit on subtalar angle resulted in more accurate BOS determination. Unrealistically large changes in joint angles between frames could be reduced by including clavicle, sternum, and medial elbow markers during IK. In cases with large arm ranges of motion, results could be further improved by running IK using medial elbow and virtual shoulder joint center markers. Model adjustments significantly improved the IK results affecting COP calculation and increased the accuracy of BOS estimation.

C A Bell↗

Canopy reflectance modelling of semiarid vegetation

Three different types of remote sensing algorithms for estimating vegetation amount and other land surface biophysical parameters were tested for semiarid environments. These included statistical linear models, the Li-Strahler geometric-optical canopy model, and linear spectral mixture analysis. The two study areas were the National Science Foundation's Jornada Long Term Ecological Research site near Las Cruces, NM, in the northern Chihuahuan desert, and the HAPEX-Sahel site near Niamey, Niger, in West Africa, comprising semiarid rangeland and subtropical crop land. The statistical approach (simple and multiple regression) resulted in high correlations between SPOT satellite spectral reflectance and shrub and grass cover, although these correlations varied with the spatial scale of aggregation of the measurements. The Li-Strahler model produced estimated of shrub size and density for both study sites with large standard errors. In the Jornada, the estimates were accurate enough to be useful for characterizing structural differences among three shrub strata. In Niger, the range of shrub cover and size in short-fallow shrublands is so low that the necessity of spatially distributed estimation of shrub size and density is questionable. Spectral mixture analysis of multiscale, multitemporal, multispectral radiometer data and imagery for Niger showed a positive relationship between fractions of spectral endmembers and surface parameters of interest including soil cover, vegetation cover, and leaf area index.

Franklin, Janet↗

Corrections in the Pioneer Venus sounder probe gas chromatographic analysis of the lower Venus atmosphere

Misidentification of two peaks from the Pioneer Venus sounder probe gas chromatograph (SPGC), also formerly known as the LGC, gave rise to quantitative errors in the abundances of oxygen, argon, and carbon monoxide. The argon abundance is estimated at 67 parts per million and that of carbon monoxide at 20 parts per million. At this time, no estimates for the oxygen abundance can be made.

Oyama, V. I.↗

GEOS-2 refraction program summary document

Data from an extensive array of collocated instrumentation at the Wallops Island test facility were intercompared in order to (1) determine the practical achievable accuracy limitations of various tropospheric and ionospheric correction techniques; (2) examine the theoretical bases and derivation of improved refraction correction techniques; and (3) estimate internal systematic and random error levels of the various tracking stations. The GEOS 2 satellite was used as the target vehicle. Data were obtained regarding the ionospheric and tropospheric propagation errors, the theoretical and data analysis of which was documented in some 30 separate reports over the last 6 years. An overview of project results is presented.

Mallinckrodt, A. J.↗

Verification and validation of the NASA Terminal Configured Vehicle's /TCV/ Wind Analysis program using real-time digital simulation

NASA's Terminal Configured Vehicle (TCV) program has been established to develop and evaluate aircraft and flight management technology that will benefit conventional takeoff and landing operations in the terminal area. To this end, a process whereby estimates of longitudinal, lateral, and vertical winds are obtained using the present complement of sensors onboard the TCV aircraft (B737-100) is developed. The results of the simulation experiment to verify and validate the TCV B737 Data Merging and Wind Analysis program have shown that the wind analysis algorithms are correct and that very satisfactory estimates of all three wind components are obtained even in the presence of adverse atmospheric conditions and realistic measurement noise. In realistic worst case conditions, wind component errors of the order of + or - 2.0 knots longitudinally, + or - 0.5 knot laterally, and + or - 1.0 knot vertically are to be expected.

Dieudonne, J. E.↗