Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Validation and Scaling of Soil Moisture in a Semi-Arid Environment: SMAP Validation Experiment 2015 (SMAPVEX15)

The NASA SMAP (Soil Moisture Active Passive) mission conducted the SMAP Validation Experiment 2015 (SMAPVEX15) in order to support the calibration and validation activities of SMAP soil moisture data products. The main goals of the experiment were to address issues regarding the spatial disaggregation methodologies for improvement of soil moisture products and validation of the in situ measurement upscaling techniques. To support these objectives high-resolution soil moisture maps were acquired with the airborne PALS (Passive Active L-band Sensor) instrument over an area in southeast Arizona that includes the Walnut Gulch Experimental Watershed (WGEW), and intensive ground sampling was carried out to augment the permanent in situ instrumentation. The objective of the paper was to establish the correspondence and relationship between the highly heterogeneous spatial distribution of soil moisture on the ground and the coarse resolution radiometer-based soil moisture retrievals of SMAP. The high-resolution mapping conducted with PALS provided the required connection between the in situ measurements and SMAP retrievals. The in situ measurements were used to validate the PALS soil moisture acquired at 1-km resolution. Based on the information from a dense network of rain gauges in the study area, the in situ soil moisture measurements did not capture all the precipitation events accurately. That is, the PALS and SMAP soil moisture estimates responded to precipitation events detected by rain gauges, which were in some cases not detected by the in situ soil moisture sensors. It was also concluded that the spatial distribution of the soil moisture resulted from the relatively small spatial extents of the typical convective storms in this region was not completely captured with the in situ stations. After removing those cases (approximately10 of the observations) the following metrics were obtained: RMSD (root mean square difference) of0.016m3m3 and correlation of 0.83. The PALS soil moisture was also compared to SMAP and in situ soil moisture at the 36-km scale, which is the SMAP grid size for the standard product. PALS and SMAP soil moistures were found to be very similar owing to the close match of the brightness temperature measurements and the use of a common soil moisture retrieval algorithm. Spatial heterogeneity, which was identified using the high-resolution PALS soil moisture and the intensive ground sampling, also contributed to differences between the soil moisture estimates. In general, discrepancies found between the L-band soil moisture estimates and the 5-cm depth in situ measurements require methodologies to mitigate the impact on their interpretations in soil moisture validation and algorithm development. Specifically, the metrics computed for the SMAP radiometer-based soil moisture product over WGEW will include errors resulting from rainfall, particularly during the monsoon season when the spatial distribution of soil moisture is especially heterogeneous.

SMAPVEX15↗

Nearfield Anisotropic Mesh Adaptation for the Third AIAA Sonic Boom Workshop

Sonic boom prediction is critical for the development of low-boom supersonic aircraft and encouraging a replacement of the overland commercial supersonic ban with a certification standard. The Third AIAA Sonic Boom Workshop nearfield test cases provide a unique opportunity to review anisotropic adaptive-mesh strategies for complex geometries with important propulsion interaction effects. Anisotropic metrics formulated to control estimated Mach interpolation and integrated nearfield pressure signature (goal-oriented) errors are compared with the results obtained on workshop-provided meshes. Detailed flow solutions and mesh renderings are combined with computational schlieren images to reveal the complex interactions present in a shock-plume interaction wind tunnel model and a prototype of the Low-Boom Flight Demonstrator. A favorable comparison of independent implementations of the entire simulation process provides evidence that each process is implemented correctly and sets a solid foundation for confidence in the nearfield prediction of each method.

sonic boom↗

Evaluating GXS Impact in the Context of International Coordination

The proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) program plans to include a hyperspectral infrared (IR) sounder on its central satellite. Expected to launch in the mid-2030s, the GeoXO Sounder (GXS) will join international counterparts in a geostationary orbit. Ahead of launch, the NASA Global Modeling and Assimilation Office (GMAO) assessed the potential effectiveness of GXS both as a single GEO IR sounder and as part of a global ring of such instruments, including those already being built by international agencies. Using an observing system simulation experiment (OSSE) framework, GXS was assessed from a global numerical weather prediction (NWP) perspective. The ability of GXS, both alone and as part of a global ring of GEO sounders, to improve weather prediction of thermodynamic variables was evaluated globally and regionally. Compared to a control, GXS dominated regional analysis and forecast improvements, and contributed significantly to global increases in forecast skill. However, more sustained global improvements on the order of 4 days rely on international partnerships. Using the FSOI metric over CONUS, the GXS observations provide the strongest radiance impact on the moist energy error norm reduction. Additionally, GXS shows the capability to improve hurricane forecast track errors, resulting in improved forecast warnings. Overall, the persistent atmospheric profile information from GXS over much of the western hemisphere provide an opportunity to improve the representation of weather systems and their forecasts.

Erica McGrath-Spangler↗

Evaluating GXS Impact in the Context of International Coordination

The proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) program plans to include a hyperspectral infrared (IR) sounder on its central satellite. Expected to launch in the mid-2030s, the GeoXO Sounder (GXS) will join international counterparts in a geostationary orbit. Ahead of launch, the NASA Global Modeling and Assimilation Office (GMAO) assessed the potential effectiveness of GXS both as a single GEO IR sounder and as part of a global ring of such instruments, including those already being built by international agencies. Using an observing system simulation experiment (OSSE) framework, GXS was assessed from a global numerical weather prediction (NWP) perspective. The ability of GXS, both alone and as part of a global ring of GEO sounders, to improve weather prediction of thermodynamic variables was evaluated globally and regionally. Compared to a control, GXS dominated regional analysis and forecast improvements, and contributed significantly to global increases in forecast skill. However, more sustained global improvements on the order of 4 days rely on international partnerships. Using the FSOI metric over CONUS, the GXS observations provide the strongest radiance impact on the moist energy error norm reduction. Additionally, GXS shows the capability to improve hurricane forecast track errors, resulting in improved forecast warnings. Overall, the persistent atmospheric profile information from GXS over much of the western hemisphere provide an opportunity to improve the representation of weather systems and their forecasts.

Erica McGrath-Spangler↗

Radial Velocity Detection of Extra-Solar Planetary Systems

The McDonald Observatory Planetary Search (MOPS) was designed to search for Jovian-mass planets in orbit around solar-type stars by making high-precision measurements of the Radial Velocity (RV) of a star, to attempt to detect the reflex orbital motion of the star around the star-planet barycenter. In our solar system, the velocity of the Sun around the Sun-Jupiter barycenter averages 12.3 m/ s. The MOPS survey started operation in September 1987, and searches 36 bright, nearby, solar-type dwarfs to 10 m/s precision. The survey was started using telluric O2 absorption lines as the velocity reference metric. Observations use the McDonald Observatory 2.7-m Harlan Smith Telescope coude spectrograph with the six-foot camera. This spectrograph configuration isolates a single order of the echelle grating on a Texas Instruments 800 x 800 CCD. The telluric line method gave us a routine radial velocity precision of about 15 m/s for stars down to about 5-th magnitude. However, the data obtained with this technique suffered from some source of long-term systematic errors, which was probably the intrinsic velocity variability of the terrestrial atmosphere, i.e. winds. In order to eliminate this systematic error and to improve our overall measurement precision, we installed a stabilized I2 gas absorption cell as the velocity metric for the MOPS in October 1990. In use at the telescope, the cell is placed directly in front of the spectrograph entrance slit, with starlight passing through the cell. The use of this sealed stabilized I2 cell removes potential problems with possible long-term drifts in the velocity metric. The survey now includes a sample of 36 nearby F, G, and K type stars of luminosity class V or IV-V.

Cochran, William D.↗

User Manual for Physical Scalars and Plotting Tools in Scala

An open-source scalar package and associated software tools have been developed in the Scala programming language, including plotting tools based on the free GRACE plotting package. The scalar package represents physical scalars and can help to prevent errors involving physical units in engineering and scientific computation. The scalar package includes a complete implementation of the standard SI metric system of units and many common non-metric units. The design also allows users to easily de ne a specialized or reduced set of physical units for any particular application or domain. The scalar package can be used in two different modes: one mode provides unit compatibility checking but is slower, and the other mode bypasses the compatibility checks but is much faster and still prevents the most common type of unit error. Switching between the two modes requires no changes in the user's code, making it convenient and usable with no significant performance penalty for even the most computationally intensive applications.

Paielli, Russell A.↗

Field Test: Results of Tandem Walk Performance Following Long-Duration Spaceflight

BACKGROUND: Coordinated locomotion has proven to be challenging for many astronauts following long duration spaceflight. As NASA's vision for spaceflight points toward interplanetary travel, we must prepare for unassisted landings, where crewmembers may need to perform mission critical tasks within minutes of landing. Thus, it is vital to develop a knowledge base from which operational guidelines can be written that define when astronauts can be expected to safely perform certain tasks. Data obtained during the Field Test experiment (FT) will add important insight to this knowledge base. Specifically, we aim to develop a recovery timeline of functional sensorimotor performance during the first 24 hours and several days after landing. METHODS: FT is an ongoing study of 30 long-duration ISS crewmembers. Thus far, 9 have completed the full FT (5 U.S. Orbital Segment [USOS] astronauts and 4 Russian cosmonauts) and 4 more consented and launching within the next year. This is in addition to the eighteen crewmembers that participated in the pilot FT (11 USOS and 7 Russian crewmembers). The FT is conducted three times preflight and three times during the first 24 hours after landing. All crewmembers were tested in Kazakhstan in either the medical tent at the Soyuz landing site (~one hour post-landing), or at the airport (~four hours post-landing). The USOS crewmembers were also tested at the refueling stop (~12 hours post-landing) and at the NASA Johnson Space Center (~24 hours post-landing) and a final session 7 days post-landing. Crewmembers are instrumented with 9 inertial measurement unit sensors that measure acceleration and angular displacement (APDM's Emerald Sensors) and foot pressure-sensing insoles that measure force, acceleration, and center of pressure (Moticon GmbH, Munich, Germany) along with heart rate and blood pressure recording instrumentation. The FT consists of 12 tasks, but here we will focus on the most challenging task, the Tandem Walk, which was also performed as part of pilot FT. To perform the Tandem Walk, subjects begin with their feet together, their arms crossed at their chest and eyes closed. When ready, they brought one foot forward and touched the heel of their foot to their toe, repeating with the other foot, and continuing for about 10 steps. Three trials were collected with the eyes closed and a fourth trial was collected with eyes open. There are four metrics which are used to determine the performance level of the Tandem Walk. The first is percent correct steps. For a step to be counted as correct, the foot could not touch the ground while bringing it forward (no side stepping), eyes must stay closed during the eyes closed trials, the heel and toe should be touching, or almost touching (no large gaps) and there shouldn't be more than a three second pause between steps. Three judges score each step and the median of the three scores is kept. The second metric is the average step speed, or the number of steps/time to complete them. Thirdly, the root mean squared (RMS) error in the resultant trunk acceleration is used to determine the amount of upper body instability observed during the task. Finally, the RMS error of the mediolateral center of pressure as measured by the Moticon insoles is used to determine the mediolateral instability at the foot level. These four parameters are combined into a new overall Tandem Walk Parameter. RESULTS: Preliminary results show that crewmembers perform the Tandem Walk significantly worse the first 24 hours after landing as compared to their baseline performance. We find that each of the four performance metrics is significantly worse immediately after landing. We will present the results of tandem walk performance during the FT thus far. We will also combine these with the 18 crewmembers that participated in the pilot FT, concentrating on the level of performance and recovery rate. CONCLUSION: The Tandem Walk data collected as part of the FT experiment will provide invaluable information on the performance capabilities of astronauts during the first 24 hours after returning from long-duration spaceflight that can be used in planning future Mars, or other deep-space missions with unassisted landings. FT will determine the average sensorimotor recovery timeline and inform return-to-duty guidelines for unassisted landings.

Rosenberg, M. J. F.↗

Achieving Accuracy Requirements for Forest Biomass Mapping: A Spaceborne Data Fusion Method for Estimating Forest Biomass and Lidar Sampling Error

The synergistic use of active and passive remote sensing (i.e., data fusion) demonstrates the ability of spaceborne light detection and ranging (LiDAR), synthetic aperture radar (SAR) and multispectral imagery for achieving the accuracy requirements of a global forest biomass mapping mission (+/-20 Mg/ha or 20%, the greater of the two, for at least 80% of grid cells). A data fusion approach also provides a means to extend 3D information from discrete spaceborne LiDAR measurements of forest structure across scales much larger than that of the LiDAR footprint. For estimating biomass, these measurements mix a number of errors including those associated with LiDAR footprint sampling over regional-global extents. A general framework for mapping above ground live forest biomass density (AGB) with a data fusion approach is presented and verified using data from NASA field campaigns near Howland, ME, USA, to assess AGB and LiDAR sampling errors across a regionally representative landscape. We combined SAR and Landsat-derived optical (passive optical) image data to identify contiguous areas (>0.5 ha) that are relatively homogenous in remote sensing metrics (forest patches). We used this image-derived data with simulated spaceborne LiDAR derived from orbit and cloud cover simulations and airborne data from NASA's Laser Vegetation Imaging Sensor (LVIS) to compute AGB and estimate LiDAR sampling error for forest patches and 100 m, 250 m, 500 m, and 1 km grid cells. At both the patch and grid scales, we evaluated differences in AGB estimation and sampling error from the combined use of LiDAR with both SAR and passive optical and with either SAR or passive optical alone. First, this data fusion approach demonstrates that incorporating forest patches into the AGB mapping framework can provide sub-grid forest information for coarser grid-level AGB reporting. Second, a data fusion approach for estimating AGB using simulated spaceborne LiDAR with SAR and passive optical image combinations reduced forest AGB sampling errors 12%-38% from those where LiDAR is used with SAR or passive optical alone. In absolute terms, sampling errors were reduced from 14-40 Mg/ha to 11-28 Mg/ha across all grid scales and prediction methods, where minimum sampling errors were 11, 15, 18, and 22 Mg/ha for 1 km, 500 m, 250 m, and 100 m grid scales, respectively. Third, spaceborne global scale accuracy requirements were achieved whereby at least 80% of the grid cells at 100 m, 250 m, 500 m, and 1 km grid levels met AGB accuracy requirements using a combination of passive optical and SAR along with machine learning methods to predict vegetation structure metrics for forested areas without LiDAR samples. Finally, using either passive optical or SAR, accuracy requirements were met at the 500 m and 250 m grid level, respectively..

LiDAR↗

Early Mission Orbit Determination Error Analysis Results for Low-Earth Orbiting Missions using TDRSS Differenced One-way Doppler Tracking Data

Differencing multiple, simultaneous Tracking and Data Relay Satellite System (TDRSS) one-way Doppler passes can yield metric tracking data usable for orbit determination for (low-cost) spacecraft which do not have TDRSS transponders or local oscillators stable enough to allow the one-way TDRSS Doppler tracking data to be used for early mission orbit determination. Orbit determination error analysis results are provided for low Earth orbiting spacecraft for various early mission tracking scenarios.

Marr, Greg C.↗

Quantization effects in Viterbi decoding rate 1/n convolutional codes

A Viterbi decoder's performance loss due to quantizing data from the additive white Gaussian noise (AWGN) channel is studied. An optimal quantization scheme and branch metric calculation method are presented. The uniformly quantized channel capacity C(sub u)(q) is used to determine the smallest number of quantization bits q that does not cause a significant loss. The quantizer stepsize which maximizes C(sub u)(q) almost minimizes the decoder bit error rate (BER). However, a slightly larger stepsize is better, like the value that minimizes the Bhattacharyya bound. The range and renormalization of state metrics is analyzed, in particular for K = 15 decoders such as the Big Viterbi Decoder (BVD) for the Galileo mission. These results are required to design reduced hardware complexity Viterbi decoders with a negligible quantization loss.

Onyszchuk, I. M.↗

Burst decoding of binary block codes on Q-ary output channels.

The burst-b distance between two binary vectors is defined and shown to be a metric. This definition is applied to a binary-input, Q-ary output channel where errors occur in bursts. A decoding algorithm is presented for such a channel that is an extension of Weldon's (1971) weighted erasure decoding. Examples are presented illustrating the techniques.

Wainberg, S.↗

Geodetic linear estimation technique and the norm choice problem

In this work the mathematical and probabilistic background of standard linear estimation techniques used in geodesy is clarified, and their interrelationship is revealed with the help of best approximation theory and the normal equations. Emphasis is given to the separation of the deterministic solution to the approximation problem from the probabilistic justification of the metric of the approximation. Least squares prediction has been related to deterministic (exact) collocation, and minimum error bound has been identified as a prediction optimality criterion in the latter. Criteria for the optimal choice of norm in Hilbert space collocation are proposed for gravimetric geodesy problems.

Dermanis, A.↗

Multi-spacecraft coherent Doppler and ranging for interplanetary-navigation

Future plans for planetary exploration currently include using multiple spacecraft to simultaneously explore one planet. This never before encountered situation places new demands on tracking systems used to support navigation. One possible solution to the problem of heavy ground resource conflicts is the use of multispacecraft coherent radio metric data, also known as, bent-pipe data. Analysis of the information content of these data types show that the information content of multi-spacecraft Doppler is dependent only on the frequency of the final downlink leg and is independent of the frequencies used on other legs. Numerical analysis shows that coherent bent-pipe data can provide significantly better capability to estimate the location of a lander on the surface of Mars than can direct lander to Earth radio metric data. However, this is complicated by difficulties in separating the effect of a lander position error from that of an orbiter position error for single passes of data.

Pollmeier, Vincent M.↗

Exploratory Analysis of Carbon Dioxide Levels and Ultrasound Measures of the Eye During ISS Missions

Carbon dioxide (CO2) levels on ISS have typically averaged 2.3 to 5.3mm Hg, with large fluctuations occurring over periods of hours and days. CO2 has effects on cerebral vascular tone, resulting in vasodilation and alteration of cerebral blood flow(CBF). Increased CBF leads to elevated intracranial pressure(ICP), which is a factor leading to visual disturbance, headaches, and other central nervous system symptoms. Ultrasound of the optic nerve provides a surrogate measurement of ICP. Inflight ultrasounds were implemented as an enhanced screening tool for the Visual Impairment/Intracranial Pressure (VIIP) Syndrome. This analysis examines the relationships between ambient CO2 levels on ISS and ultrasound measures of the eye in an effort to understand how CO2 may be associated with VIIP and to inform future analysis of inflight VIIP data. Results as shown in Figure2, there was a large timeframe where CO2 readings were removed due to sensor fault errors(see Limitations), from June 2011 to January 2012. After extensive cleaning of the CO2 data, metrics for all of the data were calculated (Table2). Preliminary analyses showed possible associations between variability measures of CO2 and AP diameter (Figure3),and average CO2 exposure and ONSD(Figure4). Adjustments for multiple comparisons were not made due to the exploratory nature of the analysis.

Schaefer, C.↗

Florida Transportation and Infrastructure: Monitoring Water Quality Along Southern Florida Seaports to Assess Impact on Coral Reef Tracts from Harbor Deepening Projects

The U.S. Army Corps of Engineers (USACE) and National Oceanic and Atmospheric Administration (NOAA) National Marine Fisheries Service (NMFS) will be supervising a harbor deepening project in Port Everglades, Florida. The project raises concerns about potential impacts on the nearby Florida reef tract through increased turbidity and sediment from the dredging. To better understand these potential impacts, the NASA DEVELOP team created an interactive Google Earth Engine tool to help establish a historical baseline of water quality parameters and assist monitoring these parameters more frequently than traditional sampling. This Seaport & Harbor Area Resource Quality (SHARQ) tool incorporates remotely sensed data from Sentinel-2 Multispectral Instrument, Landsat 5 Thematic Mapper, Landsat 7 Enhanced Thematic Mapper+, Landsat 8 Operational Land Imager, and Aqua Moderate Resolution Imaging Spectroradiometer. It allows users to view true color images and calculate water quality parameters, like turbidity and chlorophyll-a, for any given study area and time period from 1984 onward. The SHARQ tool also generate time series charts, allowing users to interpret changes in water quality over a given time range. The accuracy of the remotely sensed water quality parameter algorithms was determined using in situ data to calculate percent difference and root mean square error values (RMSE), which ranged from 0.32 to 0.58 error between sites. Using the SHARQ tool’s time series analysis feature, a baseline average turbidity metric of ~6.8 FNUs provides a historical baseline average for turbidity between September 2000 and 2020 and can assist in future decision-making for determining thresholds for turbidity.

Benjamin Rocha↗

Image Moment-Based Extended Object Tracking for Complex Motions

A novel image moment-based model for shape estimation and tracking of an extended target moving with a complex trajectory is presented. The proposed extended object tracking algorithm is based on multiple noisy measurement points sampled from the target at each time step. The shape of the object, approximated by an ellipse, is estimated using a combination of image moments. Dynamic models of image moments for constant velocity and coordinated turn motions are mathematically derived. An unscented Kalman filter - interacting multiple model (UKF-IMM) method is used to track the object and estimate its shape. A likelihood function based on average log-likelihood is derived for the IMM filter. Simulation results of the proposed UKF-IMM algorithm with the image momentbased models are presented that show the estimation of the shape of the object moving in a complex trajectory. The intersection over union (IoU), and the root mean square errors (RMSEs) of the position and velocity of the centroid of the ellipse are used as metrics. The comparison results of the proposed algorithm with a benchmark algorithm from literature based on the IoU and RMSE metrics are presented.

Extended object tracking↗

Retrieval of Aerosol Optical Properties From GOCI-II Observations: Continuation of Long-Term Geostationary Aerosol Monitoring Over East Asia

Since the Geostationary Ocean Color Imager (GOCI) was successfully launched in 2010, the GOCI Yonsei aerosol retrieval (YAER) algorithm has been continuously updated to retrieve hourly aerosol optical properties. GOCI-II has 4 more channels including UV, finer spatial resolution (250 m), and daily full disk coverage as compared to GOCI, and was launched in February 2020, onboard the GEO-KOMPSAT-2B (GK-2B) satellite. In this study, we extended the YAER algorithm to GOCI-II data based on its improved performance in many aspects and present the first results of aerosol optical properties retrieved from GOCI-II data. Utilizing the overlapping period between the GOCI-II and GOCI in geostationary Earth orbit, we present GOCI-II aerosol retrievals for high aerosol-loading cases over East Asia and show that these have a consistent spatial distribution with those from GOCI. Furthermore, GOCI-II provides AOD at an even higher spatial resolution, revealing finer changes in aerosol concentrations. Validation results for one year data show that the GOCI-II AOD has a correlation coefficient of 0.83 and a ratio within the expected error (EE) of 59.4 % when compared with the aerosol robotic network (AERONET) data. We compared statistical metrics for the GOCI and GOCI-II AODs to assess the consistency between the two datasets. In addition, it was found that there is a strong correlation between the two datasets from the comparison of gridded GOCI and GOCI-II AOD products. It is expected that data from GOCI-II will continue long-term aerosol records with high accuracy that can be used to address air-quality issues over East Asia.

AOD↗

Robust Trajectory Optimization for NRHO Rendezvous Using SPICE Kernel Relative Motion

In this paper, robust optimization is performed on trajectory correction maneuvers during the lunar lander return phase of an Artemis mission, treating the trajectory from one hour after low lunar orbit departure to arrival in the vicinity of the lunar Gateway as a relative motion problem. To enable rapid stochastic optimization techniques requiring many candidate trajectories, SPICE kernel relative motion as implemented by the Quadratic Interpolated State Transition (QIST) system is used as the underlying dynamics propagation. The optimization is performed with a genetic optimizer using linear covariance (LinCov) software in a simplified operational context, taking into account the availability of navigation sensors with varying measurement models, ranges, and accuracies. No numerical integration is used, since the relative motion around Gateway is fully characterized with the a priori computation of the QIST coefficients. Maneuver placements are computed to optimize the minimum 3σ delta-v of the trajectory, the position dispersion at a target point, and a convex combination of these two metrics. An order of magnitude runtime improvement is provided over legacy methods with less than 10% error introduced. All QIST results are shown to be in-family with legacy methods. The tradespace for optimal delta-v design is found to range from 77.0 to 93.9 m/s, while the range of optimal dispersion is between 1.4 and 11.7 km.

Relative Motion↗