Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
NASA NTRS1983

Radio metric orbit determination for the Giotto mission to Comet Halley

An international fleet of five spacecraft will fly past Comet Halley as it travels through the inner solar system in early 1986. This paper discusses orbit determination problems associated with the Giotto spacecraft, sponsored by the European Space Agency. The large number of spin axis precession maneuvers required to maintain the desired spacecraft attitude creates a new kind of radio metric orbit determination problem for this mission. This paper investigates the accuracy with which the Giotto spacecraft orbit can be determined relative to the earth or the sun, and establishes the sensitivity of this accuracy to the selection of the parameters to be estimated, the form of estimator used, the number of tracking stations employed, the length of the data arc, the selection of data types processed, and the levels of various error sources.

Wood, L. J.↗
NASA NTRS1993

Monitoring cognitive function and need with the automated neuropsychological assessment metrics in Decompression Sickness (DCS) research

Hypobaric decompression sickness (DCS) research presents the medical monitor with the difficult task of assessing the onset and progression of DCS largely on the basis of subjective symptoms. Even with the introduction of precordial Doppler ultrasound techniques for the detection of venous gas emboli (VGE), correct prediction of DCS can be made only about 65 percent of the time according to data from the Armstrong Laboratory's (AL's) hypobaric DCS database. An AL research protocol concerned with exercise and its effects on denitrogenation efficiency includes implementation of a performance assessment test battery to evaluate cognitive functioning during a 4-h simulated 30,000 ft (9144 m) exposure. Information gained from such a test battery may assist the medical monitor in identifying early signs of DCS and subtle neurologic dysfunction related to cases of asymptomatic, but advanced, DCS. This presentation concerns the selection and integration of a test battery and the timely graphic display of subject test results for the principal investigator and medical monitor. A subset of the Automated Neuropsychological Assessment Metrics (ANAM) developed through the Office of Military Performance Assessment Technology (OMPAT) was selected. The ANAM software provides a library of simple tests designed for precise measurement of processing efficiency in a variety of cognitive domains. For our application and time constraints, two tests requiring high levels of cognitive processing and memory were chosen along with one test requiring fine psychomotor performance. Accuracy, speed, and processing throughout variables as well as RMS error were collected. An automated mood survey provided 'state' information on six scales including anger, happiness, fear, depression, activity, and fatigue. An integrated and interactive LOTUS 1-2-3 macro was developed to import and display past and present task performance and mood-change information.

Nesthus, Thomas E.↗
NASA NTRS1992

Pressurized Lunar Rover

The pressurized lunar rover (PLR) consists of a 7 m long, 3 m diameter cylindrical main vehicle and a trailer which houses the power and heat rejection systems. The main vehicle carries the astronauts, life support systems, navigation and communication systems, directional lighting, cameras, and equipment for exploratory experiments. The PLR shell is constructed of a layered carbon-fiber/foam composite. The rover has six 1.5 m diameter wheels on the main body and two 1.5 m diameter wheels on the trailer. The wheels are constructed of composites and flex to increase traction and shock absorption. The wheels are each attached to a double A-arm aluminum suspension, which allows each wheel 1 m of vertical motion. In conjunction with a 0.75 m ground clearance, the suspension aids the rover in negotiating the uneven lunar terrain. The 15 N-m torque brushless electric motors are mounted with harmonic drive units inside each of the wheels. The rover is steered by electrically varying the speeds of the wheels on either side of the rover. The PLR trailer contains a radiosotope thermoelectric generator providing 6.7 kW. A secondary back-up energy storage system for short-term high-power needs is provided by a bank of batteries. The trailer can be detached to facilitate docking of the main body with the lunar base via an airlock located in the rear of the PLR. The airlock is also used for EVA operation during missions. Life support is a partly regenerative system with air and hygiene water being recycled. A layer of water inside the composite shell surrounds the command center. The water absorbs any damaging radiation, allowing the command center to be used as a safe haven during solar flares. Guidance, navigation, and control are supplied by a strapdown inertial measurement unit that works with the on-board computer. Star mappers provide periodic error correction. The PLR is capable of voice, video, and data transmission. It is equipped with two 5 W X-band transponder, allowing simultaneous transmission and reception. An S-band transponder is used to communicate with the crew during EVA. The PLR has a total mass of 6197 kg. It has a nominal speed of 10 km/hr and a top speed of 18 km/hr. The rover is capable of towing 3 metric tons (in addition to the RTG trailer).

Creel, Kenneth↗
NASA NTRS2013

Scatter-Reducing Sounding Filtration Using a Genetic Algorithm and Mean Monthly Standard Deviation

Retrieval algorithms like that used by the Orbiting Carbon Observatory (OCO)-2 mission generate massive quantities of data of varying quality and reliability. A computationally efficient, simple method of labeling problematic datapoints or predicting soundings that will fail is required for basic operation, given that only 6% of the retrieved data may be operationally processed. This method automatically obtains a filter designed to reduce scatter based on a small number of input features. Most machine-learning filter construction algorithms attempt to predict error in the CO2 value. By using a surrogate goal of Mean Monthly STDEV, the goal is to reduce the retrieved CO2 scatter rather than solving the harder problem of reducing CO2 error. This lends itself to improved interpretability and performance. This software reduces the scatter of retrieved CO2 values globally based on a minimum number of input features. It can be used as a prefilter to reduce the number of soundings requested, or as a post-filter to label data quality. The use of the MMS (Mean Monthly Standard deviation) provides a much cleaner, clearer filter than the standard ABS(CO2-truth) metrics previously employed by competitor methods. The software's main strength lies in a clearer (i.e., fewer features required) filter that more efficiently reduces scatter in retrieved CO2 rather than focusing on the more complex (and easily removed) bias issues.

Mandrake, Lukas↗
NASA NTRS2017

Filter Tuning Using the Chi-Squared Statistic

This paper examines the use of the Chi-square statistic as a means of evaluating filter performance. The goal of the process is to characterize the filter performance in the metric of covariance realism. The Chi-squared statistic is the value calculated to determine the realism of a covariance based on the prediction accuracy and the covariance values at a given point in time. Once calculated, it is the distribution of this statistic that provides insight on the accuracy of the covariance. The process of tuning an Extended Kalman Filter (EKF) for Aqua and Aura support is described, including examination of the measurement errors of available observation types, and methods of dealing with potentially volatile atmospheric drag modeling. Predictive accuracy and the distribution of the Chi-squared statistic, calculated from EKF solutions, are assessed.

Filter Tuning↗
NASA NTRS2019

Winter Wheat Yield Assessment from Landsat 8 and Sentinel-2 Data: Incorporating Surface Reflectance, Through Phenological Fitting, into Regression Yield Models

A combination of Landsat 8 and Sentinel-2 offers a high frequency of observations (3–5 days) at moderate spatial resolution (10–30 m), which is essential for crop yield studies. Existing methods traditionally apply vegetation indices (VIs) that incorporate surface reflectances (SRs) in two or more spectral bands into a single variable, and rarely address the incorporation of SRs into empirical regression models of crop yield. In this work, we address these issues by normalizing satellite data (both VIs and SRs) derived from NASA’s Harmonized Landsat Sentinel-2 (HLS) product, through a phenological fitting. We apply a quadratic function to fit VIs or SRs against accumulated growing degree days (AGDDs), which affects the rate of crop development. The derived phenological metrics for VIs and SRs, namely peak, area under curve (AUC), and fitting coefficients from a quadratic function, were used to build empirical regression winter wheat models at a regional scale in Ukraine for three years, 2016–2018. The best results were achieved for the model with near infrared (NIR) and red spectral bands and derived AUC, constant, linear, and quadratic coefficients of the quadratic model. The best model yielded a root mean square error (RMSE) of 0.201 t/ha (5.4%) and coefficient of determination R2 = 0.73 on cross-validation.

phenological fitting↗
NASA NTRS2015

Human Factors and Habitability Challenges for Mars Missions

As NASA is planning to send humans deeper into space than ever before, adequate crew health and performance will be critical for mission success. Within the NASA Human Research Program (HRP), the Space Human Factors and Habitability (SHFH) team is responsible for characterizing the risks associated with human capabilities and limitations with respect to long-duration spaceflight, and for providing mitigations (e.g., guidelines, technologies, and tools) to promote safe, reliable and productive missions. SHFH research includes three domains: Advanced Environmental Health (AEH), Advanced Food Technology (AFT), and Space Human Factors Engineering (SHFE). The AEH portfolio focuses on understanding the risk of microbial contamination of the spacecraft and on the development of standards for exposure to potential toxins such as chemicals, bacteria, fungus, and lunar/Martian dust. The two risks that the environmental health project focuses on are adverse health effects due to changes in host-microbe interactions, and risks associated with exposure to dust in planetary surface habitats. This portfolio also proposes countermeasures to these risks by making recommendations that relate to requirements for environmental quality, foods, and crew health on spacecraft and space missions. The AFT portfolio focuses on reducing the mass, volume, and waste of the entire integrated food system to be used in exploration missions, and investigating processing methods to extend the shelf life of food items up to five years, while assuring that exploration crews will have nutritious and palatable foods. The portfolio also delivers improvements in both the food itself and the technologies for storing and preparing it. SHFE sponsors research to establish human factors and habitability standards and guidelines in five risk areas, and provides improved design concepts for advanced crew interfaces and habitability systems. These risk areas include: Incompatible vehicle/habitat design, inadequate human-computer interaction, inadequate critical task design, inadequate human-automation/robotic interaction, and performance errors due to training deficiencies. To address the identified research gaps within each risk, SHFH's research plan includes studies in the laboratory, in analogs, and on International Space Station (ISS). In addition to establishing and maintaining the risk-based research portfolio, SHFH is also implementing a qualitative approach to determine how we at NASA evaluate human performance. Via interviews with experts, such as trainers, flight controllers, and flight surgeons, we are collecting the metrics by which they assess human performance, evidence of performance issues, and potential or actual consequences. The Human Performance Data Project will determine what human performance data have been collected in the past at NASA, and what data should be collected in the future in order to complete our knowledgebase and reduce risks related to human factors and habitability.

Whitmore, Mihriban↗
NASA NTRS2005

Cognition in Space Workshop: Metrics and Models - 1

"Cognition in Space Workshop I: Metrics and Models" was the first in a series of workshops sponsored by NASA to develop an integrated research and development plan supporting human cognition in space exploration. The workshop was held in Chandler, Arizona, October 25-27, 2004. The participants represented academia, government agencies, and medical centers. This workshop addressed the following goal of the NASA Human System Integration Program for Exploration: to develop a program to manage risks due to human performance and human error, specifically ones tied to cognition. Risks range from catastrophic error to degradation of efficiency and failure to accomplish mission goals. Cognition itself includes memory, decision making, initiation of motor responses, sensation, and perception. Four subgoals were also defined at the workshop as follows: (1) NASA needs to develop a human-centered design process that incorporates standards for human cognition, human performance, and assessment of human interfaces; (2) NASA needs to identify and assess factors that increase risks associated with cognition; (3) NASA needs to predict risks associated with cognition; and (4) NASA needs to mitigate risk, both prior to actual missions and in real time. This report develops the material relating to these four subgoals.

Woolford, Barbara↗
NASA NTRS2019

Accrued Delay Application in Trajectory-Based Operations

The air traffic management system lacks integration among its elements often due to using inconsistent information, models, and metrics about the traffic. Transitioning to trajectory-based operations, whereby flights are managed by full trajectories in space and time, will enable more integration, with the help of increased automation. Building on trajectory-based operations, an "accrued delay" metric is proposed, which continuously measures the amount of delay that a flight has accumulated up to the current time, including delays incurred during the current flight and inherited from previous flights through the turnaround process. Through a time-based metering and scheduling example, we show how using accrued delay as a metric can help integrate the decision-making across multiple decision horizons, leading to more efficient and balanced access to airspace services. We show that when prioritizing flights that have already accrued high delay because of a constrained runway resource, significant gains are achieved in terms of reducing total delay and its variance. We studied the sensitivity of these gains to numerous factors, such as time-based versus distance-based horizons, horizon size, and errors in conformance to scheduled times.

delay; trajectory-based operations; time-based flo↗
NASA NTRS2019

Accrued Delay Application in Trajectory-Based Operations

The air traffic management system lacks integration among its elements often due to using inconsistent information, models, and metrics about the traffic. Transitioning to trajectory-based operations, whereby flights are managed by full trajectories in space and time, will enable more integration, with the help of increased automation. Building on trajectory-based operations, an "accrued delay" metric is proposed, which continuously measures the amount of delay that a flight has accumulated up to the current time, including delays incurred during the current flight and inherited from previous flights through the turnaround process. Through a time-based metering and scheduling example, we show how using accrued delay as a metric can help integrate the decision-making across multiple decision horizons, leading to more efficient and balanced access to airspace services. We show that when prioritizing flights that have already accrued high delay because of a constrained runway resource, significant gains are achieved in terms of reducing total delay and its variance. We studied the sensitivity of these gains to numerous factors, such as time-based versus distance-based horizons, horizon size, and errors in conformance to scheduled times.

Idris, Husni↗
NASA NTRS2011

GEM-CEDAR Challenge: Comparing Ionospheric Models with Poynting Flux from DMSP Observations

As part to the GEM-CEDAR challenge we are extending the model-data comparisons to electrodynamic in-situ measurements in low-Earth orbit. We use DMSP observations of electric and magnetic fields to compute Poynting Flux values along the satellite track in high latitudes including the auroral zones and the polar cap. Models of the ionosphere that include electrodynamic parameters have been run for five events selected for the GEM-CEDAR modeling challenge for which DMSP data are available for comparison. Combined with a magnetic field model we use the modeled electric fields to compute Poynting Flux and Joule Dissipation values from outputs of CTIPe, TIE-GCM, the ionospheric electrodynamics solvers of the SWMF, LFM and OpenGGCM magnetosphere-ionosphere coupled models, and the Weimer electric field model. The online metrics analysis tool at the Community Coordinated Modeling Center (CCMC) has been updated to handle the analysis of separate short segments of available data (high-latitude sections of the satellite orbit) with model outputs to analyze how well auroral patterns are being reproduced by the models. We present initial results from the new analysis tool in terms of model yields (ratio of the difference between maximum and minimum values of model results to the observation), timing/location errors of local maxima in the inbound and outbound auroral crossings as well as cross-correlations for individual passes. We collect the information for many DMSP passes and present an analysis for model performance during quiet and geomagnetically disturbed time periods using half-orbit integrated values as well.

Rastaetter, Lutz↗
NASA NTRS1980

An analysis of network deployment for a dedicated navigation tracking system

Stringent navigation accuracy requirements for future deep space missions are expected to be met by conventional two way radio metric data supplemented with Very Long Baseline Interferometric (VLBI) data provided by a dedicated tracking network. The performance of several proposed VLBI network configurations have been evaluated by comparing navigation capability for the probe delivery and post flight probe trajectory phases of the Galileo mission. Candidate configurations include stations located at the current intercontinental DSN sites, a network with sites in Hawaii, Florida and Washington, Regional (300 km) and a Micro (30 km) baseline systems. Sensitivity to systematic error sources, network deployment, viewing period and sampling strategy are investigated. The dominant factor in performance is shown to be the baseline length.

Ellis, J.↗
NASA NTRS2018

Uncertainty in Heart Rate Complexity Metrics Caused by R-Peak Perturbations

Heart rate complexity (HRC) is a proven metric for gaining insight into human stress and physiological deterioration. To calculate HRC, the detection of the exact instance of when the heart beats, the R-peak, is necessary. Electrocardiogram (ECG) signals can often be corrupted by environmental noise (e.g., from electromagnetic interference, movement artifacts), which can potentially alter the HRC measurement, producing erroneous inputs which feed into decision support models. Current literature has only investigated how HRC is affected by noise when R-peak detection errors occur (false positives and false negatives). However, the numerical methods used to calculate HRC are also sensitive to the specific location of the fiducial point of the R-peak. This raises many questions regarding how this fiducial point is altered by noise, the resulting impact on the measured HRC, and how we can account for noisy HRC measures as inputs into our decision models. This work uses Monte Carlo simulations to systematically add white and pink noise at different permutations of signal-to-noise ratios (SNRs), time segments, sampling rates, and HRC measurements to characterize the influence of noise on the HRC measure by altering the fiducial point of the R-peak. Using the generated information from these simulations provides improved decision processes for system design which address key concerns such as permutation entropy being a more precise, reliable, less biased, and more sensitive measurement for HRC than sample and approximate entropy.

Napoli, Nicholas J.↗
NASA NTRS2008

SPICE Module for the Satellite Orbit Analysis Program (SOAP)

A SPICE module for the Satellite Orbit Analysis Program (SOAP) precisely represents complex motion and maneuvers in an interactive, 3D animated environment with support for user-defined quantitative outputs. (SPICE stands for Spacecraft, Planet, Instrument, Camera-matrix, and Events). This module enables the SOAP software to exploit NASA mission ephemeris represented in the JPL Ancillary Information Facility (NAIF) SPICE formats. Ephemeris types supported include position, velocity, and orientation for spacecraft and planetary bodies including the Sun, planets, natural satellites, comets, and asteroids. Entire missions can now be imported into SOAP for 3D visualization, playback, and analysis. The SOAP analysis and display features can now leverage detailed mission files to offer the analyst both a numerically correct and aesthetically pleasing combination of results that can be varied to study many hypothetical scenarios. The software provides a modeling and simulation environment that can encompass a broad variety of problems using orbital prediction. For example, ground coverage analysis, communications analysis, power and thermal analysis, and 3D visualization that provide the user with insight into complex geometric relations are included. The SOAP SPICE module allows distributed science and engineering teams to share common mission models of known pedigree, which greatly reduces duplication of effort and the potential for error. The use of the software spans all phases of the space system lifecycle, from the study of future concepts to operations and anomaly analysis. It allows SOAP software to correctly position and orient all of the principal bodies of the Solar System within a single simulation session along with multiple spacecraft trajectories and the orientation of mission payloads. In addition to the 3D visualization, the user can define numeric variables and x-y plots to quantitatively assess metrics of interest.

Coggi, John↗
NASA NTRS2020

In-Time UAV Flight-Trajectory Estimation and Tracking Using Bayesian Filters

Rapid increase of UAV operation in the next decade in areas of on-demand delivery, medical transportation services, law enforcement, traffic surveillance and several others pose potential risks to the low altitude airspace above densely populated areas. Safety assessment of airspace demands the need for a novel UAV traffic management (UTM) framework for regulation and tracking of the vehicles. Particularly for low-altitude UAV operations, quality of GPS measurements feeding into the UAV is often compromised by loss of communication link caused by presence of trees or tall buildings in proximity to the UAV flight path. Inaccurate GPS locations may yield to unreliable monitoring and inaccurate prognosis of remaining battery life and other safety metrics which rely on future expected trajectory of the UAV. This work therefore proposes a generalized monitoring and prediction methodology for autonomous UAVs using in-time GPS measurements. Firstly, a typical 4D smooth trajectory generation technique from a series of waypoint locations with associated expected times-of-arrival based on B-spline curves is presented. Initial uncertainty in the vehicle's expected cruise velocity is quantified to compute confidence intervals along the entire flight trajectory using error interval propagation approach. Further, the generated planned trajectory is considered as the prior knowledge which is updated during its flight with incoming GPS measurements in order to estimate its current location and corresponding kinematic profiles. Estimation of position is denoted in dicrete state-space representation such that position at a future time step is derived from position and velocity at current time step and expected velocity at the future time step. A linear Bayesian filtering algorithm is employed to efficiently refine position estimation from noisy GPS measurements and update the confidence intervals. Further, a dynamic re-planning strategy is implemented to incorporate unexpected detour or delay scenarios. Finally, critical challenges related to uncertainty quantification in trajectory prognosis for autonomous vehicles are identified, and potential solutions are discussed at the end of the paper. The entire monitoring framework is demonstrated on real UAV flight experiments conducted at the NASA Langley Research Center.

Banerjee, Portia↗
NASA NTRS1983

An orthogonal coordinate grid following the three-dimensional viscous flow over a concave surface

Swept wings designed for laminar flow control exhibit both centrifugal and crossflow instabilities which produce streamwise vortices that can lead to early transition from laminar to turbulent flow in the presence of Tollmien-Schlichting waves. This paper outlines an iterative algorithm for generation of an orthogonal, curvilinear, coordinate grid following the streamlines of the three-dimensional viscous flow over a swept, concave surface. The governing equations for the metric tensor are derived from the Riemann-Christoffel tensor for an Euclidian geometry. Unit vectors along streamline, normal and binormal directions are determined. The governing equations are not solved directly, but are employed only as compatibility equations. The scale factor for the streamline coordinate is obtained by an iterative integration scheme on a 200 x 100 x 5 grid, while the other two scale factors are determined from definitions. Sample results are obtained which indicate that the compatibility equation error decreases linearly with grid step size. Grids smaller than 200 x 100 x 5 are found to be inadequate to resolve the grid curvature.

Dagenhart, J. R↗
NASA NTRS1994

Software interface verifier

A Telos study of 40 recent subsystem deliveries into the DSN at JPL found software interface testing to be the single most expensive and error-prone activity, and the study team suggested creating an automated software interface test tool. The resulting Software Interface Verifier (SIV), which was funded by NASA/JPL and created by Telos, employed 92 percent software reuse to quickly create an initial version which incorporated early user feedback. SIV is now successfully used by developers for interface prototyping and unit testing, by test engineers for formal testing, and by end users for non-intrusive data flow tests in the operational environment. Metrics, including cost, are included. Lessons learned include the need for early user training. SIV is ported to many platforms and can be successfully used or tailored by other NASA groups.

Soderstrom, Tomas J.↗
NASA NTRS2012

Space Telescope Sensitivity and Controls for Exoplanet Imaging

Herein we address design considerations and outline requirements for space telescopes with capabilities for high contrast imaging of exoplanets. The approach taken is to identify the span of potentially detectable Earth-sized terrestrial planets in the habitable zone of the nearest stars within 30 parsecs and estimate their inner working angles, flux ratios, SNR, sensitivities, wavefront error requirements and sensing and control times parametrically versus aperture size. We consider 1, 2, 4, 8 and 16-meter diameter telescope apertures. The achievable science, range of telescope architectures, and the coronagraphic approach are all active areas of research and are all subject to change in a rapidly evolving field. Thus, presented is a snapshot of our current understanding with the goal of limiting the choices to those that appear currently technically feasible. We describe the top-level metrics of inner working angle, contrast and photometric throughput and explore how they are related to the range of target stars. A critical point is that for each telescope architecture and coronagraphic choice the telescope stability requirements have differing impacts on the design for open versus closed-loop sensing and control.

Wavefront control↗