Results for “error performance” — Page 64

NASA NTRS2004

Laser Metrology in the Micro-Arcsecond Metrology Testbed

The Space Interferometer Mission (SIM), scheduled for launch in 2009, is a space-born visible light stellar interferometer capable of micro-arcsecond-level astrometry. The Micro-Arcsecond Metrology testbed (MAM) is the ground-based testbed that incorporates all the functionalities of SIM minus the telescope, for mission-enabling technology development and verification. MAM employs a laser heterodyne metrology system using the Sub-Aperture Vertex-to-Vertex (SAVV) concept. In this paper, we describe the development and modification of the SAVV metrology launchers and the metrology instrument electronics, precision alignments and pointing control, locating cyclic error sources in the MAM testbed and methods to mitigate the cyclic errors, as well as the performance under the MAM performance metrics.

interferometry↗

NASA NTRS2008

Evaluation of Long-Term Cloud-Resolving Model Simulations Using Satellite Radiance Observations and Multi-Frequency Satellite Simulators

This paper proposes a methodology known as the Tropical Rainfall Measuring Mission (TRMM) Triple-Sensor Three-step Evaluation Framework (T3EF) for the systematic evaluation of precipitating cloud types and microphysics in a cloud-resolving model (CRM). T3EF utilizes multi-frequency satellite simulators and novel statistics of multi-frequency radiance and backscattering signals observed from the TRMM satellite. Specifically, T3EF compares CRM and satellite observations in the form of combined probability distributions of precipitation radar (PR) reflectivity, polarization-corrected microwave brightness temperature (Tb), and infrared Tb to evaluate the candidate CRM. T3EF is used to evaluate the Goddard Cumulus Ensemble (GCE) model for cases involving the South China Sea Monsoon Experiment (SCSMEX) and Kwajalein Experiment (KWAJEX). This evaluation reveals that the GCE properly captures the satellite-measured frequencies of different precipitating cloud types in the SCSMEX case but underestimates the frequencies of deep convective and deep stratiform types in the KWAJEX case. Moreover, the GCE tends to simulate excessively large and abundant frozen condensates in deep convective clouds as inferred from the overestimated GCE-simulated radar reflectivities and microwave Tb depressions. Unveiling the detailed errors in the GCE s performance provides the best direction for model improvements.

Matsui, Toshihisa↗

NASA NTRS2009

A Method for Retrieving Ground Flash Fraction from Satellite Lightning Imager Data

A general theory for retrieving the fraction of ground flashes in N lightning observed by a satellite-based lightning imager is provided. An "exponential model" is applied as a physically reasonable constraint to describe the measured optical parameter distributions, and population statistics (i.e., mean, variance) are invoked to add additional constraints to the retrieval process. The retrieval itself is expressed in terms of a Bayesian inference, and the Maximum A Posteriori (MAP) solution is obtained. The approach is tested by performing simulated retrievals, and retrieval error statistics are provided. The ability to retrieve ground flash fraction has important benefits to the atmospheric chemistry community. For example, using the method to partition the existing satellite global lightning climatology into separate ground and cloud flash climatologies will improve estimates of lightning nitrogen oxides (NOx) production; this in turn will improve both regional air quality and global chemistry/climate model predictions.

Koshak, William J.↗

NASA NTRS2010

A Ground Flash Fraction Retrieval Algorithm for GLM

A Bayesian inversion method is introduced for retrieving the fraction of ground flashes in a set of N lightning observed by a satellite lightning imager (such as the Geostationary Lightning Mapper, GLM). An exponential model is applied as a physically reasonable constraint to describe the measured lightning optical parameter distributions. Population statistics (i.e., the mean and variance) are invoked to add additional constraints to the retrieval process. The Maximum A Posteriori (MAP) solution is employed. The approach is tested by performing simulated retrievals, and retrieval error statistics are provided. The approach is feasible for N greater than 2000, and retrieval errors decrease as N is increased.

Koshak, William J.↗

NASA NTRS2007

Star Confusion Effect on SIM PlanetQuest Astrometric Performance

SIM PlanetQuest will measure star positions to an accuracy of a few microarcseconds using precise white light fringe measurements. One challenge for SIM observation scenario is "star confusion," where multiple stars are present in the instrument field of view. This is especially relevant for observing dim science targets because the density of number of stars increases rapidly with star magnitude. We study the effect of star confusion on the SIM astrometric performance due to systematic fringe errors caused by the extra photons from the confusion star(s}. Since star confusion from multiple stars may be analyzed as a linear superposition of the effect from single star confusion, we quantify the astrometric errors due to single star confusion surveying over many spectral types, including AOV, FOV, K5III, and MOV, and for various visual magnitude differences. To the leading order, the star confusion effect is characterized by the magnitude difference, spectral difference, and the angular separation between the target and confusion stars.Strategies for dealing with star confusion are presented. For example, since the presence of additional sources in the field of view leads to inconsistent delay estimates from different channels, with sufficient signal to noise ratio, the star confusion can be detected using chi-square statistics of fringe measurements from multiple spectral channels. An interesting result is that the star confusion can be detected even though the interferometer cannot resolve the separation between the target and confusion stars when their spectra are sufficiently different. Other strategies for mitigating the star confusion effect are also discussed.

crowded field↗

NASA NTRS2014

Detailed Uncertainty Analysis of the ZEM-3 Measurement System

The measurement of Seebeck coefficient and electrical resistivity are critical to the investigation of all thermoelectric systems. Therefore, it stands that the measurement uncertainty must be well understood to report ZT values which are accurate and trustworthy. A detailed uncertainty analysis of the ZEM-3 measurement system has been performed. The uncertainty analysis calculates error in the electrical resistivity measurement as a result of sample geometry tolerance, probe geometry tolerance, statistical error, and multi-meter uncertainty. The uncertainty on Seebeck coefficient includes probe wire correction factors, statistical error, multi-meter uncertainty, and most importantly the cold-finger effect. The cold-finger effect plagues all potentiometric (four-probe) Seebeck measurement systems, as heat parasitically transfers through thermocouple probes. The effect leads to an asymmetric over-estimation of the Seebeck coefficient. A thermal finite element analysis allows for quantification of the phenomenon, and provides an estimate on the uncertainty of the Seebeck coefficient. The thermoelectric power factor has been found to have an uncertainty of +9-14 at high temperature and 9 near room temperature.

Seebeck effect↗

NASA NTRS2016

Jwst from Below: An Overview of the Construction of the James Webb Space Telescope, Interesting Metrology, and Cryogenic-Vacuum Testing

NASA's James Webb Space Telescope (JWST) is a 6.6m diameter, segmented, deployable telescope for cryogenic IR space astronomy (40K). The JWST Observatory includes the Optical Telescope Element (OTE) and the Integrated Science Instrument Module (ISIM) that contains four science instruments (SI) and the guider. The SIs are mounted to a composite metering structure. The SI and guider units are integrated to the ISIM structure and optically tested at NASA Goddard Space Flight Center as a suite using a telescope simulator (Optical Telescope Element SIMulator; OSIM). OSIM is a full field, cryogenic JWST telescope simulator. SI performance, including alignment and wavefront error, is evaluated using OSIM. This is an overview presentation to undergraduate students and other personnel at the University of Richmond, planned for 12 Oct, 2016. It uses material previously released by NASA on the Internet (e.g., via Flickr) or at engineering conferences (e.g., SPIE). This presentation provides an overview of the status of the project, with an emphasis on optics and measurement.

instrument development↗

NASA NTRS2016

Chip Scale Ultra-Stable Clocks: Miniaturized Phonon Trap Timing Units for PNT of CubeSats

The Chip Scale Ultra-Stable Clocks (CSUSC) project aims to provide a superior alternative to current solutions for low size, weight, and power timing devices. Currently available quartz-based clocks have problems adjusting to the high temperature and extreme acceleration found in space applications, especially when scaled down to match small spacecraft size, weight, and power requirements. The CSUSC project aims to utilize dual-mode resonators on an ovenized platform to achieve the exceptional temperature stability required for these systems. The dual-mode architecture utilizes a temperature sensitive and temperature stable mode simultaneously driven on the same device volume to eliminate ovenization error while maintaining extremely high performance. Using this technology it is possible to achieve parts-per-billion (ppb) levels of temperature stability with multiple orders of magnitude smaller size, weight, and power.

Dual-mode resonators↗

NASA NTRS2015

Optical PAyload for Lasercomm Science (OPALS) link validation

Recently several day and nighttime links under diverse atmospheric conditions were completed using the Optical Payload for Lasercomm Science (OPALS) flight system on-board the International Space Station (ISS). In this paper we compare measured optical power and its variance at either end of the link with predictions that include atmospheric propagation models. For the 976 nm laser beacon mean power transmitted from the ground to the ISS the predicted mean irradiance of 10's of microwatts per square meter close to zenith and its decrease with range and increased air mass shows good agreement with predictions. The irradiance fluctuations sampled at 100 Hz also follow the expected increase in scintillation with air mass representative of atmospheric coherence lengths at zenith at 500 nm in the 3-8 cm range. The downlink predicted power of 100's of nanowatts was also reconciled within the uncertainty of the atmospheric losses. Expected link performance with uncoded bit-error rates less than 1E-4 required for the Reed-Solomon code to correct errors for video, text and file transmission was verified. The results of predicted and measured powers and fluctuations suggest the need for further study and refinement.

ISS↗

NASA NTRS2017

Design Trade Study for a 4-Meter Off-Axis Primary Mirror Substrate and Mount for the Habitable-Zone Exoplanet Direct Imaging Mission

An extensive trade study was conducted to evaluate primary mirror substrate design architectures for the HabEx mission baseline 4-meter off-axis telescope. The study’s purpose is not to produce a final design, but rather to established a design methodology for matching the mirror’s properties (mass and stiffness) with the mission’s optical performance specifications (static dynamic wavefront error, WFE). The study systematically compares the effect of proven design elements (closed-back vs. open-back vs. partial-back; meniscus vs. flat back vs. shaped back; etc.), which can be implemented with proven space mirror materials (ULE and Zerodur), on static and dynamic WFE. Additionally, the study compares static and dynamic WFE of each substrate point design integrated onto three and six point mounts.

space↗

NASA NTRS2019

Lidar-Polarimeter Retrieval OSSEs in Support of NASA's Aerosols and Clouds-Convection-Precipitation (ACCP) Study

The 2017 Decadal Survey (DS) highlighted Earth System Science themes, science and application questions, and several high priority objectives that have led to the inclusion of Aerosols (A) and Clouds-Convection-Precipitation (CCP) as Designated Observables (DOs). On June 1, 2018, several NASA centers (GSFC, LaRC, JPL, MSFC, GRC and ARC) submitted a joint Study Plan to the NASA Earth Science Division for the Aerosol (A) and Cloud, Convection, and Precipitation (CCP) Pre-formulation Study (A-CCP). The DS and the A-CCP team recognized the science merit in combining the A and CCP DOs for both enhancing the ability to address a number of science objectives and also to provide an expanded capability to address additional objectives beyond those addressed by individual DOs.A critical element of the A-CCP observing strategy is to make extensive use of new passive and active sensors as well as of the so-called Program-of-Record (PoR), complemented by a fully integrated sub-orbital component. Central to this observing system design is the adoption of a Value Framework in which quantitative assessment of the science benefits of space-and air-borne assets is a key element. Given pre-defined A-CCP science objectives and geophysical variables with desired accuracies, A-CCP relies on a spectrum of Observing System Simulation Experiments (OSSEs) aimed at addressing pixel level retrieval uncertainties and sampling trade-offs. In this talk we will discuss a subset of Retrieval OSSEs being considered for A-CCP, namely, synergistic lidar-polarimeter retrievals of particular relevance for the A-CCP aerosol science objectives. Starting with aerosol states from the GEOS-5 Nature Run (G5NR) sampled along specific satellite orbits, we simulate polarized radiances at the desired polarimeter wavelengths with the Vector Linearized Direct Ordinate Radiative Transfer (VLIDORT) model, alongside the lidar signal for the relevant lidars with realistic error characterization. Next, inversions are performed with the Generalized Retrieval of Aerosol and Surface Properties (GRASP) system and the accuracy of the retrieved geophysical variables are assessed. In this presentation we will highlight results for key architectures being considered for A-CCP.

da Silva, Arlindo↗

NASA NTRS2019

Modern Aerocapture Guidance to Enable Reduced-Lift Vehicles at Neptune

Aerocapture is covered extensively in the literature as means of achieving orbital insertion with dramatic mass-saving results compared to fully-propulsive systems. One of the primary obstacles facing aerocapture is the inherent uncertainty associated with passing through a planet’s upper atmosphere. In-flight dispersions due to delivery errors, environment variables, and aerodynamic performance impose a large flight envelope. System studies for aerocapture often select high lift-to-drag ratios to compensate for these uncertainties. However, modern predictor-corrector guidance strategies have shown promise in recent years to provide robust control schemes in-situ. These algorithms do not rely on a pre-calculated reference trajectory and instead employ a numerical optimizer to continuously solve nonlinear equations of motion each guidance cycle. Numerical predictor-corrector strategies may provide considerable accuracy over heritage guidance schemes. The goal of this study is reproduce a landmark study of Neptune aerocapture and apply modern guidance to illustrate relative performance improvements and cost-saving potential. Capture constraints based on the theoretical corridor width are considered. Results indicate that heritage vehicles with moderate lift-to-drag ratios, lower than previous studies have indicated, may prove viable for aerocapture at Neptune.

Heidrich, C. R.↗

NASA NTRSDate not supplied

Lidar-Polarimeter Retrieval OSSEs using a Nature Run in Support of NASA's Aerosols, Clouds, Convection and Precipitation (ACCP) Study

The 2017 Decadal Survey (DS) highlighted Earth System Science themes, science and application questions, and several high priority objectives that have led to the inclusion of Aerosols (A) and Clouds-Convection-Precipitation (CCP) as Designated Observables (DOs). On June 1, 2018, several NASA centers (GSFC, LaRC, JPL, MSFC, GRC and ARC) submitted a joint Study Plan to the NASA Earth Science Division for the Aerosol (A) and Cloud, Convection, and Precipitation (CCP) Pre-formulation Study (ACCP). The DS and the ACCP team recognized the science merit in combining the A and CCP DOs for both enhancing the ability to address a number of science objectives and also to provide an expanded capability to address additional objectives beyond those addressed by individual DOs. A critical element of the ACCP observing strategy is to make extensive use of new passive and active sensors as well as of the so-called Program-of-Record (PoR), complemented by a fully integrated sub-orbital component. Central to this observing system design is the adoption of a Value Framework in which quantitative assessment of the science benefits of space- and air-borne assets is a key element. Given pre-defined ACCP science objectives and geophysical variables with desired accuracies, ACCP relies on a spectrum of Observing System Simulation Experiments (OSSEs) aimed at addressing pixel level retrieval uncertainties and sampling trade-offs. In this talk we will discuss a subset of Retrieval OSSEs being considered for ACCP, namely, synergistic lidar-polarimeter retrievals based on observation simulations from the GEOS-5 Nature Run (G5NR). Starting with aerosol states from the GEOS-5 Nature Run (G5NR) sampled along specific satellite orbits, we simulate polarized radiances at the desired polarimeter wavelengths with the Vector Linearized Direct Ordinate Radiative Transfer (VLIDORT) model, alongside the lidar signal for the relevant lidars with realistic error characterization. Next, inversions are performed with the Generalized Retrieval of Aerosol and Surface Properties (GRASP) system and the accuracy of the retrieved geophysical variables are assessed. In this presentation we will highlight results for key architectures being considered for ACCP with emphasis on geophysical variables of particular relevance to ACCP’s aerosol science objectives.

A Da Silva↗

NASA NTRS2001

45 Km horizontal path optical link demonstrations

Observations made during a mountain-top-to-mountain-top horizontal optical link demonstration are described. The optical link spans a range of 45 Km at an average altitude of 2 Km above sea level. A multi-beam beacon comprised of eight laser beams emerging from multi-mode fiber coupled lasers (780 nm) are launched through a 0.6 m diameter telescope located at the JPL Table Mountain Facility (TMF) in Wrightwood, California. The multibeam beacon is received at Strawberry Peak located in the San Bernadino Mountains of California. The NASA, JPL developed optical communications demonstrator (OCD) receives the beacon, senses the atmosphere induced motion and using an upgraded fine steering loop compensates the re-transmission of a communications laser beam (852 nm, 400 Mbps) to TMF. The eight-beam beacon allowed a four reduction in normalized irradiance or scintillation index. This in turn was sufficient to eliminate beacon fades sensed b the OCD and allowed the fine steering loop performance evaluation. The uncompensated tracking error was determined to be 2.2 - 3 prad compared to a model prediction of 3.4 prad. The paper also discusses various auxiliary observations made during the campaign

Page, Norman A.↗

NASA NTRSDate not supplied

Effects of Communication Modality on Pilot-Controller Coordination during a Simulated m:N Operation

The last decade or so has seen growing interest in new control paradigms and concepts of operation for uncrewed aircraft systems (UAS) in which multiple aircraft are piloted remotely by a single or relatively small number of people. Referred to as “one-to-many” and “many-to- many” (alternatively, “multi-operator, multi-vehicle”)—and frequently expressed as the corresponding ratios, 1:N and m:N—such novel configurations of aircraft and the people who manage them are seen as critical to the path to future operations involving UAS. Examples of industry domains interested in these control paradigms are small package delivery services utilizing small UAS and passenger-carrying, short-range “Urban Air Mobility” (UAM) operations. Stakeholders in such operations have identified communication and coordination of flight activity with air traffic controllers (ATC) as a barrier to operations. In contrast to present-day flight operations, in which a pilot communicates with one ATC on one radio frequency for one aircraft, multi-vehicle operations potentially entail a significant increase in pilot task load for management of comms. New concepts, such as UAS Service Suppliers (USSs) and Providers of Services to UAM (PSUs), have been proposed to address the known bottleneck for Air Traffic Management (ATM) presented by multi-vehicle operations. While progress has been steadily made over years developing USSs and PSUs, it is generally expected that initial UAM operations will rely on traditional voice-over-radio communication with ATC for purposes of ATM. The current study was a human-in-the-loop simulation that had participants, each possessing a Private Pilot License, act as the ground-based pilot-in- command for multiple vehicles in a hypothetical UAM service in the San Francisco Bay Area. The experiment utilized a 2-by-3, within-subjects design in which the pilot’s Vehicle Load (4 vs. 12) and Comm System (Voice, Datalink, and a Hybrid) were manipulated. The task given to pilots was to use the Comm System to coordinate flight activity for all aircraft with appropriate controllers, having to obtain departure and arrival clearances at “vertiport” facilities and transition clearances for any intermediate airspaces along the route. Pilots were additionally responsible for compliance with vectoring instructions issued by ATC. Subjective workload questionnaires (NASA-TLX) were administered following each experimental trial. Screen recordings of the pilot’s Ground Control Station (GCS) and audio recordings of trials were subsequently coded to obtain performance metrics: response times and error rates. Presented in this paper are results related to pilot responses to vectoring instructions issued by ATC. Workload was found to be significantly higher in the 12-Vehicle condition compared to the 4-Vehicle condition, nearly maxing out the NASA-TLX overall workload scale. There was no significant difference made by the Comm System on workload ratings. Pilots’ response times to communications were fastest in the Voice condition, although overall “service time” for compliance was shorter in Datalink and Hybrid conditions in most cases. Errors by pilots were frequent in both Vehicle Load conditions, most perniciously when using the Voice system. The results of this study suggest tradeoffs in advantages and disadvantages of the three comm systems. Recommendations for communication system design are provided taking the tradeoffs into account.

Garrett G Sadler↗

NASA NTRSDate not supplied

Effects of Communication Modality on Pilot-Controller Coordination during a Simulated m:N Operation

The last decade or so has seen growing interest in new control paradigms and concepts of operation for uncrewed aircraft systems (UAS) in which multiple aircraft are piloted remotely by a single or relatively small number of people. Referred to as “one-to-many” and “many-to- many” (alternatively, “multi-operator, multi-vehicle”)—and frequently expressed as the corresponding ratios, 1:N and m:N—such novel configurations of aircraft and the people who manage them are seen as critical to the path to future operations involving UAS. Examples of industry domains interested in these control paradigms are small package delivery services utilizing small UAS and passenger-carrying, short-range “Urban Air Mobility” (UAM) operations. Stakeholders in such operations have identified communication and coordination of flight activity with air traffic controllers (ATC) as a barrier to operations. In contrast to present-day flight operations, in which a pilot communicates with one ATC on one radio frequency for one aircraft, multi-vehicle operations potentially entail a significant increase in pilot task load for management of comms. New concepts, such as UAS Service Suppliers (USSs) and Providers of Services to UAM (PSUs), have been proposed to address the known bottleneck for Air Traffic Management (ATM) presented by multi-vehicle operations. While progress has been steadily made over years developing USSs and PSUs, it is generally expected that initial UAM operations will rely on traditional voice-over-radio communication with ATC for purposes of ATM. The current study was a human-in-the-loop simulation that had participants, each possessing a Private Pilot License, act as the ground-based pilot-in- command for multiple vehicles in a hypothetical UAM service in the San Francisco Bay Area. The experiment utilized a 2-by-3, within-subjects design in which the pilot’s Vehicle Load (4 vs. 12) and Comm System (Voice, Datalink, and a Hybrid) were manipulated. The task given to pilots was to use the Comm System to coordinate flight activity for all aircraft with appropriate controllers, having to obtain departure and arrival clearances at “vertiport” facilities and transition clearances for any intermediate airspaces along the route. Pilots were additionally responsible for compliance with vectoring instructions issued by ATC. Subjective workload questionnaires (NASA-TLX) were administered following each experimental trial. Screen recordings of the pilot’s Ground Control Station (GCS) and audio recordings of trials were subsequently coded to obtain performance metrics: response times and error rates. Presented in this paper are results related to pilot responses to vectoring instructions issued by ATC. Workload was found to be significantly higher in the 12-Vehicle condition compared to the 4-Vehicle condition, nearly maxing out the NASA-TLX overall workload scale. There was no significant difference made by the Comm System on workload ratings. Pilots’ response times to communications were fastest in the Voice condition, although overall “service time” for compliance was shorter in Datalink and Hybrid conditions in most cases. Errors by pilots were frequent in both Vehicle Load conditions, most perniciously when using the Voice system. The results of this study suggest tradeoffs in advantages and disadvantages of the three comm systems. Recommendations for communication system design are provided taking the tradeoffs into account.

urban air mobility↗

DOE OSTI2020

Comparison of Human Performance between Operators and Students Using Rancor Microworld Simulator: A Preliminary Result

This paper describes an experiment using the Rancor Microworld simulator to probe into differences in human performance between students and actual operators. Six human performance measures – 1) time, 2) error, 3) workload, 4) situational awareness, 5) attention patterns, and 6) number of manipulations – are measured from experiments. The experiment has been conducted for 11 operators and 20 students so far. More experiments and analyses will be continued. Further experimental studies using Rancor Microworld are expected to be able to collect additional data that may be missing from full-scope studies and contribute to items that can support human reliability data.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2025

Airport Delay Prediction with Temporal Fusion Transformers

Since flight delay hurts passengers, airlines, and airports, its prediction becomes crucial for the decision-making of all stakeholders in the aviation industry and thus has been attempted by various previous research. However, previous delay predictions are often categorical and at a highly aggregated level. To improve that, this study proposes to apply the novel Temporal Fusion Transformer model and predict numerical airport arrival delays at quarter hour level for U.S. top 30 airports. Inputs to our model include airport demand and capacity forecasts, historic airport operation efficiency information, airport wind and visibility conditions, as well as en-route weather and traffic conditions. The results show that our model achieves satisfactory performance measured by small prediction errors on the test set. In addition, the interpretability analysis of the model outputs identifies the important input factors for delay prediction.

Liu, Ke [University of California Berkeley]↗