Engineering PapersSearch

SEARCH · Engineering Papers

Results for “partial observation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

An Adaptive Technique for a Redundant-Sensor Navigation System

An on-line adaptive technique is developed to provide a self-contained redundant-sensor navigation system with a capability to utilize its full potentiality in reliability and performance. The gyro navigation system is modeled as a Gauss-Markov process, with degradation modes defined as changes in characteristics specified by parameters associated with the model. The adaptive system is formulated as a multistage stochastic process: (1) a detection system, (2) an identification system and (3) a compensation system. It is shown that the sufficient statistics for the partially observable process in the detection and identification system is the posterior measure of the state of degradation, conditioned on the measurement history.

Chien, T. T.

Temperature and velocity profiles in sooting free boundary layer flames

Temperature and velocity profiles are presented for cyclohexane, n-heptane, and iso-octane free, laminar, boundary layer, sooting, diffusion flames. Temperatures are measured with 3 mil Pt/Pt-13 percent Rh thermocouples. Corrected gas temperatures are derived by performing an energy balance of convection to and radiation from the thermocouple bead incorporating the variation of air conductivity and platinum emissivity with temperature. Velocities are measured using laser doppler velocimetry techniques. Profiles are compared with previously reported analytic temperature and velocity fields. Comparison of theoretical and experimental temperature profiles suggests improvement in the analytical treatment is needed, which accounts more accurately for the local soot radiation. The velocity profiles are in good agreement, with the departure of the theory from observation partially due to the small fluctuations inherent in these free flows.

Ang, J. A.

Qualitative Discovery in Medical Databases

Implication rules have been used in uncertainty reasoning systems to confirm and draw hypotheses or conclusions. However a major bottleneck in developing such systems lies in the elicitation of these rules. This paper empirically examines the performance of evidential inferencing with implication networks generated using a rule induction tool called KAT. KAT utilizes an algorithm for the statistical analysis of empirical case data, and hence reduces the knowledge engineering efforts and biases in subjective implication certainty assignment. The paper describes several experiments in which real-world diagnostic problems were investigated; namely, medical diagnostics. In particular, it attempts to show that: (1) with a limited number of case samples, KAT is capable of inducing implication networks useful for making evidential inferences based on partial observations, and (2) observation driven by a network entropy optimization mechanism is effective in reducing the uncertainty of predicted events.

Maluf, David A.

Markov Tracking for Agent Coordination

Partially observable Markov decision processes (POMDPs) axe an attractive representation for representing agent behavior, since they capture uncertainty in both the agent's state and its actions. However, finding an optimal policy for POMDPs in general is computationally difficult. In this paper we present Markov Tracking, a restricted problem of coordinating actions with an agent or process represented as a POMDP Because the actions coordinate with the agent rather than influence its behavior, the optimal solution to this problem can be computed locally and quickly. We also demonstrate the use of the technique on sequential POMDPs, which can be used to model a behavior that follows a linear, acyclic trajectory through a series of states. By imposing a "windowing" restriction that restricts the number of possible alternatives considered at any moment to a fixed size, a coordinating action can be calculated in constant time, making this amenable to coordination with complex agents.

Washington, Richard

Making the Impossible Possible: Strategies for Fast POMDP Monitoring

Systems modeled as partially observable Markov decision processes (POMDPs) can be tracked quickly with three restrictions: all actions are grouped together, the out-degree of each system state is bounded by a constant, and the number of non-zero elements in the belief state is bounded by a (different) constant. With these restrictions, the tracking algorithm operates in constant time and linear space. The first restriction assumes that the action itself is unobservable. The second restriction defines a subclass of POMDPs that covers however a wide range of problems. The third restriction is an approximation technique that can lead to a potentially vexing problem: an observation may be received that has probability according to the restricted belief state. This problem of impossibility will cause the belief state to collapse. In this paper we discuss the tradeoffs between the constant bound on the belief state and the quality of the solution. We concentrate on strategies for overcoming the impossibility problem and demonstrate initial experimental results that indicate promising directions.

Washington, Richard

Optimal Limited Contingency Planning

For a given problem, the optimal Markov policy over a finite horizon is a conditional plan containing a potentially large number of branches. However, there are applications where it is desirable to strictly limit the number of decision points and branches in a plan. This raises the question of how one goes about finding optimal plans containing only a limited number of branches. In this paper, we present an any-time algorithm for optimal k-contingency planning. It is the first optimal algorithm for limited contingency planning that is not an explicit enumeration of possible contingent plans. By modelling the problem as a partially observable Markov decision process, it implements the Bellman optimality principle and prunes the solution space. We present experimental results of applying this algorithm to some simple test cases.

Meuleau, Nicolas

Hybrid Discrete-Continuous Markov Decision Processes

This paper proposes a Markov decision process (MDP) model that features both discrete and continuous state variables. We extend previous work by Boyan and Littman on the mono-dimensional time-dependent MDP to multiple dimensions. We present the principle of lazy discretization, and piecewise constant and linear approximations of the model. Having to deal with several continuous dimensions raises several new problems that require new solutions. In the (piecewise) linear case, we use techniques from partially- observable MDPs (POMDPS) to represent value functions as sets of linear functions attached to different partitions of the state space.

Feng, Zhengzhu

Learning Grasp Strategies Composed of Contact Relative Motions

Of central importance to grasp synthesis algorithms are the assumptions made about the object to be grasped and the sensory information that is available. Many approaches avoid the issue of sensing entirely by assuming that complete information is available. In contrast, this paper proposes an approach to grasp synthesis expressed in terms of units of control that simultaneously change the contact configuration and sense information about the object and the relative manipulator-object pose. These units of control, known as contact relative motions (CRMs), allow the grasp synthesis problem to be recast as an optimal control problem where the goal is to find a strategy for executing CRMs that leads to a grasp in the shortest number of steps. An experiment is described that uses Robonaut, the NASA-JSC space humanoid, to show that CRMs are a viable means of synthesizing grasps. However, because of the limited amount of information that a single CRM can sense, the optimal control problem may be partially observable. This paper proposes expressing the problem as a k-order Markov Decision Process (MDP) and solving it using Reinforcement Learning. This approach is tested in a simulation of a two-contact manipulator that learns to grasp an object. Grasp strategies learned in simulation are tested on the physical Robonaut platform and found to lead to grasp configurations consistently.

Platt, Robert, Jr.

Eta Car: The Good, the Bad and the Ugly of Nebular and Stellar Confusion

Observations in the far-UV provide a unique opportunity to investigate the very massive star Eta Car and its hot binary companion, Eta Car B. Eta Car was observed with FUSE over a large portion of the 5.54 year spectroscopic period before and after the 2003.5 minimum. The observed spectrum is defined by strong stellar wind signatures, primarily from Eta Car A, complicated by the strong absorptions of the ejecta surrounding Eta Car plus interstellar absorption. The Homunculus and Little Homunculus are massive bipolar ejecta historically associable with LBV outbursts in the 1840s and the 1890s and are linked to absorptions at -513 and -146 km/s, respectively. The FUSE spectra are confused by the extended nebulosity and thermal drifting of the FUSE co-pointed instruments. Interpretation is further complicated by two B-stars sufficiently close to h Car to be included most of the time in the large FUSE aperture. Followup observations partially succeeded in obtaining spectra of at least one of these B-stars through the smaller apertures, allowing potential separation of the B-star contributions and h Car. A complete analysis of all available spectra is currently underway. Our ultimate goals are to directly detect the hot secondary star if possible with FUSE and to identify the absorption contributions to the overall spectrum especially of the stellar members and the massive ejecta.

Gull, T.R.

Comparison of Statistical Estimation Techniques for Mars Entry, Descent, and Landing Reconstruction from MEDLI-like Data Sources

Flight data from an entry, descent, and landing (EDL) sequence can be used to reconstruct the vehicle's trajectory, aerodynamic coefficients and the atmospheric profile experienced by the vehicle. Past Mars missions have contained instruments that do not provide direct measurement of the freestream atmospheric conditions. Thus, the uncertainties in the atmospheric reconstruction and the aerodynamic database knowledge could not be separated. The upcoming Mars Science Laboratory (MSL) will take measurements of the pressure distribution on the aeroshell forebody during entry and will allow freestream atmospheric conditions to be partially observable. This data provides a mean to separate atmospheric and aerodynamic uncertainties and is part of the MSL EDL Instrumentation (MEDLI) project. Methods to estimate the flight performance statistically using on-board measurements are demonstrated here through the use of simulated Mars data. Different statistical estimators are used to demonstrate which estimator best quantifies the uncertainties in the flight parameters. The techniques demonstrated herein are planned for application to the MSL flight dataset after the spacecraft lands on Mars in August 2012.

Dutta, Soumyo

Validating MODIS Above-Cloud Aerosol Optical Depth Retrieved from Color Ratio Algorithm Using Direct Measurements Made by NASA's Airborne AATS and 4STAR Sensors

We present the validation analysis of above-cloud aerosol optical depth (ACAOD) retrieved from the color ratio method applied to MODIS cloudy-sky reflectance measurements using the limited direct measurements made by NASAs airborne Ames Airborne Tracking Sunphotometer (AATS) and Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR) sensors. A thorough search of the airborne database collection revealed a total of five significant events in which an airborne sun photometer, coincident with the MODIS overpass, observed partially absorbing aerosols emitted from agricultural biomass burning, dust, and wildfires over a low-level cloud deck during SAFARI-2000, ACE-ASIA 2001, and SEAC4RS 2013 campaigns, respectively. The co-located satellite-airborne match ups revealed a good agreement (root-mean-square difference less than 0.1), with most match ups falling within the estimated uncertainties associated with the MODIS retrievals (about -10 to +50 ). The co-retrieved cloud optical depth was comparable to that of the MODIS operational cloud product for ACE-ASIA and SEAC4RS, however, higher by 30-50% for the SAFARI-2000 case study. The reason for this discrepancy could be attributed to the distinct aerosol optical properties encountered during respective campaigns. A brief discussion on the sources of uncertainty in the satellite-based ACAOD retrieval and co-location procedure is presented. Field experiments dedicated to making direct measurements of aerosols above cloud are needed for the extensive validation of satellite based retrievals.

airborne sun photometer

Dynamic Routing of Aircraft in the Presence of Adverse Weather Using a POMDP Framework

Each year weather-related airline delays result in hundreds of millions of dollars in additional fuel burn, maintenance, and lost revenue, not to mention passenger inconvenience. The current approaches for aircraft route planning in the presence of adverse weather still mainly rely on deterministic methods. In contrast, this work aims to deal with the problem using a Partially Observable Markov Decision Processes (POMDPs) framework, which allows for reasoning over uncertainty (including uncertainty in weather evolution over time) and results in solutions that are more robust to disruptions. The POMDP-based decision support system is demonstrated on several scenarios involving convective weather cells and is benchmarked against a deterministic planning system with functionality similar to those currently in use or under development.

Decision making

Adaptive Stress Testing: Using Reinforcement Learning to Find Failures in Safety-Critical Systems

Emerging applications in artificial intelligence, such as driverless cars and autonomous aircraft promise to be more efficient, cheaper to operate, and always available. However, ensuring the safety of these systems remains a major challenge to their certification and adoption. These autonomous systems are expected to routinely make safety-critical decisions where failures can have serious consequences including loss of life and property. Testing and validation techniques aim to identify and diagnose potential failures before the system is deployed. However, finding failure scenarios in autonomous systems can be very challenging due to high-dimensional and continuous state spaces, interaction with large environments over many time steps, and the rarity of failures. This talk presents Adaptive Stress Testing (AST), a simulation-based testing framework for finding the most likely path to a failure event of a safety-critical system. The key idea of AST is that stress testing can be formulated as a Partially Observable Markov Decision Process (POMDP), which enables reinforcement learning techniques to be used for finding failure events. Reinforcement learning algorithms can efficiently explore the search space and have been shown to scale to very large systems. We present applications of AST to find failures in various safety-critical systems including the aircraft collision avoidance systems, autonomous cars, and small unmanned aerial vehicles.

autonomous vehicles

Oculometric Analysis of Saccadic Compensation for Visual Motion Processing Impairment due to Alcohol and Sleep Disruption

The Visuomotor Control Laboratory at Ames Research Center has developed a 5-minute ocular tracking test that computes 21 largely independent metrics of visuomotor performance, reflecting neural signal processing along a number of distinct pathways through cortex, brainstem, and cerebellum. Human sensorimotor performance is resilient to the challenges and stressors of many operational environments, in part, because overall performance is achieved through multiple parallel systems. Our multidimensional oculometrics allow us to examine impacts on these sub-components separately. To illustrate this, we contrasted the effects of two mild neural stressors, acute sleep-deprivation and low-dose alcohol. We have previously shown that, in both cases, oculometric analysis is a highly sensitive indicator of impairment. Here we quantified not only the observed impact on the performance of one sub-system, smooth pursuit, which uses high-level cortical processing of visual motion to track a moving object, but also the observed (partial) compensation by an evolutionarily older mid-brain and brainstem subsystem, saccades, which generates jumps in eye position to catch up with the target when smooth pursuit is inadequate. Specifically, we examined the dose-response (effect size vs. dose size) of the ground lost (pursuit deficit) and the ground recouped (saccadic compensation) across three separate studies – acute low-dose alcohol administration (16 subjects), acute sleep loss (12 subjects), and acute sleep loss with caffeine intervention (9 subjects). We computed the dose-response slopes using linear regression. The figure below shows that, in the case of acute sleep deprivation, the resulting slopes for ground lost and ground recouped (mean ± SE across subjects) were significantly different (paired t-test, t(11) = 5.17, p < 0.001), indicating poor saccadic compensation. However, when sleep loss was coupled with caffeine ingestion, ground lost was decreased and ground recouped increased such that the slopes were no longer different (t(8) = -0.05, p = 0.965). With alcohol, the two slopes were large albeit not significantly different (t(15) = 0.96, p = 0.351), indicating significant pursuit impairment but effective saccadic compensation. Our findings show that sleep deprivation and alcohol affect oculomotor performance differently. Low-dose alcohol effects appear predominantly cortical, with effective brainstem compensation. Sleep loss and circadian disruption however appears to affect both cortical and brainstem pathways with caffeine providing an effective countermeasure to both effects. Beyond the mere detection of impairment, our oculometric assessment allows us to characterize the nature of the deficit, to provide insight into the neural substrate, and to assess the effectiveness of countermeasures.

pursuit

EARLINET evaluation of the CATS Level 2 aerosol backscatter coefficient product

We present the evaluation activity of the European Aerosol Research Lidar Network (EARLINET) for the quantitative assessment of the Level 2 aerosol backscatter coefficient product derived by the Cloud-Aerosol Transport System (CATS) aboard the International Space Station (ISS; Rodier et al., 2015). The study employs correlative CATS and EARLINET backscatter measurements within a 50 km distance between the ground station and the ISS overpass and as close in time as possible, typically with the starting time or stopping time of the EARLINET performed measurement time window within 90 min of the ISS overpass, for the period from February 2015 to September 2016. The results demonstrate the good agreement of the CATS Level 2 backscatter coefficient and EARLINET. Three ISS overpasses close to the EARLINET stations of Leipzig, Germany; Évora, Portugal; and Dushanbe, Tajikistan, are analyzed here to demonstrate the performance of the CATS lidar system under different conditions. The results show that under cloud-free, relative homogeneous aerosol conditions, CATS is in good agreement with EARLINET, independent of daytime and nighttime conditions. CATS low negative biases are observed, partially attributed to the deficiency of lidar systems to detect tenuous aerosol layers of backscatter signal below the minimum detection thresholds; these are biases which may lead to systematic deviations and slight underestimations of the total aerosol optical depth (AOD) in climate studies. In addition, CATS misclassification of aerosol layers as clouds, and vice versa, in cases of coexistent and/or adjacent aerosol and cloud features, occasionally leads to non-representative, unrealistic, and cloud-contaminated aerosol profiles. Regarding solar illumination conditions, low negative biases in CATS backscatter coefficient profiles, of the order of 6.1 %, indicate the good nighttime performance of CATS. During daytime, a reduced signal-to-noise ratio by solar background illumination prevents retrievals of weakly scattering atmospheric layers that would otherwise be detectable during nighttime, leading to higher negative biases, of the order of 22.3 %.

Emmanouil Proestakis

Analysis and Prediction of VFR Vs IFR Traffic Behavior to Support Uncrewed Aircraft Flight Operations at Regional Airports

Uncrewed Aircraft flight operations at a regional airport will be affected by the uncertainty in the Visual Flight Rules traffic around. This paper analyzes Visual Flight Rules traffic behavior, compares it with Instrument Flight Rules traffic and develops traffic prediction methods to support uncrewed aircraft flight operations. The spatio-temporal distribution of traffic operating under Visual Flight Rules and Instrument Flight Rules was analyzed from one month of historical track data around Fort Worth Alliance airport as a representative regional airport. The traffic behavior was visualized as occupancy maps generated at different altitudes. The Instrument Flight Rules traffic was concentrated in fewer regions of the airspace along structured routes where the risk of interacting with one or more flights reached close to fifty percent in some areas. Visual Flight Rules traffic was spread over more regions, mostly segregated from the Instrument Flight Rules regions, and the risk of interaction was lower reaching up to twenty-five percent on average over the month in some regions. The interaction risk was predicted using predictive occupancy maps over multiple time horizons and conditioned on time and partial observation of traffic in the vicinity. The month-to-month predictability of Visual Flight Rules risk was lower than that of the Instrument Flight Rules traffic, consistently over all the conditions analyzed. However, the prediction and its accuracy were demonstrated to be sensitive to the conditions used. The predictive models generated can be used to support both strategic planning and in-flight decision-making by uncrewed aircraft during flight operations while maintaining an acceptable risk of interacting with other traffic.

VFR

Analysis and Prediction of VFR Vs IFR Traffic Behavior to Support Uncrewed Aircraft Flight Operations at Regional Airports

Uncrewed Aircraft flight operations at a regional airport will be affected by the uncertainty in the Visual Flight Rules traffic around. This paper analyzes Visual Flight Rules traffic behavior, compares it with Instrument Flight Rules traffic and develops traffic prediction methods to support uncrewed aircraft flight operations. The spatio-temporal distribution of traffic operating under Visual Flight Rules and Instrument Flight Rules was analyzed from one month of historical track data around Fort Worth Alliance airport as a representative regional airport. The traffic behavior was visualized as occupancy maps generated at different altitudes. The Instrument Flight Rules traffic was concentrated in fewer regions of the airspace along structured routes where the risk of interacting with one or more flights reached close to fifty percent in some areas. Visual Flight Rules traffic was spread over more regions, mostly segregated from the Instrument Flight Rules regions, and the risk of interaction was lower reaching up to twenty-five percent on average over the month in some regions. The interaction risk was predicted using predictive occupancy maps over multiple time horizons and conditioned on time and partial observation of traffic in the vicinity. The month-to-month predictability of Visual Flight Rules risk was lower than that of the Instrument Flight Rules traffic, consistently over all the conditions analyzed. However, the prediction and its accuracy were demonstrated to be sensitive to the conditions used. The predictive models generated can be used to support both strategic planning and in-flight decision-making by uncrewed aircraft during flight operations while maintaining an acceptable risk of interacting with other traffic.

VFR