Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “field validation results”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

RotCFD Analysis of the AH-56 Cheyenne Hub Drag

In 2016, the U.S. Army Aviation Development Directorate (ADD) conducted tests in the U.S. Army 7- by 10- Foot Wind Tunnel at NASA Ames Research Center of a nonrotating 2/5th-scale AH-56 rotor hub. The objective of the tests was to determine how removing the mechanical control gyro affected the drag. Data for the lift, drag, and pitching moment were recorded for the 4-bladed rotor hub in various hardware configurations, azimuth angles, and angles of attack. Numerical simulations of a selection of the configurations and orientations were then performed, and the results were compared with the test data. To generate the simulation results, the hardware configurations were modeled using Creo and Rhinoceros 5, three-dimensional surface modeling computer-aided design (CAD) programs. The CAD model was imported into Rotorcraft Computational Fluid Dynamics (RotCFD), a computational fluid dynamics (CFD) tool used for analyzing rotor flow fields. RotCFD simulation results were compared with the experimental results of three hardware configurations at two azimuth angles, two angles of attack, and with and without wind tunnel walls. The results help validate RotCFD as a tool for analyzing low-drag rotor hub designs for advanced high-speed rotorcraft concepts. Future work will involve simulating additional hub geometries to reduce drag or tailor to other desired performance levels.

AH-56 Cheyenne↗

Use of In Situ and Airborne Multiangle Data to Assess MODIS and Landsat-Based Estimates of Directional Reflectance and Albedo

The quantification of uncertainty in satellite-derived global surface albedo products is a critical aspect in producing complete, physically consistent, and decadal land property data records for studying ecosystem change. A challenge in validating albedo measurements acquired from space is the ability to overcome the spatial scaling errors that can produce disagreements between satellite and field-measured values. Here, we present the results from an accuracy assessment of MODIS and Landsat-TM albedo retrievals, based on collocated comparisons with tower and airborne Cloud Absorption Radiometer (CAR) measurements collected during the 2007 Cloud and Land Surface Interaction Campaign (CLASIC). The initial focus was on evaluating intersensor consistency through comparisons of intrinsic bidirectional reflectance estimates. Local and regional assessments were then performed to obtain estimates of the resulting scaling uncertainties, and to establish the accuracy of albedo reconstructions during extended periods of precipitation. In general, the satellite derived estimates met the accuracy requirements established for the high-quality MODIS operational albedos at 500 m (the greater of 0.02 units or +/-10% of surface measured values). However, results reveal a high degree of variability in the root-mean-square error (RMSE) and bias of MODIS visible (0.3-0.7 μm) and Landsat-TM shortwave (0.3-5.0 μm) albedos; where, in some cases, retrieval uncertainties were found to be in excess of 15%. Results suggest that an overall improvement in MODIS shortwave albedo retrieval accuracy of 7.8%, based on comparisons between MODIS and CAR albedos, resulted from the removal of sub-grid scale mismatch errors when directly scaling-up the tower measurements to the MODIS satellite footprint.

biosphere↗

Supersonic Engine Inlet Tone Noise Radiation

A computational and experimental acoustic analysis was conducted on a supersonic engine inlet geometry with a spike center body and an auxiliary inlet. Simulations performed using two different commercial acoustics software packages were compared to a scale model experiment conducted using an ultrasonic fan noise simulator. Both the experiment and simulations were run at discrete circumferential mode and frequency combinations to identify strengths and weaknesses of each method. For cases where a single azimuthal mode was well cut on throughout the length of the duct, reasonable agreement was found between the three methods. In cases with more complicated acoustic effects, the experimental results became intractable when considered alone and the simulations were needed for interpreting the results. The peak sound level and the peak angle of the far field radiation vary widely when changing modes and frequencies. The objective of the study is to develop a validated workflow for simulation of fan tone noise through supersonic inlet geometries for community noise predictions.

Stephens, David B.↗

Characterization and Commissioning of a Ka-Band Ground Station for Cognitive Algorithm Development

In 2018, the Cognitive Communications and Propagation projects completed installation and checkout testing of a new Ka-Band ground station at the NASA Glenn Research Center in Cleveland, Ohio. The Cognitive Algorithms Demonstration Testbed (CADeT) was developed to provide a fully characterized and controllable dynamic link environment to researchers looking to demonstrate hardware and software aligned with atmospheric sensing and cognitive algorithms. CADeT integrates a host of precision control and measurement systems in addition to repurposing a 5.5 meter beam-waveguide dish platform previously used with the Advanced Communications Technology Satellite (ACTS). This paper will discuss the laboratory testing of ground station components with a emphasis on elements vital to achieving link budget requirements including characterization of the new Gallium Nitride (GaN) Solid State Power Amplifier (SSPA) and far-field measurements of the new antenna feed. Finally, the paper discusses in-situ tests conducted with CADeT and the Tracking and Data Relay Satellite System (TDRSS) to validate laboratory results and make necessary link budget adjustments before reviewing the lessons learned.

Cameron M Seidl↗

Land surface temperature measurements from EOS MODIS data

A significant progress has been made in TIR instrumentation which is required to establish the spectral BRDF/emissivity knowledge base of land-surface materials and to validate the land-surface temperature (LST) algorithms. The SIBRE (spectral Infrared Bidirectional Reflectance and Emissivity) system and a TIR system for measuring spectral directional-hemispherical emissivity have been completed and tested successfully. Optical properties and performance features of key components (including spectrometer, and TIR source) of these systems have been characterized by integrated use of local standards (blackbody and reference plates). The stabilization of the spectrometer performance was improved by a custom designed and built liquid cooling system. Methods and procedures for measuring spectral TIR BRDF and directional-hemispheric emissivity with these two systems have been verified in sample measurements. These TIR instruments have been used in the laboratory and the field, giving very promising results. The measured spectral emissivities of water surface are very close to the calculated values based on well established water refractive index values in published papers. Preliminary results show that the TIR instruments can be used for validation of the MODIS LST algorithm in homogeneous test sites. The beta-3 version of the MODIS LST software is being prepared for its delivery scheduled in the early second half of this year.

Wan, Zhengming↗

Bosonic field digitization for quantum computers

Quantum simulation of quantum field theory is a flagship application of quantum computers that promises to deliver capabilities beyond classical computing. The realization of quantum advantage will require methods that can accurately predict error scaling as a function of the resolution and parameters of the model and that can be implemented efficiently on quantum hardware. In this paper, we address the representation of lattice bosonic fields in a discretized field amplitude basis, develop methods to predict error scaling, and present efficient qubit implementation strategies. A low-energy subspace of the bosonic Hilbert space, defined by a boson occupation number cutoff, can be represented with exponentially good accuracy by a low-energy subspace of a finite-size Hilbert space. The finite representation construction and the associated errors are directly related to the accuracy of the Nyquist-Shannon sampling and the finite Fourier transforms of the boson number states in the field and the conjugate-field bases. We analyze the relation between the boson mass, the discretization parameters used for wave function sampling, and the finite representation size. Numerical simulations of small size Φ 4 problems demonstrate that the boson mass optimizing the sampling of the ground state wave function is a good approximation to the optimal boson mass yielding the minimum low-energy subspace size. However, we find that accurate sampling of general wave functions does not necessarily result in accurate representation. Finally, we develop methods for validating and adjusting the discretization parameters to achieve more accurate simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Numerical Investigation of Plasma Flows in Magnetic Nozzles

Magnetic nozzles are used in many laboratory experiments in which plasma flows are to be confined, cooled. accelerated, or directed. At present, however, there is no generally accepted theoretical description that explains the phenomena of plasma detachment from an externally-imposed magnetic field. This is an important problem in the field of plasma propulsion, where the ionized gas must detach from the applied, solenoidal magnetic field to realize thrust production. In this paper we simulate a plasma flowing in the presence of an applied magnetic field using a multidimensional numerical simulation tool that includes theoretical models of the various dispersive and dissipative processes present in the plasma. This is an extension of the simulation tool employed in previous work by Sankaran et al. The new tool employs the same formulation of the governing equation set. but retains the axial and radial components of magnetic field and the azimuthal component of velocity that were neglected in other works. We aim to compare the computational results with the various proposed magnetic nozzle detachment theories to develop an understanding of the physical mechanisms that cause detachment. An applied magnetic field topology is obtained using a magnetostatic field solver and this field is superimposed on the time-dependent magnetic field induced in the plasma to provide a self-consistent field description. The applied magnetic field and model geometry match those found in experiments by Kurtki and Okada. We model this geometry because there ts a substantial amount of experimental data that can be compared to our computations, allowing for validation of the model. In addition, comparison of the simulation results with the experimentally obtained plasma parameters will provide insight into the mechanisms that lead to plasma detachment, revealing how the 3 scale with different input parameters.

Polzin, K. A.↗

Measurement and Prediction of the Thermomechanical Response of Shape Memory Alloy Hybrid Composite Beams

An experimental and numerical investigation into the static and dynamic responses of shape memory alloy hybrid composite (SMAHC) beams is performed to provide quantitative validation of a recently commercialized numerical analysis/design tool for SMAHC structures. The SMAHC beam specimens consist of a composite matrix with embedded pre-strained SMA actuators, which act against the mechanical boundaries of the structure when thermally activated to adaptively stiffen the structure. Numerical results are produced from the numerical model as implemented into the commercial finite element code ABAQUS. A rigorous experimental investigation is undertaken to acquire high fidelity measurements including infrared thermography and projection moire interferometry for full-field temperature and displacement measurements, respectively. High fidelity numerical results are also obtained from the numerical model and include measured parameters, such as geometric imperfection and thermal load. Excellent agreement is achieved between the predicted and measured results of the static and dynamic thermomechanical response, thereby providing quantitative validation of the numerical tool.

Davis, Brian↗

Advancing Methodologies for Applying Machine Learning and Evaluating Spatiotemporal Models of Fine Particulate Matter (PM 2.5 ) Using Satellite Data Over Large Regions

Reconstructing the distribution of fine particulate matter (PM 2.5 ) in space and time, even far from ground monitoring sites, is an important exposure science contribution to epidemiologic analyses of PM 2.5 health impacts. Flexible statistical methods for prediction have demonstrated the integration of satellite observations with other predictors, yet these algorithms are susceptible to overfitting the spatiotemporal structure of the training datasets. We present a new approach for predicting PM 2.5 using machine-learning methods and evaluating prediction models for the goal of making predictions where they were not previously available. We apply extreme gradient boosting (XGBoost) modeling to predict daily PM 2.5 on a 1 x 1 km 2 resolution for a 13 state region in the Northeastern USA for the years 2000–2015 using satellite-derived aerosol optical depth and implement a recursive feature selection to develop a parsimonious model. We demonstrate excellent predictions of withheld observations but also contrast an RMSE of 3.11 μg/m 3 in our spatial cross-validation withholding nearby sites versus an overfit RMSE of 2.10 μg/m 3 using a more conventional random ten-fold splitting of the dataset. As the field of exposure science moves forward with the use of advanced machine-learning approaches for spatiotemporal modeling of air pollutants, our results show the importance of addressing data leakage in training, overfitting to spatiotemporal structure, and the impact of the predominance of ground monitoring sites in dense urban sub-networks on model evaluation. The strengths of our resultant modeling approach for exposure in epidemiologic studies of PM 2.5 include improved efficiency, parsimony, and interpretability with robust validation while still accommodating complex spatiotemporal relationships.

air pollution↗

Findings on Subtask 3.1 - Bakken Rich Gas Enhanced Oil Recovery Project

Total in-place oil for the Bakken petroleum system (BPS) (which includes the Bakken and Three Forks Formations) has been estimated to be 600 billion barrels (bbl). However, BPS wells have decline rates as high as 85% over the first 3 years of their lives, and primary recovery factors typically range from 3% to 10% of original oil in place. Given the low initial recovery rates, even small incremental productivity improvements could dramatically increase technically recoverable oil in the BPS. One potential solution is enhanced oil recovery (EOR) using gas injection, such as carbon dioxide (CO2) or hydrocarbon (HC) gases. While commonly used in conventional reservoirs, CO2 EOR in unconventional tight oil reservoirs has been limited to pilot tests. EOR using rich gas (mixture of methane, ethane, and propane) has also been employed in numerous pilots in several unconventional plays and has recently been successfully applied in the Eagle Ford play. If successful, large-scale gas-based EOR in the BPS could dramatically increase oil productivity and recovery factors and extend the life of the play for decades. While CO2 may be a technically suitable working fluid for EOR in the BPS, supplies are limited and costs for using CO2 in EOR pilots are prohibitively high. Meanwhile, produced gas flaring has presented challenges for BPS operators in North Dakota. Analysis conducted by the North Dakota Pipeline Authority indicates that the current gas-gathering infrastructure in North Dakota is insufficient to accommodate all of the associated gas that is produced from the BPS. The geographically isolated location of North Dakota relative to large natural gas markets, combined with suppressed natural gas prices, has made it economically challenging for industry to invest capital in expanding gas-gathering infrastructure in the state. These circumstances led to a research program conducted by the Energy & Environmental Research Center (EERC) in partnership with Liberty Resources Management Company LLC (LR) to examine the potential to use rich gas injection for EOR and mitigate flaring. A rich gas EOR pilot test was designed and executed by LR at its Stomping Horse development area in Williams County, North Dakota. From July 2018 through May 2019, a total of 160 million standard cubic feet (MMscf) of rich produced gas was injected into the BPS using five different wells in a sequential injection strategy. LR’s Leon–Gohrick drill spacing unit (DSU) was used as the test site. Regulatory oversight was provided by the North Dakota Industrial Commission (NDIC). Technical support was provided by the EERC through a series of laboratory, modeling, and field-based activities, and additional post-pilot research activities incorporated learnings from the test, developed new laboratory data, improved fracture modeling methods, and developed machine learning and big data analytics. The results from the Stomping Horse rich gas EOR pilot activities indicate that developing an effective, economical EOR approach for the BPS will require more field tests. Another key lesson learned from the Stomping Horse tests is that detailed pre- and posttest data on reservoir conditions and fluids production are essential. Robust reservoir characterization provides information that is crucial to creating realistic geomodels and conducting valid dynamic simulations of potential EOR scenarios. A detailed understanding of the completions and production history of offset wells is also necessary for valid test result interpretations. This knowledge is essential to designing the operational parameters of injectivity tests and interpreting the results. A conformance control strategy is also essential to success. Laboratory-based examinations of rich gas interactions with reservoir fluids and rocks were conducted, with an emphasis on determining the ability to mobilize oil in the tight reservoir rocks and shales of the BPS. Injection fluid composition was shown to have a positive impact on reducing reservoir oil minimum miscibility pressure (MMP), reducing interfacial tension (IFT), and altering wettability. IFT and contact angle measurements demonstrated that wettability can be altered in the presence of rich gas, suggesting the potential to improve oil recovery. Iterative modeling of surface infrastructure and reservoir performance using data generated by the various project activities was conducted. A geologic model of the Stomping Horse area was built; history-matched oil, gas, and water production was used in simulations of various EOR scenarios. Early programmatic modeling results were used to support LR’s design and operation of the EOR pilot and to provide insight regarding optimization of future commercial-scale BPS EOR design and operations. Post-pilot modeling focused on alternative methods of understanding complex fracture networks and accelerating simulation time. These led to improved simulation run times and provide excellent history-matching results. Several of these iterative models were used as the bases for developing algorithms into machine learning and big data analytics. History matching in reservoir simulation is time-consuming and computer processing-intensive. Machine learning algorithms were created, and an automated history-matching tool was developed. A large set of synthetic reservoir simulations were created to generate well responses (oil, gas, and water production, well bottomhole pressure [BHP], and tracer or propane breakthrough) for a set of EOR operating parameters that included offset well status (open or closed), injectate (rich gas or propane), injection rate, and injection well BHP. A user interface was developed to provide real-time visualization. Machine learning-based models were developed to provide rapid forecasting of well performance given a set of user-defined EOR operating parameters. These predictive models allow the user to modify the offset well status, injection rate, and injection well BHP and rapidly forecast future production performance. The combination of real-time visualization tools with real-time forecasting tools provides a framework for real-time control—operational changes that the EOR site operator can enact (e.g., changing gas injection rates) to affect the observed performance and potentially improve the EOR outcome. There is great reason to be optimistic about the future of EOR in the Bakken. The results of the laboratory studies suggest significant potential for high rates of oil mobilization using produced field gas injection under the right conditions. The results of the lab studies, combined with rigorous statistical analysis of well production data and associated modeling efforts, confirm the notion that fluid mobility within the reservoir is controlled by fractures. As more knowledge is gained about the nature and distribution of fracture networks in the Bakken, the industry will be in a better position to predict and, ultimately, influence fluid mobility. New field tests are necessary to develop a more complete understanding of those conditions. Thoughtful and creatively engineered field tests within a well-characterized geologic setting will yield the fundamental knowledge needed to take Bakken oil production to the next level. This subtask was cofunded through the EERC–U.S. Department of Energy Joint Program on Research and Development for Fossil Energy-Related Resources Cooperative Agreement No. DE-FE0024233. Nonfederal funding was provided by the North Dakota Industrial Commission’s Oil and Gas Research Program and Computer Modelling Group.

04 OIL SHALES AND TAR SANDS↗

Aircraft/island/ship/satellite intercomparison: Preliminary results from July 16, 1987

The First ISCCP Regional Experiment (FIRE) objective of validating and improving satellite algorithms for inferring cloud properties from satellite radiances was one of the central motivating factors in the design of the specific field experimental strategies used in the July, 1987 marine stratocumulus intensive field observations (IFO). The in situ measuring platforms were deployed to take maximum advantage of redundant measurements (for intercomparison of the in situ sensors) and to provide optimal coverage within satellite images. One of the most ambitious of these strategies was the attempt to coordinate measurements from San Nicolas Island (SNI), the R/V Pt. Sur, the meteorological aircraft, and the satellites. For the most part, this attempt was frustrated by flight restrictions in the vicinity of SNI. The exception was the mission of July 16, 1987, which achieved remarkable success in the coordination of the platforms. This presentation concerns operations conducted by the National Center for Atmospheric Research (NCAR) Electra and how data from the Electra can be integrated with and compared to data from the Pt. Sur, SNI, and the satellites. The focus is on the large-scale, integrated picture of the conditions on July 16 from the perspective of the Electra's flight operations.

Hanson, Howard P.↗

3-D Flow Field Diagnostics and Validation Studies using Stereoscopic Tracking Velocimetry

The measurement of 3-D three-component velocity fields is of great importance in both ground and space experiments for understanding materials processing and fluid physics. Here, we present the investigation results of stereoscopic tracking velocimetry (STV) for measuring 3-D velocity fields. The effort includes diagnostic technology development, experimental velocity measurement, and comparison with analytical and numerical computation. The advantages of STV stems from the system simplicity for building compact hardware and in software efficiency for continual near-real-time process monitoring. It also has illumination flexibility for observing volumetric flow fields from arbitrary directions. STV is based on stereoscopic CCD observations of particles seeded in a flow. Neural networks are used for data analysis. The developed diagnostic tool is tested with a simple directional solidification apparatus using Succinonitrile. The 3-D velocity field in the liquid phase is measured and compared with results from detailed numerical computations. Our theoretical, numerical, and experimental effort has shown STV to be a viable candidate for reliably quantifying the 3-D flow field in materials processing and fluids experiments.

Cha, Soyoung Stephen↗

Results of the Second SeaWiFS Data Analysis Round Robin, March 2000 (DARR-00)

The accurate determination of upper ocean apparent optical properties (AOPs) is essential for the vicarious calibration of the Sea-viewing Wide Field-of-view Sensor (SeaWiFS) instrument and the validation of the derived data products. To evaluate the importance of data analysis methods upon derived AOP values, the Second Data Analysis Round Robin (DARR-00) activity was planned during the latter half of 1999 and executed during March 2000. The focus of the study was the intercomparison of several standard AOP parameters: (1) the upwelled radiance immediately below the sea surface, L(sub u)(0(-),lambda); (2) the downward irradiance immediately below the sea surface, E(sub d)(0(-),lambda); (3) the diffuse attenuation coefficients from the upwelling radiance and the downward irradiance profiles, L(sub L)(lambda) and K(sub d)(lambda), respectively; (4) the incident solar irradiance immediately above the sea surface, E(sub d)(0(+),lambda); (5) the remote sensing reflectance, R(sub rs)(lambda); (6) the normalized water-leaving radiance, [L(sub W)(lambda)](sub N); (7) the upward irradiance immediately below the sea surface, E(sub u)(0(-)), which is used with the upwelled radiance to derive the nadir Q-factor immediately below the sea surface, Q(sub n)(0(-),lambda); and (8) ancillary parameters like the solar zenith angle, theta, and the total chlorophyll concentration, C(sub Ta), derived from the optical data through statistical algorithms. In the results reported here, different methodologies from three research groups were applied to an identical set of 40 multispectral casts in order to evaluate the degree to which differences in data analysis methods influence AOP estimation, and whether any general improvements can be made. The overall results of DARR-00 are presented in Chapter 1 and the individual methods used by the three groups and their data processors are presented in Chapters 2-4.

Hooker, Stanford B.↗

Characterizing the GOES-R (GOES-16) Geostationary Lightning Mapper (GLM) On-Orbit Performance

Two overlapping efforts help to characterize the GLM performance, the Post Launch Test (PLT) phase to validate the predicted pre-launch instrument performance and the Post Launch Product Test (PLPT) phase to validate the lightning detection product used in forecast and warning decision-making. This paper documents the calibration and validation plans and activities for the first 6 months of GLM on-orbit testing and validation commencing with first light on 4 January 2017. The PLT phase addresses image quality, on-orbit calibration, RTEP threshold tuning, image navigation, noise filtering, and solar intrusion assessment, resulting in a GLM calibration parameter file. The PLPT includes four main activities, the Reference Data Comparisons (RDC), Algorithm Testing (AT), Instrument Navigation and Registration Testing (INRT), and Long Term Baseline Testing (LTBT). Field campaigns are also designed to contribute valuable insights into the GLM performance capabilities. The PLPT tests each contribute to the beta, provisional, and fully validated GLM data.

validation↗

Comparison of cloud fields from atmospheric general circulation model, in situ and satellite measurements

This paper focuses on the comparison of cloud amounts derived from an atmospheric general circulation model (AGCM), Satellite-observed clouds, and Ground-based cloud observations. Unlike Earth Radiation Budget Experiment (ERBE)-type comparisons it does not mix potential errors in the cloud amount with those in the radiation code embedded in the model. Long term cloud climatologies were used to compare global cloud amounts and regional seasonal cycles. The AGCM successfully reproduced the signatures of the warm pool and North Pacific seasonal cycle cloudiness but failed in the low stratus region off the coast of South America, a known problem for AGCMs. The data sets also reproduced the anomaly signature associated with El Nino in the warm pool region, but the model amounts were lower. Global results had a similar success rate, with the model generally producing lower total cloud compared to the satellite and in situ measurements. To compare cloud vertical distributions the cloud height may need to be validated using the corresponding radiation fields. Unfortunately there were also some large discrepancies between the two observed cloud data sets. While tremendously improved over the last decade the character of the observed cloud data sets, must be substantially enhanced before they will be useful in validating AGCMs by any but the crudest levels of comparison.

Haskins, Robert D.↗

Self-Consistent Magnetosphere-Ionosphere Coupling: Theoretical Studies

A self-consistent ring current (RC) model has been developed that couples electron and ion magnetospheric dynamics with the calculation of the electric field. Two new features were taken into account in order to close the self-consistent magnetosphere- ionosphere coupling loop. First, in addition to the RC ions, we solve an electron kinetic equation in our model. Second, using the relation of Galand and Richmond [2001], we calculate the height integrated ionospheric conductances as a function of the precipitated high energy magnetospheric electrons and ions that are produced by our code. To validate the results of our model we simulate the magnetic storm of May 2, 1986, a storm that has has been comprehensively studied, and compare our results with different theoretical approaches. The self-consistent inclusion of the hot electrons and, their effect on the conductance results in deeper penetration of the magnetospheric electric field. In addition, a slight westward rotation of the potential pattern (compared to previous self-consistent results) is evident in the inner magnetosphere. This changes the hot plasma distribution, especially by allowing increased access of plasma sheet ions and electrons to low L shells.

Khazanov, G. V.↗

Trajectory Prediction Accuracy and Error Sources for Regional Jet Descents: Results of a 2010 Flight Trial at Denver International Airport using SkyWest Revenue Flights - Part II

The Efficient Descent Advisor (EDA) controller automation tool generates trajectory-based speed, path, and altitude-profile advisories to facilitate efficient, continuous descents into congested terminal airspace. While prior field trials have assessed the trajectory prediction accuracy for large jet (i.e., Boeing and Airbus) types, smaller (i.e., regional and business) jet types present unique challenges involving different descent procedures and Flight Management System (FMS) capabilities. This paper quantifies the trajectory prediction accuracy for small jet revenue flight descents based on SkyWest Canadair Regional Jet 200, 700, and 900 aircraft arrivals to Denver in the fall of 2010. Post flight test data analysis and SkyWest pilot interviews uncovered unexpected variation between flight crews due to different interpretations of (1) which fixed flight path angle (FPA) to fly based on the flight trial procedure and (2) how to fly the descent to achieve the target FPA. Pilot reports were used to select a subset of flights where pilots indicated an FPA according to the flight trial procedure to remove the unexpected variation due to (1) to focus on (2). Results for the subset for en-route descents, from prior to top of descent to the meter fix 30 to 130 nmi downstream, indicate that aircraft arrived to the meter fix six seconds early with about a twelve second standard deviation. Large FPA errors up to one degree relative to the EDA flight trial procedure were detected after the flight trial as a characteristic of the unexpected variation. It is recommended that quantitative validation be performed during future flight trials so that experimental procedures can be adjusted if unexpected results are detected.

Field Test Results↗

Bayesian sequential optimal experimental design for nonlinear models using policy gradient reinforcement learning

We present a mathematical framework and computational methods for optimally designing a finite sequence of experiments. This sequential optimal experimental design (sOED) problem is formulated as a finite-horizon partially observable Markov decision process (POMDP) under a Bayesian setting and with information-theoretic utilities. The formulation is general and may accommodate continuous random variables, non-Gaussian posteriors, and nonlinear forward models. The sOED design policy incorporates elements of feedback and lookahead simultaneously, and we show it to generalize the commonly-used batch and greedy design strategies. We solve for the sOED policy using the policy gradient (PG) method from reinforcement learning, and provide a derivation for the PG expression in the sOED context. Adopting an actor-critic approach, the policy and value functions are parameterized using deep neural networks and improved via PG estimates produced from simulated episodes of designs and observations. The new PG-sOED algorithm is first validated on a linear-Gaussian benchmark, and then compared against other design baselines on a sensor movement problem for contaminant source inversion in a convection-diffusion field. As a result, we provide explanation for the policy behaviors using knowledge of the underlying physical process.

97 MATHEMATICS AND COMPUTING↗