Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

645 records · Page 36

Machine Learning based Aircraft Performance Model Estimation for Trajectory Prediction

The accurate prediction of aircraft trajectory by ground-based decision support tools is a critical component of air traffic management in the US National Airspace System (NAS). Accurate predictions of where the aircraft will be in the future or when they will arrive at specific locations (e.g., fixes) is a key enabler for sequencing and efficient arrival management of flights. Traditional physics based aircraft trajectory prediction relies on a simplified point-mass total energy model whose parameters are referred to as Aircraft Performance Model (APM) parameters. Even though the performance coefficients and weight of an aircraft are a vital part of the aircraft performance model’s predictions and accuracy, these coefficients are proprietary in nature and therefore, unavailable to decision-support tools. Current approaches freeze some coefficients to default base of aircraft data (BADA) values and optimize others. However, the APM parameters are highly coupled by the flight dynamics and prioritizing one parameter over others leads to bias and skewed predictions. To alleviate this problem, we provide a combined optimization framework to predict all the critical (thrust, drag and weight) APM parameters. This paper is focused on training Machine Learning (ML) models that map historical flights to optimized APM parameters that provide the best fit (in terms of prediction error). Our dataset obtained from NASA’s Sherlock data warehouse is comprised of thousands of historical flights and includes weather and track data collected from 2019. Using different subsets of relevant features (e.g., aircraft type), we trained several ML models to estimate the aircraft’s take off weight, drag polar coefficients (both parasitic and lift induced), and thrust settings (multiplier applied to the maximum engine thrust). The chosen flights are from three of the most common aircraft types (B738, B737, and A320) arriving at four airports (LAX, DEN, MSP, and DFW). Our ML approach is comprised of two different solutions: 1- using a subset of features that are known prior to the flight departure and do not change during flight (such as engine type, current temperature at departure & destination airports, aircraft type) and 2 - using a subset of temporal features of the flight trajectory (such as cruise altitude, Mach, airspeed, and rate of climb) in addition to the pre-departure features from the first solution. The labels or target variables are the APM parameters that were obtained by an optimized ordinary differential equations (ODE) fitting process (applied to individual flights). The ODE-fitting is very time intensive and is therefore performed offline. Thus, training an ML model to learn the relationship between the flight features and ODE-generated labels enables faster estimation of the APM parameters and is therefore amenable to real-time prediction. Various ML models including linear regression, random forest, XGBoost, and neural network were trained, and the results are compared. After model validation and hyperparameter-tuning, we observed that the Random Forest model outperformed the other three models by the overall mean square error (MSE) of 2% for the first solution and 1.5% for the second solution. Finally, the ML-derived parameters are compared against default BADA APM parameters using NASA’s Autonomy Development toolkit (ADK) simulation software. The simulation results for one of each aircraft type is shown and discussed.

Aida Sharif Rohani↗

A Lightning Channel Retrieval Algorithm for the North Alabama Lightning Mapping Array (LMA)

A new multi-station VHF time-of-arrival (TOA) antenna network is, at the time of this writing, coming on-line in Northern Alabama. The network, called the Lightning Mapping Array (LMA), employs GPS timing and detects VHF radiation from discrete segments (effectively point emitters) that comprise the channel of lightning strokes within cloud and ground flashes. The network will support on-going ground validation activities of the low Earth orbiting Lightning Imaging Sensor (LIS) satellite developed at NASA Marshall Space Flight Center (MSFC) in Huntsville, Alabama. It will also provide for many interesting and detailed studies of the distribution and evolution of thunderstorms and lightning in the Tennessee Valley, and will offer many interesting comparisons with other meteorological/geophysical wets associated with lightning and thunderstorms. In order to take full advantage of these benefits, it is essential that the LMA channel mapping accuracy (in both space and time) be fully characterized and optimized. In this study, a new revised channel mapping retrieval algorithm is introduced. The algorithm is an extension of earlier work provided in Koshak and Solakiewicz (1996) in the analysis of the NASA Kennedy Space Center (KSC) Lightning Detection and Ranging (LDAR) system. As in the 1996 study, direct algebraic solutions are obtained by inverting a simple linear system of equations, thereby making computer searches through a multi-dimensional parameter domain of a Chi-Squared function unnecessary. However, the new algorithm is developed completely in spherical Earth-centered coordinates (longitude, latitude, altitude), rather than in the (x, y, z) cartesian coordinates employed in the 1996 study. Hence, no mathematical transformations from (x, y, z) into spherical coordinates are required (such transformations involve more numerical error propagation, more computer program coding, and slightly more CPU computing time). The new algorithm also has a more realistic definition of source altitude that accounts for Earth oblateness (this can become important for sources that are hundreds of kilometers away from the network). In addition, the new algorithm is being applied to analyze computer simulated LMA datasets in order to obtain detailed location/time retrieval error maps for sources in and around the LMA network. These maps will provide a more comprehensive analysis of retrieval errors for LMA than the 1996 study did of LDAR retrieval errors. Finally, we note that the new algorithm can be applied to LDAR, and essentially any other multi-station TWA network that depends on direct line-of-site antenna excitation.

Koshak, William↗

STK Integrated Message Production List Editor (SIMPLE) for CEO Operations

Late in fiscal year 2011, the Crew Earth Observations (CEO) team was tasked to upgrade and replace its mission planning and mission operations software systems, which were developed in the Space Shuttle era of the 1980s and 1990s. The impetuses for this change were the planned transition of all workstations to the Windows 7 64-bit operating system and the desire for more efficient and effective use of Satellite Tool Kit (STK) software required for reliable International Space Station (ISS) Earth location tracking. An additional requirement of this new system was the use of the same SQL database of CEO science sites from the SMMS, which was also being developed. STK Integrated Message Production List Editor (SIMPLE) is the essential, all-in-one tool now used by CEO staff to perform daily ISS mission planning to meet its requirement to acquire astronaut photography of specific sites on Earth. The sites are part of a managed, long-term database that has been defined and developed for scientific, educational, and public interest. SIMPLE's end product is a set of basic time and location data computed for an operator-selected set of targets that the ISS crew will be asked to photograph (photography is typically planned 12 to 36 hours out). The CEO operator uses SIMPLE to (a) specify a payload operations planning period; (b) acquire and validate the best available ephemeris data (vectors) for the ISS during the planning period; (c) ingest and display mission-specific site information from the CEO database; (d) identify and display potential current dynamic event targets as map features; (e) compute and display time and location information for each target; (f) screen and select targets based on known crew availability constraints, obliquity constraints, and real-time evaluated constraints to target visibility due to illumination (sun elevation) and atmospheric conditions (weather); and finally (g) incorporate basic, computed time and location information for each selected target into the daily CEO Target List product (message) for submission to ISS payload planning and integration teams for their review and approval prior to uplink. SIMPLE requires and uses the following resources: an ISS mission planning period Greenwich Mean Time start date/time and end date/time), the best available ISS mission ephemeris data (vectors) for that planning period, the STK software package configured for the ISS, and an ISS mission-specific subset of the CEO sites database. The primary advantages realized by the development and implementation of SIMPLE into the CEO payload operations support activity are a smooth transition to the Windows 7 operating system upon scheduled workstation refresh; streamlining of the input and verification of the current ISS ephemeris (vector data); seamless incorporation of selected contents of the SQL database of science sites; the ability to tag and display potential dynamic event opportunities on orbit track maps; simplification of the display and selection of encountered sites based on crew availability, illumination, obliquity, and weather constraints; the incorporation of high-quality mapping of the Earth with various satellite-based datasets for use in describing targets; and the ability to encapsulate and export the essential selected target elements in XML format for use by onboard Earth-location systems, such as Worldmap. SIMPLE is a carefully designed and crafted in-house software package that includes detailed help files for the user and meticulous internal documentation for future modifications. It was delivered in February 2012 for test and evaluation. Following acceptance, it was implemented for CEO mission operations support in May 2012.

Trenchard, Mike↗

Flux Comparison of Master-8 and Ordem 3.1 Modelled Space Debris Population

With ESA’s Meteoroid And Space debris Terrestrial Environment Reference (MASTER-8) model and NASA’s Orbital Debris Engineering Model(ORDEM) 3.1, the two premier orbital debris engineering models have been officially released. The two models come with significant enhancements and now represent state-of-the-art orbital debris modelling for their respective agencies. Both models provide the community with estimates of the space debris environment from low Earth orbit (LEO) up to at least geostationary altitude. The MASTER population is an event-based simulation of all known events that generate debris and objects that are part of the U.S. Space Surveillance Network (SSN) catalog, which provides coverage of objects with diameters down to approximately 10cm in LEO and 1 m in geosynchronous Earth orbit (GEO). Different models are used to simulate the artificial objects and their orbit evolution over time. These models are called “sources” since they assign an origin to each individual object and consist of fragments, solid rocket motor (SRM) remainders, sodium-potassium(NaK) droplets, paintflakes, ejecta, and multi-layer insulation (MLI) fragments. The objects from each source are characterized by having individual release mechanisms, as well as orbital distributions, material composition, size, and mass distributions. Dedicated radar and telescope observation data is used to calibrate the model for objects larger than 1 cm in LEO and larger than 10 cm in GEO. For calibrating the small-sized objects, below 1 cm, impact data from returned surfaces are analyzed. Because the >1cm object population is dominated by fragments, the fragmentation event database was updated to include new events, as well as re-evaluate past events. Special attention was drawn to re-evaluating theFengyun-1C anti-satellite test from 2007 and Cosmos-Iridium collision event from 2009 since these events shape the fragment population because of their severity. After 2009, the two largest fragmentations in terms of number of tracked debris are the Briz-M explosion in 2012 and the NOAA-16explosion in 2015. In total, there are 261 confirmed fragmentations in the database up to November 2016.The baseline population for ORDEM 3.1 is based on the U.S. SSN catalog, and observational datasets from radar, in situ, and optical sources provide a foundation from which the model populations are statistically extrapolated to smaller size regions. These regions are not well-covered by the SSN catalog yet may pose the greatest threat to operational spacecraft. The NASA Standard Satellite Breakup Model is used to generate fragments greater than 1mm from collisions and explosions, and these fragment populations are scaled using ground-based radar data. Specific major debris-producing events, including the Fengyun-1C, Iridium 33, and Cosmos2251 debris clouds, and unique populations, such as NaK droplets, were re-examined, modelled, and added to the ORDEM environment separately. Optical measurement data is used to model the GEO population down to 10 cm. The debris environment is propagated using NASA’s LEO-to-GEO Environment Debris model, and future explosions of intact objects and collisions involving objects greater than 10 cm are assessed statistically. The environment from a few millimetres down to 10 𝜇m is modelled using a special degradation model where small particles are generated from intact spacecraft and rocket bodies, then the populations are scaled to fit in situ cratering data from Space Shuttle returned surfaces. Fragments smaller than 10 cm are differentiated based on material density categories, i.e., high-, medium-, and low-density, to better characterize the potential debris risk posed to upper stages and spacecraft. This paper will discuss the MASTER and ORDEM approaches for modelling populations and compare fluxes for specific orbits, including sun-synchronous, ISS-altitude, geosynchronous transfer, and GEO. In the end, a conclusion is drawn towards the importance of having multiple fundamentally different, yet validated, models to estimate the space debris population.

Andre Horstmann↗

Validation of satellite retrievals of cloud microsphysics and liquid water path using observations from FIRE

Cloud effective radii (r(sub e)) and cloud liquid water path (LWP) are derived from ISCCP spatially sampled satellite data and validated with ground-based pyranometer and microwave radiometer measurements taken on San Nicolas Island during the 1987 FIRE IFO. Values of r(sub e) derived from the ISCCP data are also compared to values retrieved by a hybrid method that uses the combination of LWP derived from microwave measurement and optical thickness derived from GOES data. The results show that there is significant variability in cloud properties over a 100 km x 80 km area and that the values at San Nicolas Island are not necessarily representative of the surrounding cloud field. On the other hand, even though there were large spatial variations in optical depth, the r(sub e) values remained relatively constant (with sigma less than or equal to 2-3 microns in most cases) in the marine stratocumulus. Furthermore, values of r(sub e) derived from the upper portion of the cloud generally are representative of the entire stratiform cloud. When LWP values are less than 100 g m(exp -2), then LWP values derived from ISCCP data agree well with those values estimated from ground-based microwave measurements. In most cases LWP differences were less than 20 g m(exp -2). However, when LWP values become large (e.g., greater than or equal to 200 g m(exp -2)), then relative differences may be as large as 50%- 100%. There are two reasons for this discrepancy in the large LWP clouds: (1) larger vertical inhomogeneities in precipitating clouds and (2) sampling errors on days of high spatial variability of cloud optical thicknesses. Variations of r(sub e) in stratiform clouds may indicate drizzle: clouds with droplet sizes larger than 15 microns appear to be associated with drizzling, while those less than 10 microns are indicative of nonprecipitating clouds. Differences in r(sub e) values between the GOES and ISCCP datasets are found to be 0.16 +/- 0.98 micron.

Rossow, W.↗

Physical Validation of GPM Retrieval Algorithms Over Land: An Overview of the Mid-Latitude Continental Convective Clouds Experiment (MC3E)

The joint NASA Global Precipitation Measurement (GPM) -- DOE Atmospheric Radiation Measurement (ARM) Midlatitude Continental Convective Clouds Experiment (MC3E) was conducted from April 22-June 6, 2011, centered on the DOE-ARM Southern Great Plains Central Facility site in northern Oklahoma. GPM field campaign objectives focused on the collection of airborne and ground-based measurements of warm-season continental precipitation processes to support refinement of GPM retrieval algorithm physics over land, and to improve the fidelity of coupled cloud resolving and land-surface satellite simulator models. DOE ARM objectives were synergistically focused on relating observations of cloud microphysics and the surrounding environment to feedbacks on convective system dynamics, an effort driven by the need to better represent those interactions in numerical modeling frameworks. More specific topics addressed by MC3E include ice processes and ice characteristics as coupled to precipitation at the surface and radiometer signals measured in space, the correlation properties of rainfall and drop size distributions and impacts on dual-frequency radar retrieval algorithms, the transition of cloud water to rain water (e.g., autoconversion processes) and the vertical distribution of cloud water in precipitating clouds, and vertical draft structure statistics in cumulus convection. The MC3E observational strategy relied on NASA ER-2 high-altitude airborne multi-frequency radar (HIWRAP Ka-Ku band) and radiometer (AMPR, CoSMIR; 10-183 GHz) sampling (a GPM "proxy") over an atmospheric column being simultaneously profiled in situ by the University of North Dakota Citation microphysics aircraft, an array of ground-based multi-frequency scanning polarimetric radars (DOE Ka-W, X and C-band; NASA D3R Ka-Ku and NPOL S-bands) and wind-profilers (S/UHF bands), supported by a dense network of over 20 disdrometers and rain gauges, all nested in the coverage of a six-station mesoscale rawinsonde network. As an exploratory effort to examine land-surface emissivity impacts on retrieval algorithms, and to demonstrate airborne soil moisture retrieval capabilities, the University of Tennessee Space Institute Piper aircraft carrying the MAPIR L-band radiometer was also flown during the latter half of the experiment in coordination with the ER-2. The observational strategy provided a means to sample the atmospheric column in a redundant framework that enables inter-calibration and constraint of measured and retrieved precipitation characteristics such as particle size distributions, or water contents- all within the umbrella of "proxy" satellite measurements (i.e., the ER-2). Complimenting the precipitation sampling framework, frequent and coincident launches of atmospheric soundings (e.g., 4-8/day) then provided a much larger mesoscale view of the thermodynamic and winds environment, a data set useful for initializing cloud models. The datasets collected represent a variety cloud and precipitation types including isolated cumulus clouds, severe thunderstorms, mesoscale convective systems, and widespread regions of light to moderate stratiform precipitation. We will present the MC3E experiment design, an overview of operations, and a summary of preliminary results.

Petersen, Walter A.↗

Evaluation of GEOS-5 Sulfur Dioxide Simulations During the Frostburg, MD 2010 Field Campaign.

Sulfur dioxide (SO2) is a major atmospheric pollutant with a strong anthropogenic component mostly produced by the combustion of fossil fuel and other industrial activities. As a precursor of sulfate aerosols that affect climate, air quality, and human health, this gas needs to be monitored on a global scale. Global climate and chemistry models including aerosol processes along with their radiative effects are important tools for climate and air quality research. Validation of these models against in-situ and satellite measurements is essential to ascertain the credibility of these models and to guide model improvements. In this study the Goddard Chemistry, Aerosol, Radiation, and Transport (GOCART) module running on-line inside the Goddard Earth Observing System version 5 (GEOS-5) model is used to simulate aerosol and SO2 concentrations. Data taken in November 2010 over Frostburg, Maryland during an SO2 field campaign involving ground instrumentation and aircraft are used to evaluate GEOS-5 simulated SO2 concentrations. Preliminary data analysis indicated the model overestimated surface SO2 concentration, which motivated the examination of mixing processes in the model and the specification of SO2 anthropogenic emission rates. As a result of this analysis, a revision of anthropogenic emission inventories in GEOS-5 was implemented, and the vertical placement of SO2 sources was updated. Results show that these revisions improve the model agreement with observations locally and in regions outside the area of this field campaign. In particular, we use the ground-based measurements collected by the United States Environmental Protection Agency (US EPA) for the year 2010 to evaluate the revised model simulations over North America.

Air Quality Campaign↗

MARS 2020 Backshell Radiative Heating Measurement and Shock Tube Verification

In February 2021, the Perseverance rover was brought to the surface of Mars by the Mars 2020 mission. A feature of the Mars 2020 capsule was instrumentation to measure its entry, descent and landing (EDL) with the so-called Mars EDL Instrumentation 2 (MEDLI2) [1]. The MEDLI2 introduced, among other things, backshell instrumentation, including a broadband radiometer. The radiometer was mounted on the leeside of the vehicle next to thermocouple plugs and a heat flux gauge. The data returned by the leeside MEDLI2 heat flux gauge is largely analogous to that measured by the COMARS gauge flown on the ExoMars Schiaparelli [2] entry in that it is measuring heat flux in an area that is entirely dominated by radiative heating. The COMARS measurement provided excellent validation of backshell radiative heating models for Mars entry, albeit at a limited number of points [3]. The MEDLI2 heat flux gauge measurement effectively confirmed the quality of the prediction, extended over the full trajectory, as will be presented in this paper. The MEDLI2 radiometer,however, was blocked by ablation products and suffered a loss of half of its signal. The second backshell heat flux gauge installed on the windside of the vehicle was also well predicted, although the heating had both radiative and convective contributions. It was desired to reproduce the conditions of the Mars 2020 entry via ground testing in the Electric Arc Shock Tube (EAST) at NASA Ames. Tests to verify stagnation line heating were previously reported in EAST, confirming the presence of shock layer radiation as the major discrepancy in heatshield temperature modelling [4]. Therefore, tests for stagnation line heating were not repeated. Instead, the shock tube informed bias method [5, 6] was used to identify test conditions that may produce similarity to streamlines that pass around the backside of the vehicle and are responsible for the radiation observed at the two heat flux gauge locations. This method was used to identify a range of velocities and densities in the shock tube that are relevant for confirming the radiative environment encountered. This paper reports the results obtained in the 10 cm diameter EAST shock tube, corresponding to later trajectory points at ambient pressures of 1.1-2.0 Torr and velocities from 1.2-3.5 km/s. The test series employed two primary diagnostics: emission spectroscopy and tunable diode laser absorption spectroscopy (TDLAS). The emission spectroscopy performed broadband measurements of the radiative emission of the 4.3 and 2.7 m bands of CO2 at flight similar conditions, obtaining both spectral and spatial data corresponding to the relaxation behind the shock front. The TDLAS measured the absorption of several lines of CO and CO2 and obtains species number densities and temperatures as a function of time behind the shock front. This paper will review highlights of this test series and analyses of the emission and absorption data. While the datasets generally show good agreement with predictions, a few discrepancies and items for additional investigation are identified and will be discussed

Brett A Cruden↗

Potential of VIIRS Time Series Data for Aiding the USDA Forest Service Early Warning System for Forest Health Threats: A Gypsy Moth Defoliation Case Study

This report details one of three experiments performed during FY 2007 for the NASA RPC (Rapid Prototyping Capability) at Stennis Space Center. This RPC experiment assesses the potential of VIIRS (Visible/Infrared Imager/Radiometer Suite) and MODIS (Moderate Resolution Imaging Spectroradiometer) data for detecting and monitoring forest defoliation from the non-native Eurasian gypsy moth (Lymantria dispar). The intent of the RPC experiment was to assess the degree to which VIIRS data can provide forest disturbance monitoring information as an input to a forest threat EWS (Early Warning System) as compared to the level of information that can be obtained from MODIS data. The USDA Forest Service (USFS) plans to use MODIS products for generating broad-scaled, regional monitoring products as input to an EWS for forest health threat assessment. NASA SSC is helping the USFS to evaluate and integrate currently available satellite remote sensing technologies and data products for the EWS, including the use of MODIS products for regional monitoring of forest disturbance. Gypsy moth defoliation of the mid-Appalachian highland region was selected as a case study. Gypsy moth is one of eight major forest insect threats listed in the Healthy Forest Restoration Act (HFRA) of 2003; the gypsy moth threatens eastern U.S. hardwood forests, which are also a concern highlighted in the HFRA of 2003. This region was selected for the project because extensive gypsy moth defoliation occurred there over multiple years during the MODIS operational period. This RPC experiment is relevant to several nationally important mapping applications, including agricultural efficiency, coastal management, ecological forecasting, disaster management, and carbon management. In this experiment, MODIS data and VIIRS data simulated from MODIS were assessed for their ability to contribute broad, regional geospatial information on gypsy moth defoliation. Landsat and ASTER (Advanced Spaceborne Thermal Emission and Reflection Radiometer) data were used to assess the quality of gypsy moth defoliation mapping products derived from MODIS data and from simulated VIIRS data. The project focused on use of data from MODIS Terra as opposed to MODIS Aqua mainly because only MODIS Terra data was collected during 2000 and 2001-years with comparatively high amounts of gypsy moth defoliation within the study area. The project assessed the quality of VIIRS data simulation products. Hyperion data was employed to assess the quality of MODIS-based VIIRS simulation datasets using image correlation analysis techniques. The ART (Application Research Toolbox) software was used for data simulation. Correlation analysis between MODIS-simulated VIIRS data and Hyperion-simulated VIIRS data for red, NIR (near-infrared), and NDVI (Normalized Difference Vegetation Index) image data products collectively indicate that useful, effective VIIRS simulations can be produced using Hyperion and MODIS data sources. The r(exp 2) for red, NIR, and NDVI products were 0.56, 0.63, and 0.62, respectively, indicating a moderately high correlation between the 2 data sources. Temporal decorrelation from different data acquisition times and image misregistration may have lowered correlation results. The RPC experiment also generated MODIS-based time series data products using the TSPT (Time Series Product Tool) software. Time series of simulated VIIRS NDVI products were produced at approximately 400-meter resolution GSD (Ground Sampling Distance) at nadir for comparison to MODIS NDVI products at either 250- or 500-meter GSD. The project also computed MODIS (MOD02) NDMI (Normalized Difference Moisture Index) products at 500-meter GSD for comparison to NDVI-based products. For each year during 2000-2006, MODIS and VIIRS (simulated from MOD02) time series were computed during the peak gypsy moth defoliation time frame in the study area (approximately June 10 through July 27). Gypsy moth defoliation mapping products from simated VIIRS and MOD02 time series were produced using multiple methods, including image classification and change detection via image differencing. The latter enabled an automated defoliation detection product computed using percent change in maximum NDVI for a peak defoliation period during 2001 compared to maximum NDVI across the entire 2000-2006 time frame. Final gypsy moth defoliation mapping products were assessed for accuracy using randomly sampled locations found on available geospatial reference data (Landsat and ASTER data in conjunction with defoliation map data from the USFS). Extensive gypsy moth defoliation patches were evident on screen displays of multitemporal color composites derived from MODIS data and from simulated VIIRS vegetation index data. Such defoliation was particularly evident for 2001, although widespread denuded forests were also seen for 2000 and 2003. These visualizations were validated using aforementioned reference data. Defoliation patches were visible on displays of MODIS-based NDVI and NDMI data. The viewing of apparent defoliation patches on all of these products necessitated adoption of a specialized temporal data processing method (e.g., maximum NDVI during the peak defoliation time frame). The frequency of cloud cover necessitated this approach. Multitemporal simulated VIIRS and MODIS Terra data both produced effective general classifications of defoliated forest versus other land cover. For 2001, the MOD02-simulated VIIRS 400-meter NDVI classification produced a similar yet slightly lower overall accuracy (87.28 percent with 0.72 Kappa) than the MOD02 250-meter NDVI classification (88.44 percent with 0.75 Kappa). The MOD13 250-meter NDVI classification had a lower overall accuracy (79.13 percent) and a much lower Kappa (0.46). The report discusses accuracy assessment results in much more detail, comparing overall classification and individual class accuracy statistics for simulated VIIRS 400-meter NDVI, MOD02 250-meter NDVI, MOD02-500 meter NDVI, MOD13 250-meter NDVI, and MOD02 500-meter NDMI classifications. Automated defoliation detection products from simulated VIIRS and MOD02 data for 2001 also yielded similar, relatively high overall classification accuracy (85.55 percent for the VIIRS 400-meter NDVI versus 87.28 percent for the MOD02 250-meter NDVI). In contrast, the USFS aerial sketch map of gypsy moth defoliation showed a lower overall classification accuracy at 73.64 percent. The overall classification Kappa values were also similar for the VIIRS (approximately 0.67 Kappa) versus the MOD02 (approximately 0.72 Kappa) automated defoliation detection product, which were much higher than the values exhibited by the USFS sketch map product (overall Kappa of approximately 0.47). The report provides additional details on the accuracy of automated gypsy moth defoliation detection products compared with USFS sketch maps. The results suggest that VIIRS data can be effectively simulated from MODIS data and that VIIRS data will produce gypsy moth defoliation mapping products that are similar to MODIS-based products. The results of the RPC experiment indicate that VIIRS and MODIS data products have good potential for integration into the forest threat EWS. The accuracy assessment was performed only for 2001 because of time constraints and a relative scarcity of cloud-free Landsat and ASTER data for the peak defoliation period of the other years in the 2000-2006 time series. Additional work should be performed to assess the accuracy of gypsy moth defoliation detection products for additional years.The study area (mid-Appalachian highlands) and application (gypsy moth forest defoliation) are not necessarily representative of all forested regions and of all forest threat disturbance agents. Additional work should be performed on other inland and coastal regions as well as for other major forest threats.

Spruce, Joseph P.↗

Investigating Low-Altitude Constellations of Ad-Hoc Lunar PNT System for Distributed Spacecraft Autonomy

In this study, we examine a low-altitude Lunar Position, Navigation, and Timing (LPNT) constellations and the localization performance of Centralized Extended Kalman Filter (CEKF) and Decentralized Extended Kalman Filter (DEKF) algorithms. The primary investigation involves a 100-node swarm operating at a 100 km altitude, in contrast to previous studies that examined a 21-node asset in a frozen-orbit at 5,500 km. The autonomous operation of large-scale swarm is based on two-way Inter-Satellite Link (ISL) measurements, which involve pseudoranges and relative velocities among swarm nodes. We perform a numerical assessment of the two filtering approaches, utilizing ‘fully sampled’ measurements from all available assets as well as ‘two ISL’ measurements where each spacecraft is restricted to only two antennas. This research includes an analysis of CEKF under 2-ISL constraints and evaluates the performance of DEKF in a 100-node swarm, which has not been explored in previous studies. In addition, we examine the impact of increasing the sampling frequency for DEKF, showing that the update cycle can be shortened from a 10-minute interval. A novel approach for ‘2-ISL limited’ DEKF will also be introduced, using a matching formulation that exhaustively enumerates all potential matches. This study provides valuable insights into large-scale distributed swarm operations, considering various filter configurations, sampling frequencies, matching strategies, and scalability of CEKF and DEKF for low-altitude LPNT applications. The Lunar PNT technology plays a key role in providing reliable and robust navigation services on the Moon's surface and the South pole, where the primary Lunar missions are planned. To support upcoming Lunar missions, including small satellites from NASA's Commercial Lunar Payload Services program, the Lunar PNT system must be adaptable to smaller platforms like CubeSats. Driven by the growing involvement of public and private exploration partnerships, the traditional low Earth orbit missions are shifting to beyond geosynchronous orbit [1]. These upcoming missions aim to foster a sustainable and innovative exploration program, in collaboration with commercial and international partners, to facilitate human expansion throughout the solar system and return new knowledge and opportunities to Earth [2]. As part of this trend, there are increasing efforts to utilize science missions in Lunar orbit to develop a non-dedicated and ad-hoc PNT network system. Two traditional approaches, the Deep Space Network (DSN) and the weak signal Global Positioning System (GPS), are established deep-space navigation technologies for missions beyond the geosynchronous orbit. Beginning in 1958, the DSN was developed to communicate with the Explorer 1 spacecraft based on the use of radiometric tracking in spacecraft navigation [3]. The DSN is capable of providing nearly unfettered coverage to spacecraft beyond low-Earth orbit (LEO), however, increased space mission volume has created concerns about future expectations of DSN usage for spacecraft navigation [4]. For cislunar mission applications, the position accuracy using DSN achieves 100 m (3σ) with at least three geometrically diverse ground stations when using radiometric tracking alone [5]. The DSN's dependence on Earth-based ground stations restricts its operational capabilities to periods of Earth visibility. This limitation, coupled with its poor localization performance, renders the DSN unsuitable for future lunar missions that demand continuous tracking and precise positioning. To satisfy the increasing requirements of DSN in Lunar applications, spacecrafts are also required to improve their onboard antenna power and efficiency of the transmission. However, there is an important aggregate cost trade between adding capabilities to every spacecraft and adding to a capacity on the ground that serves multiple spacecraft [6]. A weak GPS system can provide PNT service while the user spacecraft is bound to the Moon, leveraging a single, steerable high gain antenna with the relatively narrow beam which includes all the sources in its field of view [7]. However, the higher the altitude the receiver is above the GPS constellations, the poorer and the weaker are the relative geometry and the received signal powers, respectively, leading to a significant navigation accuracy reduction [8]. The transmitted power becomes weaker with increasing distance from the Earth as well as signals tracked from one of the side lobes of the GPS antenna pattern. As a results, the number of visible satellites and relative geometric condition of the GPS satellites at very high altitude drops dramatically and reduces the navigation solution accuracy. Therefore, the weak GPS system is also not an ideal way to provide PNT service to upcoming Lunar missions when considering its limited geometric condition and the recued navigation accuracy. Another navigation approach on the Moon is being developed, similar to the Global Navigation Satellite System (GNSS) on Earth, aiming to offer navigation service with continuous 24/7 coverage across the entire Lunar surface. For example, lunar communications relay and navigation systems (LCRNS) by NASA and Lunar navigation satellite systems (LNSS) by JAXA are designed to serve as dedicated Position, Navigation, and Timing (PNT) systems for the Moon. However, designing a dedicated LNSS and PNT service involves additional challenges, which are unique to the lunar environment, including limited payload capacity for the CubeSat platform, i.e., the size, weight, and power (SWaP) of the onboard clock, limited lunar ground monitoring stations, and limited financial investment as compared to the legacy Earth-GPS [9]. NASA’s focus on utilizing CubeSat platforms on the Moon leads to an alternative Lunar navigation platform that leverages the existing Lunar science and exploration assets. The small satellites used in Lunar missions can be used to create a low-cost, autonomous, ad-hoc, and on-demand mission-centric Lunar PNT swarm capable of providing PNT services to these low-cost lunar missions [10]. As upcoming Lunar missions will often operate at low-altitude about 30 km to 100 km for scientific observations and mapping purposes, the low-altitude orbital constellations could be employed to create an ad-hoc Lunar PNT system. However, several issues must be addressed, such as the instability of these orbits, which often require maintenance or are only suitable for short-duration missions, operating for fewer than 90 days. Additionally, at an altitude of 100 km, the satellites have a limited period during which they are above the horizon and capable of providing PNT service to users. The implementation of a non-dedicated, ad-hoc Lunar navigation constellation facilitates on-demand PNT services. A preliminary study of ad-hoc Lunar PNT system was conducted using 21 spacecraft in 5,5000 km altitude frozen orbits to test its feasibility and a basic performance of orbital asset localization among ad-hoc Lunar constellations in small satellites format [10]. These swarm assets are designed for autonomous localization with minimal Earth interaction, reducing dependency on bandwidth and ground resources. The design in [10] demonstrated the feasibility of a decentralized PNT approach, specifically employing a DEKF approach for state estimation, which helps minimize onboard operating costs. The DEKF method distributes computation across individual satellites, which lightens the computational load while maintaining accuracy in orbit ephemeris and clock offsets, similar to centralized systems [11]. In a follow-on study [12], each spacecraft was limited to 2 communications antennae, forcing the selection of measurements and scheduling spacecraft activities to perform the measurements. A matching algorithm is implemented to select the best measurements and schedule position estimation updates. The decentralized localization performance is also investigated with increasing levels of network degradation for swarm assets considering the impact of intermittent and permanent communication failure, to demonstrate the robustness and fidelity of the decentralized Lunar PNT service [13]. This study confirmed that the ad-hoc PNT constellations in frozen orbit are highly robust and resilient to communication failures. However, unlike frozen orbit swarm assets, the low-altitude satellites have a limited ground view at an altitude of 100 km, where the ad-hoc Lunar constellation consists of 98 low-altitude satellites, evenly distributed across seven circular polar orbital planes, alongside two satellites in a frozen orbit at an altitude of 5,500 km (Figure 1). Therefore, the number of satellites visible to ground users is significantly limited in low-altitude orbit constellations. As each visibility of a spacecraft remains intact for only a few ticks before it moves out of the field of view, the ground user encounters challenges in maintaining continuous navigation service, resulting in sparse availability and provision of Lunar PNT system. Consequently, service availability is primarily restricted to the Lunar South Pole region (Figure 2). Given these limitations and concerns, the localization performance of low-altitude swarm assets will be assessed in this study. We focus on the investigation of the localization performance of low-altitude swarm assets and ground users near the Lunar South Pole. The overall flow of the Lunar PNT simulation incorporates the DEKF approach of asset localization and the weighted least-squares approach in user localization (Figure 3). The autonomous Lunar PNT simulation is primarily implemented in MATLAB, where the DEKF based on the matching scheduler is implemented with Google’s OR-tools as a model builder and Gurobi optimization tool as a backend solver. The General Mission Analysis Tool (GMAT) is utilized to generate ephemeris data for swarm assets, and accounts for satellite orbital details, mass, and perturbations like solar radiation pressure and drag coefficients. Each ephemeris dataset is produced in the Moon International Celestial Reference Frame (ICRF) inertial coordinate system. For state estimation, the distributed swarm assets rely on two-way Inter-Satellite Link (ISL) measurements, which involve tracking pseudoranges and relative velocities between visible satellites and anchor nodes during each observation. Numerical evaluations of the decentralized localization process are conducted to demonstrate the feasibility of the low-altitude PNT system in providing reliable navigation services. The main approach involves using DEKF and CEKF to localize 100 satellites in low-altitude constellations, where the CEKF is implemented to serve as a baseline for comparing the performance of distributed algorithms. In both cases, we evaluate ‘fully sampled’ measurements from all available assets, and ‘two ISL’ measurements when spacecraft are constrained to have only two antennas. We test four estimation techniques: CEKF fully sampled, CEKF two ISL, DEKF fully sampled, and DEKF two ISL filters. As the DEKF update cycle is comprised of network setup, communication, and computations, a global broadcast network and 2-way ISL network setup will take from 4 to 6 minutes as maximum [12]. In this simulation, the DEKF update cycle is set to 10 minutes, including a 4-minute latency for obtaining and computing the actual measurement updates. We experiment an increased update cycle to demonstrate the feasibility and evaluate the impact on localization performance using various tuning values for measurement noise covariances (Figures 4 and 5). By comparing centralized and decentralized approaches using a matching algorithm, we analyze the influence of cross-correlation factors in the covariance matrix, assuming 100% reliability of all assets and measurements. The increased frequency and the adjustments of tuning parameters reveal distinct error patterns between the two scenarios. The localization accuracy of the swarm assets and ground users is assessed by taking the median error across 100 assets and one ground user (84.9°S, 137.5°E) over 7-day simulation period (Table 1). Since the user localization accuracy is significantly affected by the performance of the swarm assets, it is crucial to maintain high localization accuracy within the swarm. This study will continue to explore decentralized filtering for autonomous LPNT operations, with further investigation of an 'iterative' matching approach which enumerates every valid matching pair, planned for the following month.

Yeji Kim↗

Assessment of Cloud Fraction Derived from a New Geostationary Satellite Cloud Retrieval Algorithm for CERES and Progress Towards Cross-platform Continuity

For over two decades The Clouds and the Earth’s Radiant Energy System (CERES) project has produced long-term records of top-of-atmosphere (TOA) and surface irradiances for detecting changes in the Earth’s radiation budget and advancing understanding of how clouds contribute to those changes. Accurate characterization of the spatial and temporal distributions of clouds are a critical component for producing CERES datasets. The CERES Cloud Working Group (CWG) derives cloud properties from both geostationary (GEO) and low-Earth orbit (LEO) satellite sensors in order to provide complete global coverage at hourly temporal resolution. However, the use of multiple sensors to provide this spatiotemporal coverage throughout a long-term record presents some challenges, because the various sensors generally have different spectral band characteristics (e.g., spectral band width and response) and spatial resolution. These differences can result in spatial artifacts at the coverage boundary between two sensors or temporal artifacts when one sensor replaces another in the record. For the upcoming Edition 5 release of CERES products, the CWG is developing cloud retrieval algorithms which utilize only spectral bands common to most modern passive satellite radiometers and account for differences in spectral width and response. The goal with this approach is to provide global cloud properties for CERES with greater cross-platform consistency than the previous Edition 4 products and thus mitigate artifacts which are evident at the interface of two sensors. This study focuses on retrieval of total cloud fraction from various GEO sensors, and we use Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) observations to assess the accuracy of total cloud fraction derived from the various sensors. The Edition 5 cloud mask algorithm depends on estimates of cloud-free TOA spectral radiances to differentiate clear and cloudy conditions, and CALIOP is used to assess the accuracy of those estimates when cloud-free conditions are indeed observed.

CALIOP↗

Implementation of A New Microwave Scattering Database and A Forward Model for Active Microwave Sensors in CRTM

Radiative transfer models are extensively used for the assimilation of satellite observations into NWP models as well as retrieving geophysical products from satellite measurements. CRTM is a community model developed by NOAA JCSDA and widely used for different purposes requiring RT calculations. CRTM requires bulk scattering lookup tables in order to perform all-sky RT calculations. However, the current CRTM lookup tables for microwave frequencies were generated based on the Mie theory by assuming spherical frozen particles. The scattering lookup tables generated using the DDA technique has shown to largely improve the RT scattering calculations in the MW region. This presentation targets (i) the implementation and validation of a DDA database that was originally developed for the ARTS RT model into CRTM, and (ii) developing the CRTM active sensor module that takes advantage of the backscattering coefficients computed using the DDA method. The DDA database only provides single scattering properties of different habits, while CRTM requires bulk scattering properties. The CRTM cloud coefficients were previously generated based on the effective radius for representing the size of the particles. However, effective radius is neither measurable nor provided by the NWP models, thus need to be estimated from other geophysical variables such as water content. Therefore, in addition to calculating the CRTM bulk scattering properties from the DDA single scattering database, the CRTM was also largely modified to use cloud water content (kg.m-3), instead of effective radius, for performing the interpolation over size/mass of the particles. CRTM already requires water content as input, thus no extra variables are required for performing scattering calculations using the new ARTS DDA database. The CRTM scattering modules search for effective radius in cloud coefficient files and will use the cloud water content if the effective radius dimension is not found in the cloud coefficient files. Figure 1 shows the CRTM simulated brightness temperatures computed using different cloud coefficients versus ATMS observed values over Hurricane Irma on September 7, 2017 at 18:00 UTC. We used all the cloud water content values included in ERA5 with default CRTM/DDA habits for water, rain, snow, ice, hail, and graupel. ERA5 does not provide separate water content values for ice, hail, and graupel, thus the ice water content values were divided between ice, hail, and graupel clouds similar to what was explained in the previous section. In channels with a frequency lower than 90 GHz, emission from water and rain clouds can compensate for cloud scattering so that cloud contaminated Tbs are larger than corresponding clear sky Tbs. The DDA simulations for channels 1-7 largely perform better than the Mie simulations. The DDA simulations show a mix of small negative and positive simulated minus observed values, while the Mie results show large negative biases. The weighting functions for some of the ATMS temperature sounding channels (channels 9-15) peak mostly above the clouds, therefore the measured Tbs become less sensitive to clouds so that the results of both Mie and DDA become very similar. The Mie lookup tables generate excessive scattering for channel 16, but not enough scattering for the water vapor channels. In the specific case of Hurricane Maria, the DDA lookup tables do not generate enough scattering for channel 16, but the DDA results are much more consistent with observations for water vapor channels than for channel 16. It should be noted that the results may vary if we use other habits to represent snow, hail, and graupel in the DDA simulations. Although these results clearly show the advantage of the DDA database over the Mie dataset, different error sources such as error in the observations, displacement of clouds in the ERA5 reanalysis, and also lack of convective clouds or in general errors in the input atmospheric and cloud profiles contribute to the differences between the simulated and observed values. Aside from the improvements in the simulations, a major advantage of the new dataset is a large number of habits that can be used to tune the data assimilation systems to perform well in different weather conditions.

Isaac Moradi↗

Capturing, Analyzing, Maintaining, and Disseminating Shape Memory Material Data Between Information Management Systems

With an increased demand on reducing the time, cost, and effort to develop new materials, Integrated Computational Materials Engineering (ICME) has received widespread attention in various engineering disciplines as a catalyst for significantly reducing experimental testing during the material design process. An ICME approach to design can enable ‘fit-for-purpose’ materials to be realized in engineering applications by incorporating well-understood process-property-performance relationships between the various length and time scales in a material’s structure, enabling material optimization. However, such an approach requires validated multiscale models at the various length scales for a material, which in turn requires a large amount of data, a robust means of storing the data, and the ability to link data to developed material models. The NASA Vision 2040 [1] has identified nine key elements to enabling ICME approaches in system level design, with one being “Data, Information, and Visualization”, thus outlining the importance of a robust information management system for ICME. As the relationship between microstructure, properties, and material performance become better understood and incorporated into multiscale models that can be leveraged in application design, the emergence of new materials with application-driven properties can be realized. One such new material class that has seen growing attention are shape memory materials (SMM), in which a material can transition between a deformed and undeformed state via a reversible phase transformation when subject to a thermal, mechanical, or magnetic load [2]. SMMs have been used widely in aerospace and biomedical industries, including applications such as actuators, low-shock mechanisms, medical staples, braces, and stents [3, 4]. These materials exhibit unique behavior due to their ability to transition between phases, and thus the mechanisms that enable this transition must be captured in a data information management system and incorporated into SMM material models. At NASA Glenn Research Center, the Shape Memory Materials Database (SMMD) Tool has been developed to capture the necessary information that governs SMM material behavior and provide users the ability to select and visualize various SMMs for a specific application [5]. The database contains point-wise data for published SMM materials, along with the pedigree metadata for traceability necessary for a robust information management system. The database is also capable of storing in-house test data performed at NASA GRC by interacting with the developed Shape Memory Alloy (SMA) Analytics tool to extract the necessary point-wise values and populate the database. Although the SMMD Tool offers its users a single, authoritative source for SMM material data that is critical for model development and material design, the full material pedigree of the in-house test data for SMMs is not currently captured and is out of the scope for the SMMD tool. In this work, the schema for capturing SMM test data within the larger NASA GRC ICME Schema [6, 7, 8, 9] will be developed and implemented for thermomechanical tests conducted at NASA GRC. The developed schema will not only store the relevant data needed for the SMMD tool, but also the material pedigree (i.e., production of the bulk material, bulk material analysis, sample cut-out diagrams, sample fabrication procedure, etc.), test pedigree (i.e., test equipment used, measurement systems used, raw test data), and analysis pedigree (i.e., how the data in the SMMD tool is calculated). Furthermore, a Python-based framework will be developed to seamlessly interact between the SMA Analytics and SMMD tools, which will write the full dataset and associated metadata to the GRC Information Management System before passing the required point-wise data to the SMMD tool. Data informatics is a key element of the NASA Vision 2040, which requires not only that data is stored and maintained throughout the material lifecycle, but that the data is also accessible and reusable such that material development efforts can be minimized. Therefore, for an ICME design approach to be realized, a centralized information management system that drives the ICME process must be able to communicate with other databases. The work that will be presented in this presentation will therefore not only demonstrate the ability of NASA GRC’s information management system to capture SMM data, but also its ability to interact with pre-existing tools specialized for such materials.

Data management↗

Design and Technology Maturation of the Stratospheric Projectile Experiment of Entry Dynamics

The supersonic and transonic dynamic stability of blunt-body reentry vehicles currently poses large risks in all of NASA’s ongoing entry missions (MSR SRL, MSR EES, and Dragonfly). These projects have allocated millions of dollars to testing and modeling efforts to buy down risk by using the current state-of-the-art (SoA) facilities at NASA’s disposal. While these facilities have heritage in supplying dynamics data to reentry missions, their availability is severely limited – particularly with the high number of concur-rent projects requesting simultaneous testing– and are costly when considering the science density per dollar. None of the current SoA facility methodologies allow the test model to have the dynamics fully develop through a flight relevant free-stream profile and as such require extrapolations with resultant high uncertainties in order to relate the test dynamics to flight expectations. SPEED is a NASA Ames Center Innovation Fund (CIF) project that is developing a highly tailorable and cost-effective test methodology to better assess the dynamic stability of blunt-body reentry vehicles via a stratospheric balloon flight. This is accomplished by dropping a suite of instrumented capsules from a stratospheric balloon to gain a statistically relevant dataset of scaled reentry vehicles in mission relevant free-flight conditions. This presentation will walk through how the test methodology is being implemented specifically for the Mars Sample Return (MSR) Earth Entry System (EES) geometry in an awarded Flight Opportunities Program (FOP) test flight in early CY24. SPEED Application to MSR: SPEED consists of three main mechanical systems: the Drop Platform, the Projectile, and the test Capsule. SPEED is being developed as a set of guidelines and recommendations for how to test with the proposed Concept of Operations (Conops) since the specific design parameters will vary depending on the specific project’s reference trajectory and entry vehicle design. As such, this presentation will walk through the development time-line as shown in Fig. 2. This is meant to serve as a blueprint for further missions as desired. Mechanical and Avionics Design. The SPEED test platform designed for the MSR-EES capsule geometry with nominal entry parameters has the ability to carry 10 Capsules to altitude instrumented with: 1. 3-Axis Accelerometer 2. IMU 3. Gyroscope 4. Magnetometer 5. Pressure Transducer cruciform 6. Uplook and Horizon Cameras To package the avionics/instrumentation suite, the capsule is approximately 1’ in diameter with the Outer Mold Line (OML) centroid-scaled from the full EES design. The internal volume is gutted and custom-shaped to fit the desired instrumentation suite, as well as to allow for the positioning of ballast mass such that the Center of Gravity is analogous to the flight vehicle. All structural components in the Capsule and Projectile are 3D printed, which significantly reduces the cost of each flight unit to around $1500 including all instrumentation, avionics, and structural components. Flight Conops. The test Capsule is accelerated to the desired altitude and Mach number while stowed in the Projectile, a missile-like vehicle consisting of steel ballast in the nose, a low-drag OML, and an Ejection Mechanism to reliably release the Capsule into the free-flow supersonic conditions. For the MSR-EES design, the capsule employs ~3kg of ballast mass at the nose to accelerate the 1.25kg test Capsule to ~Mach 1.7 at 23km altitude. This requires an initial release altitude of 40km, the quoted limit of a 80kg payload by the FOP-contracted balloon provider. Once the Ejection Mechanism avionics detect the proper conditions, the spring-loaded Ejection Mechanism will release and – guided by the sabot – expose the test Capsule to the desired test conditions for ~5 seconds of free-flight in the supersonic/transonic regimes. Dynamics in the subsonic regime will also be captured with the instrumentation suite with post-flight recovery operations aimed at recovering the high-G-load capable SD cards after the planned hard impact landings. Testing and Development: In the few months the SPEED project has worked the development of MSR-EES flight test, the team has performed lab and drone based testing which this presentation will overview. After the first design phase, the team fabricated Engineering Demonstration Units (EDUs) of all subsystems to perform validation testing shown in Fig. 5. After validation was completed on the subsystem level, a drone-drop test was performed at the recreational flight ceiling of 400ft altitude to assess the SPEED systems in a flight environment. Parameters such as in-flight stability, hard impact landing performance, and avionics performance were quantified and qualified. The FY23 CIF will culminate in a helicopter drop test aboard an Air National Guard Blackhawk. This will prepare the team for the CY24 FOP stratospheric balloon flight that should provide the final verification to begin offering the test platform for mission support. Focus of Presentation: This presentation will outline the technology maturation path of the SPEED implementation to the MSR-EES capsule baseline as well as the details regarding the mechanical system, avionics and instrumentation, and flight operations. Note that a complementary presentation is being submitted for a methodology overview of the SPEED test platform, introducing the testing technique and benefits as well as the full application space of the technology.

pitch damping coefficient↗

Assessments of Physiology and Cognition in Hybrid-Reality Environments (APACHE)

NASA is planning to return to the Moon in the mid-2020s as a stepping stone to Mars missions in the 2030s. Spacewalks, or extravehicular activities (EVAs), performed on the Moon and Mars will differ in a variety of ways from those that have been performed in decades past. NASA has identified multiple risks to human health and performance associated with a crewed mission to Mars, especially those associated with exploration EVAs which are expected to be a primary mission activity. Crew may be expected to conduct up to 24 hours of EVA per person per week, where the likelihood of injury and/or mental mistakes are increased compared to ground-based training or current microgravity EVAs and the consequences of which can be catastrophic. Current test environments for exploration EVA research and technology development are large, costly facilities that are limited in their availability or capabilities. Spacesuit testing in a reduced gravity environment such as NASA’s Neutral Buoyancy Laboratory, while a good representation of the crew’s physical workload during exploration EVAs, typically has small datasets and is difficult to integrate physiological sensors or other types of crew performance measures. Meanwhile, scientific field-based testing such as NASA’s Desert Research and Technology Studies offers an operationally relevant environment for exploration EVAs, particularly for cognitive workload, but is also limited by small datasets, lack of a pressurized spacesuit, and obtrusive measures. The limitations of current analogs for exploration EVAs identify a need for a new test environment that can approximate both the physical and cognitive demands associated with exploration EVAs to enable rapid, controlled, and repeatable evaluations of human health and performance risks of exploration missions. In response, the Human Physiology, Performance, Protection, and Operations Laboratory (H-3PO) at NASA Johnson Space Center has developed a hybrid reality exploration EVA analog named the Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) to address these limitations using a combination of virtual, physical, and hybrid reality techniques. The APACHE facility resides at NASA Johnson Space Center and serves as a large “sandbox” for EVA research and simulation. At its center is a roughly 15x20ft space surrounded by a 14” tall sandbox partially filled with lunar regolith simulant to emulate the physical feeling of walking on a planetary surface and to allow for simulated geology operations. Nearby, a curved passive treadmill (Skillmill Connect, Technogym, Fairfield, NJ) and an omnidirectional treadmill (Infinadeck, Infinadeck, Rocklin, CA) are included to enable exploration of these large virtual environments while also imposing the physical demands, representative timelines, and cognitive burdens required to navigate and traverse these distances during exploration EVA. A 6DOF motion platform is used to simulate rover operations and supports various human performance evaluations and associated risks. Lastly, APACHE can support two extravehicular (EV) crewmembers working in tandem. A computer workstation is located nearby and also supports an intravehicular (IV) crewmember as part of a full mission simulation. The IV crewmember has direct video and audio communication with the EV crew in VR to provide operational and procedural support. The software used in APACHE was created by the JSC Engineering Directorate, in partnership with Buendea, powered by a custom Unreal Engine 5 (UE5.3, Epic Games) project. APACHE currently utilizes the HTC Vive Pro Eye in a wireless configuration for VR simulations. There are two virtual environments that subjects can explore within APACHE, a Lunar and Martian surface. The virtual Lunar surface was created from LIDAR data of the Lunar South Pole to create roughly 16 sq km of explorable terrain. The virtual Martian surface contains roughly 400 sq km of explorable terrain derived from Mars Reconnaissance Orbiter LIDAR data of the Jezero Crater. The immersion and related cognitive burdens of conducting a planetary EVA is simulated through a series of EVA-relevant tasks performed in the VR environment, using these high-fidelity visual representations. Additionally, APACHE includes biosensor driven informatics, such as real-time heart rate monitoring and/or derived values from model simulations, for active monitoring by the EV crew and added cognitive demand. A “Wizard of Oz” control panel enables test operators to activate contingency events such as simulated spacesuit malfunctions, loss of communications, and/or limited visibility. Embedded performance measures such as accuracy, completeness, and execution time have been developed for various exploration tasks to objectively quantify crew performance during an EVA and compare impacts to performance when different environmental stressors, both physical and cognitive, are added to or removed from the simulation. Additionally, validated cognitive and operational performance measures such as the Digit Symbol Substitution Task have been recreated and embedded in VR for direct and relatively unobtrusive measurement of motor perception. The APACHE environment currently supports multiple research studies at NASA. Examples include the CHAPEA project, a series of simulated year-long missions on Mars by a 4-person crew; and the CO2 Contingency Walk Back Study, an investigation of elevated CO2 exposure on crew performance during a contingency EVA scenario. APACHE also provides a test environment to support the development of the Crew State and Risk Model, which is a collection of individualized, mathematical models of crew physical and cognitive state; and the Personalized EVA Informatics and Decision Support system, an operational tool for flight controllers, and eventually a self-reliant Martian crew, to make biomedically-informed decisions in real-time to optimize the EVA planning and execution with respect to crew health and performance. Some technical challenges associated with developing the APACHE environment, as well as current limitations, include VR limitless natural walking with a hybrid spacesuit simulator, optimizing performance for wireless PC VR streaming while maintaining a high degree of visual fidelity, and the integration of various physiological (metabolic masks) and psychometric (eye tracking) sensors with the VR headset.

Human Performance↗