Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Amazon”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Geonex: Land Surface Monitoring from a New Generation of Geostationary Sensors

The latest generation of geostationary satellites carry sensors such as the Advanced Baseline Imager (GOES-16/17) and the Advanced Himawari Imager (Himawari-8/9) that closely mimic the spatial and spectral characteristics of MODIS and VIIRS, useful for monitoring land surface conditions. The NASA Earth Exchange (NEX) team at Ames Research Center has embarked on a collaborative effort among scientists from NASA and NOAA exploring the feasibility of producing operational land surface products similar to those from MODIS/VIIRS. The team built a processing pipeline called GEONEX that is capable of converting raw geostationary data into routine products of Fires, surface reflectances, vegetation indices, LAI/FPAR, ET and GPP/NPP using algorithms adapted from both NASA/EOS and NOAA/GOES-R programs. The GEONEX pipeline has been deployed on Amazon Web Services cloud platform and it currently leverages near-realtime geostationary data hosted in AWS public datasets under a NOAA-AWS agreement. Initial analyses of various products from ABI/AHI sensors suggest that they are comparable to those from MODIS in representing the spatio-temporal dynamics of land conditions. Cloud computing offers a variety of options for deploying the GEONEX pipeline including choice CPUs, storage media, and automation. By making the GEONEX pipeline available on the cloud, we hope to engage a broad community of Earth scientists from around the world in utilizing this new source of data for Earth monitoring.

Nemani, Ramakrishna R.↗

Evaluating the Suitability of Commercial Clouds for NASA's High Performance Computing Applications: A Trade Study

NASA’s High-End Computing Capability (HECC) Project is periodically asked if it could be more cost effective through the use of commercial cloud resources. To answer the question, HECC’s Application Performance and Productivity (APP) team undertook a performance and cost evaluation comparing three domains: two commercial cloud providers, Amazon and Penguin, and HECC’s in-house resources—the Pleiades and Electra systems. In the study, the APP team used a combination of the NAS Parallel Benchmarks (NPB) and six full applications from NASA’s workload on Pleiades and Electra to compare performance of nodes based on three different generations of Intel Xeon processors—Haswell, Broadwell, and Skylake. Because of export control limitations, the most heavily used applications on Pleiades and Electra could not be used in the cloud; therefore, only one of the applications, OpenFOAM, represents work from the Aeronautics Research Mission Directorate and the Human and Exploration Mission Directorate. The other five applications are from the Science Mission Directorate.

High Performance↗

Item Retrieval as Utility Estimation

Retrieval systems have greatly improved over the last half century, estimating relevance to a latent user need in a wide variety of areas. One area that has not enjoyed such advancements is searching for items by attribute values, a common activity in e-commerce and science, particularly given numeric values. Existing item retrieval systems assume the user has a firm grasp of their own desires and can formulate a good Boolean or SQL-style query to retrieve items, as one would do with a database. A contrasting approach would be to estimate how well items match the user?s latent desires and return items ranked by this estimation. Towards this end, we present a retrieval model inspired by multi-criteria decision making theory, concentrating on numeric attributes. We evaluate our novel approach, the de-facto standard of Boolean retrieval, and several models proposed in the literature, in two user studies using Amazon Mechanical Turk. We use a competitive game to motivate test subjects and compare methods based on the results of the subjects? initial query and their success in the game. In our experiments, our new method signi cantly outperformed the others, whereas the Boolean approaches had the worst performance.

operations research↗

Earth Observations from Geostationary Satellites

The latest generation of geostationary satellites carry sensors such as the Advanced Baseline Imager (GOES-16/17) and the Advanced Himawari Imager (Himawari-8/9) that closely mimic the spatial and spectral characteristics of MODIS and VIIRS, useful for monitoring land surface conditions. The NASA Earth Exchange (NEX) team at Ames Research Center has embarked on a collaborative effort among scientists from NASA and NOAA exploring the feasibility of producing operational land surface products similar to those from MODIS/VIIRS. The team built a processing pipeline called GeoNEX that is capable of converting raw geostationary data into routine products of Fires, surface reflectances, vegetation indices, LAI/FPAR, ET and GPP/NPP using algorithms adapted from both NASA/EOS and NOAA/GOES-R programs. The GeoNEX pipeline has been deployed on Amazon Web Services cloud platform and it currently leverages near-realtime geostationary data hosted in AWS public datasets under a NOAA-AWS agreement. Initial analyses of various products from ABI/AHI sensors suggest that they are comparable to those from MODIS in representing the spatio-temporal dynamics of land conditions. Cloud computing offers a variety of options for deploying the GeoNEX pipeline including choice CPUs, storage media, and automation. By making the GEONEX pipeline available on the cloud, we hope to engage a broad community of Earth scientists from around the world in utilizing this new source of data for Earth monitoring.

Earth↗

Widespread Increase of Boreal Summer Dry Season Length Over the Congo Rainforest

Dry season length strongly influences tropical rainforest vegetation and is largely determined by precipitation patterns. Over the Amazon, the dry season length has increased since 1979 and severe short-term droughts have occurred. However, similar changes have not been investigated for the world’s second largest rainforest, the Congo Basin, where long-term drying and large-scale declines in forest greenness and canopy water content were reported. Here we present observational evidence for widespread increases in the boreal summer (June–August) dry season length over the Congo Basin since the 1980s, from both hydrological and ecological perspectives. We analyzed both dry season onset and dry season end via multiple independent precipitation and satellite derived vegetation datasets for the period 1979–2015. The dry season length increased by 6.4–10.4 days per decade in the period 1988–2013, primarily attributed to an earlier dry season onset and a delayed dry season end. The earlier dry season onset was caused by long-term droughts due to decreased rainfall in the pre-dry season (April–June). The delayed dry season end resulted from insufficiently replenished soil moisture, which postpones the start of the next wet season and hinders vegetation regrowth. If such changes continue, the enhanced water stress in a warming climate may affect the carbon cycle and alter the composition and structure of evergreen rainforest.

Congo rainforest growing season NDVI SIF↗

Diverse Photosynthetic Capacity of Global Ecosystems Mapped by Satellite Chlorophyll Fluorescence Measurements

Photosynthetic capacity is often quantified by the Rubisco-limited photosynthetic capacity (i.e. maximum carboxylation rate, V(sub cmax)). It is a key plant functional trait that is widely used in Earth System Models for simulation of the global carbon and water cycles. Measuring V(sub cmax) is time-consuming and laborious; therefore, the spatiotemporal distribution of V(sub cmax) is still poorly understood due to limited measurements of V(sub cmax). In this study, we used a data assimilation approach to map the spatial variation of V(sub cmax) for global terrestrial ecosystems from a 11-year-long satellite-observed solar-induced chlorophyll fluorescence (SIF) record. In this SIF-derived V(sub cmax) map, the mean V(sub cmax) value for each plant function type (PFT) is found to be comparable to a widely used N-derived V(sub cmax) dataset by Kattge et al. (2009). The gradient of V(sub cmax) along PFTs is clearly revealed even without land cover information as an input. Large seasonal and spatial variations of V(sub cmax) are found within each PFT, especially for diverse crop rotation systems. The distribution of major crop belts, characterized with high V(sub cmax) values, is highlighted in this V(sub cmax) map. Legume plants are characterized with high V(sub cmax) values. This V(sub cmax) map also clearly illustrates the emerging soybean revolution in South America where V(sub cmax) is the highest among the world. The gradient of V(sub cmax) in Amazon is found to follow the transition of soil types with different soil N and P contents. This study suggests that satellite-observed SIF is powerful in deriving the important plant functional trait, i.e. V(sub cmax), for global climate change studies.

Liming He↗

GeoNEX: Land Monitoring from a New Generation of Geostationary Sensors

The latest generation of geostationary satellites carry sensors such as the Advanced Baseline Imager (GOES-16/17) and the Advanced Himawari Imager (Himawari-8/9) that closely mimic the spatial and spectral characteristics of MODIS and VIIRS, useful for monitoring land surface conditions. The NASA Earth Exchange (NEX) team at Ames Research Center has embarked on a collaborative effort among scientists from NASA and NOAA exploring the feasibility of producing operational land surface products similar to those from MODIS/VIIRS. The team built a processing pipeline called GEONEX that is capable of converting raw geostationary data into routine products of Fires, surface reflectances, vegetation indices, LAI/FPAR, ET and GPP/NPP using algorithms adapted from both NASA/EOS and NOAA/GOES-R programs. The GEONEX pipeline has been deployed on Amazon Web Services cloud platform and it currently leverages near-realtime geostationary data hosted in AWS public datasets under a NOAA-AWS agreement. Initial analyses of various products from ABI/AHI sensors suggest that they are comparable to those from MODIS in representing the spatio-temporal dynamics of land conditions. Cloud computing offers a variety of options for deploying the GEONEX pipeline including choice CPUs, storage media, and automation. By making the GEONEX pipeline available on the cloud, we hope to engage a broad community of Earth scientists from around the world in utilizing this new source of data for Earth monitoring.

GeoNEX↗

Dropsonde Observations of Total Integrated Water Vapor Transport within North Pacific Atmospheric Rivers

A0.0ircraft dropsonde observations provide the most comprehensive measurements to date of horizontal water vapor transport in atmospheric rivers (AR). The CalWater experimen0 t 0.0recently more than tripled the number of ARs probed with the required measurements. This study uses vertical profiles of water vapor, wind, and pressure obtained from 304 dropsondes across 21 ARs. On average, total water vapor transport (TIVT) in an AR was 4.7108 2108 kg s-1. This magnitude is 2.6 times larger than the average discharge of liquid water from the Amazon River. The mean AR width was 890 270 km. Subtropical ARs contained larger IWV but weaker winds than midlatitude ARs, although average TIVTs were nearly the same. Mean TIVTs calculated by defining the lateral edges of ARs using an IVT-threshold versus an IWV-threshold produced results that differed by less than 10 across all cases, but did vary between midlatitudes and subtropical regions.

water vapor↗

Radar Altimetry as a Proxy for Determining Terrestrial Water Storage Variability in Tropical Basins

The Gravity Recovery and Climate Experiment (GRACE) mission has provided us with unforeseen information on terrestrial water-storage (TWS) variability, contributing to our understanding of global hydrological processes, including hydrological extreme events and anthropogenic impacts on water storage. Attempts to decompose GRACE-based TWS signals into its different water storage layers, i.e., surface water storage (SWS), soil moisture, groundwater and snow, have shown that SWS is a principal component, particularly in the tropics, where major rivers flow over arid regions at high latitudes. Here, we demonstrate that water levels, measured with radar altimeters at a limited number of locations, can be used to reconstruct gridded GRACE-based TWS signals in the Amazon basin, at spatial resolutions ranging from 0.5 to 3°, with mean absolute errors (MAE) as low as 2.5 cm and correlations as high as 0.98. We show that, at 3° spatial resolution, spatially-distributed TWS time series can be precisely reconstructed with as few as 41 water-level time series located within the basin. The proposed approach is competitive when compared to existing TWS estimates derived from physically based and computationally expensive methods. Also, a validation experiment indicates that TWS estimates can be extrapolated to periods beyond that of the model regression with low errors. The approach is robust, based on regression models and interpolation techniques, and offers a new possibility to reproduce spatially and temporally distributed TWS that could be used to fill inter-mission gaps and to extend GRACE-based TWS time series beyond its timespan.

Terrestrial water storage↗

Forming Aggregations using Virtual Sharding: Lessons Learned from Simple Scalable Storage (S3)

Data aggregation is the ability to combine separate datasets to form a single new logical dataset provides users with a powerful abstraction. The advantage of an aggregate dataset is that the users are freed from having to understand, and incorporate into their workflow, knowledge about the (ad hoc) organization of the constituent datasets. However, aggregating large numbers of files can be computationally complex with data server systems performing many repetitive operations. As part of the authors work on subsetting data stored on Amazon Web Service (AWS) Simple Storage Service (S3), we developed technology to read portions of otherwise monolithic data files. This enables the formation of virtual shards for user in subsetting data stored in HDF5 (hierarchical data format, version 5) files. This same tool can be used to form aggregations that combine data stored in many HDF5 files when those files are stored on S3. The nature of the virtual sharding and the algorithm that exploits it for subsetting is such that it can also be used for aggregation with the need for many of the repetitive operations required by the per file aggregation techniques. We will present timing information that demonstrates the flexibility of this approach. However, the lessons learned is that while this is a useful result in and of itself, these very same techniques can be applied in other contexts where data are stored in services and on media other than S3. For example, this same technique can be applied to data stored on spinning disk. Pushing the envelope for S3 forced a reexamination of our data access techniques which lead to unexpected positive benefits.

Gallagher, James↗

Jumping the Queue: From NASA to the Commercial Cloud

NASA's High-End Computing Capability (HECC) Project has made it possible for its users to run on commercial cloud resources in a seamless way. In the first of three phases, we implemented a pilot project for a few users, enabling them to “jump the queue” and burst jobs from the HECC environment to Amazon Web Services (AWS). By using GPU-accelerated nodes at AWS, the users were able to make significant advances in their research. The second phase of the project made AWS access available to all HECC users and added accounting to make users responsible for cloud charges. We are also enabling export-controlled work through the use of AWS GovCloud. In the third phase, we will add web-based mechanisms to permit non-HECC users to access cloud resources for their HPC projects.

Hood, Robert↗

Defining Handling Qualities of Unmanned Aerial Systems: Phase II Final Report

Unmanned Air Systems (UAS) are no longer coming, they are here, and operators from first responders to Google and Amazon are demanding access to the National Airspace System (NAS) for a wide variety of missions. This includes a proliferation of small UAS or sUAS that will operate beyond line of sight at altitudes of 500 ft and below. A myriad of issues continues to slow the development of verification, validation, and certification methods that will enable the safe introduction of UAS to the NAS. These issues include the lack of both a consensus in UAS categorization process and quantitative certification requirements, including the definition of handling qualities. Because of the wide variety of UAS types (fixed wing, rotary wing from traditional helicopters to multirotor configurations, ducted fans, airships, etc.) and vehicle size from micro vehicles to the Global Hawk with a wing span similar to that of a Boeing 737, there cannot be a one-size-fits-all set of requirements. To address these issues, Systems Technology Inc. (STI) has developed the UAS Handling Qualities Assessment (UAS-HQ) process and corresponding draft specification that will guide UAS stakeholders through a systematic evaluation process. The work described herein builds on the existing, highly successful, military rotorcraft handling qualities specifications that features a mission-oriented approach, a concept that originated at STI. The vehicle is first identified by a simple weight-based classification and then the associated vehicle mission task elements are considered. These missions have specific tasks inclusive to them that then dictate the criteria and demonstration maneuvers necessary to evaluate the UAS handling qualities. An assessment of both modeled responses and flight test data can then be conducted to examine the predicted versus actual handling qualities and, if required, design modifications can then be made. Mr. David Klyde, Vice President and Technical Director, Engineering Services, served as Principal Investigator, while Dr. Natalia Alexandrov served as the NASA LaRC technical representative. In the Phase II program, STI was joined by David Mitchell of Mitchell Aerospace Research and the University of Minnesota. Mr. Mitchell led the draft specification development effort, while the University of Minnesota UAV Lab conducted sUAS flight tests under the direction of Dr. Peter Seiler.

Klyde, David H.↗

Twenty‐First Century Drought Projections in the CMIP6 Forcing Scenarios

There is strong evidence climate change will increase drought risk and severity, but these conclusions depend on the regions, seasons, and drought metrics being considered. We analyze changes in drought across the hydrologic cycle (precipitation, soil moisture, and runoff) in projections from Phase Six of the Coupled Model Intercomparison Project (CMIP6). The multi‐model ensemble shows robust drying in the mean state across many regions and metrics by the end of the 21st century, even following the more aggressive mitigation pathways (SSP1‐2.6 and SSP2‐4.5). Regional hotspots with strong drying include western North America, Central America, Europe and the Mediterranean, the Amazon, southern Africa, China, Southeast Asia, and Australia. Compared to SSP3‐7.0 and SSP5‐8.5, however, the severity of drying in the lower warming scenarios is substantially reduced and further precipitation declines in many regions are avoided. Along with drying in the mean state, the risk of the historically most extreme drought events also increases with warming, by 200–300% in some regions. Soil moisture and runoff drying in CMIP6 is more robust, spatially extensive, and severe than precipitation, indicating an important role for other temperature‐sensitive drought processes, including evapotranspiration and snow. Given the similarity in drought responses between CMIP5 and CMIP6, we speculate both generations of models are subject to similar uncertainties, including vegetation processes, model representations of precipitation, and the degree to which model responses to warming are consistent with observations. These topics should be further explored to evaluate whether CMIP6 models offer reasons to have increased confidence in drought projections.

drought↗

Educational and Scientific Applications of Climate Model Diagnostic Analyzer

Climate Model Diagnostic Analyzer (CMDA) is a web-based information system designed for the climate modeling and model analysis community to analyze climate data from models and observations. CMDA provides tools to diagnostically analyze climate data for model validation and improvement, and to systematically manage analysis provenance for sharing results with other investigators. CMDA utilizes cloud computing resources, multi-threading computing, machine-learning algorithms, web service technologies, and provenance-supporting technologies to address technical challenges that the Earth science modeling and model analysis community faces in evaluating and diagnosing climate models. As CMDA technology and infrastructure have matured, we have developed the educational and scientific applications of CMDA. Educationally, CMDA supported the summer school of the JPL Center for Climate Sciences in 2014, 2015, and 2016. In the summer school, the students work on group research projects where CMDA provide datasets, analysis tools, and provenance support utility tools. Each student is assigned to a virtual machine with CMDA installed in Amazon Web Services. Scientifically, we have developed several science use cases of CMDA covering various topics, datasets, and analysis types. Each of the science use cases is described in terms of a scientific goal, datasets used, the analysis tools used, scientific results discovered, an analysis result such as output plots and data files, and a link to the corresponding analysis service call with all the input arguments filled.

Bao, Qihao↗

Evaluation of global terrestrial evapotranspiration using state-of-the-art approaches in remote sensing, machine learning and land surface modeling

Evapotranspiration (ET) is critical in linking global water, carbon and energy cycles. However, direct measurement of global terrestrial ET is not feasible. Here, we first reviewed the basic theory and state-of-the-art approaches for estimating global terrestrial ET, including remote-sensing-based physical models, machine-learning algorithms and land surface models (LSMs). We then utilized 4 remote-sensing-based physical models, 2 machine-learning algorithms and 14 LSMs to analyze the spatial and temporal variations in global terrestrial ET. The results showed that the ensemble means of annual global terrestrial ET estimated by these three categories of approaches agreed well, with values ranging from 589.6 mm/yr (6.56×10^4 cu.km/yr) to 617.1 mm/yr (6.87×10^4 cu.km/yr). For the period from 1982 to 2011, both the ensembles of remote-sensing-based physical models and machine-learning algorithms suggested increasing trends in global terrestrial ET (0.62 mm/sq.yr with a significance level of p<0.05 and 0.38 mm yr−2 with a significance level of p<0.05, respectively). In contrast, the ensemble mean of the LSMs showed no statistically significant change (0.23 mm/sq.yr, p>0.05), although many of the individual LSMs reproduced an increasing trend. Nevertheless, all 20 models used in this study showed that anthropogenic Earth greening had a positive role in increasing terrestrial ET. The concurrent small interannual variability, i.e., relative stability, found in all estimates of global terrestrial ET, suggests that a potential planetary boundary exists in regulating global terrestrial ET, with the value of this boundary being around 600 mm/yr. Uncertainties among approaches were identified in specific regions, particularly in the Amazon Basin and arid/semiarid regions. Improvements in parameterizing water stress and canopy dynamics, the utilization of new available satellite retrievals and deep-learning methods, and model–data fusion will advance our predictive understanding of global terrestrial ET.

surface modeling↗

Uncertainty Quantification of Global Net Methane Emissions From Terrestrial Ecosystems Using a Mechanistically Based Biogeochemistry Model

Quantification of methane (CH4) emissions from wetlands and its sinks from uplands is still fraught with large uncertainties. Here, a methane biogeochemistry model was revised, parameterized, and verified for various wetland ecosystems across the globe. The model was then extrapolated to the global scale to quantify the uncertainty induced from four different types of uncertainty sources including parameterization, wetland type distribution, wetland area distribution, and meteorological input. We found that global wetland emissions are 212 ± 62 and 212 ± 32 Tg CH4 year−1 (1Tg = 1012 g) due to uncertain parameters and wetland type distribution, respectively, during 2000–2012. Using two wetland distribution data sets and three sets of climate data, the model simulations indicated that the global wetland emissions range from 186 to 212 CH4 year−1 for the same period. The parameters were the most significant uncertainty source. After combining the global methane consumption in the range of −34 to −46 Tg CH4 year−1, we estimated that the global net land methane emissions are 149–176 Tg CH4 year−1 due to uncertain wetland distribution and meteorological input. Spatially, the northeast United States and Amazon were two hotspots of methane emission, while consumption hotspots were in the Eastern United States and eastern China. During 1950–2016, both wetland emissions and upland consumption increased during El Niño events and decreased during La Niña events. This study highlights the need for more in situ methane flux data, more accurate wetland type, and area distribution information to better constrain the model uncertainty.

wetland methane emission↗

Acoustic space occupancy: Combining ecoacoustics and lidar to model biodiversity variation and detection bias across heterogeneous landscapes

There is global interest in quantifying changing biodiversity in human-modified landscapes. Ecoacoustics may offer a promising pathway for supporting multi-taxa monitoring, but its scalability has been hampered by the sonic complexity of biodiverse ecosystems and the imperfect detectability of animal-generated sounds. The acoustic signature of a habitat, or soundscape, contains information about multiple taxa and may circumvent species identification, but robust statistical technology for characterizing community-level attributes is lacking. Here, we present the Acoustic Space Occupancy Model, a flexible hierarchical framework designed to account for detection artifacts from acoustic surveys in order to model biologically relevant variation in acoustic space use among community assemblages. We illustrate its utility in a biologically and structurally diverse Amazon frontier forest landscape, a valuable test case for modeling biodiversity variation and acoustic attenuation from vegetation density. We use complementary airborne lidar data to capture aspects of 3D forest structure hypothesized to influence community composition and acoustic signal detection. Our novel analytic framework permitted us to model both the assembly and detectability of soundscapes using lidar-derived estimates of forest structure. Our empirical predictions were consistent with physical models of frequency-dependent attenuation, and we estimated that the probability of observing animal activity in the frequency channel most vulnerable to acoustic attenuation varied by over 60%, depending on vegetation density. There were also large differences in the biotic use of acoustic space predicted for intact and degraded forest habitats, with notable differences in the soundscape channels predominantly occupied by insects. This study advances the utility of ecoacoustics by providing a robust modeling framework for addressing detection bias from remote audio surveys while preserving the rich dimensionality of soundscape data, which may be critical for inferring biological patterns pertinent to multiple taxonomic groups in the tropics. Our methodology paves the way for greater integration of remotely sensed observations with high-throughput biodiversity data to help bring routine, multi-taxa monitoring to scale in dynamic and diverse landscapes.

Airborne lidar↗

Applying the Cognitive Space Gateway to Swarm Topologies

NASA's future vision for interplanetary networking includes a lunar network, Cube Satellite (CubeSat) constellations, and deep space robotic missions, comprising what could be viewed as a network of networks. Delay-tolerant networking (DTN) architecture and protocols provide a standard network layer among these varying scenarios and mitigate many challenges of the space environment, such as long delays, unplanned service interruptions, and asymmetric links. The Cognitive Space Gateway (CSG) is a routing method in a DTN architecture that uses spiking neural networks as the learning element to optimize routing decisions in a complex environment. This work aims to further develop cognitive networking technologies in several critical areas, including DTN, the CSG algorithm, CubeSat swarm topologies, and cloud services. To test the algorithm in a realistic scenario, the emulated network topology is based on a CubeSat swarm. The swarm may function as a mesh of nodes or as a hub-and-spoke network. An emulation environment will be built upon a commercial cloud service, such as Amazon Web Services (AWS) Elastic Compute Cloud. The cloud environment may enable a flexible, lower maintenance approach versus a multi-hop network based in a physical laboratory. The cloud platform will provide a secure environment allowing for collaboration among government and academic entities.

Ricardo Lent↗