Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cloud platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Remote sensing cloud properties from high spectral resolution infrared observations

A technique for estimating cloud radiative properties (spectral emissivity and reflectivity) in the IR is developed based on observations at a spectral resolution of approximately 0.5/cm. The algorithm uses spectral radiance observations and theoretical calculations of the IR spectra for clear and cloudy conditions along with lidar-determined cloud-base and cloud-top pressure. An advantage of the high spectral resolution observations is that the absorption effects of atmospheric gases are minimized by analyzing between gaseous absorption lines. The technique is applicable to both ground-based and aircraft-based platforms and derives the effective particle size and associated cloud water content required to satisfy, theoretically, the observed cloud IR spectra. The algorithm is tested using theoretical simulations and applied to observations made with the University of Wisconsin's ground-based and NASA ER-2 aircraft High-Resolution Infrared Spectrometer instruments.

Smith, William L.↗

Cloud Retrieval Intercomparisons Between SEVIRI, MODIS and VIIRS with CHIMAERA PGE06 Data Collection 6 Products

The Cross-platform HIgh resolution Multi-instrument AtmosphEric Retrieval Algorithms (CHIMAERA) system allows us to perform MODIS-like cloud top, optical and microphysical properties retrievals on any sensor that possesses a minimum set of common spectral channels. The CHIMAERA system uses a shared-core architecture that takes retrieval method out of the equation when intercomparisons are made. Here we show an example of such retrieval and a comparison of simultaneous retrievals done using SEVIRI, MODIS and VIIRS sensors. All sensor retrievals are performed using CLAVR-x (or CLAVR-x based) cloud top properties algorithm. SEVIRI uses the SAF_NWC cloud mask. MODIS and VIIRS use the IFF-based cloud mask that is a shared algorithm between MODIS and VIIRS. The MODIS and VIIRS retrievals are performed using a VIIRS branch of CHIMAERA that limits available MODIS channel set. Even though in that mode certain MODIS products such as multilayer cloud map are not available, the cloud retrieval remains fully equivalent to operational Data Collection 6.

cloud retrieval↗

A Satellite Infrared Technique for Diurnal Rainfall Variability Studies

Reliable information on the distribution of precipitation at high temporal resolution (<l hour) is essential for understanding the characteristics of convection in a region. Cloud-top infrared (IR) brightness temperatures from geostationary platforms have a weak physical connection to precipitation, however, their high sampling frequency makes them attractive in studying the temporal evolution of cloudiness and convection. On the other hand, microwave-based (MW) observations from lower sampling-frequency polar-orbiting platforms can provide a better physical connection to precipitating hydrometeors. A recent invention in rainfall estimation from a combination of these two sensors involves adjustment of IR estimates using co-existing MW-based precipitation data on a monthly basis. These techniques use the MW data to remove systematic errors in IR rain estimates, while retaining the high sampling frequency of IR observations (approximately every 15-30 minutes). Perhaps of even greater importance to climate and hydrometeorological applications is the separation of mesoscale convective systems into a portion of rain associated with deep convection (hereafter called convective precipitation), and to precipitation falling from more widespread anvil clouds. This current work focuses on estimation of tropical convective and stratiform rainfall. We attempt to answer fundamental questions, such as : is estimation of convective and stratiform precipitation from IR feasible? If so, how accurate can this be? What is the scale dependence of the IR algorithm's performance? To address these questions, quantitative comparisons are performed between coincident IR- and MW-based instantaneous rainfall estimates at the MW 85 Ghz resolution (-12.5 km). Our data set spans a three-month period (January to March, 1996) of MW and IR observations over northern South America (15N-15S and 35W-80W), which includes the Amazon river basin.

Anagnostou, Emmanouil↗

Cloud fields derived from satellite and surface data during FIRE cirrus phase 2

The interpretation of surface and aircraft measurements of cloud properties taken during field programs must take into account the large-scale cloud and meteorological conditions. Cloud properties are also required at scales beyond the point and line data taken from ground and aircraft platforms. Satellite data can provide a quantitative description of these large-scale cloud properties. When derived from geostationary satellite data, the cloud fields constitute a unique source for evaluating the development and demise of a cloud system. Satellites, however, can only see the tops of clouds, so that cloud layers below the uppermost cloud deck may remain undetected resulting in a incomplete depiction of the cloud system. Some multilayer clouds are amenable to detection from satellites. Many, especially in midlatitude cyclonic systems, can only be observed from the surface. A combination of surface and satellite cloud observations should be the most complete quantification of large-scale cloudiness if there are sufficient surface measurements. During the First International Satellite Cloud Climatology Project (ISCCP) Regional Experiment Phase 2 (FIRE-2) Cirrus Intensive Field Observation (IFO) period (November 13 - December 7, 1991) conducted at Coffeyville, Kansas, cirrus observations were taken in a variety of conditions. The IFO area was selected for a variety of reasons including the relatively dense network of surface weather stations and special surface instrumentation sites. Thus, the FIRE-2 IFO presents an excellent opportunity to combine cloud observations from surface and satellite observations. This paper presents an analysis of cloud properties on a mesoscale grid using satellite cloud property retrievals, surface observer data, and rawinsonde temperature and humidity profiles.

Minnis, Patrick↗

Cloud and Radiation Mission with Active and Passive Sensing from the Space Station

A cloud and aerosol radiative forcing and physical process study involving active laser and radar profiling with a combination of passive radiometric sounders and imagers would use the space station as an observation platform. The objectives are to observe the full three dimensional cloud and aerosol structure and the associated physical parameters leading to a complete measurement of radiation forcing processes. The instruments would include specialized radar and lidar for cloud and aerosol profiling, visible, infrared and microwave imaging radiometers with comprehensive channels for cloud and aerosol observation and specialized sounders. The low altitude,. available power and servicing capability of the space station are significant advantages for the active sensors and multiple passive instruments.

Spinhirne, James D.↗

EDX Spatial: Leveraging cloud and hybrid data management resources for spatial data

In the last few years, the National Energy Technology Laboratory has started leveraging cloud-hosted services for hosting spatial data collections published on the Energy Data eXchange (EDX). Using cloud-hosted storage and compute options offers multiple benefits for visualization and tool development through utilization of spatial data resources. The transition from on-premises services to cloud-hosted services has enabled a few key features: increased accessibility of large derivative datasets, dynamic integration of external authoritative data resources directly from outside entities through representational state transfer application programming interfaces (REST API), and the ability to produce complex mapping applications, dashboards, and online maps. As a result of the shift, NETL has launched EDX Spatial, a platform that leverages on-premises resources combined with cloud compute capabilities to enable enhanced online mapping interfaces and optimize data access. In addition, a unified workflow for handling the public release of spatial data products through EDX has been developed, including standardization of data hosting practices, metadata, symbology, and application elements. This poster reviews the opportunity of leveraging cloud-hosted and hybrid data management solutions for spatial data, and discusses the benefits and lessons learned while leveraging these services through the data repository EDX.

Morkner, Paige↗

Classification of Cloud Particle Imagery and Thermodynamics (COCPIT): A New Databasing Tool for the Characterization of Cloud Particle Images Captured During DOE Field Campaigns

The Department of Energy for decades has explored the earth system and atmosphere through research and deployment of in-situ and remote sensing platforms during field campaigns. Among these datasets exists a vast supply of cloud particle images that provide visual insight into the complex microphysics in the clouds that span our globe. The millions of images collected over decades of deployments provides a unique opportunity to further our understanding of our atmosphere down to the crystal size. This work over the past 5 years has sought to organize these images into digestible datasets that can then be used by scientists to further our understanding of microphysics. A machine learning model was developed that categorizes over 1.5 million images across 11 weather events with over 90% accuracy according to particle type. The database was then extended to include dimensional characteristics of the particle as well as co-location of environmental properties, such as temperature and water content. Then, to initialize the connection between these data and our understanding of how crystals form and grow, weather research and forecasting simulations were run to generate the growth histories of the classified crystals. This research culminates with 2 databases per event: (1) a database of all classified crystals and their dimensional and environmental properties and (2) simulated growth histories of each crystal. Finally, a user interface was created to allow researchers to explore data statistics.

54 ENVIRONMENTAL SCIENCES↗

ProvLight: Efficient Workflow Provenance Capture on the Edge-to-Cloud Continuum

Modern scientific workflows require hybrid infrastructures combining numerous decentralized resources on the IoT/Edge interconnected to Cloud/HPC systems (aka the Computing Continuum) to enable their optimized execution. Understanding and optimizing the performance of such complex Edge-to-Cloud workflows is challenging. Capturing the provenance of key performance indicators, with their related data and processes, may assist in understanding and optimizing workflow executions. However, the capture overhead can be prohibitive, particularly in resource-constrained devices, such as the ones on the IoT/Edge.To address this challenge, based on a performance analysis of existing systems, we propose ProvLight, a tool to enable efficient provenance capture on the IoT/Edge. We leverage simplified data models, data compression and grouping, and lightweight transmission protocols to reduce overheads. We further integrate ProvLight into the E2Clab framework to enable workflow provenance capture across the Edge-to-Cloud Continuum. This integration makes E2Clab a promising platform for the performance optimization of applications through reproducible experiments.We validate ProvLight at a large scale with synthetic workloads on 64 real-life IoT/Edge devices in the FIT IoT LAB testbed. Evaluations show that ProvLight outperforms state-of-the-art systems like ProvLake and DfAnalyzer in resource-constrained devices. ProvLight is 26—37x faster to capture and transmit provenance data; uses 5—7x less CPU; 2x less memory; transmits 2x less data; and consumes 2—2.5x less energy. ProvLight [1] and E2Clab [2] are available as open-source tools.

Rosendo, Daniel↗

rSHUD v2.0: advancing the Simulator for Hydrologic Unstructured Domains and unstructured hydrological modeling in the R environment

Abstract. Hydrological modeling is a crucial component in hydrology research, particularly for projecting future scenarios. However, achieving reproducibility and automation in distributed hydrological modeling research for modeling, simulation, and analysis is challenging. This paper introduces rSHUD v2.0, an innovative, open-source toolkit developed in the R environment to enhance the deployment and analysis of the Simulator for Hydrologic Unstructured Domains (SHUD). The SHUD is an integrated surface–subsurface hydrological model that employs a finite-volume method to simulate hydrological processes at various scales. The rSHUD toolkit includes pre- and post-processing tools, facilitating reproducibility and automation in hydrological modeling. The utility of rSHUD is demonstrated through case studies of the Shale Hills Critical Zone Observatory in the USA and the Waerma watershed in China. The rSHUD toolkit's ability to quickly and automatically deploy models while ensuring reproducibility has facilitated the implementation of the Global Hydrological Data Cloud (https://ghdc.ac.cn, last access: 1 September 2023), a platform for automatic data processing and model deployment. This work represents a significant advancement in hydrological modeling, with implications for future scenario projections and spatial analysis.

Shu, Lele (ORCID:0000000269034466)↗

The Altus Cumulus Electrification Study (ACES): A UAV-Based Science Demonstration

The Altus Cumulus Electrification Study (ACES) is an unmanned aerial vehicle (UAV)- based project that investigated thunderstorms in the vicinity of the Florida Everglades in August 2002. ACES was conducted to investigate storm electrical activity and its relationship to storm morphology, and to validate satellite-based lightning measurements. In addition, as part of the NASA sponsored UAV-based science demonstration program, this project provided a scientifically useful demonstration of the utility and promise of UAV platforms for Earth science and applications observations. ACES employed the Altus II aircraft, built by General Atomics - Aeronautical Systems, Inc. Key science objectives simultaneously addressed by ACES are to: (1) investigate lightning-storm relationships, (2) study storm electrical budgets, and provide Lightning Imaging Sensor validation. The ACES payload included electrical, magnetic, and optical sensors to remotely characterize the lightning activity and the electrical environment within and around thunderstorms. ACES contributed important electrical and optical measurements not available from other sources. Also, the high altitude vantage point of the UAV observing platform (up to 55,000 feet) provided cloud-top perspective. By taking advantage of its slow flight speed (70 to 100 knots), long endurance, and high altitude flight, the Altus was flown near, and when possible, over (but never into) thunderstorms for long periods of time that allowed investigations to be conducted over entire storm life cycles. An innovative real time weather system was used to identify and vector the aircraft to selected thunderstorms and safely fly around these storms, while, at the same time monitor the weather near our base of operations. In addition, concurrent ground-based observations that included radar (Miami and Key West WSRBD, NASA NPOL), satellite imagery, and lightning (NALDN and Los Alamos EDOT) enable the UAV measurements to be more completely interpreted and evaluated in the context of the thunderstorm structure, evolution, and environment.

Blakeslee, R. J.↗

Using Federated Learning to Overcome Data Gravity in Space

Humans intend to take longer missions to outer space. Understanding the impact that space has on human health is paramount to the success of these missions. Controlled experiments with model organisms are run to infer the impact of space conditions on human health, but the data these experiments generate are too large to transfer to Earth for building models. The same is true for space-relevant data generated on Earth. Ideally, these datasets should be combined to improve statistical power and model accuracy without having to transfer data. Federated learning is such a method which trains an algorithm across decentralized computing systems, each of which has their own local copy of training and testing data. In this research, made possible by NASA@Work, the AI for Life in Space group at NASA demonstrates the use of federated learning to train an ensemble of causality inference models on a combination of data residing on the International Space Station (ISS) and in the cloud. Our work leverages CRISP, a causal inference platform developed during the 2020 Frontier Development Lab’s “Astronaut Health Challenge.” We also leverage the OpenFL federated learning library which was collaboratively developed at Intel and UPenn. We used publicly available data from the NASA Ames Life Sciences Data Archive to identify features in ionizing radiation experiments as causal of changes in cardiac blood velocity. This research demonstrates, for the first time, the possibility of running machine learning algorithms on datasets separated by astronomical distances. In this experiment, all the data were generated in terra, half of which were transferred to the ISS and analyzed on the Spaceborne Computer. In the future, our research will leverage federated learning on data generated in situ on the ISS with data generated terrestrially to predict the impact of spaceflight on mammalian female reproductive capacity.

James Casaletto↗

The disCO2ver Platform: Curating Data and Tools for Geologic Carbon Sequestration and Deep Subsurface Research Systems

The U.S. DOE National Energy Technology Laboratory has invested 12+ years of development into the data repository and digital laboratory, the Energy Data eXchange (EDX, edx.netl.doe.gov). Supporting a variety of research areas across the DOE Office of Fossil Energy and Carbon Management, the platform has successfully curated and preserved thousands of data products from DOE research. The Carbon Storage Program has successfully supported data curation, upload, and publishing of data products on EDX for many years, demonstrating a success story of how resources like EDX can effectively help with long term preservation and publishing of DOE data products. EDX continues to shift towards cloud-supported infrastructure, taking a hybrid approach combining on-premises compute and storage integrated with cloud-hosted services. The integration of cloud compute and hybrid architecture enables the development of EDX-hosted platforms that tailor the data and tools hosted on them to a specific community, enables implementation of machine learning tools for data discovery and filtering, and enables the hosting of virtual (online user interface) tools. Geologic carbon sequestration (GCS) research continues to scale up in response to the current administration goals to reduce greenhouse gas emissions and transition the energy economy. Over the last year, EDX’s disCO2ver platform has been developed in response to the need for access to data products and tools to support the scaling up of GCS research. disCO2ver provides access to data resources and tools, produced by DOE and outside authoritative external resources. The platform also provides a user-access control component for the virtualization and cloud hosting of tools. Tools that need to be virtualized, to eliminate the need for users to download the tool and use local compute resources, is essential to supporting big-data analysis and machine learning that is becoming common place in carbon storage modeling, risk analysis, and data publishing practices. This talk will review the EDX’s disCO2ver platform and the current work ongoing to curate data and tools to support GCS and deep subsurface systems research.

Morkner, Paige↗

Support for the Harvard University Water Vapor and Total Water Instruments for the 2004 NASA WB57 Middle Latitude Cirrus Experiment

In order to improve our understanding of the role clouds play in the climate system, NASA is investing considerable effort in characterizing clouds with instruments ranging from passive remote sensors on board the EOS platforms, to the forthcoming active remote sensors on Cloudsat and Calipso. These missions, when taken together, have the capacity to advance our understanding of the coupling between various components of the hydrologic cycle and the atmospheric circulation, and hold the additional potential of leading to significant improvements in the characterization of cloud feedbacks in global models. This is especially true considering that several of these platforms will be flown in an identical orbit within several minutes of one another-a constellation of satellites known as the A-Train. The algorithms that are being implemented and developed to convert these new data streams from radiance and reflectivity measurements into geophysical parameters invariably rely on some set of simplifymg assumptions and empirical constants. Uncertainties in these relationships lead to poorly understood random and systematic errors in the retrieved properties. This lack of understanding introduces ambiguity in interpreting the data and in using the global data sets for their intended purposes. In light of this, a series of flights with the W57F was proposed to address certain specific issues related to the basic properties of mid latitude cirrus clouds: the NASA WE357 Middle Latitude Cirrus Experiment ("MidCiX"). The science questions addressed are: 1) Can cloud property retrieval algorithms developed for A-Train active and passive remote sensing measurements accurately characterize the microphysical properties of synoptic and convectively generated cirrus cloud systems? 2) What are the relationships between the cirrus particle mass, projected area, and particle size spectrum in various genre of cirrus clouds? 3) Does the present compliment of state of the art in situ cloud probes provide the level of precision and accuracy needed to develop and validate algorithms and to contribute to our understanding of the characteristics and microphysical processes operating in cirrus clouds?

Anderson, James G.↗

Upwelling studies with satellites

Two different ways of obtaining surface temperature structures with data from an orbiting platform are: (1) Analysis of radiometric recordings during one overpass over apparently cloud-free regions has provided the surface structures of an area. This method can be used to analyze a synoptic recording and has the further advantage of noting rapid changes in the sea surface temperatures over typical scales of a few days. (2) Mapping the sea surface temperature through use of a multispectral method which detects cloud-free conditions and uses the radiation for the determination of the sea surface temperature. This method includes data recorded from orbiting platforms over a period of 2 to 4 weeks; therefore, short-time fluctuations are smoothed out. The method is applicable to map ocean surfaces on a global scale. Both methods were used to study areas in oceans where upwelling exists.

Szekielda, K.↗

In Situ Observations and Sampling of Volcanic Emissions with Unmanned Aircraft: A NASA/UCR Case Study at Turrialba Volcano, Costa Rica

Burgeoning new technology in the design and development of robotic aircraft-unmanned aerial vehicles (UAVs)-presents unprecedented opportunities for the volcanology community to observe, measure, and sample eruption plumes and drifting volcanic clouds in situ. While manned aircraft can sample dilute parts of such emissions, demonstrated hazards to air breathing, and most particularly turbine, engines preclude penetration of the zones of highest ash concentrations. Such areas within plumes are often of highest interest with respect to boundary conditions of applicable mass-loading retrieval models, as well as Lagrangian, Eulerian, and hybrid transport models used by hazard responders to predict plume trajectories, particularly in the context of airborne hazards. Before the 2010 Ejyafyallajokull eruption in Iceland, ICAO zero-ash-tolerance rules were typically followed, particularly for relatively uncrowded Pacific Rim airspace, and over North and South America, where often diversion of aircraft around ash plumes and clouds was practical. The 2010 eruption in Iceland radically changed the paradigm, in that critical airspace over continental Europe and the United Kingdom were summarily shut by local civil aviation authorities and EURO CONTROL. A strong desire emerged for better real-time knowledge of ash cloud characteristics, particularly ash concentrations, and especially for validation of orbital multispectral imaging. UAV platforms appear to provide a viable adjunct, if not a primary source, of such in situ data for volcanic plumes and drifting volcanic clouds from explosive eruptions, with prompt and comprehensive application to aviation safety and to the basic science of volcanology. Current work is underway in Costa Rica at Turrialba volcano by the authors, with the goal of developing and testing new small, economical UAV platforms, with miniaturized instrument payloads, within a volcanic plume. We are underway with bi-monthly deployments of tethered SO2-sondes and are in the planning stages for the deployment of the SIERRA UAV to our site in March 2013. We will be conducting in situ observations simultaneously with ASTER orbital multispectral TIR data acquisitions, in order to compare in situ measurements with estimates of SO2 mass loading and dispersion derived from ASTER data. Though small UAVs are now being considered for use in active volcanic areas for in situ sampling of emissions (e.g., efforts by our group, and by our colleagues at the INGV in Italy and the Applied Science University in Dusseldorf, Germany, and others in the United Kingdom and Iceland), and also for remote sensing, much more needs to be done in the way of instrument development, and in developing small UAVs for both low altitude (tropospheric) and high altitude (stratospheric) applications. In particular, the development of all weather and day/night operational flight capabilities in close proximity to hazardous topography is crucial to a truly responsive volcano in situ measurement system. Finally, it is imperative that national civil aviation authorities recognize the unique benefits of such platforms. It is important that authorities understand that severely restricting or not deploying such tools in airspace over restless volcanoes or within eruption plumes, ostensibly because of the perceived (small) risk that such unmanned aircraft pose to manned air operations, itself poses a bigger transcendental risk to proximal populations and particularly to the aviation community, itself.

Volcanic Ash Advisory Centers (VAACs)↗

XaaS: Acceleration as a Service to Enable Productive High-Performance Cloud Computing

High-performance computing (HPC) and the cloud have evolved independently, specializing their innovations into performance or productivity. Acceleration as a Service (XaaS) is a recipe to empower both fields with a shared execution platform that provides transparent access to computing resources, regardless of the underlying cloud or HPC service provider. Bridging HPC and cloud advancements, XaaS presents a unified architecture built on performance-portable containers. Here, our converged model concentrates on low-overhead, high-performance communication and computing, targeting resource-intensive workloads from climate simulations to machine learning. XaaS lifts the restricted allocation model of Function as a Service (FaaS), allowing users to benefit from the flexibility and efficient resource utilization of serverless computing while supporting long-running and performance-sensitive workloads from HPC.

97 MATHEMATICS AND COMPUTING↗

Planetary Science with Balloon-Borne Telescopes

The National Aeronautics and Space Administration (NASA) and the planetary science community have recently been exploring the potential contributions of stratospheric balloons to the planetary science field. A study that was recently concluded explored the roughly 200 or so science questions raised in the Planetary Decadal Survey report and found that about 45 of those questions are suited to stratospheric balloon based observations. In September of 2014, a stratospheric balloon mission called BOPPS (which stands for Balloon Observation Platform for Planetary Science) was flown out of Fort Sumner, New Mexico. The mission had two main objectives, first, to observe a number of planetary targets including one or more Oort cloud comets and second, to demonstrate the applicability and performance of the platform, instruments, and subsystems for making scientific measurements in support planetary science objectives. BOPPS carried two science instruments, BIRC and UVVis. BIRC is a cryogenic infrared multispectral imager which can image in the.6-5 m range using an HgCdTe detector. Narrow band filters were used to allow detection of water and CO2 emission features of the observed targets. The UVVis is an imager with the science range of 300 to 600 nm. A main feature of the UVVis instrument is the incorporation of a guide camera and a Fine Steering Mirror (FSM) system to reduce image jitter to less than 100 milliarcseconds. The BIRC instrument was used to image targets including Oort cloud comets Siding Spring and Jacques, and the dwarf planet 1 Ceres. BOPPS achieved the first ever earth based CO2 observation of a comet and the first images of water and CO2 of an Oort cloud comet (Jacques). It also made the first ever measurement of 1Ceres at 2.73 m to refine the shape of the infrared water absorption feature on that body. The UVVis instrument, mounted on its own optics bench, demonstrated the capability for image correction both from atmospheric disturbances as well as some of the residual motion from the gondola that was not addressed by the gondolas coarse pointing systems. The mission met its primary science and engineering objectives. The results of the BOPPS mission will feed into the body of science knowledge but also feed into future planning for more science from balloon-borne platforms. A notional platform called Gondola for High-Altitude Planetary Science (GHAPS) has been explored and this concept platform can address a number of important decadal questions. This paper provides a summary of the assessment of potential balloon borne observations for planetary science purposes including where potential science contributions can be expected, the necessary performance characteristics of the platform, and other features required or desired. The BOPPS mission is summarized including descriptions of the main elements and key science and engineering results. The paper then briefly describes GHAPS, and the salient features that can make it a valuable tool for future planetary observations.

Telescope↗