Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cloud platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Facilitating NASA Earth Science Data Processing Using Nebula Cloud Computing

Cloud Computing has been implemented in several commercial arenas. The NASA Nebula Cloud Computing platform is an Infrastructure as a Service (IaaS) built in 2008 at NASA Ames Research Center and 2010 at GSFC. Nebula is an open source Cloud platform intended to: a) Make NASA realize significant cost savings through efficient resource utilization, reduced energy consumption, and reduced labor costs. b) Provide an easier way for NASA scientists and researchers to efficiently explore and share large and complex data sets. c) Allow customers to provision, manage, and decommission computing capabilities on an as-needed bases

Pham, Long↗
DOE OSTI2025

Active learning path-dependent properties using a cloud-based materials acceleration platform

Solid state materials are central to many modern technologies in which a given material may be exposed to a variety of environments. The material properties often vary with the sequence of environments in an irreversible manner, resulting in a quintessential path-dependency in experimental observables. While sequential learning techniques have been effectively deployed for accelerating learning of state properties of materials, they often use a consistent environment path in all experiments. To elevate such techniques for making optimal decisions in experimental investigations of path-dependent properties, we introduce an iterated expected information gain acquisition function that optimizes over entire experimental trajectories. This approach is implemented within a cloud-based Materials Acceleration Platform architecture utilizing an event-driven stateful broker coupled with remote HELAO (Hierarchical Experimental Laboratory Automation and Orchestration) instances and an AI science manager. The platform's efficacy was demonstrated through a case study optimizing multi-step spectro-electrochemical experiments to identify optically stable potential windows in (Co–Ni–Sb)O z metal oxides. The system successfully integrated AI-driven experiment design, remote laboratory automation, and cloud-based data infrastructure, validating the platform's capability for managing complex, adaptive, path-dependent workflows in materials discovery.

Guevarra, Dan [California Institute of Technology ↗
DOE OSTI2021

Cloud forensics and incident response platform

A system, method, and device for cloud forensics and incident response is provided. In an embodiment, a computer-implemented method for performing cloud forensics and incident response includes intercepting, by a cloud incident response module (CIRM), communication between a virtual machine (VM) and a hypervisor. The method also includes extracting, by the CIRM, data from the communication between the VM and the hypervisor according to a forensic policy. Intercepting and extracting the data are transparent to the VM and to the hypervisor. Intercepting and extracting the data are independent of the VM and the hypervisor.

Urias, Vincent↗
NASA NTRSDate not supplied

Development of a Consistent Cross-Platform GEO-Satellite Cloud Mask to Support CERES

Geostationary satellites provide continuous cloud and meteorological observations over a fixed portion of the Earth’s surface, allowing them to monitor the movement of storm systems and their diurnal variation. For climate studies, geostationary observations provide valuable insight of cloud formation and evolution and how they influence the Earth’s radiation budget. The Geo-Satellite Edition 4 cloud mask (GEO Ed4) is used operationally in NASA’s Cloud and Earth’s Radiant Energy System (CERES) project to help account for diurnal variations in cloudiness on Earth’s radiation budget. The Ed4 cloud mask was applied to imager data on MSG (MeteoSat Second Generation), Himawari, GOES-West, and GOES-East satellites using as much spectral information as possible. That approach led to some discontinuities when a more modern satellite replaced an older satellite with less spectral information. A different strategy is being investigated for the CERES GEO Ed5 cloud mask that only uses spectral channels common on every satellite. Thus, a 3-channel (0.6, 3.9, 11 µm) algorithm for daytime cloud detection, and a 2-channels (3.9 and 11 µm) algorithm for nighttime cloud detection have been implemented and tested for Ed5. The goal of Ed5 cloud mask is to achieve global cloud amount consistency across five geo-satellites, and a smooth transition from an old satellite to a new satellite over each geo-location. This paper compares cloud mask results between Ed4 and a preliminary Ed5 version over the GOES-East region, using GOES-8, GOES-13, and GOES-16 satellites, each with a different spectral channel complement. Instantaneous and monthly regional mean inter-comparisons are performed and evaluated with CALIPSO cloud products to assess the accuracy and consistency of the Ed5 approach relative to that taken in Ed4. Results will be presented and discussed at the conference.

clouds↗
NASA NTRS2015

Lidar Measurements of Wind and Cloud Around Venus from an Orbiting or Floating/flying Platform

Given the presence of clouds and haze in the upper portion of the Venus atmosphere, it is reasonable to consider a Doppler wind lidar (DWL) for making remote measurements of the 3-dimensional winds within the tops of clouds and the overlying haze layer. Assuming an orbit altitude of 250 kilometers and cloud tops at 60 kilometers (within the upper cloud layer), an initial performance assessment of an orbiting DWL was made using a numerical instrument and atmospheres model developed for both Earth and Mars. It is reasonable to expect vertical profiles of the 3-dimensional wind speed with 1 kilometer vertical resolution and horizontal spacing of 25 kilometers to several 100 kilometers depending upon the desired integration times. These profiles would begin somewhere just below the tops of the highest clouds and extend into the overlying haze layer to some to-be-determined height. Getting multiple layers of cloud returns is also possible with no negative impact on velocity measurement accuracy. The knowledge and expertise for developing coherent Doppler wind lidar technologies and techniques, for Earth related mission at NASA Langley Research Center is being leveraged to develop an appropriate system suitable for wind measurement around Venus. We are considering a fiber-laser-based lidar system of high efficiency and smaller size and advancing the technology level to meet the requirements for DWL system for Venus from an orbiting or floating/flying platform. This presentation will describe the concept, simulation and technology development plan for wind and cloud measurements on Venus.

Singh, Upendra N.↗
NASA NTRS2016

NGAP: A (Brief) Update PaaS, IaaS, Onbording, and the Future

NASA ESDIS has charged the EED2 program with delivering a NASA-compliant, secure, cloud-based platform for application hosting. More than just a move to the cloud, this has forced us to examine all aspects of application hosting, from resource management to system administration, patching to monitoring, deployment to multiple environments. The result of this mandate is NGAP, the NASA General Application Platform. In this presentation, we will also discuss the various applications we are supporting and targeting, and their architectures including NGAPs move to support both PaaS and IaaS architectures.

PaaS↗
DOE OSTI2022

MultiProBE Software Platform

MultiProBE Software Platform is cloud based multi-omic data repository and data processing compute platform.

Wright, Devin↗
NASA NTRS2021

Precipitable Water Vapor Variation in the Clear-Cloud Transition Zone From the ARM Shortwave Spectrometer

A new technique to retrieve precipitable water vapor (PWV)amount in the clear-cloud transition zone using ground-based zenith spectral radiance is developed. The method uses zenith radiances at the water vapor band at 720 nm and adjacent non-absorbing band at 750 nm.Radiative transfer calculations show that the relative difference in zenith radiance between the two bands depends on PWV and the variations in cloud optical depth introduce a small change in the relative difference which is independent of PWV amount. This allows us to retrieve PWV variations in the cloud-clear transition zone for clouds over dark ocean surface. We applied this method to a Cu cloud case with zenith radiance observations by the Shortwave Array Spectroradiometer-Zenith (SASZe) during the Marine ARM GPCI Investigation of Clouds (MAGIC) field campaign. We found that there is about 10% change in PWV amount from known-cloudy region to known-clear sky in cloud edges.

Atmosphere↗
NASA NTRS2016

First Transmitted Hyperspectral Light Measurements and Cloud Properties from Recent Field Campaign Sampling Clouds Under Biomass Burning Aerosol

We present a first view of data collected during a recent field campaign aimed at measuring biomass burning aerosol above clouds from airborne platforms. The NASA ObseRvations of CLouds above Aerosols and their intEractionS (ORACLES) field campaign recently concluded its first deployment sampling clouds and overlying aerosol layer from the airborne platform NASA P3. We present results from the Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR), in conjunction with the Solar Spectral Flux Radiometers (SSFR). During this deployment, 4STAR sampled transmitted solar light either via direct solar beam measurements and scattered light measurements, enabling the measurement of aerosol optical thickness and the retrieval of information on aerosol particles in addition to overlying cloud properties. We focus on the zenith-viewing scattered light measurements, which are used to retrieve cloud optical thickness, effective radius, and thermodynamic phase of clouds under a biomass burning layer. The biomass burning aerosol layer present above the clouds is the cause of potential bias in retrieved cloud optical depth and effective radius from satellites. We contrast the typical reflection based approach used by satellites to the transmission based approach used by 4STAR during ORACLES for retrieving cloud properties. It is suspected that these differing approaches will yield a change in retrieved properties since light transmitted through clouds is sensitive to a different cloud volume than reflected light at cloud top. We offer a preliminary view of the implications of these differences in sampling volumes to the calculation of cloud radiative effects (CRE).

airborne↗
DOE OSTI2022

Intercomparison of airborne and surface-based measurements during the CLARIFY, ORACLES and LASIC field experiments

Data are presented from intercomparisons between two research aircraft, the FAAM BAe-146 and the NASA Lockheed P3, and between the BAe-146 and the surface-based DOE (Department of Energy) ARM (Atmospheric Radiation Monitoring) Mobile Facility at Ascension Island (8 S, 14.5W, a remote island in the mid-Atlantic). These took place from 17 August to 5 September 2017, during the African biomass burning season. The primary motivation was to give confidence in the use of data from multiple platforms with which to evaluate numerical climate models. The three platforms were involved in the CLouds-Aerosol-Radiation Interaction and Forcing for Year 2017 (CLARIFY-2017), ObseRvations of Aerosols above CLouds and their intEractionS (ORACLES), and Layered Atlantic Smoke and Interactions with Clouds (LASIC) field experiments. Comparisons from flight segments on six days where the BAe-146 flew alongside the ARM facility on Ascension Island are presented, along with comparisons from wing-tip to wing-tip flight of the P3 and BAe-146 on 18 th August 2017. The intercomparison flight sampled a relatively clean atmosphere overlying a moderately polluted boundary layer, while the 6 fly-bys of the ARM site sampled both clean and polluted conditions 2–4 km upwind. We compare and validate characterisations of aerosol physical, chemical, and optical properties, atmospheric radiation, and cloud microphysics between platforms. We assess the performance of measurement instrumentation in the field, under conditions where sampling conditions are not tightly controlled as in laboratory measurements where calibrations are performed. Solar radiation measurements compared well between airborne platforms. Optical absorption coefficient measurements compared well across all three platforms, even though absolute magnitudes were often low (< 10 Mm -1 ) and close to the sensitivity limits of measurement instrumentation thereby confounding assessments of the comparability of absorption Ångström exponent characterisations. Aerosol absorption measurements from airborne platforms were more comparable than aircraft-to-ground observations. Scattering coefficient observations compared well between airborne platforms, but agreement with ground-based measurements was worse, potentially caused by small differences in sampling conditions or actual aerosol population differences. Chemical composition measurements followed a similar pattern, with better comparisons between the airborne platforms. Thermodynamics, aerosol, and cloud microphysical properties generally compared well.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Classification of Cloud Particle Imagery from Aircraft Platforms Using Convolutional Neural Networks

Abstract A vast amount of ice crystal imagery exists from a variety of field campaign initiatives that can be utilized for cloud microphysical research. Here, nine convolutional neural networks are used to classify particles into nine regimes on over 10 million images from the Cloud Particle Imager probe, including liquid and frozen states and particles with evidence of riming. A transfer learning approach proves that the Visual Geometry Group (VGG-16) network best classifies imagery with respect to multiple performance metrics. Classification accuracies on a validation dataset reach 97% and surpass traditional automated classification. Furthermore, after initial model training and preprocessing, 10 000 images can be classified in approximately 35 s using 20 central processing unit cores and two graphics processing units, which reaches real-time classification capabilities. Statistical analysis of the classified images indicates that a large portion (57%) of the dataset is unusable, meaning the images are too blurry or represent indistinguishable small fragments. In addition, 19% of the dataset is classified as liquid drops. After removal of fragments, blurry images, and cloud drops, 38% of the remaining ice particles are largely intersecting the image border (≥10% cutoff) and therefore are considered unusable because of the inability to properly classify and dimensionalize. After this filtering, an unprecedented database of 1 560 364 images across all campaigns is available for parameter extraction and bulk statistics on specific particle types in a wide variety of storm systems, which can act to improve the current state of microphysical parameterizations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

PipeSight: A High-Performance Computing Platform for Pipeline Integrity Management

The Phase I feasibility study completed as part of this project has led to a number of innovative technologies being developed and has laid the foundation for a successful Phase II effort to commercialize a platform for managing the integrity of pipelines for the damage mechanisms of the new, hybrid-energy based economy. To ground the development efforts and direction of the project, an extensive market research and customer discovery effort was undertaken early in Phase I. Through this effort, a number of pipeline owners and operators were interviewed, and the following key findings were discovered about the pipeline industry: • Small pipeline operators do not have the central engineering groups necessary to perform their own independent analysis of inspection data, but instead rely on summarized tally sheets provided to them by inspection service providers. • The time it takes to go from an inspection to a completed engineering assessment, even for small segments of pipeline, can take anywhere from 30-120 days. During this delay, critical threats can (and have been known to) cause failures. • Uncertainty is often not accounted for in the assessment of pipeline integrity. The tally sheets provided by third-party service providers are almost always deterministic in nature, identifying threats that present a concern only to the current (not the future) integrity of the pipeline. • It is uncommon to apply the latest technologies to perform advanced assessments of damaged pipelines. There is a desire to use more advanced analysis capabilities to assess threats. Many pipeline operators indicated that they would often excavate a pipeline to perform an inspection and find that the damage was not as bad as they anticipated, thus using limited resources unnecessarily. Companies are not consistent in their use of inspection data to determine corrosion rates, and those that do only calculate deterministic corrosion rates. • The industry has prominently relied on time-based inspections but has recently started to transition to risk-based inspections. However, there appears to be no uniform guidance on how to do so while properly accounting for all sources of uncertainty. • Companies are not storing inspection data in a manner that allows for the ready determination of temporal trends. • Predictive maintenance principles and practices are beginning to be used by early adopters • Some pipelines are being re-purposed to transport different process fluids than they were designed for, e.g., H 2 and CO 2 rich process streams to serve the new hybrid-energy based economy, which are presenting new integrity concerns for the existing pipeline network that crisscrosses the United States. As a result of these discoveries, we were able to target the development efforts in Phase I to best serve the needs of the industry. In Phase I, we developed a way to correlate multiple large-scale scans of the pipeline to determine a probabilistic corrosion rate that accounts for all sources of error and uncertainty in the inspection process. This probabilistic corrosion rate can be used to predict the future thickness distribution of the pipe wall. We demonstrate how this analysis may be performed in an analytical fashion and has been implemented in such a manner that it can be readily distributed using GPU computing through integration of the Kokkos programming model. We also make a very novel extension of the analytical corrosion rate model to Bayesian Networks (an explainable AI technique) that can account for non-parametric distributions of corrosion rates. With the predictions made above for the probabilistic corrosion rate and corresponding future distribution of the pipe wall thickness, we can assess the integrity of the pipeline through the use of a probabilistic engineering assessment. We developed a novel screening data analysis approach that can rapidly identify ‘hotspots’ (local thin areas) where the integrity of the pipeline is a concern. Once more, we implemented this screening approach in C++ to leverage GPU computing via the Kokkos programming model. After the critical hotspots are identified, we developed a program that can automatically generate an advanced finite element model of the damaged regions. Since the number of damaged regions that require advanced analysis can number in the thousands, we integrated an open-source container-native workflow engine for orchestrating parallel jobs on the cloud. Initially, these advanced numerical models were only designed to account for loading due to internal pressure. However, in a slight pivot from the initial Phase I proposal, we developed a complete pipe stress analysis program (called Simflex) which can simulate the complete pipeline and its response to thermal expansion, pressure, thermal bowing, weight, wind, earthquake, support displacement, support friction and external forces. This pipe stress analysis program was written generically, to handle any piping system, but contains the features needed to model long pipelines (i.e., it incorporates a model for soil mechanics and can account for the nonlinear boundary conditions necessary to simulate long underground pipelines). This pipe stress analysis program can simulate any segment of the pipeline (simple or complex) under any set of conditions and loads, to determine the supplemental loads (axial forces and bending moments) at the location of damage. This enables the most accurate state of stress to be accounted for in the pipeline, which can prove critical when evaluating the integrity of a damaged region. In the process of developing the technologies to perform the integrity assessment of the pipeline, we also extended one of the industry standard approaches for performing the assessment of local thin areas that extend more in the circumferential direction than the longitudinal direction of the pipeline. This approach was presented to the API 579-1/AS ME FFS-1 steering committee in November 2021 for consideration in the next edition of the industry standard for Fitness-For-Service (expected to be released in 2023). To help pipeline operators make decisions with the results on any integrity assessment, we developed a new approach to the life-cycle management of pipelines which uses a Bayesian Decision Network. The network is designed to help pipeline operators plan and prioritize inspection activities and ultimately make smarter, more cost-effective decisions. The Bayesian approach accounts for all sources of uncertainty and carries them through to the final optimal decisions, providing a probabilistic framework for optimizing inspection intervals. The proof-of-concept networks developed in the feasibility study are complete, verified, and are focused on a subset of the pipeline. To expand this novel approach to the scale necessary for an entire network of pipelines in Phase II, we will leverage the DOE-funded Bengi solver for industrial-scale decision making with Bayesian Networks [22]. Once implemented, we will be able to provide the pipeline industry with a much-needed tool for optimal inspection planning using truly explainable artificial intelligence (XAI). To handle all of these advanced capabilities into a cloud-based platform, the architecture of the Equity Engineering Cloud (EEC) was extended to include Argo Workflows, a framework capable of distributing and managing a massive number of jobs that consume their own resources, such that thousands of serial finite element simulations can be run in parallel. As part of this substantial undertaking, we also integrated Argo Continuous Delivery (CD) into the EEC, to aid with the rapid prototyping and iterations that will be imperative to the success of the PipeSight platform’s Agile development process in Phase II. As part of the pipe stress analysis program, we also developed a custom visualizer that leverages the DOE-funded VTK visualization library. We added custom contouring capabilities and a means for interacting visually with both the inputs and outputs of the pipe stress analysis program. We also developed routines for automating the post-processing of the finite element simulations to determine if any failure criteria are met and to visualize the deformations, stresses and strains in ParaView using the exodus II file format (a subset of netCDF).

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2004

Multi-Spectral Cloud Retrievals from Moderate Image Spectrometer (MODIS)

MODIS observations from the NASA EOS Terra spacecraft (1030 local time equatorial sun-synchronous crossing) launched in December 1999 have provided a unique set of Earth observation data. With the launch of the NASA EOS Aqua spacecraft (1330 local time crossing! in May 2002: two MODIS daytime (sunlit) and nighttime observations are now available in a 24-hour period allowing some measure of diurnal variability. A comprehensive set of remote sensing algorithms for cloud masking and the retrieval of cloud physical and optical properties has been developed by members of the MODIS atmosphere science team. The archived products from these algorithms have applications in climate modeling, climate change studies, numerical weather prediction, as well as fundamental atmospheric research. In addition to an extensive cloud mask, products include cloud-top properties (temperature, pressure, effective emissivity), cloud thermodynamic phase, cloud optical and microphysical parameters (optical thickness, effective particle radius, water path), as well as derived statistics. An overview of the instrument and cloud algorithms will be presented along with various examples, including an initial analysis of several operational global gridded (Level-3) cloud products from the two platforms. Statistics of cloud optical and microphysical properties as a function of latitude for land and Ocean regions will be shown. Current algorithm research efforts will also be discussed.

Platnick, Steven↗
NASA NTRSDate not supplied

Joint ESA-NASA Multi-Mission Algorithm and Analysis Platform (MAAP)

The scientific community is faced with a need for greatly improved data sharing, analysis, visualization and advanced collaboration based firmly on open science principles. Recent and upcoming launches of new satellite missions with more complex and voluminous data, as well as the ever more urgent need to better understand the global carbon budget and related ecological processes, provided the immediate rational for the ESA-NASA Multi-mission Algorithm and Analysis Platform (MAAP). This highly collaborative joint project of ESA and NASA established a framework between ESA and NASA to share data, science algorithms and compute resources in order to foster and accelerate scientific research conducted by ESA and NASA EO data users. Presented to the public in October 2021, the current version of MAAP provides a common cloud-based platform with computing capabilities co-located with the data, a collaborative coding and analysis environment, and a set of interoperable tools and algorithms developed to support the estimation and visualization of global above-ground biomass. Data from the Global Ecosystem Dynamics Investigation (GEDI) mission on the International Space Station and the Ice, Cloud, and Land Elevation Satellite-2 (ICESat-2) have been instrumental in the first products of MAAP including the first comprehensive map of Boreal above-ground Biomass and a current Global Biomass Harmonization Activity, but the platform is also being specifically designed to support the forthcoming ESA Biomass mission and incorporate data from the upcoming NASA-ISRO SAR (NISAR) mission. While these missions and the corresponding research which includes airborne, field, and calibration/validation data collection and analyses, provide a wealth of data and information relating to global biomass estimation, they also present data storing, processing and sharing challenges. The NISAR mission alone will produce about 80TB/day. These large data volumes present a challenge that would otherwise place accessibility limits on the scientific community and impact scientific progress. Other challenges being addressed by MAAP include: 1) Enabling researchers to easily discover, process, visualize and analyze large volumes of data from both agencies; 2) Providing a wide variety of data in the same coordinate reference frame to enable comparison, analysis, data evaluation, and data generation; 3) Providing a version-controlled science algorithm development environment that supports tools, co-located data and processing resources; and 4) Addressing intellectual property and sharing challenges related to collaborative algorithm development and sharing of data and algorithms. MAAP products can be explored on the MAAP Dashboard at https://earthdata.nasa.gov/maap-biomass or the joint platform entrance at scimaap.net. MAAP also can be accessed through individual NASA (https://maap-project.org) and ESA (https://esa-maap.org/) landing pages.

cloud computing↗
DOE OSTI2026

How Cloud is Accelerating Research at NREL

This presentation coincides with AWS's announcement of their new Parallel Computing Service (PCS) which allows for easy creation of HPC-style clusters in their AWS cloud computing platform. I helped them beta test this service before it was made generally available in August. AWS asked if we would be interested in discussing our experience with the PCS service, and our experience with HPC workloads in the cloud in general, so this slideshow discusses a brief history of scientific computing at NREL and shares a bit of our experiences and approach to utilizing cloud services for HPC-style workloads.

97 MATHEMATICS AND COMPUTING↗