Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Cloud Computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

Radiative Heating Profiles over Ascension Island during the 2016 and 2017 Biomass Burning Seasons

Marine boundary layer clouds, including the transition from stratocumulus to cumulus, are poorly represented in numerical weather prediction and general circulation models. In many cases, the complex physical relationships between cloud morphology and the environmental conditions in which marine boundary layer clouds exist are not well understood. Such uncertainties arise in the presence of biomass burning carbonaceous aerosol, as is the case over the southeast Atlantic Ocean, where it is likely that the absorbing and heating properties of these aerosols modify the microphysical composition and macrophysical arrangement of marine stratocumulus and trade cumulus. The deployment of the Atmospheric Radiation Measurement Mobile Facility #1 (AMF1) in support of LASIC (Layered Atlantic Smoke Interactions with Clouds) provided a unique opportunity to observe thermodynamic, cloud and aerosol properties during two consecutive biomass burning seasons from July through October of 2016 and 2017 over Ascension Island (7.96 S, 14.35 W). These observations in conjunction with radiation transfer modeling were used to assess the impact of biomass burning carbonaceous aerosol plumes as they passed over the site.Thermodynamic profiles were generated using a combination of radiosonde data and thermodynamic profilers to provide high temporal resolution profiles of quantities that are important for cloud development, such as CAPE and CIN. Coincident Ka-band radar and lidar profiles were used to characterize the cloud and sub-cloud structure. The resulting thermodynamic and cloud profiles are used as input forcing for the Rapid Radiative Transfer Model (RRTM) to compute radiative heating profiles over the observation site. Idealized experiments using RRTM, with and without aerosols present, are used to assess the impacts of the absorbing aerosol on the heating rate profiles.

Cumulus↗
DOE OSTI2015

Efficient Parallel Discrete Event Simulation on Cloud/Virtual Machine Platforms

Cloud and Virtual machine (VM) technologies present new challenges with respect to performance and monetary cost in executing parallel discrete event simulation (PDES) applications. Due to the introduction of overall cost as a metric, the traditional use of the highest-end computing configuration is no longer the most obvious choice. Moreover, the unique runtime dynamics and configuration choices of Cloud and VM platforms introduce new design considerations and runtime characteristics specific to PDES over Cloud/VMs. Here, an empirical study is presented to guide an understanding of the dynamics, trends, and trade-offs in executing PDES on Cloud/VM platforms. Performance and cost measures obtained from multiple PDES applications executed on the Amazon EC2 Cloud and on a high-end VM host machine reveal new, counterintuitive VM--PDES dynamics and guidelines. One of the critical aspects uncovered is the fundamental mismatch in hypervisor scheduler policies designed for general cloud workloads versus the virtual time ordering needed for PDES workloads. This insight is supported by experimental data revealing the gross deterioration in PDES performance traceable to VM scheduling policy. To overcome this fundamental problem, the design and implementation of a new deadlock-free scheduler algorithm are presented, optimized specifically for PDES applications on VMs. The scalability of our scheduler has been tested up to 128 VMs multiplexed on 32 cores, showing significant improvement in the runtime relative to the default Cloud/VM scheduler. The observations, algorithmic design, and results are timely for emerging cloud/VM-based installations, highlighting the need for PDES-specific support in high performance discrete event simulations on Cloud/VM platforms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Scalability Testing Approach for Internet of Things for Manufacturing SQL and NoSQL Database Latency and Throughput

The proliferation of low-cost sensors and industrial data solutions has continued to push the frontier of manufacturing technology. Machine learning and other advanced statistical techniques stand to provide tremendous advantages in production capabilities, optimization, monitoring, and efficiency. The tremendous volume of data gathered continues to grow, and the methods for storing the data are critical underpinnings for advancing manufacturing technology. This work aims to investigate the ramifications and design tradeoffs within a decoupled architecture of two prominent database management systems (DBMS): sql and NoSQL. A representative comparison is carried out with Amazon Web Services (AWS) DynamoDB and AWS Aurora MySQL. The technologies and accompanying design constraints are investigated, and a side-by-side comparison is carried out through high-fidelity industrial data simulated load tests using metrics from a major US manufacturer. The results support the use of simulated client load testing for comparing the latency of database management systems as a system scales up from the prototype stage into production. As a result of complex query support, MySQL is favored for higher-order insights, while NoSQL can reduce system latency for known access patterns at the expense of integrated query flexibility. Here, by reviewing this work, a manufacturer can observe that the use of high-fidelity load testing can reveal tradeoffs in IoTfM write/ingestion performance in terms of latency that are not observable through prototype-scale testing of commercially available cloud DB solutions.

AWS↗
NASA NTRS1975

Interstellar clouds containing optically thin H2

The theory of Black and Delgarno that the relative populations of the excited rotational levels of H2 can be understood in terms of cascading following absorption in the Lyman and Werner bands is employed to infer the gas densities and radiation fields within diffuse interstellar clouds containing H2 that is optically thin in those bands. The procedure is described for computing the populations of the different rotation levels, the relative distribution among the different rotation levels of newly formed H2 is determined on the basis of five simplified models, and the rate of H2 formation is estimated. The results are applied to delta Ori, two components of iota Ori, the second components of rho Leo and zeta Ori, tau Sco, gamma Vel, and zeta Pup. The inferred parameters are summarized for each cloud.

Jura, M.↗
DOE OSTI2020

Summertime Post-Cold-Frontal Marine Stratocumulus Transition Processes over the Eastern North Atlantic

Abstract Marine boundary layer (MBL) cloud morphology associated with two summertime cold fronts over the eastern North Atlantic (ENA) is investigated using high-resolution simulations from the Weather Research and Forecasting (WRF) Model and observations from the Atmospheric Radiation Measurement (ARM) ENA Climate Research Facility. Lagrangian trajectories are used to study the evolution of post-cold-frontal MBL clouds from solid stratocumulus to broken cumulus. Clouds within specified domains in the vicinity of transitions are classified according to their degree of decoupling, and cloud-base and cloud-top breakup processes are evaluated. The Lagrangian derivative of the surface latent heat flux is found to be strongly correlated with that of the cloud fraction at cloud base in the simulations. Cloud-top entrainment instability (CTEI) is shown to operate only in the decoupled MBL. A new indicator of inversion strength at cloud top that employs the vertical gradients of equivalent potential temperature and saturation equivalent potential temperature, which can be computed directly from soundings, is proposed as an alternative to CTEI. Overall, results suggest that the deepening–warming hypothesis suggested by Bretherton and Wyant explains many of the characteristics of the summertime postfrontal MBL evolution of cloud structure over the ENA, thereby widening the phase space over which the hypothesis may be applied. A subset of the deepening–warming hypothesis involving warming initially dominating over moistening is proposed. It is postulated that changes in climate change–induced modifications in cold-frontal structure over the ENA may be accompanied by coincident changes in the location and timing of MBL cloud transitions in the post-cold-frontal environment.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

EPiC-GAN: Equivariant point cloud generation for particle jets

With the vast data-collecting capabilities of current and future high-energy collider experiments, there is an increasing demand for computationally efficient simulations. Generative machine learning models enable fast event generation, yet so far these approaches are largely constrained to fixed data structures and rigid detector geometries. In this paper, we introduce EPiC-GAN - equivariant point cloud generative adversarial network - which can produce point clouds of variable multiplicity. This flexible framework is based on deep sets and is well suited for simulating sprays of particles called jets. The generator and discriminator utilize multiple EPiC layers with an interpretable global latent vector. Crucially, the EPiC layers do not rely on pairwise information sharing between particles, which leads to a significant speed-up over graph- and transformer-based approaches with more complex relation diagrams. We demonstrate that EPiC-GAN scales well to large particle multiplicities and achieves high generation fidelity on benchmark jet generation tasks.

Buhmann, Erik↗
DOE OSTI2018

Quantum Computing [Slides]

Introduction: At the last CHEP we heard a talk about Quantum Computing from a hardware perspective.; Jim is a software algorithm person and he will concentrate more on that.; 20 months is a long time in Quantum Information Science, QIS; The Josephson Junction technology we heard about then has evolved as predicted and we now have “mid-range” devices available on the cloud.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1999

Determination of Thunderstorm Anvil Ice Contents and Other Cloud Properties from Satellite Observations of Lightning

The lightning frequency model developed by Baker, Christian and Latham (1995) has been refined and extended, in an effort to provide a more realistic framework from which to examine computationally the relationships that might exist between lightning frequency f (which is now being routinely measured from satellites, using NASA/MSFC devices) and a variety of cloud physical parameters, including precipitation rate, updraught speed and non-precipitating ice content. The charging mechanism incorporated into the model is the non-inductive ice-ice mechanism - involving rebounding collisions between ice crystals and growing graupel pellets - which has achieved significant field, laboratory and modelling support in recent years. Model results indicate the existence of a simple relationship between lightning frequency f and the upward flux of ice crystals into the thunderstorm anvil. It follows that, for a particular situation, one can assign a specific mass of non-precipitating ice to an individual lightning stroke. Therefore it is possible - using satellite measurements of global lightning - to estimate the atmospheric loading of ice crystals in thunderstorm anvils: a parameter of climatological importance. One can also estimate the ice crystal loading associated with more localized storm systems. Early results from this work will be presented, together with further work on the relationships between f and other thundercloud parameters.

Blyth, Alan M.↗
NASA NTRS1999

Determination of Thunderstorm Anvil Ice Contents and Other Cloud Properties from Satellite Observations of Lightning

The lightning frequency model developed by Baker, Christian and Latham (1995) has been refined and extended, in an effort to provide a more realistic framework from which to examine computationally the relationships that might exist between lightning frequency f (which is now being routinely measured from satellites, using NASA/MSFC devices) and a variety of cloud physical parameters, including precipitation rate, updraught speed and non-precipitating ice content. Model results indicate the existence of a simple relationship between lightning frequency f and the upward flux of ice crystals into the thunderstorm anvil. It follows that, for a particular situation, one can assign a specific mass of non-precipitating ice to an individual lightning stroke. Therefore it may prove possible - using satellite measurements of global lightning - to estimate the atmospheric loading of ice crystals in thunderstorm anvils: a parameter of climatological importance. Early results from this work are presented, together with further studies of the relationships between f and other thundercloud parameters.

Blyth, Alan M.↗
DOE OSTI2016

TH-AB-202-08: A Robust Real-Time Surface Reconstruction Method On Point Clouds Captured From a 3D Surface Photogrammetry System

Purpose: Surface photogrammetry (e.g. VisionRT, C-Rad) provides a noninvasive way to obtain high-frequency measurement for patient motion monitoring in radiotherapy. This work aims to develop a real-time surface reconstruction method on the acquired point clouds, whose acquisitions are subject to noise and missing measurements. In contrast to existing surface reconstruction methods that are usually computationally expensive, the proposed method reconstructs continuous surfaces with comparable accuracy in real-time. Methods: The key idea in our method is to solve and propagate a sparse linear relationship from the point cloud (measurement) manifold to the surface (reconstruction) manifold, taking advantage of the similarity in local geometric topology in both manifolds. With consistent point cloud acquisition, we propose a sparse regression (SR) model to directly approximate the target point cloud as a sparse linear combination from the training set, building the point correspondences by the iterative closest point (ICP) method. To accommodate changing noise levels and/or presence of inconsistent occlusions, we further propose a modified sparse regression (MSR) model to account for the large and sparse error built by ICP, with a Laplacian prior. We evaluated our method on both clinical acquired point clouds under consistent conditions and simulated point clouds with inconsistent occlusions. The reconstruction accuracy was evaluated w.r.t. root-mean-squared-error, by comparing the reconstructed surfaces against those from the variational reconstruction method. Results: On clinical point clouds, both the SR and MSR models achieved sub-millimeter accuracy, with mean reconstruction time reduced from 82.23 seconds to 0.52 seconds and 0.94 seconds, respectively. On simulated point cloud with inconsistent occlusions, the MSR model has demonstrated its advantage in achieving consistent performance despite the introduced occlusions. Conclusion: We have developed a real-time and robust surface reconstruction method on point clouds acquired by photogrammetry systems. It serves an important enabling step for real-time motion tracking in radiotherapy. This work is supported in part by NIH grant R01 CA169102-02.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

The Impact of Circumsolar Diffuse Radiation on the Numerical Computation and Forecasting of DNI

Weather Research and Forecasting model with solar extensions (WRF-Solar) uses the Fast All-sky Radiation Model for Solar applications (FARMS) to predict solar radiation from the forecasted atmospheric gases, aerosols, and clouds. The Beer-Bouguer-Lambert law utilized by FARMS as well as other radiative transfer models assumes Direct Normal Irradiance (DNI) is a narrow beam only covering the sun disk. This assumption is interpreted differently in solar observations by pyrheliometers where the circumsolar diffuse radiation is accounted. This study precisely computes circumsolar diffuse radiation in all-sky conditions using a radiative transfer model based on a parameterization of precomputed cloud transmittance and reflectance. The model is implemented in WRF-Solar to provide day-ahead DNI forecast in the north America. The computation and forecasting of DNI is compared with the Beer-Bouguer-Lambert law to understand the impact of circumsolar diffuse radiation.

aerosols↗
NASA NTRS2017

Characterizing Response Versus Scan-Angle for MODIS Reflective Solar Bands Using Deep Convective Clouds

MODIS consists of a cross-track, two-sided scan mirror, whose reflectance is not uniform but is a function of angle of incidence (AOI). This feature, known as response versusscan-angle (RVS), was characterized for all reflective solar bands of both MODIS instruments prior to launch. The RVS characteristic has changed on orbit, which must be tracked precisely over time to ensure the quality of MODIS products. The MODIS characterization support team utilizes the onboard calibrators and the earth view responses from multiple pseudo invariant desert sites to track the RVS changes at different AOIs. The drawback of using deserts is the assumption that these sites are radiometrically stable during the monitoring period. In addition, the 16-day orbit repeat cycle of MODIS allows for only a limited set of AOIs over a given desert. We propose a novel and robust approach of characterizing the MODIS RVS using tropical deep convective clouds (DCC). The method tracks the monthly DCC response at specified sets of AOIs to compute the temporal RVS changes. Initial results have shown that the Aqua-MODIS collection 6 band 1 level 1B radiances show considerable residual RVS dependencies, with long-term drifts up to 2.3 at certain AOIs.

Clouds↗
DOE OSTI2024

Enhancing Cloud Cybersecurity: Prescriptive Controls for Operational Technology

This whitepaper provides strategic insights and recommendations into security cloud-based solutions for electric utilities, encompassing operational technology (OT), virtual power plants (VPP), distributed energy resources (DERs), applications, networks, and data storage as they transition to and leverage cloud infrastructure through managed service providers (MSPs) and cloud service providers (CSPs). Principles derived from established frameworks serve as a foundation for best practices across cybersecurity projects and remove the constraints of settling on a single framework. For organizations that prefer not to integrate a specific framework altogether, elements of the proposed approach could be adopted or tailored to best fit defined requirements and expected functionalities. The Cirrus assessment, a utility cloud feasibility tool, and the roadmap it provides serve as a precursor to this paper, which seeks to be a valuable resource for defining next steps following cloud technology integration feasibility appraisal. With its comprehensive approach to adoption, the Cirrus framework offers strategic guidance on responsibly preparing for or deploying a utility cloud solution. The previously published whitepaper, “Use Case-Informed Framework for Utility Cloud Migration,” details the guiding strategy, research, and deployment of cloud solutions within electric and interconnected grid systems. Before implementing the controls suggested in this document, it is recommended that stakeholders complete Cirrus's cloud integration assessment and pair the results with their unique cybersecurity controls to form a comprehensive cloud-based utility cybersecurity plan. The Cirrus outcome will consider a series of future architectures for the grid before and after the energy transition and evaluate the arguments for and against cloud applications for each electric and interconnected grid layer. This document is a companion to the original whitepaper, "Use Case-Informed Framework for Utility Cloud Migration" to further identify and recommend security controls based on Cirrus’s cloud integration assessment output. The following whitepaper outlines the cybersecurity controls that secure cloud-service models pertinent to the electric sector using the predefined categories identify, protect, detect, and respond and recover. The objective is to outline prescriptive security controls based on the type of architecture and data stored in the cloud. The focus includes dissecting the shared responsibility model and elucidating what on-premises Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS) entail. A pivotal consideration in this context is allocating responsibility for foundational cybersecurity aspects—having used Cirrus for the cloud integration assessment. The ensuing controls detailed herein also represent a checklist of controls necessary for a secure cloud transition, equipping utilities with the knowledge to navigate this digital transformation with confidence and strategic foresight in a safe and responsible manner.

42 ENGINEERING↗
NASA NTRS2010

AIRS Water Vapor and Cloud Products Validate and Explain Recent Negative Global and Tropical OLR Trends Observed by CERES

This paper compares spatial and temporal anomalies and trends of OLR as observed by CERES and computed based on AIRS retrieved surface and atmospheric geophysical parameters over the time period September 2002 February 2010. This time period is marked by a substantial decreasing OLR trend on the order of -0.1 W/m2/yr averaged over the globe. There are very large spatial variations of these trends however, with local values ranging from -2.6 W/m2/yr to +3.0 W/m2/yr in the tropics. The spatial patterns of the AIRS and CERES trends are in essentially perfect agreement with each other, as are the anomaly time series averaged over different spatial regions. This essentially perfect agreement of OLR anomalies and trends derived from observations by two different instruments, in totally independent and different manners, implies that both sets of results must be highly accurate. The agreement of anomalies and trends of OLR as observed by CERES and computed from AIRS derived products also indirectly validates the anomalies and trends of the AIRS derived products as well. We used the anomalies and trends of AIRS derived water vapor and cloud products to explain why global OLR has had a large negative trend over the time period September 2002 through February 2010. Tropical OLR began to decrease significantly at the onset of a strong La Nina in mid-2007. AIRS products show that cloudiness and mid-tropospheric water vapor began to increase in the region 5degN - 20degS latitude extending eastward from 150degW - 30 E longitude at that time, with a corresponding very large drop in OLR in this region. Late 2009 is characterized by a strong El-Nino, with a corresponding change in sign of observed anomalies of mid-tropospheric water vapor, cloud cover, and OLR in this region, as we] l as that of OLR anomalies in the tropics and globally. Monthly mean anomalies of OLR, water vapor and cloud cover over this region are all shown to be highly correlated in time with those of an El Nino anomaly index four months previously. The El Nino index is defined as the SST anomaly averaged over the area 15S to 15N and 160W eastward to 30E. If one excludes the area 5degN - 20degS, 150degW - 30degE from the statistics, the negative area mean tropical OLR trends, as well as OLR trends over the rest of the globe, are substantially

Susskind, Joel↗
NASA NTRS2010

Toward GEOS-6, A Global Cloud System Resolving Atmospheric Model

NASA is committed to observing and understanding the weather and climate of our home planet through the use of multi-scale modeling systems and space-based observations. Global climate models have evolved to take advantage of the influx of multi- and many-core computing technologies and the availability of large clusters of multi-core microprocessors. GEOS-6 is a next-generation cloud system resolving atmospheric model that will place NASA at the forefront of scientific exploration of our atmosphere and climate. Model simulations with GEOS-6 will produce a realistic representation of our atmosphere on the scale of typical satellite observations, bringing a visual comprehension of model results to a new level among the climate enthusiasts. In preparation for GEOS-6, the agency's flagship Earth System Modeling Framework [JDl] has been enhanced to support cutting-edge high-resolution global climate and weather simulations. Improvements include a cubed-sphere grid that exposes parallelism; a non-hydrostatic finite volume dynamical core, and algorithm designed for co-processor technologies, among others. GEOS-6 represents a fundamental advancement in the capability of global Earth system models. The ability to directly compare global simulations at the resolution of spaceborne satellite images will lead to algorithm improvements and better utilization of space-based observations within the GOES data assimilation system

Putman, William M.↗
NASA NTRS2007

Improvements in the Scalability of the NASA Goddard Multiscale Modeling Framework for Hurricane Climate Studies

Improving our understanding of hurricane inter-annual variability and the impact of climate change (e.g., doubling CO2 and/or global warming) on hurricanes brings both scientific and computational challenges to researchers. As hurricane dynamics involves multiscale interactions among synoptic-scale flows, mesoscale vortices, and small-scale cloud motions, an ideal numerical model suitable for hurricane studies should demonstrate its capabilities in simulating these interactions. The newly-developed multiscale modeling framework (MMF, Tao et al., 2007) and the substantial computing power by the NASA Columbia supercomputer show promise in pursuing the related studies, as the MMF inherits the advantages of two NASA state-of-the-art modeling components: the GEOS4/fvGCM and 2D GCEs. This article focuses on the computational issues and proposes a revised methodology to improve the MMF's performance and scalability. It is shown that this prototype implementation enables 12-fold performance improvements with 364 CPUs, thereby making it more feasible to study hurricane climate.

Shen, Bo-Wen↗
DOE OSTI2022

Delaunay walk for fast nearest neighbor: accelerating correspondence matching for ICP

Point set registration algorithms such as Iterative Closest Point (ICP) are commonly utilized in time-constrained environments like robotics. Finding the nearest neighbor of a point in a reference 3D point set is a common operation in ICP and frequently consumes at least 90% of the computation time. We introduce a novel approach to performing the distance-based nearest neighbor step based on Delaunay triangulation. This greedy algorithm finds the nearest neighbor of a query point by traversing the edges of the Delaunay triangulation created from a reference 3D point set. Our work integrates the Delaunay traversal into the correspondences search of ICP and exploits the iterative aspect of ICP by caching previous correspondences to expedite each iteration. An algorithmic analysis and comparison is conducted showing an order of magnitude speedup for both serial and vector processor implementation.

3d point cloud processing↗
DOE OSTI2018

Supercomputers, Clouds and Grids powered by BigPanDA for Brain studies

The PanDA WMS - Production and Distributed Analysis Workload Management System - has been developed and used by the ATLAS experiment at the LHC (Large Hadron Collider) for all data processing and analysis challenges. BigPanDA is an extension of the PanDA WMS to run ATLAS and non-ATLAS applications on Leadership Class Facilities and supercomputers, as well as traditional grid and cloud resources. The success of the BigPanDA project has drawn attention from other compute intensive sciences such as biology. In 2017, a pilot project was started between BigPanDA and the Blue Brain Project (BBP) of the Ecole Polytechnique Federal de Lausanne (EPFL) located in Lausanne, Switzerland. This proof of concept project is aimed at demonstrating the efficient application of the BigPanDA system to support the complex scientific workflow of the BBP, which relies on using a mix of desktop, cluster and supercomputers to reconstruct and simulate accurate models of brain tissue.

Computer Science↗