Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “CLOUD COMPUTING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

The Radiometric Scaling of the MODIS and VIIRS Imagers to a Common Reference and Stability Analysis for the Next Edition of CERES Products

The NASA CERES project has provided the climate quality observed TOA and computed surface fluxes to the scientific community. CERES uses MODIS and VIIRS imagers to retrieve cloud properties needed to convert Terra, Aqua, NPP, and NOAA-20 CERES footprint radiance observations into fluxes. The imagers are also used to radiometrically scale the geostationary sensors (GEO) radiances to the imager calibration reference to ensure that the GEO derived cloud properties and broadband TOA fluxes are consistent in both space and time. Both the imager and GEO retrieved cloud properties are used to compute the surface fluxes. The CERES imager and GEO calibration team uses ray-matched radiance pairs to radiometrically scale the SNPP and NOAA-20 VIIRS sensors to the Aqua-MODIS calibration reference. The radiometric scaling is further validated using geostationary imagers as transfer radiometers. The team will rely primarily on deep convective clouds to monitor the imager channel calibration stability and to correct for short term calibration drifts. The DSCOVR satellite was launched on February 25, 2015 and orbits around the L1 Lagrange point directly between the Earth and the sun. The EPIC sensor contains no onboard calibration systems. However, multiple inter-calibration studies have shown that the EPIC imager is very stable in time. The excellent radiometric stability of EPIC allows the use of EPIC observations as a stable reference to validate both the short term drift corrections of the imagers, as well as to validate the radiometric scaling factors between them. Examples of the imager relative calibration using EPIC before and after radiometric scaling will be shown along with the results from the use of invariant targets to remove imager calibration drifts.

DSCOVR-EPIC↗
DOE OSTI2023

The globus compute dataset: An open function-as-a-service dataset from the edge to the cloud

Here we present a unique function-as-a-service (FaaS) dataset capturing the use of the Globus Compute (previously funcX) platform. Globus Compute implements a federated model via which users may deploy endpoints on arbitrary remote computers, from the edge to high performance computing (HPC) cluster, and they may then invoke Python functions on those endpoints via a reliable cloud -hosted service. The dataset covers 31 weeks and includes 2121472 task submissions from 252 users executed on 580 remote computing endpoints. It includes 277386 registered functions. We describe the dataset and various observations, some that are similar to other FaaS datasets, for example, that 74% of tasks run for less than 1 s, and some that are unique to Globus Compute, for example, that endpoints are used in different ways and that the majority of functions are related to scientific computing and machine learning. To the best of our knowledge, this dataset represents the first federated FaaS dataset that includes user workloads, distributed computing endpoints, and analysis of registered function bodies. We expect the dataset to be useful for researching FaaS architectures, workload modeling, container warming, and other distributed computing architectures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

PipeSight: A High-Performance Computing Platform for Pipeline Integrity Management

The Phase I feasibility study completed as part of this project has led to a number of innovative technologies being developed and has laid the foundation for a successful Phase II effort to commercialize a platform for managing the integrity of pipelines for the damage mechanisms of the new, hybrid-energy based economy. To ground the development efforts and direction of the project, an extensive market research and customer discovery effort was undertaken early in Phase I. Through this effort, a number of pipeline owners and operators were interviewed, and the following key findings were discovered about the pipeline industry: • Small pipeline operators do not have the central engineering groups necessary to perform their own independent analysis of inspection data, but instead rely on summarized tally sheets provided to them by inspection service providers. • The time it takes to go from an inspection to a completed engineering assessment, even for small segments of pipeline, can take anywhere from 30-120 days. During this delay, critical threats can (and have been known to) cause failures. • Uncertainty is often not accounted for in the assessment of pipeline integrity. The tally sheets provided by third-party service providers are almost always deterministic in nature, identifying threats that present a concern only to the current (not the future) integrity of the pipeline. • It is uncommon to apply the latest technologies to perform advanced assessments of damaged pipelines. There is a desire to use more advanced analysis capabilities to assess threats. Many pipeline operators indicated that they would often excavate a pipeline to perform an inspection and find that the damage was not as bad as they anticipated, thus using limited resources unnecessarily. Companies are not consistent in their use of inspection data to determine corrosion rates, and those that do only calculate deterministic corrosion rates. • The industry has prominently relied on time-based inspections but has recently started to transition to risk-based inspections. However, there appears to be no uniform guidance on how to do so while properly accounting for all sources of uncertainty. • Companies are not storing inspection data in a manner that allows for the ready determination of temporal trends. • Predictive maintenance principles and practices are beginning to be used by early adopters • Some pipelines are being re-purposed to transport different process fluids than they were designed for, e.g., H 2 and CO 2 rich process streams to serve the new hybrid-energy based economy, which are presenting new integrity concerns for the existing pipeline network that crisscrosses the United States. As a result of these discoveries, we were able to target the development efforts in Phase I to best serve the needs of the industry. In Phase I, we developed a way to correlate multiple large-scale scans of the pipeline to determine a probabilistic corrosion rate that accounts for all sources of error and uncertainty in the inspection process. This probabilistic corrosion rate can be used to predict the future thickness distribution of the pipe wall. We demonstrate how this analysis may be performed in an analytical fashion and has been implemented in such a manner that it can be readily distributed using GPU computing through integration of the Kokkos programming model. We also make a very novel extension of the analytical corrosion rate model to Bayesian Networks (an explainable AI technique) that can account for non-parametric distributions of corrosion rates. With the predictions made above for the probabilistic corrosion rate and corresponding future distribution of the pipe wall thickness, we can assess the integrity of the pipeline through the use of a probabilistic engineering assessment. We developed a novel screening data analysis approach that can rapidly identify ‘hotspots’ (local thin areas) where the integrity of the pipeline is a concern. Once more, we implemented this screening approach in C++ to leverage GPU computing via the Kokkos programming model. After the critical hotspots are identified, we developed a program that can automatically generate an advanced finite element model of the damaged regions. Since the number of damaged regions that require advanced analysis can number in the thousands, we integrated an open-source container-native workflow engine for orchestrating parallel jobs on the cloud. Initially, these advanced numerical models were only designed to account for loading due to internal pressure. However, in a slight pivot from the initial Phase I proposal, we developed a complete pipe stress analysis program (called Simflex) which can simulate the complete pipeline and its response to thermal expansion, pressure, thermal bowing, weight, wind, earthquake, support displacement, support friction and external forces. This pipe stress analysis program was written generically, to handle any piping system, but contains the features needed to model long pipelines (i.e., it incorporates a model for soil mechanics and can account for the nonlinear boundary conditions necessary to simulate long underground pipelines). This pipe stress analysis program can simulate any segment of the pipeline (simple or complex) under any set of conditions and loads, to determine the supplemental loads (axial forces and bending moments) at the location of damage. This enables the most accurate state of stress to be accounted for in the pipeline, which can prove critical when evaluating the integrity of a damaged region. In the process of developing the technologies to perform the integrity assessment of the pipeline, we also extended one of the industry standard approaches for performing the assessment of local thin areas that extend more in the circumferential direction than the longitudinal direction of the pipeline. This approach was presented to the API 579-1/AS ME FFS-1 steering committee in November 2021 for consideration in the next edition of the industry standard for Fitness-For-Service (expected to be released in 2023). To help pipeline operators make decisions with the results on any integrity assessment, we developed a new approach to the life-cycle management of pipelines which uses a Bayesian Decision Network. The network is designed to help pipeline operators plan and prioritize inspection activities and ultimately make smarter, more cost-effective decisions. The Bayesian approach accounts for all sources of uncertainty and carries them through to the final optimal decisions, providing a probabilistic framework for optimizing inspection intervals. The proof-of-concept networks developed in the feasibility study are complete, verified, and are focused on a subset of the pipeline. To expand this novel approach to the scale necessary for an entire network of pipelines in Phase II, we will leverage the DOE-funded Bengi solver for industrial-scale decision making with Bayesian Networks [22]. Once implemented, we will be able to provide the pipeline industry with a much-needed tool for optimal inspection planning using truly explainable artificial intelligence (XAI). To handle all of these advanced capabilities into a cloud-based platform, the architecture of the Equity Engineering Cloud (EEC) was extended to include Argo Workflows, a framework capable of distributing and managing a massive number of jobs that consume their own resources, such that thousands of serial finite element simulations can be run in parallel. As part of this substantial undertaking, we also integrated Argo Continuous Delivery (CD) into the EEC, to aid with the rapid prototyping and iterations that will be imperative to the success of the PipeSight platform’s Agile development process in Phase II. As part of the pipe stress analysis program, we also developed a custom visualizer that leverages the DOE-funded VTK visualization library. We added custom contouring capabilities and a means for interacting visually with both the inputs and outputs of the pipe stress analysis program. We also developed routines for automating the post-processing of the finite element simulations to determine if any failure criteria are met and to visualize the deformations, stresses and strains in ParaView using the exodus II file format (a subset of netCDF).

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2015

RACORO continental boundary layer cloud investigations. Part I: Case study development and ensemble large-scale forcings

Observation-based modeling case studies of continental boundary layer clouds have been developed to study cloudy boundary layers, aerosol influences upon them, and their representation in cloud- and global-scale models. Three 60-hour case study periods span the temporal evolution of cumulus, stratiform, and drizzling boundary layer cloud systems, representing mixed and transitional states rather than idealized or canonical cases. Based on in-situ measurements from the RACORO field campaign and remote-sensing observations, the cases are designed with a modular configuration to simplify use in large-eddy simulations (LES) and single-column models. Aircraft measurements of aerosol number size distribution are fit to lognormal functions for concise representation in models. Values of the aerosol hygroscopicity parameter, κ, are derived from observations to be ~0.10, which are lower than the 0.3 typical over continents and suggestive of a large aerosol organic fraction. Ensemble large-scale forcing datasets are derived from the ARM variational analysis, ECMWF forecasts, and a multi-scale data assimilation system. The forcings are assessed through comparison of measured bulk atmospheric and cloud properties to those computed in 'trial' large-eddy simulations, where more efficient run times are enabled through modest reductions in grid resolution and domain size compared to the full-sized LES grid. Simulations capture many of the general features observed, but the state-of-the-art forcings were limited at representing details of cloud onset, and tight gradients and high-resolution transients of importance. Methods for improving the initial conditions and forcings are discussed. The cases developed are available to the general modeling community for studying continental boundary clouds.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2015

RACORO Continental Boundary Layer Cloud Investigations: 1. Case Study Development and Ensemble Large-Scale Forcings

Observation-based modeling case studies of continental boundary layer clouds have been developed to study cloudy boundary layers, aerosol influences upon them, and their representation in cloud- and global-scale models. Three 60 h case study periods span the temporal evolution of cumulus, stratiform, and drizzling boundary layer cloud systems, representing mixed and transitional states rather than idealized or canonical cases. Based on in situ measurements from the Routine AAF (Atmospheric Radiation Measurement (ARM) Aerial Facility) CLOWD (Clouds with Low Optical Water Depth) Optical Radiative Observations (RACORO) field campaign and remote sensing observations, the cases are designed with a modular configuration to simplify use in large-eddy simulations (LES) and single-column models. Aircraft measurements of aerosol number size distribution are fit to lognormal functions for concise representation in models. Values of the aerosol hygroscopicity parameter, kappa, are derived from observations to be approximately 0.10, which are lower than the 0.3 typical over continents and suggestive of a large aerosol organic fraction. Ensemble large-scale forcing data sets are derived from the ARM variational analysis, European Centre for Medium-Range Weather Forecasts, and a multiscale data assimilation system. The forcings are assessed through comparison of measured bulk atmospheric and cloud properties to those computed in "trial" large-eddy simulations, where more efficient run times are enabled through modest reductions in grid resolution and domain size compared to the full-sized LES grid. Simulations capture many of the general features observed, but the state-of-the-art forcings were limited at representing details of cloud onset, and tight gradients and high-resolution transients of importance. Methods for improving the initial conditions and forcings are discussed. The cases developed are available to the general modeling community for studying continental boundary clouds.

Boundary layers↗
DOE OSTI2023

A Privacy-Aware Federated Learning Framework for Distributed Energy Resource Analytics in Constrained Environments

To be resilient against extreme weather events, the rural communities in Puerto Rico are leveraging distributed energy resources (DER). However, computing frameworks sup-porting the grid in critical decision-making are still largely centralized. Sensitive consumer data are transmitted over the Internet or cellular networks to a secondary or tertiary node. It guarantees better situational awareness at the cost of a wider attack surface, jeopardizing user privacy, as more DER come online. Cloud, Edge, and Fog computing all require data aggregation at some level. This paper introduces a privacy-aware federated learning framework that leverages the Fog model by pushing analytics all the way to the DER and load assets. These local models train on individual asset data and transmit only learned parameters (such as weights) over secure communications to a global decision-maker. By abstracting personally identifiable consumer data without impacting decision optimality, this framework better aligns with distributed power generation paradigm.

Sundararajan, Aditya↗
NASA NTRS2017

Atmospheric Collapse on Early Mars: The Role of CO2 Clouds

The abundance of evidence that liquid water flowed on the surface early in Mars' history strongly implies that the early Martian atmosphere was significantly more massive than it is today. While it seems clear that the total CO2 inventory was likely substantially larger in the past, the fundamental question about the physical state of that CO2 is not completely understood. Because the temperature at which CO2 condenses increases with surface pressure, surface CO2 ice is more likely to form and persist as the atmospheric mass increases. For the atmosphere to remain stable against collapse, there must be enough energy, distributed planet wide, to stave off the formation of permanent CO2 caps that leads to atmospheric collapse. The presence of a "faint young sun" that was likely about 25 percent less luminous 3.8 billion years ago than the sun today makes this even more difficult. Several physical processes play a role in the ultimate stability of a CO2 atmosphere. The system is regulated by the energy balance between solar insolation, the radiative effects of the atmosphere and its constituents, atmospheric heat transport, heat exchange between the surface and the atmosphere, and latent heating/cooling. Specific considerations in this balance for a given orbital obliquity/eccentricity and atmospheric mass are the albedo of the caps, the dust content of the atmosphere, and the presence of water and/or CO2 clouds. Forget et al. show that, for Mars' current obliquity (in a circular orbit), CO2 atmospheres ranging in surface pressure from 500 hectopascals to 3000 hectopascals would have been stable against collapsing into permanent surface ice reservoirs. Soto et al. examined a similar range in initial surface pressure to investigate atmospheric collapse and to compute collapse rates. CO2 clouds and their radiative effects were included in Forget et al. but they were not included in Soto et al. Here we focus on how CO2 clouds affect the stability of the atmosphere against collapse.

Kahre, M. A.↗
NASA NTRS1973

Atmospheric and cloud structures of the Jovian planets

Wet adiabatic atmospheric models are computed for the four Jovian planets. Possible cloud-forming condensates considered are H2O ice, aqueous NH3 solution, NH4SH, and solid NH3, CH4, and Ar. Some techniques for computer calculation of condensation in a multiphase system of variable composition are discussed. Nominal models are computed for all four planets, and the effects of variations in composition and different pressure-temperature regimes are investigated in detail for Jupiter. The meaning of the calculated closed densities and their relation to the actual densities are discussed. The computed atmospheric profiles represent average conditions, subject to considerable local variations.

Weidenschilling, S. J.↗
NASA NTRS1992

Anisotropic line emission and the geometry of the broad-line region in active galactic nuclei

Attention is given to an escape probability-based formalism, including the interaction with a background opacity, which is used to predict line-beaming factors for broad-line region (BLR) clouds of AGN. Several computational details necessary to model gas exposed to an intense nonthermal continuum are outlined. It is found that all hydrogen lines are strongly inwardly beamed, and that C IV 1549 is moderately beamed. The implications of this for the geometry of the emission-line regions of AGN are discussed. Beaming is found to cause the source-cloud separation to be overestimated by variability studies (so that the radiation field at the BLR is even more intense than previously thought); it can even cause spherical geometries to have little instantaneous response to continuum changes.

Ferland, G. J.↗
DOE OSTI2014

Evaluation of convection‐permitting model simulations of cloud populations associated with the Madden‐Julian Oscillation using data collected during the AMIE/DYNAMO field campaign

Abstract Regional convection‐permitting model simulations of cloud populations observed during the 2011 Atmospheric Radiation Measurement (ARM) Madden‐Julian Oscillation Investigation Experiment/Dynamics of the Madden‐Julian Oscillation Experiment (AMIE/DYNAMO) field campaign are evaluated against ground‐based radar and ship‐based observations. Sensitivity of model simulated reflectivity, surface rain rate, and cold pool statistics to variations of raindrop breakup/self‐collection parameters in four state‐of‐the‐art two‐moment bulk microphysics schemes in the Weather Research and Forecasting (WRF) model is examined. The model simulations generally overestimate reflectivity from large and deep convective cells, and underestimate stratiform rain and the frequency of cold pools. In the sensitivity experiments, introduction of more aggressive raindrop breakup or decreasing the self‐collection efficiency increases the cold pool occurrence frequency in all of the simulations, and slightly reduces the reflectivity and precipitation statistics bias in some schemes but has little effect on the overall mean surface precipitation. Both the radar observations and model simulations of cloud populations show an approximate power law relationship between convective echo‐top height and equivalent convective cell radius.

Hagos, Samson↗
NASA NTRS1999

Modeling of Sub-Grid Heterogeneity and its Impact on GCM Global Radiation Balance

The spatial and temporal variability of high, low, and mid-level clouds is obtained from ISCCP D1 data. Monthly mean global maps of the observed cloud variability are used to re-scale GCM prognostic cloud optical depths and radiative parameters via the Monte Carlo cloud heterogeneity parameterization that utilizes the existing plane-parallel GCM radiative transfer model to compute radiative fluxes for inhomogeneous cloud distributions. The GCM radiative fluxes at TOA and the ground surface are then compared to ERBE and GEBA results. These comparisons show that including sub-grid cloud variability in the GCM radiative model improves agreement between the GCM radiative energy budget components and observations,

Lacis, Andrew↗
NASA NTRS1990

Diabatic forcing and initialization with assimilation of cloud and rain water in a forecast model: Methodology

The focus of this part of the investigation is to find one or more general modeling techniques that will help reduce the time taken by numerical forecast models to initiate or spin-up precipitation processes and enhance storm intensity. If the conventional data base could explain the atmospheric mesoscale flow in detail, then much of our problem would be eliminated. But the data base is primarily synoptic scale, requiring that a solution must be sought either in nonconventional data, in methods to initialize mesoscale circulations, or in ways of retaining between forecasts the model generated mesoscale dynamics and precipitation fields. All three methods are investigated. The initialization and assimilation of explicit cloud and rainwater quantities computed from conservation equations in a mesoscale regional model are examined. The physical processes include condensation, evaporation, autoconversion, accretion, and the removal of rainwater by fallout. The question of how to initialize the explicit liquid water calculations in numerical models and how to retain information about precipitation processes during the 4-D assimilation cycle are important issues that are addressed. The explicit cloud calculations were purposely kept simple so that different initialization techniques can be easily and economically tested. Precipitation spin-up processes associated with three different types of weather phenomena are examined. Our findings show that diabatic initialization, or diabatic initialization in combination with a new diabatic forcing procedure, work effectively to enhance the spin-up of precipitation in a mesoscale numerical weather prediction forecast. Also, the retention of cloud and rain water during the analysis phase of the 4-D data assimilation procedure is shown to be valuable. Without detailed observations, the vertical placement of the diabatic heating remains a critical problem.

Raymond, William H.↗
DOE OSTI2022

Doppler Lidar (DL) Instrument Handbook

The Doppler lidar (DL) is an active remote sensing instrument that provides range- and time-resolved measurements of radial velocity and attenuated backscatter. The principle of operation is similar to radar in that pulses of energy are transmitted into the atmosphere; the energy scattered back to the transceiver is collected and measured as a time-resolved signal. From the time delay between each outgoing transmitted pulse and the backscattered signal, the distance to the scatterer is inferred. The radial or line-of-sight velocity of the scatterers is determined from the Doppler frequency shift of the backscattered radiation. The DL uses a heterodyne detection technique in which the return signal is mixed with a reference laser beam (i.e., local oscillator) of known frequency. An onboard signal processing computer then determines the Doppler frequency shift from the spectra of the heterodyne signal. The energy content of the Doppler spectra can also be used to determine attenuated backscatter.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2014

Cloud-based Architecture Capabilities Summary Report

In collaborating scientific research arena it is important to have an environment where analysts have access to a shared of information documents, software tools and be able to accurately maintain and track historical changes in models. A new cloud-based environment would be accessible remotely from anywhere regardless of computing platforms given that the platform has available of Internet access and proper browser capabilities. Information stored at this environment would be restricted based on user assigned credentials. This report reviews development of a Cloud-based Architecture Capabilities (CAC) as a web portal for PRA tools.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Removing Numerical Pathologies in a Turbulence Parameterization Through Convergence Testing

Abstract Discretized numerical models of the atmosphere are usually intended to faithfully represent an underlying set of continuous equations, but this necessary condition is violated sometimes by subtle pathologies that have crept into the discretized equations. Such pathologies can introduce undesirable artifacts, such as sawtooth noise, into the model solutions. The presence of these pathologies can be detected by numerical convergence testing. This study employs convergence testing to verify the discretization of the Cloud Layers Unified By Binormals (CLUBB) model of clouds and turbulence. That convergence testing identifies two aspects of CLUBB's equation set that contribute to undesirable noise in the solutions. First, numerical limiters (i.e., clipping) used by CLUBB introduce discontinuities or slope discontinuities in model fields. Second, nonlinear artificial diffusion employed for improving numerical stability can introduce unintended small‐scale features into the solution of the model equations. Smoothing the limiters and using linear artificial diffusion reduces the noise and restores the expected first‐order convergence in CLUBB's solutions. These model reformulations enhance our confidence in the trustworthiness of solutions from CLUBB by eliminating the unphysical oscillations in high‐resolution simulations. The improvements in the results at coarser, near‐operational grid spacing and timestep are also seen in cumulus cloud and dry turbulence tests. In addition, convergence testing is proven to be a valuable tool for detecting pathologies, including unintended discontinuities and grid dependence, in the model equation set.

58 GEOSCIENCES↗
DOE OSTI2024

DIRAC current, upcoming and planned capabilities and technologies

DIRAC is the interware for building and operating large scale distributed computing systems. It is adopted by multiple collaborations from various scientific domains for implementing their computing models. DIRAC provides a framework and a rich set of ready-to-use services for Workload, Data and Production Management tasks of small, medium and large scientific communities having different computing requirements. The base functionality can be easily extended by custom components supporting community specific workflows. DIRAC is at the same time an aging project, and a new DiracX project is taking shape for replacing DIRAC in the long term. This contribution will highlight DIRAC’s current, upcoming and planned capabilities and technologies, and how the transition to DiracX will take place. Examples include, but are not limited to, adoption of security tokens and interactions with Identity Provider services, integration of Clouds and High Performance Computers, interface with Rucio, improved monitoring and deployment procedures.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Energy Material Network Data Hubs

In early 2015 the United States Department of Energy conceived of a consortium of collaborative bodies based on shared expertise, data, and resources that could be targeted towards the more difficult problems in energy materials research. The concept of virtual laboratories had been envisioned and discussed earlier in the decade in response to the advent of the Materials Genome Initiative and similar scientific thrusts. To be effective, any virtual laboratory needed a robust method for data management, communication, security, data sharing, dissemination, and demonstration to work efficiently and effectively for groups of remote researchers. With the accessibility of new, easily deployed cloud technology and software frameworks, such individual elements could be integrated, and the required collaboration architecture is now possible. The developers have leveraged open-source software frameworks, customized them, and merged them into a platform to enable collaborative energy materials science, regardless of the geographic dispersal of the people and resources. After five years in operations, the systems are demonstratively an effective platform for enabling research within the Energy Material Networks (EMN). This paper will show the design and development of a secured scientific data sharing platform, the ability to customize the system to support diverse workflows, and examples of the enabled research and results connected with some of the Energy Material Networks.

97 MATHEMATICS AND COMPUTING↗