Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Cloud Implementation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Understanding Biases in Simulated Cloud Radiative Effects in E3SMv3

This study systematically investigates biases in cloud radiative effects (CREs) within the recently released Energy Exascale Earth System Model version 3 (E3SMv3). Compared to its previous version (E3SMv2), E3SMv3 shows excessively strong shortwave CRE over tropical and subtropical oceans, the Southern Ocean, and the Northern Hemisphere storm tracks, which is primarily caused by an overestimation of optically intermediate low clouds. The model also displays excessive longwave CRE over the Maritime Continent and other tropical deep convection regions, resulting from an overestimation of optically thick high clouds. Implementing the Predicted Particle Properties (P3) scheme for stratiform clouds played the most significant role in these cloud changes. In addition, using a double-moment scheme for convective clouds contributed to the increase in intermediate low clouds and optically thick clouds in tropical deep convection regions. Error metrics for total cloud amount (E TCA ), cloud properties (E ctp-τ ), and cloud properties weighted by their SW and LW radiative impacts (E SW and E LW ) indicate that E3SMv3's ability to reproduce observed cloud radiative effect of low, middle, and high clouds has not been improved compared to E3SMv2. Nevertheless, the performance of E3SMv3 remains well within the spread of CMIP6 models, with E SW and E LW values smaller than those in most CMIP6 models. This study underscores the importance of integrating diverse satellite observations for robust cloud evaluation and using cloud-radiation relationships as consistency check for model errors. It suggests that further model developments focus on improving cloud microphysics and their interactions with radiation.

Environmental sciences↗
DOE OSTI2026

Cloud-Based Demonstration of the Eastern Interconnection Situational Awareness Monitoring System (ESAMS)

This report describes a cloud-based implementation and field demonstration of the Eastern Interconnection Situational Awareness and Monitoring System (ESAMS). ESAMS was developed to support the detection and source localization of forced oscillations using synchrophasor measurements from tie-lines connecting areas served by different reliability coordinators (RCs), so that RCs could better coordinate their response to wide-area events. A previous effort had identified deployment barriers associated with hosting shared situational awareness tools at a single RC. To address these barriers, ESAMS was migrated to Amazon Web Services and evaluated in a six-month field demonstration. ISO New England (ISO-NE) and PJM streamed data to the platform using AWS Direct Connect and a site-to-site VPN, respectively. The resulting multi-utility measurement footprint enabled regional source localization across major portions of the U.S. Eastern Interconnection and supported routine identification of oscillation events. During the final three months of the trial, 24 events above 2 MW/MVAR were detected. The largest detected oscillation approached a 25 MW peak-to-peak amplitude, and the longest persisted intermittently for more than 11 hours. The demonstration also assessed operational considerations—including data transfer volumes, end-to-end latency, and cloud computing costs—and found that network and compute requirements were modest relative to typical cloud capabilities while providing performance comparable to prior on-premises deployments. Overall, the results indicate that cloud hosting can provide a practical path to shared interconnection-wide oscillation monitoring. The cloud ESAMS demonstration establishes a foundation for broader utility participation and for building future wide-area analytics that leverage measurements across organizational boundaries.

Follum, James D.↗
DOE OSTI2025

sparkctl [SWR-25-109]

This package implements configuration and orchestration of Spark clusters with standalone cluster managers. This is useful in environments like HPCs where the infrastructure implemented by cloud providers, such as AWS, is not available. It is particularly helpful when users want to deploy Spark but do not have administrative control of the servers.

Thom, Daniel [National Renewable Energy Laboratory↗
DOE OSTI2026

Prong Segmentation using Point Set Transformers in Multiple View Neutrino Detectors

NOvA is a long-baseline neutrino experiment studying neutrino oscillations by detecting neutrinos from the NuMI beam at Fermilab. Its physics analysis relies on accurate prong segmentation, which involves matching each hit to its source particle and identifying the particle type. This task has commonly been addressed using a combination of traditional clustering algorithms and convolutional neural networks (CNNs). However, NOvA’s detector design presents data as two sparse and decoupled 2D images (XZ and YZ views) rather than a native 3D representation, posing a significant challenge for traditional CNN-based models. In this talk, we propose a novel neural network based on the Point Set Transformer. By treating detector hits as sparse point clouds and implementing a cross-view attention mechanism, our model enables efficient information mixing between both views. Evaluated on NOvA simulated data, our model achieves superior accuracy while requiring significantly fewer computational resources compared to other models. Furthermore, the model demonstrates great performance when applied to Liquid Argon Time Projection Chamber (LArTPC) data, which shows its potential as a universal prong segmentation algorithm for multiple view neutrino detectors.

Liu, Jiaxi [UC, Irvine]↗
DOE OSTI2025

Improving the Parameterization of Cloud and Rain Microphysics in E3SM using Novel Observationally-Constrained Bayesian Approach (Final Technical Report)

In this project, we sought to develop new cloud and rain microphysics frameworks within the Energy Exascale Earth System Model (E3SM). This work encompassed two primary avenues of research: 1) Further development of a Bayesian-based scheme called BOSS (Bayesian Observationally-constrained Statistical-physical Scheme) to represent cloud and rain microphysics, testing it in realistic high-resolution cloud models, and implementing it in E3SM; 2) Development of a methodology utilizing machine learning to enable computationally tractable use of tractable use of Markov chain Monte Carlo sampling for Bayesian parameter estimation in Earth system and cloud models. In this project, we adapted the BOSS microphysics scheme, originally formulated for rain-only, to include all liquid-phase microphysical processes for cloud and rain, in particular the processes that mediate between these two categories, for example the conversion from cloud to rain through collision and coalescence of drops. We constrained the scheme via comparison and testing against a detailed model that explicitly represents the evolution of cloud and rain particles, called a bin microphysics scheme.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Cybersecurity Standards, Certification, and Best Practices for DERs

Distributed energy resources (DERs) are becoming increasingly important to the electric grid, including solar energy systems. However, DERs also introduce new cybersecurity risks, including those posed by cloud computing. Standards harmonization is essential for ensuring that DERs are secure and can be safely integrated into the grid. This panel will discuss cyber standards harmonization for solar security. The panel will feature experts from the S2G Program, National Labs and Industry who will discuss the following topics: the cybersecurity risks and future benefits posed by ubiquitous solar energy systems, the development and implementation of cloud-based security solutions for DERs, including solar energy systems, the challenges and opportunities for harmonizing DER cybersecurity standards, and Cyber Informed Engineering and the solar security implementations The panel will also discuss the following specific initiatives: the S2G Program's DER Cybersecurity Framework, UL's DER Cybersecurity Certification Program, and IEEE 1547 Updates. The panel will conclude with a discussion of the future of standards harmonization for DER cybersecurity.

14 SOLAR ENERGY↗
DOE OSTI2025

Improving Cyber Situational Understanding

Effective cybersecurity operations require the ability to analyze large amounts of information to assess security risks and formulate defensive strategies against adversaries. This has become more complex in recent years as the sprawl and interconnectivity of devices grows through implementation of virtualization, cloud computing, and Internet of Things (IoT). The amount of data and analysis required for effective cybersecurity command and control decisions far exceeds humans’ capacity to perform manually. We characterize the analysis problem as cyber situational understanding. The research presented to improve cyber situational understanding focuses on vulnerability analysis and threat intelligence. Regarding vulnerabilities, entities must analyze and plan work for between thousands and tens of thousands of software vulnerabilities annually. Entities heavily use network firewalls to limit vulnerability exposure. As a result, some of these vulnerabilities permit exposure to adversarial exploitation, whereas others are inaccessible and therefore present negligible risk of exploitation. Distinguishing between high and low risk software vulnerabilities requires a deep understanding of the vulnerability, network firewall protection, and characteristics of the targeted device. This problem is solved by extracting network service features from vulnerability data features using both machine-learning and natural language processing. Then, the network firewall topology is parsed to determine which vulnerabilities are reachable by adversaries. Ultimately, a state-based safety analysis ascertains which vulnerabilities are unsafe. A related vulnerability analysis problem occurs in cybersecurity operations when associating an entity’s hardware and software assets to public vulnerability databases. Assets often reveal hardware and software through installation artifacts and network service identification, and entities store these artifacts in inventory databases. However, software and hardware vendors apply a standard Common Platform Enumeration (CPE) naming convention when publicly reporting vulnerabilities. Associating these two datasets often requires many hours to days of manual inspection. The proposed solution automates the mapping approach of human analysts using fuzzy matching techniques, natural language processing, and, ultimately, machine learning to present a small set of recommendations for mapping the two datasets. The result significantly reduces human analysis time and reduces the occurrence of false positives in vulnerability notifications. Finally, cyber threat intelligence (CTI) requires associating cyber observable artifacts, such as IP addresses, URIs, and file hashes, with cyber threat tactics, techniques, and procedures. Unfortunately, most CTI data is compartmentalized across multiple organizations and cannot be shared due to the legal and reputational risk with cyber threat being associated with the entity. The approach to solving this problem inovlves using a distributed ledger with anonymous token spending and authentication. This allows a consortium of semi-trusted entities to share the workload of curating CTI for a threat sharing community’s cooperative benefit.

Huff, Philip↗
DOE OSTI2025

Marine and continental stratocumulus cloud microphysical properties obtained from routine ARM Cimel sunphotometer observations

This study investigates marine and continental stratocumulus (Sc) cloud properties obtained from an automated implementation of a multispectral photometer retrieval. Photometer methods simultaneously retrieve cloud optical depth (τ) and cloud droplet effective radius (r e ), with estimates for liquid water path (LWP) calculated on the availability of those quantities. These applied methods evaluate retrieved cloud properties for Sc identified during a recent 6 year period over the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) program sites in Oklahoma, USA (SGP) and in the Azores, Portugal (ENA). Modest agreement in key quantity retrievals is found between the routine photometer products and multisensor collocated profiling references. Cumulative breakdowns contingent on cloud thickness indicate increases in all retrieved quantities in thicker clouds, with larger discrepancies in the relative performance between the retrievals collected in the presence of drizzle. Under continental cloud conditions, the clouds of a similar thickness and r e to those sampled under marine conditions report a factor of 1.5 larger τ and LWP. An r 2 ≅0.65 is found between photometer τ retrievals and shadowband radiometer measurements, with photometer retrievals reporting a high (relative) bias. The τ intercomparisons indicate that variability between retrievals is a factor of three larger than errors reported from individual retrieval input perturbation tests. Photometer r e retrievals suggest a low r 2 (< 0.1) having a standard deviation ≅ 3 µm when compared to ARM baseline multi-sensor radar/radiometer references (accounting for offsets in the cloud droplet number concentration assumptions of the latter). However, photometer LWP calculations remain relatively unbiased in non-drizzling conditions, with errors O (50 g m −2 ) and r 2 ≅0.5 to collocated radiometer and interferometer references. Additional sensitivity tests for island influences on marine Sc properties suggest that while island-influenced winds may promote larger cloud LWP or thickness, the influence could be within retrieval method uncertainty and/or collocated instrument variability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Active learning path-dependent properties using a cloud-based materials acceleration platform

Solid state materials are central to many modern technologies in which a given material may be exposed to a variety of environments. The material properties often vary with the sequence of environments in an irreversible manner, resulting in a quintessential path-dependency in experimental observables. While sequential learning techniques have been effectively deployed for accelerating learning of state properties of materials, they often use a consistent environment path in all experiments. To elevate such techniques for making optimal decisions in experimental investigations of path-dependent properties, we introduce an iterated expected information gain acquisition function that optimizes over entire experimental trajectories. This approach is implemented within a cloud-based Materials Acceleration Platform architecture utilizing an event-driven stateful broker coupled with remote HELAO (Hierarchical Experimental Laboratory Automation and Orchestration) instances and an AI science manager. The platform's efficacy was demonstrated through a case study optimizing multi-step spectro-electrochemical experiments to identify optically stable potential windows in (Co–Ni–Sb)O z metal oxides. The system successfully integrated AI-driven experiment design, remote laboratory automation, and cloud-based data infrastructure, validating the platform's capability for managing complex, adaptive, path-dependent workflows in materials discovery.

Guevarra, Dan [California Institute of Technology ↗
DOE OSTI2024

Sensitivity of Arctic Clouds to Ice Microphysical Processes in the NorESM2 Climate Model

Abstract Ice formation remains one of the most poorly represented microphysical processes in climate models. While primary ice production (PIP) parameterizations are known to have a large influence on the modeled cloud properties, the representation of secondary ice production (SIP) is incomplete and its corresponding impact is therefore largely unquantified. Furthermore, ice aggregation is another important process for the total cloud ice budget, which also remains largely unconstrained. In this study, we examine the impact of PIP, SIP, and ice aggregation on Arctic clouds, using the Norwegian Earth System Model, version 2 (NorESM2). Simulations with both prognostic and diagnostic PIP show that heterogeneous freezing alone cannot reproduce the observed cloud ice content. The implementation of missing SIP mechanisms (collisional breakup, drop shattering, and sublimation breakup) in NorESM2 improves the modeled ice properties, while improvements in liquid content occur only in simulations with prognostic PIP. However, results are sensitive to the description of collisional breakup. This mechanism, which dominates SIP in the examined conditions, is very sensitive to the treatment of the sublimation correction factor, a poorly constrained parameter that is included in the utilized parameterization. Finally, variations in ice aggregation treatment can also significantly impact cloud properties, mainly through their impact on collisional breakup efficiency. Overall, enhancement in ice production through the addition of SIP mechanisms and the reduction in ice aggregation (in line with radar observations of shallow Arctic clouds) result in enhanced cloud cover and decreased TOA radiation biases, compared to satellite measurements, especially during the cold months. Significance Statement Arctic clouds remain a large source of uncertainty in projections of the future climate due to the poor representation of the microphysical processes that govern their life cycle. Ice formation is among the least understood processes. While it is widely recognized that better constraints on primary ice production (PIP) are needed to improve existing parameterizations, we show that secondary ice production (SIP) and ice aggregation can have also a significant impact on ice number concentrations. Constraining ice formation through the addition of missing SIP mechanisms and reducing ice aggregation can improve the representation of the cloud macrophysical properties and enhance total cloud cover in the Arctic region, which in turn contributes to decreased TOA radiation biases in the cold months.

Meteorology & Atmospheric Sciences↗
DOE OSTI2026

SAIGE-GPU: accelerating genome- and phenome-wide association studies using GPUs

Genome-wide association studies (GWAS) at biobank scale are computationally intensive, especially for admixed populations requiring robust statistical models. SAIGE is a widely used method for generalized linear mixed-model GWAS but is limited by its CPU-based implementation, making phenome-wide association studies impractical for many research groups. We developed SAIGE-GPU, a GPU-accelerated version of SAIGE that replaces CPU-intensive matrix operations with GPU-optimized kernels. The core innovation is distributing genetic relationship matrix calculations across GPUs and communication layers. Applied to 2068 phenotypes from 635 969 participants in the Million Veteran Program, including diverse and admixed populations, SAIGE-GPU achieved a 5-fold speedup in mixed model fitting on supercomputing infrastructure and cloud platforms. We further optimized the variant association testing step through multi-core and multi-trait parallelization. Deployed on Google Cloud Platform and Azure, the method provided substantial cost and time savings. Source code and binaries are available for download at https://github.com/saigegit/SAIGE/tree/SAIGE-GPU-1.3.3. A code snapshot is archived at Zenodo for reproducibility (DOI: [10.5281/zenodo.17642591]). SAIGE-GPU is available in a containerized format for use across HPC and cloud environments and is implemented in R/C++ and runs on Linux systems.

Rodriguez, Alex [Argonne National Laboratory (ANL)↗
DOE OSTI2024

The influence of cloud cover on the reliability of satellite-based solar resource data

Satellite-based solar resource data are often developed and validated by using binary cloudiness categories: clear sky or overcast cloudy sky. To investigate the reliability of solar resource data in partially cloudy conditions, we estimate cloud fraction using two distinct algorithms: a physical retrieval model using surface observed global horizontal irradiance (GHI) and direct normal irradiance (DNI) and a temporal average of cloud mask data estimated by the observed DNI. Our analysis reveals a significant presence of scattered clouds, broken clouds, and mismatches between satellite- and surface-based cloud data at 17 surface sites across the contiguous United States, though confidently clear and cloudy conditions collectively account for more than 70 % of the data. Solar radiation is computed using the National Solar Radiation Database (NSRDB) algorithm and validated using surface observations. Here, our findings suggest that, in the presence of scattered clouds, NSRDB data for clear-sky conditions can be subject to significant overestimation. In cloudy-sky conditions classified by satellite data, DNI computed by the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) can be underestimated when limited clouds are detected by surface observations. The bias observed in several cloudiness categories indicates that the NSRDB is exceptionally accurate in confidently clear conditions. However, clear-sky conditions with scattered clouds and mismatched cloud data contribute significantly to the overall uncertainties in the NSRDB. Therefore, future improvements in solar resource data should involve development and implementation of satellite-derived cloud fraction and should consider a novel radiative transfer model accounting for amplified cloud reflection. The evaluation within cloudiness categories also provides a physical rationale for the superior performance of FARMS-DNI compared to the Direct Insolation Simulation Code (DISC) in both cloudy-sky and all-sky conditions.

14 SOLAR ENERGY↗
DOE OSTI2025

Scaling a Podman Container Factory in the Cloud

This technical report describes an implementation of a scalable continuous integration/continuous deployment infrastructure using Microsoft Azure™ and GitLab™ resources. We utilize GitLab continuous integration podman executors to provide rootless container operations in both privileged and unprivileged modes of operation. We utilize the GitLab Fleeting plugin for Azure to manage the scaling of continuous integration execution resources. This creates a scalable, rootless, and isolate continuous integration/continuous deployment job execution infrastructure.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Assessing modifications to the Abdul-Razzak and Ghan aerosol activation parameterization (version ARG2000) to improve simulated aerosol–cloud radiative effects in the UK Met Office Unified Model (UM version 13.0)

The representation of aerosol activation is a key source of uncertainty in global composition-climate model simulations of aerosol–cloud interactions. The Abdul-Razzak and Ghan (ARG) activation parameterization is used in several global and regional models that employ modal aerosol microphysics schemes. In this study, we investigate the ability of the ARG parameterization to reproduce simulations with a cloud parcel model and find its performance is sensitive to the geometric standard deviations (widths) of the lognormal aerosol modes. We recommend adjustments to three constant parameters in the ARG equations, which improve the performance of the parameterization for small mode widths and its ability to simulate activation in polluted conditions. For the accumulation mode width of 1.4 used in the Met Office Unified Model (UM), the modifications decrease the mean bias in the activated fraction of aerosols compared to a cloud parcel model from −6.6 % to +1.2 %. We implemented the improvements in the UM and compared simulated global cloud droplet concentrations with satellite observations. The simulated cloud radiative effect changes by −1.43 W m −2 (6 %) and aerosol indirect radiative forcing over the industrial period changes by −0.10 W m −2 (10 %).

Ghosh, Pratapaditya [Carnegie Mellon University, P↗
DOE OSTI2025

Assessing the climate impact of an improved volcanic sulfate aerosol representation in E3SM

Accurately simulating historical surface temperature variations is essential for evaluating climate models, yet many struggle to reproduce the mid-20th-century temperature trends associated with significant volcanic eruptions. This study examines the impact of volcanic sulfate aerosol representation on these biases using the Energy Exascale Earth System Model (E3SM). The standard CMIP6 protocol prescribes volcanic forcing through radiative perturbations, omitting volcanic aerosol–cloud interactions (VACIs). Here, we implement an emission-based approach with an updated volcanic eruption inventory that directly incorporates volcanic sulfur dioxide (SO 2 ) emissions, enabling a more process-based representation of volcanic forcing. This approach leads to improved surface temperature variability and a modest reduction in cold biases between 1940 and 1980 compared to the CMIP6 setup. Additionally, we assess cloud property responses to a more realistic volcanic sulfate aerosol representation, which weakens cloud-induced cooling during periods of lower volcanic activity. However, despite these refinements, a significant temperature cold bias remains, indicating that further improvements in atmospheric chemistry, aerosol microphysics, cloud processes, and model parameterizations are needed to fully resolve this issue in E3SM.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Organisation of Diverse Mechanisms of Secondary Ice Production among Basic Convective and Stratiform Cloud-types

This 3-year DoE-funded joint project had the over-arching aim of understanding how ice is initiated in clouds of various types. Focus was given to processes of fragmentation of pre-existing ice, which can occur in positive feedback loops (‘ice multiplication’). A basic question to address was which fragmentation processes prevail in which basic cloud-types. The approach was to use cloud models and field observations, while pioneering our own lab observations of ice initiation to break the deadlock from the past lack of lab observations. Historically, the tendency of the cloud physics community to avoid doing lab observations has allowed a vast gap in knowledge about ice initiation to persist for decades. During the first part of the project, new formulations were created to treat two overlooked types of fragmentation of ice. First, sublimational breakup of ice was treated based on a theoretical formula that we fitted to a pooled dataset of lab observations published previously in the literature. Second, a new mode of fragmentation of freezing raindrops was treated, which involves a supercooled drop being hit by a more massive ice particle. Some of the secondary droplets from the impact freeze. This work was done at Manchester University by Co-I Connolly. Then during the second part, both formulations were implemented in our ‘aerosol-cloud model’ (AC). AC has a hybrid bin/bulk microphysics scheme, and now represents four processes of SIP. The accuracy of AC was evaluated for four cases typifying four basic cloud-types: slightly cold-based stratiform cloud and cold-, warm- and very warm-based convective clouds. We discovered that the warmth of cloud-base, especially in the tropics, promotes SIP processes of raindrop-freezing fragmentation and rime-splintering, and surprisingly, sublimational breakup too. It was found that breakup in ice-ice collisions is ubiquitous. Finally, a portable laboratory chamber was constructed at Lund and deployed in northern Sweden to observe breakup in graupel-snow collisions outdoors. This was seen to be even more prolific than treated in our 2018 formulation. Papers describing results are either published or soon to be published.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

pnnl/Lagrangian-Droplets

The Lagrangian Droplet cloud microphysics scheme uses high-resolution data of air velocity, temperature, and water vapor mixing ratio to drive particle-based simulations of cloud microphysics. The model was first implemented using a high-resolution Large Eddy Simulation of the Pi Chamber at Michigan Tech, which is small-scale convection chamber the generates clouds in a laboratory setting

Fierce, Laura [Pacific Northwest National Laborato↗