Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cloud systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Machine learning reveals strong grid-scale dependence in the satellite N d –LWP relationship

The relationship between cloud droplet number concentration ( N d ) and liquid water path (LWP) is highly uncertain yet crucial for determining the impact of aerosol-cloud interactions (ACI) on Earth's radiation budget. The N d -LWP relationship is examined using a machine learning (ML) random forest model applied to five years of satellite data at grid resolutions ranging from 10° to 0.05° in 12 distinct regions. In the subtropics, the shape of the N d -LWP relationship switches from an inverted-V at 1° grid-resolution to an “M” shape at 0.1° resolution with decreased $\frac{\textrm{dln⁡LWP}}{\textrm{dln⁡}N_d}$ sensitivity. Tropical and midlatitude regions generally show a more positive sensitivity. Cloud sampling and filtering also influence this slope, wherein the exclusion of thin clouds, as commonly performed to reduce retrieval uncertainty, leads to strongly negative sensitivity across all regions. Precipitation is primarily responsible for driving the strength of the sensitivity, with strong positive slopes in raining clouds and negative and/or neutral responses found in non-raining clouds. A new method to compute radiative forcing from the ML model shows a robust Twomey radiative forcing across all regions and grid resolutions. However, LWP and cloud fraction adjustments to the radiative forcing, which are ∼50 % or smaller than the Twomey effect, decrease to negligible values with higher spatial resolution data. As Earth system models move toward higher spatial resolutions in the future, evaluating the LWP and CF adjustment contributions to the radiative forcing budget at these finer resolutions will be essential for evaluation and model development.

Aerosol-Cloud Interactions↗
DOE OSTI2021

Real-time Data Analytics for Condition Monitoring of Complex Industrial Systems

Modern industrial systems are now fitted with several sensors for condition monitoring. This is advantageous because these sensors can provide mass amounts of data that have the potential for aiding in tasks such as fault detection, diagnosis, and prognostics. However, the information valuable for performing these tasks is often clouded in noise and must be mined from high-dimensional data structures. Therefore, this dissertation presents a data analytics framework for performing these condition monitoring tasks using high-dimensional data. Demonstrations of this framework are detailed for challenges related to power generation systems in automobiles, power plants, and aircraft engines. These implementations leverage data collected from state-of-the-art, industry class test-rigs. Results indicate the ability of this framework to develop effective methodologies for condition monitoring of complex systems.

Peters, Benjamin↗
DOE OSTI2023

Evaluation of present-day extreme precipitation over the United States: an inter-comparison of convection and dynamic permitting configurations of E3SMv1

Abstract Accurate simulation of the present-day characteristics of mean and extreme precipitation at regional scales remains a challenge for Earth system models, which is due in part to deficiencies in model physics such as convective parameterization (CP), and coarse resolution. High horizontal resolution (HR, ∼25 km) and multiscale modeling framework (MMF, i.e. replacing conventional CP with embedded km-scale cloud-resolving models) are two promising directions that could help improve the interaction between subgrid-scale physical processes and large-scale climate. Here, we evaluate simulated extreme precipitation over the United States (US) across three configurations (i.e. low-resolution [LR], HR, and MMF) of the Energy Exascale Earth System Model (E3SMv1) and intercompare them against two gridded observation datasets (climate prediction center daily US precipitation and integrated multi-satellite retrievals for global precipitation measurement). We assess the model’s ability to simulate very heavy seasonal precipitation (illustrated by the difference between the 99th and 90th percentile values) as well as the spatial distributions of several extreme precipitation indices defined by the expert team on climate change detection and indices. Our results show that both the dry (i.e. consecutive dry days (CDD)) and wet (i.e. consecutive wet days, maximum 5 day precipitation, and very wet days) extremes evaluated herein show some improvement as well as degradation with MMF and HR relative to LR. These results vary across seasons and US subregions. For instance, only the very heavy precipitation of winter is improved with MMF and HR. Both configurations alleviate the well-known drizzling bias evident in LR across both winter and summer in many parts of the US, largely due to the overall improvement in intensity and frequency of precipitation. Additionally, our results suggest that while E3SMv1-MMF has higher intensity rates when it does rain, it has too many CDD during the summer, contributing to a low mean precipitation bias.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Smart Monitoring and Diagnostic System (SMDS) for Packaged Air Conditioners and Heat Pumps for Small/Medium Commercial Buildings: Preparation for Commercialization: CRADA 478 [Abstract only]

This project will enable Pacific Northwest National Laboratory (PNNL) and industry partner, mCloud Technologies, to work collaboratively to ready the Smart Monitoring and Diagnostic System (SMDS) for commercial deployment and validate its performance under real-world conditions at field sites. This project will specifically focus on 1) implementing the SMDS algorithms in a scalable cloud-based software architecture, 2) designing new, innovative, complimentary commercial services based on the SMDS, 3) enhancing the SMDS energy and cost impact algorithms to reduce uncertainty in estimates, 4) determining the lower limits on SMDS performance degradation detection, 5) validating algorithm performance and default values of adjustable thresholds with existing data from controlled physical testing and from customer packaged air conditioners and heat pumps (commonly referred to as rooftop units or RTUs), 6) field testing to validate the system on multiple customer buildings in diverse environments, and 7) expanding field deployment to a larger set of mCloud’s customer buildings. Project results by validating, enhancing, and quantifying the performance of the SMDS will position mCloud, and potential future licensees, to implement the SMDS in commercial offerings that encourage and enable use of condition-based and predictive maintenance, leading to significant reductions in energy use and greenhouse gas emissions associated with space conditioning by RTUs. Furthermore, these enhancements will increase the value of the SMDS for users and increase the potential market for its use and impacts.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Identifying a regional aerosol baseline in the eastern North Atlantic using collocated measurements and a mathematical algorithm to mask high-submicron-number-concentration aerosol events

Abstract. High-time-resolution measurements of in situ aerosol and cloud properties provide the ability to study regional atmospheric processes that occur on timescales of minutes to hours. However, one limitation to this approach is that continuous measurements often include periods when the data collected are not representative of the regional aerosol. Even at remote locations, submicron aerosols are pervasive in the ambient atmosphere with many sources. Therefore, periods dominated by local aerosol should be identified before conducting subsequent analyses to understand aerosol regional processes and aerosol–cloud interactions. Here, we present a novel method to validate the identification of regional baseline aerosol data by applying a mathematical algorithm to the data collected at the U.S. Department of Energy's (DOE) Atmospheric Radiation Measurement (ARM) user facility in the eastern North Atlantic (ENA). The ENA central facility (C1) includes an aerosol observing system (AOS) for the measurement of aerosol physical, optical, and chemical properties at time resolutions from seconds to minutes. A second temporary supplementary facility (S1), located ∼0.75 km from C1, was deployed for ∼1 year during the Aerosol and Cloud Experiments (ACE-ENA) campaign in 2017. First, we investigate the local aerosol at both locations. We associate periods of high submicron number concentration (Ntot) in the fine-mode condensation particle counter (CPC) and size distributions from the Ultra-High Sensitivity Aerosol Spectrometer (UHSAS) as a function of wind direction using a meteorology sensor with local sources. Elevated concentrations of Aitken-mode (< 100 nm diameter) particles were observed in correspondence with the wind directions associated with airport operations. At ENA, the Graciosa Airport and its associated activities were found to be the main sources of high-concentration aerosol events at ENA, causing peaks in 1 min Ntot that exceeded 8000 and 10 000 cm−3 at C1, in summer and winter, respectively, and 5000 cm−3 at S1 in summer. Periods with high Ntot not associated with these wind directions were also observed. As a result, the diverse local sources at ENA yielded a poor relationship between Ntot measurements collected at C1 and S1 (R2=0.03 with a slope =0.05±0.001). As a first approach to mask these events, the time periods when the wind direction was associated with the airport operations (west to northwest and southeast to south at C1 and east to south at S1) were applied. The meteorological masks removed 38.9 % of the data at C1 and 43.4 % at S1, and they did not significantly improve the relationship between the two sites (R2=0.18 with a slope =0.06±0.001). Due to the complexity of high-Ntot events observed at ENA, we develop and validate a mathematical ENA Aerosol Mask (ENA-AM) to identify high-Ntot events using 1 min resolution data from the AOS CPC at C1 and S1. After its parameterization and application, ENA-AM generated a high correlation between Ntot in the summer at C1 and S1 (R2=0.87 with a slope =0.84±0.001). We identified the regional baseline at ENA to be 428±228 cm−3 in the summer and 346±223 cm−3 in the winter. Lastly, we compared masked measurements from the AOS with the ARM Aerial Facility (AAF) during flights over C1 in the summer to understand submicron aerosol vertical mixing over C1. The high correlation (R2=0.71 with a slope of 1.04±0.01) observed between C1 and the AAF Ntot collected within an area of 10 km surrounding ENA and at altitudes < 500 m indicated that the submicron aerosol at ENA was well mixed within the first 500 m of the marine boundary layer during the month of July during ACE-ENA. Our novel method for determining a regional aerosol baseline at ENA can be applied to other time periods and at other locations with validation by a secondary site or additional collocated measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Revealing the structure of light pseudoscalar mesons at the electron–ion collider

The questions of how the bulk of the Universe's visible mass emerges and how it is manifest in the existence and properties of hadrons are profound, and probe the heart of strongly interacting matter. Paradoxically, the lightest pseudoscalar mesons appear to be key to a further understanding of the emergent mass and structure mechanisms. These mesons, namely, the pion and kaon, are the Nambu-Goldstone boson modes of quantum chromodynamics (QCD). Unravelling their partonic structure and the interplay between emergent and Higgs-boson mass mechanisms is a common goal of three interdependent approaches - continuum QCD phenomenology, lattice-regularised QCD, and the global analysis of parton distributions - linked to experimental measurements of hadron structure. Experimentally, the anticipated electron-ion collider will enable a revolution in our ability to study pion and kaon structures, accessed by scattering from the 'meson cloud' of the proton through the Sullivan process. With the goal of enabling a suite of measurements that can address these questions, we examine key reactions that identify the critical detector-system requirements needed to map tagged pion and kaon cross-sections over a wide range of kinematics. The excellent prospects for extracting pion structural, functional, and form-factor data are outlined, and similar prospects for kaon structures are discussed in the context of a worldwide programme. Finally, the successful completion of the programme outlined herein will deliver deep, far-reaching insights into the emergence of pions and kaons, their properties, and their role as QCD's Goldstone boson modes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Soft x-ray spectroscopy of ammonium sulfate aerosols at varied pH conditions

Aqueous aerosols are useful model systems for understanding the physical chemistry that takes place in the Earth’s atmosphere, as well as the chemistry of other solar system objects. Ammonium sulfate aerosols are impacted by anthropogenic sources such as farming and shipping and are understood to be important seeds of cloud nucleation in the atmosphere, affecting climate. X-ray photoelectron spectroscopy and near edge x-ray absorption fine structure spectroscopy were used in tandem to probe the surface and bulk properties of aqueous (NH 4 ) 2 SO 4 , respectively. Aerosolized solutions of (NH 4 ) 2 SO 4 , some altered with NaOH to modify pH, were introduced via an aerodynamic lens to a velocity map imaging instrument for detection. The results show that as pH and sodium cation concentration increase, sulfate anion and ammonia become more prevalent at the surface, and the aerosol surface appears to become drier. However, most of the aerosol remains aqueous, with ion concentrations insensitive to the addition of NaOH. Density functional theory calculations were also performed to probe the coordination environment at the aerosol surfaces to understand the underlying phenomena. Finally, the changes seen on the surface of the aerosol underscore the importance of pH in regulating the structure and chemical properties of atmospherically relevant aerosols.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Virtual Log-Structured Storage for High-Performance Streaming

Over the past decade, given the higher number of data sources (e.g., Cloud applications, Internet of things) and critical business demands, Big Data transitioned from batch-oriented to real-time analytics. Stream storage systems, such as Apache Kafka, are well known for their increasing role in real-time Big Data analytics. For scalable stream data ingestion and processing, they logically split a data stream topic into multiple partitions. Stream storage systems keep multiple data stream copies to protect against data loss while implementing a stream partition as a replicated log. This architectural choice enables simplified development while trading cluster size with performance and the number of streams optimally managed. This paper introduces a shared virtual log-structured storage approach for improving the cluster throughput when multiple producers and consumers write and consume in parallel data streams. Stream partitions are associated with shared replicated virtual logs transparently to the user, effectively separating the implementation of stream partitioning (and data ordering) from data replication (and durability). We implement the virtual log technique in the KerA stream storage system. When comparing with Apache Kafka, KerA improves the cluster ingestion throughput by up to 4x when multiple producers write over hundreds of data streams.

consistent stream ordering↗
DOE OSTI2020

rlmolecule: A library for general-purpose material and molecular optimization using AlphaZero-style reinforcement learning

This library includes in-progress code for the optimization of materials and molecules using reinforcement learning. This project seeks to develop a generalized machine learning approach for optimizing targeted, and often complex, functional properties over the space of possible material structures, allowing faster identification of promising candidates. Electronic and transport properties of materials are determined by their molecular structure (for molecules) or their crystal structure (for in-organic crystalline materials). The atomic composition, bonding, and 3-D-spatial arrangement in these systems therefore represent a vast, discontinuous search space for optimal candidates. This library implements AlphaZero style reinforcement learning applied to two worked examples: the optimization of stable organic radicals for redox flow batteries, and the determination of stable electrolyte species for solid state batteries. The current code contains proof-of-concept results run on the Eagle HPC system, while the completed package will be a flexible tool for material optimization across of number of energy-relevant fields, which leverages cloud compute resources for the majority of the computational heavy lifting.

Biagioni, David↗
DOE OSTI2025

Workflow for Process Automation of Soil Gas Results from an Automated Soil Gas-Sampling System for Application in Carbon Storage Projects

Conference presentation at Geoconvention, Calgary, Alberta, Canada, May 12–14, 2025. The Energy & Environmental Research Center (EERC) developed an automated workflow for processing soil gas measurements collected from the automated soil gas-sampling systems deployed across the project site. Raw soil gas measurements are collected from each station every 4 hours and automatically uploaded to a cloud database. The workflow begins by writing code to download the data to a workstation automatically, then the data are published to an online dashboard that visualizes the measurements in time-series plots and a process-based decision-making framework. This automated workflow accelerates the time from data acquisition to decision-making. It supports carbon storage project operators by preparing and delivering a live, standardized dataset for quick analysis and source attribution to provide assurance of containment and overall permit compliance.

02 PETROLEUM↗
DOE OSTI2026

Future Generation High Performance Computing Center (FG-HPCC): RFI Technical Considerations

Lawrence Livermore National Security, LLC (LLNS) is interested in receiving information about technologies that could be available in the 2029-2030 timeframe that may serve to enable the vision for a Future Generation High Performance Computing (HPC) Center (FG-HPCC) described in this document. The future HPC Center vision has been conceived to meet the future mission needs of the Advanced Simulation and Computing (ASC) Program within the National Nuclear Security Administration (NNSA). LLNS envisions a center composed not of many independent clusters, but of heterogeneous elements accessible to users as a single system. The capabilities will be integrated to create a scalable, flexible, yet tightly coupled computing center capable of integrated HPC, AI, and cloud-like workloads.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Workflow for Process Automation of Soil Gas Results from an Automated Soil Gas-Sampling System for Application in Carbon Storage Projects

Extended abstract for Geoconvention, Calgary, Alberta, Canada, May 12–14, 2025. The Energy & Environmental Research Center (EERC) developed an automated workflow for processing soil gas measurements collected from the automated soil gas-sampling systems deployed across the project site. Raw soil gas measurements are collected from each station every 4 hours and automatically uploaded to a cloud database. The workflow begins by writing code to download the data to a workstation automatically, then the data are published to an online dashboard that visualizes the measurements in time-series plots and a process-based decision-making framework. This automated workflow accelerates the time from data acquisition to decision-making. It supports carbon storage project operators by preparing and delivering a live, standardized dataset for quick analysis and source attribution to provide assurance of containment and overall permit compliance.

02 PETROLEUM↗
DOE OSTI2024

DEM, DSM, and Cleaned LiDAR Point Cloud Data from the NGEE Arctic UAS Campaigns at the Teller 27 Field Site from 2017 and 2018, Seward Peninsula, Alaska

A Digital Elevation Model (DEM) and Digital Surface Model (DSM) were derived from airborne Light Detection and Ranging (LiDAR) data collected from Los Alamos National Laboratory's (LANL) heavy-lift unoccupied aerial system (UAS) quadcopter and hexacopter platforms operated by Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) scientists from the EES-14 group at LANL. These data were collected in August 2017 and July 2018 at the NGEE Arctic field site near mile marker 27 of the Bob Blodgett Nome-Teller Memorial Highway between Nome, Alaska and Teller, Alaska. A Vulcan Raven X8 Airframe (Mitcheldean, Gloucestershire, UK), DJI Matrice 600 Pro Airframe (Shenzhen, China), and Routescene UAV LiDARSystem (Edinburgh, Scotland, UK) were used to collect LiDAR data. Following pre-processing in Routescene LidarViewer Pro software, the LiDAR point clouds were cleaned and processed using CloudCompare software to separate ground and off-ground points. A high resolution DEM and DSM were then created using ArcGIS Pro software. This data package contains fully cleaned point clouds of ground and off-ground points (.las), a 25 cm DEM (.tif), and a 25 cm DSM (.tif) for the Teller 27 field site. Ancillary aircraft data, flight mission parameters, weather conditions, and raw lidar data and imagery can be found in the L0 datasets for these campaigns: NGA299 (2017) and NGA297 (2018). Minimally processed point clouds and auxiliary files can be found in the L1 dataset: NGA304 (2017 and 2018).The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Large Aerosol Particles Favor Haze Conditions Through Limitations on Water Budget and Activation Kinetics

Experiments in the Pi Convection‐Cloud Chamber conducted by systematically changing the diameter of injected dry aerosol particles while holding the temperature difference constant demonstrate that dry diameter strongly influences the onset of haze‐dominated conditions. Two factors contribute: the system becomes water‐limited, resulting in reduction of supersaturation by growing aerosol particles to the activation diameter; and the activation process becomes kinetically limited. Dry aerosol diameter exerts a strong influence on activation time, with a power‐law exponent of 9/2. Kinetically limited activation occurs when the ratio of the activation and droplet residence times is greater than unity. The findings demonstrate that a haze‐dominated state, where cloud formation is suppressed, can be achieved not only with weak supersaturation forcing and high aerosol concentration but also with large, hygroscopic aerosol particles. These results have implications for cloud formation in polluted environments, fog development near the ocean, and hygroscopic cloud seeding.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

PyFLEXTRKR: a flexible feature tracking Python software for convective cloud analysis

Abstract. This paper describes the new open-source framework PyFLEXTRKR (Python FLEXible object TRacKeR), a flexible atmospheric feature tracking software package with specific capabilities to track convective clouds from a variety of observations and model simulations. This software can track any atmospheric 2D objects and handle merging and splitting explicitly. The package has a collection of multi-object identification algorithms, scalable parallelization options, and has been optimized for large datasets including global high-resolution data. We demonstrate applications of PyFLEXTRKR on tracking individual deep convective cells and mesoscale convective systems from observations and model simulations ranging from large-eddy resolving (∼100s m) to mesoscale (∼10s km) resolutions. Visualization, post-processing, and statistical analysis tools are included in the package. New Lagrangian analyses of convective clouds produced by PyFLEXTRKR applicable to a wide range of datasets and scales facilitate advanced model evaluation and development efforts as well as scientific discovery.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Using Pilot Jobs and CernVM File System for Simplified Use of Containers and Software Distribution

High Energy Physics (HEP) experiments entail an abundance of computing resources, i.e. sites, to run simulations and analyses by processing data. This requirement is fulfilled by local batch farms, grid sites, private/commercial clouds, and supercomputing centers via High Throughput Computing (HTC). The growing needs of such experiments and resources being prone to trends of heterogeneity make it difficult for physicists to handle these resources directly. Additionally, HEP collaborations heavily rely on data and software releases, typically in the order of tens of gigabytes, while conducting simulations and analyses. Hence, aspects of scalability, reliability, and maintenance become crucial with regards to the distribution of the necessary data and software stack. The GlideinWMS [4] framework helps with the resource management problem by using pilot jobs, aka Glideins, to provision reliable elastic virtual clusters. Glideins are submitted to unreliable heterogeneous resources which are validated and customized by the Glideins to make the worker nodes available for end-user job execution. On the other hand, the CernVM File System (CernVM-FS or CVMFS) [1] helps with data distribution. It is a write-once, read-everywhere filesystem used to deploy scientific software to thousands of nodes on a worldwide distributed computing infrastructure. CVMFS is based on the Hyper Text Transfer Protocol and has been widely used within the particle physics community for (1) distributing experiment software and data such as calibrations, and (2) facilitating containerization by efficiently hosting container images along with providing containerization software, especially Singularity [3] GlideinWMS relies on CVMFS installed locally on the computing resources to satisfy the experiments' software needs. This requires system administrators' effort to install and maintain CVMFS at the sites and limits the use of sites, especially HPC resources, that do not have CVMFS installed. This poster presents a solution, taking advantage of Glideins to provide CVMFS at most sites without the need for a local installation. Doing so expands the pool of resources available for HEP experiments and reduces the effort of system administrators for current resources. Additionally, the proposed solution allows GlideinWMS to also start Singularity [3], a containerization software that can run unprivileged, on sites where neither CVMFS nor Singularity are available, including HPC sites. The benefits provided by this solution are: (1) lower overhead for site administrators in that they have less software to install, (2) an expanded pool of resources that run user jobs with easy access to software and data provided by CVMFS, thus making life easier for the scientists, and (3) improved flexibility to use HPC resources by enabling GlideinWMS pilot jobs to support HPC sites.

Urs, Namratha↗
DOE OSTI2025

torc (Torc Workflow Management System) [SWR-24-127]

This software package orchestrates execution of a workflow of jobs on distributed computing resources. It is optimized for use on HPCs with Slurm, but also can be used in the cloud and on local computers. Please refer to the documentation at https://nrel.github.io/torc

Thom, Daniel [National Renewable Energy Laboratory↗