Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cloud systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Three-dimensional phenotyping of peach tree-crown architecture utilizing terrestrial laser scanning

Tree training systems for temperate fruit have been developed throughout history by pomologists to improve light interception, fruit yield, and fruit quality. These training systems direct crown and branch growth to specific configurations. Quantifying crown architecture could aid the selection of trees that require less pruning or that naturally excel in specific growing/training system conditions. Regarding peaches [Prunus persica (L.) Batsch], access tools such as branching indices have been developed to characterize tree-crown architecture. However, the required branching data (BD) to develop these indices are difficult to collect. Traditionally, BD have been collected manually, but this process is tedious, time-consuming, and prone to human error. These barriers can be circumnavigated by utilizing terrestrial laser scanning (TLS) to obtain a digital twin of the real tree. TLS generates three-dimensional (3D) point clouds of the tree crown, wherein every point contains 3D coordinates (x, y, z). To facilitate the use of these tools for peach, we selected 16 young peach trees scanned in 2021 and 2022. These 16 trees were then modeled and quantified using the open-source software TreeQSM. As a result, “in silico” branching and biometric data for the young peach trees were calculated to demonstrate the capabilities of TLS phenotyping of peach tree-crown architecture. The comparison and analysis of field measurements (in situ) and in silico BD, biometric data, and quantitative structural model branch uncertainty data were utilized to determine the reconstructive model’s reliability as a source substitute for field measurements. Mean average deviation when comparing young tree (YT) height was approx. 5.93%, with crown volume was approx. 13.26% across both 2021 and 2022. All point clouds of the YTs in 2022 showed residuals lower than 12 mm to cylinders fitted to all branches, and mean surface coverage greater than 40% for both the trunk and primary branching orders.

09 BIOMASS FUELS↗
DOE OSTI2021

Identifying the sources of uncertainty in climate model simulations of solar radiation modification with the G6sulfur and G6solar Geoengineering Model Intercomparison Project (GeoMIP) simulations

We present here results from the Geoengineering Model Intercomparison Project (GeoMIP) simulations for the experiments G6sulfur and G6solar for six Earth system models participating in the Climate Model Intercomparison Project (CMIP) Phase 6. The aim of the experiments is to reduce the warming that results from a high-tier emission scenario (Shared Socioeconomic Pathways SSP5-8.5) to that resulting from a medium-tier emission scenario (SSP2-4.5). These simulations aim to analyze the response of climate models to a reduction in incoming surface radiation as a means to reduce global surface temperatures, and they do so either by simulating a stratospheric sulfate aerosol layer or, in a more idealized way, through a uniform reduction in the solar constant in the model. We find that over the final two decades of this century there are considerable inter-model spreads in the needed injection amounts of sulfate (29 ± 9 Tg-SO 2 /yr between 2081 and 2100), in the latitudinal distribution of the aerosol cloud and in the stratospheric temperature changes resulting from the added aerosol layer. Even in the simpler G6solar experiment, there is a spread in the needed solar dimming to achieve the same global temperature target (1.91 ± 0.44 %). The analyzed models already show significant differences in the response to the increasing CO 2 concentrations for global mean temperatures and global mean precipitation (2.05 K ± 0.42 K and 2.28 ± 0.80 %, respectively, for SSP5-8.5 minus SSP2-4.5 averaged over 2081–2100). With aerosol injection, the differences in how the aerosols spread further change some of the underlying uncertainties, such as the global mean precipitation response (–3.79 ± 0.76 % for G6sulfur compared to –2.07 ± 0.40 % for G6solar against SSP2-4.5 between 2081 and 2100). These differences in the behavior of the aerosols also result in a larger uncertainty in the regional surface temperature response among models in the case of the G6sulfur simulations, suggesting the need to devise various, more specific experiments to single out and resolve particular sources of uncertainty. The spread in the modeled response suggests that a degree of caution is necessary when using these results for assessing specific impacts of geoengineering in various aspects of the Earth system. However, all models agree that compared to a scenario with unmitigated warming, stratospheric aerosol geoengineering has the potential to both globally and locally reduce the increase in surface temperatures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Demonstrating Hierarchical System Development With the Common Community Physics Package Single‐Column Model: A Case Study Over the Southern Great Plains

This study demonstrates a specific application of the hierarchical system development (HSD) approach to investigate, analyze, and attribute model issues within the Unified Forecast System (UFS), with a focus on process isolation. By evaluating a non‐precipitating, shallow cumulus case at the Atmospheric Radiation Measurement Southern Great Plains site in the UFS global forecast against the observation, the investigation identifies a warmer and deeper daytime convective planetary boundary layer (PBL) and misrepresented nocturnal PBL transition. Hypothesis testing, which employs the Common Community Physics Package (CCPP) single‐column model (SCM) and uses the same physics as the UFS global model, confirms that these issues are attributed to the model physics and initialization. Specifically, misrepresented PBL processes are linked to problematic surface condition and a lack of cloud formation, which may stem from deficiencies in PBL and cloud microphysics parameterizations and their interactions. The UFS initial condition contributes to an earlier, excessively collapsed daytime convective boundary layer and a lack of decoupling between the stable boundary layer and residual layer late in the afternoon. This work introduces an avenue for the community to engage with the application of HSD, along with the CCPP and CCPP SCM, to understand the interplay of model physics, disentangle the roles of model components, as well as facilitate model and forecast improvement.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Towards accelerating particle-resolved direct numerical simulation with neural operators

In this paper, we present our ongoing work aimed at accelerating a particle-resolved direct numerical simulation model designed to study aerosol–cloud–turbulence interactions. The dynamical model consists of two main components—a set of fluid dynamics equations for air velocity, temperature, and humidity, coupled with a set of equations for particle (i.e., cloud droplet) tracing. Rather than attempting to replace the original numerical solution method in its entirety with a machine learning (ML) method, we consider developing a hybrid approach. We exploit the potential of neural operator learning to yield fast and accurate surrogate models and, in this study, develop such surrogates for the velocity and vorticity fields. We discuss results from numerical experiments designed to assess the performance of ML architectures under consideration as well as their suitability for capturing the behavior of relevant dynamical systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

The Energy Exascale Earth System Model Simulations With High Vertical Resolution in the Lower Troposphere

Abstract General circulation models (GCMs) are typically run with coarse vertical resolution. For example, the Energy Exascale Earth System Model (E3SM) has a vertical resolution of about 200 m in the boundary layer, which is far too coarse to resolve sharp gradients often found in the thermodynamic fields capping subtropical marine stratocumulus. In this article, we present a series of multiyear atmosphere only simulations of E3SM version 1 where we progressively increase the vertical resolution in the lower troposphere to scales approaching those often used in large eddy simulation (LES). We report marginal impacts in regards to the simulation of boundary layer clouds when vertical resolution is moderately increased, yet find significant positive impacts when the vertical resolution approaches that typically used in LES (∼10 m). In these experiments, there is a marked change in the simulated turbulence and thermodynamics which leads to more abundant marine stratocumulus. However, these simulations are burdened with excessive computational cost. They are also subject to degradations in overall climate metrics due to time step sensitivities and because some processes and parameterizations are sensitive to changes in the vertical resolution.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Energy Exascale Earth System Model v2.0

First release of version 2 of the Energy Exascale Earth System Model. The atmosphere component remains EAM. Major changes since version 1 include: all column-physics parameterizations are computed on a separate grid that has approximately half the number of points of the dynamics grid, a new nonhydrostatic dynamical core (running in hydrostatic mode) with semi-Lagrangian tracer transport, CLUBB updated from v1 to v2, a new convective trigger (dCAPE/ULL) based on the dynamic Convective Available Potential Energy (CAPE) (dCAPE) and the Unrestricted Launch Level (ULL) concepts is used in ZM. minimum cloud droplet number changed, gravity wave drag energy conservation fixed and new tunings used, dust emission size distribution changed to emit more coarse dust particles The land component is still ELM. Major changes since version 1 include: using SNICAR-AD for radiation in snow to match the sea-ice model and fixing bugs in snow compaction and water state calculation. The ocean component remains MPAS-ocean. Major change since version 1 include: Redi isopycnal mixing has been updated, tested, and tuned in combination with the Gent-McWilliams parameterization, a sign error was fixed in the 3rd-order flux routines, the mesh used in low-resolution coupled cases was modified and the time steps adjusted, new regionally refined meshes were created, one focused on North America and another on the Southern Ocean, including ice shelf cavities. The sea-ice component remains MPAS-seaice. Major changes since version 1 include: A new heat- and freshwater-conserving coupling of frazil ice, turning off of SSH filtering, addition of SNICAR-AD and snow grain aging. The land-ice component remains MPAS-Albany-landIce (MALI) and is a static ice sheet. There is more out-of-the-box support for cryosphere configurations including the new regionally refined configuration around Antarctica with ice shelf cavities. The river model is MOSART. The half-degree river mesh was redone so it no longer treats Black and Caspian seas as ocean. The coupler remains cpl7/MCT. Major changes since version 1 include handling of ice shelf melt fluxes (heat / freshwater exchange with the ocean), and data icebergs. All components allow regional refinement of their meshes and two separate example of refinement, one in and around North America and one around Antarctica and the Southern Ocean, are provided.

E3SM Project, DOE↗
DOE OSTI2022

FORTE Measurements of Global Lightning Altitudes

While multiple lightning detection systems provide geographical locations of lightning events across the globe, robust lightning altitude measurements on a global scale have proven elusive. Space-based platforms have an advantageous viewing geometry for making these measurements, but prior studies with the Fast On-orbit Recording of Transient Events (FORTE) satellite were limited to a few thousand events. In this study, we apply the same technique for calculating source altitude from the previous efforts to a large catalog of hundreds of thousands of global FORTE in-cloud lightning events that were coincident with flashes geolocated by its lightning imager between 1997 and 2003. We use this new data set to document global variations in lightning altitude. As in previous studies, we find that FORTE primarily resolves sources from the upper (positive) charge layer at ~11 km altitude in normal thunderstorms. However, sources are also recorded from other charge layers in the storm and from leaders developing between layers. In particular, we note a pronounced increase in source altitude in the first 20 ms of FORTE flashes from the negative leader developing upward into the upper positive charge layer. Regions known for wintertime and/or stratiform lightning have increased contributions from low-altitude sources, while tropical regions particularly around Panama and the Maritime Continent have the greatest concentrations of high-altitude sources.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Testing of Fusion Machine Components Against Cryogenic Pellet Impacts

Shattered pellet injection (SPI), currently the most effective method of disruption mitigation, is currently implemented on tokamaks worldwide for experimental purposes. Cryogenic pellets are formed and fired into an angled surface before entering the plasma. The impact with the angled surface causes the pellets to fragment into a cloud of particles with the purpose of increasing the surface area for ablation. As pellets traverse guide tubes, depending on design, there is a chance of an off-normal pellet impact. Pellet impacts are also, depending on design, possible in the plasma chamber if not fully ablated and assimilated, or if the fragment plume is not directed in the proper direction. This paper outlines a series of pellet impact tests on various tiles and components relevant to the ITER, JET, and ASDEX Upgrade SPI systems. In conclusion, testing was done to assess the potential damage from pellet and fragment plume impacts through high-speed imaging and the visual inspection of components.

Cryogenic pellets↗
DOE OSTI2020

The Strong Impact of Weak Horizontal Convergence on Continental Shallow Convection

Idealized large-eddy simulation (LES) is a basic tool for studying three-dimensional turbulence in the planetary boundary layer. LES is capable of providing benchmark solutions for parameterization development efforts. However, real small-scale atmospheric flows develop in heterogeneous and transient environments with locally varying vertical motions inherent to open multiscale interactive dynamical systems. These variations are often too subtle to detect them by state-of-the-art remote and in situ measurements, and are typically excluded from idealized simulations. The present study addresses the impact of weak [i.e., O(10-6) s-1] short-lived low-level large-scale convergence/divergence perturbations on continental shallow convection. The results show a strong response of shallow nonprecipitating convection to the applied weak large-scale dynamical forcing. Evolutions of CAPE, mean liquid water path, and cloud-top heights are significantly affected by the imposed convergence/divergence. In contrast, evolving cloud-base properties, such as the area coverage and mass flux, are only weakly affected. To contrast those impacts with microphysical sensitivity, the baseline simulations are perturbed assuming different observationally based cloud droplet number concentrations and thus different rainfall. For the tested range of microphysical perturbations, the imposed convergence/divergence provides significantly larger impact than changes in the cloud microphysics. Simulation results presented here provide a stringent test for convection parameterizations, especially important for large-scale models progressing toward resolving some nonhydrostatic effects.

Meteorology & Atmospheric Sciences↗
DOE OSTI2025

High-Spectral Resolution Lidar (HSRL) Instrument Handbook

High-spectral-resolution lidar (HSRL) systems provide vertical profiles of optical depth, backscatter cross-section, depolarization, and backscatter phase function. All HSRL measurements are calibrated by reference to molecular scattering, which is measured at each point in the lidar profile. Like the Raman lidar (RL), but unlike simple backscatter lidars such as the micropulse lidar (MPL), this enables the HSRL to measure backscatter cross-sections and optical depths without prior assumptions about the scattering properties of the atmosphere. The depolarization observations allow robust discrimination between ice and water clouds. Rigorous error estimates can be computed for all measurements. A very narrow angular field of view reduces multiple scattering contributions. The small field of view, coupled with a narrow optical bandwidth, nearly eliminates noise due to scattered sunlight. The laser transmitter is a diode-pumped, frequency-doubled Nd:YAG laser. Narrow-band, single-frequency operation is provided by injection seeding with a single-frequency, cw-diode-pumped diode laser. The main laser cavity is maintained in resonance with the seed laser by adjusting the cavity length to minimize the time between the Q-switch trigger and the emission of the laser pulse. The emission wavelength is tuned via temperature control of the seed laser crystal and is locked to line #1109 of the iodine absorption spectra. Locking is accomplished by minimizing the transmission through a 2-cm-long iodine absorption cell. Use of a high-repetition-rate laser and expansion of the transmitted beam through a 400-mm telescope reduces the transmitted energy density to eye-safe levels. It is possible to look directly into the output beam without hazard. The receiver and transmitter use the same afocal telescope, simplifying the maintenance of stable alignment of the transmitter and receiver although the angular FOV is only 100 μrad. The small FOV and the 4-kHz repetition rate also limit the near-field signal strength, making it possible to record continuous profiles that start at an altitude of ~100 m and extend to 30 km using photon counting detectors. The small FOV also suppresses multiple scattering contributions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

CO 2 Storage Site Screening Platform Development and CO 2 Storage Resource Analysis in SECARB Offshore Reservoirs Using SAS Viya

A major goal of the SECARB Offshore Partnership (DE-FE0031557) is to screen deep saline aquifers and hydrocarbon reservoirs in the central Gulf of Mexico for CO 2 sequestration and CO 2 -enhanced oil and gas recovery (EOR/EGR) and estimate the corresponding CO 2 storage resources for select reservoirs. CO 2 storage potential associated with offshore CO 2 -EOR is considerable and likely represents “low hanging fruit” for near-term CO 2 storage given the in-place infrastructure in the region. It is for these reasons that this assessment focuses on oil and gas fields. To this end, three major objectives have been completed and include (1) managing geological data derived from different sources, (2) building a reservoir screening platform for CO 2 storage, and (3) ranking the reservoirs based on the estimated CO 2 storage resources. The SAS ® Viya platform was used for data management and analytics. The Viya platform is a cloud service platform that provides data integration, data management, quick analytics, data visualization, machine learning functions, and application programming interfaces (APIs) for multi-programming languages. Different sources of data containing geologic information, reservoir properties, and EOR/EGR information were collected, cleaned, formatted, and loaded into the SAS ® Viya platform for evaluation. The major geological characteristics of both shelf and deep-water areas of the central Gulf were examined and compared to define the appropriate reservoir screening criteria. Next, a CO 2 storage site screening system was built in the SAS ® Viya platform with the pre-defined criteria. Finally, the CO 2 storage resources of the screened reservoirs were calculated and reported at the BOEM field level to identify fields with the highest estimated CO 2 storage resource. The fields with the largest total estimated CO 2 storage resource are located in the Mississippi Canyon protraction area. Due to proximity to the Mississippi Delta (indicative of less infrastructure) and large estimated CO 2 storage resources, future development activities may wish to focus efforts in the Mississippi Canyon protraction area.

02 PETROLEUM↗
DOE OSTI2021

Quantifying and attributing time step sensitivities in present-day climate simulations conducted with EAMv1

Abstract. This study assesses the relative importance of time integration error in present-day climate simulations conducted with the atmosphere component of the Energy Exascale Earth System Model version 1 (EAMv1) at 1∘ horizontal resolution. We show that a factor-of-6 reduction of time step size in all major parts of the model leads to significant changes in the long-term mean climate. Examples of changes in 10-year mean zonal averages include the following: up to 0.5 K of warming in the lower troposphere and cooling in the tropical and subtropical upper troposphere, 1 %–10 % decreases in relative humidity throughout the troposphere, and 10 %–20 % decreases in cloud fraction in the upper troposphere and decreases exceeding 20 % in the subtropical lower troposphere. In terms of the 10-year mean geographical distribution, systematic decreases of 20 %–50 % are seen in total cloud cover and cloud radiative effects in the subtropics. These changes imply that the reduction of temporal truncation errors leads to a notable although unsurprising degradation of agreement between the simulated and observed present-day climate; to regain optimal climate fidelity in the absence of those truncation errors, the model would require retuning. A coarse-grained attribution of the time step sensitivities is carried out by shortening time steps used in various components of EAM or by revising the numerical coupling between some processes. Our analysis leads to the finding that the marked decreases in the subtropical low-cloud fraction and total cloud radiative effect are caused not by the step size used for the collectively subcycled turbulence, shallow convection, and stratiform cloud macrophysics and microphysics parameterizations but rather by the step sizes used outside those subcycles. Further analysis suggests that the coupling frequency between the subcycles and the rest of EAM significantly affects the subtropical marine stratocumulus decks, while deep convection has significant impacts on trade cumulus. The step size of the cloud macrophysics and microphysics subcycle itself appears to have a primary impact on cloud fraction in the upper troposphere and also in the midlatitude near-surface layers. Impacts of step sizes used by the dynamical core and the radiation parameterization appear to be relatively small. These results provide useful clues for future studies aiming at understanding and addressing the root causes of sensitivities to time step sizes and process coupling frequencies in EAM. While this study focuses on EAMv1 and the conclusions are likely model-specific, the presented experimentation strategy has general value for weather and climate model development, as the methodology can help researchers identify and understand sources of time integration error in sophisticated multi-component models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

The WRF-Solar Ensemble Prediction System: Development, Test, and Validation

Providing reliable probabilistic solar radiation information is needed to improve management of the uncertainty and variability of solar generation. Thus, guidance on how to develop skillful and accurate ensemble forecasts is essential and it will ultimately contribute to integration of high amounts of solar energy on the grid. A team from the National Renewable Energy Laboratory and the National Center for Atmospheric Research had been collaborating to develop the WRF-Solar ensemble prediction system (WRF-Solar EPS) in the past three years to produce probabilistic solar irradiance forecasts and better predict solar energy by quantifying forecast uncertainty. The WRF-Solar EPS basically generates ensemble members for solar irradiance based on stochastic perturbations to provide intraday and day-ahead probabilistic forecasts. This study will present main research steps in developing the WRF-Solar EPS including: (a) tangent linear analysis for identifying key input variables of six WRF-Solar modules significantly related to predicting of cloud and solar irradiance, (b) combining stochastic perturbation technique with the WRF-Solar model, and (c) ensemble calibration method to decrease error and uncertainty of ensemble-based solar forecasts. The capability of WRF-Solar EPS is now updated to the most recent version of standard WRF model. This presentation will summarize comprehensive results from the evaluation of forecasts against the National Solar Radiation Data Base as well as ground-measured observations. Moreover, we will introduce the user's guide for WRF-Solar EPS (e.g., parameters to configure stochastic perturbations) and future extension of this research.

day-ahead forecast↗
DOE OSTI2023

Methods for Mapping of Surface Charge Density on Arbitrary Dielectric Objects

A system to map surface charge densities on dielectric objects – e.g. PTFE, PMMA, and PA6 – is described to study maximum surface charge limits discharge and decay characteristics. Two electromechanical movements are used to achieve these goals: a three-axis robotic arm with an electrostatic probe and a three-axis auxiliary movement fitted with a current viewing resistor and laser displacement sensor. Dielectric objects no larger than a cylinder of eight-inch diameter and twelve inches in height are analyzed to create surface point clouds and generate a set of scan points. The arbitrary object is positioned upon a rotational axis with a laser displacement sensor oriented radially towards the rotational axis of the platform to determine the object’s physical limits.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Impact of Global Warming on U.S. Summertime Mesoscale Convective Systems: A Simple Lagrangian Parcel Model Perspective

Abstract Mesoscale convective systems (MCSs) are the dominant rainfall producer over the United States during the warm season, causing natural disasters and severe weather every year. Global climate models have large uncertainty in projecting precipitation changes in the future climate. Here, a simple Lagrangian parcel model is used to investigate the impact of global warming on MCS initiation and growth. The single-column parcel model projects a mean precipitation decrease over the central United States and an increase to its east, in agreement with the CMIP5 model projection. It also highlights the crucial role of current climate mean-state model bias in exaggerating the change in future mean precipitation projection by 25%. As for convective population, the model captures the decreased occurrence frequency of weak to moderate convection and increased frequency of strong convection due to the increased CAPE and CIN, in agreement with convection-permitting regional simulations. Novel parameterizations of gust-front propagation speed and subsidence strength are developed as guided by cloud-resolving simulations. The multicolumn parcel model employing those parameterizations captures readily the cold pool–induced upscale growth feature. It simulates smaller mesoscale clusters over the central United States under global warming due to gust-front slowdown and subsidence strength enhancement, which are further attributed to land aridity–induced weakening of initial accumulated precipitation and strengthening of updraft speed, respectively. That said, mesoscale clusters could become bigger under more favorable conditions in future climate, including boundary layer moistening, convection lifetime lengthening, and cold pool mechanical-lifting enhancement, which require further investigations to improve mechanistic understanding of future MCS changes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

FORTE Measurements of Global Optical Lightning Waveforms and Implications for Optical Lightning Detection

Lightning processes generate a diverse collection of optical pulses from current traversing the lightning channels. These signals are then broadened spatially and temporally via scattering in the clouds. The resulting waveforms measured from space with instruments like the photodiode detector (PDD) on the Fast On-orbit Recording of Transient Events (FORTE) satellite have a variety of shapes. In this study, we use coincident optical and Radio-Frequency measurements to document the properties of optical PDD waveforms associated with different types of lightning, estimate delays from scattering in the clouds, and comment on how pulse shape impacts optical lightning detection. We find that the attributes of optical pulses recorded by the PDD are consistent with prior studies, but vary globally and with event amplitude. The most powerful lightning tends to be single-peaked with faster rise times (median: ~100 µs) and shorter effective widths (median: ~400 µs) than normal lightning. Particularly dim events, meanwhile, include cases of broad optical waveforms with sustained optical emission throughout the PDD record, which the pixelated FORTE Lightning Location System (LLS) instrument has difficulty detecting. We propose that this is due to the optical signal being divided between individual LLS pixels that are each, individually, not bright enough to trigger. We use PDD waveforms and Monte Carlo radiative transfer modeling to demonstrate that increasing the temporal and spatial resolution of a pixelated lightning imager will make it more difficult to detect these broad/dim pulses as their energy becomes divided between additional pixels/integration frames.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Moving small files in a networked environment

Globally distributed computing infrastructures, such as clouds and supercomputers, are currently used to manage data that is generated with an unprecedented speed from a variety of resources. Coping with this trend, the volume of data exchanged across distant sites increases substantially. To accelerate data transfer, high-speed networks are provided to connect remote sites. Most existing data movement solutions are optimized for moving large files. However, it is still challenging to transfer a large number of small files across networks. This disadvantage not only lowers data transfer performance, but also decreases overall system utilization. Here, we identify that moving small files is mainly constrained by degraded file system throughput, not just network performance as might be suspected. We have built a data transfer pipeline model to analyze the impact of small network I/O and storage I/O on data movement. Extending one of the widely used open source data movement solutions, GridFTP, we demonstrate several appropriate engineering approaches that mitigate the bottleneck and increase data transfer efficiency. We show optimizations that improve data transfer performance more than 5 times. In comparison to existing solutions, our approaches can save a significant amount of system resources for moving lots of small files.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Enhanced Atmospheric Research at the Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) (Final Report)

The Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) was an international scientific expedition into the central Arctic sea ice to study the changing atmosphere-ice-ocean system and its key physical, chemical, and biological processes in a way that will support improved understanding and modeling of Arctic climate. The US Department of Energy’s Atmospheric Research Measurement (ARM) Program operated its second ARM Mobile Facility (AMF2) as a major contribution to the expedition, and the Atmospheric System Research (ASR) program supported this project to maximize the success of DOE’s involvement in MOSAiC. This project has enabled the successful collection of data through support of field operations plans, in-field operational implementation, oversight of real-time data quality, and representing DOE’s interests within the broader international MOSAiC endeavor. The project has promoted scientific research by facilitating and leading a number of efforts to develop value-added products that will support research, including products related to aerosol properties, trace gases, cloud properties, snowfall, the surface energy budget, and a merged product designed for model assessment. These products and related analyses have also contributed to numerous scientific publications on related themes as well as direct model evaluation. Lastly, the project has engaged in a great deal of communication and outreach activities that help to publicize and promote both MOSAiC and DOE’s specific contribution to a broad audience that includes the scientific community, program management, policy makers, and the general public.

54 ENVIRONMENTAL SCIENCES↗