SEARCH · Engineering Papers

Results for “Simulation of distributed computing systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Strong Dark Matter Self-interactions Diversify Halo Populations within and surrounding the Milky Way

Abstract We perform a high-resolution cosmological zoom-in simulation of a Milky Way (MW)–like system, which includes a realistic Large Magellanic Cloud analog, using a large differential elastic dark matter self-interaction cross section that reaches ≈100 cm 2 g −1 at relative velocities of ≈10 km s −1 , motivated by the diverse and orbitally dependent central densities of dwarf galaxies within and surrounding the MW. We explore the effects of dark matter self-interactions on satellite, splashback, and isolated halos through their abundance, central densities, maximum circular velocities, orbital parameters, and correlations between these variables. We use an effective constant cross section model to analytically predict the stages of our simulated halos’ gravothermal evolution, demonstrating that deviations from the collisionless R max – V max relation can be used to select deeply core-collapsed halos, where V max is a halo’s maximum circular velocity, and R max is the radius at which it occurs. We predict that a sizable fraction (≈20%) of subhalos with masses down to ≈10 8 M ⊙ is deeply core collapsed in our SIDM model. Core-collapsed systems form ≈10% of the isolated halo population down to the same mass; these isolated, core-collapsed halos would host faint dwarf field galaxies with extremely steep central density profiles. Finally, most halos with masses above ≈10 9 M ⊙ are core-forming in our simulation. Our study thus demonstrates how self-interactions diversify halo populations in an environmentally dependent fashion within and surrounding MW-mass hosts, providing a compelling avenue to address the diverse dark matter distributions of observed dwarf galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Huge ensembles – Part 1: Design of ensemble weather forecasts using spherical Fourier neural operators

Abstract. Simulating low-likelihood high-impact extreme weather events in a warming world is a significant and challenging task for current ensemble forecasting systems. While these systems presently use up to 100 members, larger ensembles could enrich the sampling of internal variability. They may capture the long tails associated with climate hazards better than traditional ensemble sizes. Due to computational constraints, it is infeasible to generate huge ensembles (comprised of 1000–10 000 members) with traditional, physics-based numerical models. In this two-part paper, we replace traditional numerical simulations with machine learning (ML) to generate hindcasts of huge ensembles. In Part 1, we construct an ensemble weather forecasting system based on spherical Fourier neural operators (SFNOs), and we discuss important design decisions for constructing such an ensemble. The ensemble represents model uncertainty through perturbed-parameter techniques, and it represents initial condition uncertainty through bred vectors, which sample the fastest-growing modes of the forecast. Using the European Centre for Medium-Range Weather Forecasts Integrated Forecasting System (IFS) as a baseline, we develop an evaluation pipeline composed of mean, spectral, and extreme diagnostics. With large-scale, distributed SFNOs with 1.1 billion learned parameters, we achieve calibrated probabilistic forecasts. As the trajectories of the individual members diverge, the ML ensemble mean spectra degrade with lead time, consistent with physical expectations. However, the individual ensemble members' spectra stay constant with lead time. Therefore, these members simulate realistic weather states during the rollout, and the ML ensemble passes a crucial spectral test in the literature. The IFS and ML ensembles have similar extreme forecast indices, and we show that the ML extreme weather forecasts are reliable and discriminating. These diagnostics ensure that the ensemble can reliably simulate the time evolution of the atmosphere, including low-likelihood high-impact extremes. In Part 2, we generate a huge ensemble initialized each day in summer 2023, and we characterize the simulations of extremes.

Mahesh, Ankur↗

NASA NTRS1992

Planning for the semiconductor manufacturer of the future

Texas Instruments (TI) is currently contracted by the Air Force Wright Laboratory and the Defense Advanced Research Projects Agency (DARPA) to develop the next generation flexible semiconductor wafer fabrication system called Microelectronics Manufacturing Science & Technology (MMST). Several revolutionary concepts are being pioneered on MMST, including the following: new single-wafer rapid thermal processes, in-situ sensors, cluster equipment, and advanced Computer Integrated Manufacturing (CIM) software. The objective of the project is to develop a manufacturing system capable of achieving an order of magnitude improvement in almost all aspects of wafer fabrication. TI was awarded the contract in Oct., 1988, and will complete development with a fabrication facility demonstration in April, 1993. An important part of MMST is development of the CIM environment responsible for coordinating all parts of the system. The CIM architecture being developed is based on a distributed object oriented framework made of several cooperating subsystems. The software subsystems include the following: process control for dynamic control of factory processes; modular processing system for controlling the processing equipment; generic equipment model which provides an interface between processing equipment and the rest of the factory; specification system which maintains factory documents and product specifications; simulator for modelling the factory for analysis purposes; scheduler for scheduling work on the factory floor; and the planner for planning and monitoring of orders within the factory. This paper first outlines the division of responsibility between the planner, scheduler, and simulator subsystems. It then describes the approach to incremental planning and the way in which uncertainty is modelled within the plan representation. Finally, current status and initial results are described.

Fargher, Hugh E.↗

NASA NTRS1999

Combustion Instabilities Modeled

NASA Lewis Research Center's Advanced Controls and Dynamics Technology Branch is investigating active control strategies to mitigate or eliminate the combustion instabilities prevalent in lean-burning, low-emission combustors. These instabilities result from coupling between the heat-release mechanisms of the burning process and the acoustic flow field of the combustor. Control design and implementation require a simulation capability that is both fast and accurate. It must capture the essential physics of the system, yet be as simple as possible. A quasi-one-dimensional, computational fluid dynamics (CFD) based simulation has been developed which may meet these requirements. The Euler equations of mass, momentum, and energy have been used, along with a single reactive species transport equation to simulate coupled thermoacoustic oscillations. A very simple numerical integration scheme was chosen to reduce computing time. Robust boundary condition procedures were incorporated to simulate various flow conditions (e.g., valves, open ends, and choked inflow) as well as to accommodate flow reversals that may arise during large flow-field oscillations. The accompanying figure shows a sample simulation result. A combustor with an open inlet, a choked outlet, and a large constriction approximately two thirds of the way down the length is shown. The middle plot shows normalized, time-averaged distributions of the relevant flow quantities, and the bottom plot illustrates the acoustic mode shape of the resulting thermoacoustic oscillation. For this simulation, the limit cycle peak-to-peak pressure fluctuations were 13 percent of the mean. The simulation used 100 numerical cells. The total normalized simulation time was 50 units (approximately 15 oscillations), which took 26 sec on a Sun Ultra2.

Paxson, Daniel E.↗

NASA NTRS2006

NASA Tech Briefs, August 2006

Topics covered include: Measurement and Controls Data Acquisition System IMU/GPS System Provides Position and Attitude Data Using Artificial Intelligence to Inform Pilots of Weather Fast Lossless Compression of Multispectral-Image Data Developing Signal-Pattern-Recognition Programs Implementing Access to Data Distributed on Many Processors Compact, Efficient Drive Circuit for a Piezoelectric Pump; Dual Common Planes for Time Multiplexing of Dual-Color QWIPs; MMIC Power Amplifier Puts Out 40 mW From 75 to 110 GHz; 2D/3D Visual Tracker for Rover Mast; Adding Hierarchical Objects to Relational Database General-Purpose XML-Based Information Managements; Vaporizable Scaffolds for Fabricating Thermoelectric Modules; Producing Quantum Dots by Spray Pyrolysis; Mobile Robot for Exploring Cold Liquid/Solid Environments; System Would Acquire Core and Powder Samples of Rocks; Improved Fabrication of Lithium Films Having Micron Features; Manufacture of Regularly Shaped Sol-Gel Pellets; Regulating Glucose and pH, and Monitoring Oxygen in a Bioreactor; Satellite Multiangle Spectropolarimetric Imaging of Aerosols; Interferometric System for Measuring Thickness of Sea Ice; Microscale Regenerative Heat Exchanger Protocols for Handling Messages Between Simulation Computers Statistical Detection of Atypical Aircraft Flights NASA's Aviation Safety and Modeling Project Multimode-Guided-Wave Ultrasonic Scanning of Materials Algorithms for Maneuvering Spacecraft Around Small Bodies Improved Solar-Radiation-Pressure Models for GPS Satellites Measuring Attitude of a Large, Flexible, Orbiting Structure

Source record↗

DOE OSTI2019

Modeling and Simulation Tool to Improve Urban Search Planning (NA22 Final Report)

The venture project Tool to Improve Urban Search Planning (LL14-V-Urban Search Planning ToolPD3RS) supported two major types of effort: 1) development of a software prototype search planning tool, with the goal of transitioning the tool to operational users for evaluation and possible adoption; 2) enabling research to better understand the radiation characteristics of an urban environment, with implications for deployment of radiation detection systems in that environment. The first effort has resulted in prototype software, Optimization Planning Tool for Urban Search (OPTUS), that has been distributed to a limited set of potential users, including users within the NNSA emergency response community. The second effort supported various research topics including high fidelity radiation transport modeling in urban environments, measurement campaigns for model validation, development of vehicle-based high purity germanium (HPGe) detector systems and supporting data analysis, and computational capabilities for archiving and managing large data sets. While some of these related efforts have informed the models and software design of the OPTUS tool, in large part they pursued more basic research, some of which has evolved into separate DNN R&D projects. Project performers included Oak Ridge National Laboratory (ORNL), Lawrence Berkeley National Laboratory (LBNL) and the Remote Sensing Laboratory (RSL), in addition to Lawrence Livermore Laboratory (LLNL), the project lead. The project also supported university research, including several internships at the laboratories.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Probabilistic constrained Bayesian inversion for transpiration cooling

Abstract To enable safe operations in applications such as rocket combustion chambers, the materials require cooling to avoid material damage. Here, transpiration cooling is a promising cooling technique. Numerous studies investigate possibilities to simulate and evaluate the complex cooling mechanism. One naturally arising question is the amount of coolant required to ensure a safe operation. To study this, we introduce an approach that determines the posterior probability distribution of the Reynolds number using an inverse problem and constraining the maximum temperature of the system under parameter uncertainties. Mathematically, this chance inequality constraint is dealt with by a generalized polynomial chaos expansion of the system. The posterior distribution will be evaluated by different Markov chain Monte Carlo based methods. A novel method for the constrained case is proposed and tested among others on two‐dimensional transpiration cooling models.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2004

Computational and Experimental Study of Energetic Materials in a Counterflow Microgravity Environment

Counterflow diffusion flames are studied for various fuels flowing against decomposition products from solid ammonium perchlorate (AP) pellets in order to obtain fundamental understanding of composite propellant flame structure and chemistry. We illustrate this approach through a combined experimental and numerical study of a fuel mixture consisting of C2H4 CO + H2, and C2H2 + C2H4 flowing against solid AP. For these particular AP-fuel systems, the resulting flame zone simulates the various flame structures that are ex+ to exist between reaction products from Ap crystals and a hydrocarbon binder. As in all our experimental studies, quantitative species and temperature profiles have been measured between the fuel exit and AP surface. Species measured included CN, NH, NO, OH, N2, CO2, CO, H2, CO, HCl, and H2O. Temperature was measured using a thermocouple at the exit, spontaneous Raman scattering measurements throughout the flame, OH rotational population distributions, and NO vibrational population distributions. The burning rate of AP was also measured as a function of strain rate, given by the separation distance between the AP surface and the gaseous hydrocarbon fuel tube exit plane. This distance was nominally set at 5 mm, although studies have been performed for variations in separation distance. The measured 12 scalars are compared with predictions from a detailed gas-phase kinetics model consisting of 86 species and 531 reactions. Model predictions are found to be in good agreement with experiment and illustrate the type of kinetic features that may be expected to occur in propellants when AP particle size distributions are varied. Furthermore, the results constitute the continued development of a necessary database and validation of a comprehensive model for studying more complex AP-solid fuel systems in microgravity. Exploratory studies have also been performed with liquid and solid fuels at normal gravity. Because of melting (and hence dripping) and deep thermal wave penetration into the liquid, these experiments were found feasible, but not used for obtaining quantitative data. Microgravity experiments are needed to eliminate the dripping and boiling phenomena of these systems at normal gravity. Microgravity tests in the NASA Glenn 2.2 second drop tower were performed (1) to demonstrate the feasibility of performing propellant experiments using the NASA Glenn microgravity facilities, (2) to develop the operational procedures for safe handing of the energetic materials and disposal of their toxic combustion by-products and (3) to obtain initial measurements of the AP burning rate and flame structure under microgravity conditions. Experiments were conducted on the CH4/AP system previously studied at normal gravity using a modified design of the counterflow burner and a NASA Glenn Pig Rig, i.e., one of the existing drop rigs for general-purpose usage. In these experiments, the AP burning rate was measured directly with a linear variable differential transducer (LVDT) and video imaging of the flame structure was recorded ignition was achieved by hot wires stretched across the AP surfaces. Initial drop tower combustion data show that with the same burner separation distance and flow conditions of the normal gravity experiments, the AP burning rate is approximately a factor of two lower. This difference is likely a result of radiation effects, but further tests with longer test times need to be conducted to verify that steady state conditions were achieved under microgravity conditions.

Takahashi, Fumiaki↗

DOE OSTI2023

A reduced-order model of concentration polarization in reverse osmosis systems with feed spacers

Feed spacers in reverse osmosis systems generate complex fluid flows that limit computational fluid dynamics (CFD) simulations to small length and time scales. That limits our ability to simulate mineral scaling and other membrane fouling phenomena, which occur over longer length and time scales. Thus motivated, we develop a reduced model that replaces the CFD simulation of the velocity field with an analytical model that mimics spacers. This focuses the remaining numerical effort on simulating the advection–diffusion equation governing solute transport. We motivate and validate the model with CFD simulations and bench-scale experiments of spacer filaments in three different arrangements, including cases of unsteady vortex shedding. We show that the model produces a roughly 10,000-fold speedup compared to CFD, and accurately reproduces CFD predictions of not only the average and maximum concentrations, but also the local concentration distribution along the membrane. Here, we also demonstrate the model for simulating a feed channel with a length-to-height ratio of 200. The model provides a simple testbed for exploratory studies of multispecies transport, precipitation, and membrane fouling phenomena for which simulating spacers is often prohibitive.

Computational fluid dynamics↗

DOE OSTI2019

Observing crystal nucleation in four dimensions using atomic electron tomography

Nucleation plays a critical role in many physical and biological phenomena that range from crystallization, melting and evaporation to the formation of clouds and the initiation of neurodegenerative diseases. However, nucleation is a challenging process to study in experiments, especially in the early stage when several atoms or molecules start to form a new phase from a parent phase. A number of experimental and computational methods have been used to investigate nucleation processes, but experimental determination of the three-dimensional atomic structure and the dynamics of early stage nuclei has been unachievable. Here we use atomic electron tomography to study early stage nucleation in four dimensions (4D: that is, including time) at atomic resolution. Using FePt nanoparticles as a model system, we find that early stage nuclei are irregularly shaped, each has a core of one to a few atoms with the maximum order parameter, and the order parameter gradient points from the core to the boundary of the nucleus. We capture the structure and dynamics of the same nuclei undergoing growth, fluctuation, dissolution, merging and/or division, which are regulated by the order parameter distribution and its gradient. These experimental observations are corroborated by molecular dynamics simulations of heterogeneous and homogeneous nucleation in liquid–solid phase transitions of Pt. Our experimental and molecular dynamics results differ from classical nucleation theory, indicating that a theory beyond this is needed to describe early stage nucleation at the atomic scale. Looking forward, we anticipate that the reported approach will open the door to the study of many fundamental problems in materials science, nanoscience, condensed matter physics and chemistry, such as phase transition, atomic diffusion, grain boundary dynamics, interface motion, defect dynamics and surface reconstruction with 4D atomic resolution.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

DOE OSTI2025

Universal energy-speed-accuracy trade-offs in driven nonequilibrium systems

The connection between measure theoretic optimal transport and dissipative nonequilibrium dynamics provides a language for quantifying nonequilibrium control costs, leading to a collection of thermodynamic speed limits, which rely on the assumption that the target probability distribution is perfectly realized. This is almost never the case in experiments or numerical simulations, so here we address the situation in which the external controller is imperfect. We obtain a lower bound for the dissipated work in generic nonequilibrium control problems that (1) is asymptotically tight and (2) matches the thermodynamic speed limit in the case of optimal driving. Along with analytically solvable examples, we refine this imperfect driving notion to systems in which the controlled degrees of freedom are slow relative to the nonequilibrium relaxation rate, and identify independent energy contributions from fast and slow degrees of freedom. Furthermore, we develop a strategy for optimizing minimally dissipative protocols based on optimal transport flow matching, a generative machine learning technique. Furthermore, this latter approach ensures the scalability of both the theoretical and computational framework we put forth. Crucially, we demonstrate that we can compute the terms in our bound numerically using efficient algorithms from the computational optimal transport literature and that the protocols we learn saturate the bound.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

CyclusJS: A Distributed Web-based Fuel Cycle Visual Analytics. Research Performance (Final Report)

The overall aim of the CyclusJS project has been to design novel approaches that support fuel cycle simulations and empower decision-makers and researchers with better tools to compare and contrast results from multiple simulations to understand the landscape of potential outcomes better. In particular, nuclear fuel cycle simulations focus on modeling the nuclear industry and ecosystem at a macroscopic level, and the analysis tools connect such simulations with decision support systems. As a demonstration of the novelty and effectiveness of the proposed approach, we study scenarios for transitioning from one technology, Light Water Reactors (LWR), to a newer Sodium-cooled Fast breeder Reactor (SFR) technology.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Surface Roughness Effects from Additive Manufacturing in High Efficiency Gas Turbine Combustion Systems

In the past, clean combustion systems were characterized by high system development costs due to growing complexity and escalating manufacturing costs from conventional manufacturing processes. As a result, high efficiency concepts are difficult to design and more difficult to be cost-effectively manufactured. In recent years, with the introduction of additive manufacturing (AM) technologies, the rapid prototyping and mass production processes of clean combustion systems are promising to be significantly simplified with significant reduction in terms of engine manufacturing cost and engine energy cost. Compared with conventional manufacturing built parts, the AM process enabled a simpler design to be adopted for the nozzle, reducing the number of required braze and weld joints from twenty-five to just five. The resulting nozzle was 25% lighter and five times more durable and contributed to a 15% reduction in fuel burn in comparison with the previous model produced. Applying these improvements to a fleet of 5,000 turbofan engines at 150 kN thrust would result in fuel cost savings of $ \$ $6B annually (at $ \$ $5/gallon Jet-A fuel price, 700 gallon/hour fuel consumption rate, and 2,300 operational hours per year), and reduce CO2 emissions by more than 25 million tons per year. These advances support core Department of Energy (DOE) missions in energy efficiency, improving productivity, and environmental sustainability. Maximizing the benefit of these new capabilities will require high prediction capability of high speed turbulent flow with wall modeled Large Eddy Simulation (LES). GE Aviation maintains that advanced simulation technology and supercomputing is required in order to provide the appropriate boundary conditions to realize the maximum potential of AM and Ceramic Matrix Composite to reduce cooling flow, a first order penalty on the Brayton cycle. The algorithm developed using the ANSYS/Fluent software would provide the foundation for entirely new avenues of research and development with potential multi-billion dollar impact to the US economy, and significant reduction in carbon based emissions across the aerospace and power generation industries. The formulation of this iWLES (integral wall model for LES) is generic and allows to capture the changes in flow dynamics that have a significant impact on the wall bounded flow characteristics, such as swirler effective area, bulk swirl number, local pressure distribution, exit velocity profile, and turbulence kinetic energy profile. A periodic channel flow with rough flat plate is simulated using LES (Wall-Adapting Local Eddy-viscosity) model to verify the implementation of iWLES in the Fluent User Defined Function (UDF). As the flow fields are highly sensitive due to surface roughness of the wall bounded flows in the combustion systems, there is significant potential to conduct further LES studies focusing on the turbulence boundary layer interaction. Accurately capturing near wall physics will elucidate the impact of rough surfaces on combustor flow and aero-thermal interactions.

42 ENGINEERING↗

DOE OSTI2024

Trust-Based Detection and Mitigation of Cyber Attacks in Distributed Cooperative Control of Islanded AC Microgrids

In this study, we address the challenge of detecting and mitigating cyber attacks in the distributed cooperative control of islanded AC microgrids, with a particular focus on detecting False Data Injection Attacks (FDIAs), a significant threat to the Smart Grid (SG). The SG integrates traditional power systems with communication networks, creating a complex system with numerous vulnerable links, making it a prime target for cyber attacks. These attacks can lead to the disclosure of private data, control network failures, and even blackouts. Unlike machine learning-based approaches that require extensive datasets and mathematical models dependent on accurate system modeling, our method is free from such dependencies. To enhance the microgrid’s resilience against these threats, we propose a resilient control algorithm by introducing a novel trustworthiness parameter into the traditional cooperative control algorithm. Our method evaluates the trustworthiness of distributed energy resources (DERs) based on their voltage measurements and exchanged information, using Kullback-Leibler (KL) divergence to dynamically adjust control actions. We validated our approach through simulations on both the IEEE-34 bus feeder system with eight DERs and a larger microgrid with twenty-two DERs. The results demonstrated a detection accuracy of around 100%, with millisecond range mitigation time, ensuring rapid system recovery. Additionally, our method improved system stability by up to almost 100% under attack scenarios, showcasing its effectiveness in promptly detecting attacks and maintaining system resilience. These findings highlight the potential of our approach to enhance the security and stability of microgrid systems in the face of cyber threats.

Computer Science↗

DOE OSTI2021

An Adaptive Tracking Algorithm for Convection in Simulated and Remote Sensing Data

A robust and computationally efficient object tracking algorithm is developed by incorporating various tracking techniques. Physical properties of the objects, such as brightness temperature or reflectivity, are not considered. Therefore, the algorithm is adaptable for tracking convection-like features in simulated data and remotely sensed two-dimensional images. In this algorithm, a first guess of the motion, estimated using the Fourier phase shift, is used to predict the candidates for matching. A disparity score is computed for each target–candidate pair. The disparity also incorporates overlapping criteria in the case of large objects. Then the Hungarian method is applied to identify the best pairs by minimizing the global disparity. The high-disparity pairs are unmatched, and their target and candidate are declared expired and newly initiated objects, respectively. They are tested for merger and split on the basis of their size and overlap with the other objects. The sensitivity of track duration is shown for different disparity and size thresholds. The report highlights the algorithm’s ability to study convective life cycles using radar and simulated data over Darwin, Australia. The algorithm skillfully tracks individual convective cells (a few pixels in size) and large convective systems. The duration of tracks and cell size are found to be lognormally distributed over Darwin. The evolution of size and precipitation types of isolated convective cells is presented in the Lagrangian perspective. This algorithm is part of a vision for a modular platform [viz., TINT is not TITAN (TINT) and Tracking and Object-Based Analysis of Clouds (tobac)] that will evolve into a sustainable choice to analyze atmospheric features.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Radiation-Induced Noise Resilience of Neuromorphic Architectures

Neuromorphic event-based networks use asynchronous time-dependent information to extract features from input data that can allow for edge-based distributed applications such as object recognition. The noise resilience properties of such networks, especially in the context of space applications, are yet to be explored. In this paper, we use the hierarchy of time surfaces (HOTS) algorithm, which is one of the neuromorphic algorithms, to understand the least and most resilient modules in a neuromorphic network. The HOTS algorithm relies on the computing of time surfaces that maps the temporal delays between neighboring pixels into normalized features that involve many computations that are also found in other neuromorphic networks such as exponential decays, distance computations, etcetera. We implemented HOTS on a Digilent PYNQ board with a Xilinx Zynq 7020 system on a chip, and we subjected the boards running the HOTS network inference to neutron radiation at the Los Alamos Neutron Science Center. Furthermore, we used simulation models from our previous similar experiments on the event-based sensor to create a neutron induced noise model to quantify the effect of this noise on the overall performance of the network. This experiment provides the preliminary measurements of the reliability of the HOTS algorithm and proposes methods to create a more reliable HOTS architecture in future spacecraft missions.

Engineering↗

DOE OSTI2022

Transitioning from File-Based HPC Workflows to Streaming Data Pipelines with openPMD and ADIOS2

This paper aims to create a transition path from file-based IO to streaming-based workflows for scientific applications in an HPC environment. By using the openPMP-api, traditional workflows limited by filesystem bottlenecks can be overcome and flexibly extended for in situ analysis. The openPMD-api is a library for the description of scientific data according to the Open Standard for Particle-Mesh Data (openPMD). Its approach towards recent challenges posed by hardware heterogeneity lies in the decoupling of data description in domain sciences, such as plasma physics simulations, from concrete implementations in hardware and IO. The streaming backend is provided by the ADIOS2 framework, developed at Oak Ridge National Laboratory. This paper surveys two openPMD-based loosely-coupled setups to demonstrate flexible applicability and to evaluate performance. In loose coupling, as opposed to tight coupling, two (or more) applications are executed separately, e.g. in individual MPI contexts, yet cooperate by exchanging data. This way, a streaming-based workflow allows for standalone codes instead of tightly-coupled plugins, using a unified streaming-aware API and leveraging high-speed communication infrastructure available in modern compute clusters for massive data exchange. We determine new challenges in resource allocation and in the need of strategies for a flexible data distribution, demonstrating their influence on efficiency and scaling on the Summit compute system. The presented setups show the potential for a more flexible use of compute resources brought by streaming IO as well as the ability to increase throughput by avoiding filesystem bottlenecks.

Poeschel, Franz↗

NASA NTRS1991

A study of the thermal and optical characteristics of radiometric channels for Earth radiation budget applications

An improved dynamic electrothermal model for the Earth Radiation Budget Experiment (ERBE) total, nonscanning channels is formulated. This model is then used to accurately simulate two types of dynamic solar observation: the solar calibration and the so-called pitchover maneuver. Using a second model, the nonscanner active cavity radiometer (ACR) thermal noise is studied. This study reveals that radiative emission and scattering by the surrounding parts of the nonscanner cavity are acceptably small. The dynamic electrothermal model is also used to compute ACR instrument transfer function. Accurate in-flight measurement of this transfer function is shown to depend on the energy distribution over the frequency spectrum of the radiation input function. A new array-type field of view limiter, whose geometry controls the input function, is proposed for in-flight calibration of an ACR and other types of radiometers. The point spread function (PSF) of the ERBE and the Clouds and Earth's Radiant Energy System (CERES) scanning radiometers is computed. The PSF is useful in characterizing the channel optics. It also has potential for recovering the distribution of the radiative flux from Earth by deconvolution.

Mahan, J. R.↗