Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Parallel application”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Nanosecond machine learning regression with deep boosted decision trees in FPGA for high energy physics

We present a novel application of the machine learning / artificial intelligence method called boosted decision trees to estimate physical quantities on field programmable gate arrays (FPGA). The software package fwXmachina features a new architecture called parallel decision paths that allows for deep decision trees with arbitrary number of input variables. It also features a new optimization scheme to use different numbers of bits for each input variable, which produces optimal physics results and ultraefficient FPGA resource utilization. Problems in high energy physics of proton collisions at the Large Hadron Collider (LHC) are considered. Estimation of missing transverse momentum (E T miss ) at the first level trigger system at the High Luminosity LHC (HL-LHC) experiments, with a simplified detector modeled by Delphes, is used to benchmark and characterize the firmware performance. The firmware implementation with a maximum depth of up to 10 using eight input variables of 16-bit precision gives a latency value of $\mathcal{O}$(10) ns, independent of the clock speed, and $\mathcal{O}$(0.1)% of the available FPGA resources without using digital signal processors.

Instruments & Instrumentation↗

VAN-DAMME: GPU-accelerated and symmetry-assisted quantum optimal control of multi-qubit systems

We present an open-source software package, VAN-DAMME (Versatile Approaches to Numerically Design, Accelerate, and Manipulate Magnetic Excitations), for massively-parallelized quantum optimal control (QOC) calculations of multi-qubit systems. To enable large QOC calculations, the VAN-DAMME software package utilizes symmetry-based techniques with custom GPU-enhanced algorithms. This combined approach allows for the simultaneous computation of hundreds of matrix exponential propagators that efficiently leverage the intra-GPU parallelism found in high-performance GPUs. In addition, to maximize the computational efficiency of the VAN-DAMME code, we carried out several extensive tests on data layout, computational complexity, memory requirements, and performance. These extensive analyses allowed us to develop computationally efficient approaches for evaluating complex-valued matrix exponential propagators based on Padé approximants. To assess the computational performance of our GPU-accelerated VAN-DAMME code, we carried out QOC calculations of systems containing 10 - 15 qubits, which showed that our GPU implementation is 18.4× faster than the corresponding CPU implementation. Our GPU-accelerated enhancements allow efficient calculations of multi-qubit systems, which can be used for the efficient implementation of QOC applications across multiple domains.

97 MATHEMATICS AND COMPUTING↗

GLUE Code: A framework handling communication and interfaces between scales

Many scientific applications are inherently multiscale in nature. Such complex physical phenomena often require simultaneous execution and coordination of simulations spanning multiple time and length scales. This is possible by combining expensive small-scale simulations (such as molecular dynamics simulations) with larger scale simulations (such continuum limit/hydro solvers) to allow for considerably larger systems using task and data parallelism. However, the granularity of the tasks can be very large and often leads to load imbalance. Traditionally, we use approximations to streamline the computation of the more costly interactions and this introduces trade-offs between simulation cost and accuracy. In recent years, the available computational power and the advances in machine learning have made computing these scale-bridging interactions and multiscale simulations more feasible. One driving application has been plasma modeling in inertial confinement fusion (ICF), which is fundamentally multiscale in nature. This requires deep understanding of how to extrapolate microscopic information into macroscopically relevant scales. For example, in ICF one needs an accurate understanding of the connection between experimental observables and the underlying microphysics. The properties of the larger scales are often affected by the microscale behavior incorporated usually into the equations of state and ionic and electronic transport coefficients (Liboff, 1959; Rinderknecht et al., 2014; Rosenberg et al., 2015; Ross et al., 2017). Instead of incorporating this information using reliable molecular dynamics (MD) simulations, one often needs to use theoretical models, due to the inability of MD to reach engineering scales (Glosli et al., 2007; Marinak et al., 1998). One approach to resolve this issue is by coupling two MD simulations of different scales via force interpolation, e.g., the AdResS method (Krekeler et al., 2018; Nagarajan et al., 2013). Another approach, which we will pursue in the scope of this work, is by enabling scale bridging between MD simulations and meso/macro-scale models through the development and support of application programming interfaces that these different applications can interact through.

54 ENVIRONMENTAL SCIENCES↗

Wide-Bandgap Semiconductor Amplifiers for Fusion Plasma Heating and Control

This paper discusses power electronics developed under the ARPA-E GAMOW program to support nuclear fusion power production. The goal of this project was to develop and assess the potential for wide-bandgap (WBG) semiconductor devices in power electronics to enable high-efficiency and high-voltage solid-state systems for fusion plasma generation, heating, and control. The power electronics use an architecture in which multiple high-power boards can be combined to produce megawatt-level power, where using multiple boards provides high reliability. Two main areas of power electronics boards are developed in this project for fusion plasma heating and control applications: (1) pulse generation and control and (2) radiofrequency generation. The first area is for boards capable of driving high-voltage millisecond pulses at high duty cycles. The envisioned application of these pulses is in plasma control of magnetohydrodynamic instabilities, plasma position, and edge-localized modes. Pulse-width modulation allows for the implementation of a wide variety of linear and nonlinear control systems. The boards developed for this project could actuate control coils based on digital input signals and can be parallelized to provide megawatts of output power. The design of the pulse generator is a low-side load switch. A load switch was designed and constructed that utilized 2-kV-rated field-effect transistor (FET)-based cascodes developed by Qorvo under this project to perform initial testing of these cascodes. The second area is being implemented using class E amplifiers with WBG devices and a reactance steering network to handle inductive or capacitive plasma loads. Applications include ion cyclotron resonance heating (ICRH) and high-harmonic fast-wave (HHFW) heating. A class E reactance steering network is demonstrated in modeling and experiment with a resistive-inductive load that models an inductively-coupled plasma. Power combining of boards with class E reactance steering networks is also simulated and demonstrated experimentally, to enable scaling up to high power. Modeling of high-power-density cooling and remaining useful life is conducted to enable reliable, effectively cooled high-power electronics for fusion applications.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Formation and Shape Changing of Conductive Helical Ribbons via Deposition of Highly Stressed Films on Mechanically Responsive Substrates

Abstract This work demonstrates that the electrodeposition of highly stressed films on compliant ribbons is a robust process to obtain helical structures with excellent mechanical stability and potentially high thermal and electrical conductance. Electrodeposition on end‐tethered ribbons alters their axial and bending stiffness while imparting mechanical stress to drive the formation of a helix with a microscale diameter and pitch in a controlled and scalable manner. The process generates helices with diameters and pitches between 80 and 200 µm and lengths as large as several millimeters. The approach is amenable to parallel processing a large number of 3D structures on any substrate, including large‐area semiconductor wafers. This phenomenon is explained in terms of the change of stress gradients as material is added. Applications of the fabricated helices include antennas, metamaterials, and slow‐wave structures in frequency ranges not previously attainable.

Chemistry↗

Deep Gaussian process-based cost-aware batch Bayesian optimization for complex materials design campaigns

The accelerating pace and expanding scope of materials discovery demand optimization frameworks that efficiently navigate vast design spaces with complex response surfaces while judiciously allocating limited evaluation resources. We present a cost-aware, batch Bayesian optimization scheme powered by deep Gaussian process (DGP) surrogates and a heterotopic querying strategy. Our DGP surrogate, formed by stacking GP layers, models complex hierarchical relationships among high-dimensional compositional features and captures correlations across multiple target properties, propagating uncertainty through successive layers. We integrate evaluation cost into an upper-confidence-bound acquisition extension, which, together with heterotopic querying, proposes small batches of candidates in parallel, balancing exploration of under-characterized regions with exploitation of high-mean, low-variance predictions across correlated properties. Applied to refractory high-entropy alloys for high-temperature applications, our framework converges to optimal formulations in fewer iterations with cost-aware queries than conventional GP-based BO, highlighting the value of deep, uncertainty-aware, cost-sensitive strategies in materials campaigns.

36 MATERIALS SCIENCE↗

Multifunctional nanopore electrode array method for characterizing and manipulating single entities in attoliter-volume enclosures

Structurally regular nanopore arrays fabricated to contain independently controllable annular electrodes represent a new kind of architecture capable of electrochemically addressing small collections of matter—down to the single entity (molecule, particle, and biological cell) level. Furthermore, these nanopore electrode arrays (NEAs) can also be interrogated optically to achieve single entity spectroelectrochemistry. Larger entities such as nanoparticles and single bacterial cells are investigated by dark-field scattering and potential-controlled single-cell luminescence experiments, respectively, while NEA-confined molecules are probed by single molecule luminescence. By carrying out these experiments in arrays of identically constructed nanopores, massively parallel collections of single entities can be investigated simultaneously. The multilayer metal–insulator design of the NEAs enables highly efficient redox cycling experiments with large increases in analytical sensitivity for chemical sensing applications. NEAs may also be augmented with an additional orthogonally designed nanopore layer, such as a structured block copolymer, to achieve hierarchically organized multilayer structures with multiple stimulus-responsive transport control mechanisms. Finally, NEAs constructed with a transparent bottom layer permit optical access to the interior of the nanopore, which can result in the cutoff of far-field mode propagation, effectively trapping radiation in an ultrasmall volume inside the nanopore. Furthermore, the bottom metal layer may be used as both a working electrode and an optical cladding layer, thus, producing bifunctional electrochemical zero-mode waveguide architectures capable of carrying out spectroelectrochemical investigations down to the single molecule level.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Sequence length scaling in vision transformers for scientific images on frontier

Vision Transformers (ViTs) are pivotal for foundational models in scientific imagery, including Earth science applications, due to their capability to process large sequence lengths. While transformers for text have inspired scaling sequence lengths in ViTs, adapting these for ViTs introduces unique challenges. We develop distributed sequence parallelism for ViTs, enabling them to handle up to 1M tokens. Our approach, leveraging DeepSpeed-Ulysses and Long-Sequence-Segmentation with model sharding, is the first to apply sequence parallelism in ViT training, achieving a 94% batch scaling efficiency on 2,048 AMD-MI250X GPUs. Evaluating sequence parallelism in ViTs, particularly in models up to 10B parameters, highlighted substantial bottlenecks. We countered these with hybrid sequence, pipeline, and flash attention strategies, to scale beyond single GPU memory limits. Our method significantly enhances climate modeling accuracy by 20% in temperature predictions, marking the first training of a vision transformer model to convergence with a sequence length of 188K tokens, using full self-attention.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗

Cardinal: Seismic and Geoacoustic Array Processing

Data collected via seismic and infrasound array deployments are leveraged in the geosciences to detect and characterize a myriad of natural and anthropogenic sources. These deployments consist of numerous sensors placed in a predetermined configuration to amplify signal strength and improve the efficacy of array processing techniques used to measure signal directionality and waveform coherence. High‐fidelity feature extraction is often predicated on interstation distance as well as the frequency content and wavelength of an incident signal. Numerous array processing softwares analyze data in sequential frequency bands to obtain a more detailed characterization of a signal. However, current algorithms are limited in their ability to determine optimal array configuration for each band. We introduce an open‐source Python code, called Cardinal, to process seismic and infrasound array data in discretized time–frequency space with the option of applying an adaptive array design to determine optimal subarray configuration for each frequency band. To reduce computational time, the array processing step can be run in parallel using multithreading. Furthermore, the software has the capability to aggregate array processing results from different time–frequency pixels to produce separate sets of detections, or families, with added utility via the application of an adaptive semblance threshold, which aids in isolating signals‐of‐interest from coherent background noise. Upon appropriate configuration, Cardinal exhibits the potential to combine distinct seismic and infrasound phases into separate families.

Adaptive Array↗

Novel Full-Ceramic Multi-Tubular Membrane Systems for Pre-Combustion CO2 Capture with Simultaneous H2 Production: Fabrication, Performance Testing, and 3D CFD Modeling

Inorganic membranes show promise for application in pre-combustion CO2 capture with simultaneous H2 production. State-of-the-art systems for use under high temperature and pressure conditions consist of multiple membrane tube bundles prepared in a "candle-filter" configuration, in which the membrane tubes are open at one end and sealed at the other. This configuration is used for practical reasons, specifically the need to minimize potential problems due to thermal expansion mismatch, at high temperatures, between the ceramic tube bundle and the steel housing. The primary technical problem with the candle-filter configuration for use in commercial-scale installations is the inability to purge the permeate side (typically the tube side), a feature that is crucial for high H2 recovery. In this study, we fabricated dual-end open, commercial-size ceramic multiple-tube bundles made of zeolite, palladium (Pd), and carbon molecular sieve (CMS) membranes that enable permeate-side (tube-side) purge for gas separation applications. Experimental gas separation data with these membrane bundles under harsh operating conditions (temperatures up to 350 and pressures up to 800 psig), to be presented at the meeting, manifest excellent performance. Parallel to the membrane bundle construction and testing efforts, we have also developed a detailed 3D CFD modeling package using COMSOL Multiphysics software to gain more insight into the effect on the H2 purity and recovery of the detailed geometry of the multi-tubular membrane system, including the number of tubes used, their dimensions, and placement in the bundle, as well as the number, type, and positioning of internal baffles and other flow-enhancement accessories. The CFD package is validated with experimental data from different systems (1-tube, 3-tube, and 19-tube bundles), and shows high accuracy in predicting the experimental results (<5 % error in all cases). The results of our study show that the detailed internal geometry of these multi-tubular membrane systems has a considerable impact on the performance of the system as the flow maldistribution within the shell-side can substantially decrease (>40%) the H2 recovery.

20 FOSSIL-FUELED POWER PLANTS↗

TriC: Distributed-memory Triangle Counting by Exploiting the Graph Structure

Graph analytics has emerged as an important tool in the analysis of large scale data from diverse application domains such as social networks, cyber security and bioinformatics. Counting the number of triangles in a graph is a fundamental kernel with several applications such as detecting the community structure of a graph or in identifying important vertices in a graph. The ubiquity of massive datasets is driving the need to scale graph analytics on parallel systems. However, numerous challenges exist in efficiently parallelizing graph algorithms, especially on distributed-memory systems. Irregular memory accesses and communication patterns, low computation to communication ratios, and the need for frequent synchronization are some of the leading challenges. In this paper, we present TriC, our distributed-memory implementation of triangle counting in graphs using the Message Passing Interface (MPI), as a submission to the 2020 GraphChallenge competition. Using a set of synthetic and real-world inputs from the challenge, we demonstrate a speedup of up to 90x relative to previous work on 32 processor-cores of a NERSC Cori node. We also provide details from distributed runs with up to8192 processes along with strong scaling results. The observations presented in this work provide an understanding of the system-level bottlenecks at scale that specifically impact sparse-irregular workloads and will therefore benefit other efforts to parallelize graph algorithms.

Halappanavar, Mahantesh↗

2020 International Conference on Smart Grids and Energy Systems (SGES)

This paper is concerned about phasor-based linear state estimation of three-phase power grids which contain non transposed lines and unsymmetrical branches. It builds upon our previous work where the linear measurement equations were decoupled into three independent sets via the symmetrical component transformation. Such a transformation may however not fully decouple the measurement equations if there are nontransposed transmission lines and unsymmetrical branches in the system. This paper addresses this limitation by deriving additive terms that compensate for the remaining coupling between sequence measurements after the application of the conventional transformation. It will be shown that general unbalanced threephase power grids can still be transformed into three decoupled subsystems and their state estimation solution can be obtained in parallel by the proposed approach.

Khalili, Ramtin↗

Exploring the Use of Novel Spatial Accelerators in Scientific Applications

Driven by the need to find alternative accelerators which can viably replace GPUs in next-generation Supercomputing systems, this paper proposes a methodology to enable agile application/hardware co-design. The application-first methodology provides the ability to come up with design of accelerators while working with real-world workloads, available accelerators, and system software. The iterative design process targets a set of kernels in a workload for performance estimates that can prune the design space for later phases of detailed architectural evaluations. To this effect, in this paper, a novel data-parallel device model is introduced that simulates the latency of performance-sensitive operations in an accelerator including data transfers and kernel computation using multi-core CPUs. The use of off-the-shelf simulators, such as pre-RTL simulator Aladdin or multiple tools available for exploring the design of deep neural network accelerators (e.g., Timeloop) is demonstrated for evaluation of various accelerator designs using applications with realistic inputs. Examples of multiple device configurations that are instantiable in a system are explored to evaluate the performance benefit of deploying novel accelerators. The proposed device is integrated with a programming model and system software to potentially explore the impacts of high-level programming languages/compilers and low-level effects such as task scheduling on multiple accelerators. We analyze our methodology for a set of applications that represent high-performance computing (HPC) and graph analytics. The applications include a computational chemistry kernel realized using tensor contractions, triangle counting, GraphSAGE and Breadth-first Search. These applications include kernels such as dense matrix-dense matrix multiplication, sparse matrix-spare matrix multiplication, and sparse matrix-dense vector multiplication. Our results indicate potential performance benefits and insights for system design by including accelerators that realize these kernels along-side general purpose accelerators.

AI, codesign, Accelerated Computing, Modeling and ↗

Two-dimensional materials for bio-realistic neuronal computing networks

Two-dimensional (2D) van der Waals materials have found broad utility in a diverse range of applications including electronics, optoelectronics, renewable energy, and quantum information technologies. Meanwhile, exponentially growing digital data coupled with the ubiquity of artificial intelligence algorithms have generated significant interest in edge neuromorphic computing as an alternative to centralized cloud computing. The drive to incorporate neuroscience principles into computing hardware is motivated by the low power consumption, parallel processing, and reconfigurability of the human brain. The diverse library of 2D materials with atomic-level thicknesses, exceptional electrostatic tunability, and integration versatility is particularly well-suited for realizing bio-realistic synaptic and neuronal functionality. Here, we summarize past and present work in this field and outline the frontier challenges that have not yet been overcome. Here we also delineate potential solutions and suggest that the neuroscience principles of criticality and synchrony have the potential to inspire breakthrough applications of 2D materials in neuronal computing networks.

36 MATERIALS SCIENCE↗

Estimating biofuel contaminant concentration from 4D ERT with mixing models

Here, we present the results of a lab-scaled feasibility study to assess the performance of electrical resistivity tomography for detection, characterization, and monitoring of fuel grade ethanol releases to the subsurface. Further, we attempt to determine the concentration distribution of the ethanol from the electrical resistivity tomography data using mixing-models. Ethanol is a renewable fuel source as well as an oxygenate fuel additive currently used to replace the known carcinogen methyl tert-butyl ether; however, ethanol is preferentially biodegraded and a cosolvent. When introduced to areas previously impacted by nonethanol-based fuels, it will facilitate the persistence of carcinogenic fuel compounds like benzene and ethylbenzene, as well as remobilize them to the ground water. These compounds would otherwise be retained in the soil column undergoing active or passive remediation processes such as soil vapor extraction or natural attenuation. Here, we introduce ethanol to a saturated Ottawa sand in a tank instrumented for four-dimensional geoelectrical measurements. Forward model results suggest pure phase ethanol released into a water saturated silica sand should present a detectable target for electrical resistivity tomography relative to a saturated silica sand only. We observe the introduction of ethanol to the closed hydraulic system and subsequent migration over the duration of the experiment. One-dimensional and three–dimensional temporal data are assessed for the detection, characterization, and monitoring of the ethanol release. Results suggest one-dimensional geoelectrical measurements may be useful for monitoring a release, while three-dimensional geoelectrical field imaging would be useful to characterize, monitor, and design effective remediation approaches for an ethanol release, assuming field conditions do not preclude the application of geoelectrical methods. We then attempt to use predictive mixing models to calculate the distribution of ethanol concentration within the measurement domain. For this study we examine four different models: a nested parallel mixing model, a nested cubic mixing model, the complex refractive index model (CRIM), and the Lichtenecker-Rother (L-R) model. The L-R model, modified to include an electrical formation factor geometry term, provided the best agreement with expected EtOH concentrations.

09 BIOMASS FUELS↗

thevenin: An Equivalent Circuit Modeling Package [SWR-24-132]

This package is a wrapper for the well-known Thevenin equivalent circuit model for simulating battery behavior with a focus on ease of use. The model is comprised of a single series resistor followed by any number of parallel RC pairs. The package includes an intuitive "experiment" interface, which simplifies the programming of constant or dynamic current, voltage, and/or power-driven loads, making it ideal for a wide range of applications, from basic tests to complex simulations. It also supports state-of-charge (SOC) and temperature-dependent properties, allowing the model to be more easily calibrated against real cells.

Randall, Corey↗

Assessment of Tools for Molten Salt Reactor Dose Rate Calculations

This report discusses a preliminary assessment of the capabilities of current state-of-the-art stochastic codes Shift and MCNP6 to calculate the ex-core radiation dose rates for a simplified Molten Salt Reactor (MSR) model. The Monte Carlo code Shift has been under significant development in recent years at ORNL as part of the CASL program and is now supported by NEAMS. Originally, Shift was developed for LWR ex-core calculations but with dose rate and shielding calculations specifically requested by the NEAMS program’s MSR industry partners, the MSR Application Drivers team was tasked with assessing Shift for non-LWR applications. This was the first application of the Shift code for non-LWRs and the findings can be considered preliminary due to the activities occurring only over a 5-month period. Attractive features of Shift include massive parallelization and advanced automated variance reduction techniques such as CADIS and FW-CADIS.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Alfalfa Virtual Building Service: Software Engineering Best Practices Applied to Runtime Interaction with Building Energy Models

Buildings are active participants in increasingly complex energy systems. Building Energy Modeling (BEM) has a key role to play in planning and de-risking an equitable energy transition, with BEM-backed "virtual buildings" critical path for diverse applications that include workforce training tools, Hardware-in-the-Loop (HIL) experimentation to study equipment performance under a range of conditions, Control-Hardware-in-the-Loop (CHIL) experimentation to de-risk commercial control implementations at equipment through grid orchestration levels, and integration of dynamic load profiles into grid modeling tools for energy system experimentation at the urban scale. Modeling requirements vary across these applications, but many software engineering tasks do not. The Alfalfa Virtual Building Service (AVBS, see https://github.com/NREL/alfalfa/wiki) is an open-source web service that solves these common tasks robustly in one place, providing a foundational platform for power users to bootstrap their own applications. AVBS abstracts the specifics of runtime interaction with OpenStudio, Modelica, and Spawn of EnergyPlus models behind a unified REST API. Additionally, AVBS provides resources for cloud deployment and scaling to 100s of parallel simulations, a growing library of modular Operational Technology (OT) integrations for emulation of real-world interfaces, and scripts to automate the population of communities of virtual buildings from URBANopt, ResStock and ComStock.

building automation↗