Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “high throughput computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Fast 2D Bicephalous Convolutional Autoencoder for Compressing 3D Time Projection Chamber Data

High-energy large-scale particle colliders produce data at high speed in the order of 1 terabytes per second in nuclear physics and petabytes per second in high energy physics. Developing real-time data compression algorithms to reduce such data at high throughput to fit permanent storage has drawn increasing attention. Specifically, at the newly constructed sPHENIX experiment at the Relativistic Heavy Ion Collider (RHIC), a time projection chamber is used as the main tracking detector, which records particle trajectories in a volume of three-dimensional (3D) cylinder. The resulting data are usually very sparse with occupancy around 10.8%. Such sparsity presents a challenge to conventional learning-free lossy compression algorithms, such as SZ, ZFP, and MGARD. The 3D convolutional neural network (CNN)-based approach, Bicephalous Convolutional Autoencoder (BCAE), outperforms traditional methods both in compression rate and reconstruction accuracy. BCAE can also utilize the computation power of graphical processing units suitable for deployment in a modern heterogeneous highperformance computing environment. This work introduces two BCAE variants: BCAE++ and BCAE-2D. BCAE++ achieves a 15% better compression ratio and a 77% better reconstruction accuracy measured in mean absolute error compared with BCAE. BCAE-2D treats the radial direction as the channel dimension of an image, resulting in a 3× speedup in compression throughput. In addition, we demonstrate an unbalanced autoencoder with a larger decoder can improve reconstruction accuracy without significantly sacrificing throughput. Lastly, we observe both the BCAE++ and BCAE-2D can benefit more from using half-precision mode in throughput (76 - 79% increase) without loss in reconstruction accuracy. The source code and links to data and pretrained models can be found at https://github.com/BNL-DAQ-LDRD/NeuralCompression_v2

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Multi-omics Resources for Understanding Gene Regulation in Response to ER Stress in Plants

Proteotoxic stress of the endoplasmic reticulum (ER) is a potentially lethal condition that ensues when the biosynthetic capacity of the ER is overwhelmed. A sophisticated and largely conserved signaling, known as the unfolded protein response (UPR), is designed to monitor and alleviate ER stress. In plants, the emerging picture of gene regulation by the UPR now appears to be more complex than ever before, requiring multi-omics-enabled network-level approaches to be untangled. In the past decade, with an increasing access and decreasing costs of next-generation sequencing (NGS) and high-throughput protein–DNA interaction (PDI) screening technologies, multitudes of global molecular measurements, known as omics, have been generated and analyzed by the research community to investigate the complex gene regulation of plant UPR. In this chapter, we present a comprehensive catalog of omics resources at different molecular levels (transcriptomes, protein–DNA interactomes, and networks) along with the introduction of key concepts in experimental and computational tools in data generation and analyses. Finally, this chapter will serve as a starting point for both experimentalists and bioinformaticians to explore diverse omics datasets for their biological questions in the plant UPR, with likely applications also in other species for conserved mechanisms.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Exploring the phase space of Zn 2 SbN 3 , a novel semiconducting nitride

The novel semiconductor Zn 2 SbN 3 is one of a growing list of ternary nitrides with promise for optoelectronic and energy applications. Previous work by Arca et al. [Materials Horizons, 2019, 6, 1669–1974] first reported synthesis of this material, but did not explore the effects of growth conditions on material formation. In this work, we present a semi-automated study of the relationship between growth conditions and crystallinity via high-throughput RF sputtering and a custom X-ray diffraction analysis routine. Zn 2 SbN 3 is found to crystallize in a wide range of growth conditions, and the formation of several contaminant phases is examined. Electron microscopy of these secondary phases, caused both by off-stoichiometry and by growth conditions, provides insight into the growth mechanisms of Zn 2 SbN 3 . Furthermore, computational work relates this material to other Zn-based ternary nitrides and offers an explanation for the difficulty of growing cation-ordered material despite the wide range of growth conditions explored.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Evaluating the Use of Foundational Chemical Language Models in Multimodal Graph Fusion

Rapid and accurate prediction of the physicochemical properties of molecules given their structures remains a key challenge in cheminformatics. Machine learning approaches offer high-throughput options, but the optimality of inductive biases and data representations are up for debate. For example, BERT-based masked language models (MLMs) can be trained in a self-supervised way on hundreds of millions to billions of readily available SMILES strings. Another option is graph neural networks (GNNs), which can operate directly on molecular structures. Yet, generating accurate molecular geometry is computationally expensive, leading to a relative scarcity in data compared to SMILES strings. It is attractive to combine these two paradigms by pre-training an LM on a large corpus of SMILES strings and embedding these representation into a geometric graph neural network. Despite the promise of such an approach, and contrary to previous studies, we find mixed results with the combination of the LMs and GNNs on several molecule datasets. In particular, we found evidence for improvement on the FreeSolv and QM7 benchmarks, but degraded performance on the ESOL, LIPO and QM9 datasets compared to a GNN baseline.

Francel, Collin [University of Alabama]↗
DOE OSTI2025

Spatially Aware Linear Transformer (SAL-T) for Particle Jet Tagging

Transformers are very effective in capturing both global and local correlations within high-energy particle collisions, but they present deployment challenges in high-data-throughput environments, such as the CERN LHC. The quadratic complexity of transformer models demands substantial resources and increases latency during inference. In order to address these issues, we introduce the Spatially Aware Linear Transformer (SAL-T), a physics-inspired enhancement of the linformer architecture that maintains linear attention. Our method incorporates spatially aware partitioning of particles based on kinematic features, thereby computing attention between regions of physical significance. Additionally, we employ convolutional layers to capture local correlations, informed by insights from jet physics. In addition to outperforming the standard linformer in jet classification tasks, SAL-T also achieves classification results comparable to full-attention transformers, while using considerably fewer resources with lower latency during inference. Experiments on a generic point cloud classification dataset (ModelNet10) further confirm this trend. Our code is available at https://github.com/aaronw5/SAL-T4HEP.

Wang, Aaron [Illinois U., Chicago] (ORCID:00000003↗
DOE OSTI2025

Modeling diffusion and depletion in high-aspect-ratio atomic layer deposition processes: Process parameters and manufacturing impacts

Atomic layer deposition (ALD) is a powerful technique for modifying the surface chemistry and properties of substrates with complex and nonplanar topologies. However, achieving uniform and conformal deposition on ultrahigh-aspect-ratio substrates remains challenging, typically requiring large quantities of precursors and long exposure times. Furthermore, process optimization is often performed empirically and involves substantial trial and error. In this work, we perform a combined experimental and computational study of ALD Al 2 O 3 infiltration into silica aerogel monoliths (aspect ratio >10 5 ). A reaction-diffusion model is used to explore the effects of key processing parameters, namely, exposure time per dose, precursor source temperature, number of aerogels in the reactor, and reactor volume. The model is based on quasi-static mode ALD, where the dosed precursor is held in the chamber for a fixed period of time before purging. We analyze the trade-offs between process throughput and precursor utilization for each of these parameters. Furthermore, we investigate the co-optimization and interactions between multiple process parameters, demonstrating the potential for further improvements. Furthermore, this physics-based model can be used to identify a set of process parameters for high-aspect-ratio ALD that meet specific manufacturing objective functions, including throughput, cost, and sustainability.

Aerogel↗
DOE OSTI2022

Transitioning from File-Based HPC Workflows to Streaming Data Pipelines with openPMD and ADIOS2

This paper aims to create a transition path from file-based IO to streaming-based workflows for scientific applications in an HPC environment. By using the openPMP-api, traditional workflows limited by filesystem bottlenecks can be overcome and flexibly extended for in situ analysis. The openPMD-api is a library for the description of scientific data according to the Open Standard for Particle-Mesh Data (openPMD). Its approach towards recent challenges posed by hardware heterogeneity lies in the decoupling of data description in domain sciences, such as plasma physics simulations, from concrete implementations in hardware and IO. The streaming backend is provided by the ADIOS2 framework, developed at Oak Ridge National Laboratory. This paper surveys two openPMD-based loosely-coupled setups to demonstrate flexible applicability and to evaluate performance. In loose coupling, as opposed to tight coupling, two (or more) applications are executed separately, e.g. in individual MPI contexts, yet cooperate by exchanging data. This way, a streaming-based workflow allows for standalone codes instead of tightly-coupled plugins, using a unified streaming-aware API and leveraging high-speed communication infrastructure available in modern compute clusters for massive data exchange. We determine new challenges in resource allocation and in the need of strategies for a flexible data distribution, demonstrating their influence on efficiency and scaling on the Summit compute system. The presented setups show the potential for a more flexible use of compute resources brought by streaming IO as well as the ability to increase throughput by avoiding filesystem bottlenecks.

Poeschel, Franz↗
DOE OSTI2025

Network Slicing for Federated Learning in Operational Technology Environment

Industrial Control Systems (ICS) and Supervisory Control and Data Acquisition (SCADA) environments are essential to modern infrastructure, facing challenges in ensuring low-latency, high-throughput communication while mitigating cyber threats. This paper presents a framework integrating Federated Learning (FL) and network slicing with Quality of Service (QoS) to enable real-time monitoring without disrupting OT operations. Leveraging digital twin technology and Network Function Virtualization (NFV), the architecture supports predictive analytics and Industry 4.0 requirements. FL facilitates decentralized model training, preserving data privacy and scalability, though it introduces potential throughput constraints. Network slicing addresses this by creating dedicated virtualized segments optimized for performance and security. Advanced fault tolerance at the container and instance levels enhances system reliability. The proposed architecture ensures high throughput, low latency, and secure orchestration for real-time anomaly detection in OT networks. Performance evaluations validate its efficiency in throughput, deployment, and learning accuracy, providing a robust foundation for future ICS automation and data-driven decision-making.

Delgado, Brian G. Rodiles [University of Texas at ↗
NASA NTRS2015

Link Analysis of High Throughput Spacecraft Communication Systems for Future Science Missions

NASA's plan to launch several spacecraft into low Earth Orbit (LEO) to support science missions in the next ten years and beyond requires down link throughput on the order of several terabits per day. The ability to handle such a large volume of data far exceeds the capabilities of current systems. This paper proposes two solutions, first, a high data rate link between the LEO spacecraft and ground via relay satellites in geostationary orbit (GEO). Second, a high data rate direct to ground link from LEO. Next, the paper presents results from computer simulations carried out for both types of links taking into consideration spacecraft transmitter frequency, EIRP, and waveform; elevation angle dependent path loss through Earths atmosphere, and ground station receiver GT.

Antennas↗
NASA NTRS2015

Link Analysis of High Throughput Spacecraft Communication Systems for Future Science Missions

NASA's plan to launch several spacecrafts into low Earth Orbit (LEO) to support science missions in the next ten years and beyond requires down link throughput on the order of several terabits per day. The ability to handle such a large volume of data far exceeds the capabilities of current systems. This paper proposes two solutions, first, a high data rate link between the LEO spacecraft and ground via relay satellites in geostationary orbit (GEO). Second, a high data rate direct to ground link from LEO. Next, the paper presents results from computer simulations carried out for both types of links taking into consideration spacecraft transmitter frequency, EIRP, and waveform; elevation angle dependent path loss through Earths atmosphere, and ground station receiver GT.

Amplifier↗
DOE OSTI2026

MapsTorch : automatic differentiation for X-ray fluorescence data analysis

X-ray fluorescence (XRF) is a popular spectroscopy technique for elemental analysis. Spectrum fitting and parameter tuning are at the core of XRF analysis and are conventionally manually intensive, especially for synchrotron experiments involving large amounts of diverse samples. This work introduces the automatic differentiation (AD) technique to XRF and an open-source package called MapsTorch. By transforming an analytical model of the XRF spectrum into a differentiable computation graph with AD, MapsTorch enables robust optimization of parameters and elemental intensities. We evaluate MapsTorch by conducting computational experiments on a large number of historical synchrotron XRF datasets and compare its performance with the currently practiced fitting tool NLopt. The results show that MapsTorch consistently achieves high-quality fits and often leads to better fitting quality than NLopt, particularly in tasks such as initial spectrum fitting and elemental intensity refinement. The robust performance of MapsTorch paves the way for developing automated and high-throughput XRF data analysis workflows to handle the increasing data volumes expected from next-generation synchrotron facilities.

X-ray fluorescence↗
DOE OSTI2022

Drugsniffer: An Open Source Workflow for Virtually Screening Billions of Molecules for Binding Affinity to Protein Targets

The SARS-CoV2 pandemic has highlighted the importance of efficient and effective methods for identification of therapeutic drugs, and in particular has laid bare the need for methods that allow exploration of the full diversity of synthesizable small molecules. While classical high-throughput screening methods may consider up to millions of molecules, virtual screening methods hold the promise of enabling appraisal of billions of candidate molecules, thus expanding the search space while concurrently reducing costs and speeding discovery. Here, we describe a new screening pipeline, called drugsniffer, that is capable of rapidly exploring drug candidates from a library of billions of molecules, and is designed to support distributed computation on cluster and cloud resources. As an example of performance, our pipeline required ~40,000 total compute hours to screen for potential drugs targeting three SARS-CoV2 proteins among a library of ~3.7 billion candidate molecules.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1992

Second tracking and data relay satellite system (TDRSS) ground terminal - STGT

The STGT will provide high availability command and control and improved services to users of NASA's Space Network in the 1990s and beyond. The Space Network, comprising the TDRSS, will be the primary communications gateway for Space Station Freedom and other user's spacecraft and their ground support elements. The STGT will contain a redundant, distributed computer system providing configuration and control of redundant RF to baseband equipment chains for throughput of user data, for user tracking services and for control and monitoring of the TDR Satellites. An interface with NASA's Network Control Center, located at the Goddard Space Flight Center, provides automated scheduling and control of the STGT. A local TDRSS Operations Control Center for local monitoring and back-up control and an interface with the Domestic Satellite for data distribution will be provided by the STGT. This paper describes the STGT, with emphasis on configuration, control and monitoring of those elements providing TDRSS services to user spacecraft.

Berndt, Allen K.↗
DOE OSTI2022

Low Latency and High Data Rate (LLHD) Scheduler: A Multipath TCP Scheduler for Dynamic and Heterogeneous Networks

The scheduler is a crucial component of the multipath transmission control protocol (MPTCP) that dictates the path that a data packet takes. Schedulers are in charge of delivering data packets in the right order to prevent delays caused by head-of-line blocking. The modern Internet is a complicated network whose characteristics change in real-time. MPTCP schedulers are supposed to understand the real-time properties of the underlying network, such as latency, path loss, and capacity, in order to make appropriate scheduling decisions. However, the present scheduler does not take into account all of these characteristics together, resulting in lower performance. We present the low latency and high data rate (LLHD) scheduler, which successfully makes scheduling decisions based on real-time information on latency, path loss, and capacity, and achieves around 25% higher throughput and 45% lower data transmission delay than Linux’s default MPTCP scheduler.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

CommAwareNet: Towards Communication‐Aware Smart Facilities: Designing an Energy‐Efficient High‐Data‐Rate and Reliable Hybrid THz/VLC Comm. Arch. Reinforced with Intelligent Surfaces for Future Network

This project will develop foundations for energy-efficient, high-data-rate, and reliable communication links for next-generation advanced wireless technologies. The Internet of Everything is emerging as a major technology that can establish a massively connected network among both human-type users and machine-type devices. Particularly, massive machine-type communication is becoming the dominant communication paradigm for numerous emerging areas, including data center networking and wireless backhaul, healthcare (e-health), manufacturing (industry 4.0), utilities, transportation (connected cars and public safety), and virtual or augmented reality for human-machine interaction applications. The rising demand for high data rates, especially in indoor scenarios and densely populated outdoor environments, will eventually overload conventional RF-based technologies. This project aims to conduct fundamental research to design, optimize, and validate a communication-aware, energy-efficient, and reliable network (CommAwareNet) architecture for future smart facilities and environments that require unprecedented high throughput needs for massive numbers of the machine- and human-type users. The scientific and technical merit of this work lies in the research required to bring the proposed transformative CommAwareNet solution into fully functional and practical architecture.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

High-throughput ab initio reaction mechanism exploration in the cloud with automated multi-reference validation

Quantum chemical calculations on atomistic systems have evolved into a standard approach to studying molecular matter. These calculations often involve a significant amount of manual input and expertise, although most of this effort could be automated, which would alleviate the need for expertise in software and hardware accessibility. Here, we present the AutoRXN workflow, an automated workflow for exploratory high-throughput electronic structure calculations of molecular systems, in which (i) density functional theory methods are exploited to deliver minimum and transition-state structures and corresponding energies and properties, (ii) coupled cluster calculations are then launched for optimized structures to provide more accurate energy and property estimates, and (iii) multi-reference diagnostics are evaluated to back check the coupled cluster results and subject them to automated multi-configurational calculations for potential multi-configurational cases. All calculations are carried out in a cloud environment and support massive computational campaigns. Key features of all components of the AutoRXN workflow are autonomy, stability, and minimum operator interference. We highlight the AutoRXN workflow with the example of an autonomous reaction mechanism exploration of the mode of action of a homogeneous catalyst for the asymmetric reduction of ketones.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

High-throughput investigation of the formation of double spinels

Spinel compounds, with the general chemical formula AB 2 O 4 , are a wide class of materials, where A and B can be a variety of cations, providing this structure with a great deal of functional flexibility and giving rise to its considerable scientific interest. Recently, a spinel with the general formula ABB'O 4 has been predicted, increasing the possible usability of the spinels due to the higher cation diversity in the so-called double spinel structure. In this study, we use density functional theory calculations to predict if double spinels can be formed between experimentally synthesized normal and inverse single spinels. Our computations reveal that 49 double spinels have negative mixing enthalpies and are thus thermodynamically stable, with most of the stable compounds being formed from one of two distinct cation orderings. We show that the 17 different cations that form the different double spinels have a preferred site, tetrahedral or octahedral, except for Mn, Fe and Co which can occupy both sites interchangeably. We also study the relation between mixing enthalpies and cation-specific properties, as well as ways to classify the double spinels into distinct types and spinel groups depending on the cation ordering and cation oxidation states, respectively. Furthermore, by applying the Sure Independence Screening and Sparsifying Operator (SISSO) approach on the coordination-dependent ionic radii of the elemental constituents, we show that an interplay of local strain and electrostatic dominated terms can be used to separate the double spinels into distinct structural types depending on the cation order and their oxidation states.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Data-driven computational prediction and experimental realization of exotic perovskite-related polar magnets

Rational design of technologically important exotic perovskites is hampered by the insufficient geometrical descriptors and costly and extremely high-pressure synthesis, while the big-data driven compositional identification and precise prediction entangles full understanding of the possible polymorphs and complicated multidimensional calculations of the chemical and thermodynamic parameter space. Here we present a rapid systematic data-mining-driven approach to design exotic perovskites in a high-throughput and discovery speed of the A 2 BB ’O 6 family as exemplified in A 3 TeO 6 . The magnetoelectric polar magnet Co 3 TeO 6 , which is theoretically recognized and experimentally realized at 5 GPa from the six possible polymorphs, undergoes two magnetic transitions at 24 and 58 K and exhibits helical spin structure accompanied by magnetoelastic and magnetoelectric coupling. We expect the applied approach will accelerate the systematic and rapid discovery of new exotic perovskites in a high-throughput manner and can be extended to arbitrary applications in other families.

36 MATERIALS SCIENCE↗