Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “architecture design”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

HARMONY: Large-Scale Architecture Search for Efficient Hybrid Language Models

As large language models scale to trillions of parameters, their computational and memory requirements present critical challenges for efficient training and deployment. While Mixture of Experts (MoE) architectures enable efficient scaling through sparse parameter activation, and state-space models like Mamba offer linear-time complexity, principled methods for combining these paradigms remain undeveloped. We introduce HARMONY (Hybrid Architecture Research for Mamba, Optimized with Neural efficiencY), a multi-objective evolutionary neural architecture search framework for discovering efficient hybrid language models that integrate Transformer attention mechanisms, Mixture-of-Experts routing, and Mamba state-space components. Through large-scale distributed search using 16,384 MI250X GPUs on the Frontier supercomputer, HARMONY explores a comprehensive design space encompassing six attention variants (MHA, MQA, GQA, MLA, SWA, and Mamba-2), variable MoE configurations with both routed and shared experts, and extensive Mamba hyperparameters. Our framework discovers heterogeneous architectures that balance training performance with computational efficiency through multi-objective optimization incorporating latency penalties and fitness-based selection. Analysis of discovered architectures reveals that optimal hybrid designs favor heterogeneous component mixing rather than homogeneous patterns, with Mamba-2 and Multi-Head Latent Attention (MLA) emerging as preferred mechanisms. Discovered architectures demonstrate superior training efficiency: our best configuration achieves a final perplexity of 1.0874 with 2.38B parameters while processing 4,320 tokens/second, outperforming significantly larger manually designed models. Full-scale evaluation shows HARMONY's top architectures achieve better loss trajectories than equivalently-sized models using state-of-the-art configurations including Mixtral, Jamba, and Samba. Additionally, we demonstrate 91% weak scaling efficiency when training discovered 36B-parameter models across 1,024 GPUs. HARMONY is released as an open framework with comprehensive tools for building and training hybrid models using expert-data-pipeline parallelism, democratizing access to automated architecture design for next-generation language models.

Herron, Emily [ORNL] (ORCID:0000000273008172)↗

Space-tiled colloidal crystals from DNA-forced shape-complementary polyhedra pairing

Generating space-filling arrangements of most discrete polyhedra nanostructures of the same shape is not possible. However, if the appropriate individual building blocks are selected (e.g., cubes), or multiple shapes of the appropriate dimensions are matched (e.g., octahedra and tetrahedra) and their pairing interactions are subsequently forced, space-filled architectures may be possible. With flexible molecular ligands (polyethylene glycol–modified DNA), the shape of a polyhedral nanoparticle can be deliberately altered and used to realize geometries that favor space tessellation. In this work, 10 new colloidal crystals were synthesized from DNA-modified nanocrystal building blocks that differed in shapes and sizes, designed to form space-filling architectures with micron-scale dimensions. The insights and capabilities provided by this new strategy substantially expand the scope of colloidal crystals possible and provide an expanded tool kit for researchers interested in designing metamaterials.

Science & Technology - Other Topics↗

Engineering the atomic structure of sequence-defined peptoid polymers and their assemblies

Peptoids are a family of sequence-defined, non-natural biomimetic polymers which show excellent properties including good chemical and enzymatic stability and high structural tunability. The solid-phase submonomer synthesis method allows precise control over the identity and sequence of chemically diverse side chains, enabling the atomic engineering of their chemical structures for a variety of applications. This unprecedented level of structural control enables access to atomically defined three-dimensional chain conformations and assemblies, facilitating the design and optimization of a variety of nanoscale architectures that can function in biology and materials science. In order to approach the rational design of peptoid materials in a more predictive and precise manner, it is crucial to fully understand how chemical information, in the form of the monomer sequence, encodes their folding and assembly into structurally defined, functional 3D shapes. Furthermore, this perspective focuses on recent studies into the atomic engineering of peptoid nanostructures by examining the impact of sequence variations on their secondary and three-dimensional structures, as well as their functional properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An artificial spiking quantum neuron

Abstract Artificial spiking neural networks have found applications in areas where the temporal nature of activation offers an advantage, such as time series prediction and signal processing. To improve their efficiency, spiking architectures often run on custom-designed neuromorphic hardware, but, despite their attractive properties, these implementations have been limited to digital systems. We describe an artificial quantum spiking neuron that relies on the dynamical evolution of two easy to implement Hamiltonians and subsequent local measurements. The architecture allows exploiting complex amplitudes and back-action from measurements to influence the input. This approach to learning protocols is advantageous in the case where the input and output of the system are both quantum states. We demonstrate this through the classification of Bell pairs which can be seen as a certification protocol. Stacking the introduced elementary building blocks into larger networks combines the spatiotemporal features of a spiking neural network with the non-local quantum correlations across the graph.

Kristensen, Lasse Bjørn (ORCID:0000000239398170)↗

Universal Utility Data Exchange (UUDEX) Functional Design Requirements - Rev 1

This document provides a set of high-level functional design requirements for Universal Utility Data Exchange (UUDEX). These requirements include a set of use cases, data exchanges supported by UUDEX, both for grid operations and for cyber security data, functional requirements for data exchange, data models used by UUDEX, data exchange architectures, and security considerations. These functional design requirements are intended to be used in more detailed design documents.

97 MATHEMATICS AND COMPUTING↗

Design, Fabrication and On-Sun Performance Evaluation of SiC Receiver Feature Specimens for CST Applications Using Additively Manufactured SiC Materials

Increasing operating temperatures of solar receivers is paramount to the efficiency of concentrated solar thermal (CST) and solar power (CSP) systems. Successful development of CST systems to generate heat for industrial applications requires significant increase in temperature capability and techno-economically viability of the receiver systems. Supported by an award from the Solar Technology Office (SETO), US Department of Energy (DOE), GE Aerospace Research in collaboration with Heliogen Holdings Inc and Sandia National Lab, is engaged in the development of ultra-High Operating Temperature SiC-matrix Solar Thermal Air Receiver (HOTSSTAR) enabled by additive manufacturing. The program objective is to demonstrate SiC receiver with air exit temperatures up to 1100 oC and high thermal efficiencies. We report design, fabrication and on-sun test results of SiC components of a prototype 50kW (thermal) HOTSSTAR module. The receiver module architecture is based on a radial airflow design and consists of a series of radial SiC receiver sectors organized around a SiC center absorber. The SiC components are fabricated using binder-jet printed SiC followed by melt-infiltration reaction bonding process. To enhance the reliability and to minimize the risk of cracking damage of SiC test articles in thermal gradient and thermal shock environment of the application, the components were laminated with GE’s MI SiC-SiC CMC. Following extensive design and lab test analyses, selected SiC component designs are tested at Heliogen Lancaster Solar field under highly concentrated solar fluxes around 2000 suns to assess the thermal performance characteristics under realistic field conditions. We report on the test results and compare the thermal performances of different HOTSSTAR SiC absorbers. Finally, we discuss fabrication and initial assembly of a 50kW prototype test module in preparation of on-sun field tests to assess the performance of our final design.

CST, CSP, high temperature, air receiver, SiC, add↗

A parallel and performance portable implementation of a full-field crystal plasticity model

We have developed a parallel implementation of an Elasto-Viscoplastic Fast Fourier Transform-based (EVPFFT) micromechanical solver to enable computationally efficient crystal plasticity modeling for polycrystalline materials. Our primary focus lies in achieving performance portability, allowing a single EVPFFT implementation to run optimally on various homogeneous architectures, including multi-core Central Processing Units (CPUs), as well as on heterogeneous computer architectures comprising multi-core CPUs and Graphics Processing Units (GPUs) from different vendors. To accomplish this goal, we have leveraged MATAR, a C++ software library that simplifies the creation and utilization of multidimensional dense or sparse matrix and array data structures. These data structures are designed to be portable across diverse architectures through the use of Kokkos, a performance-portable library. Additionally, we have employed the Message Passing Interface (MPI) to efficiently distribute the computational workload among processors. The heFFTe (Highly Efficient FFT for Exascale) library is used to facilitate the performance portability of the fast Fourier transforms (FFTs) computation. The computational performance of EVPFFT is evaluated and presented in terms of parallel scalability and simulation runtime on different high-performance computing (HPC) architectures. As a result, the utility of the developed framework to efficiently simulate the micro-mechanical fields in polycrystalline microstructures in engineering applications is discussed.

36 MATERIALS SCIENCE↗

Neural architecture codesign for fast physics applications

We develop a pipeline to streamline neural architecture codesign for physics applications to reduce the need for ML expertise when designing models for novel tasks. Our method employs neural architecture search and network compression in a two-stage approach to discover hardware efficient models. This approach consists of a global search stage that explores a wide range of architectures while considering hardware constraints, followed by a local search stage that fine-tunes and compresses the most promising candidates. We exceed performance on various tasks and show further speedup through model compression techniques such as quantization-aware-training and neural network pruning. We synthesize the optimal models to high level synthesis code for FPGA deployment with the hls4ml library. Additionally, our hierarchical search space provides greater flexibility in optimization, which can easily extend to other tasks and domains. We demonstrate this with two case studies: Bragg peak finding in materials science and jet classification in high energy physics, achieving models with improved accuracy, smaller latencies, or reduced resource utilization relative to the baseline models.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

High-Efficiency and Low-Carbon Energy Storage and Power Generation System for Electric Aviation

This report summarizes the work performed by University of California San Diego (UCSD) – Honeywell Aerospace (Honeywell) team for the U.S. Department of Energy/Advanced Research Projects Agency-Energy (DOE/ARPA-E) under Phase 1 (April 2021 – October 2023) project, Cooperative Agreement DE-AR0001347 entitled “High-Efficiency and Low-Carbon Energy Storage and Power Generation System for Electric Aviation”. The main objective of this project is to develop and demonstrate an energy storage and power generation (ESPG) system operating on bio liquid natural gas (LNG) for electric aviation applications. The ESPG system concept in this project is a fuel cell, battery, and gas turbine hybrid system that incorporates an innovative solid oxide fuel cell (SOFC) technology. This SOFC technology has two main novel elements: (i) a lightweight and compact stack architecture that consists of cells and cell modules in electrical parallel and series connections (the module design) and (ii) exceptionally high performance, direct methane thin-film cells on porous substrate made by sputtering deposition process. This fuel cell has the specific power and volumetric power density suitable for electric aviation applications. Based on the current status of the SOFC technology, the Phase 1 work focused on the following activities: (i) ESPG System Modeling – to design and optimize an aircraft SOFC-based ESPG system concept that met the performance, weight and cost targets; (ii) Cell Material Development and Scaleup – to demonstrate scalability of the sputtering process for manufacture of thin-film SOFC cells of practical sizes, confirm the exceptional performance of sputtered cells, improve cell stability and durability for operation with hydrogen and methane fuel, and develop a suitable electrically conducting porous substrate to replace the current non-conducting ceramic substrate; (iii) Stack Development – to design and manufacture stack components for the stack architecture, evaluate and select a suitable sealant, and build and operate multi-cell stacks to demonstrate stack operation, and (iv) Technology to Market – to develop business models and commercialization plans, conduct various market and technology analysis and estimate SOFC and ESPG system costs.

25 ENERGY STORAGE↗

Operando Neutron Imaging of Lithium Flux and Gradient Cathode Design for Enhanced Kinetics in High‐Loading All‐Solid‐State Li─S Batteries

All-solid-state Li–sulfur batteries (ASSLSBs) are considered promising candidates for next-generation energy storage owing to their inherent safety, high energy density, and abundant sulfur resources. However, slow redox kinetics greatly limit sulfur utilization during solid-solid sulfur reactions, leading to significant challenges to achieve efficient performance in high-mass-loading ASSLSBs. Here, operando neutron image is employed to directly visualize, for the first time, that sluggish Li + transport kinetics and the uneven distribution of Li + during cathodic reactions are critical factors limiting sulfur conversion. To address this issue, gradient cathode architectures comprising three and five layers are designed, in which catholyte concentrations are strategically varied to optimize Li-ion flux and enhance ionic conductivity of the whole composite cathode electrode. Operando neutron imaging distinctly visualizes and confirms that three-layer gradient approach significantly enhances Li-ion mobility, resulting in more uniform redox reactions and greatly improved sulfur utilization compared to traditional non-gradient structures. Consequently, the three-layer gradient cathode achieves superior rate performance and reduced electrode polarization at high sulfur mass loadings of 4.5 and 6.0 mg cm −2 . Furthermore, the applicability and scalability of this design are demonstrated in a five-layer gradient cathode architecture, achieving an impressive discharge specific capacity increase from 656 mAh g −1 (three-layer gradient) to 1232 mAh g −1 at 1/20 C for ultra-high sulfur loading of 7.5 mg cm −2 . In conclusion, this innovative gradient cathode design offers substantial advancements in understanding and overcoming Li-ion transport limitations, paving the way toward practical, high-energy-density ASSLSBs.

25 ENERGY STORAGE↗

Augmented DNA Nanoarchitectures: A Structural Library of 3D Self-Assembling Tensegrity Triangle Variants

The DNA tensegrity triangle is known to reliably self-assemble into a 3D rhombohedral crystalline lattice via sticky-end cohesion. Here, in this study, the library of accessible motifs is expanded through covalent extensions of intertriangle regions and sticky-end-coordinated linkages of adjacent triangles with double helical segments using both geometrically symmetric and asymmetric configurations. The molecular structures of 18 self-assembled architectures at resolutions of 3.32–9.32 Å are reported; the observed cell dimensions, cavity sizes, and cross-sectional areas agree with theoretical expectations. These data demonstrate that fine control over triclinic and rhombohedral crystal parameters and the customizability of more complex 3D DNA lattices are attainable via rational design. It is anticipated that augmented DNA architectures may be fine-tuned for the self-assembly of designer nanocages, guest–host complexes, and proscriptive 3D nanomaterials, as originally envisioned. Finally, designer asymmetric crystalline building blocks can be seen as a first step toward controlling and encoding information in three dimensions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Software Defined Architectures for Portability and Performance

The Software Defined Architectures for Portability and Performance (SODAPOP) project developed a co-design framework to partition and map converged applications on specialized heterogeneous architectures. We started from key domain applications that combine scientific simulation with data analytics and machine learning as drivers to integrate our framework. The framework includes high-level compilers that interfaces with high-level programming frameworks, domain-specific optimization passes, and hardware-oriented optimizations. The framework leverages hardware generators to enable specialization and facilitate exploration of custom system designs.

97 MATHEMATICS AND COMPUTING↗

An Introduction to the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FAST-DERMS): Preprint

Deployment and capability of distributed energy resources (DER) in power systems is growing rapidly. These resources present an opportunity for low-cost provision of energy and grid services. The Federal Energy Regulatory Commission recently provided rulings to enable market participation of these distribution-connected resources, but the prevailing strategies for their management may not scale well to meet future needs. This paper introduces the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FASTDERMS) which was designed to address this need. In it we describe the architectural features of the approach, and a reference controls implementation employing a hierarchical coordination that includes stochastic optimization, model predictive control, and a simple real-time management scheme. Sample results from simulation show firm transmission-level service provision measured at the distribution substation.

DERMS↗

Practical implications of SFQ-based two-qubit gates

Scalability of today’s superconducting quantum computers is limited due to the huge costs of generating/routing microwave control pulses per qubit from room temperature. One active research area in both industry and academia is to push the classical controllers to the dilution refrigerator in order to increase the scalability of quantum computers. Superconducting Single Flux Quantum (SFQ) is a classical logic technology with low power consumption and ultra-high speed, and thus is a promising candidate for in-fridge classical controllers with maximized scalability. Prior work has demonstrated high-fidelity SFQ-based single-qubit gates. However, little research has been done on SFQ-based multi-qubit gates, which are necessary to realize SFQ-based universal quantum computing.In this paper, we present the first thorough analysis of SFQ-based two-qubit gates. Our observations show that SFQ-based two-qubit gates tend to have high leakage to qubit non-computational subspace, which presents severe design challenges. We show that despite these challenges, we can realize gates with high fidelity by carefully designing optimal control methods and qubit architectures. We develop optimal control methods that suppress leakage, and also investigate various qubit architectures that reduce the leakage. After carefully engineering our SFQ-friendly quantum system, we show that it can achieve similar gate fidelity and gate time to microwave-based quantum systems. Furthermore, the promising results of this paper show that (1) SFQ-based universal quantum computation is both feasible and effective; and (2) SFQ is a promising approach in designing classical controller for quantum machines because it can increase the scalability while preserving gate fidelity and performance.

42 ENGINEERING↗

PERLE A ‘STEPPING STONE’ FOR THE NEXT GENERATION ERLS

PERLE (Powerful ERL for Experiments) is a novel Energy Recovery Linac (ERL) test facility, which has been designed to validate choices for a 50 GeV ERL foreseen in the design of the LHeC and the FCC-eh, and to later serve a set of dedicated nuclear and particle physics experiments. Its main thrust is to probe high current, continuous wave (CW), multi-pass operation with superconducting cavities at 802 MHz (and perhaps testing other frequencies of interest). With very high transient beam power (~10 MW), PERLE offers an opportunity for controllable study of every beam dynamic effect of interest in the next generation of ERL design and become a ?stepping stone? between present state-of-art 1 MW ERLs and future 100 MW scale applications. PERLE design features flexible momentum compaction lattice architecture for six vertically stacked return arcs and a high current, 7 MeV, photo-injector. With only one pair of four cavity cryomodules, 500 MeV beam energy can be reached in three re-circulation passes, with beam currents of about 20 mA. The beam is decelerated in three consecutive passes back to the injection energy. Work on the engineering design of PERLE has just begun.

Bogacz, S.↗

Co-Development of Oscillating Water Column (OWC) and Offshore Power Station

The project proposed an Oscillating Water Column (OWC) at a low power rating (1-5kW); to build a prototype and perform field testing within 1–3 years and achieving a commercial version of the OWC 3–5 years. We selected the OWC off-the-shelf components to secure the supply-chain sources and to warrant stable and minimum pricing. We want to curtail the capital cost by reducing the weight and volume of the overall system structure at the design level by designing a high-speed turbine generator and optimizing the airspeed amplification. We want to minimize the operational and maintenance (O&M) costs through simplified architecture, minimal parts, modular/plug-and-play, and easy access designs.

16 TIDAL AND WAVE POWER↗

A sub-5 ps jitter time-to-digital converter ASIC with back-gate delay tuning in 22 nm CMOS

We present the design of a Time-to-Digital Converter (TDC) ASIC together with performance characterization results at cryogenic temperature (6-8 K), and at room temperature using emulated Low-Gain Avalanche Detector (LGAD) signals. The TDC design uses a two-step architecture with a ring-oscillator based counter and a Vernier delay line fine TDC. The TDC is implemented in an FD-SOI process, and back-gate tuning is used not only to correct threshold variation due to cryogenic operation, but also as a novel way to tune TDC delay elements with very little overhead. Using this technique, we demonstrate a design with very low power (0.5 mW) and area (0.003 mm 2 ). We present test results using the Fermilab Constant Fraction Discriminator (FCFD) ASIC to produce discriminated signals from an internal charge injection mechanism that mimics the waveform and signal amplitude of minimum ionizing particles impinging on LGAD sensors. We characterize the time precision of the full system and verify that the TDC ASIC contributes a negligible amount to the total system time precision, fully consistent with the expected jitter contribution of less than 5 ps. In conclusion, the results presented here demonstrate the utility of our TDC for applications in physics and quantum communications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Nanoparticle-Mediated Assembly of Peptoid Nanosheets Functionalized with Solid-Binding Proteins: Designing Heterostructures for Hierarchy

The fabrication of ordered architectures that intimately integrate polymer, protein and inorganic components remains difficult. Two promising building blocks to tackle this challenge are peptoids, peptide mimics capable of self-assembly into well-defined structures, and solid-binding peptides, which offer a biological path to controlled inorganic assembly. Here, we report on the synthesis of 3.3 nm-thick, thiol-reactive peptoid nanosheets from equimolar mixtures of unmodified and maleimide-derivatized versions of the Nbpe 6 Nce 6 oligomer, optimize the location of engineered cysteine residues in silica-binding derivatives of superfolder green fluorescent protein for maleimide conjugation, and react the two components to form proteinpeptoid hybrids exhibiting partial or uniform protein coverage on both of their sides. Using 10 nm silica nanoparticles, we trigger the stacking of these 2D structures into a multi-layer material comprised of alternating peptoid, protein and organic layers. This simple and modular approach to hierarchical hybrid synthesis should prove useful in bioimaging and photocatalysis applications.

77 NANOSCIENCE AND NANOTECHNOLOGY↗