Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “design pattern”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

HARMONY: Large-Scale Architecture Search for Efficient Hybrid Language Models

As large language models scale to trillions of parameters, their computational and memory requirements present critical challenges for efficient training and deployment. While Mixture of Experts (MoE) architectures enable efficient scaling through sparse parameter activation, and state-space models like Mamba offer linear-time complexity, principled methods for combining these paradigms remain undeveloped. We introduce HARMONY (Hybrid Architecture Research for Mamba, Optimized with Neural efficiencY), a multi-objective evolutionary neural architecture search framework for discovering efficient hybrid language models that integrate Transformer attention mechanisms, Mixture-of-Experts routing, and Mamba state-space components. Through large-scale distributed search using 16,384 MI250X GPUs on the Frontier supercomputer, HARMONY explores a comprehensive design space encompassing six attention variants (MHA, MQA, GQA, MLA, SWA, and Mamba-2), variable MoE configurations with both routed and shared experts, and extensive Mamba hyperparameters. Our framework discovers heterogeneous architectures that balance training performance with computational efficiency through multi-objective optimization incorporating latency penalties and fitness-based selection. Analysis of discovered architectures reveals that optimal hybrid designs favor heterogeneous component mixing rather than homogeneous patterns, with Mamba-2 and Multi-Head Latent Attention (MLA) emerging as preferred mechanisms. Discovered architectures demonstrate superior training efficiency: our best configuration achieves a final perplexity of 1.0874 with 2.38B parameters while processing 4,320 tokens/second, outperforming significantly larger manually designed models. Full-scale evaluation shows HARMONY's top architectures achieve better loss trajectories than equivalently-sized models using state-of-the-art configurations including Mixtral, Jamba, and Samba. Additionally, we demonstrate 91% weak scaling efficiency when training discovered 36B-parameter models across 1,024 GPUs. HARMONY is released as an open framework with comprehensive tools for building and training hybrid models using expert-data-pipeline parallelism, democratizing access to automated architecture design for next-generation language models.

Herron, Emily [ORNL] (ORCID:0000000273008172)↗

Investigating the Impact of Temporal and Directional Traffic Distribution on Crash Frequencies

Safety Performance Functions (SPFs) are mathematical models that establish relationships between the frequency of various crash types and site-specific characteristics, serving as essential tools for traffic safety analysis and roadway design. Traditional SPFs, however, often overlook the temporal fluctuations in traffic flow (such as peak-hour surges) and directional imbalances between opposing traffic streams. These traffic patterns can exacerbate congestion, disrupt driver behavior, and create unexpected conflict points, potentially leading to increased crash frequencies and more severe accidents. In light of this gap, this study aims to explore the potential of incorporating K-factors (representing peak-hour traffic proportions) and D-factors (reflecting the imbalance of directional traffic) into the development of SPFs to assess whether these factors can effectively represent the impact of temporal and spatial traffic distribution on roadway safety. Using crash data from Pennsylvania urban-suburban collector roadways, it is found that the D-factor plays a significant role in predicting the frequency of total crashes, fatal + injury crashes, and angle crashes, with positive coefficient signs indicating that higher directional imbalances correspond to increased crash risks. Similarly, the K-factor emerges as a critical predictor for fatal + injury crashes and rear-end crashes, with negative coefficients suggesting that a more pronounced traffic peak is associated with a reduction in expected crash frequencies. These results highlight the importance of accounting for uneven traffic distribution in both time and direction when developing SPFs, offering deeper insights into crash patterns and supporting more effective safety interventions and roadway designs.

Xu, Guanhao [ORNL] (ORCID:0000000214326357)↗

Polarization-dependent thin-film wire-grid reflectarray for terahertz waves

A thin-film polarization-dependent reflectarray based on patterned metallic wire grids is realized at 1 THz. Unlike conventional reflectarrays with resonant elements and a solid metal ground, parallel narrow metal strips with uniform spacing are employed in this design to construct both the radiation elements and the ground plane. For each radiation element, a certain number of thin strips with an identical length are grouped to effectively form a patch resonator with equivalent performance. The ground plane is made of continuous metallic strips, similar to conventional wire-grid polarizers. The structure can deflect incident waves with the polarization parallel to the strips into a designed direction and transmit the orthogonal polarization component. Measured radiation patterns show reasonable deflection efficiency and high polarization discrimination. Utilizing this flexible device approach, similar reflectarray designs can be realized for conformal mounting onto surfaces of cylindrical or spherical devices for terahertz imaging and communications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

SU-C-9A-07: Fabrication and Calibration of a Novel High-Sensitivity Collimator for Brain SPECT Imaging

Purpose: We have designed a novel collimator for brain SPECT imaging that yields greatly increased sensitivity near the center of the brain without loss of resolution. The collimator was manufactured and initial evaluation has been completed. Methods: The collimator was time-consuming and challenging to build. Because our desired hole pattern required substantial variations in hole angle, we designed two supporting plates to securely position about 34,000 hexagonal, slightly tapered, 75-mm long steel pins. The holes in the plates were modeled to yield the desired focal length, hole length and septal thickness. Molten lead was poured in between the plates, and all pins were removed after cooling. The sensitivity gain compared to a fan-beam collimator was measured using a point source placed along the central ray at several distances from the collimator face. Visual inspection of the holes was not possible as the collimator was sealed so it could be safely mounted on a SPECT system. Therefore, we prepared a 2D array of 768, ∼48μCi Tc-99m point sources, separated by 1.6 cm. The array was imaged for 10 minutes at 4 shifted locations to reduce sampling distance to 8 mm. Results: The sensitivity of the novel cone-beam collimator varied with distance from the detector face; it was higher than that of the fan-beam collimator by factors ranging from 3 to 176. Examination of the projections of the 4×768 point sources revealed that fewer than 2% of the holes were fully or partially blocked, which indicates that the intensive manual fabrication process was very successful. Conclusion: We have designed and manufactured a novel collimator for brain SPECT imaging. As expected, the sensitivity is much higher than that of a fan-beam collimator. Because of differences between the manufactured collimator and its design, reconstruction of the data will require a measured system function.

60 APPLIED LIFE SCIENCES↗

Respiratory motion management using audio-visual biofeedback for respiratory-gated radiotherapy of synchrotron-based pulsed heavy-ion beam delivery

Purpose: To efficiently deliver respiratory-gated radiation during synchrotron-based pulsed heavy-ion radiotherapy, a novel respiratory guidance method combining a personalized audio-visual biofeedback (BFB) system, breath hold (BH), and synchrotron-based gating was designed to help patients synchronize their respiratory patterns with synchrotron pulses and to overcome typical limitations such as low efficiency, residual motion, and discomfort. Methods: In-house software was developed to acquire body surface marker positions and display BFB, gating signals, and real-time beam profiles on a LED screen. Patients were prompted to perform short BHs or short deep breath holds (SDBH) with the aid of BFB following a personalized standard BH/SDBH (stBH/stSDBH) guiding curve or their own representative BH/SDBH (reBH/reSDBH) guiding curve. A practical simulation was performed for a group of 15 volunteers to evaluate the feasibility and effectiveness of this method. Effective dose rates (EDRs), mean absolute errors between the guiding curves and the measured curves, and mean absolute deviations of the measured curves were obtained within 10%–50% duty cycles (DCs) that were synchronized with the synchrotron’s flat-top phase. Results: All maneuvers for an individual volunteer took approximately half an hour, and no one experienced discomfort during the maneuvers. Using the respiratory guidance methods, the magnitude of residual motion was almost ten times less than during nongated irradiation, and increases in the average effective dose rate by factors of 2.39–4.65, 2.39–4.59, 1.73–3.50, and 1.73–3.55 for the stBH, reBH, stSDBH, and reSDBH guiding maneuvers, respectively, were observed in contrast with conventional free breathing-based gated irradiation, depending on the respiratory-gated duty cycle settings. Conclusions: The proposed respiratory guidance method with personalized BFB was confirmed to be feasible in a group of volunteers. Increased effective dose rate and improved overall treatment precision were observed compared to conventional free breathing-based, respiratory-gated irradiation. Because breathing guidance curves could be established based on the respective average respiratory period and amplitude for each patient, it may be easier for patients to cooperate using this technique.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Using Deep Learning for Automated Communication Pattern Characterization: Little Steps and Big Challenges

Characterization of a parallel application’s communication patterns can be useful for performance analysis, debugging, and system design. However, obtaining and interpreting a characterization can be difficult. AChax implements an approach that uses search and a library of known communication patterns to automatically characterize communication patterns. Our approach has some limitations that reduce its effectiveness for the patterns and pattern combinations used by some real-world applications. By viewing AChax’s pattern recognition problem as an image recognition problem, it may be possible to use deep learning to address these limitations. In this position paper, we present our current ideas regarding the benefits and challenges of integrating deep learning into AChax and our conclusion that a hybrid approach combining deep learning classification, regression, and the existing AChax approach may be the best long-term solution to the problem of parameterizing recognized communication patterns.

Roth, Philip↗

Phase-selective entrainment of nonlinear oscillator ensembles

The ability to organize and finely manipulate the hierarchy and timing of dynamic processes is important for understanding and influencing brain functions, sleep and metabolic cycles, and many other natural phenomena. However, establishing spatiotemporal structures in biological oscillator ensembles is a challenging task that requires controlling large collections of complex nonlinear dynamical units. In this report, we present a method to design entrainment signals that create stable phase patterns in ensembles of heterogeneous nonlinear oscillators without using state feedback information. We demonstrate the approach using experiments with electrochemical reactions on multielectrode arrays, in which we selectively assign ensemble subgroups into spatiotemporal patterns with multiple phase clusters. As a result, the experimentally confirmed mechanism elucidates the connection between the phases and natural frequencies of a collection of dynamical elements, the spatial and temporal information that is encoded within this ensemble, and how external signals can be used to retrieve this information.

59 BASIC BIOLOGICAL SCIENCES↗

Costless metabolic secretions as drivers of interspecies interactions in microbial ecosystems

Metabolic exchange mediates interactions among microbes, helping explain diversity in microbial communities. As these interactions often involve a fitness cost, it is unclear how stable cooperation can emerge. Here we use genome-scale metabolic models to investigate whether the release of “costless” metabolites (i.e. those that cause no fitness cost to the producer), can be a prominent driver of intermicrobial interactions. By performing over 2 million pairwise growth simulations of 24 species in a combinatorial assortment of environments, we identify a large space of metabolites that can be secreted without cost, thus generating ample cross-feeding opportunities. In addition to providing an atlas of putative interactions, we show that anoxic conditions can promote mutualisms by providing more opportunities for exchange of costless metabolites, resulting in an overrepresentation of stable ecological network motifs. These results may help identify interaction patterns in natural communities and inform the design of synthetic microbial consortia.

59 BASIC BIOLOGICAL SCIENCES↗

Composite pressure cell for pulsed magnets

We report that extreme pressures and high magnetic fields can affect materials in profound and fascinating ways. However, large pressures and fields are often mutually incompatible; the rapidly changing fields provided by pulsed magnets induce eddy currents in the metallic components used in conventional pressure cells, causing serious heating, forces, and vibration. Here, we report a diamond-anvil-cell made mainly out of insulating composites that minimizes inductive heating while retaining sufficient strength to apply pressures of up to 8 GPa. Any residual metallic component is made of low-conductivity metals and patterned to reduce eddy currents. The simple design enables rapid sample or pressure changes, desired by pulsed-magnetic-field-facility users. The pressure cell has been used in pulsed magnetic fields of up to 65 T with no noticeable heating at cryogenic temperatures. Several measurement techniques are possible inside the cell at temperatures as low as 500 mK.

47 OTHER INSTRUMENTATION↗

The parallelism motifs of genomic data analysis

Genomic datasets are growing dramatically as the cost of sequencing continues to decline and small sequencing devices become available. Enormous community databases store and share these data with the research community, but some of these genomic data analysis problems require large-scale computational platforms to meet both the memory and computational requirements. These applications differ from scientific simulations that dominate the workload on high-end parallel systems today and place different requirements on programming support, software libraries and parallel architectural design. For example, they involve irregular communication patterns such as asynchronous updates to shared data structures. We consider several problems in high-performance genomics analysis, including alignment, profiling, clustering and assembly for both single genomes and metagenomes. We identify some of the common computational patterns or ‘motifs’ that help inform parallelization strategies and compare our motifs to some of the established lists, arguing that at least two key patterns, sorting and hashing, are missing. This article is part of a discussion meeting issue ‘Numerical algorithms for high-performance computational science’.

59 BASIC BIOLOGICAL SCIENCES↗

Interferometric studies of the radiation wave front on the Luch setup

A radial shear interferometer for studying the shape of the wave front and aberrations of the optical system of the Luch setup were designed and created. To improve the interferometric pattern, the interferometer was simulated numerically by using the Fresnel software package. The parameters of the interferometer were optimized. The interferometer allows one to record interferograms of pulsed radiation at the first and second harmonics of a neodymium laser, as well as of continuous IR radiation with a short coherence length. A new method was developed for recovering the wave front by using the WinFringe software for interferograms with a reference front. Aberrations introduced by different parts and the entire optical system of the setup were measured. The wave fronts of the first and second harmonics obtained in full-scale experiments are presented. The experimental results agree with the radiation divergence measured by other methods.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Experiences in extending parallware to support OpenACC. In: WACCPD '15 Proceedings of the Second Workshop on Accelerator Programming using Directives, Article No. 4

Porting scientific codes to accelerator-based computers using OpenACC and OpenMP is an important topic for the HPC community. Programmability, performance portability and developer productivity are key issues for the widespread use of these systems. In the scope of general-purpose parallel computing, Parallware is a new commercial OpenMP-enabling source-to-source compiler that automatically adds OpenMP capabilities in scientific programs. Thus, extending Parallware with OpenACC or OpenMP 4.x support would contribute to improve programmability and developer productivity. In contrast, the performance portability of such approach needs to be demonstrated in practice. This paper presents a preliminary study to extend Parallware with OpenACC support for GPU devices. A simple benchmark suite has been designed to mimic important features and computational patterns of real scientific applications. Handcoded OpenACC versions are compared to OpenMP versions automatically generated by Parallware. Performance is evaluated with the PGI OpenACC compiler on systems accelerated with NVIDIA GPUs.

Lobeiras, Jacobo↗

Surface-Enhanced Raman Scattering as an Emerging Characterization and Detection Technique

While surface-enhanced Raman spectroscopy (SERS) has been attracting a continuously increasing interest of scientific community since its discovery, it has enjoyed a particularly rapid growth in the last decade. Most notable recent advances in SERS include novel technological approaches to SERS substrates and innovative applications of SERS in medicine and molecular biology. While a number of excellent reviews devoted to SERS appeared in the literature over the last two decades, we will focus this paper more specifically on several promising trends that have been highlighted less frequently. In particular, we will briefly overview strategies in designing and fabricating SERS substrates using deterministic patterning and then cover most recent biological applications of SERS.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Synthetic Proxy Infrastructure for Task Evaluation

The Synthetic Proxy Infrastructure for Task Evaluation is a proxy application designed to support application developers in gauging the performance of various task granularities when determining how best to utilize task based programming models.The infrastructure is designed to provide examples of common communication patterns with a synthetic workload intended to provide performance data to evaluate programming model and platform overheads for the purpose of determining task granularity for task decomposition purposes. This is presented as a reference implementation of a proxy application with run-time configurable input and output task dependencies ranging from an embarrassingly parallel scenario to patterns with stencil-like dependencies upon their nearest neighbors. Once all, if any, inputs are satisfied each task will execute a synthetic workload (a simple DGEMM of in this case) of varying size and output all, if any, outputs to the next tasks.The intent is for this reference implementation to be implemented as a proxy app in different programming models so as to provide the same infrastructure and to allow for application developers to simulate their own communication needs to assist in task decomposition under various models on a given platform.

Junghans, Christoph↗

ANALYSIS OF MULTIBUNCH SPECTRUM FOR AN UNEVEN BUNCH DISTRIBUTION IN A STORAGE RING

Modern storage-ring designs often require an uneven bunch distribution pattern. An uneven bunch fill pattern can result in complex structures for the beam current spectra. Particularly at high average beam currents, these complex current spectra need to be taken into account in concern of beam-dynamical effects. In this study, we analyze a beam current spectrum for various filling patterns with bunch trains and gaps. The characteristics of the resulting beam current spectra are illustrated and discussed.

Li, Rui↗

Membrane Purification Cell for Aluminum Recycling

Recycling mixed aluminum scrap usually requires adding primary aluminum to the scrap stream as a diluent to reduce the concentration of non-aluminum constituents used in aluminum alloys. Since primary aluminum production requires approximately 10 times more energy than melting scrap, the bulk of the energy and carbon dioxide emissions for recycling are associated with using primary aluminum as a diluent. Eliminating the need for using primary aluminum as a diluent would dramatically reduce energy requirements, decrease carbon dioxide emissions, and increase scrap utilization in recycling. Electrorefining can be used to extract pure aluminum from mixed scrap. Some example applications include producing primary grade aluminum from specific scrap streams such as consumer packaging and mixed alloy saw chips, and recycling multi-alloy products such as brazing sheet. Electrorefining can also be used to extract valuable alloying elements such as Li from Al-Li mixed scrap. This project was aimed at developing an electrorefining process for purifying aluminum to reduce energy consumption and emissions by 75% compared to conventional technology. An electrolytic molten aluminum purification process, utilizing a horizontal membrane cell anode, was designed, constructed, operated and validated. The electrorefining technology could also be used to produce ultra-high purity aluminum for advanced materials applications. The technical objectives for this project were to: - Validate the membrane cell concept with a lab-scale electrorefining cell; - Determine if previously identified voltage increase issue for chloride electrolytes holds for a fluoride-based electrolyte system; - Assess the probability that voltage change issues can be solved; and - Conduct a market and economic analysis to assess commercial feasibility. The process was tested using three different binary alloy compositions (Al-2.0 wt.% Cu, Al-4.7 wt.% Si, Al-0.6 wt.% Fe) and a brazing sheet scrap composition (Al-2.8 wt.% Si-0.7 wt.% Fe-0.8 wt.% Mn),. Purification factors (defined as the initial impurity concentration divided by the final impurity concentration) of greater than 20 were achieved for silicon, iron, copper, and manganese. Cell performance was measured using its current and voltage characteristics and composition analysis of the anode, cathode, and electrolytes. The various cells were autopsied as part of the study. Three electrolyte systems tested were: LiCl-10 wt. % AlCl3, LiCl-10 wt. % AlCl3-5 wt.% AlF3 and LiF-10 wt.% AlF3. An extended four-day run with the LiCl-10 wt.% AlCl3-5 wt.% AlF3 electrolyte system was stable for the entire duration of the experiment, running at energy requirements about one third of the Hoopes and the conventional Hall-Heroult process. Three different anode membranes were investigated with respect to their purification performance and survivability: a woven graphite cloth with 0.05 cm nominal thickness & > 90 % porosity, a drilled rigid membrane with nominal porosity of 33%, and another drilled rigid graphite membrane with increased thickness. The latter rigid drilled graphite was selected as the most promising membrane design. The economic viability of the membrane cell to purify scrap is sensitive to primary & scrap aluminum prices, and the cost of electricity. In particular, it is sensitive to the differential between scrap and primary aluminum price which is highly variable and dependent on the scrap source. In order to be economically viable, any scrap post-processing technology in the U.S. market must have a total operating cost well below the scrap price differential of $0.20-$0.40 per lb to the London Metal Exchange (LME), a margin of 65%-85% of the LME price. The cost to operate the membrane cell is estimated to be < $0.24/lb of purified aluminum. The energy cost is estimated to be $0.05/lb of purified aluminum with the remaining costs being repair and maintenance, electrolyte, labor, taxes and depreciation. The bench-scale work on membrane purification cell process has demonstrated technological advantages and substantial energy and investment savings against other electrolytic processes. However, in order to realize commercial reality, the following items need to be fully investigated: 1. Further evaluation of a pure fluoride electrolyte. 2. Investigate alternative non conductive, more mechanically robust and chemically inert membrane candidates. 3. Optimized membrane cell design to understand contribution of fluid flow patterns and the mass transfer conditions. 4. Improve current efficiency and total metallic aluminum recovery from the cell. All Tasks and Milestones were completed successfully.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Synthetic Proxy Infrastructure for Task Evaluation

The Synthetic Proxy Infrastructure for Task Evaluation is a proxy application designed to support application developers in gauging the performance of various task granularities when determining how best to utilize task based programming models.The infrastructure is designed to provide examples of common communication patterns with a synthetic workload intended to provide performance data to evaluate programming model and platform overheads for the purpose of determining task granularity for task decomposition purposes. This is presented as a reference implementation of a proxy application with run-time configurable input and output task dependencies ranging from an embarrassingly parallel scenario to patterns with stencil-like dependencies upon their nearest neighbors. Once all, if any, inputs are satisfied each task will execute a synthetic workload (a simple DGEMM of in this case) of varying size and output all, if any, outputs to the next tasks.The intent is for this reference implementation to be implemented as a proxy app in different programming models so as to provide the same infrastructure and to allow for application developers to simulate their own communication needs to assist in task decomposition under various models on a given platform.

Junghans, Christoph↗

Surface Acoustic Wave H2 and O2 Sensors Based on Conducting Metal Oxides/Langasite for Elevated Temperature Applications - presentation

<p style="text-align: justify;"><span style="font-family: Arial; font-size: 10pt;">• </span><span style="color: black; font-family: Arial; font-size: 10pt;">SAW reflective delay line devices were designed and successfully fabricated on Langasite by patterning platinum electrodes.</span><p style="text-align: justify;"><span style="font-family: Arial; font-size: 10pt;">• </span><span style="color: black; font-family: Arial; font-size: 10pt;">Fabricated devices successfully tested up to 500°C for temperature sensing applications.</span><p style="text-align: justify;"><span style="font-family: Arial; font-size: 10pt;">• </span><span style="color: black; font-family: Arial; font-size: 10pt;">Indium oxide (IO) and indium tin oxide (ITO) sensing layers were developed on the SAW devices using sputtering and sol-gel method.</span><p style="text-align: justify;"><span style="font-family: Arial; font-size: 10pt;">• </span><span style="color: black; font-family: Arial; font-size: 10pt;">IO- and ITO-functionalized langasite SAW reflective delay line devices were used for sensing H2 and O2 at 350°C. </span><br>

Mao, Elizabeth↗