Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “architecture design”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Liquid–Solid Boundaries Dominate Activity of CO 2 Reduction on Gas-Diffusion Electrodes

Electrochemical CO 2 electrolysis to produce hydrocarbon fuels or material feedstocks offers a renewable alternative to fossilized carbon sources. Gas-diffusion electrodes (GDEs), composed of solid electrocatalysts on porous supports positioned near the interface of a conducting electrolyte and CO 2 gas, have been able to demonstrate the substantial current densities needed for future commercialization. These higher reaction rates have often been ascribed to the presence of a three-phase interface, where solid, liquid, and gas provide electrons, water, and CO 2 , respectively. Conversely, mechanistic work on electrochemical reactions implicates a fully two-phase reaction interface, where gas molecules reach the electrocatalyst’s surface by dissolution and diffusion through the electrolyte. Because the discrepancy between an atomistic three-phase versus two-phase reaction has substantial implications for the design of catalysts, gas-diffusion layers, and cell architectures, the nuances of nomenclatures and governing phenomena surrounding the three-phase-region require clarification. In this paper we outline the macro, micro, and atomistic phenomena occurring within a gas-diffusion electrode to provide a focused discussion on the architecture of the often-discussed three-phase region for CO 2 electrolysis. From this information, we comment on the outlook for the broader CO 2 electroreduction GDE cell architecture.

CO2 reduction↗

Discovery of Stacking Heterogeneity, Layer Buckling, and Residual Water in COF-999-NH 2 and Implications on CO 2 Capture

Covalent organic frameworks (COFs), with their modular architectures and tunable functionalities, provide a versatile platform to design sorbents for the direct capture of CO 2 from air. Here, for this work, we combined density functional theory, molecular dynamics, and grand canonical Monte Carlo simulations with experiment to understand structural factors for furthering COF-999-NH 2 ’s performance as the precursor to COF-999 for direct air CO 2 capture. Small energy differences among laterally shifted stackings suggest intrinsic stacking heterogeneity. The simulations show pronounced layer buckling coupled to extensive amine–nitrile hydrogen bonding and persistent pore water, which initiates undesired polymerization and undermines uptake. The predicted presence of water is confirmed by subsequent experiments. These insights point to a single, actionable design rule: exclude retained water by introducing hydrophobic pore environments to maximize the CO 2 capture efficiency.

adsorption↗

Decorated networks of native proteins: nanomaterials with tunable mesoscopic domain size

Natural and artificial proteins with designer properties and functionalities offer unparalleled opportunity for functional nanoarchitectures formed through self-assembly. However, to exploit this potential we need to design the system such that assembly results in desired architecture forms while avoiding denaturation and therefore retaining protein functionality. Here we address this challenge with a model system of fluorescent proteins. By manipulating self-assembly using techniques inspired by soft matter where interactions between the components are controlled to yield the desired structure, we have developed a methodology to assemble networks of proteins of one species which we can decorate with another, whose coverage we can tune. Consequently, the interfaces between domains of each component can also be tuned, with potential applications for example in energy – or electron – transfer. Our model system of eGFP and mCherry with tuneable interactions reveals control over domain sizes in the resulting networks.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Generic High Bandwidth Data Acquisition Card for Physics Experiments

In high energy physics and nuclear physics experiments particularly the ones based on particle accelerator, the data rate from the detector is usually in the order of Terabytes per second. This high throughput data from detector front-end electronics need to be transmitted to the back-end computing farm for high level event selection and building. A Data Acquisition (DAQ) system with features of high-density, scalable, easily upgradeable is crucial to simplify the readout architecture of whole experiment. This paper will introduce the design of a generic high bandwidth PCIe card which can be used as the important input output card in a scalable DAQ system. It can factorize front-end electronics from data handling, and reduce amount of custom hardware in favor of scalable detectorindependent commercial hardware and software. Besides the 48 channels of bidirectional high speed fiber optical links with frontends, it also supports to synchronize with the experiment timing system, and to fanout the clock and trigger information with a fixed latency to the front-end electronics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Compressive Neural Representations of Volumetric Scalar Fields

Here, we present an approach for compressing volumetric scalar fields using implicit neural representations. Our approach represents a scalar field as a learned function, wherein a neural network maps a point in the domain to an output scalar value. By setting the number of weights of the neural network to be smaller than the input size, we achieve compressed representations of scalar fields, thus framing compression as a type of function approximation. Combined with carefully quantizing network weights, we show that this approach yields highly compact representations that outperform state-of-the-art volume compression approaches. The conceptual simplicity of our approach enables a number of benefits, such as support for time-varying scalar fields, optimizing to preserve spatial gradients, and random-access field evaluation. We study the impact of network design choices on compression performance, highlighting how simple network architectures are effective for a broad range of volumes.

97 MATHEMATICS AND COMPUTING↗

Accurate and Accelerated Neuromorphic Network Design Leveraging A Bayesian Hyperparameter Pareto Optimization Approach

Neuromorphic systems allow for extremely efficient hardware implementations for neural networks (NNs). In recent years, several algorithms have been presented to train spiking NNs (SNNs) for neuromorphic hardware. However, SNNs often provide lower accuracy than their artificial NNs (ANNs) counterparts or require computationally expensive and slow training/inference methods. To close this gap, designers typically rely on reconfiguring SNNs through adjustments in the neuron/synapse model or training algorithm itself. Nevertheless, these steps incur significant design time, while still lacking the desired improvement in terms of training/inference times (latency). Designing SNNs that can mimic the accuracy of ANNs with reasonable training times is an exigent challenge in neuromorphic computing. In this work, we present an alternative approach that looks at such designs as an optimization problem rather than algorithm or architecture redesign. We develop a versatile multiobjective hyperparameter optimization (HPO) for automatically tuning HPs of two state-of-the-art SNN training algorithms, SLAYER and HYBRID. We emphasize that, to the best of our knowledge, this is the first work trying to improve SNNs’ computational efficiency, accuracy, and training time using an efficient HPO. We demonstrate significant performance improvements for SNNs on several datasets without the need to redesign or invent new training algorithms/architectures. Our approach results in more accurate networks with lower latency and, in turn, higher energy efficiency than previous implementations. In particular, we demonstrate improvement in accuracy and more than 5× reduction in the training/inference time for the SLAYER algorithm on the DVS Gesture dataset. In the case of HYBRID, we demonstrate 30% reduction in timesteps while surpassing the accuracy of the state-of-the-art networks on CIFAR10. Further, our analysis suggests that even a seemingly minor change in HPs could change the accuracy by 5 - 6×.

Parsa, Maryam↗

HPS-RL: Hyperparameter tuning for deep RL applications (HPS-RL) v1

Genetic Algorithms meets Deep RL for Hyperparameters Hyperparameter optimization and architecture search can easily become cumbersome and finding the right hyperparameters can seriously impact the robustness of the deep RL application being developed. We use genetic algorithms to evolve optimum deep RL architectures in a scalable manner. HPS-RL is designed to work with multiple gym enviornments, allow users to test their own optimization functions and tune multi-objective parameters in multiple deep RL algorithms. HPS-RL uses multi-threading and is being extended with mpipy for distributed processing on HPC. https://arxiv.org/abs/2201.11182

Kiran, Mariam↗

OPEN ALPHADIFFRACT

Open-source release of the AlphaDiffract data generation and training system. Includes only the public Materials Project dataset retrievers.AlphaDiffract is a deep learning framework that achieves state-of-the-art performance in predicting the crystal system, space group, and lattice parameters directly from PXRD patterns. AlphaDiffract utilizes a 1D adaptation of the ConvNeXt architecture, a modern convolutional neural network that integrates key design principles from transformers, coupledwith dedicated prediction heads for each crystallographic property.

Prince, Michael [Argonne National Laboratory (ANL)↗

Using case-level context to classify cancer pathology reports

Individual electronic health records (EHRs) and clinical reports are often part of a larger sequence—for example, a single patient may generate multiple reports over the trajectory of a disease. In applications such as cancer pathology reports, it is necessary not only to extract information from individual reports, but also to capture aggregate information regarding the entire cancer case based off case-level context from all reports in the sequence. In this paper, we introduce a simple modular add-on for capturing case-level context that is designed to be compatible with most existing deep learning architectures for text classification on individual reports. We test our approach on a corpus of 431,433 cancer pathology reports, and we show that incorporating case-level context significantly boosts classification accuracy across six classification tasks—site, subsite, laterality, histology, behavior, and grade. We expect that with minimal modifications, our add-on can be applied towards a wide range of other clinical text-based tasks.

60 APPLIED LIFE SCIENCES↗

Multiobjective and categorical global optimization of photonic structures based on ResNet generative neural networks

Abstract We show that deep generative neural networks, based on global optimization networks (GLOnets), can be configured to perform the multiobjective and categorical global optimization of photonic devices. A residual network scheme enables GLOnets to evolve from a deep architecture, which is required to properly search the full design space early in the optimization process, to a shallow network that generates a narrow distribution of globally optimal devices. As a proof-of-concept demonstration, we adapt our method to design thin-film stacks consisting of multiple material types. Benchmarks with known globally optimized antireflection structures indicate that GLOnets can find the global optimum with orders of magnitude faster speeds compared to conventional algorithms. We also demonstrate the utility of our method in complex design tasks with its application to incandescent light filters. These results indicate that advanced concepts in deep learning can push the capabilities of inverse design algorithms for photonics.

Jiang, Jiaqi↗

Celeritas: GPU-accelerated particle transport for detector simulation in High Energy Physics experiments

Within the next decade, experimental High Energy Physics (HEP) will enter a new era of scientific discovery through a set of targeted programs recommended by the Particle Physics Project Prioritization Panel (P5), including the upcoming High Luminosity Large Hadron Collider (LHC) HL-LHC upgrade and the Deep Underground Neutrino Experiment (DUNE). These efforts in the Energy and Intensity Frontiers will require an unprecedented amount of computational capacity on many fronts including Monte Carlo (MC) detector simulation. In order to alleviate this impending computational bottleneck, the Celeritas MC particle transport code is designed to leverage the new generation of heterogeneous computer architectures, including the exascale computing power of U.S. Department of Energy (DOE) Leadership Computing Facilities (LCFs), to model targeted HEP detector problems at the full fidelity of Geant4. This paper presents the planned roadmap for Celeritas, including its proposed code architecture, physics capabilities, and strategies for integrating it with existing and future experimental HEP computing workflows.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

5G Securely Energized and Resilient: Task 2 and 3 Progress Report

The 5G Securely Energized and Resilient project implemented at the National Renewable Energy Laboratory is sponsored by the Office of the Under Secretary of Defense and is designed to demonstrate the successful deployment of 5G-6G (FutureG) technologies in the context of electrical microgrid scenarios. Through implementation of this project, cybersecurity researchers were able to design a platform to better understand the fundamental system architecture, limitations, and benefits of 5G systems supporting energy system requirements. Although the work for this project was developed in the context of “FutureG Advanced Component Development & Prototypes,” which is a U.S. Department of Defense effort to ensure communications system resilience in the context of military deployments, the results can also apply to communications for electrical grids in general. Several key points were established in Tasks 2 and 3 of this project that are further expanded on in the body of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Low Greenhouse Gas (GHG) Vehicle Technologies Research, Development, Demonstration and Deployment Topic 5 Natural Gas Engine Enabling Technologies

A 10 liter natural gas engine has been developed with significant improvements in efficiency while maintaining ultra low NOx emissions and meeting all other EPA criteria emissions limits. This was accomplished through design and analysis of performance components specifically for operation with natural gas in contrast to current production engines which are a minimally modified diesel engine that retain most diesel design features including a flat deck swirl head. The architecture developed here includes a pent roof cylinder head with tumble charge motion and cooling passages specifically optimized for effective cooling around the spark plug and valve bridges. Also in contrast to current production natural gas engines, EGR was not used, in part to avoid the initial cost and warranty expense associated with EGR systems, but also for performance benefits of faster combustion, reduced risk of misfire and high open cycle efficiency due to the turbocharger’s ability to extract energy from the high temperature exhaust. The exhaust manifold uses high temperature material and thermal mechanical fatigue analysis was completed to ensure the ability to withstand high exhaust temperatures without EGR. Other features include dual overhead cam with late intake valve closing Miller cycle and 14:1 compression ratio steel pistons. Low NOx emissions are achieved with stoichiometric combustion and application of a close coupled plus underfloor three way catalysts. The program target of peak brake thermal efficiency of 42% has been demonstrated along with bsNOx of 0.02 g/hp-hr over HD-FTP and RMCSET emissions cycles.

99 GENERAL AND MISCELLANEOUS↗

VRN3P: Variational Recurrent Neural Network Based Net-Load Prediction under High Solar Penetration

This is the final technical report for the SETO-funded VRN3P project (PNNL# 76914). The goal of this project, led by Pacific Northwest National Laboratory (PNNL), in collaboration with Lawrence Livermore National Laboratory (LLNL) and Portland General Electric (PGE), was to develop and validate a deep variational recurrent neural network-based net-load prediction (VRN3P) framework for probabilistic time-series forecasting of day-ahead net-load under high solar penetration scenarios. The project team reports successful design of a novel probabilistic net-load forecasting architecture, comprising of a variational autoencoder and a recurrent neural network, which demonstrates 30% improvement in forecast performance, 60% improvement in training time, and consumes 44% less memory, when compared with conventional baseline models. The team tested the VRN3P model performance on GridLAB-D test-cases representing varying BTM solar penetration levels of 20%, 30%, and 50%, with integrated time-series net-load profiles provided by the utility partner (PGE). The VRN3P model demonstrate <2% hourly MAPE (averaged over the year) for day- ahead net-load forecast on the test scenario with 20% BTM solar. Transfer learning extension of the VRN3P model has demonstrated 8.33× speed-up in training, while still achieving acceptable forecast performance of 2.24% hourly MAPE on the 30% BTM solar penetration test-scenario. A preliminary version of the VRN3P GridAPPS-D™has been developed, along with a web-based interactive user-interface (named ‘Forte’) which has made available on GitHub for public use.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Countering Weapons of Mass Destruction (CWMD) Zero Trust Framework: CWMD Zero Trust Principles Model

The research focuses on the critical need for enhanced cybersecurity within the Countering Weapons of Mass Destruction (CWMD) Office, specifically targeting Chemical, Biological, Radiological, and Nuclear devices. Traditional perimeter-based security models are insufficient against modern cyber threats, prompting a shift toward Zero Trust principles (ZTP) that emphasize continuous verification and stringent security for all devices. Federal directives mandate the adoption of Zero Trust (ZT) across agencies, supported by guidelines from National Institute of Standards and Technology (NIST), U.S. Department of Homeland Security (DHS) Cybersecurity and Infrastructure Security Agency (CISA), U.S. Department of Defense (DoD) and National Security Agency (NSA). The research involved mapping ZT guidance from these agencies to develop tailored CWMD ZTP. The study identified gaps and areas for improvement, including clear transitional guidance from traditional to ZT architectures and the focus on explicit cross cutting capabilities. Design improvements are recommended to ensure increased comprehensive protection and resilience against sophisticated cyber threats for Chemical, Biological, Radiological, and Nuclear (CBRN) devices. Collaborative efforts among federal agencies are essential for the successful deployment of an optimized ZT guidance.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Improving Variational Autoencoders for New Physics Detection at the LHC With Normalizing Flows

We investigate how to improve new physics detection strategies exploiting variational autoencoders and normalizing flows for anomaly detection at the Large Hadron Collider. As a working example, we consider the DarkMachines challenge dataset. We show how different design choices (e.g., event representations, anomaly score definitions, network architectures) affect the result on specific benchmark new physics models. Once a baseline is established, we discuss how to improve the anomaly detection accuracy by exploiting normalizing flow layers in the latent space of the variational autoencoder.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

BENEFIT with Northeastern University: HVAC Hardware-in-the-Loop Experimental Testing of a Heat Pump and Air Conditioner

This dataset includes HVAC Hardware-in-the-Loop (HIL) experimental results for a single stage, SEER 16, HSPF 9.5, 3-ton single-speed air source heat pump with 15 kW of backup auxiliary heating tested in both cooling and heating mode, and a two stage, SEER 21, 2-ton central air conditioner tested in cooling mode for a set of outdoor temperatures and indoor setpoint temperatures. In addition to these tests, experimental tests focused on the operation of auxiliary heating for the heat pump for winter condition were also conducted. The laboratory experiments for transient testing of the heat pump and air conditioner were conducted using the two HIL systems in the Systems Performance Laboratory (SPL) at NREL’s Energy Systems Integration Facility (ESIF). Further information on laboratory design and capabilities of the SPL along with the architecture of HVAC HIL system can be found in: Sparn, B. F. 2018. Laboratory Resources and Techniques to Evaluate Smart Home Technology (No. NREL/CP-5500-71696). National Renewable Energy Laboratory (NREL), Golden, CO (United States). https://www.nrel.gov/docs/fy18osti/71696.pdf and the experimental setup and validation of HVAC HIL platform can be found in: Ramaraj, S. and Sparn, B. 2022. Validation of HVAC Hardware-In-the-Loop Simulation for Advanced Control Strategies in Smart Homes (No. NREL/CP-5500-82562). National Renewable Energy Lab (NREL), Golden, CO (United States). https://www.nrel.gov/docs/fy22osti/82562.pdf. These experimental results can be used to validate how we currently model the cycling behavior of heat pumps and air conditioners. Additionally, many demand response programs implement heat pump and air conditioner control by changing the thermostat set point – these data may also be used to verify our models for heat pump and air conditioner demand response control are implemented correctly. The Test_Matrix file describes all the indoor and outdoor test conditions for heat pump and air conditioner and the file names of data sets include information about the test conditions. A wide range of outdoor air temperatures were chosen to accommodate summer and winter conditions. In addition to operating the HVAC equipment with different outdoor temperatures, we also operate the system with different indoor temperature set points to represent different grid signals or different operating conditions. For cooling conditions, the baseline set point is 72°F. To represent Load Up signals, the setpoint is changed to 68°F. The Load Shed set point is 76°F. For heating conditions, the baseline set point was assumed to be 68°F. The Load add set point is 72°F and the Load shed set point is 64°F. The starting indoor temperature for cooling conditions was set ~2°F above the indoor setpoint temperature so that the equipment turned on quickly. Similarly, the initial indoor temperature was set ~2°F lower than setpoint for heating mode tests to ensure that heating began quickly. The return air temperature was assumed to be equal to the indoor setpoint temperature in all cases. The experimental data are sampled at 1-second intervals. The data from ecobee thermostat at 5-minute interval are resampled and added to the corresponding file. The content of each data set is as follows: • T_Return (C): Measured return air temperature [C] • T_Return_SP (C): Return air temperature setpoint from E+ model, sent to HIL [C] • T_Supply (C): Measured supply air temperature at evaporator outlet [C] • T_Outdoor (C): Measured outdoor air temperature [C] • T_Outdoor_SP (C): Outdoor air temperature setpoint from weather file, sent to HIL [C] • T_Indoor (C): Measured indoor air temperature [C] • T_Indoor_SP (C): Indoor air temperature setpoint from E+ model, sent to HIL [C] • Outdoor Unit Power (W): Measured power of the outdoor unit [W] • Indoor Unit Power (W): Measured power of the indoor unit [W] • Evaporator Airflow Rate (CFM): Measured evaporator or indoor unit airflow rate sent to E+ model [CFM] • Cooling/Heating Capacity (kW): Calculated cooling/heating capacity sent to E+ model [kW] • T_SP_Thermostat (C): Thermostat cooling/heating setpoint temperature [C] • T_Indoor_Thermostat (C): Thermostat indoor air temperature [C]

24 POWER TRANSMISSION AND DISTRIBUTION↗

Phase Identification in Synchrotron X-ray Diffraction Patterns of Ti–6Al–4V Using Computer Vision and Deep Learning

X-ray diffraction patterns contain information about the atomistic structure and microstructure (defect population) of materials, extracting detailed information from diffraction patterns is complex, demanding and relies on prior knowledge. Here, we hypothesize that deep-learning techniques can help to perform an effective and accurate analysis with high throughput rates. To demonstrate this concept, we applied a novel deep learning framework to determine the evolution of the β-phase volume fraction in a Ti–6Al–4V alloy during heat-treatment from video sequences of 2D diffraction patterns recorded in transmission and with highly monochromatic radiation in a synchrotron beamline. In particular, we studied the impact of network design on prediction reliability and computational performance. Networks of different architectures were trained using 3008 experimental 2D patterns. A well-tuned model was found to reproduce the phase fractions of another experimental data set, consisting of 1100 diffraction patterns, with a mean-square error as small as 2.6 x 10 -4 . The average prediction error of β-phase volume fraction was within 1.6 x 10 -2 (in each diffraction pattern) of the values obtained by conventional methods. Our work demonstrates that convolutional neural networks can evaluate high energy X-ray diffraction patterns with a remarkable level of reliability. Furthermore, it demonstrates the significance of network design on the reliability of predictions and computational performance. The most complex models do not necessarily result in highest accuracy and may even fail to learn from the data.

36 MATERIALS SCIENCE↗