Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Programmable”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Magnesium- and intermetallic alloys-based hydrides for energy storage: modelling, synthesis and properties

Hydrides based on magnesium and intermetallic compounds provide a viable solution to the challenge of energy storage from renewable sources, thanks to their ability to absorb and desorb hydrogen in a reversible way with a proper tuning of pressure and temperature conditions. Therefore, they are expected to play an important role in the clean energy transition and in the deployment of hydrogen as an efficient energy vector. This review, by experts of Task 40 ‘Energy Storage and Conversion based on Hydrogen’ of the Hydrogen Technology Collaboration Programme of the International Energy Agency, reports on the latest activities of the working group ‘Magnesium- and Intermetallic alloys-based Hydrides for Energy Storage’. The following topics are covered by the review: multiscale modelling of hydrides and hydrogen sorption mechanisms; synthesis and processing techniques; catalysts for hydrogen sorption in Mg; Mg-based nanostructures and new compounds; hydrides based on intermetallic TiFe alloys, high entropy alloys, Laves phases, and Pd-containing alloys. Finally, an outlook is presented on current worldwide investments and future research directions for hydrogen-based energy storage.

Energy storage↗
DOE OSTI2022

Hydrogen storage in complex hydrides: past activities and new trends

Abstract Intense literature and research efforts have focussed on the exploration of complex hydrides for energy storage applications over the past decades. A focus was dedicated to the determination of their thermodynamic and hydrogen storage properties, due to their high gravimetric and volumetric hydrogen storage capacities, but their application has been limited because of harsh working conditions for reversible hydrogen release and uptake. The present review aims at appraising the recent advances on different complex hydride systems, coming from the proficient collaborative activities in the past years from the research groups led by the experts of the Task 40 ‘Energy Storage and Conversion Based on Hydrogen’ of the Hydrogen Technology Collaboration Programme of the International Energy Agency. An overview of materials design, synthesis, tailoring and modelling approaches, hydrogen release and uptake mechanisms and thermodynamic aspects are reviewed to define new trends and suggest new possible applications for these highly tuneable materials.

Dematteis, Erika Michela (ORCID:0000000236804196)↗
DOE OSTI2022

Fundamentals of hydrogen storage in nanoporous materials

Abstract Physisorption of hydrogen in nanoporous materials offers an efficient and competitive alternative for hydrogen storage. At low temperatures (e.g. 77 K) and moderate pressures (below 100 bar) molecular H 2 adsorbs reversibly, with very fast kinetics, at high density on the inner surfaces of materials such as zeolites, activated carbons and metal–organic frameworks (MOFs). This review, by experts of Task 40 ‘Energy Storage and Conversion based on Hydrogen’ of the Hydrogen Technology Collaboration Programme of the International Energy Agency, covers the fundamentals of H 2 adsorption in nanoporous materials and assessment of their storage performance. The discussion includes recent work on H 2 adsorption at both low temperature and high pressure, new findings on the assessment of the hydrogen storage performance of materials, the correlation of volumetric and gravimetric H 2 storage capacities, usable capacity, and optimum operating temperature. The application of neutron scattering as an ideal tool for characterising H 2 adsorption is summarised and state-of-the-art computational methods, such as machine learning, are considered for the discovery of new MOFs for H 2 storage applications, as well as the modelling of flexible porous networks for optimised H 2 delivery. The discussion focuses moreover on additional important issues, such as sustainable materials synthesis and improved reproducibility of experimental H 2 adsorption isotherm data by interlaboratory exercises and reference materials.

08 HYDROGEN↗
DOE OSTI2021

Fast convolutional neural networks on FPGAs with hls4ml

We introduce an automated tool for deploying ultra low-latency, low-power deep neural networks with convolutional layers on field-programmable gate arrays (FPGAs). By extending the hls4ml library, we demonstrate an inference latency of 5 µs using convolutional architectures, targeting microsecond latency applications like those at the CERN Large Hadron Collider. Considering benchmark models trained on the Street View House Numbers Dataset, we demonstrate various methods for model compression in order to fit the computational constraints of a typical FPGA device used in trigger and data acquisition systems of particle detectors. In particular, we discuss pruning and quantization-aware training, and demonstrate how resource utilization can be significantly reduced with little to no loss in model accuracy. We show that the FPGA critical resource consumption can be reduced by 97% with zero loss in model accuracy, and by 99% when tolerating a 6% accuracy degradation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Real-time semantic segmentation on FPGAs for autonomous vehicles with hls4ml

In this paper, we investigate how field programmable gate arrays can serve as hardware accelerators for real-time semantic segmentation tasks relevant for autonomous driving. Considering compressed versions of the ENet convolutional neural network architecture, we demonstrate a fully-on-chip deployment with a latency of 4.9 ms per image, using less than 30% of the available resources on a Xilinx ZCU102 evaluation board. The latency is reduced to 3 ms per image when increasing the batch size to ten, corresponding to the use case where the autonomous vehicle receives inputs from multiple cameras simultaneously. We show, through aggressive filter reduction and heterogeneous quantization-aware training, and an optimized implementation of convolutional layers, that the power consumption and resource utilization can be significantly reduced while maintaining accuracy on the Cityscapes dataset.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Ultra-low latency recurrent neural network inference on FPGAs for physics applications with hls4ml

Abstract Recurrent neural networks have been shown to be effective architectures for many tasks in high energy physics, and thus have been widely adopted. Their use in low-latency environments has, however, been limited as a result of the difficulties of implementing recurrent architectures on field-programmable gate arrays (FPGAs). In this paper we present an implementation of two types of recurrent neural network layers—long short-term memory and gated recurrent unit—within the hls4ml framework. We demonstrate that our implementation is capable of producing effective designs for both small and large models, and can be customized to meet specific design requirements for inference latencies and FPGA resources. We show the performance and synthesized designs for multiple neural networks, many of which are trained specifically for jet identification tasks at the CERN Large Hadron Collider.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Probe microscopy is all you need *

We pose that microscopy offers an ideal real-world experimental environment for the development and deployment of active Bayesian and reinforcement learning methods. Indeed, the tremendous progress achieved by machine learning (ML) and artificial intelligence over the last decade has been largely achieved via the utilization of static data sets, from the paradigmatic MNIST to the bespoke corpora of text and image data used to train large models such as GPT3, DALL·E and others. However, it is now recognized that continuous, minute improvements to state-of-the-art do not necessarily translate to advances in real-world applications. We argue that a promising pathway for the development of ML methods is via the route of domain-specific deployable algorithms in areas such as electron and scanning probe microscopy and chemical imaging. This will benefit both fundamental physical studies and serve as a test bed for more complex autonomous systems such as robotics and manufacturing. Favorable environment characteristics of scanning and electron microscopy include low risk, extensive availability of domain-specific priors and rewards, relatively small effects of exogenous variables, and often the presence of both upstream first principles as well as downstream learnable physical models for both statics and dynamics. Recent developments in programmable interfaces, edge computing, and access to application programming interfaces (APIs) facilitating microscope control, all render the deployment of ML codes on operational microscopes straightforward. We discuss these considerations and hope that these arguments will lead to create novel set of development targets for the ML community by accelerating both real world ML applications and scientific progress.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Distilling particle knowledge for fast reconstruction at high-energy physics experiments

Knowledge distillation is a form of model compression that allows artificial neural networks of different sizes to learn from one another. Its main application is the compactification of large deep neural networks to free up computational resources, in particular on edge devices. In this article, we consider proton-proton collisions at the High-Luminosity Large Hadron Collider (HL-LHC) and demonstrate a successful knowledge transfer from an event-level graph neural network (GNN) to a particle-level small deep neural network (DNN). Our algorithm, DistillNet, is a DNN that is trained to learn about the provenance of particles, as provided by the soft labels that are the GNN outputs, to predict whether or not a particle originates from the primary interaction vertex. The results indicate that for this problem, which is one of the main challenges at the HL-LHC, there is minimal loss during the transfer of knowledge to the small student network, while improving significantly the computational resource needs compared to the teacher. This is demonstrated for the distilled student network on a CPU, as well as for a quantized and pruned student network deployed on a field programmable gate array. Our study proves that knowledge transfer between networks of different complexity can be used for fast artificial intelligence (AI) in high-energy physics that improves the expressiveness of observables over non-AI-based reconstruction algorithms. Such an approach can become essential at the HL-LHC experiments, e.g. to comply with the resource budget of their trigger stages.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Accelerating data acquisition with FPGA-based edge machine learning: a case study with LCLS-II

New scientific experiments and instruments generate vast amounts of data that need to be transferred for storage or further processing, often overwhelming traditional systems. Edge machine learning (EdgeML) addresses this challenge by integrating machine learning (ML) algorithms with edge computing, enabling real-time data processing directly at the point of data generation. EdgeML is particularly beneficial for environments where immediate decisions are required, or where bandwidth and storage are limited. In this paper, we demonstrate a high-speed configurable ML model in a fully customizable EdgeML system using a field programmable gate array (FPGA). Our demonstration focuses on an angular array of electron spectrometers, referred to as the ‘CookieBox,’ developed for the Linac Coherent Light Source II project. The EdgeML system captures 51.2 Gbps from a 6.4 GS s −1 analog to digital converter and is designed to integrate data pre-processing and ML inside an FPGA. Our implementation achieves an inference latency of 0.2 µs for the ML model, and a total latency of 0.4 µs for the complete EdgeML system, which includes pre-processing, data transmission, digitization, and ML inference. The modular design of the system allows it to be adapted for other instrumentation applications requiring low-latency data processing.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

SymbolNet: neural symbolic regression with adaptive dynamic pruning for compression

Abstract Compact symbolic expressions have been shown to be more efficient than neural network (NN) models in terms of resource consumption and inference speed when implemented on custom hardware such as field-programmable gate arrays (FPGAs), while maintaining comparable accuracy (Tsoi et al 2024 EPJ Web Conf. 295 09036). These capabilities are highly valuable in environments with stringent computational resource constraints, such as high-energy physics experiments at the CERN Large Hadron Collider. However, finding compact expressions for high-dimensional datasets remains challenging due to the inherent limitations of genetic programming (GP), the search algorithm of most symbolic regression (SR) methods. Contrary to GP, the NN approach to SR offers scalability to high-dimensional inputs and leverages gradient methods for faster equation searching. Common ways of constraining expression complexity often involve multistage pruning with fine-tuning, which can result in significant performance loss. In this work, we propose S y m b o l N e t , a NN approach to SR specifically designed as a model compression technique, aimed at enabling low-latency inference for high-dimensional inputs on custom hardware such as FPGAs. This framework allows dynamic pruning of model weights, input features, and mathematical operators in a single training process, where both training loss and expression complexity are optimized simultaneously. We introduce a sparsity regularization term for each pruning type, which can adaptively adjust its strength, leading to convergence at a target sparsity ratio. Unlike most existing SR methods that struggle with datasets containing more than O ( 10 ) inputs, we demonstrate the effectiveness of our model on the LHC jet tagging task (16 inputs), MNIST (784 inputs), and SVHN (3072 inputs).

Tsoi, Ho Fung (ORCID:0000000225502184)↗
DOE OSTI2025

Geometric GNNs for charged particle tracking at GlueX

Nuclear physics experiments are aimed at uncovering the fundamental building blocks of matter. The experiments involve high-energy collisions that produce complex events with many particle trajectories. Tracking charged particles resulting from collisions in the presence of a strong magnetic field is critical to enable the reconstruction of particle trajectories and precise determination of interactions. It is traditionally achieved through combinatorial approaches that scale worse than linearly as the number of hits grows. Since particle hit data naturally form a point cloud and can be structured as graphs, graph neural networks (GNNs) emerge as an intuitive and effective choice for this task. In this study, we evaluate the GNN model for track finding on the data from the GlueX experiment at Jefferson Lab. We use simulation data to train the model and test on both simulation and real GlueX measurements. We demonstrate that GNN-based track finding outperforms the currently used traditional method at GlueX in terms of segment-based efficiency at a fixed purity while providing faster inferences. We show that the GNN model can achieve significant speedup by processing multiple events in batches, which exploits the parallel computation capability of graphical processing units (GPUs). Finally, we compare the GNN implementation on GPU and field-programmable gate array and describe the trade-off.

batched GNN pipeline↗
DOE OSTI2023

Integration of Ag-CBRAM crossbars and Mott ReLU neurons for efficient implementation of deep neural networks in hardware

In-memory computing with emerging non-volatile memory devices (eNVMs) has shown promising results in accelerating matrix-vector multiplications. However, activation function calculations are still being implemented with general processors or large and complex neuron peripheral circuits. Here, we present the integration of Ag-based conductive bridge random access memory (Ag-CBRAM) crossbar arrays with Mott rectified linear unit (ReLU) activation neurons for scalable, energy and area-efficient hardware (HW) implementation of deep neural networks. We develop Ag-CBRAM devices that can achieve a high ON/OFF ratio and multi-level programmability. Compact and energy-efficient Mott ReLU neuron devices implementing ReLU activation function are directly connected to the columns of Ag-CBRAM crossbars to compute the output from the weighted sum current. We implement convolution filters and activations for VGG-16 using our integrated HW and demonstrate the successful generation of feature maps for CIFAR-10 images in HW. Our approach paves a new way toward building a highly compact and energy-efficient eNVMs-based in-memory computing system.

Mott insulators↗
DOE OSTI2025

Leveraging dendritic complexity for neuromorphic computing

Abstract Beyond-von Neumann computing approaches are necessary to sustain the growth of microelectronics and the increasing appetite for artificial intelligence/machine learning algorithms. Neuromorphic computing is an emerging paradigm that takes inspiration from the brain to provide a path forward to improve the computational efficiency and computational density of next-generation computing architectures. In nature, we observe brains performing complex computations with a much smaller energy footprint than conventional computing approaches. Current neuromorphic systems are focused primarily on scalability, namely, increasing the number of computational units (neurons) and connections between units (synapses). However, for brain-like cognition and efficiency in next-generation computing hardware, we need increased complexity in function, as well as improved connection density for scalability. Here, we present our work that aims to incorporate dendrites for ‘compute-on-wire’ in neuromorphic architectures to increase the computational complexity (e.g. number of programmable parameters, nonlinear dynamics) as well as computational efficiency (energy/compute) of artificial neural networks (ANNs). We do this by showcasing neuromorphic dendrite elements that can be leveraged for various applications. We will present examples of neuroscience-inspired direction-selective circuits and an ANN with active dendrites leveraging shunting inhibition. We also demonstrate the benefits of using dendrites in deep neural networks. To conclude, we discuss how we can utilize emerging hardware devices in these systems and design next-generation neuromorphic architectures with dendrites.

Cardwell, Suma G. (ORCID:0000000226575545)↗
DOE OSTI2019

Joint linkage and association mapping of complex traits in shrub willow (Salix purpurea L.)

Abstract Background and Aims Increasing energy demands and the necessity to reduce greenhouse gas emissions are key motivating factors driving the development of lignocellulosic crops as an alternative to non-renewable energy sources. The effects of global climate change will require a better understanding of the genetic basis of complex adaptive traits to breed more resilient bioenergy feedstocks, like willow (Salix spp.). Shrub willow is a sustainable and dedicated bioenergy crop, bred to be fast-growing and high-yielding on marginal land without competing with food crops. In a rapidly changing climate, genomic advances will be vital for the sustained improvement of willow and other non-model bioenergy crops. Here, joint genetic mapping was used to exploit genetic variation garnered from both recent and historical recombination events in S. purpurea. Methods A panel of North American naturalized S. purpurea accessions and full-sib F2S. purpurea population were genotyped and phenotyped for a suite of morphological, physiological, pest and disease resistance, and wood chemical composition traits, collected from multi-environment and multi-year replicated field trials. Controlling for population stratification and kinship in the association panel and spatial variation in the F2, a comprehensive mixed model analysis was used to dissect the complex genetic architecture and plasticity of these important traits. Key Results Individually, genome-wide association (GWAS) models differed in terms of power, but the combined approach, which corrects for yearly and environmental co-factors across datasets, improved the overall detection and resolution of associated loci. Although there were few significant GWAS hits located within support intervals of QTL for corresponding traits in the F2, many large-effect QTL were identified, as well as QTL hotspots. Conclusions This study provides the first comparison of linkage analysis and linkage disequilibrium mapping approaches in Salix, and highlights the complementarity and limits of these two methods for elucidating the genetic architecture of complex bioenergy-related traits of a woody perennial breeding programme.

Plant Sciences↗
DOE OSTI2020

Pilot testing of CO2 capture from a coal-fired power plant—Part 2: Results from 1-MWe pilot tests

Abstract Using a 1-MWe slipstream pilot plant, solid-sorbent-based post-combustion CO2 capture was tested at a coal-fired power plant. Results from pilot testing were used to develop a preliminary full-scale commercial design. The sorbent selected for pilot-scale evaluation during this project consisted of an ion-exchange resin that incorporated amines covalently bonded to the substrate. A unique temperature-swing-absorption (TSA) process was developed that incorporated a three-stage fluidized-bed adsorber integrated with a single-stage fluidized-bed regenerator. Overall, following start-up and commissioning challenges that are often associated with first-of-a-kind pilots, the pilot plant operated as designed and expected, with a few key exceptions. The two primary exceptions were associated with: (i) handling characteristics of the sorbent, which were sufficiently different at operating temperature than at ambient temperature when design specifications were established with lab-scale testing; and (ii) CO2 adsorption in the transport line between the regenerator and adsorber that preloaded the sorbent with CO2 prior to entering the adsorber. Results from the pilot programme demonstrate that solid-sorbent-based post-combustion capture can be utilized to achieve 90% CO2 capture from coal-fired power plants.

Sjostrom, Sharon↗
DOE OSTI2021

Integrating crop growth models with remote sensing for predicting biomass yield of sorghum

Abstract Plant phenotypes are often descriptive, rather than predictive of crop performance. As a result, extensive testing is required in plant breeding programmes to develop varieties aimed at performance in the target environments. Crop models can improve this testing regime by providing a predictive framework to (i) augment field phenotyping data and derive hard-to-measure phenotypes and (ii) estimate performance across geographical regions using historical weather data. The goal of this study was to parameterize the Agricultural Production Systems sIMulator (APSIM) crop growth models with remote-sensing and ground-reference data to predict variation in phenology and yield-related traits in 18 commercial grain and biomass sorghum hybrids. Genotype parameters for each hybrid were estimated using remote-sensing measurements combined with manual phenotyping in West Lafayette, IN, in 2018. The models were validated in hybrid performance trials in two additional seasons at that site and against yield trials conducted in Bushland, TX, between 2001 and 2018. These trials demonstrated that (i) maximum plant height, final dry biomass and radiation use efficiency (RUE) of photoperiod-sensitive and -insensitive forage sorghum hybrids tended to be higher than observed in grain sorghum, (ii) photoperiod-sensitive sorghum hybrids exhibited greater biomass production in longer growing environments and (iii) the parameterized and validated models perform well in above-ground biomass simulations across years and locations. Crop growth models that integrate remote-sensing data offer an efficient approach to parameterize larger plant breeding populations.

Yang, Kai-Wei↗
DOE OSTI2025

Developmentally-specific physiological and metabolic responses support drought resilience in switchgrass and constrains biofuel yield

Switchgrass (Panicum virgatum) is a promising bioenergy crop due in part to its resilience to drought stress. However, the significance of drought timing remains poorly understood, both from a plant biology perspective and its impact on downstream biofuel production. This study determines the developmental stage-specific physiological and metabolic responses of switchgrass to drought stress and its implications for biofuel production using a custom-built programmable irrigation system. Vegetative, flowering, and senescence-stage drought significantly reduced carbon dioxide assimilation, and stomatal conductance without affecting biomass yield. Metabolic profiling revealed significant accumulation of glucose, fructose, quinic acid, shikimate and GABA during vegetative-stage drought, while flowering and senescence stages exhibited limited metabolic changes. Similarly, specialized metabolites also displayed distinct developmental patterns, with vegetative-stage drought driving the most pronounced metabolic alterations. Thermochemically-treated and hydrolyzed switchgrass biomass from vegetative-stage drought showed elevated lignocellulose-derived compounds and saponins with the latter most positively correlating with fermentation lag times. Conversely, senescence-stage drought enhanced ethanol yields while lowering saponin levels in the hydrolysates. While vegetative-stage drought enhanced physiological resilience, it compromises downstream biofuel production by introducing fermentation inhibitors, particularly saponins.

biofuel↗
DOE OSTI2020

Supernova host galaxies in the dark energy survey: I. Deep coadds, photometry, and stellar masses

ABSTRACT The 5-yr Dark Energy Survey Supernova Programme (DES-SN) is one of the largest and deepest transient surveys to date in terms of volume and number of supernovae. Identifying and characterizing the host galaxies of transients plays a key role in their classification, the study of their formation mechanisms, and the cosmological analyses. To derive accurate host galaxy properties, we create depth-optimized coadds using single-epoch DES-SN images that are selected based on sky and atmospheric conditions. For each of the five DES-SN seasons, a separate coadd is made from the other four seasons such that each SN has a corresponding deep coadd with no contaminating SN emission. The coadds reach limiting magnitudes of order ∼27 in g band, and have a much smaller magnitude uncertainty than the previous DES-SN host templates, particularly for faint objects. We present the resulting multiband photometry of host galaxies for samples of spectroscopically confirmed type Ia (SNe Ia), core-collapse (CCSNe), and superluminous (SLSNe) as well as rapidly evolving transients (RETs) discovered by DES-SN. We derive host galaxy stellar masses and probabilistically compare stellar-mass distributions to samples from other surveys. We find that the DES spectroscopically confirmed sample of SNe Ia selects preferentially fewer high-mass hosts at high-redshift compared to other surveys, while at low redshift the distributions are consistent. DES CCSNe and SLSNe hosts are similar to other samples, while RET hosts are unlike the hosts of any other transients, although these differences have not been disentangled from selection effects.

79 ASTRONOMY AND ASTROPHYSICS↗