Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning efficiency”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

An Attack-Resilient Middleware Architecture for Grid Integration of Distributed Energy Resources

In recent years, the increasing penetration of Distributed Energy Resources (DERs) has made an impact on the operation of the electric power systems. In the grid integration of DERs, data acquisition systems and communications infrastructure are crucial technologies to maintain system economic efficiency and reliability. Since most of these generators are relatively small, dedicated communications investments for every generator are capital cost prohibitive. Combining real-time attack-resilient communications middleware with Internet of Things (IoTs) technologies allows for the use of existing infrastructure. In our paper, we propose an intelligent communication middleware that utilizes the Quality of Experience (QoE) metrics to complement the conventional Quality of Service (QoS) evaluation. Furthermore, our middleware employs deep learning techniques to detect and defend against congestion attacks. The simulation results illustrate the efficiency of our proposed communications middleware architecture.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Hybrid Entanglement Distribution between Remote Microwave Quantum Computers Empowered by Machine Learning

Superconducting microwave circuits with Josephson junctions, the major platform for quantum computing, can only reach the full capability when connected. This requires an efficient protocol to distribute microwave entanglement. While quantum computers typically use discrete-variable (DV) methods for information encoding, the entire continuous-variable (CV) degree of freedom in electromagnetic fields must be utilized to achieve the highest entanglement distribution rate. Here, we propose a hybrid protocol to resolve the incompatibility between DV microwave quantum computers and CV quantum communications. CV microwave entanglement is distributed using optical swapping of optical-microwave entanglement pairs. To interface with DV microwave quantum computers, we further design a hybrid circuit to simultaneously convert and distill high-quality DV entanglement from noisy CV entanglement. The hybrid circuit is trained with machine-learning algorithms, ensuring high entanglement fidelity and generation rate. In conclusion, our work not only provides a practical method to realize efficient quantum links for superconducting microwave quantum computers, but also opens avenues to bridge the gap between DV and CV quantum systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Broad range material-to-system screening of metal–organic frameworks for hydrogen storage using machine learning

Hydrogen is pivotal in the transition to sustainable energy systems, playing major roles in power generation and industrial applications. Metal–organic frameworks (MOFs) have emerged as promising mediums for efficient hydrogen storage. However, identifying potential candidates for deployment is challenging due to the vast number of currently available synthesized MOFs. This study integrates molecular simulations, machine learning, and techno-economic analysis to evaluate the performance of MOFs across broad operation conditions for hydrogen storage applications. While previous screenings of MOF databases have predominantly emphasized high hydrogen capacities under cryogenic conditions, this study reveals that optimal temperatures and pressures for cost minimization depend on the raw price of the MOF. Specifically, when MOFs are priced at $15/kg, among the 9720 MOFs tested, 9692 MOFs achieve the lowest cost at temperatures between 170 K and 250 K and a pressure of 150 bar. Under these optimal conditions, 362 MOFs deliver a lower levelized cost of storage than 350 bar compressed gas hydrogen storage. Furthermore, this study reveals key material properties that result in low system cost, such as high surface areas (>3000 m2/g), large void fractions (>0.78), and large pore volumes (>1.1 cm3/g).

Hydrogen storage↗

Machine Learning a Simple Interpretable Short-Range Potential for Silica

A wide array of models, spanning from computationally expensive ab initio methods to a spectrum of force-field approaches, have been developed and employed to probe silica polymorphs and understand growth processes and atomic-level dynamical transitions in silica. However, the quest for a model capable of making accurate predictions with high computational efficiency for various silica polymorphs is still ongoing. Recent developments in short-range machine-learned models, such as GAP and NNPScan, have shown promise in providing reasonable descriptions of silica, but their computational cost remains high compared to force fields such as BKS which are based on simple interpretable functional forms. Here, in this study, we build on the recent success of our reinforcement learning (RL) workflow to derive a new set of optimal parameters for a promising short-range BKS-based model proposed by Soules. We use RL to navigate the eight-dimensional parameter space of the Soules potential using an experimental training data set that includes both local and global structural features from approximately 21 experimentally realized silica polymorphs, including high density phases and porous zeolites. We compare the performance of our machine-learned ML-Soules model with other high quality models including our recent machine-learned parametrization of BKS (ML-BKS), a machine-learned potential (GAP), as well as predictions of ab initio calculations with the highly fidelity SCAN functional. The ML-Soules accurately captures the relative energetic ordering of various polymorphs as well as their structural features at a significantly reduced computational expense. The ML-Soules model also reasonably captures the structure, density, and elastic constants of quartz, as well as metastable silica polymorphs. We further discuss the limitations of the Soules functional form and propose potential enhancements, including the incorporation of additional three-body terms and/or the utilization of different short-ranged functional forms to achieve greater accuracy for both global and local features in the modeling of silica while retaining low computational cost.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning-guided design of direct methanol fuel cells with a platinum group metal-free cathode

Direct methanol fuel cells (DMFCs) offer a promising solution for clean electricity generation, particularly in small electronics and remote auxiliary power units. However, optimizing their efficiency and performance is challenging due to the complex interactions between various factors. Here, we present a novel approach that integrates experiments with machine learning to model and predict the performance of these fuel cells using atomically dispersed platinum group metal (PGM)-free catalysts at the cathode. Further, our machine learning models, trained on diverse input parameters, allow for the comprehensive optimization of DMFC performance prior to fabrication and testing. Through extensive experimental validation, we demonstrate that this data-driven approach accurately predicts key performance metrics, such as maximum power output and polarization curves. By combining our models with interpretable game-theory methods, we provide deep insights into the factors governing fuel cell performance, ultimately paving the way for the design of scalable and efficient DMFC technologies.

25 ENERGY STORAGE↗

AI-Driven Smart Community Control for Accelerating PV Adoption and Enhancing Grid Resilience

Rapid deployment of residential photovoltaic (PV) systems helps decarbonize our electricity supplies, but under certain circumstances, high-penetration PV may pose challenges to the electrical distribution grid. In a project funded by the U.S. Department of Energy's Solar Energy Technologies Office and Building Technologies Office, the National Renewable Energy Laboratory and its partners studied how flexible building loads and battery storage, when coordinated at home-level and community-level scales, can be used to address those challenges and enhance grid resilience. In this webinar, we will discuss the methodology, simulation and field pilot results, insights from partners, and lessons learned from the project.

artificial intelligence↗

Explainable Artificial Intelligence Technology for Predictive Maintenance

The domestic nuclear power plant fleet has relied on labor-intensive and time-consuming preventive maintenance programs, thus driving up operation and maintenance costs to achieve high-capacity factors. Artificial intelligence and machine learning can help simplify complex problems, such as diagnosing equipment degradation, to enable more effective decision-making. Benefits will be felt not only within existing analog and digital instrumentation and control, but also work processes, the integration of people with technology, and most importantly, the business case. Together, these hold promise to make nuclear power more efficient and reduce costs associated with operation and maintenance. While the artificial intelligence and machine learning technologies hold significant promise in the nuclear industry, there are challenges or barriers to their adoption. This report outlines the those different machine learning adoption barriers (categorized as historical, technical, economic, regulatory, and user) that the industry must overcome to realize the full benefits of artificial intelligence and machine learning capabilities for long-term economic sustainability. This report also provides solutions for some of these barriers by focusing on improving the explainability of machine learning to encourage trust from the end-user. Trust and explainability are essential to machine learning adoption. This report focuses on research-developed solutions to some of these barriers while analyzing a non-safety-related system, namely the circulating water system. This system frequently experiences waterbox fouling which our models preemptively diagnoses then explains to the operator how those conclusions were reached. This report presents and discusses the inherent trade-off between machine learning performance (in terms of accuracy) and explainability, where highly accurate machine learning methods (such as deep-learning) are the least explainable, and the most explainable methods (such as decision trees) are the least accurate. In addition, explainability of artificial intelligence techniques in terms of transparency and post-hoc metrics are discussed. This report outlines the importance of data novelty and value of new information in evaluating both the explainability and trustworthiness. Novelty detection helps to establish consistency or inconsistency of the new data with respect to the training data. On the other hand, value of information could be a part of the user-centric visualization recommendation system that request additional information to be collected, thereby strengthening the machine learning outcomes. During this project, a copyrighted user-centric visualization that aligns with a human-in-the-loop approach was developed. The user-centric visualization presents different levels of information and can be tailored as per user credentials to gain user confidence. One of the salient features of the user-centric visualization is it presents machine learning methods with explainability metrics. A simplified version of the user-centric visualization was presented to 32 users with varying levels of machine learning expertise. Feedback was solicited to test the hypothesis that the app contained sufficient explainability and that the users would trust the algorithm. Overall, the app was positively received, and the hypothesis was supported. This report discusses the trust-but-verify framework – a potential approach to build user trust artificial intelligence. The framework discusses trust from the human level to artificial intelligence level. The fundamental premise of the trust but verify framework is derived from an observation of nuclear safety culture (i.e., nuclear power plant personnel do not rely on a singular source of data to make a decision). This also ties back to the user-centric visualization that presents different levels of information to achieve both explainability and trustworthiness of artificial intelligence. Even so, the adoption of artificial intelligence and machine learning in the nuclear industry faces additional barriers, namely regulatory and stakeholder readiness. To overcome these challenges, new solutions must gain regulatory approval and cater to stakeholder needs. The Nuclear Regulatory Committee has a 5-year strategic plan which prepares them for reviewing artificial intelligence technologies in licensee submissions. Early and frequent engagement with the regulator is encouraged. Additionally, artificial intelligence solutions should incorporate human-in-the-loop considerations and offer explainability. Stakeholders must prepare by hiring or training staff to adapt to advancing technology in everyday plant tasks.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Online accelerator optimization with a machine learning-based stochastic algorithm

Abstract Online optimization is critical for realizing the design performance of accelerators. Highly efficient stochastic optimization algorithms are needed for many online accelerator optimization problems in order to find the global optimum in the non-linear, coupled parameter space. In this study, we propose to use the multi-generation Gaussian process optimizer for online accelerator optimization and demonstrate that the algorithm is significantly more efficient than other stochastic algorithms that are commonly used in the accelerator community.

Zhang, Zhe (ORCID:0000000281430381)↗

Reliable edge machine learning hardware for scientific applications

Extreme data rate scientific experiments create massive amounts of data that require efficient ML edge processing. This leads to unique validation challenges for VLSI implementations of ML algorithms: enabling bit-accurate functional simulations for performance validation in experimental software frameworks, verifying those ML models are robust under extreme quantization and pruning, and enabling ultra-fine-grained model inspection for efficient fault tolerance. We discuss approaches to developing and validating reliable algorithms at the scientific edge under such strict latency, resource, power, and area requirements in extreme experimental environments. We study metrics for developing robust algorithms, present preliminary results and mitigation strategies, and conclude with an outlook of these and future directions of research towards the longer-term goal of developing autonomous scientific experimentation methods for accelerated scientific discovery.

Baldi, Tommaso↗

Cutting the Deployment Costs of Physics-Based MPC in Buildings by Simulation-Based Imitation Learning

It has been shown that model predictive control (MPC) is a promising solution for energy-efficient building operations. However, the deployment of MPC in a large portion of the building stock has not been possible partially because of high installation costs. Every building is unique and requires a tailored MPC solution. The best performing solutions are often based on physics-based modeling, which is, however, computationally expensive and requires dedicated software. A promising direction that tackles this problem is to train a neural network-based optimal control policy to imitate the behavior of physics-based MPC from the simulation data generated offline. The neural networks give control actions that closely approximate those produced by physics-based MPC, but with a fraction of the computational and memory requirements and without the need for licensed software. The main advantage of the proposed approach stems from simple evaluation at execution time, leading to low computational footprints and easy deployment on embedded HW platforms. In the case study, we present the energy savings potential of physics-based MPC applied to an office building in Belgium. We demonstrate how neural network approximators can be used to cut the implementation and maintenance costs of MPC deployment without compromising performance. We also critically assess the presented approach by pointing out the remaining challenges and open research questions.

Drgona, Jan↗

Efficient Training of Deep Neural Operator Networks via Randomized Sampling

Neural operators (NOs) employ deep neural networks to learn the mappings between infinitedimensional function spaces. Deep operator network (DeepONet), a popular NO architecture, has demonstrated success in the real-time prediction of complex dynamics across various scientific and engineering applications. In this work, we introduce a random sampling technique to be adopted during the training of DeepONet, aimed at improving the generalization ability of the model, while significantly reducing the computational time. The proposed approach targets the trunk network of the DeepONet model that outputs the basis functions corresponding to the spatiotemporal locations of the bounded domain on which the physical system is defined. While constructing the loss function, DeepONet training traditionally considers a uniform grid of spatiotemporal points at which all the output functions are evaluated for each iteration. This approach leads to a larger batch size, resulting in poor generalization and increased memory demands, due to the limitations of the stochastic gradient descent (SGD) optimizer. The proposed random sampling over the inputs of the trunk net mitigates these challenges, improving generalization and reducing the memory requirements during training, resulting in significant computational gains. We validate our hypothesis through three benchmark examples, demonstrating substantial reductions in training time while achieving comparable or lower overall test errors relative to the traditional training approach. Our results indicate that incorporating randomization in the trunk network inputs during training enhances the efficiency and robustness of DeepONet, offering a promising avenue for improving the framework’s performance in modeling complex physical systems.

Karumuri, Sharmila [Department of Civil & Systems ↗

Training courses on neutron detection systems on the ISIS research reactor: on-site and through internet training

Today, ISIS research reactor is an essential tool for Education and Training programs organized by the National Institute for Nuclear Science and Technology (INSTN) from CEA. In the field of nuclear instrumentation, the INSTN offers both, theoretical courses and training courses on the use of neutron detection systems taking advantage of the ISIS research reactor for the supply of a wide range of neutron fluxes. This paper describes the content of the training carried out on the use of neutron detectors and detection systems, on-site or remote. The ISIS reactor is a 700 kW open core pool type reactor. The facility is very flexible since neutron detectors can be inserted into the core or its vicinity, and be used at different levels of power according to the needs of the course. Neutron fluxes, typically ranging from 1 to 10{sup 12} n/cm{sup 2}.s, can be obtained for the characterisation of the neutron detectors and detection systems. For the monitoring of the neutron density at low level of power, the Instrumentation and Control (I and C) system of the reactor is equipped with two detection systems, named BN1 and BN2. Each way contains a fission chamber, type CFUL01, connected to an electronic system type SIREX.The system works in pulse mode and exhibits two outputs: the counting rate and the doubling time. For the high level of power, the I and C is equipped with two detection systems HN1 and HN2.Each way contain a boron ionization chamber (type CC52) connected to an electronics system type SIREX. The system works in current mode and has two outputs: the current and the doubling time. For each mode, the trainees can observe and measure the signal at the different stages of the electronic system, with an oscilloscope. They can understand the role of each component of the detection system: detector, cable and each electronic block. The limitation of the detection modes and their operating range can be established from the measured signal. The trainees can also modify the settings of the electronic system, such as the high voltage and the discrimination level in order to obtain all the characteristic curves of the detectors. These curves are used to define the right setting of the electronic system and to discuss the expected degradation of the detector signal resulting from the detector damage under the integrated neutron and gamma fluxes. Moreover, in addition to the study of the neutron detection systems itself, the integration of the measurements made by these detection systems in the logic of the safety system of the nuclear reactor is also addressed. Providing the trainees with an extensive overview of each part of the neutron monitoring instrumentation apply to a nuclear reactor, hands-on measurements on the ISIS reactor play a major role in ensuring a practical and comprehensive understanding of the neutron detection system and their integration in the safety system of nuclear reactors. It also gives a solid background for the follow up and the development of the neutron detection systems. In addition to on-reactor training, Internet Reactor Laboratory capability has been implemented on the ISIS reactor in 2014. For the Internet Reactor Laboratory an extensive video conference system has been implemented on ISIS reactor. The system includes 4 cameras and the transmission of the video signal given by the supervision system of the reactor which records and processes the data of the reactor. According to the pedagogic needs during the training courses, the lecturer on the ISIS reactor chooses to broadcast the relevant information at each stage of the course. For example, graph showing the histogram of the counting and current as a function of the time, or the electrical signal observed on the oscilloscope, can be broadcasted trough internet. By interacting through the video conference, the remote classroom is able to ask for changes in the reactor power or settings of the detection systems. They can also ask for the broadcast of some particular information. At the guest institution, the information is displayed in two parts or screens, as shown in the Figure 3. Concerning the interaction with - and the feedback from - the remote classroom, the camera of the video system in the remote classroom is used to ensure the contact between the trainees and the lecturer and reactor operators. Thus, the Internet Reactor Laboratory is complementary to the on reactor training courses. It allows distant learning, reducing the overall cost of the course when this is necessary. It can efficiently be used for the development of the human resources needed by the nuclear industry and the nuclear programs in countries without research reactors.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Reconstruction of Six-Dimensional Phase Space

A phase space is a mathematical representation of all possible physical states of a system. Particle beams at Fermilab exist within a six-dimensional (6D) phase space defined by three positional components, (x, y, z) and three momentum components, (px, py, pz). To reconstruct this space implies taking measurement data from detectors and mapping out particle behavior using computational methods. The beam detectors, however, are only able to detect spatial distribution among the events of the beam, therefore being limited to positional data. Also, due to the vast number of events in a particle beam, it is extremely difficult to analyze and differentiate every single one’s behavior. However, with Machine Learning (ML), which can distinguish between patterns and map out particle behavior more efficiently. We first used the particle beam software, G4beamline, to simulate a 10,000-event muon beam, adjusting parameters such as initial momentum magnitude (p¬0) and virtual detector position. Using ten virtual detectors, we analyzed p0 values such that minimum 9,990 events were analyzed by every detector. We then input the data from these beam simulations to a C++ program, that randomly selects 100 events, and creates a 2D histogram based on spatial distribution, detector position, and event intensity. This process is repeated 100 times to create 100 histograms per p0 value. These images were then input to a modified ResNet18 Convolutional Neural Network (CNN) for training, and to predict p0 from some unseen set of histograms. The model was accurate when trained on momentum increments of 5 MeV/c and provided with denser training samples around highly variable test values. These results displayed machine learning being able to accurately predict p0 from being trained on different particle behaviors.

Shirlee, Jermain [Fermilab]↗

Artificial to Spiking Neural Networks Conversion with Calibration in Scientific Machine Learning

Here, we introduce a method to convert physics-informed neural networks (PINNs), commonly used in scientific machine learning, to spiking neural networks (SNNs), which are expected to have higher energy efficiency compared to traditional artificial neural networks (ANNs). We first extend the calibration technique of SNNs to arbitrary activation functions beyond ReLU, making it more versatile, and we prove a theorem that ensures the effectiveness of the calibration. We successfully convert PINNs to SNNs, enabling computational efficiency for diverse regression tasks in solving multiple differential equations, including the unsteady Navier–Stokes equations. We demonstrate great gains in terms of overall efficiency, including separable PINNs (SPINNs), which accelerate the training process. Overall, this is the first work of this kind and the proposed method achieves relatively good accuracy with low spike rates.

PINN↗

A systematic analysis of phase stability in refractory high entropy alloys utilizing linear and non-linear cluster expansion models

We report that obtaining surrogate models for various types of materials has long been a goal of computational material scientists and physicists, as they allow the calculation of thermodynamic quantities and properties of interest far more efficiently than DFT. Many surrogate models, including interatomic potentials generated by machine learning algorthims and cluster expansions, rely on incorporating many-body interactions such as three-body or four-body interactions. When utilizing machine learning algorithms for interatomic potentials, it is common to start with two-body interactions and systematically include three- and four-body clusters to improve the fit, stopping when including the additional clusters does not measurably change the predictive power of the model. In cluster expansions for FCC and related lattices, it is often enough to include mostly two-body interactions and a handful of three-body interactions. However, it remains to be seen whether those will be enough in the case of lattices with a lower packing fraction, such as BCC.

36 MATERIALS SCIENCE↗

CASM — A software package for first-principles based study of multicomponent crystalline solids

CASM is a software package that enables first-principles based studies of crystalline materials. It has been designed to treat coupled chemical, mechanical, vibrational, and magnetic degrees of freedom to determine ground state and finite temperature properties of crystals. The symmetry of the underlying parent crystal structure is used to enumerate perturbations of the parent crystal structure and generate derivative structures which can be input to first-principles calculations in order to explore the ground state energy landscape. CASM algorithmically constructs cluster expansions that fully couple discrete and continuous degrees of freedom, and generates highly efficient code to evaluate the cluster expansion basis functions. Widely used machine learning methods are integrated for fitting expansion coefficients to first-principle calculations. The fully parameterized cluster expansions can be combined with (kinetic) Monte Carlo methods to calculate finite temperature thermodynamic and kinetic properties. CASM Alloy Manager identifies distinct parent crystal structures in an alloy system, creating individual projects for each, and integrating the results. The integrated infrastructure facilitates the linkage between first-principles statistical mechanics predictions with higher length scale computational methods, such as phase field simulations. In conclusion, CASM projects are designed to be easy to share in repositories, to re-use, and to extend to include additional chemical species or types of degrees of freedom.

36 MATERIALS SCIENCE↗

Uncertainty quantification for Multiphase-CFD simulations of bubbly flows: a machine learning-based Bayesian approach supported by high-resolution experiments

In this paper, we developed a machine learning-based Bayesian approach to inversely quantify and reduce the uncertainties of multiphase computational fluid dynamics (MCFD) simulations for bubbly flows. The proposed approach is supported by high-resolution two-phase flow measurements, including those by double-sensor conductivity probes, high-speed imaging, and particle image velocimetry. Local distributions of key physical quantities of interest (QoIs), including the void fraction and phasic velocities, are obtained to support the Bayesian inference. In the process, the epistemic uncertainties of the closure relations are inversely quantified while the aleatory uncertainties from stochastic fluctuations of the system are evaluated based on experimental uncertainty analysis. The combined uncertainties are then propagated through the MCFD solver to obtain uncertainties of the QoIs, based on which probability-boxes are constructed for validation. The proposed approach relies on three machine learning methods: feedforward neural networks and principal component analysis for surrogate modeling, and Gaussian processes for model form uncertainty modeling. The whole process is implemented within the framework of an open-source deep learning library PyTorch with graphics processing unit (GPU) acceleration, thus ensuring the efficiency of the computation. The results demonstrate that with the support of high-resolution data, the uncertainties of MCFD simulations can be significantly reduced. The proposed approach has the potential for other applications that involve numerical models with empirical parameters.

42 ENGINEERING↗

Sustainability, Scalability, and Resiliency of the Town of Innisfil Mobility-on-Demand Experiment: Preliminary Results, Analyses, and Lessons Learned

In 2017, the town of Innisfil, Ontario, launched Innisfil Transit in partnership with Uber, a transportation network company, to provide a subsidized on-demand public mobility service as an alternative to investing in a new fixed-route bus service. The performance of Innisfil Transit is documented in a 2021 Ryerson University report by Sweet, Mitra, and Benaroya, which shows greater cost effectiveness of the mobility provided over the proposed bus alternative. This paper expands on those findings by assessing Innisfil Transit with respect to sustainability, scalability, and resiliency. First, we quantify the energy and emissions of this program relative to traditional transit and driving alone across varying powertrains. We then characterize a conservative first-order estimate of the percentage of US communities that fall within a similar spatial-demographic tier as Innisfil. Replicability also hinges on service cost and performance in comparison to average values for low-density transit in the US. Lastly, most transit agencies experienced a significant drop in demand (as much as 90%) with slowly rebounding ridership since the onset of the COVID-19 pandemic. The resiliency of the Innisfil program to the pressures induced by the pandemic is examined in comparison to other transit operations. The lessons learned across these three dimensions complement prior work to better understand the efficiency and sustainability of on-demand public mobility service for low-density communities like Innisfil.

ADVANCED PROPULSION SYSTEMS↗