Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Neural Network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93

Potential Cooling Energy Savings of Economizer Control and Artificial-Neural-Network-Based Air-Handling Unit Discharge Air Temperature Control for Commercial Building

Heating, ventilation, and air-conditioning (HVAC) systems play a significant role in building energy consumption, accounting for around 50% of total energy usage. As a result, it is essential to explore ways to conserve energy and improve HVAC system efficiency. One such solution is the use of economizer controls, which can reduce cooling energy consumption by using the free-cooling effect. However, there are various types of economizer controls available, and their effectiveness may vary depending on the specific climate conditions. To investigate the cooling energy-saving potential of economizer controls, this study employs a dry-bulb temperature-based economizer control approach. The dry-bulb temperature-based control strategy uses the outdoor air temperature as an indicator of whether free cooling can be used instead of mechanical cooling. This study also introduces an artificial neural network (ANN) prediction model to optimize the control of the HVAC system, which can lead to additional cooling energy savings. To develop the ANN prediction model, the EnergyPlus program is used for simulation modeling, and the Python programming language is employed for model development. The results show that implementing a temperature-based economizer control strategy can lead to a reduction of 7.6% in annual cooling energy consumption. Moreover, by employing an ANN-based optimal control of discharge air temperature in air-handling units, an additional 22.1% of cooling energy savings can be achieved. In conclusion, the findings of this study demonstrate that the implementation of economizer controls, especially the dry-bulb temperature-based approach, can be an effective strategy for reducing cooling energy consumption in HVAC systems. Additionally, using ANN prediction models to optimize HVAC system controls can further increase energy savings, resulting in improved energy efficiency and reduced operating costs.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Design and optimization of Artificial Neural Networks for the modelling of superconducting magnets operation in tokamak fusion reactors

In superconducting tokamaks, the cryoplant provides the helium needed to cool different clients, among which by far the most important one is the superconducting magnet system. The evaluation of the transient heat load from the magnets to the cryoplant is fundamental for the design of the latter and the assessment of suitable strategies to smooth the heat load pulses, induced by the intrinsically pulsed plasma scenarios characteristic of today's tokamaks, is crucial for both suitable sizing and stable operation of the cryoplant. For that evaluation, accurate but expensive system-level models, as implemented in e.g. the validated state-of-the-art 4C code, were developed in the past, including both the magnets and the respective external cryogenic cooling circuits. Here we show how these models can be successfully substituted with cheaper ones, where the magnets are described by suitably trained Artificial Neural Networks (ANNs) for the evaluation of the heat load to the cryoplant. First, two simplified thermal-hydraulic models for an ITER Toroidal Field (TF) magnet and for the ITER Central Solenoid (CS) are developed, based on ANNs, and a detailed analysis of the chosen networks' topology and parameters is presented and discussed. The ANNs are then inserted into the 4C model of the ITER TF and CS cooling circuits, which also includes active controls to achieve a smoothing of the variation of the heat load to the cryoplant. The training of the ANNs is achieved using the results of full 4C simulations (including detailed models of the magnets) for conventional sigmoid-like waveforms of the drivers and the predictive capabilities of the ANN-based models in the case of actual ITER operating scenarios are demonstrated by comparison with the results of full 4C runs, both with and without active smoothing, in terms of both accuracy and computational time. Exploiting the low computational effort requested by the ANN-based models, a demonstrative optimization study has been finally carried out, with the aim of choosing among different smoothing strategies for the standard ITER plasma operation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An Artificial Neural Network Model to Predict the Bainite Plate Thickness of Nanostructured Bainitic Steels Using an Efficient Network-Learning Algorithm

Nanostructured bainitic steel has an extraordinary ultrahigh strength of about 2.0 GPa along with good toughness of 30 MPa m{sup 1/2}. The finer thickness of plate 20-80 nm is largely responsible for achieving such a large hardness of 690-720 HV. In this work, a multilayer perceptron-based artificial neural network (ANN) model has been developed to predict the thickness of bainite plate pertaining to nanostructured bainitic steels. The inputs of the ANN model are, namely, Gibbs free energy for bainitic transformation, austenite strength, transformation temperature for bainite and carbon concentration in the steel. The model prediction revealed that the bainite plate thickness critically depends on austenite strength and Gibbs free energy. From the neural prediction, it is concluded that formation of nanostructured bainitic steel is feasible only if sufficient austenite strength (above 165 MPa) has been achieved. This can be accomplished with a minimum carbon content of 0.5 wt.% in steel and transformation temperature below 300 °C. Higher driving force (Gibbs free energy) below − 1800 J/mol is another prerequisite condition of formation of nanostructured bainite steel. The network-learning architecture has been optimized using the Broyden–Fletcher–Goldfarb–Shanno (BFGS) algorithm to minimize the network training error within eight training cycles. The algorithm facilitates a faster convergence of network training and testing errors.

36 MATERIALS SCIENCE↗

Water dissociation at the water–rutile TiO 2 (110) interface from ab initio-based deep neural network simulations

The interaction of water with TiO 2 surfaces is of crucial importance in various scientific fields and applications, from photocatalysis for hydrogen production and the photooxidation of organic pollutants to self-cleaning surfaces and bio-medical devices. In particular, the equilibrium fraction of water dissociation at the TiO 2 –water interface has a critical role in the surface chemistry of TiO 2 , but is difficult to determine both experimentally and computationally. Among TiO 2 surfaces, rutile TiO 2 (110) is of special interest as the most abundant surface of TiO 2 ’s stable rutile phase. While surface-science studies have provided detailed information on the interaction of rutile TiO 2 (110) with gas-phase water, much less is known about the TiO 2 (110)–water interface, which is more relevant to many applications. In this work, we characterize the structure of the aqueous TiO 2 (110) interface using nanosecond timescale molecular dynamics simulations with ab initio-based deep neural network potentials that accurately describe water/TiO 2 (110) interactions over a wide range of water coverages. Simulations on TiO 2 (110) slab models of increasing thickness provide insight into the dynamic equilibrium between molecular and dissociated adsorbed water at the interface and allow us to obtain a reliable estimate of the equilibrium fraction of water dissociation. We find a dissociation fraction of 22 ± 6% with an associated average hydroxyl lifetime of 7.6 ± 1.8 ns. These quantities are both much larger than corresponding estimates for the aqueous anatase TiO 2 (101) interface, consistent with the higher water photooxidation activity that is observed for rutile relative to anatase.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

WE-AB-204-06: Pseudo-CT Generation Using Undersampled, Single-Acquisition UTE-MDixon and Direct-Mapping Artificial Neural Networks for MR-Based Attenuation Correction and Radiation Therapy Planning

Purpose: Emerging technologies such as dedicated PET/MRI and MR-therapy systems require robust and clinically practical methods for determining photon attenuation. Herein, we propose using novel MR acquisition methods and processing for the generation of pseudo-CTs. Methods: A single acquisition, 190-second UTE-mDixon sequence with 25% (angular) sampling density and 3D radial readout was performed on nine volunteers. Three water-filled tubes were placed in the FOV for trajectory-delay correction. The MR data were reconstructed to generate three primitive images acquired at TEs of 0.1, 1.5 and 2.8 ms. In addition, three derived MR images were generated, i.e. two-point Dixon water/fat separation and R2* (1/T2*) map. Furthermore, two spatial features, i.e. local binary pattern (S-1) and relative spatial coordinates (S-2), were incorporated. A direct-mapping operator was generated using Artificial Neural Networks (ANNs) for transforming the MR features to a pseudo-CT. CT images served as the training data and, using a leave-one-out method, for performance evaluation using mean prediction deviation (MPD), mean absolute prediction deviation (MAPD), and correlation coefficient (R). Results: The errors between measured CT and pseudo-CT declined dramatically when the spatial features, i.e. S-1 and S-2, were included. The MPD, MAPD, and R were, respectively, 5±57 HU, 141±41 HU, and 0.815±0.066 for results generated by the ANN trained without the spatial features and were 32±26 HU, 115±18 HU, and 0.869±0.035 with the spatial features. The estimation errors of the pseudo-CT were smaller when both the S-1 and S-2 were used together than when either the S-1 or the S-2 was used. Pseudo-CT generation (256×256×256 voxels) by ANN took < 0.5 s using a computer having an Intel i7 3.4GHz CPU and 16 GB RAM. Conclusion: The proposed direct-mapping ANN approach is a technically accurate, clinically practical method for pseudo-CT generation and can potentially help improve the accuracy of MR-AC and MR-RTP applications. Please note that the project was completed with partial funding from the Ohio Department of Development grant TECH 11-063 and a sponsored research agreement with Philips Healthcare that is managed by Case Western Reserve University. As noted in the affiliations, some of the authors are Philips employees.

60 APPLIED LIFE SCIENCES↗

Deep Neural Network Assisted Distributed Strain and Temperature Fiber Sensor System for Natural Gas Pipeline Monitoring

Natural gas pipeline integrity monitoring is crucial to detect potential leaks, find structural issues, and prevent environmental damage. This article presents a system of natural gas pipeline monitoring that uses a specialized double Brillouin peak sensing fiber along with the Brillouin optical time domain analysis (BOTDAs) technique. The calibrated sensing fiber coefficients for strain and temperature are 41.8 kHz/ με and 0.9 MHz/°C for peak 1; and 47.2 kHz/ με , and 1.11 MHz/°C for peak 2, respectively. Initially, lab tests were performed by installing a short section of double Brillouin peak fiber (DBPF) on a 1-in steel pipe under pressure up to 1000 per square inch (psi) at elevated temperatures. Simultaneous distributed measurements of temperature and pressure-induced hoop strain were successfully measured. Considering the long processing speed to extract Brillouin frequency shift (BFS), we employ a novel probabilistic deep neural network (PDNN) framework for rapid BFS prediction. Additionally, using the Finite Element Method, the effects of the pipeline pressure on hoop strain were modeled and compared to the experimental hoop strain under the same set of pipeline conditions. Finally, an actual 4-in outer diameter steel natural gas pipeline was used for pilot-scale tests, where hoop strain was measured at various pressure levels. Leaks were simulated to demonstrate accurate pipeline integrity monitoring. At an internal pipe pressure of 1000 psi, hoop strain of approximately 300 με was observed, and the sensitivity was calculated as 0.28 με /psi. The results of this pilot-scale study demonstrated that the system is capable of performing distributed monitoring sufficient to detect pipeline pressure and the presence of leaks to ensure the safe operation of gas pipelines in the field.

03 NATURAL GAS↗

Toward Fast and Reliable Potential Energy Surfaces for Metallic Pt Clusters by Hierarchical Delta Neural Networks

Data-driven machine learning force fields (MLF) are more and more popular in atomistic simulations, and exploit machine learning methods to predict energies and forces for unknown structures based on the knowledge learned from an existing reference database. The latter usually comes from density functional theory calculations. One main drawback of MLFs is that physical laws are not incorporated in the machine learning models and instead, MLFs are designed to be very flexible to simulate complex quantum chemistry potential energy surface (PES). In general, MLFs have poor transferability, and hence a very large trainset is required to span all the target feature space to get a reliable MLF. This procedure becomes more troublesome when the PES is complicated, with a large number of degrees of freedom, in which building a large database is inevitable and very expensive, especially when accurate but costly exchange-correlation functionals have to be used. In this manuscript, we exploit a high dimensional neural network potential (HDNNP) on Pt clusters of size 6 to 20 as one example. Furthermore, our standard level of energy calculation is DFT GGA (PBE) using a plane wave basis set. We introduce an approximate but fast level with the PBE functional and a minimal atomic orbital basis set, then a more accurate but expensive level, using a hybrid functional or non-local vdw functional and a plane wave basis set, is reliably predicted by learning the difference with HDNNP. Findings show that such a differential approach (named ΔHDNNP) can deliver very accurate predictions (error < 10 meV/atom) in reference to converged basis set energies as well as more accurate but expensive xc functional. The overall speedup can be as large as 900 for 20 atom Pt cluster. More importantly, ΔHDNNP shows much better transferability due to the intrinsic smoothness of delta potential energy surface, and accordingly one can use much smaller trainset data to obtain better accuracy than the conventional HDNNP. A multi-layer ΔHDNNP is thus proposed to obtain very accurate predictions versus expensive non-local vdW functional calculations in which the required trainset is further reduced. The approach can be easily generalized to any other machine learning methods and opens a path to study the structure and dynamics of Pt clusters and nanoparticles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Physics-informed neural networks for inverse problems in nano-optics and metamaterials

In this paper, we employ the emerging paradigm of physics-informed neural networks (PINNs) for the solution of representative inverse scattering problems in photonic metamaterials and nano-optics technologies. In particular, we successfully apply mesh-free PINNs to the difficult task of retrieving the effective permittivity parameters of a number of finite-size scattering systems that involve many interacting nanostructures as well as multi-component nanoparticles. Our methodology is fully validated by numerical simulations based on the finite element method (FEM). The development of physics-informed deep learning techniques for inverse scattering can enable the design of novel functional nanostructures and significantly broaden the design space of metamaterials by naturally accounting for radiation and finite-size effects beyond the limitations of traditional effective medium theories.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Reconstruction and Selection of Neutrino Interactions in MicroBooNE using Deep Convolutional Neural Networks

In this document, we describe a new reconstruction workflow developed for the MicroBooNE experiment. It features the use of Deep Convolutional Neural Networks trained to recognize key structures within the data sufficient for the 3D reconstruction of neutrino interactions within the detector. As a test of the reconstruction utility, the products of the reconstruction workflow are used to select inclusive charged-current (CC) $\nu_e$ and $\nu_\mu$ interactions in both simulated and real MicroBooNE data. In simulation, our $\nu_e$ and $\nu_\mu$ selections achieve an efficiency of 57% and 68\%, respectively, with a purity of 91% and 96%, respectively. We find that these selections are competitive with the inclusive selections used for the most recent MicroBooNE LEE searches. In particular, the CC-$\nu_e$ inclusive selection efficiency improves by over 20% while also improving sample purity. As a first step in quantifying potential bias, the data and Monte Carlo expectati ons are compared for both selections using the MicroBooNE open data. Within statistical and systematic uncertainties, both the electron and muon CC-inclusive event samples agree. A comparison of the real data events chosen by our work and another reconstruction framework shows that the two analyses each identify a sizeable fraction of events the other does not. This suggests that future analyses integrating the strengths of each could lead to combined gains. This work demonstrates, for the first time on real LArTPC data, state-of-the-art neutrino interaction reconstruction centered around deep learning algorithms.

43 PARTICLE ACCELERATORS↗

NSGA-PINN: A Multi-Objective Optimization Method for Physics-Informed Neural Network Training

This paper presents NSGA-PINN, a multi-objective optimization framework for the effective training of physics-informed neural networks (PINNs). The proposed framework uses the non-dominated sorting genetic algorithm (NSGA-II) to enable traditional stochastic gradient optimization algorithms (e.g., ADAM) to escape local minima effectively. Additionally, the NSGA-II algorithm enables satisfying the initial and boundary conditions encoded into the loss function during physics-informed training precisely. We demonstrate the effectiveness of our framework by applying NSGA-PINN to several ordinary and partial differential equation problems. In particular, we show that the proposed framework can handle challenging inverse problems with noisy data.

Lu, Binghang (ORCID:0009000160016632)↗

Physically-Informed Artificial Neural Networks for Atomistic Modeling of Materials

A new approach is presented for the development of classical interatomic potentials using physically-informed neural networks (PINN) combined with an analytical bond-order atomic interaction model. Due to the strong physical underpinnings, the PINN potentials demonstrate much better transferability than the existing machine-learning potentials while drastically improving the accuracy in comparison with traditional potentials. PINN potentials can be constructed for both metallic and covalent materials in a unified manner. A number of applications of PINN potentials to large-scale molecular dynamics and Monte Carlo simulations and calculation of thermal and mechanical properties of diverse materials are demonstrated. Some of the specific materials systems include silicon and aluminum, as well as alloys and compounds. Computational aspects of PINN potentials are discussed and future developments in this field are outlined.

J Hickman↗

Flood Mapping Using UAVSAR and Convolutional Neural Networks

We have mapped flooded areas in data collected by the NASA/JPL Uninhabited Aerial Vehicle Synthetic Aperture Radar (UAVSAR) using two convolutional neural network (CNN) image classifier architectures: U-Net and SegNet. Our study area was a region around Houston, TX, USA affected by widespread flooding in 2017 due to Hurricane Harvey. To train and test the classifiers, we manually labelled over 10000 image segments in two flight lines. Both U-Net and SegNet yielded higher accuracy than a previous non-machine learning classifier we used as a baseline. U-Net had slightly higher accuracy than SegNet. The classifiers performed better in areas with more homogeneous land cover. To independently validate the classifier accuracy we used NOAA aerial imagery, with overall accuracy around 80%. Future work includes assessing the classifier robustness in other study areas, assessing the classifier dependence on UAVSAR incidence angle, particularly for open water and bare ground, and collecting more training data, particularly in urban areas. This study demonstrates the potential of CNN image classifiers for mapping flooded areas in airborne polarimetric SAR imagery, and for land cover classification of polarimetric SAR imagery more generally.

Denbina, Michael W↗

Developing Data-Driven Artificial Neural Network for A High Throughput Retrieval of Aerosol Optical Depth and Surface Temperature of Mars

In this work, we aim to developartificial neural network(ANN)techniquesto reproduce the retrieval results ofphysical quantities from spacecraft observations of solar system bodiesusing radiative transfer methods. The particular application here is the retrieval of dust optical depth, water-ice optical depth, and surface temperatureonMarsusingdaytime observationsobtained by the Thermal Emission Spectrometer (TES) onboard the Mars Global Surveyor.Compared against the results obtained from traditional radiative transfer retrieval techniques, our ANN successfully recoveredthe three quantitiesusingdaytime observations. The principal advantage of thesemachine learning(ML) algorithms istheir complete automation and highthroughput. Therefore, the algorithms presented here would be useful for very large datasets andwould make practical the sampling of many different approximations or boundary conditions related to a given observation dataset and retrieval problem.

Rafael Moreno↗

Three-terminal ferroelectric synapse device with concurrent learning function for artificial neural networks

Spike-timing-dependent synaptic plasticity (STDP) is demonstrated in a synapse device based on a ferroelectric-gate field-effect transistor (FeFET). STDP is a key of the learning functions observed in human brains, where the synaptic weight changes only depending on the spike timing of the pre- and post-neurons. The FeFET is composed of the stacked oxide materials with ZnO/Pr(Zr,Ti)O{sub 3} (PZT)/SrRuO{sub 3}. In the FeFET, the channel conductance can be altered depending on the density of electrons induced by the polarization of PZT film, which can be controlled by applying the gate voltage in a non-volatile manner. Applying a pulse gate voltage enables the multi-valued modulation of the conductance, which is expected to be caused by a change in PZT polarization. This variation depends on the height and the duration of the pulse gate voltage. Utilizing these characteristics, symmetric and asymmetric STDP learning functions are successfully implemented in the FeFET-based synapse device by applying the non-linear pulse gate voltage generated from a set of two pulses in a sampling circuit, in which the two pulses correspond to the spikes from the pre- and post-neurons. The three-terminal structure of the synapse device enables the concurrent learning, in which the weight update can be performed without canceling signal transmission among neurons, while the neural networks using the previously reported two-terminal synapse devices need to stop signal transmission for learning.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Predictive model using artificial neural network to design phase change material-based ocean thermal energy harvesting systems for powering uncrewed underwater vehicles

Uncrewed Underwater Vehicles (UUVs) are a major beneficiary of the phase change material (PCM)-based ocean thermal energy harvesting technology for their mission needs. However, this technology relies on different parameters and energy conversion steps that could be critical to the general energy generation efficiency. Sea trials showed that the design performed lower than their laboratory design specifications. This underperformance results from different factors, mainly the UUV’s trajectory, travel time, underwater ocean currents, temperature fluctuations, and biofouling on the heat exchanger due to long term underwater operations. Therefore, there exists a need to continuously monitor the ambient energy harvesting system and predict system performance, for mission planning purposes. Two major parameters influencing the energy harvesting system include the final pressure inside the hydraulic energy storage vessel or accumulator, and the electrical load value. Here, this work focuses on the hydraulic to electric energy conversion system. Therefore, a combination of numerical model and experimental testing is used to develop a predictive model using artificial neural network using MATLAB. After validation with experimental testing, 1000 data samples obtained from the numerical model are used to train the ANN. Compared to the experimental results, the developed ANN model can predict in less than a second the designed benchtop system’s total efficiency with less than 15 percent maximum error range. This predictive model development represents a cost-effective way for optimization and a computational energy efficient mode aboard UUVs for mission planning for deployed UUVs using PCM-based ocean thermal energy harvesting technology.

30 DIRECT ENERGY CONVERSION↗