Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning rate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Operator learning for energy-efficient building ventilation control with computational fluid dynamics simulation of a real-world classroom

Energy-efficient ventilation control plays an important role in reducing building energy consumption while ensuring occupant health and comfort. While Computational Fluid Dynamics (CFD) simulations provide detailed and physically accurate representations of indoor airflow, their high computational cost limits their use in real-time building control. In this work, we present a neural operator learning framework that combines the physical accuracy of CFD with the computational efficiency of machine learning to enable building ventilation control with the high-fidelity fluid dynamics models. Our method jointly optimizes the airflow supply rates and vent angles to reduce energy use and adhere to air quality constraints. We train an ensemble of neural operator transformer models to learn the mapping from building control actions to airflow fields using high-resolution CFD data. This learned neural operator is then embedded in an optimization-based control framework for building ventilation control. Experimental results show that our approach achieves significant energy savings compared to maximum airflow rate control, rule-based control, as well as data-driven control methods using spatially averaged CO 2 prediction and deep learning–based reduced-order models, while consistently maintaining safe indoor air quality. These results highlight the practicality and scalability of our method in maintaining energy efficiency and indoor air quality in real-world buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Event Cause Analysis in Distribution Networks using Synchro Waveform Measurements

This paper presents a machine learning method for event cause analysis to enhance situational awareness in distribution networks. The data streams are captured using time-synchronized high sampling rates synchro waveform measurement units (SWMU). The proposed method is formulated based on a machine learning method, the convolutional neural network (CNN). This method is capable of capturing the spatiotemporal feature of the measurements effectively and perform the event cause analysis. Several events are considered in this paper to encompass a range of possible events in real distribution networks, including capacitor bank switching, transformer energization, fault, and high impedance fault (HIF). The dataset for our study is generated using the real time digital simulator (RTDS) to simulate real-world events. The event cause analysis is performed using only one cycle of the voltage waveforms after the event is detected. The simulation results show the effectiveness of the proposed machine learning-based method compared to the state-of-the-art classifiers.

Niazazari, Iman↗

Accurate prediction of mega-electron-volt electron beam properties from UED using machine learning

To harness the full potential of the ultrafast electron diffraction (UED) and microscopy (UEM), we must know accurately the electron beam properties, such as emittance, energy spread, spatial-pointing jitter, and shot-to-shot energy fluctuation. Owing to the inherent fluctuations in UED/UEM instruments, obtaining such detailed knowledge requires real-time characterization of the beam properties for each electron bunch. While diagnostics of these properties exist, they are often invasive, and many of them cannot operate at a high repetition rate. Here, we present a technique to overcome such limitations. Employing a machine learning (ML) strategy, we can accurately predict electron beam properties for every shot using only parameters that are easily recorded at high repetition rate by the detector while the experiments are ongoing, by training a model on a small set of fully diagnosed bunches. Applying ML as real-time noninvasive diagnostics could enable some new capabilities, e.g., online optimization of the long-term stability and fine single-shot quality of the electron beam, filtering the events and making online corrections of the data for time-resolved UED, otherwise impossible. This opens the possibility of fully realizing the potential of high repetition rate UED and UEM for life science and condensed matter physics applications.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Development of learning objectives to support undergraduate virology curriculum guidelines

It has become increasingly important for microbiology educators to help students learn critical concepts of the discipline. This is particularly true in virology, where current challenges include increasing rates of vaccine hesitancy, misinformation about the COVID-19 pandemic, and controversy surrounding research on pathogens with pandemic potential. Having students learn virology can attract more people to the field and increase the number of people who can engage in meaningful discourse about issues relating to the discipline. However, the limited number of virologists who teach undergraduates, combined with the fact that many institutions lack stand-alone virology courses, results in virology often being taught as a limited number of lectures within an undergraduate microbiology course (if it is covered at all), which may or may not be taught by an individual trained as a virologist. To provide a framework to teach virology to undergraduate students, a team of virology educators, with support from the American Society for Virology (ASV), developed curriculum guidelines for use in a stand-alone undergraduate virology course or a virology section within another course. These guidelines are available at the ASV website (https://asv.org/curriculum-guidelines/). To assist educators in implementing these guidelines, we created examples of measurable learning objectives. This perspective provides details about the virology curriculum guidelines and learning objectives and accompanies the perspective by Boury et al. in this issue of the Journal of Microbiology & Biology Education about the recent revision of the microbiology curriculum guidelines overseen by the American Society for Microbiology.

59 BASIC BIOLOGICAL SCIENCES↗

Advancing Multiscale Simulation of Plasma-Surface Interfaces

We report the development of an atomistic-informed, surface-state-dependent predictive model for particle exchange in a carbon-tungsten plasma-surface interface. The predictive model uses machine learning (ML) techniques to learn the energy and angular distributions for particle exchange and rate functions for surface state evolution from molecular dynamics simulations of cumulative bombardment of tungsten by energetic carbon ions. Each predictive component is sensitive to the energy and trajectory of incident plasma species and the surface state. The surface state is represented by a set of surface state descriptors, which were derived from the atomistic surface state for each independent carbon bombardment event. These descriptors are representative of the composition and degree of amorphization of the outermost angstrom of surface material and were chosen to optimize predictive performance for particle exchange at the interface. The distributions for particle exchange (reflection/sputtering) are demonstrated to vary with each surface state descriptor, motivating the development of surface-state-dependent particle exchange models for plasma simulations. The performance of various ML methods was compared, including polynomial quantile regression, artificial neural networks, k-nearest neighbors, and random forest algorithms, with polynomial regression performing the best for interpolation and extrapolation of learned relationships. In addition to the particle exchange model, a neutral network was developed and used to identify data sufficiency throughout surface descriptor space, which will enable real-time feedback during future data production to ensure data is produced where it is most needed, and we provide commentary on improvements to the data production workflow for future endeavors.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Uncertainty bounds for multivariate machine learning predictions on high-strain brittle fracture

Simulation of the crack network evolution on high strain rate impact experiments performed in brittle materials is very compute-intensive. The cost increases even more if multiple simulations are needed to account for the randomness in crack length, location, and orientation, which is inherently found in real-world materials. Constructing a machine learning emulator can make the process faster by orders of magnitude. There has been little work, however, on assessing the error associated with their predictions. Estimating these errors is imperative for meaningful overall uncertainty quantification. In this work, we extend the heteroscedastic uncertainty estimates to bound a multiple output machine learning emulator. Overall, we find that the response prediction is accurate within its predicted errors, but with a somewhat conservative estimate of uncertainty.

36 MATERIALS SCIENCE↗

Measurement of the Higgs boson production rate in association with top quarks in final states with electrons, muons, and hadronically decaying tau leptons at $\sqrt{s} =$ 13 TeV

The rate for Higgs (${\mathrm{H}} $) bosons production in association with either one (${\mathrm{t}} {\mathrm{H}} $) or two (${\mathrm{t}} {{\overline{{{\mathrm{t}}}}}} {\mathrm{H}} $) top quarks is measured in final states containing multiple electrons, muons, or tau leptons decaying to hadrons and a neutrino, using proton–proton collisions recorded at a center-of-mass energy of $13\,\text {Te}\text {V} $ by the CMS experiment. The analyzed data correspond to an integrated luminosity of 137$\,\text {fb}^{-1}$. The analysis is aimed at events that contain ${\mathrm{H}} \rightarrow {\mathrm{W}} {\mathrm{W}} $, ${\mathrm{H}} \rightarrow {\tau } {\tau } $, or ${\mathrm{H}} \rightarrow {\mathrm{Z}} {\mathrm{Z}} $ decays and each of the top quark(s) decays either to lepton+jets or all-jet channels. Sensitivity to signal is maximized by including ten signatures in the analysis, depending on the lepton multiplicity. The separation among ${\mathrm{t}} {\mathrm{H}} $, ${\mathrm{t}} {{\overline{{{\mathrm{t}}}}}} {\mathrm{H}} $, and the backgrounds is enhanced through machine-learning techniques and matrix-element methods. The measured production rates for the ${\mathrm{t}} {{\overline{{{\mathrm{t}}}}}} {\mathrm{H}} $ and ${\mathrm{t}} {\mathrm{H}} $ signals correspond to $0.92 \pm 0.19\,\text {(stat)} ^{+0.17}_{-0.13}\,\text {(syst)} $ and $5.7 \pm 2.7\,\text {(stat)} \pm 3.0\,\text {(syst)} $ of their respective standard model (SM) expectations. The corresponding observed (expected) significance amounts to 4.7 (5.2) standard deviations for ${\mathrm{t}} {{\overline{{{\mathrm{t}}}}}} {\mathrm{H}} $, and to 1.4 (0.3) for ${\mathrm{t}} {\mathrm{H}} $ production. Assuming that the Higgs boson coupling to the tau lepton is equal in strength to its expectation in the SM, the coupling $y_{{\mathrm{t}}}$ of the Higgs boson to the top quark divided by its SM expectation, $\kappa _{{\mathrm{t}}}=y_{{\mathrm{t}}}/y_{{\mathrm{t}}}^{\mathrm {SM}}$, is constrained to be within $-0.9< \kappa _{{\mathrm{t}}}< -0.7$ or $0.7< \kappa _{{\mathrm{t}}}< 1.1$, at 95% confidence level. This result is the most sensitive measurement of the ${\mathrm{t}} {{\overline{{{\mathrm{t}}}}}} {\mathrm{H}} $ production rate to date.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

AXEAP : a software package for X-ray emission data analysis using unsupervised machine learning

The Argonne X-ray Emission Analysis Package ( AXEAP ) has been developed to calibrate and process X-ray emission spectroscopy (XES) data collected with a two-dimensional (2D) position-sensitive detector. AXEAP is designed to convert a 2D XES image into an XES spectrum in real time using both calculations and unsupervised machine learning. AXEAP is capable of making this transformation at a rate similar to data collection, allowing real-time comparisons during data collection, reducing the amount of data stored from gigabyte-sized image files to kilobyte-sized text files. With a user-friendly interface, AXEAP includes data processing for non-resonant and resonant XES images from multiple edges and elements. AXEAP is written in MATLAB and can run on common operating systems, including Linux, Windows, and MacOS.

97 MATHEMATICS AND COMPUTING↗

Machine learning and TDDFT software for stopping power computation

(SF-24-012) Stopping power describes the rate that a material slows radiation particles passing through it and is useful in designing many technologies. Few organizations can perform new measurements, which require significant resources and rare equipment, and all others rely on coarse approximations rendered from pre-existing data. Methods for computing stopping power in new materials, such as time-dependent density functional theory (TD-DFT), have only recently (circa-2015) become available but are too computationally costly to use frequently enough to have a pronounced impact. We have created a method that opens a pathway to computing stopping power without any need for experimental data by combining electronic structure computations and machine learning.

Ward, Logan↗

Frequency Disturbance Event Detection Based on Synchrophasors and Deep Learning

Power system frequency disturbances are caused by various generation and transmission events including generator trips, load disconnections, line trips, etc. Accurate detections of the events are crucial to bulk power system situation awareness and event investigation. This paper utilizes the recent advances of deep learning to build a convolutional neural network model to detect events in an accurate yet straightforward manner. Herein, the rate of change of frequency and the relative angle shift are converted to images as the inputs of the proposed model. Finally, this paper uses two convolutional neural networks and classifier fusion to achieve the detection result. Compared with the conventional event detection algorithm and the frequency only deep learning model, the proposed model improves the detection accuracy by over 48%. As a promising tool for bulk power system situation awareness, the proposed model requires a short decision time, which is suitable for practical scenarios.

42 ENGINEERING↗

AADL: Anderson Accelerated Deep Learning

We propose a stable, distributed approach to perform AA that accelerates the convergence rate of stochastic first-order optimizers to train neural networks. Differently from previous works, we do not alter neither the scheme to perform AA nor the loss function minimized during the training. To improve robustness against stagnation, we customize general guidelines that suggest to relax the frequency of AA corrections by performing AA only at the end of an entire training epoch. To improve robustness of AA against the stochastic oscillations of first-order optimizers, we average the gradients computed on consecutive stochastic optimization updates. The improved regularity of the converging sequence and the reduced amplitude of stochastic oscillations across consecutive optimization steps allows AA to efficiently extrapolate an improved converging sequence, thereby overcoming limitations of existing approaches to perform AA on stochastic optimization.

Lupo Pasini, Massimiliano [Oak Ridge National Lab.↗

Diagnostics, Prognostics, and Optimization for Lithium-Ion Battery Systems

Health management of lithium-ion battery systems presents a host of challenges due to their complex physics, large numbers of components, and a wide variety of degradation behaviors across different battery types. Dr. Paul Gasper will present on research from the Electrochemical Energy Storage Group on Lithium-ion battery diagnostics, prognostics, and optimization. Diagnostics research, including state-estimation via machine-learning from electrochemical impedance spectroscopy and DC pulses as well as continuous state-estimation via Kalman filters, will highlight the ongoing challenges for accurately measuring the state of batteries without performing time-consuming characterization tests. NLR's industry-recognized battery prognostics work, which predicts real-world battery degradation by identifying degradation rate models from accelerated aging data using statistical modeling and machine-learning, will be used to demonstrate the critical impact of battery controls, thermal management, and operating strategy on durability and lifetime. Finally, the use of prognostic models for financial or lifetime optimization will be discussed.

25 ENERGY STORAGE↗

Prognostic analysis of high-flow nasal cannula therapy and non-invasive ventilation in mild to moderate hypoxemia patients and construction of a machine learning model for 48-h intubation prediction—a retrospective analysis of the MIMIC database

Background This study aims to investigate the clinical outcome between high-flow nasal cannula (HFNC) and non-invasive ventilation (NIV) therapy in mild to moderate hypoxemic patients on the first ICU day and to develop a predictive model of 48-h intubation. Methods The study included adult patients from the MIMIC III and IV databases who first initiated HFNC or NIV therapy due to mild to moderate hypoxemia (100 < PaO2/FiO2 ≤ 300). The 48-h and 30-day intubation rates were compared using cross-sectional and survival analysis. Nine machine learning and six ensemble algorithms were deployed to construct the 48-h intubation predictive models, of which the optimal model was determined by its prediction accuracy. The top 10 risk and protective factors were identified using the Shapley interpretation algorithm. Result A total of 123,042 patients were screened, of which, 673 were from the MIMIC IV database for ventilation therapy comparison (HFNC n = 363, NIV n = 310) and 48-h intubation predictive model construction (training dataset n = 471, internal validation set n = 202) and 408 were from the MIMIC III database for external validation. The NIV group had a lower intubation rate (23.1% vs. 16.1%, p = 0.001), ICU 28-day mortality (18.5% vs. 11.6%, p = 0.014), and in-hospital mortality (19.6% vs. 11.9%, p = 0.007) compared to the HFNC group. Survival analysis showed that the total and 48-h intubation rates were not significantly different. The ensemble AdaBoost decision tree model (internal and external validation set AUROC 0.878, 0.726) had the best predictive accuracy performance. The model Shapley algorithm showed Sequential Organ Failure Assessment (SOFA), acute physiology scores (APSIII), the minimum and maximum lactate value as risk factors for early failure and age, the maximum PaCO 2 and PH value, Glasgow Coma Scale (GCS), the minimum PaO 2 /FiO 2 ratio, and PaO 2 value as protective factors. Conclusion NIV was associated with lower intubation rate and ICU 28-day and in-hospital mortality. Further survival analysis reinforced that the effect of NIV on the intubation rate might partly be attributed to the other impact factors. The ensemble AdaBoost decision tree model may assist clinicians in making clinical decisions, and early organ function support to improve patients’ SOFA, APSIII, GCS, PaCO 2 , PaO 2 , PH, PaO 2 /FiO 2 ratio, and lactate values can reduce the early failure rate and improve patient prognosis.

Fu, Wei↗

Smart Methane Emission Detection System Development Final Report

Working with the Department of Energy's National Energy Technology Laboratory, Southwest Research Institute® (SwRI®) developed a system to identify methane leaks reliably, accurately, and autonomously at critical midstream sections of the natural gas distribution network in real- time for the purpose of mitigating methane emissions using Optical Gas Imaging (OGI) cameras. SwRI's Smart Leak Detection – Methane (SLED/M) adds a high degree of automation to the process of methane leak detection to minimize sources of human error, minimize response time to a leak event, and maximize midstream visibility. Furthermore, SwRI has been working towards integrating Quantitative OGI (QOGI) capabilities into this existing technology. By leveraging Deep Learning, SwRI now has the capability to estimate fugitive emission leak rates quickly and reliably, which allows operators to detect emissions, quantify leak rate, prioritize repairs, and validate the repairs in a single instrument. The next generation QOGI technology leverages the same cameras used in Leak Detection and Repair (LDAR) programs, with improvements in safety and speed for traditional quantification-based repairs, ultimately leading to less overhead cost for the operators.

03 NATURAL GAS↗

Search for solar axions produced through the axion-electron coupling gae using a new GridPix detector at CAST

We present a search for solar axions produced through the axion-electron coupling (g ae ) using data from a novel 7-GridPix detector installed at the CERN Axion Solar Telescope (CAST). The detector, featuring ultra-thin silicon nitride windows and multiple veto systems, collected approximately 160 hours of solar tracking data between 2017–2018. Using machine learning techniques and the veto systems, we achieved a background rate of 1.06 × 10 −5 keV −1 cm −2 s −1 at a signal efficiency of about 80% in the 0.2 to 8 keV range. Analysis of the data yielded no significant excess above background, allowing us to set a new upper limit on the product of the axion-electron and axion-photon couplings of g ae · g aγ < 7.35 × 10 −23 GeV −1 at 95% confidence level for axion masses below 10 meV. This result improves upon the previous best helioscope limit and demonstrates the potential of GridPix technology for rare event searches. Additionally, we derived a limit on the axion-photon coupling of g aγ < 9.0 × 10 −11 GeV −1 at 95% CL, which, while not surpassing CAST’s best limit, provides complementary constraints on axion models.

Beyond Standard Model↗

Development, characterization, and modeling of a high-performance Ru/B2CA catalyst for ammonia synthesis

This paper documents the development and performance of a nano-phase Ru catalyst on a (BaO) x (CaO) y (Al 2 O 3 ) support. Extensive screening of the support’s ternary composition shows the best stoichiometry is (BaO) 2 (CaO)(Al 2 O 3 ), denoted B2CA. The paper first describes catalyst preparation and characterization. The paper reports a detailed 12-step reaction mechanism that represents ammonia synthesis over wide ranges of temperature, pressure, space velocity, and feed composition. Additionally, the mechanism is developed and validated using results of packed-bed experiments. The elementary reaction pathways consider surface adsorbates, including catalyst-poisoning behaviors. The rate expressions include important coverage-dependent activation barriers. Machine learning models assist interpretation of the catalyst-support interactions. The detailed chemistry is much more predictive than is possible with global representations (N 2 + 3H 2 ⇌ 2NH 3 ). The validated models can be applied to assist optimizing reactor design and operating conditions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

On Alfvénic turbulence of solar wind streams observed by Solar Orbiter during March 2022 perihelion and their source regions

It has been recently accepted that the standard classification of the solar wind solely according to flow speed is outdated, and particular interest has been devoted to the study of the origin and evolution of so-called Alfvénic slow solar wind streams and to what extent such streams resemble or differ from fast wind. In March 2022, Solar Orbiter completed its first nominal phase perihelion passage. During this interval, it observed several Alfvénic streams, allowing for characterization of fluctuations in three slow wind intervals (AS1-AS3) and comparison with a fast wind stream (F) at almost the same heliocentric distance. This work makes use of Solar Orbiter plasma parameters from the Solar Wind Analyzer (SWA) and magnetic field measurements from the magnetometer (MAG). The magnetic connectivity to the solar sources of selected solar wind intervals was reconstructed using a ballistic extrapolation based on measured solar wind speed down to the (spherical) source surface at 2.5 R s below which a potential field extrapolation was used to map back to the Sun. The source regions were identified using SDO/AIA observations. A spectral analysis of in situ measured magnetic field and velocity fluctuations was performed to characterize correlations, Alfvénicity, normalized cross-helicity, and residual energy in the frequency domain as well as intermittency of the fluctuations and spectral energy transfer rate estimated via mixed third-order moments. A machine learning technique was used to separate proton core, proton beam, and alpha particles and to study v − b correlations for the different ion populations in order to evaluate the role played by each population in determining the Alfvénic content of solar wind fluctuations. The comparison between fast wind and Alfvénic slow wind intervals highlights the differences between the two solar wind regimes: The fast wind is characterized by larger amplitude fluctuations, and magnetic and velocity fluctuations are closer to equipartition of energy. In fact the Alfvénic slow wind streams appear to be on a spectrum of wind types, with AS1, originating from open field lines neighboring active regions and displaying similarities with the fast wind in terms of fluctuation amplitude and turbulence characteristics, but not with respect to the alpha particles and proton beams. The other two slow streams differed both in their sources as well as plasma characteristics, with AS2 coming from the expansion of a narrow coronal hole corridor and AS3 from a region straddling a pseudostreamer. The latter displayed the coldest and highest density but the slowest stream with the smallest fluctuation amplitude and greatest magnetic energy excess. It also showed the largest scatter in proton beam speeds and the greatest difference in speed between proton beam and alpha particles. This study shows how the old fast–slow solar wind dichotomy, already called into question by the observations of slower Alfvénic solar wind streams, should further be refined, as the Alfvénic slow wind, originating in different solar wind regions, show significant differences in density, temperature, and proton and alpha-particle properties in the inner heliosphere. The observations presented here provide the starting point for a better understanding of the origin and evolution of different solar wind streams as well as the evolving turbulence contained within.

magnetohydrodynamics (MHD)↗

Advanced Signal Decomposition Analysis and Anomaly Detection in Photovoltaic Systems

With the rapid expansion of large-scale photovoltaic (PV) plants, it is paramount for solar stakeholders to understand the reliability and efficiency of their plants to inform maintenance decisions, increase production, and understand the design factors that impact performance. Diagnosing underperformance in PV plants is challenging due to the relatively few monitoring points with respect to the large geographic footprint of the plant. This work introduces a cutting-edge method that transforms the analysis and management of key factors influencing PV plant performance, including performance loss rate (PLR), recoverable soiling, and major system changes. Identifying these factors is critical for deriving actionable insights. Leveraging advanced analytical techniques such as wavelet transformation, robust regression, and extreme point analysis, this approach provides a nuanced understanding of these factors. This method has been tested across two synthetic datasets and one real dataset, consistently surpassing existing benchmarks by achieving a lower median mean absolute error and reduced error variability across all comparable components.

14 SOLAR ENERGY↗