Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Boosting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

A Comparison of Machine Learning Methods for Frequency Nadir Estimation in Power Systems: Preprint

An increasing penetration level of inverter-based renewable energy resources changes the inertia of power systems, posing challenges for maintaining the desired system frequency stability. An accurate frequency nadir estimation is crucial for power system operators to prepare preventive actions against large frequency excursions. In this paper, five machine learning methods - linear regression, gradient boosting, support vector regression, an artificial neural network, and XGBoost - are applied to two different sets of preprocess data for the prediction of the frequency nadir in the Western Electricity Coordinating Council 240-bus system with high renewable penetration levels. The training and testing data sets are collected by extensive generation scheduling simulations on the Multi-timescale Integrated Dynamic and Scheduling (MIDAS) toolbox. Numerical results show that all five machine learning methods can achieve high performance accuracy for power system nadir frequency estimation. Among them, the gradient boosting and the XGBoost are clear winners by providing the best prediction accuracy.

data driven↗

Improving Di-Higgs Sensitivity at Future Colliders in Hadronic Final States with Machine Learning

One of the central goals of the physics program at the future colliders is to elucidate the origin of electroweak symmetry breaking, including precision measurements of the Higgs sector. This includes a detailed study of Higgs boson (H) pair production, which can reveal the H self-coupling. Since the discovery of the Higgs boson, a large campaign of measurements of the properties of the Higgs boson has begun and many new ideas have emerged during the completion of this program. One such idea is the use of highly boosted and merged hadronic decays of the Higgs boson ($\mathrm{H}\to\mathrm{b}\bar{\mathrm{b}}$, $\mathrm{H}\to\mathrm{W}\mathrm{W}\to\mathrm{q}\bar{\mathrm{q}}\mathrm{q}\bar{\mathrm{q}}$) with machine learning methods to improve the signal-to-background discrimination. In this white paper, we champion the use of these modes to boost the sensitivity of future collider physics programs to Higgs boson pair production, the Higgs self-coupling, and Higgs-vector boson couplings. We demonstrate the potential improvement possible at the Future Circular Collider in hadron mode, especially with the use of graph neural networks.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Compounds that induce octane overboosting

A fuel mixture includes a fuel and an octane overboosting additive. Methods of preparing and using such mixtures are disclosed. In particular, the mixture includes an additive that provides octane boosting that produces peak octane at or before a 40% blend and produces at least a 1 octane boost at 10% volume of additive to fuel mixture.

Monroe, Eric↗

Pulsed Power Supply for Magnet Quench Training

Superconducting magnets typically go through aseries of spontaneous “training” quenches as their current isincreased towards its design value. To decrease the number ofthese quenches, a device has been designed to boost the magnetcurrent at the moment a quench has been detected and beforemagnet protection has been initiated. The aim of the boost is todrive the magnet coil further along towards its maximum currentwith each training quench, and hence reduce the number ofquenches required.

43 PARTICLE ACCELERATORS↗

Rare Higgs Processes at CMS and Precision Timing Detector Studies for HL-LHC CMS Upgrade

This thesis describes the search for two rare Higgs processes. The first analysis describes the CMS Run 2 search for $H$ $\rightarrow$ $\mu$$\mu$ decays, with 137.3 fb$^{-1}$ of data at $\sqrt{s}$ = 13 TeV. The analysis targeted four different Higgs production modes: the gluon fusion (ggH), the vector boson fusion (VBF), the Higgs-strahlung process (VH), and the production in association with a pair of top quarks (ttH). Each category used a dedicated machine learning based classifier to separate the signal from the background processes. A combined fit from all these categories saw a slight excess in the data corresponding to 3.0 standard deviations at $M$$_{H}$ = 125.38 GeV, and gave the first evidence for the Higgs boson decay to second-generation fermions. The best-fit signal strength and the corresponding 68% CL interval was found to be +0.17?????? = 1.19 $_{-0.39}^{+0.41}$ (stat)$_{-0.16}^{+0.17}$(syst) at $M$$_{H}$ = 125.38 GeV. The second analysis describes the CMS Run 2 search for 𝐻𝐻 → 𝑏𝑏𝑏𝑏 with highly boosted Higgs bosons. This analysis used a dedicated jet identification algorithm based on graph neural networks (ParticleNet) to identify boosted H→ bb jets. This search targeted the gluon fusion and the vector boson fusion HH production modes, and put constraints on the allowed values of the various Higgs couplings as: 𝜅𝜆 ∈ [−9.9, 16.9] when 𝜅𝑉 = 1, 𝜅2𝑉 = 1; 𝜅𝑉 ∈ [−1.17, −0.79] ∪ [0.81, 1.18] when 𝜅𝜆 = 1, 𝜅2𝑉 = 1; 𝜅2𝑉 ∈ [0.62, 1.41] when 𝜅𝜆 = 1, 𝜅𝑉 = 1. A scenario with 𝜅2𝑉 = 0 was excluded with a significance of 6.3 standard deviations for the first time, when other H couplings are fixed to their SM values. The combined observed (expected) 95% upper limit on the HH production cross section was found to be 9.9 (5.1) × SM. Finally, this thesis also discusses the planned MIP Timing Detector (MTD) upgrade for CMS at the HL-LHC. The MTD will be a time-of-flight (TOF) detector, designed to provide a precision timing information for charged particles using SiPMs + LYSO scintillating crystals, with a time resolution of ∼30 ps. This thesis describes several R&D tests that have been performed for characterizing the sensor properties (time resolution, light yield, etc.) and optimizing the sensor design geometry. This thesis also contains a description of mock test setups for cooling the sensors, since it is known to be an effective way of mitigating the increased dark current rates in the sensors due to radiation damage.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Efficient and Robust Jet Tagging at the LHC with Knowledge Distillation

The challenging environment of real-time data processing systems at the Large Hadron Collider (LHC) strictly limits the computational complexity of algorithms that can be deployed. For deep learning models, this implies that only models with low computational complexity that have weak inductive bias are feasible. To address this issue, we utilize knowledge distillation to leverage both the performance of large models and the reduced computational complexity of small ones. In this paper, we present an implementation of knowledge distillation, demonstrating an overall boost in the student models' performance for the task of classifying jets at the LHC. Furthermore, by using a teacher model with a strong inductive bias of Lorentz symmetry, we show that we can induce the same inductive bias in the student model which leads to better robustness against arbitrary Lorentz boost.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Technology Feasibility of High-Temperature Heat Pumps for Industrial Drying Process in the US

High-temperature heat pumps are a prospective technology for electrifying and decarbonizing industrial drying processes. This study investigates the technological potential of HTHPs in replacing fossil-fuel burners or steam boilers in industrial spray dryers. The performance of HTHPs with three configurations was investigated, including high high-temperature heat pump boosted with an electric air heater, a steam-generating high-temperature heat pump with multi-stage mechanical vapor compressions, and transcritical high-temperature heat pumps. R1336mzz(Z) is used as the refrigerant in both subcritical and transcritical high-temperature heat pumps, and R717 is used as the working fluid in the mechanical vapor recompression and the heat transfer fluids. Thermodynamic models are built to evaluate the energy efficiency of HTHPs. A case study was carried out on an industrial spray dryer integrated with a waste heat recuperator, where the HTHPs are used to recover precooled air with a dew point of 40℃ and supply heat for drying air at 200℃. For a high-temperature heat pump boosted with an electric air heater, a higher system-level COP is achieved with a high supply temperature from high-temperature heat pump. For a high-temperature heat pump with mechanical vapor recompressions, larger temperature drops in the flashing tank provide higher heat capacities but almost constant values of the coefficient of performance. For a transcritical high-temperature heat pump, an optimum discharge pressure exists for the temperature profiles within the gas cooler and the coefficient of performance. The transcritical high-temperature heat pump provides the best energy efficiency among the three configurations. The theoretical results prove the technical feasibility of high-temperature heat pumps in industrial air-drying applications. .

Wang, Pengtao↗

Accelerating Resonance Searches via Signature-Oriented Pre-training

The search for heavy resonances beyond the Standard Model (BSM) is a key objective at the LHC. While the recent use of advanced deep neural networks for boosted-jet tagging significantly enhances the sensitivity of dedicated searches, it is limited to specific final states, leaving vast potential BSM phase space underexplored. We introduce a novel experimental method, Signature-Oriented Pre-training for Heavy-resonance ObservatioN (Sophon), which leverages deep learning to cover an extensive number of boosted final states. Pre-trained on the comprehensive JetClass-II dataset, the Sophon model learns intricate jet signatures, ensuring the optimal constructions of various jet tagging discriminates and enabling high-performance transfer learning capabilities. We show that the method can not only push widespread model-specific searches to their sensitivity frontier, but also greatly improve model-agnostic approaches, accelerating LHC resonance searches in a broad sense.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Understanding the High Energy Higgs Sector with the CMS Experiment and Artificial Intelligence

This dissertation describes efforts towards understanding the Higgs boson at the highest energies humanly accessible, using the CMS experiment at the Large Hadron Collider and advances in artificial intelligence (AI) and machine learning (ML). We present searches for resonant and nonresonant Higgs-boson (H) pair production in the all-hadronic two beauty-quark and two vector boson (V) final state, using a novel strategy to measure the quartic HHVV coupling and search for new Higgs-like bosons. By targeting highly Lorentz-boosted Higgs pairs, we probe effects of potential new physics in the high energy Higgs sector, which could hold answers to fundamental mysteries of nature such as baryon asymmetry. To enable these and future searches, we introduce as well significant developments in AI/ML, including in the identification of boosted H$\rightarrow$VV decays with deep transformer networks and advances in AI-accelerated fast simulations of the CMS detector. The latter notably includes the development of the first, highly performant generative models for point-cloud data in high energy physics, which have the potential to improve CMS' computational efficiency by up to three orders of magnitude. We also highlight novel solutions to the important and challenging problems of calibrating and validating these ML techniques. Finally, we present new approaches to search for new physics in a model-agnostic manner, using physics-informed ML methods equivariant to Lorentz transformations. The quartic HHVV coupling is observed (expected) to be constrained to $[-0.04, 2.05]$ ($[0.05, 1.98]$) at the 95% confidence level relative to the standard model prediction, representing the second-most sensitive measurement of this coupling by CMS to date. Exclusion limits on the production cross section of new heavy resonances decaying to two Higgs-like bosons are expected to be as low as 0.3 fb for high resonance masses.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Accuracy of predictions made by machine learned models for biocrude yields obtained from hydrothermal liquefaction of organic wastes

Hydrothermal liquefaction (HTL) has potential for converting abundant wet organic wastes into renewable fuels. Because HTL consists of a complex reaction network, deterministic, physics-based prediction of its biocrude yield is prohibitively difficult. Data-driven methods provide an alternative to the physics-based approach; however, rigorous testing must be performed to ensure the accuracy of predictions made by data-driven methods. To this end, a data set was assembled consisting of 570 data points appearing in the open literature. The data set was divided into training, validation, and test sub-sets and used for evaluating different machine learning regression approaches to predict biocrude yield. Among the tested algorithms, Random Forest and eXtreme Gradient Boosting (XGBoost) predicted biocrude yields in a test set that had not been used for training with the greatest accuracy, with root mean square errors (RMSE) of 8.34 and 8.57, respectively. Further refinement of the Random Forest model reduced its RMSE to 8.07. In comparison, predictions of a series of literature models resulted in RMSE ranging from 9.16 in the most accurate case to 27.6 in the least accurate; most literature models yielded RMSE values > 10. Using biocrude yield predictions from the most accurate Random Forest model and a probabilistic economic analysis found that the model accuracy is sufficient to prioritize allocation of resources based on projected minimum fuel selling price. In our report the models and analysis represent a major advance in the ability to use readily available data to predict biocrude yields on new feedstocks that have not previously been studied.

42 ENGINEERING↗

Estimation of the Surface Fluxes for Heat and Momentum in Unstable Conditions with Machine Learning and Similarity Approaches for the LAFE Data Set

Abstract Measurements of three flux towers operated during the land atmosphere feedback experiment (LAFE) are used to investigate relationships between surface fluxes and variables of the land–atmosphere system. We study these relations by means of two machine learning (ML) techniques: multilayer perceptrons (MLP) and extreme gradient boosting (XGB). We compare their flux derivation performance with Monin–Obukhov similarity theory (MOST) and a similarity relationship using the bulk Richardson number (BRN). The ML approaches outperform MOST and BRN. Best agreement with the observations is achieved for the friction velocity. For the sensible heat flux and even more so for the latent heat flux, MOST and BRN deviate from the observations while MLP and XGB yield more accurate predictions. Using MOST and BRN for latent heat flux, the root mean square errors (RMSE) are 107 Wm $$^{-2}$$ - 2 and 121 Wm $$^{-2}$$ - 2 , respectively, as well as the intercepts of the regression lines are $$\approx 110$$ ≈ 110 Wm $$^{-2}$$ - 2 . For the ML methods, the RMSEs reduce to 31 Wm $$^{-2}$$ - 2 for MLP and 33 Wm $$^{-2}$$ - 2 for XGB as well as the intercepts to just 4 Wm $$^{-2}$$ - 2 for MLP and $$-1$$ - 1 Wm $$^{-2}$$ - 2 for XGB with slopes of the regression lines close to 1, respectively. These results indicate significant deficiencies of MOST and BRN, particularly for the derivation of the latent heat flux. In fact, in contrast to the established theories, feature importance weighting demonstrates that the ML methods base their improved derivations on net radiation, the incoming and outgoing shortwave radiations, the air temperature gradient, and the available water contents, but not on the water vapor gradient. The results imply that further studies of surface fluxes and other turbulent variables with ML techniques provide great promise for deriving advanced flux parameterizations and their implementation in land–atmosphere system models.

54 ENVIRONMENTAL SCIENCES↗

Modeling household online shopping demand in the U.S.: a machine learning approach and comparative investigation between 2009 and 2017

Despite the rapid growth of online shopping and research interest in the relationship between online and in-store shopping, national-level modeling and investigation of the demand for online shopping with a prediction focus remain limited in the literature. Here, this paper differs from prior work and leverages two recent releases of the U.S. National Household Travel Survey (NHTS) data for 2009 and 2017 to develop machine learning (ML) models, specifically gradient boosting machine (GBM), for predicting household-level online shopping purchases. The NHTS data allow for not only conducting nationwide investigation but also at the level of households, which is more appropriate than at the individual level given the connected consumption and shopping needs of members in a household. We follow a systematic procedure for model development including employing Recursive Feature Elimination algorithm to select input variables (features) in order to reduce the risk of model overfitting and increase model explainability. Among several ML models, GBM is found to yield the best prediction accuracy. Extensive post-modeling investigation is conducted in a comparative manner between 2009 and 2017, including quantifying the importance of each input variable in predicting online shopping demand, and characterizing value-dependent relationships between demand and the input variables. In doing so, two latest advances in machine learning techniques, namely Shapley value-based feature importance and Accumulated Local Effects plots, are adopted to overcome inherent drawbacks of the popular techniques in current ML modeling. The modeling and investigation are performed at the national level, with a number of findings obtained. The models developed and insights gained can be used for online shopping-related freight demand generation and may also be considered for evaluating the potential impact of relevant policies on online shopping demand.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Process Heat for Chemical Industry

Process heating with nuclear energy can reduce greenhouse gas emissions by reducing combustion of fossil fuels in fired heaters as steam boilers. Light water reactors can replace the majority of steam duties used by industry; however, high temperature processes such as steam methane reforming require advanced high temperature reactors. Here, guidance on matching the scale of nuclear reactors with specific industries is provided. Principles of heat transport, temperature boosting, and substitution for hot combustion gases are also discussed in this section.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evolution of dislocation loops in irradiated α-Uranium: An atomistically-informed cluster dynamics investigation

An atomistically-informed mean field cluster dynamics model has been developed to investigate the nucleation and growth of prismatic loops in irradiated a-Uranium. TEM analysis of neutron irradiated a-Uranium shows the evolution of self-interstitial atom and vacancy loops on (010) and (100) crystallographic planes, respectively, resulting in an anisotropic lattice swelling of its face-centered orthorhombic crystal. To provide model parameters, the crystallography of loops and the binding energy of point defects to these loops were studied using an angular dependent EAM potential and classical molecular dynamics (MD) simulations. Furthermore, using the bond-boost hyperdynamics method, the anisotropic diffusion of interstitials and vacancies in a-Uranium was investigated. Here, the mechanisms of point defect diffusion and the associated migration energies were reported and compared with previous DFT studies. The energetics and kinetic quantities mentioned above were used in the cluster dynamics model to predict the cluster density as a function of dose rate, dose and temperature and the results were compared to the reported neutron irradiation experiments. The model predictions reveal an accumulation of small sized vacancy loops along with a population of large and growing self-interstitial loops, which closely corresponds to the TEM observations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Search for a new heavy resonance decaying to a top quark and a neutral scalar boson in proton-proton collisions at $\sqrt{s}$ = 13 TeV

A first search at the LHC for a new heavy resonance decaying to a top quark and a neutral scalar boson ϕ in the fully hadronic final state is presented, where the ϕ boson is identified by its decay into a bottom quark-antiquark pair. The search is focused on final states in which the decay products of the highly Lorentz boosted top quark and ϕ boson are each reconstructed as a single, large-radius jet with distinct substructure. The analysis is performed using proton-proton collision data at a center-of-mass energy of 13 TeV, corresponding to an integrated luminosity of 138 fb −1 , recorded with the CMS detector at the LHC in 2016–2018. The single production of a vector-like top quark, T′, is used as a benchmark model for the signal process. The results of this search are combined with those of a previous CMS search in which semileptonic decays of the top quark were used. No significant excess of data is observed with respect to the background prediction. For the case where the neutral scalar is a standard model Higgs boson and the T′ quark width is 5% of its mass, T′ quark masses between 0.85 and 1.3 TeV are excluded at 95% confidence level and the most stringent limits to date are set for masses above 2 TeV . For other ϕ boson masses, upper limits as low as 0.1 fb are set on the product of the T′ quark production cross section and branching fraction for its decay to a top quark and a ϕ boson.

Boosted↗

Micro-structural features and material properties impact on adhesive metal joints via computational modeling and machine learning

The quality of structural bonding in practical applications depends on various factors arising from materials, pre-processing conditions, and manufacturing. Understanding how these factors influence bonding performance and determining their relative importance are of significant interest. Thus, this study evaluates the effects of microstructural features and material properties on the structural strength of adhesively-bonded metal joints at the submillimeter scale, utilizing a combination of Finite Element Modeling (FEM) and Machine Learning (ML) with Gradient Boosting Regression (GBR). The microstructural features include adhesive thickness, internal voids within the adhesive, adherend-adhesive interfacial voids, void size and volume fraction, and surface roughness. The material properties include the constitutive behavior of the adhesive, as well as the adherend-adhesive interfacial strength and fracture energy. The changes in structural strength and morphologies of the bonded metal structures with respect to different microstructural features and material properties were clarified by FEM. By further leveraging ML-GBR, the sequence of importance of these factors affecting bonding performance across various scenarios was summarized. This work provides valuable insights into the development of improved structural bonding for adhesive joints in industries such as automotive , aerospace, and beyond.

36 MATERIALS SCIENCE↗

Gaining Perspective on Unconventional Well Design Choices through Play-level Application of Machine Learning Modeling

The recent development of unconventional oil and gas (O&G) reservoirs has led to an abundant hydrocarbon supply, both domestically and globally. However, there is a continued push to develop new and innovative approaches to improve exploration and extraction efficiencies and overall well productivity moving forward. Substantial improvements in unconventional O&G development are expected through optimized well completion and stimulation strategies aimed at maximizing well productivity. Optimizing well designs will require tailoring to the distinctive geologic conditions present for any newly placed well. To better evaluate the impact of well design attributes and their associated interactions on productivity in a major unconventional play, multivariate machine learning-based models that use empirical datasets were developed. A gradient boosted regression tree (GBRT) algorithm was applied. GBRT has been narrowly investigated for O&G applications but enables straightforward parametric importance and influence evaluation, as well as assessment of parameter interaction effects. Models were trained on well design and locational parameters that serve as a proxy for variable geologic conditions to estimate two types of productivity indicator response variables strongly correlated to estimated ultimate recovery (EUR). The dataset utilized consists of over 7,000 well observations that cover the majority of the productive region of the Marcellus Shale. Model performance was evaluated and algorithm parameters tuned by analyzing the goodness-of-fit for simulated results against observed data in a cross-validation approach. Models were found capable of 73–79 percent prediction accuracy on held out testing data of gas equivalent production and can be used to inform future well design and placement decisions for increasing EUR per well and improving overall field-level recovery. Study results indicate that Marcellus well performance improves most with upscaling perforated interval lengths and water and proppant volumes per foot; but relative productivity improvements are spatially dependent across the play. Finally, optimal combinations of water and proppant on well performance were found to vary depending on well location, emphasizing the utility of data-driven models capable of broad application across a play of interest for informing tailored well design approaches prior to their field deployment.

04 OIL SHALES AND TAR SANDS↗

Methane Emissions from Gathering Compressor Stations in the U.S.

Using results from a nationally representative measurement campaign at 180 gathering compressor stations conducted with nine industry partners, this study estimated emissions for the U.S. gathering sector, where sector-specific emission factors have not been previously available. The study drew from a partner station population of 1705 stations—a significantly larger pool than was available for prior studies. Data indicated that whole gas emission rates from components on gathering stations were comparable to or higher than emission factors utilized by the EPA’s greenhouse gas reporting program (GHGRP) but less than emission factors used for similar components on transmission compressor stations. Field data also indicated that the national population of stations likely has a higher fraction of smaller stations, operating at lower throughput per station, than the data used to develop the per-station emission factor used in EPA’s greenhouse gas inventory (GHGI). This was the first national study to incorporate extensive activity data reported to the GHGRP, including 319 basin-level reports, covering 15,895 reported compressors. Further, combining study emission data with 2017 GHGRP activity data, the study indicated statistically lower national emissions of 1290 [1246–1342] Gg methane per year or 66% [64–69%] of current GHGI estimates, despite estimating 17% [12–22%] more stations than the 2017 GHGI (95% confidence interval). Finally, we propose a replicable method that uses GHGRP activity data to annually update GHGI gathering and boost sector emissions.

03 NATURAL GAS↗