Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “factorization machine”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Design Considerations of a Transverse Flux Machine for Direct-Drive Wind Turbine Applications

This paper presents the design considerations of a double-sided transverse flux machine (TFM) for direct-drive wind turbine applications. The proposed TFM has a modular structure with quasi-U stator cores and toroidal ring windings. The rotor is constructed with ferrite magnets in a flux-concentrating setup to achieve high air gap flux density. Pole number selection is critical in the design process of a TFM as it affects both the torque density and power factor under fixed magnetic and changing electrical loading. Several key design ratios are introduced to facilitate the initial design procedure. The effect of pole shaping on back-EMF and inductance is also analyzed. These investigations provide guidance toward the required design of a TFM for direct-drive applications. The analyses are carried out using analytical and three-dimensional finite element analysis (FEA). A proof-of-concept prototype was developed to experimentally validate the FEA results.

17 WIND ENERGY↗

Extracting the gamma-ray source-count distribution below the Fermi-LAT detection limit with deep learning

We reconstruct the extra-galactic gamma-ray source-count distribution, or dN/dS, of resolved and unresolved sources by adopting machine learning techniques. Specifically, we train a convolutional neural network on synthetic 2-dimensional sky-maps, which are built by varying parameters of underlying source-counts models and incorporate the Fermi-LAT instrumental response functions. The trained neural network is then applied to the Fermi-LAT data, from which we estimate the source count distribution down to flux levels a factor of 50 below the Fermi-LAT threshold. We perform our analysis using 14 years of data collected in the (1,10) GeV energy range. The results we obtain show a source count distribution which, in the resolved regime, is in excellent agreement with the one derived from cataloged sources, and then extends as dN/dS ~ S -2 in the unresolved regime, down to fluxes of 5 · 10 -12 cm -2 s -1 . The neural network architecture and the devised methodology have the flexibility to enable future analyses to study the energy dependence of the source-count distribution.

79 ASTRONOMY AND ASTROPHYSICS↗

Physics-Informed Machine-Learning Prediction of Curie Temperatures and Its Promise for Guiding the Discovery of Functional Magnetic Materials

High-performance permanent magnets with a high Curie temperature, containing less critical materials, are integral to zero-carbon energy solutions. We built a machine-learning model trained over available experimentally measured Curie temperature values to predict the T C of multicomponent magnetic materials. We chose two compositions from a pseudo-binary (Zr 1–x Ce x )Fe 2 system, namely, (Zr 0.16 Ce 0.84 )Fe 2 and (Zr 0.94 Ce 0.06 )Fe 2 , to experimentally validate the ability of our model to predict the Curie temperature of novel compounds. We also provided a detailed discussion on the correlation of the Curie temperature with the de Gennes scaling factor in rare-earth intermetallic compounds and its breakdown below a certain rare-earth content. The electronic structure calculations (density of states and Fermi surface) were performed using the density functional theory on selected compounds (Zr 0.16 Ce 0.84 )Fe 2 and (Zr 0.94 Ce 0.06 )Fe 2 to understand the electronic origin of a strong magnetic exchange. We found that the change in the electronic density of states and electron/hole fillings at the Fermi level directly correlate with the Curie temperature. Notably, our model was able to capture these key electronic structure trends, which show that physics-informed machine learning can play a crucial role in designing new high-performance magnets with improved properties for environmentally sustainable applications.

36 MATERIALS SCIENCE↗

Metal Amorphous Nanocomposite Soft Magnetic Material-Enabled High Power Density, Rare Earth Free Rotational Machines [Metal Amorphous Nanocomposite (MANC) Soft Magnetic Material (SMM) Enabled High Power Density, Rare Earth Free Rotational Machines]

Metal amorphous nanocomposites (MANCs) are promising soft magnetic materials (SMMs) for power electronic applications offering low power loss at high frequency and maintaining a relatively high flux density. While applications in certain motor designs have been recently modeled, their widespread application awaits scaled manufacturing of MANC materials and proliferation of new higher speed motor designs. A hybrid motor design based on permanent magnets and doubly salient stator and rotor is reported here to develop a compact (a factor of 10 smaller than currently possible in Si steels), high-speed (>1 kHz, electrical), high-power (>2.5 kW) motor by incorporating low loss (<10 W/kg at 1 kHz) MANCs such as recently reported Fe-Ni-based alloys. A feature of this motor design is flux focusing from the permanent magnet allowing use of lower energy permanent magnet chosen from among non-rare earth containing compositions and attractive due to constraints posed by rare earth criticality. A 2-D finite element analysis model reported here indicates that a 2.5 kW hybrid motor may be built with a permanent magnet with a 0.4 T remanence at a rotor speed of 6000 rpm. At a magnetic switching frequency of 1.4 kHz, the core loss may be limited to <3 W by selecting an appropriate MANC SMM. The projected efficiency exceeds 96% not including power loss in the controller. Under full load conditions, the flux density distributions for the SMM stay predominantly <1.3 T, the saturation magnetization of optimized FeNi-based MANC alloys. As a result, the maximum demagnetizing field in the permanent magnet is less than 2.2 × 10 5 A/m sustainable, for example, with a high-grade hard ferrite magnet.

42 ENGINEERING↗

Incorporating Physical Priors into Weakly Supervised Anomaly Detection

We propose a new machine-learning-based anomaly detection strategy for comparing data with a background-only reference (a form of weak supervision). The sensitivity of previous strategies degrades significantly when the signal is too rare or there are many unhelpful features. Our prior-assisted weak supervision (PAWS) method incorporates information from a class of signal models to significantly enhance the search sensitivity of weakly supervised approaches. As long as the true signal is in the prespecified class, PAWS matches the sensitivity of a dedicated, fully supervised method without specifying the exact parameters ahead of time. On the benchmark LHC Olympics anomaly detection dataset, our mix of semisupervised and weakly supervised learning is able to extend the sensitivity over previous methods by a factor of 10 in cross section. Furthermore, if we add irrelevant (noise) dimensions to the inputs, classical methods degrade by another factor of 10 in cross section while PAWS remains insensitive to noise. This new approach could be applied in a number of scenarios and pushes the frontier of sensitivity between completely model-agnostic approaches and fully model-specific searches.

artificial neural networks↗

Ab Initio Modeling of Aqueous Methanol Mixtures at DFT-SCAN Level Using Machine Learning Interatomic Potentials

Abstract Methanol–water mixtures find use in many applications, particularly catalytic energy conversion processes. Their importance has motivated numerous computational studies, most of which employed molecular dynamics based on classical force fields. These enable simulations of large systems on long time scales but do not reliably describe reactive dynamics involving bond breaking and bond formation. In contrast, ab initio molecular dynamics (AIMD) based on density functional theory (DFT) is generally more reliable for such applications but has a high computational cost, which discourages systematic studies of alcohol-water mixtures. To remedy this, we trained a machine learning interatomic potential capable of probing the properties of aqueous methanol mixtures at the DFT level using the SCAN functional. Our results show that SCAN qualitatively reproduces multiple key experimental features arising from the amphiphilic nature of methanol, including density, diffusion coefficients, X-ray structure factors, and Kirkwood–Buff integrals. We also find that structural correlations between water molecules are somewhat overestimated, leading to a stronger preferential association than that predicted by experiments. However, increasing the temperature by 30 K mitigates this effect and also recovers the correct mobilities of both methanol and water. These results indicate that SCAN provides an accurate description of methanol–water mixtures, making it a reliable choice for investigating the reactive dynamics in such systems.

Park, Sanghyun J. [Princeton University , , , ,]↗

Simple descriptor derived from symbolic regression accelerating the discovery of new perovskite catalysts

Symbolic regression (SR) is an approach of interpretable machine learning for building mathematical formulas that best fit certain datasets. In this work, SR is used to guide the design of new oxide perovskite catalysts with improved oxygen evolution reaction (OER) activities. A simple descriptor, μ/t, where μ and t are the octahedral and tolerance factors, respectively, is identified, which accelerates the discovery of a series of new oxide perovskite catalysts with improved OER activity. We successfully synthesise five new oxide perovskites and characterise their OER activities. Remarkably, four of them, Cs 0.4 La 0.6 Mn 0.25 Co 0.75 O 3 , Cs 0.3 La 0.7 NiO 3 , SrNi 0.75 Co 0.25 O 3 , and Sr 0.25 Ba 0.75 NiO 3 , are among the oxide perovskite catalysts with the highest intrinsic activities. Our results demonstrate the potential of SR for accelerating the data-driven design and discovery of new materials with improved properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Decomposition of high-rank factorized unitary coupled-cluster operators using ancilla and multiqubit controlled low-rank counterparts

The factorized form of the unitary coupled-cluster (UCC) approximation is one of the most promising methodologies to prepare trial states for strongly correlated systems within the variational quantum eigensolver framework. The factorized form of the UCC Ansatz can be systematically applied to a reference state to generate the desired entanglement. The difficulty associated with such an approach is the requirement of simultaneously entangling a growing number of qubits, which quickly exceeds the hardware limitations of today's quantum machines. In particular, while circuits for singles and double excitations can be performed on current hardware, higher-rank excitations require too many gate operations. In this work, we propose a set of schemes that trade off using extra qubits for a reduced gate depth to decompose high-rank UCC excitation operators into significantly lower depth circuits. These results will remain useful even when fault-tolerant machines are available to reduce the overall state-preparation circuit depth.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Partitioning and Communication Strategies for Sparse Non-negative Matrix Factorization

Non-negative matrix factorization (NMF), the problem of finding two non-negative low-rank factors whose product approximates an input matrix, is a useful tool for many data mining and scientific applications such as topic modeling in text mining and unmixing in microscopy. In this paper, we focus on scaling algorithms for NMF to very large sparse datasets and massively parallel machines by employing effective algorithms, communication patterns, and partitioning schemes that leverage the sparsity of the input matrix. We consider two previous works developed for related problems, one that uses a fine-grained partitioning strategy using a point-to-point communication pattern and one that uses a Cartesian, or checkerboard, partitioning strategy using a collective-based communication pattern. We show that a combination of the previous approaches balances the demands of the various computations within NMF algorithms and achieves high efficiency and scalability. From the experiments, we see that our proposed strategy runs up to 10x faster than the state of the art on real-world datasets.

Kaya, Oguz↗

Development of 80- and 100- Mile Work Day Cycles Representative of Commercial Pickup and Delivery Operation

When developing and designing new technology for integrated vehicle systems deployment, standard cycles have long existed for chassis dynamometer testing and tuning of the powertrain. However, to this day with recent developments and advancements in plug-in hybrid and battery electric vehicle technology, no true 'work day' cycles exist with which to tune and measure energy storage control and thermal management systems. To address these issues and in support of development of a range-extended pickup and delivery Class 6 commercial vehicle, researchers at the National Renewable Energy Laboratory in collaboration with Cummins analyzed 78,000 days of operational data captured from more than 260 vehicles operating across the United States to characterize the typical daily performance requirements associated with Class 6 commercial pickup and delivery operation. In total, over 2.5 million miles of real-world vehicle operation were condensed into a pair of duty cycles, an 80-mile cycle and a 100-mile cycle representative of the daily operation of U.S. class 3-6 commercial pickup and delivery trucks. Using novel machine learning clustering methods combined with mileage-based weighting, these composite representative cycles correspond to 90th and 95th percentiles for daily vehicle miles traveled by the vehicles observed. In addition to including vehicle speed vs time drive cycles, in an effort to better represent the environmental factors encountered by pickup and delivery vehicles operating across the United States, a nationally representative grade profile and key status information were also appended to the speed vs. time profiles to produce a 'work day' cycle that captures the effects of vehicle dynamics, geography, and driver behavior which can be used for future design, development, and validation of technology.

100 mile↗

Carbon Capture through Membranes - Leveraging Multiphysics Modeling, Dimensional Analysis and Machine Learning to Scale up and Optimize Devices and Processes for Decarbonization

We study the separation performance using membrane modules through dimensional analysis (DA). We formulate the main process equations to identify relevant dimensionless numbers inherent in the physics. In particular, we identify that the critical step in the separation process is mass transfer through the selective layer. Remarkably, the dimensionless feed flow (DFfeed) emerges as a crucial factor in describing this process. Not only does DFfeed directly appear in the governing equations, but it also holds a physical significance associated with the time scales for the mass transfer across the feed side and through the selective layer. Regarding the output performance variables, we consider the recovery, stage cut, productivity and purity. In this context, we profit from experimental data and CFD simulations to evaluate the separation performance of the modules when varying the input flowrate, the scale of the module, and the CO2 permeance. These datasets enable us to establish correlations between performance metrics and the dimensionless feed flow (DFfeed). Using simple power functions of DFfeed, we obtain R2 coefficients exceeding 0.99, indicating the accuracy of the correlations built in the present work. In the future, we wish to use DA to understand key transport mechanisms, predict and control module performance, and challenge the universality of these findings by testing various gas separations across different membrane modules beyond our case study.

Pedrozo, Hector A.↗

Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations

One of the most promising applications of machine learning in computational physics is to accelerate the solution of partial differential equations (PDEs). The key objective of machine-learning-based PDE solvers is to output a sufficiently accurate solution faster than standard numerical methods, which are used as a baseline comparison. Here, we first perform a systematic review of the ML-for-PDE-solving literature. Out of all of the articles that report using ML to solve a fluid-related PDE and claim to outperform a standard numerical method, we determine that 79% (60/76) make a comparison with a weak baseline. Second, we find evidence that reporting biases are widespread, especially outcome reporting and publication biases. We conclude that ML-for-PDE-solving research is overoptimistic: weak baselines lead to overly positive results, while reporting biases lead to under-reporting of negative results. To a large extent, these issues seem to be caused by factors similar to those of past reproducibility crises: researcher degrees of freedom and a bias towards positive results. We call for bottom-up cultural changes to minimize biased reporting as well as top-down structural reforms to reduce perverse incentives for doing so.

97 MATHEMATICS AND COMPUTING↗

Quantifying Drivers of Methane Hydrobiogeochemistry in a Tidal River Floodplain System

The influence of coastal ecosystems on global greenhouse gas (GHG) budgets and their response to increasing inundation and salinization remains poorly constrained. In this study, we have integrated an uncertainty quantification (UQ) and ensemble machine learning (ML) framework to identify and rank the most influential processes, properties, and conditions controlling methane behavior in a freshwater floodplain responding to recently restored seawater inundation. Our unique multivariate, multiyear, and multi-site dataset comprises tidal creek and floodplain porewater observations encompassing water level, salinity, pH, temperature, dissolved oxygen (DO), dissolved organic carbon (DOC), total dissolved nitrogen (TDN), partial pressure of carbon dioxide (pCO 2 ), nitrous oxide (pN 2 O), methane (pCH 4 ), and the stable isotopic composition of methane (δ 13 CH 4 ). Additionally, we incorporated topographical data, soil porosity, hydraulic conductivity, and water retention parameters for UQ analysis using a previously developed 3D variably saturated flow and transport floodplain model for a physical mechanistic understanding of factors influencing groundwater levels and salinity and, therefore, CH 4 . Principal component analysis revealed that groundwater level and salinity are the most significant predictors of overall biogeochemical variability. The ensemble ML models and UQ analyses identified DO, water level, salinity, and temperature as the most influential factors for porewater methane levels and indicated that approximately 80% of the total variability in hourly water levels and around 60% of the total variability in hourly salinity can be explained by permeability, creek water level, and two van Genuchten water retention function parameters: the air-entry suction parameter α and the pore size distribution parameter m. These findings provide insights on the physicochemical factors in methane behavior in coastal ecosystems and their representation in local- to global-scale Earth system models.

54 ENVIRONMENTAL SCIENCES↗

Learning to concentrate: multi-tracer forecasts on local primordial non-Gaussianity with machine-learned bias

Local primordial non-Gaussianity (LPNG) is predicted by many non-minimal models of inflation, and creates a scale-dependent contribution to the power spectrum of large-scale structure (LSS) tracers, whose amplitude is characterized by b Φ . Knowledge of b Φ for the observed tracer population is therefore crucial for learning about inflation from LSS. Recently, it has been shown that the relationship between linear bias b 1 and b Φ for simulated halos exhibits significant secondary dependence on halo concentration. We leverage this fact to forecast multi-tracer constraints on ${f}^{loc}_{NL}$. We train a machine learning model on observable properties of simulated IllustrisTNG galaxies to predict b Φ for samples constructed to approximate DESI emission line galaxies (ELGs) and luminous red galaxies (LRGs). We find σ(${f}^{loc}_{NL}$) = 2.3, and σ(${f}^{loc}_{NL}$) = 3.7, respectively. These forecasted errors are roughly factors of 3, and 35% improvements over the single-tracer case for each sample, respectively. When considering both ELGs and LRGs in their overlap region, we forecast σ(${f}^{loc}_{NL}$) = 1.5 is attainable with our learned model, more than a factor of 3 improvement over the single-tracer case, while the ideal split by b Φ could reach σ(${f}^{loc}_{NL}$) < 1. In conclusion, we also perform multi-tracer forecasts for upcoming spectroscopic surveys targeting LPNG (MegaMapper, SPHEREx) and show that splitting tracer samples by b Φ can lead to an order-of-magnitude reduction in projected σ(${f}^{loc}_{NL}$) for these surveys.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Shock equation of state of LiH 6 to 1.1 TPa

Using laser-generated shock waves, we have measured pressure, density, and temperature of LiH on the principal Hugoniot between 260 and 1100 GPa (2.6–11 Mbar) and on a second-shock Hugoniot up to 1400 GPa to near fivefold compression, extending the maximum pressure reached in non-nuclear experiments by a factor of two. Here, we observe the onset of metal-like reflectivity consistent with temperature-induced ionization of the Li 2s electron, and no sign of additional changes in ionization up to the maximum pressure. Our measurements are in good agreement with gas gun, Z-machine, and underground test data and are accurately described by quantum molecular dynamics simulations. The results confirm the validity of equation of state models built on an average-atom description of the electron-thermal contribution to the free energy and a density-dependent Grüneisen parameter to describe shock response of LiH over this pressure range.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

tell: a Python package to model future total electricity loads in the United States

The purpose of the Total ELectricity Load (tell) model is to generate 21st century profiles of hourly electricity load (demand) across the Conterminous United States (CONUS). tell loads reflect the impact of climate and socioeconomic change at a spatial and temporal resolution adequate for input to an electricity grid operations model. tell uses machine learning to develop profiles that are driven by projections of climate/meteorology and population. tell also harmonizes its results with United States (U.S.) state-level, annual projections from a national- to global-scale energy-economy model. This model accounts for a wide range of other factors affecting electricity demand, including technology change in the building sector, energy prices, and demand elasticities, which stems from model coupling with the U.S. version of the Global Change Analysis Model (GCAM-USA). tell was developed as part of the Integrated Multisector Multiscale Modeling (IM3) project. IM3 explores the vulnerability and resilience of interacting energy, water, land, and urban systems in response to compound stressors, such as climate trends, extreme events, population, urbanization, energy system transitions, and technology change

24 POWER TRANSMISSION AND DISTRIBUTION↗

Statistically-driven Experimental Design to Improve Reference-free Quantification of Small Molecules by Liquid Chromatography-Mass Spectrometry

Non-targeted analysis of small molecules and metabolites in unknown, complex samples using liquid chromatography-tandem mass spectrometry remains challenging. One of the main bottlenecks is the extensive unannotated regions of metabolomics mass spectrometry data, resulting in knowledge gaps. Small molecule annotation in mass spectrometry data has conventionally relied on reference standards and libraries for compound identification and confirmation, which can constrain compound identification to those molecules already known, thus limiting the ability to discover new knowledge and new markers. Retention time prediction can facilitate and expedite unknown compound identification in non-targeted analysis of complex metabolomics samples. Additionally, accurate retention time predictions can also inform sample mixture design for LC-MS/MS analyses. However, current machine learning-based methods for retention time prediction are typically developed for specific chromatographic platforms and are not generalizable across scales. And while technologies and methods to improve reference-free metabolite identification for more comprehensive annotation of unknowns has received much attention, development of the same for quantitation without reference standards has been much more limited, despite its importance in toxicological, environmental, food safety, forensics, and clinical applications. We believe that a reference-free quantitation strategy that exploits mass spectrometry data already collected for reference-free identification can provide much more insight on unknowns, and move the metabolomics field for more complete unknowns characterization. As such, we pursue two efforts to improve upon current state-of-the-art methods in non-targeted analysis: (1) machine learning-based retention time prediction and (2) statistical design of experiments framework for reference-free quantitation. In this work, we develop and demonstrate (1) a generalizable retention time prediction capability across chromatographic conditions and scales, and (2) a statistical design-based framework for response factor contribution elucidation and reference-free quantitation. Evaluation of our retention time prediction model, PrediToR, showed approximately 24% improvement over current models, and we observed approximately 10X improvement in concentration estimation accuracy from our statistical design-based response factor model over a primarily ionization efficiency-based model. We expect that future efforts to improve upon these new capabilities will further advance non-targeted analysis of small molecules towards truly reference-free metabolomics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Subsurface Characterization and Machine Learning Predictions at Brady Hot Springs Results

Geothermal power plants typically show decreasing heat and power production rates over time. Mitigation strategies include optimizing the management of existing wells - increasing or decreasing the fluid flow rates across the wells - and drilling new wells at appropriate locations. The latter is expensive, time-consuming, and subject to many engineering constraints, but the former is a viable mechanism for periodic adjustment of the available fluid allocations. Data and supporting literature from a study describing a new approach combining reservoir modeling and machine learning to produce models that enable strategies for the mitigation of decreased heat and power production rates over time for geothermal power plants. The computational approach used enables translation of sets of potential flow rates for the active wells into reservoir-wide estimates of produced energy and discovery of optimal flow allocations among the studied sets. In our computational experiments, we utilize collections of simulations for a specific reservoir (which capture subsurface characterization and realize history matching) along with machine learning models that predict temperature and pressure timeseries for production wells. We evaluate this approach using an "open-source" reservoir we have constructed that captures many of the characteristics of Brady Hot Springs, a commercially operational geothermal field in Nevada, USA. Selected results from a reservoir model of Brady Hot Springs itself are presented to show successful application to an existing system. In both cases, energy predictions prove to be highly accurate: all observed prediction errors do not exceed 3.68% for temperatures and 4.75% for pressures. In a cumulative energy estimation, we observe prediction errors that are less than 4.04%. A typical reservoir simulation for Brady Hot Springs completes in approximately 4 hours, whereas our machine learning models yield accurate 20-year predictions for temperatures, pressures, and produced energy in 0.9 seconds. This paper aims to demonstrate how the models and techniques from our study can be applied to achieve rapid exploration of controlled parameters and optimization of other geothermal reservoirs. Includes a synthetic, yet realistic, model of a geothermal reservoir, referred to as open-source reservoir (OSR). OSR is a 10-well (4 injection wells and 6 production wells) system that resembles Brady Hot Springs (a commercially operational geothermal field in Nevada, USA) at a high level but has a number of sufficiently modified characteristics (which renders any possible similarity between specific characteristics like temperatures and pressures as purely random). We study OSR through CMG simulations with a wide range of flow allocation scenarios. Includes a dataset with 101 simulated scenarios that cover the period of time between 2020 and 2040 and a link to the published paper about this project, where we focus on the Machine Learning work for predicting OSR's energy production based on the simulation data, as well as a link to the GitHub repository where we have published the code we have developed (please refer to the repository's readme file to see instructions on how to run the code). Additional links are included to associated work led by the USGS to identify geologic factors associated with well productivity in geothermal fields. Below are the high-level steps for applying the same modeling + ML process to other geothermal reservoirs: 1. Develop a geologic model of the geothermal field. The location of faults, upflow zones, aquifers, etc. need to be accounted for as accurately as possible 2. The geologic model needs to be converted to a reservoir model that can be used in a reservoir simulator, such as, for instance, CMG STARS, TETRAD, or FALCON 3. Using native state modeling, the initial temperature and pressure distributions are evaluated, and they become the initial conditions for dynamic reservoir simulations 4....

15 GEOTHERMAL ENERGY↗