Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “statistical physics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Efficient computation of N -point correlation functions in D dimensions

We present efficient algorithms for computing the N-point correlation functions (NPCFs) of random fields in arbitrary D-dimensional homogeneous and isotropic spaces. Such statistics appear throughout the physical sciences and provide a natural tool to describe stochastic processes. Typically, algorithms for computing the NPCF components have $\mathscr O$(n N ) complexity (for a dataset containing n particles); their application is thus computationally infeasible unless N is small. By projecting the statistic onto a suitably defined angular basis, we show that the estimators can be written in a separable form, with complexity $\mathscr O$(n 2 ) or $\mathscr O$(n g log n g ) if evaluated using a Fast Fourier Transform on a grid of size n g . Our decomposition is built upon the D-dimensional hyperspherical harmonics; these form a complete basis on the (D – 1) sphere and are intrinsically related to angular momentum operators. Concatenation of (N – 1) such harmonics gives states of definite combined angular momentum, forming a natural separable basis for the NPCF. As N and D grow, the number of basis components quickly becomes large, providing a practical limitation to this (and all other) approaches: However, the dimensionality is greatly reduced in the presence of symmetries; for example, isotropic correlation functions require only states of zero combined angular momentum. We provide a Julia package implementing our estimators and show how they can be applied to a variety of scenarios within cosmology and fluid dynamics. The efficiency of such estimators will allow higher-order correlators to become a standard tool in the analysis of random fields.

97 MATHEMATICS AND COMPUTING↗

Hierarchical, rotation‐equivariant neural networks to select structural models of protein complexes

Abstract Predicting the structure of multi‐protein complexes is a grand challenge in biochemistry, with major implications for basic science and drug discovery. Computational structure prediction methods generally leverage predefined structural features to distinguish accurate structural models from less accurate ones. This raises the question of whether it is possible to learn characteristics of accurate models directly from atomic coordinates of protein complexes, with no prior assumptions. Here we introduce a machine learning method that learns directly from the 3D positions of all atoms to identify accurate models of protein complexes, without using any precomputed physics‐inspired or statistical terms. Our neural network architecture combines multiple ingredients that together enable end‐to‐end learning from molecular structures containing tens of thousands of atoms: a point‐based representation of atoms, equivariance with respect to rotation and translation, local convolutions, and hierarchical subsampling operations. When used in combination with previously developed scoring functions, our network substantially improves the identification of accurate structural models among a large set of possible models. Our network can also be used to predict the accuracy of a given structural model in absolute terms. The architecture we present is readily applicable to other tasks involving learning on 3D structures of large atomic systems.

Eismann, Stephan↗

Virtual refrigerant charge sensing algorithm for residential CO₂ heat pumps

Natural refrigerants are increasingly adopted in next-generation heat pump systems, among which CO₂ heat pumps have attracted significant attention. However, due to their high operating pressures, the leakage risk is higher, resulting in undercharge conditions and degraded heat pump performance. Thus, developing an accurate refrigerant charge level detection technique is necessary to guarantee safe and efficient operation. Although virtual refrigerant charge (VRC) level calculation algorithms for CO₂ heat pumps exist, they typically rely on empirically selected features without a systematic selection framework, leading to multicollinearity and potential overfitting, which limit their prediction accuracy and generalizability. To address these issues, this study proposes a VRC algorithm framework with a systematic feature selection method that identifies physically meaningful and statistically significant features, and is applied using a residential CO₂ heat pump as a case study. The method is extended from previous work on conventional refrigerants to account for charge behavior in CO₂ gas coolers. The selected features include gas cooler outlet density, evaporator pressure, and superheat temperature. The results demonstrate that the proposed feature selection method significantly improves prediction accuracy compared to existing VRC approaches. A relatively small training dataset (∼30 samples) is sufficient for feature identification and model development. The developed algorithm achieves less than 3% prediction error under both undercharge and overcharge conditions, representing reductions of 46.7% and 35.3% compared to two recent reference VRC algorithms for transcritical CO₂ heat pumps reported in the literature. The proposed algorithm and feature selection method enhance leakage detection capability, facilitate the deployment of CO₂ heat pump systems, and contribute to reduced energy waste and maintenance costs.

Guo, Fangzhou [Lawrence Berkeley National Laborato↗

A better way to define dark matter haloes

ABSTRACT Dark matter haloes have long been recognized as one of the fundamental building blocks of large-scale structure formation models. Despite their importance – or perhaps because of it! – halo definitions continue to evolve towards more physically motivated criteria. Here, we propose a new definition that is physically motivated, effectively unique, and parameter-free: ‘A dark matter halo is comprised of the collection of particles orbiting in their own self-generated potential’. This definition is enabled by the fact that, even with as few as ≈300 particles per halo, nearly every particle in the vicinity of a halo can be uniquely classified as either orbiting or infalling based on its dynamical history. For brevity, we refer to haloes selected in this way as physical haloes. We demonstrate that (1) the mass function of physical haloes is Press–Schechter, provided the critical threshold for collapse is allowed to vary slowly with peak height; and (2) the peak-background split prediction of the clustering amplitude of physical haloes is statistically consistent with the simulation data, with accuracy no worse than ≈5 per cent.

Astronomy & Astrophysics↗

Toward Robust and Routine Determination of Mw for Small Earthquakes: Application to the 2020 Mw 5.7 Magna, Utah, Seismic Sequence

To better characterize seismic hazard, particularly, for induced seismicity, there is an increasing interest in methods to estimate moment magnitude (M w ) for small earthquakes. M w is generally preferred over other magnitude types, but, it is difficult to estimate M w for earthquakes with local magnitude (M L ) <3-3.5, using conventional moment tensor (MT) inversion. The 2020 M ww 5.7 Magna, Utah, seismic sequence provides an opportunity to illustrate and evaluate the value of spectral methods for this purpose. Starting with a high-quality seismic catalog of 2103 earthquakes (M L <5.6), we estimate M w using two independent spectral methods—one based on direct waves, yielding M w,direct , and the other based on coda waves, yielding M w,coda . For the direct-wave method, we present a non-parametric (NP) inversion scheme that solves for apparent geometrical spreading, G(R), and site effects (S), similar to other NP procedures that have been used to calibrate regional M L scales. The NP inversion is constrained using M ws derived from MTs for nine events in the Magna sequence. We recover statistically robust and physically reasonable G(R) and S and compute M w,direct for 635 Magna earthquakes down to M L 0.7. For the coda-wave method, we consider two separate calibration schemes involving previous MT solutions and compute M w,coda for 311 earthquakes down to M L 1.0. For 280 of the events that were processed with both methods—M w,direct and M w,coda —are strongly correlated (r = 0.98), with a mean difference of only 0.05. We compare M w,direct and M w,coda with M L and find reasonably good agreement for M L <3.6 with the theoretically predicted relationship of M w =(2/3)M L +C, in which C is a regional constant. Our results imply that seismic network operators can use spectral-based M w estimates to replace M L estimates for events with M L ≥1.0, and possibly smaller. The main requirement is the existence of a small number of MT solutions for calibration purposes.

58 GEOSCIENCES↗

Phasor-Measurement-Unit-Based Data Analytics Using Digital Twin and PhasorAnalytics Software

A major objective of this project was to apply GE’s commercial machine learning and data analytics toolsets to large-scale, real-world, anonymized Phasor Measurement Unit (PMU) datasets in order to extract signatures, correlated and/or causal factors, and precursor patterns associated with significant power system phenomena. The project had a particular emphasis on extraction of insights relevant to asset health monitoring, real-time load modeling and cybersecurity monitoring. Additionally, the team was directed to undertake a comprehensive data quality analysis for the provided datasets and encouraged to estimate the ‘machine-learning readiness’ of the datasets by documenting any major obstacles to the application of commercial machine learning algorithms. To accomplish the aforementioned objectives, the project team’s work centered around the identification of key event signatures and application of the identified event signatures for event detection and event classification. The industry-validated, semi-supervised machine learning strategy employed for event signature identification involved several major tasks, including data-preprocessing, generation of an overabundance of features, normal data identification, normality modeling, and event signature identification through a methodical, quantitative ranking of features in order of relevance to each studied event type. Throughout the project, data quality issues and mitigation techniques were investigated. In this report, insights are provided regarding the readiness of the provided synchrophasor datasets for application of machine learning and data analytics. The methodologies employed for this technical strategy are summarized in this report. With regards to data preprocessing and feature generation, the provided Training and Test Datasets were ingested into GE’s big data environment. Subsequently, the team applied bad data cleansing and data imputation scripts, event detection scripts, and application programming interfaces (APIs) to the datasets for convenient data access. The project team completed development and validation of dozens of physics-based, statistics-based and transformation-based feature functions used for the extraction of over 60 synchrophasor features. Using a new parallel feature generation technology developed on this project, over 60 features have been rapidly generated for the full two years’ worth of Training and Test Dataset data associated with both the Eastern and Western interconnects. Even accommodating for temporal down-sampling inherent to the feature extraction procedure, this parallel feature generation activity resulted in a massive feature set with a storage requirement approximately equal to that of the raw training dataset itself. With regards to normal data identification and normality modeling, a normality model was built using the feature data extracted from the Training Dataset and iteratively refined subsequent to incremental adjustments and expansions of the Training Dataset feature data. With respect to event characterization and signature identification, an event signature identification pipeline was developed and used in conjunction with the normality model to identify over 15 event signatures for key event categories within the Training Dataset. The identified event signatures were used to characterize hundreds of key events in terms of relative severity, duration, and location of the event. An investigation was undertaken to identify correlated and causal factors involved in transformer events. A separate investigation into temporal trends in ring-down analysis results was undertaken to determine possible associations between system dynamics and various other factors such as loading, season or year. To validate the identified event signatures, additional work was undertaken to develop signature-based anomaly detection and classification tools suitable for convenient application to the synchrophasor datasets. The anomaly detection and classification tools, suitable for online application, were then applied to the entirety of the Eastern Interconnect Training and Test Datasets. Performance of the event detection and classification tools was evaluated upon receipt of the Test Dataset event logs (i.e., the labels for events contained in the Test Dataset), and promising results were obtained despite several challenges (documented herein) associated with application of supervised or semi-supervised machine learning methods to large-scale, anonymized datasets. Finally, the detection and classification tools were used to detect, classify, and characterize thousands of new events not included in the original event logs provided by the DOE within both the Training and Test Datasets.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Highly Resolved Reference Projections of Building Energy Use for the Contiguous United States: Building Sector Energy Baselines, Projection Methods, and Results

This report describes one methodology of projecting energy consumption of the US residential and commercial building sectors using NREL's ResStock™ and ComStock™ as well as growth rates derived from EIA's Annual Energy Outlook (AEO). The impetus for this work is to provide an intermediate method for compiling demand-side sectoral energy projections that is suitable for grid-scale analysis, such as NREL's Standard Scenarios. ResStock and ComStock are physics-based and statistically representative building stock models of the US residential and commercial sector, respectively. Using the 2012 actual meteorological year (AMY) weather data, the sectoral energy baselines are simulated and then segmented along key dimensions (e.g., geography, dwelling/building type). The segmented results are then scaled using the corresponding annual growth rates derived from the 2021 AEO reference case to produce energy projections out to 2050. The compiled result is a demand-side grid model (dsgrid) data set suitable for use in NREL's large-scale grid models, such as the Regional Energy Deployment System (ReEDS). This simple projection method does not endogenously represent how the building stock could evolve through time. Most notably, it does not reflect large-scale electrification, for example, the conversion of space heating, water heating, clothes drying, and cooking from primary fossil fuels to electricity, as this is not part of AEO's reference case assumptions. Nonetheless this approach is more resolved and potentially extensible compared to the current method used by Standard Scenarios's reference case, which augments a sector's total load based on a single growth rate from AEO.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Improving Protein–Ligand Interaction Modeling with cryo-EM Data, Templates, and Deep Learning in 2021 Ligand Model Challenge

Elucidating protein–ligand interaction is crucial for studying the function of proteins and compounds in an organism and critical for drug discovery and design. The problem of protein–ligand interaction is traditionally tackled by molecular docking and simulation, which is based on physical forces and statistical potentials and cannot effectively leverage cryo-EM data and existing protein structural information in the protein–ligand modeling process. In this work, we developed a deep learning bioinformatics pipeline (DeepProLigand) to predict protein–ligand interactions from cryo-EM density maps of proteins and ligands. DeepProLigand first uses a deep learning method to predict the structure of proteins from cryo-EM maps, which is averaged with a reference (template) structure of the proteins to produce a combined structure to add ligands. The ligands are then identified and added into the structure to generate a protein–ligand complex structure, which is further refined. The method based on the deep learning prediction and template-based modeling was blindly tested in the 2021 EMDataResource Ligand Challenge and was ranked first in fitting ligands to cryo-EM density maps. These results demonstrate that the deep learning bioinformatics approach is a promising direction for modeling protein–ligand interactions on cryo-EM data using prior structural information.

59 BASIC BIOLOGICAL SCIENCES↗

A Hybrid Deep Learning Approach to Cosmological Constraints from Galaxy Redshift Surveys

We present a deep machine learning (ML)–based technique for accurately determining σ g and Ω m from mock 3D galaxy surveys. The mock surveys are built from the AbacusCosmos suite of N -body simulations, which comprises 40 cosmological volume simulations spanning a range of cosmological parameter values, and we account for uncertainties in galaxy formation scenarios through the use of generalized halo occupation distributions (HODs). We explore a trio of ML models: a 3D convolutional neural network (CNN), a power spectrum–based fully connected network, and a hybrid approach that merges the two to combine physically motivated summary statistics with flexible CNNs. We describe best practices for training a deep model on a suite of matched-phase simulations, and we test our model on a completely independent sample that uses previously unseen initial conditions, cosmological parameters, and HOD parameters. Despite the fact that the mock observations are quite small (~0.07 h -3 Gpc 3 ) and the training data span a large parameter space (six cosmological and six HOD parameters), the CNN and hybrid CNN can constrain estimates of σ g and Ω m to ~3% and ~4%, respectively.

79 ASTRONOMY AND ASTROPHYSICS↗

Comparison between PARFUME and Bison Using the AGR-2 Irradiation Experiment

This report documents comparisons between Fuel Model (PARFUME) model predictions versus Bison for selected compacts from the second irradiation test of the Advanced Gas Reactor (AGR) program that occurred from June 2010 to October 2013 in the Advanced Test Reactor (ATR) at Idaho National Laboratory (INL). PARFUME is a fuel performance analysis and modeling code, used for evaluating gas-reactor tristructural isotropic (TRISO) coated particle fuel for prismatic, pebble bed, plate, and cylindrical type fuel geometries. PARFUME is an integrated mechanistic computer code that evaluates the thermal, mechanical, and physico-chemical behavior of TRISO coated-fuel particles and the probability for fuel failure given the particle-to-particle statistical variations in physical dimensions and material properties that arise during the fuel fabrication process. Bison is a nuclear fuel performance application built using the Multiphysics Object-Oriented Simulation Environment (MOOSE) finite element library (Permann 2020). Bison is capable of modeling multiple fuel forms in a wide variety of dimensions and geometries. It solves coupled nonlinear partial differential equations, including heat conduction, mechanics, fission product species transport etc., in a fully implicit manner. Comparisons between PARFUME and Bison were performed using four compacts from the AGR-2 experiment. Selected outputs were chosen based on their impact on the probability of the SiC layer failing. In general there was good agreement between PARFUME and Bison with the exception of predicting the gap formed between the buffer and IPyC. Further comparisons between PARFUME and Bison are planned to further develop Bison’s capabilities.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Effective dissipation rate in a Liouvillian-graph picture of high-temperature quantum hydrodynamics

At high temperature, generic strongly interacting spin systems are expected to display hydrodynamics: local transport of conserved quantities, governed by classical partial differential equations like the diffusion equation. I argue that the emergence of this dissipative long-wavelength dynamics from the system's unitary microscopic dynamics is controlled by the structure of the Liouvillian graph of the system's Hamiltonian, that is, the graph induced on Pauli strings by commutation with that Hamiltonian. The Liouvillian graph decomposes naturally into subgraphs of Pauli strings of constant diameter, and the coherent dynamics of these subgraphs determines the rate at which operator weight spreads to long operators. In conclusion, this argument provides a quantitative theory of the emergence of a dissipative effective dynamics from unitary microscopic dynamics; it also leads to an effective model with Hilbert space dimension linear in system size and exponential in the UV cutoff for diffusion.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Data-driven prediction of scaling and ignition of inertial confinement fusion experiments

Recent advances in inertial confinement fusion (ICF) at the National Ignition Facility (NIF), including ignition and energy gain, are enabled by a close coupling between experiments and high-fidelity simulations. Neither simulations nor experiments can fully constrain the behavior of ICF implosions on their own, meaning pre- and postshot simulation studies must incorporate experimental data to be reliable. Linking past data with simulations to make predictions for upcoming designs and quantifying the uncertainty in those predictions has been an ongoing challenge in ICF research. We have developed a data-driven approach to prediction and uncertainty quantification that combines large ensembles of simulations with Bayesian inference and deep learning. The approach builds a predictive model for the statistical distribution of key performance parameters, which is jointly informed by past experiments and physics simulations. The prediction distribution captures the impact of experimental uncertainty, expert priors, design changes, and shot-to-shot variations. We have used this new capability to predict a 10× increase in ignition probability between Hybrid-E shots driven with 2.05 MJ compared to 1.9 MJ, and validated our predictions against subsequent experiments. We describe our new Bayesian postshot and prediction capabilities, discuss their application to NIF ignition and validate the results, and finally investigate the impact of data sparsity on our prediction results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Physics guided machine learning using simplified theories

Recent applications of machine learning, in particular deep learning, motivate the need to address the generalizability of the statistical inference approaches in physical sciences. In this Letter, we introduce a modular physics guided machine learning framework to improve the accuracy of such data-driven predictive engines. The chief idea in our approach is to augment the knowledge of the simplified theories with the underlying learning process. To emphasize their physical importance, our architecture consists of adding certain features at intermediate layers rather than in the input layer. To demonstrate our approach, we select a canonical airfoil aerodynamic problem with the enhancement of the potential flow theory. We include the features obtained by a panel method that can be computed efficiently for an unseen configuration in our training procedure. By addressing the generalizability concerns, our results suggest that the proposed feature enhancement approach can be effectively used in many scientific machine learning applications, especially for the systems where we can use a theoretical, empirical, or simplified model to guide the learning module.

42 ENGINEERING↗

Predicting industrial building energy consumption with statistical and machine-learning models informed by physical system parameters

The industrial sector consumes about one-third of global energy, making them a frequent target for energy use reduction. Variation in energy usage is observed with weather conditions, as space conditioning needs to change seasonally, and with production, energy-using equipment is directly tied to production rate. Previous models were based on engineering analyses of equipment and relied on site-specific details. Others consisted of single-variable regressors that did not capture all contributions to energy consumption. Further, new modeling techniques could be applied to rectify these weaknesses. Applying data from 45 different manufacturing plants obtained from industrial energy audits, a supervised machine-learning model is developed to create a general predictor for industrial building energy consumption. The model uses features of air enthalpy, solar radiation, and wind speed to predict weather-dependency; motor, steam, and compressed air system parameters to capture support equipment contributions; and operating schedule, production rate, number of employees, and floor area to determine production-dependency. Results showed that a model that used a linear regressor over a transformed feature space could outperform a support vector machine and utilize features more representative of physical systems. Using informed parameters to build a reliable predictor will more accurately characterize a manufacturing facility's energy savings opportunities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Berni Julian Alder, theoretical physicist and inventor of molecular dynamics, 1925–2020

Berni Julian Alder, one of the leading figures in the invention of molecular dynamics simulations used for a wide array of problems in physics and chemistry, died on September 7th, 2020. His career, spanning more than 65 years, transformed statistical mechanics, many body physics, the study of chemistry and the microscopic dynamics of fluids, by making atomistic computational simulation (in parallel with traditional theory and experiment) a new pathway to unexpected discoveries. Among his many honors, the CECAM prize, recognizing exceptional contributions to the simulation of the microscopic properties of matter is named for him. He was awarded the National Medal of Science by President Obama in 2008.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Nonequilibrium statistical mechanics and optimal prediction of partially-observed complex systems

Abstract Only a subset of degrees of freedom are typically accessible or measurable in real-world systems. As a consequence, the proper setting for empirical modeling is that of partially-observed systems. Notably, data-driven models consistently outperform physics-based models for systems with few observable degrees of freedom; e.g. hydrological systems. Here, we provide an operator-theoretic explanation for this empirical success. To predict a partially-observed system’s future behavior with physics-based models, the missing degrees of freedom must be explicitly accounted for using data assimilation and model parametrization. Data-driven models, in contrast, employ delay-coordinate embeddings and their evolution under the Koopman operator to implicitly model the effects of the missing degrees of freedom. We describe in detail the statistical physics of partial observations underlying data-driven models using novel maximum entropy and maximum caliber measures. The resulting nonequilibrium Wiener projections applied to the Mori–Zwanzig formalism reveal how data-driven models may converge to the true dynamics of the observable degrees of freedom. Additionally, this framework shows how data-driven models infer the effects of unobserved degrees of freedom implicitly, in much the same way that physics models infer the effects explicitly. This provides a unified implicit-explicit modeling framework for predicting partially-observed systems, with hybrid physics-informed machine learning methods combining both implicit and explicit aspects.

97 MATHEMATICS AND COMPUTING↗

Explainable AI classification for parton density theory

Quantitatively connecting properties of parton distribution functions (PDFs, or parton densities) to the theoretical assumptions made within the QCD analyses which produce them has been a longstanding problem in HEP phenomenology. To confront this challenge, we introduce an ML-based explainability framework, XAI4PDF, to classify PDFs by parton flavor or underlying theoretical model using ResNet-like neural networks (NNs). By leveraging the differentiable nature of ResNet models, this approach deploys guided backpropagation to dissect relevant features of fitted PDFs, identifying x-dependent signatures of PDFs important to the ML model classifications. By applying our framework, we are able to sort PDFs according to the analysis which produced them while constructing quantitative, human-readable maps locating the x regions most affected by the internal theory assumptions going into each analysis. This technique expands the toolkit available to PDF analysis and adjacent particle phenomenology while pointing to promising generalizations.

Artificial Intelligence↗