Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Physics regularization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Physics-Driven Convolutional Autoencoder Approach for CFD Data Compressions: Preprint

With the growing size and complexity of turbulent flow models, data compression approaches are of the utmost importance to analyze, visualize, or restart the simulations. Recently, in-situ autoencoder-based compression approaches have been proposed and shown to be effective at producing reduced representations of turbulent flow data. However, these approaches focus solely on training the model using point-wise sample reconstruction losses that do not take advantage of the physical properties of turbulent flows. In this paper, we show that training autoencoders with additional physics-informed regularizations, e.g., enforcing incompressibility and preserving enstrophy, improves the compression model in three ways: (i) the compressed data better conform to known physics for homogeneous isotropic turbulence without negatively impacting point-wise reconstruction quality, (ii) inspection of the gradients of the trained model uncovers changes to the learned compression mapping that can facilitate the use of explainability techniques, and (iii) as a performance byproduct, training losses are shown to converge up to 12x faster than the baseline model.

auto-encoders↗

Eco-PiNN: A Physics-informed Neural Network for Eco-toll Estimation

The eco-toll estimation problem quantifies the expected environmental cost (e.g., energy consumption, exhaust emissions) for a vehicle to travel along a path. This problem is important for societal applications such as eco-routing, which aims to find paths with the lowest exhaust emissions or energy need. The challenges of this problem are threefold: (1) the dependence of a vehicle's eco-toll on its physical parameters; (2) the lack of access to data with eco-toll information; and (3) the influence of contextual information (i.e. the connections of adjacent segments in the path) on the eco-toll of road segments. Prior work on eco-toll estimation has mostly relied on pure data-driven approaches and has high estimation errors given the limited training data. To address these limitations, we propose a novel Eco-toll estimation Physics-informed Neural Network framework (Eco-PiNN) using three novel ideas, namely, (1) a physics-informed decoder that integrates the physical laws governing vehicle dynamics into the network, (2) an attention-based contextual information encoder, and (3) a physics-informed regularization to reduce overfitting. Experiments on real-world heavy-duty truck data show that the proposed method can greatly improve the accuracy of eco-toll estimation compared with state-of-the-art methods.

97 MATHEMATICS AND COMPUTING↗

A novel numerical treatment of the near-wall regions in the k – ω class of RANS models

In this study, we discuss a novel approach to modeling the near-wall region in the class of k – ω to models. The proposed methodology obviates the need for ad hoc boundary conditions of to omega on the wall as typically required in the k – ω model. The primary motivation of this work is to provide a formulation equivalent to the standard k – ω to and k – ω to SST models, but which at the same time overcomes their limitations in the context of their implementation in high-order methods. This is achieved by subtracting the asymptotically known singular behavior of omega at walls. Imposing a grid-dependent value of omega at walls in high-order codes is not straightforward as is demonstrated below and it causes instability as well as accuracy issues. The mathematical formulation of the two novel approaches, termed as the "regularized k – ω model" and the "regularized k – ω OJ SST model", is discussed in detail. A consistency and verification study for these two approaches is performed by proving that the regularized models recover the results of the standard models in various canonical problems, such as turbulent channel and pipe flows, and a systematic investigation of convergence, using both p- (polynomial order) as well as h- (grid) refinement is reported. Furthermore, comparisons highlighting the performance of the proposed methods in more complex configurations such as flow over a backward facing step and the turbulent mixing of fluid streams of different temperatures in a T-junction are also presented.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Emergent gravity from vanishing energy-momentum tensor

A constraint of vanishing energy-momentum tensor is motivated by a variety of perspectives on quantum gravity. We demonstrate in a concrete example how this constraint leads to a metric-independent theory in which quantum gravity emerges as a nonperturbative artifact of regularization-scale physics. We analyze a scalar theory similar to the Dirac-Born-Infeld (DBI) theory with vanishing gauge fields, with the DBI Lagrangian modulated by a scalar potential. In the limit of a large number of scalars, we explicitly demonstrate the existence of a composite massless spin-2 graviton in the spectrum that couples to matter as in Einstein gravity. As a result, we comment on the cosmological constant problem and the generalization to theories with fermions and gauge fields.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Islands in non-minimal dilaton gravity: exploring effective theories for black hole evaporation

We start from (3 + 1)-dimensional Einstein gravity with minimally coupled massless scalar matter, through spherical dimensional reduction, the matter theory is non-minimally coupled with the dilaton in (1 + 1)-dimensions. Despite its simplicity, constructing a self-consistent one-loop effective theory for this model remains a challenge, partially due to a Weyl-invariant ambiguity in the effective action. With a universal splitting property for the one-loop action, the ambiguity can be identified with the state-dependent part of the covariant quantum stress tensor. By introducing on-shell equivalent auxiliary fields to construct minimal candidates of Weyl-invariant terms, we derive a one-parameter family of one-loop actions with unique, regular, and physical stress tensors corresponding to the Boulware, Hartle-Hawking and Unruh states. We further study the back-reacted geometry and the corresponding quantum extremal islands that were inaccessible without a consistent one-loop theory. Along the way, we elaborate on the implications of our construction for the non-minimal dilaton gravity model.

2D Gravity↗

Machine-learning predictions of the shale wells’ performance

The ultra-low permeability nature of shale reservoirs leads to an extended linear flow and necessitates horizontal wells with multi-stage engineered fractures to efficiently extract hydrocarbons resources. These artificially-generated and naturally-occurring fractures form complex networks that create complex flow regimes which control oil production. These fractures are neither identical nor equally-spaced, which leads to a production profile with a masked onset of the boundary-dominated flow. The combination of the extended linear flow with the indeterminate onset of the boundary-dominated flow challenges the current deterministic analytic approaches to forecast the estimated ultimate recovery (EUR). In this work, we propose a novel machine-learning approach which overcomes these challenges and provides reliable EUR estimates based on field-wide analyses. We implement a novel unsupervised machine learning (ML) methodology, which allows for automatic identification of the optimal number of features (signals) present in the data based on non-negative matrix/tensor factorization coupled with k-means clustering incorporating regularization and physics constraints. In the presented analyses, the input data to the ML algorithm is the available (public) production history from the field collected at existing unconventional reservoirs. We validate our approach through hindcasting of the production data, where we achieved an excellent agreement. In addition, our approach is able to identify the poorly-performing wells, which could benefit from early refracing. Our approach provides fast and accurate estimations of the well performance without presumptions about the state of the well or the flow regime.

03 NATURAL GAS↗

MO-DE-BRA-02: From Teaching to Learning: Systems-Based-Practice and Practice-Based-Learning Innovations in Medical Physics Education Programs

Purpose: The increasing complexity in the field of radiation medicine and concomitant rise in patient safety concerns call for enhanced systems-level training for future medical physicists and thus commensurate innovations in existing educational program curricula. In this work we report on the introduction of three learning opportunities to augment medical physics educational programs towards building systems-based practice and practice-based learning competencies. Methods: All initiatives were introduced for senior -level graduate students and physics residents in an institution with a newly established medical-physics graduate program and therapeutic-physics residency program. The first, centered on incident learning, was based on a spreadsheet tool that incorporated the reporting structure of the Radiation Oncology-incident Learning System (ROILS), included 120 narratives of published incidents and enabled inter-rater variability calculations. The second, centered on best-practices, was a zero-credit seminar course, where students summarized select presentations from the AAPM virtual library on a weekly basis and moderated class discussions using a point/counterpoint approach. Presentation styles were critiqued. The third; centered on learning-by-teaching, required physics residents to regularly explain fundamental concepts in radiological physics from standard textbooks to board certified physics faculty members. Results: Use of the incident-learning system spreadsheet provided a platform to recast known accidents into the framework of ROILS, thereby increasing awareness of factors contributing to unsafe practice and appreciation for inter-rater variability. The seminar course enhanced awareness of best practices, the effectiveness of presentation styles and encouraged critical thinking. The learn-by-teaching rotation allowed residents to stay abreast of and deepen their knowledge of relevant subjects. Conclusion: The incorporation of systems-driven initiatives broadens comprehension of the wider systems context of medical physics, enhances awareness of resources for innovation, communication and sustained learning while maintaining a metric-driven focus on patient safety within the formative phase of student careers. The initiatives were well-received, feasible, and utilized available or shared-resources translatable across educational programs.

60 APPLIED LIFE SCIENCES↗

Constructing Neural Network Based Models for Simulating Dynamical Systems

Dynamical systems see widespread use in natural sciences like physics, biology, and chemistry, as well as engineering disciplines such as circuit analysis, computational fluid dynamics, and control. For simple systems, the differential equations governing the dynamics can be derived by applying fundamental physical laws. However, for more complex systems, this approach becomes exceedingly difficult. Data-driven modeling is an alternative paradigm that seeks to learn an approximation of the dynamics of a system using observations of the true system. In recent years, there has been an increased interest in applying data-driven modeling techniques to solve a wide range of problems in physics and engineering. Here this article provides a survey of the different ways to construct models of dynamical systems using neural networks. In addition to the basic overview, we review the related literature and outline the most significant challenges from numerical simulations that this modeling paradigm must overcome. Based on the reviewed literature and identified challenges, we provide a discussion on promising research areas.

97 MATHEMATICS AND COMPUTING↗

Developing and Managing Data Acquisition Software Using Spack

The Data Acquisition systems of particle physics experiments regularly push the boundaries of high-throughput computing, demanding low-latency collection of data from thousands of devices, collating data into time-sliced events, processing these events and making trigger decisions, and writing the selected data streams to disk. To accomplish these tasks, the DAQ Engineering and Operations department at Fermilab leverages multiple software libraries and builds reusable DAQ frameworks on top. These libraries must be delivered in well-defined bundles and are thoroughly tested for compatibility and functionality before being deployed to live detectors. We have several techniques used to ensure that a consistent set of dependencies can be delivered and re-created at need. We must also support active development of DAQ software components, ideally in an environment as close as possible to that of the detectors. This development often occurs across multiple packages which have to be built in concert and features tested in a consistent and reproducible manner. I will present our scheme for accomplishing these goals using Spack environments, bundle packages, and Github Actions-based CI.

Flumerfelt, Eric [Fermilab]↗

Gibbs Measures Over Locally Tree-Like Graphs and Percolative Entropy Over Infinite Regular Trees

Consider a statistical physical model on the d-regular infinite tree T{sub d} described by a set of interactions Φ. Let {G_n} be a sequence of finite graphs with vertex sets V{sub n} that locally converge to T{sub d}. From Φ one can construct a sequence of corresponding models on the graphs G{sub n}. Let {μ_n} be the resulting Gibbs measures. Here we assume that {μ_n} converges to some limiting Gibbs measure μ on T{sub d} in the local weak{sup ∗} sense, and study the consequences of this convergence for the specific entropies |V{sub n}|{sup −1}H(μ{sub n}). We show that the limit supremum of |V{sub n}|{sup −1}H(μ{sub n}) is bounded above by the percolative entropyH{sub perc}(μ), a function of μ itself, and that |V{sub n}|{sup −1}H(μ{sub n}) actually converges to H{sub perc}(μ) in case Φ exhibits strong spatial mixing on T{sub d}. When it is known to exist, the limit of |V{sub n}|{sup −1}H(μ{sub n}) is most commonly shown to be given by the Bethe ansatz. Percolative entropy gives a different formula, and we do not know how to connect it to the Bethe ansatz directly. We discuss a few examples of well-known models for which the latter result holds in the high temperature regime.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Magnetic field mapping of inaccessible regions using physics-informed neural networks

A difficult problem concerns the determination of magnetic field components within an experimentally inaccessible region when direct field measurements are not feasible. In this paper, we propose a new method of accessing magnetic field components using non-disruptive magnetic field measurements on a surface enclosing the experimental region. Magnetic field components in the experimental region are predicted by solving a set of partial differential equations (Ampere’s law and Gauss’ law for magnetism) numerically with the aid of physics-informed neural networks (PINNs). Prediction errors due to noisy magnetic field measurements and small number of magnetic field measurements are regularized by the physics information term in the loss function. We benchmark our model by comparing it with an older method. The new method we present will be of broad interest to experiments requiring precise determination of magnetic field components, such as searches for the neutron electric dipole moment.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An adaptive and stability-promoting layerwise training approach for sparse deep neural network architecture

This work presents a two-stage adaptive framework for progressively developing deep neural network (DNN) architectures that generalize well for a given training data set. In the first stage, a layerwise training approach is adopted where a new layer is added each time and trained independently by freezing parameters in the previous layers. We impose desirable structures on the DNN by employing manifold regularization, sparsity regularization, and physics-informed terms. We introduce a ε – δ – stability-promoting concept as a desirable property for a learning algorithm and show that employing manifold regularization yields a ε – δ stability-promoting algorithm. Further, we also derive the necessary conditions for the trainability of a newly added layer and investigate the training saturation problem. In the second stage of the algorithm (post-processing), a sequence of shallow networks is employed to extract information from the residual produced in the first stage, thereby improving the prediction accuracy. Numerical investigations on prototype regression and classification problems demonstrate that the proposed approach can outperform fully connected DNNs of the same size. Moreover, by equipping the physics-informed neural network (PINN) with the proposed adaptive architecture strategy to solve partial differential equations, we numerically show that adaptive PINNs not only are superior to standard PINNs but also produce interpretable hidden layers with provable stability. As a result, we also apply our architecture design strategy to solve inverse problems governed by elliptic partial differential equations.

42 ENGINEERING↗

The need for application-based adaptation of deformable image registration

Purpose: To utilize a deformable phantom to objectively evaluate the accuracy of 11 different deformable image registration (DIR) algorithms. Methods: The phantom represents an axial plane of the pelvic anatomy. Urethane plastic serves as the bony anatomy and urethane rubber with three levels of Hounsfield units (HU) is used to represent fat and organs, including the prostate. A plastic insert is placed into the phantom to simulate bladder filling. Nonradiopaque markers reside on the phantom surface. Optical camera images of these markers are used to measure the positions and determine the deformation from the bladder insert. Eleven different DIR algorithms are applied to the full and empty-bladder computed tomography images of the phantom (fixed and moving volumes, respectively) to calculate the deformation. The algorithms include those from MIM Software (MIM) and Velocity Medical Solutions (VEL) and nine different implementations from the deformable image registration and adaptive radiotherapy toolbox for Matlab. These algorithms warp one image to make it similar to another, but must utilize a method for regularization to avoid physically unrealistic deformation scenarios. The mean absolute difference (MAD) between the HUs at the marker locations on one image and the calculated location on the other serves as a metric to evaluate the balance between image similarity and regularization. To demonstrate the effect of regularization on registration accuracy, an additional beta version of MIM was created with a variable smoothness factor that controls the emphasis of the algorithm on regularization. The distance to agreement between the measured and calculated marker deformations is used to compare the overall spatial accuracy of the DIR algorithms. This overall spatial accuracy is also utilized to evaluate the phantom geometry and the ability of the phantom soft-tissue heterogeneity to represent patient data. To evaluate the ability of the DIR algorithms to accurately transfer anatomical contours, the rectum is delineated on both the fixed and moving images. A Dice similarity coefficient is then calculated between the contour on the fixed image and that transferred, via the calculated deformation, from the moving to the fixed image. Results: The phantom possesses sufficient soft-tissue heterogeneity to act as a proxy for patient data. Large discrepancies appear between the algorithms and the measured ground-truth deformation. VEL yields the smallest mean spatial error and a Dice coefficient of 0.90. MIM produces the lowest MAD value and the highest Dice coefficient of 0.96, but creates the largest spatial errors. Increasing the MIM smoothness factor above the default value improves the overall spatial accuracy, but the factor associated with the lowest mean error decreases the Dice coefficient to 0.85. Conclusions: Different applications of DIR require disparate balances between image similarity and regularization. A DIR algorithm that is optimized only for its ability to transfer anatomical contours will yield large deformation errors in homogeneous regions, which is problematic for dose mapping. For this reason, these algorithms must be tested for their overall spatial accuracy. The developed phantom is an objective tool for this purpose.

60 APPLIED LIFE SCIENCES↗

Block-Structured Operator Inference for Coupled Multiphysics Model Reduction

This work presents a block-structured formulation of Operator Inference as a way to learn structured reduced-order models for multiphysics systems. The approach specifies the governing equation structure for each physics component and the structure of the coupling terms. Once the multiphysics structure is specified, the reduced-order model is learned from snapshot data following the nonintrusive Operator Inference methodology. In addition to preserving physical system structure, which in turn permits preservation of system properties such as stability and second-order structure, the block-structured approach has the advantages of reducing the overall dimensionality of the learning problem and admitting tailored regularization for each physics component. The numerical advantages of the block-structured formulation over a monolithic Operator Inference formulation are demonstrated for aeroelastic analysis, which couples aerodynamic and structural models. For the benchmark test case of the AGARD 445.6 wing, block-structured Operator Inference provides an average 20% online prediction speedup over monolithic Operator Inference across subsonic and supersonic flow conditions in both the stable and fluttering parameter regimes while preserving the accuracy achieved with monolithic Operator Inference.

42 ENGINEERING↗

Global stellarator coil optimization with quadratic constraints and objectives

Most present stellarator designs are produced by costly two-stage optimization: the first for an optimized equilibrium, and the second for a coil design reproducing its magnetic configuration. Few proxies for coil complexity and forces exist at the equilibrium stage. Rapid initial state finding for both stages is a topic of active research. Most present convex coil optimization codes use the least square winding surface method by Merkel (NESCOIL), with recent improvements in conditioning, regularization, sparsity, and physics objectives. While elegant, the method is limited to modeling the norms of linear functions in coil current. We present QUADCOIL, a global coil optimization method that targets combinations of linear and quadratic functions of the current. It can directly constrain and/or minimize a wide range of physics objectives unavailable in NESCOIL and REGCOIL, including the Lorentz force, magnetic energy, curvature, field-current alignment, and the maximum density of a dipole array. QUADCOIL requires no initial guess and runs nearly $10$ 2 x faster than filament optimization. Integrating it in the equilibrium optimization stage can potentially exclude equilibria with difficult-to-design coils, without significantly increasing the computation time per iteration. QUADCOIL finds the exact, global minimum in a large parameter space when possible, and otherwise finds a well-performing approximate global minimum. It supports most regularization techniques developed for NESCOIL and REGCOIL. We demonstrate QUADCOIL’s effectiveness in coil topology control, minimizing non-convex penalties, and predicting filament coil complexity with three numerical examples.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Divergence of laser-driven relativistic electron beams

Electron acceleration by ultrahigh intensity lasers is studied by means of two-dimensional planar particle-in-cell simulations. It is shown that the full divergence of the fast electron beam is defined by two complementary physical effects: the regular radial beam deviation depending on the electron radial position and the angular dispersion. If the scale length of the preplasma surrounding the solid target is sufficiently low, the radial deviation is determined by the transverse component of the laser ponderomotive force. The random angular dispersion is due to the small scale magnetic fields excited near the critical density due to the collisionless Weibel instability. When a preplasma is present, the radial beam deviation increases due to the electron acceleration in larger volumes and can become comparable to the local angular dispersion. This effect has been neglected so far in most of the fast electron transport calculations, overestimating significantly the beam collimation by resistive magnetic fields. Simulations with a two-dimensional cylindrically-symmetric hybrid code accounting for the electron radial velocity demonstrate a substantially reduced strength and a shorter penetration of the azimuthal magnetic field in solid targets.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Studies of singlet Rydberg series of LiH derived from Li(nl) + H(1s), with n ≤ 6 and l ≤ 4

The 50 singlet states of LiH composed of 49 Rydberg states and one non-Rydberg ionic state derivable from Li(nl) + H(1s), with n ≤ 6 and l ≤ 4, are studied using the multi-reference configuration interaction method combined with the Stuttgart/Köln group's effective core potential/core polarization potential method. Basis functions that can yield energy levels up to the 6g orbital of Li have been developed, and they are used with a huge number of universal Kaufmann basis functions for Rydberg states. The systematics and regularities of the physical properties such as potential energies, quantum defects, permanent dipole moments, transition dipole moments, and nonadiabatic coupling matrix elements of the Rydberg series are studied. The behaviors of potential energy curves and quantum defect curves are explained using the Fermi approximation. The permanent dipole moments of the Rydberg series reveal that they are determined by the sizes of the Rydberg orbitals, which are proportional to n{sup 2}. Interesting mirror relationships of the dipole moments are observed between l-mixed Rydberg series, with the rule Δl = ±1, except for s–d mixing, which is also accompanied by n-mixing. The members of the l-mixed Rydberg series have dipole moments with opposite directions. The first derivatives of the dipole moment curves, which show the charge-transfer component, clearly show not only mirror relationships in terms of direction but also oscillations. The transition dipole moment matrix elements of the Rydberg series are determined by the small-r region, with two consequences. One is that the transition dipole moment matrix elements show n{sup −3/2} dependence. The other is that the magnitudes of the transition dipole moment matrix elements decrease rapidly as l increases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗