Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “mathematics and computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Improving the five-point bootstrap

We present a new algorithm for the numerical evaluation of five-point conformal blocks in d-dimensions, greatly improving the efficiency of their computation. To do this we use an appropriate ansatz for the blocks as a series expansion in radial coordinates, derive a set of recursion relations for the unknown coefficients in the ansatz, and evaluate the series using a Padé approximant to accelerate its convergence. We then study the 〈σσϵσσ〉 correlator in the 3d critical Ising model by truncating the operator product expansion (OPE) and only including operators with conformal dimension below a cutoff ∆ ⩽ ∆cutoff. We approximate the contributions of the operators above the cutoff by the corresponding contributions in a suitable disconnected five-point correlator. Using this approach, we compute a number of OPE coefficients with greater accuracy than previous methods.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Physics-preserving enriched Galerkin method for a fully-coupled thermo-poroelasticity model

This paper proposes a new numerical method for a fully-coupled, quasi-static thermo-poroelasticity model in a unified enriched Galerkin (EG) method framework. In our method, the mechanics sub-problem is solved using a locking-free EG method, and the flow and heat sub-problems are solved using a locally-conservative EG method. The proposed method offers mass and energy conservation properties with much lower costs than other methods with the same properties, including discontinuous Galerkin methods and mixed finite element methods. The well-posedness and optimal a priori error estimates are carefully derived. Here, several numerical tests confirm the theoretical optimal convergence rates and the mass and energy conservation properties of the new method.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

A phase transition for finding needles in nonlinear haystacks with LASSO artificial neural networks

To fit sparse linear associations, a LASSO sparsity inducing penalty with a single hyperparameter provably allows to recover the important features (needles) with high probability in certain regimes even if the sample size is smaller than the dimension of the input vector (haystack). More recently learners known as artificial neural networks (ANN) have shown great successes in many machine learning tasks, in particular fitting nonlinear associations. Small learning rate, stochastic gradient descent algorithm and large training set help to cope with the explosion in the number of parameters present in deep neural networks. Yet few ANN learners have been developed and studied to find needles in nonlinear haystacks. Driven by a single hyperparameter, our ANN learner, like for sparse linear associations, exhibits a phase transition in the probability of retrieving the needles, which we do not observe with other ANN learners. To select our penalty parameter, we generalize the universal threshold of Donoho and Johnstone (Biometrika 81(3):425–455, 1994) which is a better rule than the conservative (too many false detections) and expensive cross-validation. In the spirit of simulated annealing, we propose a warm-start sparsity inducing algorithm to solve the high-dimensional, non-convex and non-differentiable optimization problem. We perform simulated and real data Monte Carlo experiments to quantify the effectiveness of our approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Simulation of Gas Production from Multilayered Hydrate-Bearing Media with Fully Coupled Flow, Thermal, Chemical and Geomechanical Processes Using TOUGH+Millstone. Part 2: Geomechanical Formulation and Numerical Coupling

The TOUGH+Millstone simulator has been developed for the analysis of coupled flow, thermal and geomechanical processes associated with the formation and/or dissociation of CH 4 hydrates in geological media. It is composed of two constituent codes: (a) a significantly enhanced version of the TOUGH+HYDRATE simulator, v2.0, that accounts for all known flow, physical, thermodynamic and chemical processes associated with the behavior of hydrate-bearing systems undergoing changes and includes the most recent advances in the description of the system properties, coupled seamlessly with (b) Millstone v1.0, a new code that addresses the conceptual, computational and mathematical shortcomings of earlier codes used to describe the geomechanical response of these systems. The capabilities of the TOUGH+Millstone code are demonstrated in the simulation and analysis of the system flow, thermal and geomechanical behavior during gas production from a realistic complex offshore hydrate deposit. In the second part of this series, we describe the Millstone geomechanical simulator. The hydrate-dependent, rate-based poromechanical formulation is presented and solved using a finite element discretization. A novel multimesh coupling scheme is introduced, wherein interpolators are automatically built to transfer data between the finite difference discretization of TOUGH+ and the finite element discretization of Millstone. We provide verification examples against analytic solutions for poroelasticity and a simplified demonstration problem for mechanically induced phase change in a hydrate sediment.

58 GEOSCIENCES↗
DOE OSTI2019

Simulation of Gas Production from Multilayered Hydrate-Bearing Media with Fully Coupled Flow, Thermal, Chemical and Geomechanical Processes Using TOUGH + Millstone. Part 1: Numerical Modeling of Hydrates

TOUGH + Millstone has been developed for the analysis of coupled flow, thermal and geomechanical processes associated with the formation and/or dissociation of CH4-hydrates in geological media. It is composed of two constituent codes: (a) a significantly enhanced version of the TOUGH + HYDRATE simulator, V2.0, that accounts for all known flow, physical, thermodynamic and chemical processes associated with the behavior of hydrate-bearing systems undergoing changes and includes the most recent advances in the description of the system properties, coupled seamlessly with (b) Millstone V1.0, a new code that addresses the conceptual, computational and mathematical shortcomings of earlier codes used to describe the geomechanical response of these systems. The capabilities of TOUGH + Millstone are demonstrated in the simulation and analysis of the system flow, thermal and geomechanical behavior during gas production from a realistic complex offshore hydrate deposit. In the first paper of this series, we discuss the physics underlying the T + H hydrate simulator, the constitutive relationships describing the physical, chemical (equilibrium and kinetic) and thermal processes, the states of the CH 4 + H 2 O system and the sources of critically important data, as well as the mathematical approaches used for the development of the of mass and energy balance equations and their solution. Finally, we provide verification examples of the hydrate code against numerical results from the simulation of laboratory and field experiments.

58 GEOSCIENCES↗
DOE OSTI2019

Simulation of Gas Production from Multilayered Hydrate-Bearing Media with Fully Coupled Flow, Thermal, Chemical and Geomechanical Processes Using TOUGH+Millstone. Part 3: Production Simulation Results

The TOUGH+Millstone simulator has been developed for the analysis of coupled flow, thermal and geomechanical processes associated with the formation and/or dissociation of CH 4 - /sub>-hydrates in geological media. It is composed of two constituent codes: (a) a significantly enhanced version of the TOUGH+Hydrate simulator, v2.0, that accounts for all known flow, physical, thermodynamic and chemical processes associated with the evolution of hydrate-bearing systems and includes the most recent physical properties relationships, coupled seamlessly with (b) Millstone v1.0, a new code that addresses the conceptual, computational and mathematical shortcomings of earlier codes used to describe the geomechanical response of these systems. The capabilities of the TOUGH+Millstone code are demonstrated in the simulation and analysis of the system flow, thermal, and geomechanical behavior during gas production from a realistic complex offshore hydrate deposit. In the third paper of this series, we apply the simulators described in parts 1 and 2 to a problem of gas production from a complex, multilayered system of hydrate-bearing sediments in an oceanic environment. We perform flow simulations of constant-pressure production via a vertical well and compare those results to a coupled flow-geomechanical simulation of the same process. Finally, the results demonstrate the importance of fully coupled geomechanics when modeling the evolution of reservoir properties during production.

58 GEOSCIENCES↗
DOE OSTI2022

Variable resolution Poisson-disk sampling for meshing discrete fracture networks

Here, we present the near-Maximal Algorithm for Poisson-disk Sampling (nMAPS) to generate point distributions for variable resolution Delaunay triangular and tetrahedral meshes in two and three-dimensions, respectively. nMAPS consists of two principal stages. In the first stage, an initial point distribution is produced using a cell-based rejection algorithm. In the second stage, holes in the sample are detected using an efficient background grid and filled in to obtain a near-maximal covering. Extensive testing shows that nMAPS generates a variable resolution mesh in linear run time with the number of accepted points. We demonstrate nMAPS capabilities by meshing three-dimensional discrete fracture networks (DFN) and the surrounding volume. The discretized boundaries of the fractures, which are represented as planar polygons, are used as the seed of 2D-nMAPS to produce a conforming Delaunay triangulation. The combined mesh of the DFN is used as the seed for 3D-nMAPS, which produces conforming Delaunay tetrahedra surrounding the network. Under a set of conditions that naturally arise in maximal Poisson-disk samples and are satisfied by nMAPS, the two-dimensional Delaunay triangulations are guaranteed to only have well-behaved triangular faces. While nMAPS does not provide triangulation quality bounds in more than two dimensions, we found that low-quality tetrahedra in 3D are infrequent, can be readily detected and removed, and a high-quality balanced mesh is produced.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Physics-informed regularization and structure preservation for learning stable reduced models from data with operator inference

Operator inference learns low-dimensional dynamical-system models with polynomial nonlinear terms from trajectories of high-dimensional physical systems (non-intrusive model reduction). Here, this work focuses on the large class of physical systems that can be well described by models with quadratic and cubic nonlinear terms and proposes a regularizer for operator inference that induces a stability bias onto learned models. The proposed regularizer is physics informed in the sense that it penalizes higher-order terms with large norms and so explicitly leverages the polynomial model form that is given by the underlying physics. This means that the proposed approach judiciously learns from data and physical insights combined, rather than from either data or physics alone. Additionally, a formulation of operator inference is proposed that enforces model constraints for preserving structure such as symmetry and definiteness in linear terms. Numerical results demonstrate that models learned with operator inference and the proposed regularizer and structure preservation are accurate and stable even in cases where using no regularization and Tikhonov regularization leads to models that are unstable.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Opportunities and data requirements for data-driven prognostics and health management in liquid hydrogen storage systems

During the past decade, Prognostics and Health Management (PHM) has become an important set of tools in various areas of industry and academic reliability engineering. PHM consists of a variety of mathematical and computational methods used to support data-driven decision-making to increase the safety, availability, and reliability of complex engineering systems. In particular, PHM can provide crucial insight into reliability and safety design improvements for developing technologies where historical performance and failure data are limited. This is the case of hydrogen fueling and storage technologies. This work presents a high-level approach for designing data-driven PHM applications for bulk liquid hydrogen (LH 2 ) storage systems for hydrogen fueling stations. This paper addresses core aspects of the design, development, and implementation of data-driven PHM applications that can improve the reliability assessment of hydrogen components. The analysis focuses on the relationship between data availability and diagnostic/prognostic capabilities; potential challenges; and integration schemes for current risk mitigation measures. We identify potential condition-monitoring data sources for key components in an LH 2 storage system, including storage tanks, piping, and pumps. Further, we determine that the short-term goals for the implementation of data-driven models in PHM frameworks in hydrogen systems should focus on developing adequate data collection and analysis strategies, as well as exploring the effect on reliability, safety, and regulations for hydrogen systems.

08 HYDROGEN↗
DOE OSTI2024

Acceleration of Graph Neural Network-Based Prediction Models in Chemistry via Co-Design Optimization on Intelligence Processing Units

Atomic structure prediction and associated property calculations are the bedrock of chemical physics. Since high-fidelity ab initio modeling techniques for computing the structure and properties can be prohibitively expensive, this motivates the development of machine-learning (ML) models that make these predictions more efficiently. Training graph neural networks over large atomistic databases introduces unique computational challenges such as the need to process millions of small graphs with variable size and support communication patterns that are distinct from learning over large graphs such as social networks. We demonstrate a novel hardware-software co-design approach to scale up the training of atomistic graph neural networks (GNN) for structure and property prediction. First, to eliminate redundant computation and memory associated with alternative padding techniques and to improve throughput via minimizing communication, we formulate the effective coalescing of the batches of variable-size atomistic graphs as the bin packing problem and introduce a hardware-agnostic algorithm to pack these batches. In addition, we propose hardware-specific optimizations including a planner and vectorization for the gather-scatter operations targeted for Graphcore’s Intelligence Processing Unit (IPU), as well as model-specific optimizations such as merged communication collectives and optimized softplus. Putting these all together, we demonstrate the effectiveness of the proposed co-design approach by providing an implementation of a well-established atomistic GNN on the Graphcore IPUs. We evaluate the training performance on multiple atomistic graph databases with varying degrees of graph counts, sizes and sparsity. Here, we demonstrate that such a co-design approach can reduce the training time of atomistic GNNs and can improve the performance by up to 1.5× compared to the baseline implementation of the model on the IPUs. Additionally, we compare our IPU implementation with a Nvidia GPU-based implementation and show that our atomistic GNN implementation on the IPUs can run 1.8× faster on average compared to the execution time on the GPUs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Assessment of Extinction‐, Satellite‐, and Model‐Based Vertical Cloud Condensation Nuclei (CCN) Retrieval Methods Using Airborne CCN Measurements Over the Southern Great Plains

Abstract Accurate estimates of the vertical profile of cloud condensation nuclei (CCN) concentration are crucial to better quantify aerosol‐cloud interactions. We assessed the correlation between the vertical CCN concentrations obtained from extinction‐, satellite‐, and model‐based retrieval methods and airborne CCN concentrations collected at 0.24% supersaturation within the 3, 9, 27, and 81 km regions centered over the U.S. Department of Energy's Atmospheric Radiation Measurement User Facility Southern Great Plains (SGP) site during the spring and summer of 2016. The extinction profiles at a wavelength 355 nm were provided by the ground‐based Raman lidar. Our analysis showed moderate correlation between dry‐corrected extinction and airborne CCN data. We found the retrieved number concentration of CCN (RNCCN) method showed regression best‐fit slopes close to unity and consistent prediction errors for the majority of the data. The Lenhardt et al. (2023, https://doi.org/10.5194/amt‐16‐2037‐2023 ) method showed similar conclusions but only during spring, whereas the Mamouri and Ansmann (2016, https://doi.org/10.5194/acp‐16‐5905‐2016 ) method showed poor correlation. The Shinozuka et al. (2015, https://doi.org/10.5194/acp‐15‐7585‐2015 ) satellite‐based method exhibited reasonable agreement during summer but poor correlation during periods where both high (∼1,400 #/cm 3 ) and low (∼50 #/cm 3 ) airborne CCN concentrations were observed. The Copernicus Atmosphere Monitoring Service reanalysis modeled 3‐D CCN data set showed a moderate to weak positive correlation but performed poorly at high airborne CCN concentrations. Our analysis suggests the extinction‐based RNCCN method performed better than other methods across most observation periods under the diverse meteorological conditions observed at the SGP site.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Controlling the pandemic during the SARS-CoV-2 vaccination rollout

There is a consensus that mass vaccination against SARS-CoV-2 will ultimately end the COVID-19 pandemic. However, it is not clear when and which control measures can be relaxed during the rollout of vaccination programmes. We investigate relaxation scenarios using an age-structured transmission model that has been fitted to age-specific seroprevalence data, hospital admissions, and projected vaccination coverage for Portugal. Our analyses suggest that the pressing need to restart socioeconomic activities could lead to new pandemic waves, and that substantial control efforts prove necessary throughout 2021. Using knowledge on control measures introduced in 2020, we anticipate that relaxing measures completely or to the extent as in autumn 2020 could launch a wave starting in April 2021. Additional waves could be prevented altogether if measures are relaxed as in summer 2020 or in a step-wise manner throughout 2021. We discuss at which point the control of COVID-19 would be achieved for each scenario.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Correspondence between neuroevolution and gradient descent

Abstract We show analytically that training a neural network by conditioned stochastic mutation or neuroevolution of its weights is equivalent, in the limit of small mutations, to gradient descent on the loss function in the presence of Gaussian white noise. Averaged over independent realizations of the learning process, neuroevolution is equivalent to gradient descent on the loss function. We use numerical simulation to show that this correspondence can be observed for finite mutations, for shallow and deep neural networks. Our results provide a connection between two families of neural-network training methods that are usually considered to be fundamentally different.

97 MATHEMATICS AND COMPUTING↗