Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

Effect of Irradiation on Strengthening of a Model Fe-9Cr Oxide Dispersion Strengthened Alloy

The growing energy demand will increasingly call upon advanced nuclear reactors to supply safe and reliable energy worldwide. However, structural and cladding materials in these reactors will be subject to extreme conditions of up to a few hundred displacements per atom (dpa) at temperatures as high as 600 deg. C. Oxide dispersion strengthened (ODS) alloys are leading candidates for these components because their dispersion of Y-Ti-O nanoclusters provides high strength at elevated temperatures and dimensional stability under irradiation. But recent work has suggested that the oxides are unstable under irradiation, which has serious implications on mechanical performance. Thus, the objective of this work is to understand the change in strengthening mechanisms of an Fe-9Cr ODS alloy under irradiation. We use two approaches to assess strengthening of a proton-irradiated and neutron-irradiated Fe-9Cr ODS. First, nanoindentation directly measures changes in yield strength. Second, microstructure measurements are passed through models of two strengthening mechanisms. Results of these two approaches are compared to infer the strengthening mechanisms in the irradiated ODS alloy. A model Fe-9Cr ODS steel was irradiated to 3 dpa at 500 deg. C using either 2.0 MeV protons or a fast neutron spectrum. Both irradiation types induced the formation of dislocation loops and voids. Both proton and neutron irradiation resulted in dissolution of oxide nanoclusters, though neutron irradiation led to much more extensive oxide nano-cluster dissolution. The irradiated microstructure was used to predict irradiation hardening by considering both the precipitation strengthening and solid solution strengthening mechanisms. Due to more extensive oxide nano-cluster dissolution under neutron irradiation, the solid solution strengthening mechanism must be considered in order for the predicted change in yield strength to be comparable to that measured by nanoindentation. (authors)

36 MATERIALS SCIENCE↗

The behavior of transverse waves in nonuniform solar flux tubes. II. Implications for coronal loop seismology

The seismology of coronal loops using observations of damped transverse oscillations in combination with results from theoretical models is a tool to indirectly infer physical parameters in the solar atmospheric plasma. Existing seismology schemes based on approximations of the period and damping time of kink oscillations are often used beyond their theoretical range of applicability. These approximations assume that the variation of density across the loop is confined to a nonuniform layer much thinner than the radius of the loop, but the results of the inversion problem often do not satisfy this preliminary hypothesis. Here, we determine the accuracy of the analytic approximations of the period and damping time, and the impact on seismology estimates when largely nonuniform loops are considered. We find that the accuracy of the approximations when used beyond their range of applicability is strongly affected by the form of the density profile across the loop, that is observationally unknown and so must be arbitrarily imposed as part of the theoretical model. The error associated with the analytic approximations can be larger than 50% even for relatively thin nonuniform layers. This error directly affects the accuracy of approximate seismology estimates compared to actual numerical inversions. In addition, assuming different density profiles can produce noncoincident intervals of the seismic variables in inversions of the same event. The ignorance about the true shape of density variation across the loop is an important source of error that may dispute the reliability of parameters seismically inferred assuming an ad hoc density profile.

79 ASTRONOMY AND ASTROPHYSICS↗

Dark matter voids in the SDSS galaxy survey

What do we know about voids in the dark matter distribution given the Sloan Digital Sky Survey (SDSS) and assuming the ΛCDM model? Recent application of the Bayesian inference algorithm BORG to the SDSS Data Release 7 main galaxy sample has generated detailed Eulerian and Lagrangian representations of the large-scale structure as well as the possibility to accurately quantify corresponding uncertainties. Building upon these results, we present constrained catalogs of voids in the Sloan volume, aiming at a physical representation of dark matter underdensities and at the alleviation of the problems due to sparsity and biasing on galaxy void catalogs. To do so, we generate data-constrained reconstructions of the presently observed large-scale structure using a fully non-linear gravitational model. We then find and analyze void candidates using the VIDE toolkit. Our methodology therefore predicts the properties of voids based on fusing prior information from simulations and data constraints. For usual void statistics (number function, ellipticity distribution and radial density profile), all the results obtained are in agreement with dark matter simulations. Our dark matter void candidates probe a deeper void hierarchy than voids directly based on the observed galaxies alone. The use of our catalogs therefore opens the way to high-precision void cosmology at the level of the dark matter field. We will make the void catalogs used in this work available at http://www.cosmicvoids.net.

79 ASTRONOMY AND ASTROPHYSICS↗

Generalized framework for likelihood-based field-level inference of growth rate from velocity and density fields

Measuring the growth rate of large-scale structures ( f ) as a function of redshift has the potential to break degeneracies between modified gravity and dark energy models, when combined with expansion-rate probes. Direct estimates of peculiar velocities of galaxies have attracted interest as a means of estimating fσ 8 . In particular, field-level methods can be used to fit the field nuisance parameter along with cosmological parameters simultaneously. This article aims to provide the community with a unified framework for the theoretical modeling of the likelihood-based field-level inference by performing fast field covariance calculations for velocity and density fields. Our purpose is to lay the foundations for a nonlinear extension of the likelihood-based method at the field level. We have developed a generalized framework, implemented in the dedicated software flip to perform a likelihood-based inference of fσ 8 . We derived a new field covariance model, which includes wide-angle corrections. We also included the models previously described in the literature inside our framework. We compared their performance against ours, and we validated our model by comparing it with the two-point statistics of a recent N-body simulation. The tests we performed have allowed us to validate our software and determine the appropriate wavenumber range to integrate our covariance model and its validity in terms of separation. Our framework allows for a wider wavenumber coverage to be used in our calculations than in previous works, which is particularly interesting for nonlinear model extensions. Finally, our generalized framework allows us to efficiently perform a survey geometry-dependent Fisher forecast of the fσ 8 parameter. We show that the Fisher forecast method we developed gives an error bar that is 30% closer to a full likelihood-based estimation than a standard volume Fisher forecast.

Ravoux, Corentin↗

Hybrid Star Models in the Light of New Multimessenger Data

Abstract Recent astrophysical mass inferences of compact stars HESS J1731-347 and PSR J0952-0607, with extremely small and large masses respectively, as well as the measurement of the neutron skin of Ca in the CREX experiment challenge and constrain the models of dense matter. We examine the concept of hybrid stars—objects containing quark cores surrounded by nucleonic envelopes—as models that account for these new data along with other inferences. We employ a family of 81 nucleonic equations of state (EOSs) with variable skewness and slope of symmetry energy at saturation density and a constant speed-of-sound EOS for quark matter. For each nucleonic EOS, a family of hybrid EOSs is generated by varying the transition density, the energy jump, and the speed of sound. These models are tested against the data from GW170817 and J1731-347, which favor low-density soft EOS and J0592-0607 and J0740+6620, which require high-density stiff EOS. The addition of J0592-0607's mass measurement to the constraints has no significant impact on the parameter space of the admissible EOS, but allows us to explore the potential effect of pulsars more massive than J0740+6620, if such exists. We then examine the occurrence of twin configurations and quantify the ranges of masses and radii that they can possess. It is shown that including J1731-347 data favors EOSs that predict low-mass twins with M ≲ 1.3 M ⊙ that can be realized if the deconfinement transition density is low. If combined with large speed of sound in quark matter such models allow for maximum masses of hybrid stars in 2.0–2.6 M ⊙ .

Astronomy & Astrophysics↗

Quantification and prediction of solidification textures under additive manufacturing conditions

Crystallographic textures are a major determinant of the macroscale anisotropic properties of polycrystalline metallic alloys produced in a wide range of additive manufacturing (AM) processes. Here, we introduce a statistical method that can accurately quantify the degree of orientational order of textures despite the large random fluctuations in the orientation of individual grains inherent in AM processes. The method, demonstrated for laser and resolidification of AlSi thin films, extends Z-scoring to a dynamical regime to assess the statistical significance of observed textures compared to randomly generated ones at different stages of solidification. We further show that, combined with phase-field modeling, this method can be used to infer fundamental anisotropic properties of the solid-liquid interface that are essential for texture prediction, and are compared here to the results of atomistic simulations. In addition, phase-field modeling reveals that, even at rapid AM solidification rates, the observed 〈110〉-dominated textures in the AlSi thin films are controlled predominantly by the anisotropy of the interface free-energy and sheds light on the physical mechanism of grain competition. These results significantly enhance both the existing tools for the quantification and prediction of AM crystallographic textures and our basic understanding of their formation.

36 MATERIALS SCIENCE↗

Interpreting and Accelerating Transformers for Jet Tagging

Attention-based transformers are ubiquitous in machine learning applications from natural language processing to computer vision. In high energy physics, one central application is to classify collimated particle showers in colliders based on the particle of origin, known as jet tagging. In this work, we study the interpretatbility and prospects for acceleration of Particle Transformer (ParT), a state-of-the-art model, leverages particle-level attention to improve jet-tagging performance. We analyzing ParT's attention maps and particle-pair correlations in the eta-phi plane, revealing intriguing features, such as a binary attention pattern that identifies critical substructure in jets. These insights enhance our understanding of the model's internal workings and learning process and hint at ways to improve its efficiency. Along these lines, we also explore low-rank attention, attention alternatives, and dynamic quantization to accelerate transformers for jet tagging. With quantization, we achieve a 50% reduction in model size and a 10% increase in inference speed without compromising accuracy. These combined efforts enhance both the performance and the interpretability of transformers in high-energy physics, opening avenues for more efficient and physics-driven model designs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Kepler’S supernova: An OVERLUMINOUS type Ia event interacting with a massive circumstellar medium at a very late phase

We have analyzed XMM-Newton, Chandra, and Suzaku observations of three similarly aged, ejecta-dominated supernova remnants (SNRs), Kepler's SNR, Tycho's SNR, and SNR 0509-67.5, to investigate the properties of the SN ejecta and the circumstellar medium (CSM). By simply comparing the X-ray spectra, we find that line intensity ratios of iron-group elements (IGEs) to intermediate-mass elements (IMEs) for Kepler's SNR and SNR 0509-67.5 are much higher than those for Tycho's SNR. Given that Tycho's SNR and SNR 0509-67.5 are thought to be the remnants of a typical SN Ia and an overluminous SN Ia, respectively, we argue that Kepler is the product of an overlumious SN Ia. This inference is supported by our spectral modeling, which reveals the IGE and IME masses, respectively, to be 0.95{sub −0.37}{sup +0.34} M{sub ⊙} and 0.12{sub −0.05}{sup +0.19} M{sub ⊙} (Kepler's SNR), 0.75{sub −0.15}{sup +0.51} M{sub ⊙} and 0.34{sub −0.25}{sup +0.08} M{sub ⊙} (SNR 0509-67.5), and 0.35{sub −0.15}{sup +0.55} M{sub ⊙} and 0.70{sub −0.28}{sup +0.12} M{sub ⊙} (Tycho's SNR). We find that the CSM component in Kepler's SNR consists of tenuous diffuse gas (∼0.3 M{sub ⊙}) present throughout the entire remnant, plus dense knots (∼0.035 M{sub ⊙}). Since both of them show N overabundance, their origin would be CNO-processed material from the progenitor system. The mass of the diffuse CSM allows us to infer the pre-SN mass-loss rate to be ∼1.5×10{sup −5}(v{sub w}/10 km s{sup −1}) M{sub ⊙} yr{sup −1}. The dense knots have slow proper motions and relatively small ionization timescales; hence, they were likely located a few parsecs away from the progenitor at the explosion. We thus argue that Kepler's SN was an overluminous (91T-like) event that recently started to interact with the massive CSM. This supports the possible link between 91T-like SNe and “Ia-CSM” SNe.

79 ASTRONOMY AND ASTROPHYSICS↗

MEAN AGE GRADIENT AND ASYMMETRY IN THE STAR FORMATION HISTORY OF THE SMALL MAGELLANIC CLOUD

We derive the star formation history (SFH) in four regions of the Small Magellanic Cloud (SMC) using the deepest VI color-magnitude diagrams (CMDs) ever obtained for this galaxy. The images were obtained with the Advanced Camera for Surveys on board the Hubble Space Telescope (HST) and are located at projected distances of 0.°5-2° from the SMC center, probing the main body and the wing of the galaxy. We derived the SFHs of the four fields using two independent procedures to fit synthetic CMDs to the data. We compare the SFHs derived here with our earlier results for the SMC bar to create a deep pencil-beam survey of the global history of the central SMC. We find in all the six fields observed with HST a slow star formation (SF) pace from 13 to 5-7 Gyr ago, followed by a ≈2-3 times higher activity. This is remarkable because dynamical models do not predict a strong influence of either the Large Magellanic Cloud (LMC) or the Milky Way at that time. The level of the intermediate-age SF rate enhancement systematically increases toward the center, resulting in a gradient in the mean age of the population, with the bar fields being systematically younger than the outer ones. SF over the most recent 500 Myr is strongly concentrated in the bar, the only exception being the area of the SMC wing. The strong current activity of the latter is likely driven by interaction with the LMC. At a given age, there is no significant difference in metallicity between the inner and outer fields, implying that metals are well mixed throughout the SMC. The age-metallicity relations we infer from our best-fitting models are monotonically increasing with time, with no evidence of dips. This may argue against the major merger scenario proposed by Tsujimoto and Bekki in 2009, although a minor merger cannot be ruled out.

79 ASTRONOMY AND ASTROPHYSICS↗

Understanding protein-complex assembly through grand canonical maximum entropy modeling

Inside a cell, heterotypic proteins assemble in inhomogeneous, crowded systems where the abundance of these proteins vary with cell types. While some protein complexes form putative structures that can be visualized with imaging, there are far more protein complexes that are yet to be solved because of their dynamic associations with one another. Nevertheless, it is possible to infer these protein complexes through a physical model. However, it is often not clear to physicists what kind of data from biology is necessary for such a modeling endeavor. Here, we aim to model these clusters of coarse-grained protein assemblies from multiple subunits through the constraints of interactions among the subunits and the chemical potential of each subunit. We obtained the constraints on the interactions among subunits from the known protein structures. We inferred the chemical potential that dictates the particle number distribution of each protein subunit from the knowledge of protein abundance from experimental data. Guided by the maximum entropy principle, we formulated an inverse statistical mechanical method to infer the distribution of particle numbers from the data of protein abundance as chemical potentials for a grand canonical multicomponent mixture. Using grand canonical Monte Carlo simulations, we captured a distribution of high-order clusters in a protein complex of succinate dehydrogenase with four known subunits. The complexity of hierarchical clusters varies with the relative protein abundance of each subunit in distinctive cell types such as lung, heart, and brain. When the crowding content increases, we observed that crowding stabilizes emergent clusters that do not exist in dilute conditions. We, therefore, proposed a testable hypothesis that the hierarchical complexity of protein clusters on a molecular scale is a plausible biomarker of predicting the phenotypes of a cell.

59 BASIC BIOLOGICAL SCIENCES↗

GCoD: Graph Convolutional Network Acceleration via Dedicated Algorithm and Accelerator Co-Design

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art graph learning model. However, it remains notoriously challenging to inference GCNs over large graph datasets, limiting their application to large real-world graphs and hindering the exploration of deeper and more sophisticated GCN graphs. This is because real-world graphs can be extremely large and sparse. Furthermore, the node degree of GCNs tends to follow the power-law distribution and therefore have highly irregular adjacency matrices, resulting in prohibitive inefficiencies in both data processing and movement and thus substantially limiting the achievable GCN acceleration efficiency. To this end, this paper proposes the first GCN algorithm and accelerator Co-Design framework dubbed GCoD which can largely alleviate the aforementioned GCN irregularity and boost GCNs' inference efficiency. Specifically, on the algorithm level, GCoD integrates a divide and conquer GCN training strategy that polarizes the graphs to be either denser or sparser in local neighborhoods without compromising the model accuracy, resulting in graph adjacency matrices that (mostly) have merely two levels of workload and enjoys largely enhanced regularity and thus ease of acceleration. On the hardware level, we further develop a dedicated two-pronged accelerator with a separated engine to process each of the aforementioned workloads, further boosting the overall utilization and acceleration efficiency. Extensive experiments and ablation studies validate that our GCoD consistently outperforms state-of-the-art designs in terms of accelerator efficiency while maintaining or even improving the task accuracy. Additionally, we visualize GCoD trained graph adjacency matrices to better understand its advantages. All codes and pre-trained models will be released upon acceptance.

You, Haoran↗

Impact of three-dimensional hot-spot flow asymmetry on ion-temperature measurements in inertial confinement fusion experiments

Three-dimensional (3-D) implosion asymmetries lead to signficant variations in ion-temperature measurements in inertial confinement fusion experiments. We present an analytical method to generalize the physical properties of velocity variance in the Brysk ion-temperature model. This analysis provides a consistent explanation for the 3-D effects of inferred ion-temperature variations for various single modes and multimodes modeled by the deceleration-phase hydrocode DEC3D and the neutron transport code IRIS3D . The effect of the hot-spot ow asymmetry on variations in ion-temperature measurement is shown uniquely determined by a complete set of six hot-spot flow parameters. An approximated solution to the minimum inferred ion temperature is derived and shown to be close to the thermal ion temperature for low mode l = 1, which exhibits the largest anisotropic velocity variance in the single-mode spectrum. In conclusion, the isotropic velocity variance for low mode l = 2 is shown to result in the minimum inferred ion temperatures being well above the thermal ion temperature.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Are Terrestrial Biosphere Models Fit for Simulating the Global Land Carbon Sink?

The Global Carbon Project estimates that the terrestrial biosphere has absorbed about one-third of anthropogenic CO 2 emissions during the 1959–2019 period. This sink-estimate is produced by an ensemble of terrestrial biosphere models and is consistent with the land uptake inferred from the residual of emissions and ocean uptake. The purpose of our study is to understand how well terrestrial biosphere models reproduce the processes that drive the terrestrial carbon sink. One challenge is to decide what level of agreement between model output and observation-based reference data is adequate considering that reference data are prone to uncertainties. To define such a level of agreement, we compute benchmark scores that quantify the similarity between independently derived reference data sets using multiple statistical metrics. Models are considered to perform well if their model scores reach benchmark scores. Our results show that reference data can differ considerably, causing benchmark scores to be low. Model scores are often of similar magnitude as benchmark scores, implying that model performance is reasonable given how different reference data are. While model performance is encouraging, ample potential for improvements remains, including a reduction in a positive leaf area index bias, improved representations of processes that govern soil organic carbon in high latitudes, and an assessment of causes that drive the inter-model spread of gross primary productivity in boreal regions and humid tropics. The success of future model development will increasingly depend on our capacity to reduce and account for observational uncertainties.

58 GEOSCIENCES↗

System risk quantification and decision making support using functional modeling and dynamic Bayesian network

Risk-informed decision-making requires a probabilistic assessment of the likelihood of success of control action, given the system status. This paper presents a systematic state transition modeling approach integrating dynamic probabilistic risk assessment with a decision-making process using a dynamic Bayesian network (DBN) coupled with functional modeling. A functional model designed with multilevel flow modeling (MFM) technique was used to build a system state structure inferred by energy, mass, and information flow so that one can verify the developed model with respect to system functionality. The MFM model represents the causal relationship among the nodes, which captures the structure of process parameters and control units. Each node may have multiple possible states, and the DBN structured by the MFM model represents the time-domain transitions among the defined states. Furthermore, the MFM-DBN integrated state transition modeling is a white-box approach that allows one to draw the system's risk profile by updating the system states and supports the decisions probabilistically with physical inference. An example of a simple heating system has been used to illustrate this process, including decision-making support based on quantitative risk profile. For demonstrating its applicability to a complex system operational decision making, a case study of station blackout accident scenario leading to the seal loss of coolant accident in a nuclear power plant is presented. The proposed approach effectively provided the risk profile along time for each option so that the operators can make the best decision, which minimizes the plant risk.

42 ENGINEERING↗

Topological Interpretability for Deep Learning

With the growing adoption of AI-based systems across everyday life, the need to understand their decision-making mechanisms is correspondingly increasing. The level at which we can trust the statistical inferences made from AI-based decision systems is an increasing concern, especially in high-risk systems such as criminal justice or medical diagnosis, where incorrect inferences may have tragic consequences. Despite their successes in providing solutions to problems involving real-world data, deep learning (DL) models cannot quantify the certainty of their predictions. These models are frequently quite confident, even when their solutions are incorrect. This work presents a method to infer prominent features in two DL classification models trained on clinical and non-clinical text by employing techniques from topological and geometric data analysis. We create a graph of a model's feature space and cluster the inputs into the graph's vertices by the similarity of features and prediction statistics. We then extract subgraphs demonstrating high-predictive accuracy for a given label. These subgraphs contain a wealth of information about features that the DL model has recognized as relevant to its decisions. We infer these features for a given label using a distance metric between probability measures, and demonstrate the stability of our method compared to the LIME and SHAP interpretability methods. This work establishes that we may gain insights into the decision mechanism of a DL model. This method allows us to ascertain if the model is making its decisions based on information germane to the problem or identifies extraneous patterns within the data.

Spannaus, Adam↗

Distributed-Memory Sparse Deep Neural Network Inference Using Global Arrays

Partitioned Global Address Space (PGAS) models exhibit tremendous promise in developing efficient and productive distributed-memory parallel applications. They have been used extensively in scientific computations due to conveniently offering a ``shared-memory''-like model and convenient interfaces that separate communication with synchronization. Traditionally, PGAS communication models have been applied to dense/contiguously distributed data, but most modern applications depict varied levels of sparsity. Existing PGAS models require certain adaptations to support distributed sparse computations, since associated computations often require matrix arithmetic, in addition to data movement. The Global Arrays toolkit from Pacific Northwest National Laboratory (PNNL) is one of the earliest PGAS models to combine one-sided data communication and distributed matrix operations and is still used in the popular NWChem quantum chemistry suite. Recently, we have expanded the Global Arrays toolkit to support common sparse operations, like sparse matrix-dense matrix multiplies (SpMM), sparse matrix-sparse matrix multiplication (SpGEMM) and Sampled Dense-Dense Matrix Multiplication (SDDMM). As it turns out, these operations are the bedrock of sparse Deep Learning (DL); sparse deep neural networks and Graph Neural Networks (GNNs) have gained increasing attention recently in achieving speedups on training and inference with reduced memory footprints. Unlike scientific applications in High Performance Computing (HPC), modern (distributed-memory capable) DL toolkits often rely on non-standardized and closed-source vendor software optimizations, creating challenges in software-hardware co-design at scale. Our goal is to support a variety of distributed-memory sparse matrix operations and helper functions in the newly created Sparse Global Arrays (SGA), such that it is possible to build portable and productive Machine Learning scenarios for algorithm/software and hardware codesign purposes. Contemporary data-parallel schemes for training/inference are undergoing a major overhaul since model replication limits scalability and causes resource inefficiencies. As such, we have adopted tensor parallelism in decomposing the model and inputs, to mitigate memory issues. Current implementation is built on top of MPI and uses CPUs to maximize the portability across the platforms.

Distributed computing, machine learning↗

Differentiable stochastic halo occupation distribution

ABSTRACT In this work, we demonstrate how differentiable stochastic sampling techniques developed in the context of deep reinforcement learning can be used to perform efficient parameter inference over stochastic, simulation-based, forward models. As a particular example, we focus on the problem of estimating parameters of halo occupation distribution (HOD) models that are used to connect galaxies with their dark matter haloes. Using a combination of continuous relaxation and gradient re-parametrization techniques, we can obtain well-defined gradients with respect to HOD parameters through discrete galaxy catalogue realizations. Having access to these gradients allows us to leverage efficient sampling schemes, such as Hamiltonian Monte Carlo, and greatly speed up parameter inference. We demonstrate our technique on a mock galaxy catalogue generated from the Bolshoi simulation using a standard HOD model and find near-identical posteriors as standard Markov chain Monte Carlo techniques with an increase of ∼8× in convergence efficiency. Our differentiable HOD model also has broad applications in full forward model approaches to cosmic structure and cosmological analysis.

79 ASTRONOMY AND ASTROPHYSICS↗