Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Uncertainty-refined image segmentation under domain shift

A method for digital image segmentation is provided. The method comprises training a neural network for image segmentation with a labeled training dataset from a first domain, wherein a subset of nodes in the neural net are dropped out during training. The neural network receives image data from a second, different domain. A vector of N values that sum to 1 is calculated for each image element, wherein each value represents an image segmentation class. A label is assigned to each image element according to the class with the highest value in the vector. Multiple inferences are performed with active dropout layers for each image element, and an uncertainty value is generated for each image element. The label of any image element with an uncertainty value above a predefined threshold is replaced with a new label corresponding to the class with the next highest value.

Martinez, Carianne↗

Uncertainty-refined image segmentation under domain shift

Digital image segmentation is provided. The method comprises training a neural network for image segmentation with a labeled training dataset from a first domain, wherein a subset of nodes in the neural net are dropped out during training. The neural network receives image data from a second, different domain. A vector of N values that sum to 1 is calculated for each image element, wherein each value represents an image segmentation class. A label is assigned to each image element according to the class with the highest value in the vector. Multiple inferences are performed with active dropout layers for each image element, and an uncertainty value is generated for each image element. Uncertainty is resolved according to expected characteristics. The label of any image element with an uncertainty above a threshold is replaced with a new label corresponding to a segmentation class based on domain knowledge.

Martinez, Carianne↗

Dark Energy Survey Year 3 results: optimized $w$CDM simulation-based inference with weak lensing map-level hybrid statistics

We present cosmological constraints from the Dark Energy Survey Year 3 (DES Y3) weak lensing data using hierarchical hybrid statistics within a Bayesian simulation-based inference framework that is based on the Gower Street simulations. To maximize the precision of the inference, we have developed a new, information-theory based, data compression of the weak lensing maps to just seven highly informative summary statistics. The hybrid scheme exploits the high information content of the power spectrum, compressing both the power spectrum and neural-based summaries that are designed to extract further information. Our simulation-based approach enables principled forward modelling of all major sources of systematic uncertainty and survey properties into realistic mock observations, including the survey mask, photometric redshift uncertainties, intrinsic galaxy alignments, multiplicative shear calibration bias, source galaxy clustering, non-Gaussian shape noise, and non-linear structure formation. The summary statistics are then used in a Bayesian simulation-based inference pipeline. The inference is validated through coverage tests and checks for robustness against baryonic feedback. Assuming a $w$CDM cosmology, our analysis yields $S_8 = 0.808 \pm 0.017$, $Ω_{\rm m} = 0.325 \pm 0.024$, and $w < -0.766$ (marginalized posterior 68 per cent credible intervals). This rigorous combination of information theory, physics- and neural network-based extreme data compression, and principled Bayesian analysis improves the figure of merit for $(Ω_{\rm m}, S_8, w)$ by 60 per cent over the previous state-of-the-art, and by almost a factor of 3 over two-point analyses of the same data. They are the most precise joint constraints on $(Ω_{\rm m}, S_8, w)$ from weak gravitational lensing data alone of any survey to date. We intend to apply this analysis to the more recent DES Y6 data.

Williamson, J. [University Coll. London]↗

Extending Symmetry-Preserving Attention Networks (SPANet) for Jet Assignment in Fully Hadronic \(t\bar{t}\) Events

Fully hadronic \(t\bar{t}\) reconstruction requires assigning reconstructed jets to the two top-quark decay branches, \(t\bar{t}\to(Wb)(Wb)\to(qqb)(qqb)\). This is a combinatorially large, symmetry-rich, and frequently underconstrained set-assignment problem due to detector effects and partial reconstructability. SPANet provides a strong symmetry-preserving baseline for this task, but its standard inference eagerly commits to a single hypothesis and does not explicitly treat branch-level reconstructability decisions. We present a two-stage extension of the SPANet pipeline for fully hadronic \(t\bar{t}\) events: (i) SPANet is modified into a proposal model that generates a shortlist of candidate jet assignments; (ii) a custom dual-head set transformer is trained to re-rank these candidates and identify reconstructible branches. Our extension gives modest improvements in candidate-selection efficiency, with SPANet achieving \(69.9\%\) and our extension achieving \(71.1\%\). Finally, an oracle study of the generated shortlist shows a substantial upper bound of \(88.5\%\) on the evaluated fully reconstructable subset, suggesting that the shortlist contains significant residual information that is not fully exploited.

Lisondodi Tada, Mateo [Puerto Rico U., Mayaguez] (↗

Horizontal crustal motion in the central and eastern Mediterranean inferred from Satellite Laser Ranging measurements

Four campaigns to acquire Satellite Laser Ranging (SLR) measurements at sites in the Mediterranean region have been completed. These measurements to the LAGEOS satellite, made largely by mobile systems, cover a time span beginning in November 1985 and ending in June 1993. The range data from 18 sites in the central and eastern Mediterranean have been simultaneously analyzed with data acquired by the remainder of the global laser tracking network. Estimates of horizontal motion were placed into a regional, northern Europe-fixed, kinematic reference frame. Uncertainties are on the order of 5 mm/yr for sites having at least four occupations by mobile systems and approach 1 mm/yr for permanently located sites with long histories of tracking. The resulting relative motion between sites in the Aegean exhibit characteristics of broadly distributed pattern of radial extension, but at rates that are about 50% larger than those implied from studies of seismic strain rates based on seismicity of magnitude 6 or greater or across the region. The motion estimated for sites in Turkey exhibit velocity components associated with the westward motion of the Anatolian Block relative to Eurasia. These results provide a present-day 'snapshot' of ongoing deformational processes as experienced by the locations occupied by SLR systems.

Smith, David E.↗

Insights into cosmological structure formation with machine learning.

Our modern understanding of cosmological structure formation posits that small matter density fluctuations present in the early Universe, as traced by the cosmic microwave background, grow via gravitational instability to form extended haloes of dark matter. A theoretical understanding of the structure, evolution and formation of dark matter haloes is an essential step towards unravelling the intricate connection between halo and galaxy formation, needed to test our cosmological model against data from upcoming galaxy surveys. Physical understanding of the process of dark matter halo formation is made difficult by the highly non-linear nature of the haloes' evolution. I describe a new approach to gain physical insight into cosmological structure formation based on machine learning. This approach combines the ability of machine learning algorithms to learn non-linear relationships, with techniques that enable us to physically interpret the learnt mapping. I describe applicatio ns of th e method, with the aim of investigating which aspects of the early universe density field impact the later formation of dark matter haloes. First I present a case where the process of halo formation is turned into a binary classification problem; the algorithm predicts whether or not dark matter `particles' in the initial conditions of a simulation will collapse into haloes of a given mass range. Second, I present its generalization to regression, where the algorithm infers the final mass of the halo to which each particle will later belong. I show that the initial tidal shear does not play a significant role compared to the initial density field in establishing final halo masses. Finally, I demonstrate that extending the framework to deep learning algorithms such as convolutional neural networks allows us to explore connections between the early universe and late time haloes beyond those studied by existing analytic approximations of halo collapse.

79 ASTRONOMY AND ASTROPHYSICS↗

Representing Complex Systems as Graphs for Debugging and Predictive Maintenance-Preliminary Thoughts

Representing complex systems as graphs enables use of mathematical tools to identify faults or predict failures. Graph nodes correspond to individual modules or subsystems, and edges link coupled system parts. ‘Probes’ measure the node outputs, monitoring the system health for unexpected behavior. Assuming one cannot probe every point, within a system, the fault correlates to a region—not necessarily the specific location. Bayesian networks trained to understand fault patterns can accurately identify the source. The diagnostic tool described aides debugging by pinpointing system failure causes. For predictive maintenance, probe data develop probability distribution functions describing subsystem mean time to failure. Unit lifetime can be estimated through these probability distributions. Two approaches include using Bayesian classifiers to infer the system failure source and developing maintenance schedules by treating systems as collections of random variables. When failure behavior does not follow a closed form function, use of similarity models is proposed.

97 MATHEMATICS AND COMPUTING↗

The Geology of Pluto and Charon as Revealed by New Horizons

NASA's New Horizons spacecraft has revealed that Pluto and Charon exhibit strikingly different surface appearances, despite their similar densities and presumed bulk compositions. Much of Pluto's surface can be attributed to surface-atmosphere interactions and the mobilization of volatile ices by insolation. Many valley systems appear to be the consequence of glaciation involving nitrogen ice. Other geological activity requires or required internal heating. The convection and advection of volatile ices in Sputnik Planum can be powered by present-day radiogenic heat loss. On the other hand, the prominent mountains at the western margin of Sputnik Planum, and the strange, multi-km-high mound features to the south, probably composed of H2O, are young geologically as inferred by light cratering and superposition relationships. Their origin, and what drove their formation so late in Solar System history, is under investigation. The dynamic remolding of landscapes by volatile transport seen on Pluto is not unambiguously evident on Charon. Charon does, however, display a large resurfaced plain and globally engirdling extensional tectonic network attesting to its early endogenic vigor.

New Horizons↗

The Geology of Pluto and Charon as Revealed by New Horizons

NASA's New Horizons spacecraft has revealed that Pluto and Charon exhibit strikingly different surface appearances, despite their similar densities and presumed bulk compositions. Much of Pluto's surface can be attributed to surface-atmosphere interactions and the mobilization of volatile ices by insolation. Many valley systems appear to be the consequence of glaciation involving nitrogen ice. Other geological activity requires or required internal heating. The convection and advection of volatile ices in Sputnik Planum can be powered by present-day radiogenic heat loss. On the other hand, the prominent mountains at the western margin of Sputnik Planum, and the strange, multi-km-high mound features to the south, probably composed of H2O, are young geologically as inferred by light cratering and superposition relationships. Their origin, and what drove their formation so late in Solar System history, is under investigation. The dynamic remolding of landscapes by volatile transport seen on Pluto is not unambiguously evident on Charon. Charon does, however, display a large resurfaced plain and globally engirdling extensional tectonic network attesting to its early endogenic vigor.

Moore, Jefrey M.↗

EFIT-Prime: Probabilistic and physics-constrained reduced-order neural network model for equilibrium reconstruction in DIII-D

We introduce EFIT-Prime, a novel machine learning surrogate model for EFIT (Equilibrium FIT) that integrates probabilistic and physics-informed methodologies to overcome typical limitations associated with deterministic and ad hoc neural network architectures. EFIT-Prime utilizes a neural architecture search-based deep ensemble for robust uncertainty quantification, providing scalable and efficient neural architectures that comprehensively quantify both data and model uncertainties. Physically informed by the Grad–Shafranov equation, EFIT-Prime applies a constraint on the current density J tor and a smoothness constraint on the first derivative of the poloidal flux, ensuring physically plausible solutions. Furthermore, the spatial location of the diagnostics is explicitly incorporated in the inputs to account for their spatial correlation. Extensive evaluations demonstrate EFIT-Prime's accuracy and robustness across diverse scenarios, most notably showing good generalization on negative-triangularity discharges that were excluded from training. Timing studies indicate an ensemble inference time of 15 ms for predicting a new equilibrium, offering the possibility of plasma control in real-time, if the model is optimized for speed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Exploring Li-Ion Transport Properties of Li 3 TiCl 6 : A Machine Learning Molecular Dynamics Study

We performed large-scale molecular dynamics simulations based on a machine-learning force field (MLFF) to investigate the Li-ion transport mechanism in cation-disordered Li 3 TiCl 6 cathode at six different temperatures, ranging from 25°C to 100°C. In this work, deep neural network method and data generated by ab − initio molecular dynamics (AIMD) simulations were deployed to build a high-fidelity MLFF. Radial distribution functions, Li-ion mean square displacements (MSD), diffusion coefficients, ionic conductivity, activation energy, and crystallographic direction-dependent migration barriers were calculated and compared with corresponding AIMD and experimental data to benchmark the accuracy of the MLFF. From MSD analysis, we captured both the self and distinct parts of Li-ion dynamics. The latter reveals that the Li-ions are involved in anti-correlation motion that was rarely reported for solid-state materials. Similarly, the self and distinct parts of Li-ion dynamics were used to determine Haven’s ratio to describe the Li-ion transport mechanism in Li 3 TiCl 6 . Obtained trajectory from molecular dynamics infers that the Li-ion transportation is mainly through interstitial hopping which was confirmed by intra- and inter-layer Li-ion displacement with respect to simulation time. Ionic conductivity (1.06 mS/cm) and activation energy (0.29eV) calculated by our simulation are highly comparable with that of experimental values. Overall, the combination of machine-learning methods and AIMD simulations explains the intricate electrochemical properties of the Li 3 TiCl 6 cathode with remarkably reduced computational time. Thus, our work strongly suggests that the deep neural network-based MLFF could be a promising method for large-scale complex materials.

Selvaraj, Selva Chandrasekaran (ORCID:000000029023↗

Evaluating the Potential and Challenges of an Uncertainty Quantification Method for Long Short–Term Memory Models for Soil Moisture Predictions

Recently, recurrent deep networks have shown promise to harness newly available satellite–sensed data for long–term soil moisture projections. However, to be useful in forecasting, deep networks must also provide uncertainty estimates. Here we evaluated Monte Carlo dropout with an input–dependent data noise term (MCD+N), an efficient uncertainty estimation framework originally developed in computer vision, for hydrologic time series predictions. MCD+N simultaneously estimates a heteroscedastic input–dependent data noise term (a trained error model attributable to observational noise) and a network weight uncertainty term (attributable to insufficiently constrained model parameters). Although MCD+N has appealing features, many heuristic approximations were employed during its derivation, and rigorous evaluations and evidence of its asserted capability to detect dissimilarity were lacking. To address this, we provided an in–depth evaluation of the scheme's potential and limitations. We showed that for reproducing soil moisture dynamics recorded by the Soil Moisture Active Passive (SMAP) mission, MCD+N indeed gave a good estimate of predictive error, provided that we tuned a hyperparameter and used a representative training data set. The input–dependent term responded strongly to observational noise, while the model term clearly acted as a detector for physiographic dissimilarity from the training data, behaving as intended. However, when the training and test data were characteristically different, the input–dependent term could be misled, undermining its reliability. Additionally, due to the data–driven nature of the model, data noise also influences network weight uncertainty, and therefore the two uncertainty terms are correlated. Altogether, this approach has promise, but care is needed to interpret the results.

54 ENVIRONMENTAL SCIENCES↗

Generative modeling enables molecular structure retrieval from Coulomb explosion imaging

Capturing the structural changes that molecules undergo during chemical reactions in real space and time is a long-standing dream and an essential prerequisite for understanding and ultimately controlling femtochemistry. A key approach to tackle this challenging task is Coulomb explosion imaging, which benefited decisively from recently emerging high-repetition-rate X-ray free-electron laser sources. With this technique, information on the molecular structure is inferred from the momentum distributions of the ions produced by the rapid Coulomb explosion of molecules. Retrieving molecular structures from these distributions poses a highly non-linear inverse problem that remains unsolved for molecules consisting of more than a few atoms. Here, we address this challenge using a diffusion-based Transformer neural network. We show that the network reconstructs unknown molecular geometries from ion-momentum distributions with a mean absolute error below one Bohr radius, which is half the length of a typical chemical bond.

Artificial Intelligence (cs.AI)↗

An isolated water droplet in the aqueous solution of a supramolecular tetrahedral cage

Water under nanoconfinement at ambient conditions has exhibited low-dimensional ice formation and liquid–solid phase transitions, but with structural and dynamical signatures that map onto known regions of water’s phase diagram. Using terahertz (THz) absorption spectroscopy and ab initio molecular dynamics, we have investigated the ambient water confined in a supramolecular tetrahedral assembly, and determined that a dynamically distinct network of 9 ± 1 water molecules is present within the nanocavity of the host. The low-frequency absorption spectrum and theoretical analysis of the water in the Ga 4 L 6 12– host demonstrate that the structure and dynamics of the encapsulated droplet is distinct from any known phase of water. A further inference is that the release of the highly unusual encapsulated water droplet creates a strong thermodynamic driver for the high-affinity binding of guests in aqueous solution for the Ga 4 L 6 12– supramolecular construct.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

How earthquakes organize stress

Stress is not uniform in the Earth. Therefore, we must use natural experiments to measure the distribution of stresses and related quantities, rather than single values. For instance, dynamic triggering shows that faults are uniformly distributed over their loading cycles in Southern California. The probability that a fault ruptures across a barrier measures the in situ energy distribution. Fault roughness reflects the distribution of strength. These natural experiments produce observable distributions that are surprisingly consistent and suggest some degree of self-organization in the Earth’s crust. Once established, the functional form of the distributions can be used to track changes in response to earthquakes as well as to distinguish fundamentally different fault systems. Transient fault locking before stress release in laboratory experiments can be interpreted as a consequence of self-organization of fault stress. The robust self-organization of multiple variables in earthquake systems suggests that the most consequential mechanical outcome of earthquakes may be the redistribution of stress and the strain energy associated with it. The low friction on a fault during seismic slip as inferred by temperature measurements of the Tohoku earthquake is consistent with dissipation playing a secondary role to this redistribution process. Through stress redistribution and interaction, subduction zone faults tend to synchronize, perhaps due to their geometric simplicity, while the continental system of Southern California cannot synchronize, perhaps due to the complexity of the fault network. Earthquakes organize stress in the crust and produce a suite of well-defined, consistent distributions.

earthquakes↗

Integration of object-oriented knowledge representation with the CLIPS rule based system

The paper describes a portion of the work aimed at developing an integrated, knowledge based environment for the development of engineering-oriented applications. An Object Representation Language (ORL) was implemented in C++ which is used to build and modify an object-oriented knowledge base. The ORL was designed in such a way so as to be easily integrated with other representation schemes that could effectively reason with the object base. Specifically, the integration of the ORL with the rule based system C Language Production Systems (CLIPS), developed at the NASA Johnson Space Center, will be discussed. The object-oriented knowledge representation provides a natural means of representing problem data as a collection of related objects. Objects are comprised of descriptive properties and interrelationships. The object-oriented model promotes efficient handling of the problem data by allowing knowledge to be encapsulated in objects. Data is inherited through an object network via the relationship links. Together, the two schemes complement each other in that the object-oriented approach efficiently handles problem data while the rule based knowledge is used to simulate the reasoning process. Alone, the object based knowledge is little more than an object-oriented data storage scheme; however, the CLIPS inference engine adds the mechanism to directly and automatically reason with that knowledge. In this hybrid scheme, the expert system dynamically queries for data and can modify the object base with complete access to all the functionality of the ORL from rules.

Logie, David S.↗

Deep Moonquake Focal Mechanisms: Recovery and Implications

A defining characteristic of deep moonquakes is their tendency to occur with tidal periodicity, prompting previous studies to infer that they are related to the buildup and release of tidal stress within the Moon. In studies of tidal forcing, a key constraint is the focal mechanism: the fault parameters describing the type of failure moonquakes represent. The quality of the lunar seismic data and the limited source/receiver geometries of the Apollo seismic network prohibit the determination of deep moonquake fault parameters using first-motion polarities, as is typically done in terrestrial seismology. Without being able to resolve tidal stress onto a known failure plane, we can examine only gross qualities of the tidal stress tensor with respect to moonquake occurrence, so we cannot fully address the role of tidal stress in moonquake generation. We will examine the extent to which shear (S) and compression (P) wave amplitude ratios can constrain moonquake fault geometry by determining whether, for a given cluster, there exists a focal mechanism that can produce a radiation pattern consistent with the amplitudes measured by the Apollo instruments. Amplitudes are read in the ray coordinate frame, directly from seismograms for which the P and S arrivals are clearly identifiable on all long-period channels of the four Apollo stations. We apply an empirical station correction to account for site effects and the differences between P- and S-wave attenuation. Instead of focusing on the best fitting solution only, we formulate the inverse problem using a falsification criterion: all source orientations that do not reproduce the observed SV/P ratios within an error margin derived from the uncertainty of amplitude readings are rejected. All others are accepted as possible solutions. The inversion is carried out using an exhaustive grid search on a regular grid with predefined step size, encompassing all possible combinations of strike, dip and slip. To assess the sensitivity of the inversion for the uncertainty of the lunar interior structure, we carry out repeated inversions with different velocity structures. Our data set consist of a total of 106 events from 25 deep moonquake clusters. The largest contribution of 37 events originates from the most active cluster, A001, while other clusters are represented by 1 to 9 events. Since the definition of a cluster implies that all events share the same source orientation, a comparison of the inversion results of all events from one cluster will reduce ambiguities of the inversion. Once we obtain a suite of fault parameters for a given source, we can attempt to further constrain the focal mechanism with refined analyses of tidal stresses and predictions based on synthetic seismograms.

Knapmeyer, Martin↗

A physics-constrained deep learning surrogate model of the runaway electron avalanche growth rate

A surrogate model of the runaway electron avalanche growth rate in a magnetic fusion plasma is developed. This is accomplished by employing a physics-informed neural network (PINN) to learn the parametric solution of the adjoint to the relativistic Fokker–Planck equation. The resulting PINN is able to evaluate the runaway probability function across a broad range of parameters in the absence of any synthetic or experimental data. This surrogate of the adjoint relativistic Fokker–Planck equation is then used to infer the avalanche growth rate as a function of the electric field, synchrotron radiation and effective charge. Predictions of the avalanche PINN are compared against first principle calculations of the avalanche growth rate with excellent agreement observed across a broad range of parameters.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗