Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Graph convolutional networks applied to unstructured flow field data

Abstract Many scientific and engineering processes produce spatially unstructured data. However, most data-driven models require a feature matrix that enforces both a set number and order of features for each sample. They thus cannot be easily constructed for an unstructured dataset. Therefore, a graph based data-driven model to perform inference on fields defined on an unstructured mesh, using a graph convolutional neural network (GCNN) is presented. The ability of the method to predict global properties from spatially irregular measurements with high accuracy is demonstrated by predicting the drag force associated with laminar flow around airfoils from scattered velocity measurements. The network can infer from field samples at different resolutions, and is invariant to the order in which the measurements within each sample are presented. The GCNN method, using inductive convolutional layers and adaptive pooling, is able to predict this quantity with a validation R 2 above 0.98, and a Normalized Mean Squared Error below 0.01, without relying on spatial structure.

Ogoke, Francis (ORCID:0000000224327783)↗

Integrating multimodal data through interpretable heterogeneous ensembles

Motivation: Integrating multimodal data represents an effective approach to predicting biomedical characteristics, such as protein functions and disease outcomes. However, existing data integration approaches do not sufficiently address the heterogeneous semantics of multimodal data. In particular, early and intermediate approaches that rely on a uniform integrated representation reinforce the consensus among the modalities but may lose exclusive local information. The alternative late integration approach that can address this challenge has not been systematically studied for biomedical problems. Results: We propose Ensemble Integration (EI) as a novel systematic implementation of the late integration approach. EI infers local predictive models from the individual data modalities using appropriate algorithms and uses heterogeneous ensemble algorithms to integrate these local models into a global predictive model. We also propose a novel interpretation method for EI models. We tested EI on the problems of predicting protein function from multimodal STRING data and mortality due to coronavirus disease 2019 (COVID-19) from multimodal data in electronic health records. We found that EI accomplished its goal of producing significantly more accurate predictions than each individual modality. It also performed better than several established early integration methods for each of these problems. The interpretation of a representative EI model for COVID-19 mortality prediction identified several disease-relevant features, such as laboratory test (blood urea nitrogen and calcium) and vital sign measurements (minimum oxygen saturation) and demographics (age). These results demonstrated the effectiveness of the EI framework for biomedical data integration and predictive modeling.

59 BASIC BIOLOGICAL SCIENCES↗

Theoretical uncertainty quantification for heavy-ion fusion

Despite recent advances and focus on rigorous uncertainty quantification for microscopic models of quantum many-body systems, the uncertainty on the dynamics of those systems has been underexplored. To address this, we have used time-dependent Hartree-Fock to examine the model uncertainty for a collection of low-energy, heavy-ion fusion reactions. Fusion reactions at near-barrier energies represent a rich test-bed for the dynamics of quantum many-body systems owing to the complex interplay of collective excitation, transfer, and static effects that determine the fusion probability of a given system. The model uncertainty is sizable for many of the systems studied and the primary contribution arises from static properties that are ill-constrained, such as the neutron radius of neutron-rich nuclei. Furthermore, these large uncertainties motivate the use of information from reactions to better constrain existing models and to infer static properties from reaction data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Probing Dark Matter Using Precision Measurements of Stellar Accelerations

Dark matter comprises the bulk of the matter in the Universe, but its particle nature and cosmological origin remain mysterious. Knowledge of the dark matter density distribution in the Milky Way Galaxy is crucial both to our understanding of the standard cosmological model and for grounding direct and indirect searches for the particles comprising dark matter. Current measurements of Galactic dark matter content rely on model assumptions to infer the forces acting upon stars from the distribution of observed velocities. Here, we propose to apply the precision radial velocity method, optimized in recent years for exoplanet astronomy, to measure the change in the velocity of stars over time, thereby providing a direct probe of the local gravitational potential in the Galaxy. Using numerical simulations, we develop a realistic strategy to observe the differential accelerations of stars in our Galactic neighborhood with next-generation telescopes, at the level of 10 –8 cm/s 2 . Our simulations show that detecting accelerations at this level with an ensemble of 10 3 stars requires the effect of stellar noise on radial velocity measurements to be reduced to < 10 cm/s. Furthermore, the measured stellar accelerations may then be used to extract the local dark matter density and morphological parameters of the density profile.

79 ASTRONOMY AND ASTROPHYSICS↗

Targeted quantification of functional enzyme dynamics in environmental samples for microbially mediated biogeochemical processes: Targeted quantification of functional enzyme dynamics

Microbially mediated biogeochemical processes are catalyzed by enzymes that control the transformation of carbon, nitrogen, and other elements in environment. The dynamic linkage between enzymes and biogeochemical species transformation has, however, rarely been investigated because of the lack of analytical approaches to efficiently and reliably quantify enzymes and their dynamics in soils and sediments. Herein, we developed a signature peptide-based technique for sensitively quantifying dissimilatory and assimilatory enzymes using nitrate-reducing enzymes in a hyporheic zone sediment as an example. Moreover, the measured changes in enzyme concentration were found to correlate with the nitrate reduction rate in a way different from that inferred from biogeochemical models based on biomass or functional genes as surrogates for functional enzymes. This phenomenon has important implications for understanding and modeling the dynamics of microbial community functions and biogeochemical processes in environments. Our results also demonstrate the importance of enzyme quantification for the identification and interrogation of those biogeochemical processes with low metabolite concentrations as a result of faster enzyme-catalyzed consumption of metabolites than their production. The dynamic enzyme behaviors provide a basis for the development of enzyme-based models to describe the relationship between the microbial community and biogeochemical processes.

Li, Minjing↗

A theoretical study on quasifission and fusion–fission processes in heavy-ion collisions

Despite recent advances and focus on rigorous uncertainty quantification for microscopic models of quantum many-body systems, the uncertainty on the dynamics of those systems has been underexplored. To address this, we have used time-dependent Hartree-Fock to examine the model uncertainty for a collection of low-energy, heavy-ion fusion reactions. Fusion reactions at near-barrier energies represent a rich test-bed for the dynamics of quantum many-body systems owing to the complex interplay of collective excitation, transfer, and static effects that determine the fusion probability of a given system. The model uncertainty is sizable for many of the systems studied and the primary contribution arises from static properties that are ill-constrained, such as the neutron radius of neutron-rich nuclei. These large uncertainties motivate the use of information from reactions to better constrain existing models and to infer static properties from reaction data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗

Density perturbation mode structure of high frequency compressional and global Alfvén eigenmodes in the National Spherical Torus Experiment using a novel reflectometer analysis technique

Reflectometry measurements of compressional (CAE) and global (GAE) Alfvén eigenmodes are analyzed to obtain the amplitude and spatial structure of the density perturbations associated with the modes. A novel analysis technique developed for this purpose is presented. The analysis also naturally yields the amplitude and spatial structure of the density contour radial displacement, which is found to be 2–4 times larger than the value estimated directly from the reflectometer measurements using the much simpler ‘mirror approximation’. The modes were driven by beam ions in a high power (6 MW) neutral beam heated H-mode discharge (#141398) in the National Spherical Torus Experiment. The results of the analysis are used to assess the contribution of the modes to core energy transport and ion heating. The total displacement amplitude of the modes, which is shown to be larger than previously estimated (Crocker et al 2013 Nucl. Fusion 53 43017), is compared to the predicted threshold (Gorelenkov et al 2010 Nucl. Fusion 50 84012) for the anomalously high heat diffusion inferred from transport modeling in similar NSTX discharges. The results of the analysis also have strong implications for the energy transport via coupling of CAEs to kinetic Alfvén waves seen in simulations with the Hybrid MHD code (Belova et al 2015 Phys. Rev. Lett. 115 15001). Finally, the amplitudes of the observed CAEs fall well below the threshold for causing significant ion heating by stochastic velocity space diffusion (Gates et al 2001 Phys. Rev. Lett. 87 205003).

Reflectometry↗

Commercial Building Energy Asset Score

This software (Asset Scoring Tool) is designed to help building owners and managers to gain insight into the as-built efficiency of their buildings. It is a web tool where users can enter their building information and obtain an asset score report. The asset score report consists of modeled building energy use (by end use and by fuel type), building systems (envelope, lighting, heating, cooling, service hot water) evaluations, and recommended energy efficiency measures. The intended users are building owners and operators who have limited knowledge of building energy efficiency. The scoring tool collects minimum building data (~20 data entries) from users and build a full-scale energy model using the inference functionalities from Facility Energy Decision System (FEDS). The scoring tool runs real-time building energy simulation using EnergyPlus and performs life-cycle cost analysis using FEDS. An API is also under development to allow the third-party applications to exchange data with the web service of the scoring tool.

Source record↗

Reasoning4PDEs

Towards Reasoning for PDE Foundation Models: A Reward-Model-Driven Inference-Time-Scaling Algorithm

Mansingh, Siddharth↗

General Bayesian Inference over the Stiefel Manifold via the Givens Transform

We introduce here an approach based on the Givens representation for posterior inference in statistical models with orthogonal matrix parameters, such as factor models and probabilistic principal component analysis (PPCA). We show how the Givens representation can be used to develop practical methods for transforming densities over the Stiefel manifold into densities over subsets of Euclidean space. We demonstrate how to deal with issues arising from the topology of the Stiefel manifold and how to inexpensively compute the change-of-measure terms. We introduce an auxiliary parameter approach that limits the impact of topological issues. We provide both analysis of our methods and numerical examples demonstrating the effectiveness of the approach. We also discuss how our Givens representation can be used to define general classes of distributions over the space of orthogonal matrices. We then give demonstrations on several examples showing how the Givens approach performs in practice in comparison with other methods.

97 MATHEMATICS AND COMPUTING↗

Kronecker-structured covariance models for multiway data

Many applications produce multiway data of exceedingly high dimension. Modeling such multi-way data is important in multichannel signal and video processing where sensors produce multi-indexed data, e.g. over spatial, frequency, and temporal dimensions. We will address the challenges of covariance representation of multiway data and review some of the progress in statistical modeling of multiway covariance over the past two decades, focusing on tensor-valued covariance models and their inference. We will illustrate through a space weather application: predicting the evolution of solar active regions over time.

97 MATHEMATICS AND COMPUTING↗

Microanalysis of carbonate cement δ 18 O in a CO 2 -storage system seal: Insights into the diagenetic history of the Eau Claire Formation (Upper Cambrian), Illinois Basin

Oxygen isotope (δ 18 O) zonation in carbonate mineral cements is often employed as a proxy record (typically with millimeter-scale resolution) of changing temperature regimes during different stages of sediment diagenesis. Recent advances in secondary ion mass spectrometry allow for highly precise and accurate determinations of cement δ 18 O values to be made in situ on a micrometer scale, thus significantly increasing the spatial resolution available to studies of diagenesis in sandstone–shale and carbonate systems. Chemo-isotopically zoned dolomite–ankerite cements within shaly sandstone beds of the predominantly silty–shaly Eau Claire Formation (Cambrian, Illinois Basin) were investigated, revealing the following: with increasing depth of burial (from <0.5 to ~2 km [<1500 to 6500 ft]), cement δ 18 O values decrease from a high of approximately 24‰ down to approximately 14‰ (on the Vienna standard mean ocean water [VSMOW] scale, equivalent to -6.5‰ to -16.5‰ on the Vienna Peedee belemnite [VPDB] scale). The observed cross-basin trend is largely consistent with cements having formed in response to progressive sediment burial and heating. Within the context of independent burial and thermal history models for the Illinois Basin, cementation began soon after deposition and continued intermittently into the mid-Permian. Finally, however, temperatures in excess of burial model predictions are inferred at the time of latest ankerite cement precipitation, which we propose overlapped in time with conductive heating of the Eau Claire Formation (a closed system) from under- and overlying sandstone aquifers that channeled the flow of hot, Mississippi Valley–type mineralizing brines during the mid-Permian (ca. 270 Ma).

58 GEOSCIENCES↗

Evaluation of data driven low-rank matrix factorization for accelerated solutions of the Vlasov equation

Low-rank methods have shown success in accelerating simulations of a collisionless plasma described by the Vlasov equation, but still rely on computationally costly linear algebra every time step. We propose a data-driven factorization method using artificial neural networks, specifically with convolutional layer architecture, that trains on existing simulation data. At inference time, the model outputs a low-rank decomposition of the distribution field of the charged particles, and we demonstrate that this step is faster than the standard linear algebra technique. Numerical experiments show that the method achieves comparable reconstruction accuracy for interpolation tasks, generalizing to unseen test data in a manner beyond just memorizing training data; patterns in factorization also inherently followed the same numerical trend as those within algebraic methods (e.g., truncated singular-value decomposition). However, when training on the first 70% of a time-series data and testing on the remaining 30%, the method fails to meaningfully extrapolate. Despite this limiting result, the technique may have benefits for simulations in a statistical steady-state or otherwise showing temporal stability. These results suggest that while the model offers a computationally efficient alternative for datasets with temporal stability, its current formulation is best suited for interpolation rather than for predicting future states in time-evolving systems. This study thus lays the groundwork for further refinement of neural network-based approaches to low-rank matrix factorization in high-dimensional plasma simulations.

97 MATHEMATICS AND COMPUTING↗

Sythesis of MCMC and Belief Propagation

Markov Chain Monte Carlo (MCMC) and Belief Propagation (BP) are the most popular algorithms for computational inference in Graphical Models (GM). In principle, MCMC is an exact probabilistic method which, however, often suffers from exponentially slow mixing. In contrast, BP is a deterministic method, which is typically fast, empirically very successful, however in general lacking control of accuracy over loopy graphs. In this paper, we introduce MCMC algorithms correcting the approximation error of BP, i.e., we provide a way to compensate for BP errors via a consecutive BP-aware MCMC. Our framework is based on the Loop Calculus (LC) approach which allows to express the BP error as a sum of weighted generalized loops. Although the full series is computationally intractable, it is known that a truncated series, summing up all 2-regular loops, is computable in polynomial-time for planar pair-wise binary GMs and it also provides a highly accurate approximation empirically. Motivated by this, we first propose a polynomial-time approximation MCMC scheme for the truncated series of general (non-planar) pair-wise binary models. Our main idea here is to use the Worm algorithm, known to provide fast mixing in other (related) problems, and then design an appropriate rejection scheme to sample 2-regular loops. Furthermore, we also design an efficient rejection-free MCMC scheme for approximating the full series. The main novelty underlying our design is in utilizing the concept of cycle basis, which provides an efficient decomposition of the generalized loops. In essence, the proposed MCMC schemes run on transformed GM built upon the non-trivial BP solution, and our experiments show that this synthesis of BP and MCMC outperforms both direct MCMC and bare BP schemes.

97 MATHEMATICS AND COMPUTING↗

Conditional Generative Adversarial Networks for Solving Heat Transfer Problems

Generative Adversarial Networks (GANs) have been used as a deep learning approach to solving physics and engineering problems. Using deep learning for these problems is attractive in that reasonably accurate models can be inferred from only raw data, eliminating the need to define the exact physical equations governing a problem. We expand on previous work using GANs to generate steady-state solutions to the two-dimensional heat equation. Using a basic conditional GAN (cGAN), we generate accurate solutions for rectangular domains conditioned on four edge boundary conditions (MAE < 0.5%). For finding steady-state solutions over arbitrary two-dimensional domains (not constrained to rectangles), we use a cGAN designed for image-to-image translation. We train this GAN on various types of geometric domains (circles, squares, triangles, shapes with one circular or rectangular hole), achieving accurate results on test data made up of geometries similar to those in training (MAE < 1%). For both of these GANs, we experiment with different loss function terms, showing that a term using the gradients of solution images significantly improves the basic cGAN but not the image-to-image GAN. Lastly, we show that the image-to-image GAN performs poorly when applied to two-dimensional geometries that vary in structure from training data (MAE < 8% for shapes with multiple holes or different shaped holes). This demonstrates the cGAN's lack of generalizability. While the cGAN is an accurate and computationally efficient method when trained and tested on similarly structured data, it is a much less reliable method when applied to data that is slightly different in structure from the training data.

97 MATHEMATICS AND COMPUTING↗

Real-time neutron multiplicity and source localization for criticality safety during fuel debris removal

Advancing neutron detection and analysis techniques for complex radiation environments is an ongoing focus in nuclear instrumentation and monitoring. This proposal presents research and development of a generalized real-time neutron monitoring and analysis system, applicable to any detector capable of producing time-tagged neutron count data. While the work is demonstrated using the Neutron Multiplication Analysis Detector (NoMAD), a modular 15-tube helium-3 (He-3) array, due to its availability, spatial resolution, and flexible deployment, the methods developed are extensible to other systems, including organic scintillators and fast digital detectors. This research investigates two complementary analytical techniques for real-time characterization of neutron emitting sources: neutron multiplicity estimation based on the Hage-Cifarelli formalism and spatial localization using supervised machine learning applied to spatial count rate patterns. These methods are designed to operate under dynamic, evolving conditions such as fuel debris retrieval or reactor startup, where neutron-emitting material geometries may be partially unknown or changing over time. By integrating statistical neutron emission data with spatial localization, this research aims to develop and evaluate methods for real time neutron monitoring, source characterization, and material verification. Key contributions include implementation of a low-latency data pipeline for continuous neutron multiplicity analysis, development and validation of machine learning models for spatial inference, and experimental evaluation of system performance under variable measurement conditions. The outcomes are intended to support applications in nuclear safeguards, verification, emergency response, and reactor startup.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Near-Efficient and Non-Asymptotic Multiway Inference

We establish non-asymptotic efficiency guarantees for tensor decomposition–based inference in count data models. Under a Poisson framework, we consider two related goals: (i) parametric inference , the estimation of the full distributional parameter tensor, and (ii) multiway analysis , the recovery of its canonical polyadic (CP) decomposition factors. Our main result shows that in the rank-one setting, a rank-constrained maximum-likelihood estimator achieves multiway analysis with variance matching the Cramér–Rao Lower Bound (CRLB) up to absolute constants and logarithmic factors. This provides a general framework for studying “near-efficient” multiway estimators in finite-sample settings. For higher ranks, we illustrate that our multiway estimator may not attain the CRLB; nevertheless, CP-based parametric inference remains nearly minimax optimal, with error bounds that improve on prior work by offering more favorable dependence on the CP rank. Numerical experiments corroborate near-efficiency in the rank-one case and highlight the efficiency gap in higher-rank scenarios.

97 MATHEMATICS AND COMPUTING↗