Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

OccuTherm: Occupant Thermal Comfort Inference using Body Shape Information

Thermal comfort is a decisive factor for the well-being, productivity, and overall satisfaction of commercial building occupants. Many commercial building automation systems either use a fixed zone-wide temperature set-point for all occupants or they rely on extensive sensor deployments with frequent online interaction with occupants. This results in inadequate comfort levels or significant training effort from users, respectively. However, the increasing ubiquity of cheap, depth-based occupancy tracking systems has enabled an improvement in inferential capabilities. We propose the novel system OccuTherm to model thermal comfort of occupants. We conducted a laboratory study with 77 participants to collect data for the implementation of a thermal comfort model that derives thermal comfort using the human body shape. Based on the comparison with model baselines and ablations, we show that our approach infers thermal comfort of individuals with 60 % accuracy when body shape information is taken into account; 6 % more than state-of-the-art approaches. We make our code, mobile app, datasets, and models freely available.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

How CMB and large-scale structure constrain chameleon interacting dark energy

We explore a chameleon type of interacting dark matter-dark energy scenario in which a scalar field adiabatically traces the minimum of an effective potential sourced by the dark matter density. We discuss extensively the effect of this coupling on cosmological observables, especially the parameter degeneracies expected to arise between the model parameters and other cosmological parameters, and then test the model against observations of the cosmic microwave background (CMB) anisotropies and other cosmological probes. We find that the chameleon parameters α and β, which determine respectively the slope of the scalar field potential and the dark matter-dark energy coupling strength, can be constrained to α < 0.17 and β < 0.19 using CMB data and measurements of baryon acoustic oscillations. The latter parameter in particular is constrained only by the late Integrated Sachs-Wolfe effect. Adding measurements of the local Hubble expansion rate H{sub 0} tightens the bound on α by a factor of two, although this apparent improvement is arguably an artefact of the tension between the local measurement and the H{sub 0} value inferred from Planck data in the minimal ΛCDM model. The same argument also precludes chameleon models from mimicking a dark radiation component, despite a passing similarity between the two scenarios in that they both delay the epoch of matter-radiation equality. Based on the derived parameter constraints, we discuss possible signatures of the model for ongoing and future large-scale structure surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Machine Learning

The absence of a robust and unified theory of cyber dynamics presents challenges and opportunities for using machine learning based data-driven approaches to further the understanding of the behavior of such complex systems. Analysts can also use machine learning approaches to gain operational insights. In order to be operationally beneficial, cybersecurity machine learning based models need to have the ability to: (1) represent a real-world system, (2) infer system properties, and (3) learn and adapt based on expert knowledge and observations. Probabilistic models and Probabilistic graphical models provide these necessary properties and are further explored in this chapter. Bayesian Networks and Hidden Markov Models are introduced as an example of a widely used data driven classification/modeling strategy.

Anomaly detection↗

Diffusion model approach to simulating electron-proton scattering events

Generative artificial intelligence is a fast-growing area of research offering various avenues for exploration in high-energy nuclear physics. In this work, we explore the use of generative models for simulating electron-proton collisions relevant to experiments like the Continuous Electron Beam Accelerator Facility and the future Electron-Ion Collider (EIC). These experiments play a critical role in advancing our understanding of nucleons and nuclei in terms of quark and gluon degrees of freedom. The use of generative models for simulating collider events faces several challenges such as the sparsity of the data, the presence of global or eventwide constraints, and steeply falling particle distributions. In this work, we focus on the implementation of diffusion models for the simulation of electron-proton scattering events at EIC energies. Our results demonstrate that diffusion models can reproduce relevant observables such as momentum distributions and correlations of particles, momentum sum rules, and the leading electron kinematics, all of which are of particular interest in electron-proton collisions. Although the sampling process is relatively slow compared to other machine-learning architectures, we find diffusion models can generate high-quality samples. We foresee various applications of our work including inference for nuclear structure, interpretable generative machine learning, and searches of physics beyond the Standard Model. Published by the American Physical Society 2024

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

ON THE MAGNETIC FIELD OF PULSARS WITH REALISTIC NEUTRON STAR CONFIGURATIONS

We have recently developed a neutron star model fulfilling global and not local charge neutrality, both in the static and in the uniformly rotating cases. The model is described by the coupled Einstein-Maxwell-Thomas-Fermi equations, in which all fundamental interactions are accounted for in the framework of general relativity and relativistic mean field theory. Uniform rotation is introduced following Hartle's formalism. We show that the use of realistic parameters of rotating neutron stars, obtained from numerical integration of the self-consistent axisymmetric general relativistic equations of equilibrium, leads to values of the magnetic field and radiation efficiency of pulsars that are very different from estimates based on fiducial parameters that assume a neutron star mass M = 1.4 M {sub ☉}, radius R = 10 km, and moment of inertia I = 10{sup 45} g cm{sup 2}. In addition, we compare and contrast the magnetic field inferred from the traditional Newtonian rotating magnetic dipole model with respect to the one obtained from its general relativistic analog, which takes into account the effect of the finite size of the source. We apply these considerations to the specific high-magnetic field pulsar class and show that, indeed, all of these sources can be described as canonical pulsars driven by the rotational energy of the neutron star, and have magnetic fields lower than the quantum critical field for any value of the neutron star mass.

79 ASTRONOMY AND ASTROPHYSICS↗

Probabilistic Inference of Low-Surface-Brightness Galaxy Morphological Parameters Using Simulation-Based Inference

Low-surface-brightness galaxies (LSBGs) are diffuse, often dark-matter-dominated systems whose faintness makes their structural parameters difficult to measure reliably in wide-field imaging surveys. Robust parameter inference, including uncertainty quantification, is important for population studies and for comparisons with models of galaxy formation, as future surveys are expected to produce increasingly large samples of diffuse galaxies. In practice, LSBG profile modeling is sensitive to sky- background errors, masking choices, contaminating background sources, and the computational cost of obtaining posterior-level uncertainties for large samples. Motivated by these questions, we develop a simulation-based inference (SBI) framework for estimating posterior distributions of LSBG morphological parameters from simulated galaxy images. Using PyImfit, we generate DES-like single-Sersic profile LSBG images with known position angle, ellipticity, Sersic index, effective surface brightness, and effective radius. We then train a normalizing-flow-based neural posterior estimator using the sbi package to infer these parameters from the simulated images. For isolated simulated galaxies, the SBI posterior recovers the true input parameters, produces posterior predictive residuals consistent with the assumed noise model, and shows good empirical calibration in a DES-motivated test regime. We also compare SBI with PyImfit-based MCMC inference and find broadly comparable posterior constraints, while SBI enables substantially faster posterior sampling after training. Finally, we test robustness to compact background contaminants. A model trained only on isolated galaxies produces undercovered posteriors on contaminated images, whereas training on simulations with variable contaminant positions and fluxes improves calibration across contaminated test sets. These results demonstrate the promise of SBI for scalable, uncertainty-aware LSBG morphology inference, while emphasizing that posterior reliability strongly depends on whether training simulations include relevant observational complications.

Batbayar, Bilguun [U. Chicago (main)]↗

Chandra and XMM-Newton study of the supernova remnant Kes 73 hosting the magnetar 1E 1841-045

We present a Chandra and XMM-Newton study of the supernova remnant (SNR) Kes 73 hosting the anomalous X-ray pulsar 1E 1841–045. The Chandra image reveals clumpy structures across the remnant with enhanced emission along the western rim. The X-ray emission fills the radio shell and spatially correlates with the infrared image. The global X-ray spectrum is described by a two-component thermal model with a column density N {sub H} = 2.6{sub −0.3}{sup +0.4}×10{sup 22} cm{sup –2} and a total luminosity of L{sub X} = 3.3{sub −0.5}{sup +0.7}×10{sup 37} erg s{sup –1} (0.5-10 keV, at an assumed distance of 8.5 kpc). The soft component is characterized by a temperature kT{sub s} = 0.5{sub −0.2}{sup +0.1} keV, a high ionization timescale, and enhanced Si and S abundances, suggesting emission that is dominated by shocked ejecta. The hard component has a temperature kT{sub h} = 1.6{sub −0.7}{sup +0.8} keV, a relatively low ionization timescale, and mostly solar abundances suggesting emission that is dominated by interstellar/circumstellar shocked material. A spatially resolved spectroscopy study reveals no significant variations in the spectral properties. We infer an SNR age ranging between 750 yr and 2100 yr, an explosion energy of 3.0{sub −1.8}{sup +2.8}×10{sup 50} erg and a shock velocity of (1.2 ± 0.3)×10{sup 3} km s{sup –1} (under the Sedov phase assumption). We also discuss the possible scenario for Kes 73 expanding into the late red-supergiant wind phase of its massive progenitor. Comparing the inferred metal abundances to core-collapse nucleosynthesis model yields, we estimate a progenitor mass ≳20 M {sub ☉}, adding a candidate to the growing list of highly magnetized neutron stars proposed to be associated with very massive progenitors.

79 ASTRONOMY AND ASTROPHYSICS↗

Physics Informed Neural Networks as Computational Physics Emulators

This report is a brief overview and evaluation of Physics Informed Neural Networks (PINNs). Karniadakis and co-workers, e.g., Karniadakis et al. (2021) assert that the PINNs approach integrates seamlessly both data and mathematical physics models, even in partially understood, uncertain and high-dimensional contexts. They further claim that PINNs are effective and efficient for ill-posed and inverse problems, and when combined with domain decomposition, are scalable to large problems and a tool to discover hidden physics. While they demonstrate the capabilities in specific academic instances, their overarching claims about PINNs seem to be an overstatement, at least at the current time. We have briefly considered a few of the limitations of PINNs in this investigation. It is not clear to us if the PINNs approach can ever be competitive with approaches that use specialized algorithms to achieve high-accuracy solutions of governing equations and other techniques that can combine observational data with such solutions. As an example of the latter, consistent with the principles of Bayesian inference, data assimilation, or more generally data-model fusion, is a process that fuses observational data typically with a computational model that respects certain constraints such as conservation laws. For example, improvements in observational network combined with data assimilation have been key in improving weather predictions over the past four decades Kalnay (2003).

97 MATHEMATICS AND COMPUTING↗

Exploring unsupervised top tagging using Bayesian inference

Recognizing hadronically decaying top-quark jets in a sample of jets, or even its total fraction in the sample, is an important step in many LHC searches for Standard Model and Beyond Standard Model physics as well. Although there exists outstanding top-tagger algorithms, their construction and their expected performance rely on Montecarlo simulations, which may induce potential biases. For these reasons we develop two simple unsupervised top-tagger algorithms based on performing Bayesian inference on a mixture model. In one of them we use as the observed variable a new geometrically-based observable \tilde{A}_{3} A ̃ 3 , and in the other we consider the more traditional \tau_{3}/\tau_{2} τ 3 / τ 2 N N -subjettiness ratio, which yields a better performance. As expected, we find that the unsupervised tagger performance is below existing supervised taggers, reaching expected Area Under Curve AUC \sim 0.80-0.81 ∼ 0.80 − 0.81 and accuracies of about 69% - − 75% in a full range of sample purity. However, these performances are more robust to possible biases in the Montecarlo that their supervised counterparts. Our findings are a step towards exploring and considering simpler and unbiased taggers.

Alvarez, Ezequiel↗

X-ray continuum as a measure of pressure and fuel–shell mix in compressed isobaric hydrogen implosion cores

Pressure, by definition, characterizes the conditions within an isobaric implosion core at peak compression [Gus'kov et al., Nucl. Fusion 16, 957 (1976); Betti et al., Phys. Plasmas 8, 5257 (2001)] and is a key parameter in quantifying its near-ignition performance [Lawson, Proc. Phys. Soc. London, B 70, 6 (1957); Betti et al., Phys. Plasmas 17, 058102 (2010); Goncharov et al., Phys. Plasmas 21, 056315 (2014); and Glenzer et al., Phys. Plasmas 19, 056318 (2012)]. At high spectral energy, where the x-ray emission from an imploded hydrogen core is optically thin, the emissivity profile can be inferred from the spatially resolved core emission. This emissivity, which can be modeled accurately under hot-core conditions, is dependent almost entirely on the pressure when measured within a restricted spectral range matched to the temperature range anticipated for the emitting volume. In this way, the hot core pressure at the time of peak emission can be inferred from the measured free-free emissivity profile. The pressure and temperature dependences of the x-ray emissivity and the neutron-production rate explain a simple scaling of the total filtered x-ray emission as a constant power of the total neutron yield for implosions of targets of similar design over a broad range of shell implosion isentropes. This scaling behavior has been seen in implosion simulations and is confirmed by measurements of high-isentrope implosions [Sangster et al., Phys. Plasmas 20, 056317 (2013)] on the OMEGA laser system [Boehly et al., Opt. Commun. 133, 495 (1997)]. Attributing the excess emission from less-stable, low-isentrope implosions, above the level expected from this neutron-yield scaling, to the higher emissivity of shell carbon mixed into the implosion's central hot spot, the hot-spot “fuel–shell” mix mass can be inferred.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Bayesian inference of in-medium baryon-baryon scattering cross sections from HADES proton flow data

Within a Bayesian statistical framework using a Gaussian Process emulator for an isospin-dependent Boltzmann-Uehling-Uhlenbeck (IBUU) transport model simulator of heavy-ion reactions at intermediate energies, we infer from the HADES proton flow data the posterior probability distribution functions of in-medium baryon-baryon scattering cross section modification factor X with respect to free-space and the corresponding incompressibility K of nuclear matter as well as their correlation function. In conclusion, the mean value of X is found to be $X$ = $1.32_ {+0.28} ^ {-0.40} $ at 68% confidence level assuming the nuclear incompressibility K will not exceed 400 MeV, providing circumstantial evidence for enhanced baryon-braryon scattering cross sections in hot and dense nuclear matter.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Automatic extraction of cancer registry reportable information from free-text pathology reports using multitask convolutional neural networks

Objective: In this work we implement 2 different multitask learning (MTL) techniques, hard parameter sharing and cross-stitch, to train a word-level convolutional neural network (CNN) specifically designed for automatic extraction of cancer data from unstructured text in pathology reports. We show the importance of learning related information extraction (IE) tasks leveraging shared representations across the tasks to achieve state-of-the-art performance in classification accuracy and computational efficiency. Materials and Methods: Multitask CNN (MTCNN) attempts to tackle document information extraction by learning to extract multiple key cancer characteristics simultaneously. We trained our MTCNN to perform 5 information extraction tasks: (1) primary cancer site (65 classes), (2) laterality (4 classes), (3) behavior (3 classes), (4) histological type (63 classes), and (5) histological grade (5 classes). We evaluated the performance on a corpus of 95 231 pathology documents (71 223 unique tumors) obtained from the Louisiana Tumor Registry. We compared the performance of the MTCNN models against single-task CNN models and 2 traditional machine learning approaches, namely support vector machine (SVM) and random forest classifier (RFC). Results: MTCNNs offered superior performance across all 5 tasks in terms of classification accuracy as compared with the other machine learning models. Based on retrospective evaluation, the hard parameter sharing and cross-stitch MTCNN models correctly classified 59.04% and 57.93% of the pathology reports respectively across all 5 tasks. The baseline models achieved 53.68% (CNN), 46.37% (RFC), and 36.75% (SVM). Based on prospective evaluation, the percentages of correctly classified cases across the 5 tasks were 60.11% (hard parameter sharing), 58.13% (cross-stitch), 51.30% (single-task CNN), 42.07% (RFC), and 35.16% (SVM). Moreover, hard parameter sharing MTCNNs outperformed the other models in computational efficiency by using about the same number of trainable parameters as a single-task CNN. Conclusions: The hard parameter sharing MTCNN offers superior classification accuracy for automated coding support of pathology documents across a wide range of cancers and multiple information extraction tasks while maintaining similar training and inference time as those of a single task–specific model.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Tokamak divertor plasma emulation with machine learning

Abstract Future tokamak devices that aim to create conditions relevant to power plant operations must consider strategies for mitigating damage to plasma facing components in the divertor. One of the goals of MAST-U tokamak operations is to inform these considerations by researching advanced divertor configurations that aid stable plasma detachment. Machine design, scenario planning and detachment control would all greatly benefit from tools that enable rapid calculation of scenario-relevant quantities given some input parameters. This paper presents a method for generating large, simulated scrape-off layer data sets, which was applied to generate a data set of steady-state Hermes-3 simulations of the MAST-U tokamak. A machine learning model was constructed using a Bayesian approach to hyperparameter optimisation to predict diagnosable output quantities given control-relevant input features. The resulting best-performing model, which is based on a feedforward neural network, achieves high accuracy when predicting electron temperature at the divertor target and carbon impurity radiation front position and runs in around 1 ms in inference mode. Techniques for interpreting the predictions made by the model were applied, and a high-resolution parameter scan of upstream conditions was performed to demonstrate the utility of rapidly generating accurate predictions using the emulator. This work represents a step forward in the design of machine learning-driven emulators of tokamak exhaust simulation codes in operational modes relevant to divertor detachment control and plasma scenario design.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Machine Learning 5G Attack Detection in Programmable Logic

Machine learning-assisted network security may significantly contribute to securing 5G components. However, machine learning network security inference speeds generally require tens to hundreds of milliseconds thereby introducing significant latency in 5G operations. The inference latency can be reduced by deploying the machine learning model to programmable logic in a field programmable gate array (FPGA) at the cost of a small loss in accuracy. In order to quantify this loss, as well as to establish baseline performance inference speeds for programmable logic implementations, this work explores an autoencoder and a ß-variational autoencoder deployed on two different FPGA evaluation boards and compares accuracy and performance against an NVIDIA A100 GPU implementation. A publicly available 5G dataset containing 10 types of attacks along with normal traffic is introduced as part of the evaluation.

97 MATHEMATICS AND COMPUTING↗

Pushing the frontiers in climate modelling and analysis with machine learning

Climate modelling and analysis are facing new demands to enhance projections and climate information. Here, in this study, we argue that now is the time to push the frontiers of machine learning beyond state-of-the-art approaches, not only by developing machine-learning-based Earth system models with greater fidelity, but also by providing new capabilities through emulators for extreme event projections with large ensembles, enhanced detection and attribution methods for extreme events, and advanced climate model analysis and benchmarking. Utilizing this potential requires key machine learning challenges to be addressed, in particular generalization, uncertainty quantification, explainable artificial intelligence and causality. This interdisciplinary effort requires bringing together machine learning and climate scientists, while also leveraging the private sector, to accelerate progress towards actionable climate science.

54 ENVIRONMENTAL SCIENCES↗

3-D Semantic Information Inference from Airborne Video. Final Report

We developed a full 3D modeling pipeline focusing on an important application scenario: city-scale 3D reconstruction from aerial imagery. We propose an approach to solve camera pose estimation and dense reconstruction from Wide Area Aerial Surveillance (WAAS) videos captured by an airborne platform. Our approach solves them in an online fashion: it incrementally updates a sparse 3D map and estimates the camera pose as each new frame arrives; depth maps of selected key frames are computed using a variational method and integrated to produce a full 3D model via volumetric reconstruction. In practice, aerial imagery is usually captured using a multicamera system. We propose an approach for camera pose estimation of multi-camera aerial imagery which is parallelized on multiple GPUs for efficiency. The approach is also extended for progressive 3D model acquisition with a hand-held camera. We also developed an offline approach since online approach is not a necessity and accuracy has higher priority over efficiency in many scenarios. We presented MeshRecon, a mesh-based offline system composed of three modules: a dense point cloud is generated using multi-resolution plane sweep method; an initial mesh model is extracted from the point cloud via global optimization considering visibility information of all images; the mesh model is then iteratively refined to capture structural details by optimizing the photometric consistency and spatial regularization. The major processes are parallelized on GPU for efficiency. For the aerial imagery case, we evaluate our system on several real-world multicamera aerial imagery datasets, each covering an urban scenario of several square kilometers. Quantitative result shows that the reconstructed geometric 3D model is highly accurate with error smaller than 1 meter over the entire city. Besides aerial imagery, we also evaluate its performance on general geometric 3D model acquisition of real-world objects. Result shows that the system is robust and flexible for various types of objects at different scales in both indoor and outdoor environments. Based on city 3D models reconstructed at different times, we present a system for city-scale geometry change detection by performing comparisons at the 3D geometry level. Our system is able to detect geometry changes at different scales, ranging from a building cluster to small-scale vegetation changes, with high accuracy.

97 MATHEMATICS AND COMPUTING↗

popclass

popclass is a lightweight python package that allows fast, probabilistic classification of the lens of a microlensing event given the event's posterior distribution and a model of the Galaxy. popclass provides the bridge between Galactic simulation and lens classification, an interface to common Bayesian inference libraries, and the ability for users to flexibly specify their own Galactic model and classification parameters.

Mcgill, Peter↗

Impact of Limited Degree of Freedom Drag Coefficients on a Floating Offshore Wind Turbine Simulation

The worldwide effort to design and commission floating offshore wind turbines (FOWT) is motivating the need for reliable numerical models that adequately represent their physical behavior under realistic sea states. However, properly representing the hydrodynamic quadratic damping for FOWT remains uncertain, because of its dependency on the choice of drag coefficients (dimensionless or not). It is hypothesized that the limited degree of freedom (DoF) drag coefficient formulation that uses only translational drag coefficients causes mischaracterization of the rotational DoF drag, leading to underestimation of FOWT global loads, such as tower base fore-aft shear. To address these hydrodynamic modeling uncertainties, different quadratic drag models implemented in the open-source mid-fidelity simulation tool, OpenFAST, were investigated and compared with the experimental data from the Offshore Code Comparison Collaboration, Continued, with Correlation (OC5) project. The tower base fore-aft shear and up-wave mooring line tension were compared under an irregular wave loading condition to demonstrate the effects of the different damping models. Two types of hydrodynamic quadratic drag formulations were considered: (1) member-based dimensionless drag coefficients applied only at the translational DoF (namely limited-DoF drag model) and (2) quadratic drag matrix model (in dimensional form). Based on the results, the former consistently underestimated the 95th percentile peak loads and spectral responses when compared to the OC5 experimental data. In contrast, the drag matrix models reduced errors in estimates of the tower base shear peak load by 7–10% compared to the limited-DoF drag model. The underestimation in the tower base fore-aft shear was thus inferred be related to mischaracterization of the rotational pitch drag and the heave motion/drag by the limited-DoF model.

17 WIND ENERGY↗