Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Inferring the Redshift of More than 150 GRBs with a Machine-learning Ensemble Model

Gamma-ray bursts (GRBs), due to their high luminosities, are detected up to a redshift of 10, and thus have the potential to be vital cosmological probes of early processes in the Universe. Fulfilling this potential requires a large sample of GRBs with known redshifts, but due to observational limitations, only 11% have known redshifts (z). There have been numerous attempts to estimate redshifts via correlation studies, most of which have led to inaccurate predictions. To overcome this, we estimated GRB redshift via an ensemble-supervised machine-learning (ML) model that uses X-ray afterglows of long-duration GRBs observed by the Neil Gehrels Swift Observatory. The estimated redshifts are strongly correlated (a Pearson coefficient of 0.93) and have an rms error, namely, the square root of the average squared error $\langle$Δz 2 $\rangle$, of 0.46 with the observed redshifts showing the reliability of this method. The addition of GRB afterglow parameters improves the predictions considerably by 63% compared to previous results in peer-reviewed literature. Finally, we use our ML model to infer the redshifts of 154 GRBs, which increase the known redshifts of long GRBs with plateaus by 94%, a significant milestone for enhancing GRB population studies that require large samples with redshift.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2004

Theoretical and Observational Determination of Global and Regional Radiation Budget, Forcing and Feedbacks at the Top-of-Atmosphere and Surface

Report consists of: 1. List of accomplishments 2. List of publications 3. Abstracts of published or submitted papers and 4. Subject invention disclosure. The accomplishments of the grant listed are: 1. Improved the third-order turbulence closure in cloud resolving models to remove the liquid water oscillation. 2. Used the University of California-Los Angeles (UCLA) large-eddy simulation (LES) model to provide data for radiation transfer testing. 3. Revised shortwave k-distribution models based on HITRAN 2000. 4. Developed a gamma-weighted two-stream radiative transfer model for radiation budget estimate applications. 5. Estimated the effect of spherical geometry to the earth radiation budget. 6. Estimated top-of-atmosphere irradiance over snow and sea ice surfaces. 7. Estimated the aerosol direct radiative effect at the top of the atmosphere. 8. Estimated the top-of-atmosphere reflectance of the clear-sky molecular atmosphere over ocean. 9. Developed and validated new set of Angular Distribution Models for the CERES TRMM satellite instrument (tropical) 10. Developed and validated new set of Angular Distribution Models for the CERES Terra satellite instrument (global) 11. Quantified the top-of-atmosphere direct radiative effect of aerosols over global oceans from merged CERES and MODIS observations 12 Clarified the definition of TOA flux reference level for radiation budget studies 13. Developed new algorithm for unfaltering CERES measured radiances 14. Used multiangle POLDER measurements to produce narrowband angular distribution models and examine the effect of scene identification errors on TOA albedo estimates 15. Developed and validated a novel algorithm called the Multidirectional Reflectance Matching (MRM) model for inferring TOA albedos from ice clouds using multi-angle satellite measurements. 16. Developed and validated a novel algorithm called the Multidirectional Polarized Reflectance Matching (MPRM) model for inferring particle shapes from ice clouds using multi-angle polarized satellite measurements. 17. Developed 4 advanced light scattering models including the three-dimensional (3D) uniaxial perfectly matched layer (UPML) finite-difference time-domain (FDTD) model. 18. Develop sunglint in situ measurement and study reflectance distribution in the sunglint area. 19. Lead a balloon-borne radiometer TOA albedo validation effort. 20. Developed a CERES surface UVB, UVA, and UV index product.

Loeb, Norman G.↗
DOE OSTI2023

Inferring Viral Transmission Time from Phylogenies for Known Transmission Pairs

When the time of an HIV transmission event is unknown, methods to identify it from virus genetic data can reveal the circumstances that enable transmission. We developed a single-parameter Markov model to infer transmission time from an HIV phylogeny constructed of multiple virus sequences from people in a transmission pair. Our method finds the statistical support for transmission occurring in different possible time slices. We compared our time-slice model results to previously described methods: a tree-based logical transmission interval, a simple parsimony-like rules-based method, and a more complex coalescent model. Across simulations with multiple transmitted lineages, different transmission times relative to the source’s infection, and different sampling times relative to transmission, we found that overall our time-slice model provided accurate and narrower estimates of the time of transmission. We also identified situations when transmission time or direction was difficult to estimate by any method, particularly when transmission occurred long after the source was infected and when sampling occurred long after transmission. Applying our model to real HIV transmission pairs showed some agreement with facts known from the case investigations. We also found, however, that uncertainty on the inferred transmission time was driven more by uncertainty from time calibration of the phylogeny than from the model inference itself. Encouragingly, comparable performance of the Markov time-slice model and the coalescent model—which make use of different information within a tree—suggests that a new method remains to be described that will make full use of the topology and node times for improved transmission time inference.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Assessing Membership Inference Attacks under Distribution Shifts

Membership inference attacks (MIAs) exploit machine learning models to infer whether a data point was in the training set, posing significant privacy risks even with limited black-box access. These attacks rely on the attacker approximating the target model’s training distribution, yet the impact of distribution shifts between target and shadow models on MIA success remains underexplored. We systematically evaluate five types of distribution shifts —-cutout, jitter, Gaussian noise, label shift, and attribute shift —- at varying intensities. Our results reveal that these shifts affect MIA effectiveness in nuanced ways, with some reducing attack success while others exacerbate vulnerabilities, and the same shift can have opposite effects depending on the type of MIA. This highlights the complex interplay between distributional differences and attack performance, offering critical insights for improving model defenses against MIAs.

Shi, Yichuan [Massachusetts Institute of Technolog↗
DOE OSTI2022

Feasibility of Vascular Parameter Estimation for Assessing Hypertensive Pregnancy Disorders

Abstract Hypertensive pregnancy disorders (HPDs), such as pre-eclampsia, are leading sources of both maternal and fetal morbidity in pregnancy. Noninvasive imaging, such as ultrasound (US) and magnetic resonance imaging (MRI), is an important tool for predicting and monitoring these high risk pregnancies. While imaging can measure hemodynamic parameters, such as uterine artery pulsatility and resistivity indices (PI and RI), the interpretation of such metrics for disease assessment relies on ad hoc standards, which provide limited insight to the physical mechanisms underlying the emergence of hypertensive pregnancy disorders. To provide meaningful interpretation of measured hemodynamic data in patients, advances in computational fluid dynamics can be brought to bear. In this work, we develop a patient-specific computational framework that combines Bayesian inference with a reduced-order fluid dynamics model to infer parameters, such as vascular resistance, compliance, and vessel cross-sectional area, known to be related to the development of hypertension. The proposed framework enables the prediction of hemodynamic quantities of interest, such as pressure and velocity, directly from sparse and noisy MRI measurements. We illustrate the effectiveness of this approach in two systemic arterial network geometries: an aorta with branching carotid artery and a maternal pelvic arterial network. For both cases, the model can reconstruct the provided measurements and infer parameters of interest. In the case of the maternal pelvic arteries, the model can make a distinction between the pregnancies destined to develop hypertension and those that remain normotensive, expressed through the value range of the predicted absolute pressure.

Biophysics↗
DOE OSTI2020

Sampling Low-Dimensional Markovian Dynamics for Preasymptotically Recovering Reduced Models from Data with Operator Inference

This work introduces a method for learning low-dimensional models from data of high-dimensional black-box dynamical systems. The novelty is that the learned models are exactly the reduced models that are traditionally constructed with classical projection-based model reduction techniques. Thus, the proposed approach learns models that are guaranteed to have the well-studied properties of reduced models known from model reduction, without requiring full knowledge of the governing equations and without requiring the operators of the high-dimensional systems. The key ingredient is a new data sampling scheme to obtain re-projected trajectories of high-dimensional systems that correspond to Markovian dynamics in low-dimensional subspaces. The exact recovery of reduced models from these re-projected trajectories is guaranteed pre-asymptotically under certain conditions for finite amounts of data and for a large class of systems with polynomial nonlinear terms. Numerical results demonstrate that the low-dimensional models learned with the proposed approach match reduced models from traditional model reduction up to numerical errors in practice. In conclusion, the numerical results further indicate that low-dimensional models fitted to re-projected trajectories are predictive even in situations where models fitted to trajectories without re-projection are inaccurate and unstable.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Cholesky-based experimental design for Gaussian process and kernel-based emulation and calibration.

Gaussian processes and other kernel-based methods are used extensively to construct approximations of multivariate data sets. The accuracy of these approximations is dependent on the data used. This paper presents a computationally efficient algorithm to greedily select training samples that minimize the weighted L p error of kernel-based approximations for a given number of data. The method successively generates nested samples, with the goal of minimizing the error in high probability regions of densities specified by users. The algorithm presented is extremely simple and can be implemented using existing pivoted Cholesky factorization methods. Training samples are generated in batches which allows training data to be evaluated (labeled) in parallel. For smooth kernels, the algorithm performs comparably with the greedy integrated variance design but has significantly lower complexity. Numerical experiments demonstrate the efficacy of the approach for bounded, unbounded, multi-modal and non-tensor product densities. We also show how to use the proposed algorithm to efficiently generate surrogates for inferring unknown model parameters from data using Bayesian inference.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Non-intrusive reduced-order modeling for dynamical systems with spatially localized features

This work presents a non-intrusive reduced-order modeling framework for dynamical systems with spatially localized features characterized by slow singular value decay. The proposed approach builds upon two existing methodologies for reduced and full-order non-intrusive modeling, namely Operator Inference (OpInf) and sparse Full-Order Model (sFOM) inference. We decompose the domain into two complementary subdomains that exhibit fast and slow singular value decay. The dynamics of the subdomain exhibiting slow singular value decay are learned with sFOM while the dynamics with intrinsically low dimensionality on the complementary subdomain are learned with OpInf. The resulting, coupled OpInf-sFOM formulation leverages the computational efficiency of OpInf and the high resolution of sFOM, and thus enables fast non-intrusive predictions for conditions beyond those sampled in the training data set. A novel regularization technique with a closed-form solution based on the Gershgorin disk theorem is introduced to promote stable sFOM and OpInf models. We also provide a data-driven indicator for subdomain selection and ensure solution smoothness over the interface via a post-processing interpolation step. We evaluate the efficiency of the approach in terms of offline and online speedup through a quantitative, parametric computational cost analysis. We demonstrate the coupled OpInf-sFOM formulation for two test cases: a one-dimensional Burgers’ model for which accurate predictions beyond the span of the training snapshots are presented, and a two-dimensional parametric model for the Pine Island Glacier ice thickness dynamics, for which the OpInf-sFOM model achieves an average prediction error on the order of 1% with an online speedup factor of approximately 8$\times$ compared to the numerical simulation.

42 ENGINEERING↗
DOE OSTI2024

Latent Stochastic Differential Equations for Modeling Quasar Variability and Inferring Black Hole Properties

Quasars are bright and unobscured active galactic nuclei (AGN) thought to be powered by the accretion of matter around supermassive black holes at the centers of galaxies. The temporal variability of a quasar’s brightness contains valuable information about its physical properties. The UV/optical variability is thought to be a stochastic process, often represented as a damped random walk described by a stochastic differential equation (SDE). Upcoming wide-field telescopes such as the Rubin Observatory Legacy Survey of Space and Time (LSST) are expected to observe tens of millions of AGN in multiple filters over a ten year period, so there is a need for efficient and automated modeling techniques that can handle the large volume of data. Latent SDEs are machine learning models well suited for modeling quasar variability, as they can explicitly capture the underlying stochastic dynamics. In this work, we adapt latent SDEs to jointly reconstruct multivariate quasar light curves and infer their physical properties such as the black hole mass, inclination angle, and temperature slope. Our model is trained on realistic simulations of LSST ten year quasar light curves, and we demonstrate its ability to reconstruct quasar light curves even in the presence of long seasonal gaps and irregular sampling across different bands, outperforming a multioutput Gaussian process regression baseline. Our method has the potential to provide a deeper understanding of the physical properties of quasars and is applicable to a wide range of other multivariate time series with missing data and irregular sampling.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRSDate not supplied

Architectures of Exoplanetary Systems: Towards a Multi-planet Model for Reproducing the Planet Radius Valley and Intra-system Size Similarity

Multi-planet systems provide crucial insights into the architectures and correlations within planetary systems, which in turn offer clues into their formation and evolution histories. Through the thousands of exoplanet candidates that it discovered, NASA's Kepler mission revealed that systems with multiple transiting planets are common. We describe a new model for inferring the exoplanet population observed by Kepler, which combines a semi-parametric description of planetary systems with a prescription for envelope mass-loss due to photoevaporation. This new model is a"hybrid" of the maximum AMD (angular momentum deficit) model in which the orbital excitations of the planets are drawn by distributing the system's critical AMD (He et al. 2020), and a photoevaporation model for sculpting the observed radius valley (Neil & Rogers 2020). This is an update to the SysSim suite of exoplanet population models derived from forward modeling the Kepler detection pipeline. The hybrid model is constrained by the observed statistics of multi-transiting systems, including additional constraints from the distribution of planet radii and their intra-system size patterns. This model is capable of producing a planet radius valley as well as a preference for planet size similarity. However, we find that the Kepler catalog exhibits features that are even more significant (i.e., it has a deeper observed radius valley and stronger size similarity) than the best-fit model. We use this model to infer the intrinsic planet radius valley as well as the distribution of primordial planet masses and core masses.

kepler↗
DOE OSTI2023

Crustal and uppermost mantle structure near the Gloria Fault, North Atlantic, from ocean bottom seismometer surface wave observations

SUMMARY In this work, we present both 1-D and 3-D shear wave velocity (Vs) models of the oceanic crust and uppermost mantle below the Deep OCean Test ARray area, located ∼ 70 km north of the central section of the Gloria Fault, in the eastern North-Atlantic Ocean. The velocity models are inferred from the dispersion of surface waves recorded on ocean bottom seismometers. Dispersion measurements are obtained from the analysis of ambient seismic noise at short periods (< 14 s) and teleseismic surface waves at long periods (> 14 s) using the two-station method. The 1-D Vs model is inferred from the joint inversion of Rayleigh wave phase velocities and Love wave group and phase velocities. The 3-D tomographic model is obtained by inversion of 2-D Love wave group velocity maps as a function of depth, further constrained by the average of Love wave phase velocities obtained from ambient noise (4–9 s) and the average Rayleigh and Love wave phase velocities calculated from teleseismic data (14–44 s). The 1-D Vs model shows a sediment layer with a low velocity of 1.05 km s−1, similar to previous studies in the region. Below the sediments, we find an oceanic crust with velocities ranging from 3.3 to 4.5 km s−1. The model reaches an unusually high velocity of 4.9 km s−1 in a 20 km thick layer at depths between 16 and 36 km. We interpret this fast velocity layer as indicative of the presence of harzburgite, a residue of enhanced melting that might have been formed by the proximity between the Mid-Atlantic Ridge and the Azores mantle plume. At greater depths the velocity decreases, forming a low-velocity zone that reaches a minimum at ∼ 70 km depth, which we interpret as the maximum depth for the lithosphere–asthenosphere boundary. The 3-D model shows a structure that is mostly horizontally layered, with Vs isocontours at 3.5–4.5 km s−1 highlighting oscillations of the crustal structure with wavelengths of ∼25–30 km. These oscillations may be due to changes in the rate of mantle upwelling and magma supply rate.

Pinzón, Juan I. (ORCID:0000000338078068)↗
NASA NTRS1993

An analysis of the Voyager 2 Ultraviolet Spectrometer occultation data at Uranus - Inferring heat sources and model atmospheres

Heat source information is derived here from the Voyager 2 Ultraviolet Spectrometer occultation data of Uranus. Analytic functions for the local heat dependence on altitude are used to obtain a temperature profile by solving the heat equation. The stellar entrance and exit occultation and a solar occultation are used to infer the thermal and density structure of the atmosphere. The least squares fit solution to the solar occultation data gives one source located at 1.8 x 10 exp -5 microbar with a strength of 0.056 +/- 0.01 erg/sq cm/s. Latitudinal temperature gradients are obtained.

Stevens, Michael H.↗
DOE OSTI2020

UQ Toolkit v 2.0

The Uncertainty Quantification (UQ) Toolkit is a software library for the characterizaton and propagation of uncertainties in computational models. For the characterization of uncertainties, Bayesian inference tools are provided to infer uncertain model parameters, as well as Bayesian compressive sensing methods for discovering sparse representations of high-dimensional input-output response surfaces, and also Karhunen-Loève expansions for representing stochastic processes. Uncertain parameters are treated as random variables and represented with Polynomial Chaos expansions (PCEs). The library implements several spectral basis function types (e.g. Hermite basis functions in terms of Gaussian random variables or Legendre basis functions in terms of uniform random variables) that can be used to represent random variables with PCEs. For propagation of uncertainty, tools are provided to propagate PCEs that describe the input uncertainty through the computational model using either intrusive methods (Galerkin projection of equations onto basis functions) or non-intrusive methods (perform deterministic operation at sampled values of the random values and project the obtained results onto basis functions).

Safta, Cosmin↗
DOE OSTI2021

Keras CT Segmentation v.1

SAND2020-14119 O A Tensorflow and Keras-backed framework for learned segmentation methods of 3D CT scan volumes. Supported functionality includes training models, running inference and quantifying uncertainty. The main underlying model architecture is V-Net. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Ganter, Tyler↗
DOE OSTI2023

Joint Analysis of the Epidemic Evolution and Human Mobility During the First Wave of COVID-19 in Spain: Retrospective Study

Background The initial wave of the COVID-19 pandemic placed a tremendous strain on health care systems worldwide. To mitigate the spread of the virus, many countries implemented stringent nonpharmaceutical interventions (NPIs), which significantly altered human behavior both before and after their enactment. Despite these efforts, a precise assessment of the impact and efficacy of these NPIs, as well as the extent of human behavioral changes, remained elusive. Objective In this study, we conducted a retrospective analysis of the initial wave of COVID-19 in Spain to better comprehend the influence of NPIs and their interaction with human behavior. Such investigations are vital for devising future mitigation strategies to combat COVID-19 and enhance epidemic preparedness more broadly. Methods We used a combination of national and regional retrospective analyses of pandemic incidence alongside large-scale mobility data to assess the impact and timing of government-implemented NPIs in combating COVID-19. Additionally, we compared these findings with a model-based inference of hospitalizations and fatalities. This model-based approach enabled us to construct counterfactual scenarios that gauged the consequences of delayed initiation of epidemic response measures. Results Our analysis demonstrated that the pre–national lockdown epidemic response, encompassing regional measures and heightened individual awareness, significantly contributed to reducing the disease burden in Spain. The mobility data indicated that people adjusted their behavior in response to the regional epidemiological situation before the nationwide lockdown was implemented. Counterfactual scenarios suggested that without this early epidemic response, there would have been an estimated 45,400 (95% CI 37,400-58,000) fatalities and 182,600 (95% CI 150,400-233,800) hospitalizations compared to the reported figures of 27,800 fatalities and 107,600 hospitalizations, respectively. Conclusions Our findings underscore the significance of self-implemented prevention measures by the population and regional NPIs before the national lockdown in Spain. The study also emphasizes the necessity for prompt and precise data quantification prior to enacting enforced measures. This highlights the critical interplay between NPIs, epidemic progression, and human behavior. This interdependence presents a challenge in predicting the impact of NPIs before they are implemented.

Public, Environmental & Occupational Health↗
NASA NTRS1984

Empirical models of the eddy heat flux and vertical shear on short time scales

An intimate relation exists between the vertical shear and the horizontal eddy heat flux within the atmosphere. In the present investigation empirical means are employed to provide clues concerning the relationship between the shear and eddy heat flux. In particular, linear regression models are applied to individual and joint time series of the shear and eddy heat flux. These discrete models are used as a basis to infer continuous models. A description is provided of the observed relationship between the flux and the shear, taking into account means, standard deviations, and lag correction functions.

Ghan, S. J.↗
DOE OSTI2018

Learning from crowds with variational Gaussian processes

Solving a supervised learning problem requires to label a training set. This task is traditionally performed by an expert, who provides a label for each sample. The proliferation of social web services (e.g., Amazon Mechanical Turk) has introduced an alternative crowdsourcing approach. Anybody with a computer can register in one of these services and label, either partially or completely, a dataset. The effort of labeling is then shared between a great number of annotators. However, this approach introduces scientifically challenging problems such as combining the unknown expertise of the annotators, handling disagreements on the annotated samples, or detecting the existence of spammer and adversarial annotators. All these problems require probabilistic sound solutions which go beyond the naive use of majority voting plus classical classification methods. In this work we introduce a new crowdsourcing model and inference procedure which trains a Gaussian Process classifier using the noisy labels provided by the annotators. Variational Bayes inference is used to estimate all unknowns. The proposed model can predict the class of new samples and assess the expertise of the involved annotators. Moreover, the Bayesian treatment allows for a solid uncertainty quantification. Since when predicting the class of a new sample we might have access to some annotations for it, we also show how our method can naturally incorporate this additional information. Furthermore, a comprehensive experimental section evaluates the proposed method with synthetic and real experiments, showing that it consistently outperforms other state-of-the-art crowdsourcing approaches.

97 MATHEMATICS AND COMPUTING↗