Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

DLHub: Simplifying publication, discovery, and use of machine learning models in science

Machine Learning (ML) has become a critical tool enabling new methods of analysis and driving deeper understanding of phenomena across scientific disciplines. There is a growing need for "learning systems" to support various phases in the ML lifecycle. While others have focused on supporting model development, training, and inference, few have focused on the unique challenges inherent in science, such as the need to publish and share models and to serve them on a range of available computing resources. In this paper, we present the Data and Learning Hub for science (DLHub), a learning system designed to support these use cases. Specifically, DLHub enables publication of models, with descriptive metadata, persistent identifiers, and flexible access control. It packages arbitrary models into portable servable containers, and enables low-latency, distributed serving of these models on heterogeneous compute resources. In this work, we show that DLHub supports low-latency model inference comparable to other model serving systems including TensorFlow Serving, SageMaker, and Clipper, and improved performance, by up to 95%, with batching and memoization enabled. We also show that DLHub can scale to concurrently serve models on 500 containers. Finally, we describe five case studies that highlight the use of DLHub for scientific applications.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Biological Research and Space Health Enabled by Machine Learning to Support Deep Space Missions

A key science goal of the NASA “Moon to Mars” campaign is to understand how biology responds to the Lunar, Martian, and deep space environments in order to advance fundamental knowledge and support human space missions. Through artificial intelligence (AI) and machine learning (ML), a paradigm shift has begun in space biosciences and engineered astronaut health systems, to enable Earth-independence and mission operations autonomy. We describe current AI/ML methods to support 1) fundamental biology, 2) in situ analytics, 3) high performance computing, 4) automated science, 5) self-driving labs, 6) remote data management, 7) integrated mission biomonitoring, and 8) a Precision Space Health system. AI/ML approaches that can be integrated to support these domains include active learning, explainable AI, adaptive learning, causal inference, knowledge graphs, federated learning, transfer learning, and large language models. Finally, we present results from several current ML projects that are underway in the space biology field to address key challenges of small sample n, high feature count, heterogeneity, and sparse data. These include 1) connecting omics to phenotypic data using an ensemble model to infer causality of rodent liver health disruption, 2) usage of explainable ML to interrogate muscular underpinnings of muscle atrophy, 3) ML models analyzing and determining directed acyclic graphs of human health risk leveraging rodent bone datasets, 4) usage of large pre-trained models connecting biomedical knowledgebases with small spaceflight datasets to understand gene-to-gene interactions, and 5) a suite of benchmarked open science datasets enabling programmers to identify best algorithms to answer space biology questions.

space biology↗
DOE OSTI2018

Late-time mixing and turbulent behavior in high-energy-density shear experiments at high Atwood numbers

The LANL Shear Campaign uses millimeter-scale initially solid shock tubes on the National Ignition Facility to conduct high-energy-density hydrodynamic plasma experiments, capable of reaching energy densities exceeding 100 kJ/cm3. These shock-tube experiments have for the first time reproduced spontaneously emergent coherent structures due to shear-based fluid instabilities [i.e., Kelvin-Helmholtz (KH)], demonstrating hydrodynamic scaling over 8 orders of magnitude in time and velocity. The KH vortices, referred to as “rollers,” and the secondary instabilities, referred to as “ribs,” are used to understand the turbulent kinetic energy contained in the system. Their evolution is used to understand the transition to turbulence and that transition's dependence on initial conditions. Experimental results from these studies are well modeled by the RAGE (Radiation Adaptive Grid Eulerian) hydro-code using the Besnard-Harlow-Rauenzahn turbulent mix model. Information inferred from both the experimental data and the mix model allows us to demonstrate that the specific Turbulent Kinetic Energy (sTKE) in the layer, as calculated from the plan-view structure data, is consistent with the mixing width growth and the RAGE simulations of sTKE.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Earth System Reanalysis in Support of Climate Model Improvements

Recent climate model developments, established through increased model resolution, have led to substantial improvements in model simulations of the time-evolving, coupled Earth system and its subcomponents. However, regardless of resolution, climate models will always produce climate features and variability that differ from the real world and will be prone to biases. This is due to many remaining uncertainties, such as in parametric and structural model uncertainty, in the initial conditions prescribed, and in the prescribed (scenario) forcing which varies on decadal to centennial timescales. Further model improvements are expected to arise specifically from improved representation of physical processes realized through model-data fusion. This will create an unprecedented opportunity to better exploit a large array of Earth observations, from in situ measurements to weather radars and satellite observations, as the resolved scales of the models approach those of the observations. For this, climate DA will be the central tool to bring models and observations into consistency, by improving initial conditions, inferring uncertain model parameters and structure, and quantifying uncertainty. Generally, there will be advantages and complementarities of adjoint-based smoother approaches, ensemble-based filter approaches, or new ML-inspired approaches. Yet, the ever-increasing model resolution will present growing challenges arising from computational cost, calling for new ways of performing data assimilation and model optimization. Using the complementarity in a hybrid approach, blending tools and concepts from variational, ensemble and ML methods might be what is required in the future. In this context ML could be important to handle non-linear responses, and to better approximate non-Gaussian distributions.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2004

Windows(Registered Trademark)-Based Software Models Cyclic Oxidation Behavior

Oxidation of high-temperature aerospace materials is a universal issue for combustion-path components in turbine or rocket engines. In addition to the question of the consumption of material due to growth of protective scale at use temperatures, there is also the question of cyclic effects and spallation of scale on cooldown. The spallation results in the removal of part of the protective oxide in a discontinuous step and thereby opens the way for more rapid oxidation upon reheating. In experiments, cyclic oxidation behavior is most commonly characterized by measuring changes in weight during extended time intervals that include hundreds or thousands of heating and cooling cycles. Weight gains occurring during isothermal scale-growth processes have been well characterized as being parabolic or nearly parabolic functions of time because diffusion controls reaction rates. In contrast, the net weight change in cyclic oxidation is the sum of the effects of the growth and spallation of scale. Typically, the net weight gain in cyclic oxidation is determined only empirically (that is, by measurement), with no unique or straightforward mathematical connection to either the rate of growth or the amount of metal consumed. Thus, there is a need for mathematical modeling to infer spallation mechanisms. COSP is a computer program that models the growth and spallation processes of cyclic oxidation on the basis of a few elementary assumptions that were discussed in COSP: A Computer Model of Cyclic Oxidation, Oxidation of Metals, vol. 36, numbers 1 and 2, 1991, pages 81-112. Inputs to the model include the selection of an oxidation-growth law and a spalling geometry, plus oxide-phase, growth-rate, cycle-duration, and spall-constant parameters. (The spalling fraction is often shown to be a constant factor times the existing amount of scale.) The output of COSP includes the net change in weight, the amounts of retained and spalled oxide, the total amounts of oxygen and metal consumed, and the terminal rates of weight loss and metal consumption.

Smialek, J. L.↗
NASA NTRSDate not supplied

Biological Research and Space Health Enabled by Machine Learning to Support Deep Space Missions

A key science goal of the NASA “Moon to Mars” campaign is to understand how biology responds to the Lunar, Martian, and deep space environments in order to advance fundamental knowledge, reduce risk, and support safe, productive human space missions. Through the powerful emerging computer science approaches of artificial intelligence (AI) and machine learning (ML), a paradigm shift has begun in biomedical science and engineered astronaut health systems, to enable Earth-independence and autonomy of mission operations. We present a decadal view of AI/ML architecture to support deep space mission goals, developed in concert with leaders in the field. We describe current AI/ML methods to support 1) fundamental biology, 2) in situ analytics, 3) high performance computing hardware, 4) automated science, 5) self-driving labs, 6) remote data management, 7) integrated real-time mission biomonitoring, and 8) a Precision Space Health system. Cutting-edge AI/ML approaches that can be integrated to support these domains include active learning, explainable AI, adaptive learning, causal inference, knowledge graphs, federated learning, transfer learning, and large language models. Finally, we present results from several current ML projects that are underway in the field to address key challenges of small sample n, high feature count, heterogeneity, and sparse data. These include 1) connecting omics data to phenotypic data using an ensemble model to infer causality of spaceflight rodent liver health disruption, 2) usage of explainable ML to interrogate the muscular underpinnings of spaceflight muscle atrophy, 3) ML models analyzing and determining directed acyclic graphs of human space health risk leveraging rodent bone datasets, 4) usage of large pre-trained models connecting biomedical knowledgebases with small spaceflight datasets to understand gene-to-gene interaction networks, and 5) a suite of benchmarked open science datasets (spaceflight mouse liver; radiation DNA damage) enabling programmers to identify the best ML algorithms to answer space biological science questions.

space biology↗
NASA NTRSDate not supplied

Biological Research and Space Health Enabled by Machine Learning to Support Deep Space Missions

A key science goal of the NASA “Moon to Mars” campaign is to understand how biology responds to the Lunar, Martian, and deep space environments in order to advance fundamental knowledge, reduce risk, and support safe, productive human space missions. Through the powerful emerging computer science approaches of artificial intelligence (AI) and machine learning (ML), a paradigm shift has begun in biomedical science and engineered astronaut health systems, to enable Earth-independence and autonomy of mission operations. We present a decadal view of AI/ML architecture to support deep space mission goals, developed in concert with leaders in the field. We describe current AI/ML methods to support 1) fundamental biology, 2) in situ analytics, 3) high performance computing hardware, 4) automated science, 5) self-driving labs, 6) remote data management, 7) integrated real-time mission biomonitoring, and 8) a Precision Space Health system. Cutting-edge AI/ML approaches that can be integrated to support these domains include active learning, explainable AI, adaptive learning, causal inference, knowledge graphs, federated learning, transfer learning, and large language models. Finally, we present results from several current ML projects that are underway in the field to address key challenges of small sample n, high feature count, heterogeneity, and sparse data. These include 1) connecting omics data to phenotypic data using an ensemble model to infer causality of spaceflight rodent liver health disruption, 2) usage of explainable ML to interrogate the muscular underpinnings of spaceflight muscle atrophy, 3) ML models analyzing and determining directed acyclic graphs of human space health risk leveraging rodent bone datasets, 4) usage of large pre-trained models connecting biomedical knowledgebases with small spaceflight datasets to understand gene-to-gene interaction networks, and 5) a suite of benchmarked open science datasets (spaceflight mouse liver; radiation DNA damage) enabling programmers to identify the best ML algorithms to answer space biological science questions.

space biology↗
DOE OSTI2016

Comparison of continuous and discrete-time data-based modeling for hypoelliptic systems

In this work, we compare two approaches to the predictive modeling of dynamical systems from partial observations at discrete times. The first is continuous in time, where one uses data to infer a model in the form of stochastic differential equations, which are then discretized for numerical solution. The second is discrete in time, where one directly infers a discrete-time model in the form of a nonlinear autoregression moving average model. The comparison is performed in a special case where the observations are known to have been obtained from a hypoelliptic stochastic differential equation. We show that the discrete-time approach has better predictive skills, especially when the data are relatively sparse in time. Finally , we discuss open questions as well as the broader significance of the results.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1988

Inference of geologic surface parameters from polarimetric radar observations and model inversion

The results of inferring geologic parameters such as rms surface height, correlation length, and dielectric constant of rough surfaces by fitting observed polarization signatures with those predicted by the second order Rice model are discussed. The inferred results are compared to measured values of rms height and correlation length. The rms height values inferred are in good agreement with in situ measurements. The inferred correlation lengths generally do not agree with measured values. The results allow the separation of the effects of surface roughness and dielectric constant on the overall backscatter from rough surfaces.

Vanzyl, Jakob J.↗
DOE OSTI2026

Informing Robust Functional Relationship Benchmarks: An Evaluation of the Temperature Sensitivity of Ecosystem Respiration Across the Arctic-Boreal Region

During land model development, simulated carbon dynamics are often benchmarked against observational data sets to evaluate model performance. Functional relationship benchmarks are the relationship between a driving variable (e.g., temperature) and a response variable (e.g., ecosystem respiration) and are a promising tool for assessing model performance by evaluating modeled sensitivities to changing environmental conditions. However, observed functional relationships can be influenced by choices made during data collection and throughout the benchmarking process, impacting the inferred skill of land models. To avoid misrepresenting a model's true performance, it is necessary to systematically evaluate best practices when constructing functional relationship benchmarks. We developed a set of guidelines for constructing functional relationship benchmarks, considering the choice of data set, number of daily observations, temporal extent, and temporal resolution across Alaska and Canada over a 20-year period from 2001 to 2020. The temperature sensitivity of ecosystem respiration from observations, evaluated through an apparent Q 10 , is highly variable both spatially and as a result of the data processing approach applied in the benchmark formation. When benchmarking 13 models from the Warming Permafrost Model Intercomparison Project (WrPMIP), the range in inferred model skill is substantially impacted by the choices applied in constructing functional relationship benchmarks. The inferred performance of a given model is most sensitive to the number of daily observations and temporal extent, followed by choice of benchmark data set and temporal averaging. Results from this analysis can guide the development of consistent and robust functional relationships for future model evaluation studies.

Poe, Jeralyn [Northern Arizona University, Flagsta↗
DOE OSTI2023

A Bayesian model for multivariate discrete data using spatial and expert information with application to inferring building attributes

When modeling sparsely observed multivariate data, strong prior information elicited from experts can be used to bolster predictive accuracy and counteract sampling bias. Similarly, modeling autocorrelation in space can help make use of co-occurrence patterns present in many types of spatial data. To make use of both expert prior information and spatial structure, we propose a novel graphical model for a spatial Bayesian network developed specifically to address challenges in inferring the attributes of buildings from geographically sparse observational data. This model is implemented as the sum of a spatial multivariate Gaussian random field and a tabular conditional probability function in real-valued space prior to projection onto the probability simplex. This modeling form is especially suitable for the usage of prior information in the form of sets of atomic rules obtained from experts. To perform inference with missing data, we implement a Markov chain Monte Carlo scheme composed of alternating steps of Gibbs sampling of missing entries and Hamiltonian Monte Carlo for model parameters. A case study in building attribution is presented to highlight the advantages and limitations of this approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Bayesian model-data comparison incorporating theoretical uncertainties

Accurate comparisons between theoretical models and experimental data are critical for scientific progress. However, inferred physical model parameters can vary significantly with the chosen physics model, highlighting the importance of properly accounting for theoretical uncertainties. In this Letter, we present a Bayesian framework that explicitly quantifies these uncertainties by statistically modeling theory errors, guided by qualitative knowledge of a theory’s varying reliability across the input domain. We demonstrate the effectiveness of this approach using two systems: a simple ball drop experiment and multi-stage heavy-ion simulations. In both cases incorporating model discrepancy leads to improved parameter estimates, with systematic improvements observed as additional experimental observables are integrated.

Bayesian methods↗
DOE OSTI2026

Statistical inference of anomalous thermal transport with uncertainty quantification for interpretive 2D SOL models

The critical task of inferring anomalous cross-field transport coefficients is addressed in simulations of boundary plasmas with fluid models. A workflow for parameter inference in the UEDGE fluid code is developed using Bayesian optimization with parallelized sampling and integrated uncertainty quantification. In this workflow, transport coefficients are inferred by maximizing their posterior probability distribution, which is generally multidimensional and non-Gaussian. Uncertainty quantification is integrated throughout the optimization within the Bayesian framework that combines diagnostic uncertainties and model limitations. As a concrete example, we infer the anomalous electron thermal diffusivity $\chi_\perp$ from an interpretive 2D model describing electron heat transport in the conduction-limited region with radiative power loss. The workflow is first benchmarked against synthetic data and then tested on H-, L-, and I-mode discharges to match their midplane temperature and divertor heat flux profiles. We demonstrate that the workflow efficiently infers diffusivity and its associated uncertainty, generating 2D profiles that match 1D measurements. Future efforts will focus on incorporating more complicated fluid models and analyzing transport coefficients inferred from a large database of experimental results.

Bayesian optimization↗
DOE OSTI2022

Operator inference for non-intrusive model reduction with quadratic manifolds

This paper proposes a novel approach for learning a data-driven quadratic manifold from high-dimensional data, then employing this quadratic manifold to derive efficient physics-based reduced-order models. The key ingredient of the approach is a polynomial mapping between high-dimensional states and a low-dimensional embedding. This mapping consists of two parts: a representation in a linear subspace (computed in this work using the proper orthogonal decomposition) and a quadratic component. The approach can be viewed as a form of data-driven closure modeling, since the quadratic component introduces directions into the approximation that lie in the orthogonal complement of the linear subspace, but without introducing any additional degrees of freedom to the low-dimensional representation. Combining the quadratic manifold approximation with the operator inference method for projection-based model reduction leads to a scalable non-intrusive approach for learning reduced-order models of dynamical systems. Further, applying the new approach to transport-dominated systems of partial differential equations illustrates the gains in efficiency that can be achieved over approximation in a linear subspace.

42 ENGINEERING↗
NASA NTRS2011

Sensitivity of Seawater Oxygen Isotopes to Climatic and Tectonic Boundary Conditions in an Early Paleogene Simulation with GISS ModelE-R

An isotope-enabled ocean-atmosphere general circulation model (GISS ModelE -R) is used to estimate the spatial gradients of the oxygen isotopic composition of seawater (delta O-18(sub sw), where delta is the deviation from a known reference material in per mil) during the early Paleogene (45.65 Ma). Understanding the response of delta O-18(sub sw) to changes in climatic and tectonic boundary conditions is important because records of carbonate delta O-18 document changes in hydrology, as well as changes in temperature and global ice -volume. We present results from an early Paleogene configuration of ModelE -R which indicate that spatial gradients of surface ocean delta O-18(sub sw) during this period could have been significantly different to those in the modern ocean. The differences inferred from ModelE -R are sufficient to change early Paleogene sea surface temperature estimates derived from primary carbonate delta O-18 signatures by more than +/-2 C in large areas of the ocean. In the North Atlantic, Indian, and Southern Oceans, the differences in d18Osw inferred from our simulation with ModelE -R are in direct contrast with those from another d18O ]tracing model study which used different, but equally plausible, early Paleogene boundary conditions. The large differences in delta O-18(sub sw) between preindustrial and early Paleogene simulations, and between models, emphasizes the sensitivity of d18Osw to climatic and tectonic boundary conditions. For this reason, absolute estimates of Eocene/ Paleocene temperature derived from carbonate delta O-18 alone are likely to have larger uncertainties than are usually assumed.

Roberts, Christopher D.↗
DOE OSTI2018

Optimization, Inference and Learning for Advanced Networks

This piece of software aims at providing an implementation of methods to perform efficient optimization, probabilistic inference and model selection and learning for various type of networked systems. The software contains a suite of methods and functions that: 1) perform probabilistic inference and random sampling on networked models 2) select or learn networked models from data 3) solve optimization tasks with a networked structure Network models that are supported by these features include, but are not limited to, factor graphs and Markov random fields such as Ising models, Potts models, p-spins models, Gaussian random fields and restricted Boltzmann machine.

Hijazi, Hassan↗
DOE OSTI2020

Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms

Here in this work we present a non-intrusive model reduction method to learn low-dimensional models of dynamical systems with non-polynomial nonlinear terms that are spatially local and that are given in analytic form. In contrast to state-of-the-art model reduction methods that are intrusive and thus require full knowledge of the governing equations and the operators of a full model of the discretized dynamical system, the proposed approach requires only the non-polynomial terms in analytic form and learns the rest of the dynamics from snapshots computed with a potentially black-box full-model solver. The proposed method learns operators for the linear and polynomially nonlinear dynamics via a least-squares problem, where the given non-polynomial terms are incorporated on the right-hand side. The least-squares problem is linear and thus can be solved efficiently in practice. The proposed method is demonstrated on three problems governed by partial differential equations, namely the diffusion–reaction Chafee–Infante model, a tubular reactor model for reactive flows, and a batch-chromatography model that describes a chemical separation process. The numerical results provide evidence that the proposed approach learns reduced models that achieve comparable accuracy as models constructed with state-of-the-art intrusive model reduction methods that require full knowledge of the governing equations.

42 ENGINEERING↗
DOE OSTI2021

Towards a dynamic photosynthesis model to guide yield improvement in C4 crops

Summary The most productive C4 food and biofuel crops, such as Saccharum officinarum (sugarcane), Sorghum bicolor (sorghum) and Zea mays (maize), all use NADP‐ME‐type C4 photosynthesis. Despite high productivities, these crops fall well short of the theoretical maximum solar conversion efficiency of 6%. Understanding the basis of these inefficiencies is key for bioengineering and breeding strategies to increase the sustainable productivity of these major C4 crops. Photosynthesis is studied predominantly at steady state in saturating light. In field stands of these crops light is continually changing, and often with rapid fluctuations. Although light may change in a second, the adjustment of photosynthesis may take many minutes, leading to inefficiencies. We measured the rates of CO 2 uptake and stomatal conductance of maize, sorghum and sugarcane under fluctuating light regimes. The gas exchange results were combined with a new dynamic photosynthesis model to infer the limiting factors under non‐steady‐state conditions. The dynamic photosynthesis model was developed from an existing C4 metabolic model for maize and extended to include: (i) post‐translational regulation of key photosynthetic enzymes and their temperature responses; (ii) dynamic stomatal conductance; and (iii) leaf energy balance. Testing the model outputs against measured rates of leaf CO 2 uptake and stomatal conductance in the three C4 crops indicated that Rubisco activase, the pyruvate phosphate dikinase regulatory protein and stomatal conductance are the major limitations to the efficiency of NADP‐ME‐type C4 photosynthesis during dark‐to‐high light transitions. We propose that the level of influence of these limiting factors make them targets for bioengineering the improved photosynthetic efficiency of these key crops.

59 BASIC BIOLOGICAL SCIENCES↗