Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data driven model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

Observations on the Application of Machine Learning Techniques to Aviation Operations

There is an increasing interest in applying methods based on Machine Learning Techniques (MLT) to problems in aviation operations. The current interest is based on developments in Cloud Computing, the availability of open software and the success of MLT in automation, consumer behavior and finance involving large database. Historically aviation operations have been analyzed using physics-based models and provide information for making operational decisions. This talk describes issues to be addressed in applying either model-driven or data-driven methods. Aviation operations involving many decision makers, multiple objectives, poor or unavailable physics-based models and a rich historical database are prime candidates for analysis using data-driven methods. The issues are illustrated by a detailed example and summary of current research in the area. The application of MLT to aviation operations falls into two categories: (a) based on the lack of a physics-based model, MLT is the favored approach and (b) marginal difference between regression methods using physics-based models and MLT. Further research is needed in the selection of MLT to critical aviation operations. As always, the best approach depends on the task, the physical understanding of the problem and the quality and quantity of the available data.

Sridhar, Banavar↗
NASA NTRS2020

Application of Machine Learning Techniques to Aviation Operations: A Case Study

There is an increasing interest in applying methods based on Machine Learning Techniques (MLT) to problems in aviation operations. The current interest is based on developments in Cloud Computing, the availability of open software and the success of MLT in automation, consumer behavior and finance involving large database. Historically aviation operations have been analyzed using physics-based models and provide information for making operational decisions. This talk describes issues to be addressed in applying either model-driven or data-driven methods. Aviation operations involving many decision makers, multiple objectives, poor or unavailable physics-based models and a rich historical database are prime candidates for analysis using data-driven methods. The issues are illustrated by a detailed example and summary of current research in the area. The application of MLT to aviation operations falls into two categories 58; (a) based on the lack of a physics-based model, MLT is the favored approach and (b) marginal difference between regression methods using physics-based models and MLT. Further research is needed in the selection of MLT to critical aviation operations. As always, the best approach depends on the task, the physical understanding of the problem and the quality and quantity of the available data.

Sridhar, Banavar↗
DOE OSTI2021

A Review and Outlook on Energy Consumption Estimation Models for Electric Vehicles

Electric vehicles (EVs) are critical to the transition to a low-carbon transportation system. The successful adoption of EVs heavily depends on energy consumption models that can accurately and reliably estimate electricity consumption. This paper reviews the state-of-the-art of EV energy consumption models, aiming to provide guidance for future development of EV applications. Here, we summarize influential variables of EV energy consumption into four categories: vehicle component, vehicle dynamics, traffic and environment related factors. We classify and discuss EV energy consumption models in terms of modeling scale (microscopic vs. macroscopic) and methodology (data-driven vs. rule-based). Our review shows trends of increasing macroscopic models that can be used to estimate trip-level EV energy consumption and increasing data-driven models that utilized machine learning technologies to estimate EV energy consumption based on large volume real-world data. We identify research gaps for EV energy consumption models, including the development of energy estimation models for modes other than personal vehicles (e.g., electric buses, electric trucks, and electric non-road vehicles); the development of energy estimation models that are suitable for applications related to vehicle-to-grid integration; and the development of multi-scale energy estimation models as a holistic modeling approach.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Benefits and Cautions in Data Assimilation Strategies: An Example of Modeling Groundwater Recharge

Assimilating recent observations improves model outcomes for real-time assessments of groundwater processes. This is demonstrated in estimating time-varying recharge to a shallow fractured-rock aquifer in response to precipitation. Results from estimating the time-varying water-table altitude (h) and recharge, and their error covariances, are compared for forecasting, filtering, and fixed-lag smoothing (FLS), which are implemented using the Kalman Filter as applied to a data-driven, mechanistic model of recharge. Forecasting uses past observations to predict future states and is the current paradigm in most groundwater modeling investigations; filtering assimilates observations up to the current time to estimate current states; and FLS estimates states following a time lag over which additional observations are collected. Results for forecasting yield a large error covariance relative to the magnitude of the expected recharge. With assimilating recent observations of h, filtering and FLS produce estimates of recharge that better represent time-varying observations of h and reduce uncertainty in comparison to forecasting. Although model outcomes from applying data assimilation through filtering or FLS reduce model uncertainty, they are not necessarily mass conservative, whereas forecasting outcomes are mass conservative. Mass conservative outcomes from forecasting are not necessarily more accurate, because process errors are inherent in any model. Improvements in estimating real-time groundwater conditions that better represent observations need to be weighed for the model application against outcomes with inherent process deficiencies. In conclusion, results from data assimilation strategies discussed in this investigation are anticipated to be relevant to other groundwater processes models where system states are sensitive to system inputs.

aquifer recharge↗
DOE OSTI2025

Constrained or unconstrained? Neural-network-based equation discovery from data

Throughout many fields, practitioners often rely on differential equations to model systems. Yet, for many applications, the theoretical derivation of such equations and/or the accurate resolution of their solutions may be intractable. Instead, recently developed methods, including those based on parameter estimation, operator subset selection, and neural networks, allow for the data-driven discovery of both ordinary and partial differential equations (PDEs), on a spectrum of interpretability. The success of these strategies is often contingent upon the correct identification of representative equations from noisy observations of state variables and, as importantly and intertwined with that, the mathematical strategies utilized to enforce those equations. Specifically, the latter has been commonly addressed via unconstrained optimization strategies. Representing the PDE as a neural network, we propose to discover the PDE (or the associated operator) by solving a constrained optimization problem and using an intermediate state representation similar to a physics-informed neural network (PINN). The objective function of this constrained optimization problem promotes matching the data, while the constraints require that the discovered PDE is satisfied at a number of spatial collocation points. We present a penalty method and a widely used trust-region barrier method to solve this constrained optimization problem, and we compare these methods on numerical examples. Our results on several example problems demonstrate that the latter constrained method outperforms the penalty method, particularly for higher noise levels or fewer collocation points. This work motivates further exploration into using sophisticated constrained optimization methods in scientific machine learning, as opposed to their commonly used, penalty-method or unconstrained counterparts. For both of these methods, we solve these discovered neural network PDEs with classical methods, such as finite difference methods, as opposed to PINNs-type methods relying on automatic differentiation. Here, we briefly highlight how simultaneously fitting the data while discovering the PDE improves the robustness to noise and other small, yet crucial, implementation details.

Data-driven discovery↗
DOE OSTI2022

A PDE Model of Breast Tumor Progression in MMTV-PyMT Mice

The evolution of breast tumors greatly depends on the interaction network among different cell types, including immune cells and cancer cells in the tumor. This study takes advantage of newly collected rich spatio-temporal mouse data to develop a data-driven mathematical model of breast tumors that considers cells’ location and key interactions in the tumor. The results show that cancer cells have a minor presence in the area with the most overall immune cells, and the number of activated immune cells in the tumor is depleted over time when there is no influx of immune cells. Interestingly, in the case of the influx of immune cells, the highest concentrations of both T cells and cancer cells are in the boundary of the tumor, as we use the Robin boundary condition to model the influx of immune cells. In other words, the influx of immune cells causes a dominant outward advection for cancer cells. We also investigate the effect of cells’ diffusion and immune cells’ influx rates in the dynamics of cells in the tumor micro-environment. Sensitivity analyses indicate that cancer cells and adipocytes’ diffusion rates are the most sensitive parameters, followed by influx and diffusion rates of cytotoxic T cells, implying that targeting them is a possible treatment strategy for breast cancer.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Neural entropy-stable conservative flux form neural networks for learning hyperbolic conservation laws

We propose a neural entropy-stable conservative flux form neural network (NESCFN) for learning hyperbolic conservation laws and their associated entropy functions directly from solution trajectories, without requiring any predefined numerical discretization. While recent neural network architectures have successfully integrated classical numerical principles into learned models, most rely on prior knowledge of the governing equations or assume a fixed discretization. Our approach removes this dependency by embedding entropy-stable design principles into the learning process itself, enabling the discovery of physically consistent dynamics in a fully data-driven setting. By jointly learning both the flux function and a corresponding entropy, NESCFN promotes conservation and entropy dissipation, which is critical for long-term stability and fidelity in the system of hyperbolic conservation laws. Furthermore, numerical results demonstrate that the method achieves stability and conservation over extended time horizons and accurately captures shock propagation speeds, even without oracle access to future-time solution profiles in the training data.

Conservative flux form↗
DOE OSTI2024

Data-Efficient Generation of Protein Conformational Ensembles with Backbone-to-Side-Chain Transformers

Excitement at the prospect of using data-driven generative models to sample configurational ensembles of biomolecular systems stems from the extraordinary success of these models on a diverse set of high-dimensional sampling tasks. Unlike image generation or even the closely related problem of protein structure prediction, there are currently no data sources with sufficient breadth to parametrize generative models for conformational ensembles. To enable discovery, a fundamentally different approach to building generative models is required: models should be able to propose rare, albeit physical, conformations that may not arise in even the largest data sets. Here, in this work, we introduce a modular strategy to generate conformations based on “backmapping” from a fixed protein backbone that (1) maintains conformational diversity of the side chains and (2) couples the side-chain fluctuations using global information about the protein conformation. Our model combines simple statistical models of side-chain conformations based on rotamer libraries with the now ubiquitous transformer architecture to sample with atomistic accuracy. Together, these ingredients provide a strategy for rapid data acquisition and hence a crucial ingredient for scalable physical simulation with generative neural networks.

36 MATERIALS SCIENCE↗
NASA NTRS2017

Mission Assurance: A Model-Based Approach

The purpose of Safety and Mission Assurance (SMA) at NASA’s Jet Propulsion Laboratory is to ensure mission safety and success. As the complexity of technical systems increases, the tools, processes, and infrastructure used to facilitate SMA activities must evolve. A transition from a document-centric approach to a data-driven, model-based architecture is critical in allowing SMA efforts to grapple with complex system designs. This work describes how a sample subset of existing SMA processes can be executed in a model-based environment, while also describing ways in which a model-based architecture can further augment SMA efforts. One key aspect is supporting the complex interplay between the different SMA processes and the systems engineering effort to provide additional insight into the system from an SMA perspective. The proposed architecture for model-based mission assurance provides an avenue for assuring mission safety and success in increasingly complex systems.

Schreiner, Samuel S.↗
DOE OSTI2025

Micromechanical Surrogate Machine Learning Model for Creep Deformation Modeling

Process variability during the manufacture of gas turbine engine hot section components can significantly affect the material’s resulting microstructure. In casting, for instance, geometric variation within a component (thin sections versus thick sections, radial location) influences cooling rates and the resulting grain size. The high temperature creep response is known to be sensitive to grain size owing to a diffusional creep mechanism which occurs more readily along grain boundaries. Microstructural variation correspondingly drives mechanical behavior which propagates into component scale performance uncertainty. These factors are essential when planning inspection, maintenance, and repair strategies within a reliability framework. These benefits provide opportunities to increase overall energy efficiency through refined margins. Critically, there is an opportunity to bolster existing data-driven reliability models using physics-driven process-structure-property relations. Here we present recent work establishing a framework for evaluating the probabilistic creep performance of high-temperature materials. A novel microstructure-sensitive crystal plasticity finite element model is established that captures both grain boundary and crystallographic deformation effects. The computationally expensive physics model is calibrated using a statistical approach and this high-fidelity model is subsequently used to train a computationally efficient machine learning surrogate model. The surrogate model is essential for sampling a large ensemble of simulated structure-property pair results. The ensemble data are then mined to extract salient trends to be incorporated into a microstructure-sensitive reliability model. The proposed approach represents a novel way to capture microstructure-sensitive trends from physics-based models within a modern reliability framework.

Fernandez-Zelaia, Patxi [ORNL]↗
DOE OSTI2020

Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms

Here in this work we present a non-intrusive model reduction method to learn low-dimensional models of dynamical systems with non-polynomial nonlinear terms that are spatially local and that are given in analytic form. In contrast to state-of-the-art model reduction methods that are intrusive and thus require full knowledge of the governing equations and the operators of a full model of the discretized dynamical system, the proposed approach requires only the non-polynomial terms in analytic form and learns the rest of the dynamics from snapshots computed with a potentially black-box full-model solver. The proposed method learns operators for the linear and polynomially nonlinear dynamics via a least-squares problem, where the given non-polynomial terms are incorporated on the right-hand side. The least-squares problem is linear and thus can be solved efficiently in practice. The proposed method is demonstrated on three problems governed by partial differential equations, namely the diffusion–reaction Chafee–Infante model, a tubular reactor model for reactive flows, and a batch-chromatography model that describes a chemical separation process. The numerical results provide evidence that the proposed approach learns reduced models that achieve comparable accuracy as models constructed with state-of-the-art intrusive model reduction methods that require full knowledge of the governing equations.

42 ENGINEERING↗
NASA NTRS1994

Data driven propulsion system weight prediction model

The objective of the research was to develop a method to predict the weight of paper engines, i.e., engines that are in the early stages of development. The impetus for the project was the Single Stage To Orbit (SSTO) project, where engineers need to evaluate alternative engine designs. Since the SSTO is a performance driven project the performance models for alternative designs were well understood. The next tradeoff is weight. Since it is known that engine weight varies with thrust levels, a model is required that would allow discrimination between engines that produce the same thrust. Above all, the model had to be rooted in data with assumptions that could be justified based on the data. The general approach was to collect data on as many existing engines as possible and build a statistical model of the engines weight as a function of various component performance parameters. This was considered a reasonable level to begin the project because the data would be readily available, and it would be at the level of most paper engines, prior to detailed component design.

Gerth, Richard J.↗
DOE OSTI2023

Direct Estimation of Parameters in ODE Models Using WENDy: Weak-Form Estimation of Nonlinear Dynamics

Abstract We introduce the Weak-form Estimation of Nonlinear Dynamics (WENDy) method for estimating model parameters for non-linear systems of ODEs. Without relying on any numerical differential equation solvers, WENDy computes accurate estimates and is robust to large (biologically relevant) levels of measurement noise. For low dimensional systems with modest amounts of data, WENDy is competitive with conventional forward solver-based nonlinear least squares methods in terms of speed and accuracy. For both higher dimensional systems and stiff systems, WENDy is typically both faster (often by orders of magnitude) and more accurate than forward solver-based approaches. The core mathematical idea involves an efficient conversion of the strong form representation of a model to its weak form, and then solving a regression problem to perform parameter inference. The core statistical idea rests on the Errors-In-Variables framework, which necessitates the use of the iteratively reweighted least squares algorithm. Further improvements are obtained by using orthonormal test functions, created from a set of $$C^{\infty }$$ C ∞ bump functions of varying support sizes.We demonstrate the high robustness and computational efficiency by applying WENDy to estimate parameters in some common models from population biology, neuroscience, and biochemistry, including logistic growth, Lotka-Volterra, FitzHugh-Nagumo, Hindmarsh-Rose, and a Protein Transduction Benchmark model. Software and code for reproducing the examples is available at https://github.com/MathBioCU/WENDy .

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

System modeling for grid-interactive efficient building applications

Despite the abundance of research applications of system modeling in grid-interactive efficient buildings (GEBs), the transfer of those applications to real-world practices is still in its early stages. This is partially due to the lack of a summary on how system modeling should be established for a given application of GEBs. Here, we fill this gap by providing an extensive survey of the literature on system modeling for different GEBs that have been produced in the past decade. This survey involves over 300 relevant journal articles from the building community, the power system community, and the society of control. Specifically, we first identified key requirements of system modeling for GEBs based on various types of applications discussed in those publications. We then summarized the system modeling applications from those publications, in terms of their assumptions, modeling approach, and simulation. After that, we analyzed different assumptions made for various applications, the extent to which those modeling approaches satisfied the key requirements, and how those approaches can be scaled up for large-scale applications, which are quite common in GEBs. In addition, we gave insights on how to use system modeling for different applications in GEBs. At the end, we provided recommended directions for future studies to fully unleash the potentials of system modeling to support GEBs.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Real-Time, Adaptive Radiological Anomaly Detection and Isotope Identification Using Non-Negative Matrix Factorization

Spectroscopic anomaly detection and isotope identification algorithms are integral components in nuclear nonproliferation applications such as search operations. The task is especially challenging in the case of mobile detector systems because the observed gamma-ray background changes more than for a static detector system, and a pretrained background model can easily find itself out of domain. The result is that algorithms may exceed their intended false alarm rate or sacrifice detection sensitivity to maintain the desired false alarm rate. Non-negative matrix factorization (NMF) is a powerful tool for spectral anomaly detection and identification, but, like many similar algorithms that rely on data-driven background models, in its conventional implementation, it is unable to update in real time to account for environmental changes that affect the background spectroscopic signature. Here, we have developed a novel NMF-based algorithm that periodically updates its background model to accommodate changing environmental conditions. The adaptive NMF algorithm involves fewer assumptions about its environment, making it more generalizable than existing NMF-based methods while maintaining or exceeding detection performance on simulated and real-world datasets.

Anomaly detection↗
DOE OSTI2024

The SAGA Survey. V. Modeling Satellite Systems around Milky Way–Mass Galaxies with Updated UniverseMachine

Abstract Environment plays a critical role in shaping the assembly of low-mass galaxies. Here, we use the U niverse M achine (UM) galaxy–halo connection framework and Data Release 3 of the Satellites Around Galactic Analogs (SAGA) Survey to place dwarf galaxy star formation and quenching into a cosmological context. UM is a data-driven forward model that flexibly parameterizes galaxy star formation rates (SFRs) using only halo mass and assembly history. We add a new quenching model to UM, tailored for galaxies with m ⋆ ≲ 10 9 M ⊙ , and constrain the model down to m ⋆ ≳ 10 7 M ⊙ using new SAGA observations of 101 satellite systems around Milky Way (MW)–mass hosts and a sample of isolated field galaxies in a similar mass range from the Sloan Digital Sky Survey. The new best-fit model, “UM-SAGA,” reproduces the satellite stellar mass functions, average SFRs, and quenched fractions in SAGA satellites while keeping isolated dwarfs mostly star-forming. The enhanced quenching in satellites relative to isolated field galaxies leads the model to maximally rely on halo assembly to explain the observed environmental quenching. Extrapolating the model down to m ⋆ ∼ 10 6.5 M ⊙ yields a quenched fraction of ≳30% for isolated field galaxies and ≳80% for satellites of MW-mass hosts at this stellar mass. Spectroscopic surveys can soon test this specific prediction to reveal the relative importance of internal feedback, cessation of mass and gas accretion, satellite-specific gas processes, and reionization for the evolution of faint low-mass galaxies.

Wang, Yunchong (ORCID:000000018913626X)↗
DOE OSTI2024

The precision measurement of the muon $g-2$ at Fermilab

The Muon $g-2$ Experiment at Fermilab aims to measure the magnetic anomaly of the muon with the unprecedented precision of 140 parts per billion. In April 2021, the collaboration published the first measurement based on the first year of data collection, which was found to be consistent with the previous experiment at Brookhaven. The new global average of the experimental measurements strengthens the long-standing tension with the data-driven Standard Model prediction to a combined discrepancy of 4.2$\sigma$. On the theory side, however, recent improvements in the theoretical calculation of the hadronic contribution based on Lattice-QCD techniques are introducing new tensions on the value predicted by the theory. The Muon $g-2$ Experiment at Fermilab has now concluded its sixth and final year of data taking and a new result based on the Run-2 and Run-3 data was published in August 2023. This paper briefly describes the precision measurement conducted by the Muon $g-2$ Experiment at Fermilab and its current status.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗