Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data driven modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78

The Hyperspectral Infrared Imager (HyspIRI) Public Health and Air Quality Applications

The neglected tropical diseases (NTDs), a group of chronic, debilitating, and poverty-promoting parasitic, bacterial, and some viral and fungal infections, are among the most common causes of illness of the poorest people living in developing countries. Abiotic environmental factors are important in determining the distribution of disease-causing vectors and their life-cycles. HyspIRI observations can be merged through a Land Data Assimilation System (LDAS) be used to drive spatially-explicit ecological models of NTD vectors distribution and life cycles. Assimilations will be driven by observational data LDAS and satellite-derived meteorological forcing data, parameter datasets, and assimilation observations. HyspIRI hyperspectral measurements would provide global measurements of surface mineralogy and biotic crusts important in accessing the impact of dust in human health. HyspIRI surface thermal measurements would also help identify the variability of dust sources due to surface moisture conditions and map mineralogy.

Luvall, Jeffrey C.↗

Chemical Reactivity Through Adaptive Quantum Mechanics/Many-Body Representations: Theoretical Development, Software Implementation, and Applications (Final Report)

The main objective of this research project was the development and application of a new theoretical/computational framework to model chemical transformations and electronic excitations in fluid mixtures across different phases. Our theoretical/computational framework combines our data-driven many-body (DD-MB) potentials representing molecular interactions with adaptive schemes for modeling chemical reactions in solution. The combination of these two components resulted in an adaptive quantum mechanics/many-body (adQM/MB) method that largely suppresses discontinuities between QM and MM regions, which affect existing QM/MM methods, and thus provides an accurate representation of both quantum mechanical and environmental effects through a rigorous description of mutual polarization between QM and MM regions. The implementation of our DD-MB potentials and adQM/MB method in popular software enabled computer simulations of solvation phenomena, reactive processes, and electronic excitations in fluid mixtures with chemical and spectroscopic accuracy, representing a major step toward realistic computer simulations of a wide range of molecular systems relevant to the DOE mission.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Verification and validation of developed short-term forecasting models

Recent advancements in machine learning (ML) and artificial intelligence (AI) technologies provide an opportunity for leveraging data-driven algorithms to predict future nuclear power plant (NPP) operating conditions by using recorded plant process data. Successfully implementing these models can lead to cost-reducing, conditioned-based predictive maintenance through optimized maintenance schedules and a reduction of unnecessary maintenance activities. This report discusses the verification and validation of short-term forecasting processes (i.e., data cleaning, feature selection, model optimization, and forecasting) developed in previous reports. The verification and validation (V&V) process demonstrates the expected precision and accuracy when the ML model encounters new datasets from different systems. Shapley additive explanations were used as the primary means of feature selection across these different data set. Individual models were trained for each data set, then validated through a cross-validation procedure. In this report, two different ML models were tasked to predict variables from three different plant process data sets with varying prediction horizons. The results indicate that support vector regression (SVR) outperformed long short-term memory (LSTM) neural networks in regard to each data set and each prediction horizon in this study, but further tuning and optimization could improve long short-term memory results. However, each forecasting model showed reduced performance as the prediction horizon was extended from 1 hour to 1 day ahead. Research is ongoing to evaluate the optimal input variable space, which is based on a given set of process parameters, to further improve forecasting accuracy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Simulation of hydropower at subcontinental to global scales: a state-of-the-art review

Abstract Hydroelectric power is playing a new and often expanded role in the world’s major power grids, offering low carbon generating capacity in industrializing, dam-building economies while providing reserve and flexibility to co-manage fledgling wind and solar resources in high income countries. Driven by river flows, conventional hydropower is exposed to the vagaries of weather and climate, motivating drought and climate change hydropower impact studies at large spatial scales. Here we review methods of climate-driven hydropower simulation at large spatial scales, specifically multi-basin regions to global. We identify four types of approach based on complexity of tools and richness of data applied to the problem. Since the earliest attempts to model climate-driven hydropower at continental scale almost two decades ago, the field has transitioned from one of scientific curiosity to practical application, with studies increasingly motivated by the need to inform power grid expansion planning and operation. As the hydrological and water management models used in large-scale hydropower studies become more sophisticated, new opportunities will emerge to study the impacts of changing hydropower on power system reliability and performance at large power grid scale. To grasp these opportunities, the water resources community must continue to enhance data and models for representing river flows and anthropogenic water use and management at subcontinental to global scales.

13 HYDRO ENERGY↗

Hybrid feature-driven learning system for abnormality detection and localization

A cyber-physical system may have a plurality of monitoring nodes each generating a series of current monitoring node values over time representing current operation of the system. A data-driven features extraction computer platform may receive the series of current monitoring node values and generate current data-driven feature vectors based on the series of current monitoring node values. A residual features extraction computer platform may receive the series of current monitoring node values, execute a system model and utilize a stochastic filter to determine current residual values, and generate current residual-driven feature vectors based on the current residual values. An abnormal detection platform may then receive the current data-driven and residual-driven feature vectors and compare the current data-driven and residual-driven feature vectors with at least one decision boundary associated with an abnormal detection model. An abnormal alert signal may then be transmitted when appropriate based on a result of said comparison.

Abbaszadeh, Masoud↗

Inter-well connectivity detection in CO 2 WAG projects using statistical recurrent unit models

Routine well-wise injection and production measurements contain significant information on subsurface structure and properties. Data-driven technology that interprets surface data into subsurface structure or properties can assist operators in making informed decisions by providing a better understanding of field assets. Our machine-learning framework is built on the statistical recurrent unit (SRU) model and interprets well-based injection/production data into inter-well connectivity without relying on a geologic model. We test it on synthetic and field-scale CO 2 EOR projects utilizing the water-alternating-gas (WAG) process. SRU is a special type of recurrent neural network (RNN) that allows for better characterization of temporal trends, by learning various statistics of the input at different time scales. In our application, the complete states (injection rate, pressure and cumulative injection) at injectors and pressure states at producers are fed to SRU as the input and the phase rates at producers are treated as the output. Once the SRU is trained and validated, it is then used to assess the connectivity of each injector to any producer using permutation variable importance method, wherein inputs corresponding to an injector are shuffled and the increase in prediction error at a given producer is recorded as the importance (connectivity metric) of the injector to the producer. This method is tested in both synthetic and field-scale cases. The validation of the proposed data-driven inter-well connectivity assessment is performed using synthetic data from simulation models where inter-well connectivity can be easily measured using the streamline-based flux allocation. The SRU model is shown to offer excellent prediction performance on the synthetic case. Despite significant measurement noise and frequent well shut-ins imposed in the field-scale case, the SRU model offers good prediction accuracy, the overall relative error of the phase production rates at most producers ranges from 10% to 30%. It is shown that the dominant connections identified by the data-driven method and streamline method are in close agreement. This significantly improves confidence in our data-driven procedure. The novelty of this work is that it is purely data-driven method and can directly interpret routine surface measurements to intuitive subsurface knowledge. Furthermore, the streamline-based validation procedure provides physics-based backing to the results obtained from data analytics. This study results in a reliable and efficient data analytics framework that is well-suited for large field applications.

42 ENGINEERING↗

Harnessing on-machine metrology data for prints with a surrogate model for laser powder directed energy deposition

In this study, we leverage the massive amount of multi-modal on-machine metrology data generated from Laser Powder Directed Energy Deposition (LP-DED) to construct a comprehensive surrogate model of the 3D printing process. By employing Dynamic Mode Decomposition with Control (DMDc), a data-driven technique, we capture the complex physics inherent in this extensive dataset. This physics-based surrogate model emphasizes thermodynamically significant quantities, enabling us to accurately predict key process outcomes. The model ingests 21 process parameters, including laser power, scan rate, and position, while providing outputs such as melt pool temperature, melt pool size, and other essential observables. Furthermore, it incorporates uncertainty quantification to provide bounds on these predictions, enhancing reliability and confidence in the results. We then deploy the surrogate model on a new, unseen part and monitor the printing process as validation of the method. Our experimental results demonstrate that the predictions align with actual measurements with high accuracy, confirming the effectiveness of our approach. Furthermore, this methodology not only facilitates real-time predictions but also operates at process-relevant speeds, establishing a basis for implementing feedback control in LP-DED.

Digital twins↗

Tools for probing new physics with newly discovered gamma-ray targets

Here, we present a computational tool, TweedleDEE, for empirically modeling diffuse gamma-ray background emission in a 1° region of the sky, using publicly available gamma-ray data off-axis from the region of interest. This background model allows a user to perform a purely data-driven search for anomalous localized sources of gamma-ray emission, including new physics. A major application of this tool would be in searching for dark matter annihilation in newly discovered astrophysical targets. For this purpose, we derive a scaling relation for determining velocity-dependent 𝐽-factors using only the stellar parameters, which can be broadly applied to obtain dark matter constraints from new targets. As an application of these tools, we use TweedleDEE and MADHATv2 to perform the first search for dark matter annihilation in the newly discovered Leo VI dwarf spheroidal galaxy, and present model constraints for a variety of choices of the annihilation channel and velocity dependence of the cross section.

dark matter↗

Early Earth and Rocky Extrasolar Planet Characterization

Scientists are currently designing instruments, telescopes, and spacecraft to search for evidence of life beyond Earth. This search for life beyond Earth comes with an expectation to detect life that is different than the life found on modern-day Earth. But scientists will also be expected to provide compelling proof behind any claims that we are not alone. These two expectations are seemingly at odds with each other, because it will be easiest to provide compelling evidence for life when we have a deep understanding of the life we are looking at.The study of Earth history provides a means to reconcile this tension. Different periods of Earth history present us with biospheres that are dramatically different from modern-day Earth, but for which we have abundant data. This informs our understanding of habitability, because of the variety of global chemical and climatic conditions in Earth history for which we know life has thrived. The study of Earth history also informs our understanding of how to detect life; as the global influences of life have completely changed, so have the detectable features of Earth's biosphere.The appreciation of our home planet as a tightly coupled system also provides us top-level lessons for how to search for an even broader set of biospheres with a wider variety of detectable features. The study of Earth history has taught us that life is a both a function of and critical forcing on the planetary environment. Numerical models of these interactions can by driven by our understanding of Earth history, and be validated against the geological and geochemical data. These models can then be applied to a wider variety of planetary conditions. This will help scientists determine what kinds of life are possible, and eventually help them recognize and confirm the presence of life on rocky planets around other stars.

Domagal-Goldman, Shawn D.↗

Dynamic Model Agnostic Reliability Evaluation of Machine-Learning Models Integrated in Instrumentation & Control Systems

In recent years, the field of data-driven neural network-based machine learning (ML) algorithms has grown significantly and spurred research in its applicability to instrumentation and control systems. While they are promising in operational contexts, the trustworthiness of such algorithms is not adequately assessed. Failures of ML-integrated systems are poorly understood; the lack of comprehensive risk modeling can degrade the trustworthiness of these systems. In recent reports by the National Institute for Standards and Technology, trustworthiness in ML is a critical barrier to adoption and will play a vital role in intelligent systems' safe and accountable operation. Thus, in this work, we demonstrate a real-time model-agnostic method to evaluate the relative reliability of ML predictions by incorporating out-of-distribution detection on the training dataset. It is well documented that ML algorithms excel at interpolation (or near-interpolation) tasks but significantly degrade at extrapolation. This occurs when new samples are "far" from training samples. The method, referred to as the Laplacian distributed decay for reliability (LADDR), determines the difference between the operational and training datasets, which is used to calculate a prediction's relative reliability. LADDR is demonstrated on a feedforward neural network-based model used to predict safety significant factors during different loss-of-flow transients. LADDR is intended as a "data supervisor" and determines the appropriateness of well-trained ML models in the context of operational conditions. Ultimately, LADDR illustrates how training data can be used as evidence to support the trustworthiness of ML predictions when utilized for conventional interpolation tasks.

97 MATHEMATICS AND COMPUTING↗

An adaptive, data-driven multiscale approach for dense granular flows

The accuracy of coarse-grained continuum models of dense granular flows is limited by the lack of high-fidelity closure models for granular rheology. One approach to addressing this issue, referred to as the hierarchical multiscale method, is to use a high-fidelity fine-grained model to compute the closure terms needed by the coarse-grained model. The difficulty with this approach is that the overall model can become computationally intractable due to the high computational cost of the high-fidelity model. In this work, we describe a multiscale modeling approach for dense granular flows that utilizes neural networks trained using high-fidelity discrete element method (DEM) simulations to approximate the constitutive granular rheology for a continuum incompressible flow model. Our approach leverages an ensemble of neural networks to estimate predictive uncertainty that allows us to determine whether the rheology at a given point is accurately represented by the neural network model. Additional DEM simulations are only performed when needed, minimizing the number of additional DEM simulations required when updating the rheology. This adaptive coupling significantly reduces the overall computational cost of the approach while controlling the error. In addition, the neural networks are customized to learn regularized rheological behavior to ensure well-posedness of the continuum solution. We first validate the approach using two-dimensional steady-state and decelerating inclined flows. We then demonstrate the efficiency of our approach by modeling three-dimensional sub-aerial granular column collapse for varying initial column aspect ratios, where our multiscale method compares well with the computationally expensive computational fluid dynamics (CFD)-DEM simulation.

Dense granular flows↗

Projection pursuit adaptation on polynomial chaos expansions

Here, the present work addresses the issue of accurate stochastic approximations in high-dimensional parametric space using tools from uncertainty quantification (UQ). The basis adaptation method and its accelerated algorithm in polynomial chaos expansions (PCE) were recently proposed to construct low-dimensional approximations adapted to specific quantities of interest (QoI). The present paper addresses one difficulty with these adaptations, namely their reliance on quadrature point sampling, which limits the reusability of potentially expensive samples. Projection pursuit (PP) is a statistical tool to find the “interesting” projections in high-dimensional data and thus bypass the curse-of-dimensionality. In the present work, we combine the fundamental ideas of basis adaptation and projection pursuit regression (PPR) to propose a novel method to simultaneously learn the optimal low-dimensional spaces and PCE representation from given data. While this projection pursuit adaptation (PPA) can be entirely data-driven, the constructed approximation exhibits mean-square convergence to the solution of an underlying governing equation and thus captures the supports and probability distributions associated with the physics constraints. The proposed approach is demonstrated on a borehole problem and a structural dynamics problem, demonstrating the versatility of the method and its ability to discover low-dimensional manifolds with high accuracy with limited data. In addition, the method can learn surrogate models for different quantities of interest while reusing the same data set.

97 MATHEMATICS AND COMPUTING↗

Modeling of the metal–insulator transition temperature in alio-valently doped VO 2 through symbolic regression

The correlated semiconductor vanadium dioxide (VO 2 ) exhibits an insulator–metal transition (IMT) near room temperature, which is of interest in various device applications. Precise IMT temperature control is crucial to determine the use cases across technologies such as thermochromic windows, actuators for robots or neuronal oscillators. Doping the cation or anion sites can modulate the IMT by several tens of degrees and control hysteresis. However, modeling the effects of control parameters (e.g., doping concentration, type of dopants) is challenging due to complex experimental procedures and limited data, hindering the use of traditional data-driven machine learning approaches. Symbolic regression (SR) can bridge this gap by identifying nonlinear expressions connecting key input parameters to target properties, even with small data sets. In this work, we develop SR models to capture the IMT trends in VO 2 influenced by different dopant parameters. Using experimental data from the literature, our study reveals a dual nature of the IMT temperature with varying tungsten (W) doping concentrations. The symbolic model captures data trends and accounts for experimental variability, providing a complementary approach to first-principles calculations. Our feature-driven analysis across a broader class of dopants informs selectivity and provides qualitative insights into tuning phase transition properties valuable for neuromorphic computing and thermochromic windows.

36 MATERIALS SCIENCE↗

Machine learning models inaccurately predict current and future high-latitude C balances

The high-latitude carbon (C) cycle is a key feedback to the global climate system, yet because of system complexity and data limitations, there is currently disagreement over whether the region is a source or sink of C. Recent advances in big data analytics and computing power have popularized the use of machine learning (ML) algorithms to upscale site measurements of ecosystem processes, and in some cases forecast the response of these processes to climate change. Due to data limitations, however, ML model predictions of these processes are almost never validated with independent datasets. To better understand and characterize the limitations of these methods, we develop an approach to independently evaluate ML upscaling and forecasting. We mimic data-driven upscaling and forecasting efforts by applying ML algorithms to different subsets of regional process-model simulation gridcells, and then test ML performance using the remaining gridcells. In this study, we simulate C fluxes and environmental data across Alaska using ecosys, a process-rich terrestrial ecosystem model, and then apply boosted regression tree ML algorithms to training data configurations that mirror and expand upon existing AmeriFLUX eddy-covariance data availability. We first show that a ML model trained using ecosys outputs from currently-available Alaska AmeriFLUX sites incorrectly predicts that Alaska is presently a modeled net C source. Increased spatial coverage of the training dataset improves ML predictions, halving the bias when 240 modeled sites are used instead of 15. However, even this more accurate ML model incorrectly predicts Alaska C fluxes under 21st century climate change because of changes in atmospheric CO 2 , litter inputs, and vegetation composition that have impacts on C fluxes which cannot be inferred from the training data. Our results provide key insights to future C flux upscaling efforts and expose the potential for inaccurate ML upscaling and forecasting of high-latitude C cycle dynamics.

54 ENVIRONMENTAL SCIENCES↗

Statistical Treatment of Convolutional Neural Network Superresolution of Inland Surface Wind for Subgrid-Scale Variability Quantification

Abstract Machine learning models have been employed to perform either physics-free data-driven or hybrid dynamical downscaling of climate data. Most of these implementations operate over relatively small downscaling factors because of the challenge of recovering fine-scale information from coarse data. This limits their compatibility with many global climate model outputs, often available between ∼50- and 100-km resolution, to scales of interest such as cloud resolving or urban scales. This study systematically examines the capability of a type of superresolving convolutional neural network (SR-CNNs) to downscale surface wind speed data over land from different coarse resolutions (25-, 48-, and 100-km resolution) to 3 km. For each downscaling factor, we consider three convolutional neural network (CNN) configurations that generate superresolved predictions of fine-scale wind speed, which take between one and three input fields: coarse wind speed, fine-scale topography, and diurnal cycle. In addition to fine-scale wind speeds, probability density function parameters are generated through which sample wind speeds can be generated, accounting for the intrinsic stochasticity of wind speed. For assessing generalization to new data, CNN models are tested on regions with different topography and climate that are unseen during training. The evaluation of superresolved predictions focuses on subgrid-scale variability and the recovery of extremes. Models with coarse wind and fine topography as inputs exhibit the best performance when compared with other model configurations, operating across the same downscaling factor. Our diurnal cycle encoding results in lower out-of-sample generalizability when compared with other input configurations.

17 WIND ENERGY↗

Sensitivity of Global Modeling Initiative Model Predictions of Antarctic Ozone Recovery to Input Meteorological Fields

We use the Global Modeling Initiative chemistry and transport model to simulate the evolution of stratospheric ozone between 1995 and 2030, using boundary conditions consistent with the recent World Meteorological Organization ozone assessment. We compare the Antarctic ozone recovery predictions of two simulations, one driven by an annually repeated year of meteorological data from a general circulation model (GCM), the other using a year of output from a data assimilation system (DAS), to examine the sensitivity of Antarctic ozone recovery predictions to the characteristic dynamical differences between GCM- and DAS-generated meteorological data. Although the age of air in the Antarctic lower stratosphere differs by a factor of 2 between the simulations, we find little sensitivity of the 1995-2030 Antarctic ozone recovery between 350 and 650 K to the differing meteorological fields, particularly when the recovery is specified in mixing ratio units. Percent changes are smaller in the DAS-driven simulation compared to the GCM-driven simulation because of a surplus of Antarctic ozone in the DAS-driven simulation which is not consistent with observations. The peak ozone change between 1995 and 2030 in both simulations is approx.20% lower than photochemical expectations, indicating that changes in ozone transport due to changing ozone gradients at 450 K between 1995 and 2030 constitute a small negative feedback. Total winter/spring ozone loss during the base year (1995) of both simulations and the rate of ozone loss during August and September is somewhat weaker than observed. This appears to be due to underestimates of Antarctic Cl(sub y) at the 450 K potential temperature level.

Considine, David B.↗

Search for phenomena beyond the Standard Model in events with large $b$-jet multiplicity using the ATLAS detector at the LHC

A search is presented for new phenomena in events characterised by high jet multiplicity, no leptons (electrons or muons), and four or more jets originating from the fragmentation of b -quarks ( b -jets). The search uses 139 fb -1 of $\sqrt{s}$ = 13 TeV proton–proton collision data collected by the ATLAS experiment at the Large Hadron Collider during Run 2. The dominant Standard Model background originates from multijet production and is estimated using a data-driven technique based on an extrapolation from events with low b -jet multiplicity to the high b -jet multiplicities used in the search. No significant excess over the Standard Model expectation is observed and 95% confidence-level limits that constrain simplified models of R-parity-violating supersymmetry are determined. The exclusion limits reach 950 GeV in top-squark mass in the models considered.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Computation and turbulence modeling for three-dimensional boundary layers including turbomachinery rotor flows

A method is developed for predicting the behavior of three-dimensional, turbulent boundary layers occurring in internal flows, including those on turbomachinery rotor blades. These boundary layers are complex, turbulent, and subject to Coriolis and centrifugal forces. The major thrust of this paper is the development and use of an algebraic Reynolds stress model (ARSM) that captures the changes in turbulent flow structure arising from curvature, rotation, and three dimensionality. The prediction of pressure-driven secondary flow agrees well with the measured data, and all three turbulence models (k-epsilon, algebraic eddy viscosity, and ARSM) show the same level of agreement. The prediction of boundary-layer development on rotor blades shows much better agreement with measurements with the ARSM. It is essential to employ higher-order turbulence models to capture the effects of rotation, curvature, and three dimensionality on boundary layers in turbomachinery.

Zhang, J.↗