Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data driven modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Distribution Grid Model Publication Investigation

Interest in the external exchange of distribution grid model data is growing around the world, driven largely by the challenges and opportunities presented by the increasing amount of generation, storage, and flexible load being embedded within the distribution grid. This report provides an overview of the current state of distribution grid model data sharing, with a focus on the industry-leading activities currently underway in Great Britain (GB). A second report will explore opportunities for external distribution grid model sharing in the United States.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Data Imbalance, Uncertainty Quantification, and Transfer Learning in Data‐Driven Parameterizations: Lessons From the Emulation of Gravity Wave Momentum Transport in WACCM

Abstract Neural networks (NNs) are increasingly used for data‐driven subgrid‐scale parameterizations in weather and climate models. While NNs are powerful tools for learning complex non‐linear relationships from data, there are several challenges in using them for parameterizations. Three of these challenges are (a) data imbalance related to learning rare, often large‐amplitude, samples; (b) uncertainty quantification (UQ) of the predictions to provide an accuracy indicator; and (c) generalization to other climates, for example, those with different radiative forcings. Here, we examine the performance of methods for addressing these challenges using NN‐based emulators of the Whole Atmosphere Community Climate Model (WACCM) physics‐based gravity wave (GW) parameterizations as a test case. WACCM has complex, state‐of‐the‐art parameterizations for orography‐, convection‐, and front‐driven GWs. Convection‐ and orography‐driven GWs have significant data imbalance due to the absence of convection or orography in most grid points. We address data imbalance using resampling and/or weighted loss functions, enabling the successful emulation of parameterizations for all three sources. We demonstrate that three UQ methods (Bayesian NNs, variational auto‐encoders, and dropouts) provide ensemble spreads that correspond to accuracy during testing, offering criteria for identifying when an NN gives inaccurate predictions. Finally, we show that the accuracy of these NNs decreases for a warmer climate (4 × CO 2 ). However, their performance is significantly improved by applying transfer learning, for example, re‐training only one layer using ∼1% new data from the warmer climate. The findings of this study offer insights for developing reliable and generalizable data‐driven parameterizations for various processes, including (but not limited to) GWs.

54 ENVIRONMENTAL SCIENCES↗

Explainable AI for a No-Teardown Vehicle Component Cost Estimation: A Top-Down Approach

The broader ambition of this article is to popularize an approach for the fair distribution of the quantity of a system's output to its subsystems while allowing for underlying complex subsystem level interactions. Particularly, we present the use of this framework on a very specific (but generalizable) application, interesting for a more general AI audience. Here, we detail a data-driven approach to vehicle price modeling and its component price estimation by leveraging a combination of concepts from machine learning and game theory. We show an alternative to common teardown methodologies and surveying approaches for component and vehicle price estimation at the manufacturer's suggested retail price (MSRP) level that has the advantage of bypassing uncertainties involved in gathering teardown data, the need to perform expensive and biased surveying, and the need to perform retail price equivalent or indirect cost multiplier adjustments to mark up direct manufacturing costs to MSRP. This novel exercise not only provides accurate pricing of the technologies at the customer level, but also shows the, a priori known, large gaps in pricing strategies between manufacturers, vehicle classes, market segments, etc. There is also clear interaction between the price of technologies and other specifications present in vehicles. Those results are indication that old methods of manufacturer-level component costing, aggregation, and application of flat and rigid adjustment factors should be carefully examined. The findings are based on a database developed by Argonne, which includes over 64,000 vehicles covering MY1990 to MY2020 with hundreds of vehicle specs.

97 MATHEMATICS AND COMPUTING↗

Integrated edge-to-exascale workflow for real-time steering in neutron scattering experiments

We introduce a computational framework that integrates artificial intelligence (AI), machine learning, and high-performance computing to enable real-time steering of neutron scattering experiments using an edge-to-exascale workflow. Focusing on time-of-flight neutron event data at the Spallation Neutron Source, our approach combines temporal processing of four-dimensional neutron event data with predictive modeling for multidimensional crystallography. At the core of this workflow is the Temporal Fusion Transformer model, which provides voxel-level precision in predicting 3D neutron scattering patterns. The system incorporates edge computing for rapid data preprocessing and exascale computing via the Frontier supercomputer for large-scale AI model training, enabling adaptive, data-driven decisions during experiments. This framework optimizes neutron beam time, improves experimental accuracy, and lays the foundation for automation in neutron scattering. Although real-time experiment steering is still in the proof-of-concept stage, the demonstrated potential of this system offers a substantial reduction in data processing time from hours to minutes via distributed training, and significant improvements in model accuracy, setting the stage for widespread adoption across neutron scattering facilities and more efficient exploration of complex material systems.

97 MATHEMATICS AND COMPUTING↗

Livewire: A Model Platform for Data Quality Assessment and AI Readiness Across DOE Missions

High-quality, well-governed data is essential for accelerating discovery and achieving operational excellence across DOE and national laboratory missions. The Livewire Data Platform is a DOE-supported platform that offers automated assessments of data quality, standardization, provenance, and Artificial Intelligence (AI) readiness. It allows researchers and data practitioners to systematically and easily evaluate datasets against established governance criteria and prepare them for advanced analytics. Livewire addresses critical challenges in DOE's data ecosystem with integrated capabilities for metadata validation, provenance tracking, and schema alignment. This platform's automated workflows assist users in identifying data quality gaps, enhancing interoperability between datasets collected from various stakeholders, and ensuring compliance with DOE data standards, all while reducing manual curation efforts. Additionally, we will discuss its AI readiness framework, which is being developed to prepare datasets for training models, developing advanced analytic tools, and machine learning applications. Using some of the more than one hundred tabular datasets on Livewire, processed with this open-source methodology, we will demonstrate how Livewire can serve as a model for scalable, standards-driven data management. This approach provides a pathway to leverage existing and future datasets within the DOE, boosting innovation and efficiency across national laboratories.

33 - ADVANCED PROPULSION SYSTEMS↗

Search for resonant production of dark quarks in the dijet final state with the ATLAS detector

This paper presents a search for a new Z' resonance decaying into a pair of dark quarks which hadronise into dark hadrons before promptly decaying back as Standard Model particles. This analysis is based on proton-proton collision data recorded at $\sqrt{s}$ = 13 TeV with the ATLAS detector at the Large Hadron Collider between 2015 and 2018, corresponding to an integrated luminosity of 139 fb –1 . After selecting events containing large-radius jets with high track multiplicity, the invariant mass distribution of the two highest-transverse-momentum jets is scanned to look for an excess above a data-driven estimate of the Standard Model multijet background. No significant excess of events is observed and the results are thus used to set 95% confidence-level upper limits on the production cross-section times branching ratio of the Z' to dark quarks as a function of the Z' mass for various dark-quark scenarios.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Regularization by denoising diffusion models for solving inverse PDE problems with application to full waveform inversion

Partial differential equation (PDE)-governed inverse problems are fundamental across various scientific and engineering applications; yet they face significant challenges due to nonlinearity, ill-posedness, and sensitivity to noise. Here, we introduce a computational framework, regularization by denoising using diffusion models for partial differential equations (RED-DiffEq), by integrating physics-driven inversion and data-driven learning. RED-DiffEq leverages pretrained diffusion models as a regularization mechanism for PDE-governed inverse problems. We apply RED-DiffEq to solve the full waveform inversion problem in geophysics, a challenging seismic imaging technique that seeks to reconstruct high-resolution subsurface velocity models from seismic measurement data. Our method shows enhanced accuracy and robustness compared to benchmark methods. Additionally, it exhibits strong generalization and domain decomposition capacity, enabling the inversion of more complex velocity models with larger domains than those used in training the diffusion model. Our framework can also be directly applied to diverse PDE-governed inverse problems.

Shan, Siming [Yale University, New Haven, CT (Unit↗

Flipped SU(5) GUT phenomenology: proton decay and $\mathbf {g_\mu - 2}$

We consider proton decay and $\mathbf {g_\mu - 2}$ in flipped SU(5) GUT models. We first study scenarios in which the soft supersymmetry-breaking parameters are constrained to be universal at some high scale M in above the standard GUT scale where the QCD and electroweak SU(2) couplings unify. In this case the proton lifetime is typically > rsim10 36 years, too long to be detected in the foreseeable future, and the supersymmetric contribution to $\mathbf {g_\mu - 2}$ is too small to contribute significantly to resolving the discrepancy between the experimental measurement and data-driven calculations within the Standard Model. However, we identify a region of the constrained flipped SU(5) parameter space with large couplings between the 10- and 5-dimensional GUT Higgs representations where p → e + π 0 decay may be detectable in the Hyper-Kamiokande experiment now under construction, though the contribution to $\mathbf {g_\mu - 2}$ is still small. A substantial contribution to $\mathbf {g_\mu - 2}$ is possible, however, if the universality constraints on the soft supersymmetry-breaking masses are relaxed. We find a ‘quadrifecta’ region where observable proton decay co-exists with a (partial) supersymmetric resolution of the $\mathbf {g_\mu - 2}$ discrepancy and acceptable values of m h and the relic LSP density.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

W2VPCA: A Machine Learning Method for Measuring Attitudes With Natural Language

Company strategy influences many decisions in freight transportation. Behavioral models of company decision-making therefore could benefit from including strategy variables. However, strategy is difficult to observe and quantify. Attitudinal surveys of company executives can be used to collect measurements of latent strategy to use in quantitative models. However, surveys are costly and burdensome. Text mining methods to collect measurements overcome these issues somewhat, but typically require manual intervention and ignore the context of words, which can be problematic. This study introduces a new machine learning method to generate strategy measurement data from existing big text data. The new method, called W2VPCA, combines Natural Language Processing and Principal Components Analysis. W2VPCA produces measurement data that serve as quantitative indicators of latent strategy in behavioral models. W2VPCA is unsupervised, data-driven, and uses information on word context. We apply W2VPCA to generate measurements of latent strategies using readily available, large-scale text data: annual company reports. The empirical measurements are used successfully to associate two latent strategies, one focusing on distribution and the other on products, with truck fleet and distribution center outsourcing decisions. The main empirical outcome is that the W2VPCA measurements outperform Bag-of-Words measurements in a psychometric analysis of latent firm strategies. While this study focuses on freight behavioral models, W2VPCA may also have applications in behavioral modeling in other domains.

97 MATHEMATICS AND COMPUTING↗

Data-driven estimation of energy consumption for electric bus under real-world driving conditions

Reliable and accurate estimation of an electric bus’s instantaneous energy consumption is critical in evaluating energy impacts of planning and control of electric bus operations. In this study, we developed machine learning-based long short-term memory (LSTM) and artificial neural network (ANN) models to estimate 1 Hz energy consumption of electric buses based on continuous monitoring data of electric buses in Chattanooga, Tennessee, in 2019 and 2020. We propose a data-partitioning algorithm to separate energy charging and discharging modes before applying data-driven estimation models. Here, a K-fold cross-validation-based model selection process was conducted to identify the optimal model structure and input variables in terms of prediction accuracy. The estimation results show the predicted mean absolute percentage error rates of LSTM and ANN models were 3% and 5%, respectively. We compared the proposed models with existing models in the literature based on the same testing data to demonstrate the predictability of our models.

Artificial neural network↗

Seismic Tomographic Modeling of the Crust and Upper Mantle beneath Israel and the Middle East: Improved Resolution through Optimized Model Parameterization

Accurate regional seismic travel-time (RSTT) predictions rely on regional phases (e.g., Pg, Lg, Pn, Sn ) to account for 3D effects in the crust and upper mantle that are not captured by 1D models traditionally used for real-time location. The RSTT prediction model accounts for regional-scale crust and upper mantle structure globally by incorporating regional seismic phases into its travel-time calculations. Previous versions of the RSTT model have used a constant grid cell size of 1°. To improve the tomographic accuracy of recovering velocity structure at regional scales, we, in this study, perform data-driven grid refinement on the RSTT model down to a 0.125° grid (~14 km) in pursuit of two main goals: (1) to test the limits of RSTT capability and accuracy of determined velocity structure through variable grid refinement and (2) to image smaller structures in Israel and the Middle East and illuminate upper mantle dynamics operating in this complex tectonic area. We investigate the effects of model parameterization as grid cell size decreases and the trade-offs between recovered velocity structures. Our final dataset includes 4751 events and 499 stations that recorded 79,344 Pn and 7489 Pg . The variable grid refinement method allows recovery of finer-scale velocity structures and reduces travel-time residuals in areas with the highest data coverage. At smaller grid cell sizes, longer paths need to be upweighted to stabilize the inversion. Results illuminate tectonic features undefined in coarser grid-size models; in particular, we observe mantle perturbations related to the subduction zone around the Cyprian arc and crustal anomalies near the Dead Sea fault and throughout the Anatolian plate.

58 GEOSCIENCES↗

Process prediction and detection of faults using probabilistic bidirectional recurrent neural networks on real plant data

Attaining Industry 4.0 for manufacturing operations requires advanced monitoring systems and real-time data analytics of plant data, among other topics. We propose a Probabilistic Bidirectional Recurrent Network (PBRN) for industrial process monitoring for the early detection of faults. The model is based on a Gated Recurrent Unit (GRU) neural network that allows the model to retain long-term dependencies between sensor data along a time horizon, hence learning the dynamic behavior of the process. To reduce the false-positive detection rate of the model, we compel the model to learn from a highly noisy sensor reading while outputting noise-free sensor outputs. The performance of the proposed model is compared to other data-driven statistical process monitoring schemes using real plant data from an industrial Air Separations Unit (ASU) containing noisy sensor readings. We show that the model can learn from noisy data without reducing its performance. Using two different fault cases, we demonstrate the model’s ability to carry out early fault detection with average false-positive rates of 2.9% and 4.9% for both fault cases. The missed detection rates are 0.1% and 0.2%, respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Machine learning assisted modeling of mixing timescale for LES/PDF of high-Karlovitz turbulent premixed combustion

Accurate modeling of mixing in the transported probability density function (PDF) method remains a great challenge, especially for turbulent premixed combustion under extreme conditions such as high Karlovitz number Ka. Recently, a power-law based mixing timescale model was developed for the large-eddy simulations (LES)/PDF modeling of high-Ka number turbulent premixed flames. It is found in this work that the power-law mixing timescale model is highly sensitive to the model parameters. It is thus critically needed to develop accurate calibration of these model parameters. The empirical specification of the model parameters developed in Zhang et. al. is found to be inadequate for accurate modeling of the mixing timescale. Here, machine learning is introduced as an attractive alternative in this work for the specification of the model parameters. A high-Ka number DNS jet flame is used as the training and validation of the machine learning models. The choices of the input parameters are discussed and compared for the machine learning models. The effect of differential molecular diffusion on mixing is examined by including the effect of the Lewis number in the training of the machine learning models. The performance of different machine learning algorithms is compared for the specification of the mixing model parameters. Overall, excellent performance of the machine learning models is observed for assisting the mixing modeling. The feasibility, interpretability, applicability, generality, and portability of using machine learning are discussed in general to provide a perspective on applying data-driven machine learning for turbulent combustion modeling studies.

42 ENGINEERING↗

Hierarchical Model Reduction Driven by Machine Learning for Parametric Advection-Diffusion-Reaction Problems in the Presence of Noisy Data

Abstract We propose a new approach to generate a reliable reduced model for a parametric elliptic problem, in the presence of noisy data. The reference model reduction procedure is the directional HiPOD method, which combines Hierarchical Model reduction with a standard Proper Orthogonal Decomposition, according to an offline/online paradigm. In this paper we show that directional HiPOD looses in terms of accuracy when problem data are affected by noise. This is due to the interpolation driving the online phase, since it replicates, by definition, the noise trend. To overcome this limit, we replace interpolation with Machine Learning fitting models which better discriminate relevant physical features in the data from irrelevant unstructured noise. The numerical assessment, although preliminary, confirms the potentialities of the new approach.

97 MATHEMATICS AND COMPUTING↗

Data-driven insights into the fluorescence of asphaltene aggregates using extended Frenkel exciton model

The origin of the fluorescence redshift during asphaltene aggregation remains debated due to the great diversity of asphaltene molecules, while the extended Frenkel exciton model provided a theoretical framework for studying multi-chromophore systems, such as asphaltene aggregates. We investigated the fluorescence energy of hundreds of asphaltene dimers based on 133 experimental revealed asphaltene monomer structures. Our result shows that the dimer's fluorescence energy is always lower than both of its monomers regardless of its intermolecular conformation, with its redshift dominated by superexchange. The dimer oscillator strength predominantly depends on the monomer with the lower fluorescence energy, and the involvement of charge-transfer states and the cancellation between monomer transition dipole moments suppressed the fluorescence especially when two monomers have similar fluorescence energy. The above-mentioned findings hold for all asphaltene dimers despite their diversity, which offers a theoretical interpretation for comprehending the relationship between asphaltene aggregation and its fluorescence variation. Furthermore, this work provides theoretical guidance to other research areas related to organic planar conjugated systems with multiple chromophores.

Chemistry↗

High-Performance Semiempirical Excited-State Molecular Dynamics Powered by Graphics Processing Units

Here, this Letter introduces excited-state molecular dynamics in PYSEQM, a GPU-accelerated semiempirical quantum chemistry engine implemented in PyTorch. The new module enables Born–Oppenheimer molecular dynamics (BOMD) using configuration-interaction singles and random phase approximation for excited states, allowing long trajectories and large statistical ensembles to be simulated efficiently on a single GPU. We also implement an extended Lagrangian excited-state BOMD (XL-ESMD) scheme that propagates auxiliary electronic variables, enabling relaxed ground and excited-state convergence thresholds without compromising energy conservation. The excited-state BOMD implementation scales smoothly from small chromophores to a nearly 900-atom dendrimer (taking 6.5 s per MD step). PYSEQM also supports batched execution, allowing many geometries or trajectories to be evaluated in a single GPU launch, substantially increasing throughput and making ensemble-based protocols routine. As a demonstration, we compute absorption, emission, and infrared spectra from trajectories propagated on the ground and first excited states. The XL-ESMD scheme yields identical spectra at significantly lower computational cost, establishing the role of extended Lagrangian based dynamics for efficient excited-state BOMD simulations. Beyond raw performance, PYSEQM’s PyTorch foundation provides automatic differentiation for forces, efficient GPU batching, and seamless interfacing with machine learning models. These capabilities position PYSEQM as a practical platform for machine learning-augmented excited-state dynamics and lay the foundation for future data-driven nonadiabatic excited-state dynamics modeling of ultrafast spectroscopic probes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Creating a Tools Ecosystem for Cross-Discipline Environmental Data Reuse

Reusing data is difficult even within well-defined science communities and only gets worse when combining data from multiple communities and disciplines. Through the lens of current work on constructing an environmental epidemiological data set from multiple disciplinary sources, we demonstrate the need for a new tool ecosystem to support heterogeneous Big Data science. Extending existing community standards for schemas and/or data formats through human auditing and wrangling of the data is not feasible at scale. This work therefore suggests new approaches for the multi-disciplinary communities to build a shared tool ecosystem for big data. We discuss both the larger context of data wrangling of epidemiological data sets for novel artificial intelligence algorithms and the specific lessons from working with these multi-disciplinary data sets. Adopting a more model-driven, automatable approach promises not only better efficiency but also removes key sources of human-generated errors and promotes reuse and reproducibility of science data.

Logan, Jeremy↗

Computational insights into the interaction of water with the UiO-66 metal–organic framework and its functionalized derivatives

The UiO-66 metal–organic framework (MOF) has been identified as a promising hydrophilic material for water harvesting. Recent studies show that its water uptake ability at low relative humidity (RH) can be improved by incorporating hydrophilic functional groups into the framework. In this work, we provide computational insights into the adsorption of water in UiO-66 and its functionalized derivatives to reveal the role played by different adsorption sites and functional groups in the adsorption mechanism. We started by developing molecular models for UiO-66, UiO-66-NH 2 , UiO-66-OH, and UiO-66-(OH) 2 compatible with the MB-pol data-driven many-body potential of water. We then benchmarked these models against ab initio data. Here we used these models to perform molecular dynamics simulations and calculate radial distribution functions, IR spectra, and two-dimensional density distribution maps for water in the MOFs. These results consistently show that the μ 3 -OH sites are the preferential interaction sites for water in UiO-66 and all its variants, and the formation of localised water clusters inside the octahedral pores is responsible for the abrupt step in the experimental adsorption isotherms. Furthermore, the presence of functional groups in the framework allows water to cluster in the octahedral pores at lower RH, thus making the MOF a more efficient water harvester. Overall, this study provides molecular-level insights into the pore filling process of UiO-66 and its functionalized derivatives, which are needed for the design of efficient water harvesting materials based on MOFs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗