Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “complex modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Dakota Uncertainty Quantification Methods Applied to the CFD code Nek5000

Predictive modeling and simulation of the performance of a nuclear reactor and its fuel is a challenging task because of the large number of coupled physical phenomena that must be addressed. In addition to this intrinsic complexity, model uncertainty must be accounted for in any analysis if the model will be used to facilitate design or operational decisions which may impact safety and performance. Rigorous, structured uncertainty analyses are performed by first characterizing the model's input uncertainties and, by propagating the uncertainty through the model in order to estimate the output's uncertainty. This paper presents the state of advancement of the Nuclear Energy Advanced Modeling and Simulation (NEAMS) project to characterize the uncertainty of the CFD code Nek5000 using the Dakota package. Nek5000 is a high order spectral element computational fluid dynamics (CFD) code developed at Argonne National Laboratory for high resolution spectral-filtered large eddy simulations (LESs) and unsteady Reynolds averaged Navier-Stokes (RANS) simulations. The Dakota package developed at Sandia National Laboratory can be integrated with many scientific and engineering codes to facilitate efficient, effective uncertainty quantification (UQ) and sensitivity analyses. Dakota is designed to interface with external packages/codes such as Nek5000 through a script-driven interface called fork. Such interface provides maximum flexibility to the users for pre- and post-processing tasks preceding and following each function evaluation. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Codeposition Route to CuI-Pyridine Coordination Complexes for Organic Light-Emitting Diodes

We demonstrate a new approach for utilizing CuI coordination complexes as emissive layers in organic light-emitting diodes that involves in situ codeposition of CuI and 3,5-bis(carbazol-9-yl)pyridine (mCPy). With a simple three-layer device structure, pure green electroluminescence at 530 nm from a Cu(I) complex was observed. A maximum luminance and external quantum efficiency (EQE) of 9700 cd/m2 and 4.4%, respectively, were achieved. The luminescent species was identified as [CuI(mCPy)2]2 on the basis of photophysical studies of model complexes and X-ray absorption spectroscopy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Madden–Julian Oscillation prediction skill of a new-generation global model demonstrated using a supercomputer

Global cloud/cloud system-resolving models are perceived to perform well in the prediction of the Madden–Julian Oscillation (MJO), a huge eastward -propagating atmospheric pulse that dominates intraseasonal variation of the tropics and affects the entire globe. However, owing to model complexity, detailed analysis is limited by computational power. Here we carry out a simulation series using a recently developed supercomputer, which enables the statistical evaluation of the MJO prediction skill of a costly new-generation model in a manner similar to operational forecast models. We estimate the current MJO predictability of the model as 27 days by conducting simulations including all winter MJO cases identified during 2003–2012. The simulated precipitation patterns associated with different MJO phases compare well with observations. An MJO case captured in a recent intensive observation is also well reproduced. Our results reveal that the global cloud-resolving approach is effective in understanding the MJO and in providing month-long tropical forecasts.

54 ENVIRONMENTAL SCIENCES↗

Testing emission models on the extreme blazar 2WHSP J073326.7+515354 detected at very high energies with the MAGIC telescopes

ABSTRACT Extreme high-energy-peaked BL Lac objects (EHBLs) are an emerging class of blazars. Their typical two-hump-structured spectral energy distribution (SED) peaks at higher energies with respect to conventional blazars. Multiwavelength (MWL) observations constrain their synchrotron peak in the medium to hard X-ray band. Their gamma-ray SED peaks above the GeV band, and in some objects it extends up to several TeV. Up to now, only a few EHBLs have been detected in the TeV gamma-ray range. In this paper, we report the detection of the EHBL 2WHSP J073326.7+515354, observed and detected during 2018 in TeV gamma rays with the MAGIC telescopes. The broad-band SED is studied within an MWL context, including an analysis of the Fermi-LAT data over 10 yr of observation and with simultaneous Swift-XRT, Swift-UVOT, and KVA data. Our analysis results in a set of spectral parameters that confirms the classification of the source as an EHBL. In order to investigate the physical nature of this extreme emission, different theoretical frameworks were tested to model the broad-band SED. The hard TeV spectrum of 2WHSP J073326.7+515354 sets the SED far from the energy equipartition regime in the standard one-zone leptonic scenario of blazar emission. Conversely, more complex models of the jet, represented by either a two-zone spine-layer model or a hadronic emission model, better represent the broad-band SED.

Acciari, V. A.↗

Generation of Data-Driven Expected Energy Models for Photovoltaic Systems

Although unique expected energy models can be generated for a given photovoltaic (PV) site, a standardized model is also needed to facilitate performance comparisons across fleets. Current standardized expected energy models for PV work well with sparse data, but they have demonstrated significant over-estimations, which impacts accurate diagnoses of field operations and maintenance issues. This research addresses this issue by using machine learning to develop a data-driven expected energy model that can more accurately generate inferences for energy production of PV systems. Irradiance and system capacity information was used from 172 sites across the United States to train a series of models using Lasso linear regression. The trained models generally perform better than the commonly used expected energy model from international standard (IEC 61724-1), with the two highest performing models ranging in model complexity from a third-order polynomial with 10 parameters (Radj2 = 0.994) to a simpler, second-order polynomial with 4 parameters (Radj2=0.993), the latter of which is subject to further evaluation. Subsequently, the trained models provide a more robust basis for identifying potential energy anomalies for operations and maintenance activities as well as informing planning-related financial assessments. We conclude with directions for future research, such as using splines to improve model continuity and better capture systems with low (≤1000 kW DC) capacity.

14 SOLAR ENERGY↗

Modeling the contributions of global air temperature, synoptic-scale phenomena and soil moisture to near-surface static energy variability using artificial neural networks

Abstract. The static energy content of the atmosphere is increasing on a global scale, but exhibits important subglobal and subregional scales of variability and is a useful parameter for integrating the net effect of changes in the partitioning of energy at the surface and for improving understanding of the causes of so-called warming holes (i.e., locations with decreasing daily maximum air temperatures ( T ) or increasing trends of lower magnitude than the global mean). Further, measures of the static energy content (herein the equivalent potential temperature, θ e ) are more strongly linked to excess human mortality and morbidity than air temperature alone, and have great relevance in understanding causes of past heat-related excess mortality and making projections of possible future events that are likely to be associated with negative human health and economic consequences. New nonlinear statistical models for summertime daily maximum and minimum θ e are developed and used to advance understanding of drivers of historical change and variability over the eastern USA. The predictor variables are an index of the daily global mean temperature, daily indices of the synoptic-scale meteorology derived from T and specific humidity ( Q ) at 850 and 500 hPa geopotential heights ( Z ), and spatiotemporally averaged soil moisture ( SM ). SM is particularly important in determining the magnitude of θ e over regions that have previously been identified as exhibiting warming holes, confirming the key importance of SM in dictating the partitioning of net radiation into sensible and latent heat and dictating trends in near-surface T and θ e . Consistent with our a priori expectations, models built using artificial neural networks (ANNs) out-perform linear models that do not permit interaction of the predictor variables (global T , synoptic-scale meteorological conditions and SM ). This is particularly marked in regions with high variability in minimum and maximum θ e , where more complex models built using ANN with multiple hidden layers are better able to capture the day-to-day variability in θ e and the occurrence of extreme maximum θ e . Over the entire domain, the ANN with three hidden layers exhibits high accuracy in predicting maximum θ e > 347 K. The median hit rate for maximum θ e >347 K is > 0.60, while the median false alarm rate is ≈ 0.08.

54 ENVIRONMENTAL SCIENCES↗

Development and Application of ANN Model for Worker Assignment into Virtual Cells of Large Sized Configurations

This paper presents an extended version of study already undertaken on development of an artificial neural networks (ANNs) model for assigning workforce into virtual cells under virtual cellular manufacturing systems (VCMS) environments. Previously, the same authors have introduced this concept and applied it to virtual cells of two-cell configuration and the results demonstrated that ANNs could be a worth applying tool for carrying out workforce assignments. In this attempt, three-cell configurations problems are considered for worker assignment task. Virtual cells are formed under dual resource constraint (DRC) context in which the number of available workers is less than the total number of machines available. Since worker assignment tasks are quite non-linear and highly dynamic in nature under varying inputs and conditions and, in parallel, ANNs have the ability to model complex relationships between inputs and outputs and find similar patterns effectively, an attempt was earlier made to employ ANNs into the above task. In this paper, the multilayered perceptron with feed forward (MLP-FF) neural network model has been reused for worker assignment tasks of three-cell configurations under DRC context and its performance at different time periods has been analyzed. The previously proposed worker assignment model has been reconfigured and cell formation solutions available for three-cell configuration in the literature are used in combination to generate datasets for training ANNs framework. Finally, results of the study have been presented and discussed.

99 GENERAL AND MISCELLANEOUS↗

Structure of the electrical double layer at the ice–water interface

The surface of ice in contact with water contains sites that undergo deprotonation and protonation and can act as adsorption sites for aqueous ions. Therefore, an electrical double layer should form at this interface and existing models for describing the electrical double layer at metal oxide–water interfaces should be able to be modified to describe the surface charge, surface potential, and ionic occupancy at the ice–water interface. I used a surface complexation model along with literature measurements of the zeta potential of ice in brines of various strength and pH to constrain equilibrium constants. I then made predictions of ion site occupancy, surface charge density, and partitioning of counterions between the Stern and diffuse layers. The equilibrium constant for cation adsorption is more than 5 orders of magnitude larger than the other constants, indicating that this reaction dominates even at low salinity. Deprotonated OH sites are predicted to be slightly more abundant than dangling O sites, consistent with previous work. Surface charge densities are on the order of ±0.001 C/m2 and are always negative at the moderate pH values of interest to atmospheric and geophysical applications (6–9). In this pH range, over 99% of the counterions are contained in the Stern layer. This suggests that diffuse layer polarization will not occur because the ionic concentrations in the diffuse layer are nearly identical to those in the bulk electrolyte and that electrical conduction and polarization in the Stern layer will be negligible due to reduced ion mobility.

Daigle, Hugh (ORCID:0000000260628321)↗

Posterior Covariance Matrix Approximations

Here, the Davis equation of state (EOS) is commonly used to model thermodynamic relationships for high explosive (HE) reactants. Typically, the parameters in the EOS are calibrated, with uncertainty, using a Bayesian framework and Markov Chain Monte Carlo (MCMC) methods. However, MCMC methods are computationally expensive, especially for complex models with many parameters. This paper provides a comparison between MCMC and less computationally expensive Variational methods (Variational Bayesian and Hessian Variational Bayesian) for computing the posterior distribution and approximating the posterior covariance matrix based on heterogeneous experimental data. All three methods recover similar posterior distributions and posterior covariance matrices. This study demonstrates that for this EOS parameter calibration application, the assumptions made in the two Variational methods significantly reduce the computational cost but do not substantially change the results compared to MCMC.

97 MATHEMATICS AND COMPUTING↗

Application of High Performance Computing for Simulating the Unstable Dynamics of Dilute Spark-Ignited Combustion

In collaboration with a major automotive manufacturer, we are using computational simulations of in-cylinder combustion to understand the multi-scale nonlinear physics of the dilute stability limit. Because some key features of dilute combustion can take thousands of successive cycles to develop, the computation time involved in using complex models to simulate these effects has limited industrys ability to exploit simulations in optimizing advanced engines. We describe a novel approach for utilizing parallel computations to reveal long-timescale features of dilute combustion without the need to simulate many successive engine cycles in series. Our approach relies on carefully guided, concurrent, single-cycle simulations to create metamodels that preserve the long-timescale features of interest. We use a simplified combustion model to develop and demonstrate our strategy for adaptively guiding the concurrent simulations to generate metamodels. We next will implement this strategy with higher-fidelity, multi-scale combustion models on large computing facilities to generate more refined metamodels. The refined metamodels can then be used to accelerate engine development because of their efficiency. Similar approaches might also be used for rapidly exploring the dynamics of other complex multi-scale systems that evolve with serial dependency on time.

Finney, Charles↗

Mitigating spectral bias in neural operators via high-frequency scaling for physical systems

Neural operators have emerged as powerful surrogates for modeling complex physical problems. However, they suffer from spectral bias making them oblivious to high-frequency modes, which are present in multiscale physical systems. Therefore, they tend to produce over-smoothed solutions, which is particularly problematic in modeling turbulence and for systems with intricate patterns and sharp gradients such as multi-phase flow systems. In this work, we introduce a new approach named high-frequency scaling (HFS) to mitigate spectral bias in convolutional-based neural operators. By integrating HFS with proper variants of UNet, we demonstrate a higher prediction accuracy by mitigating spectral bias in single and two-phase flow problems. Unlike Fourierbased techniques, HFS is directly applied to the latent space, thus eliminating the computational cost associated with the Fourier transform. Additionally, we investigate alternative spectral bias mitigation through a diffusion model conditioned on neural operators. While the diffusion model integrated with the standard neural operator may still suffer from significant errors, these errors are substantially reduced when the diffusion model is integrated with a HFS-enhanced neural operator.

97 MATHEMATICS AND COMPUTING↗

Practical Probabilistic Programming

Recent advances in probabilistic programming languages (PPLs) have provided the capability for exact inference: computing a closed-form probability distribution for a given probabilistic program. In particular, the new language Roulette uses a language oriented programming (LOP) approach, wherein analysts build new programming languages on top of a set of primitives provided by Roulette, which then translates these structures into a weighted model counting problem which can be solved by automated reasoning tools. However, because Roulette provides few convenience features, developing these new languages is challenging even for expert users. We developed a standard library of common probability functions for Roulette with the goal of improved usability. This included approximation of continuous probability density functions using discrete probability mass functions. We demonstrated this approach by modeling a cosmic ray striking a RAM controller. We found that Roulette provides a powerful interface for highly expressive probabilistic programs to be generated. In collaboration with the NNSA Advanced Simulation and Computing program, which resulted in development of a tool called Circulette, we were able to model complex circuits expressed in Verilog using probabilistic programs with an expressivity not previously possible. Our research question that motivated the development of a Roulette standard library was to determine whether non-experts could use a PPL to model relevant problems regarding radiation effects on microelectronics. This standard library improved the expressivity of Roulette by implementing common probability density functions, mathematical operators on distributions, and support for empirical distributions. While Roulette is a powerful modeling language, the untyped, LOP approach makes error messages difficult to understand and requires expert aid. We recommend further research on Roulette, especially with its error messages, to enable improved usability. At the same time, this project demonstrated that for users familiar with Roulette and the LOP approach, Roulette provides powerful new capabilities that can be integrated with other Sandia modeling capabilities.

97 MATHEMATICS AND COMPUTING↗

A semi-coupled aero-servo-hydro numerical model for floating vertical axis wind turbines operating on TLPs

Floating vertical axis wind turbines (VAWTs) have many advantages over floating horizontal axis wind turbines (HAWTs) at large scales in deep water; however, there are several key challenges to overcome as well. One of the challenges is accurate prediction of the dynamic motion and loads performance of a floating VAWT. Here, a new semi-coupled aero-servo-hydro method is developed to assess dynamic responses of a floating VAWT by modeling the system as a 7-degree-of-freedom (7-DOF) model: the supporting platform is considered as a 6-DOF rigid body; the rotation of the rotor is considered as the 7th DOF. Aerodynamic, hydrodynamic, and mooring loads and control of the rotor speed are fully considered. This model can predict performance of floating VAWTs with reasonable fidelity according to validation with OrcaFlex through static and dynamic responses of a floating VAWT with Darrieus rotor operating on a new tension-leg platform (TLP). Being a reduced complexity model, the 7-DOF model can be efficiently applied to assess performance of the newly designed floating VAWT. This model is used to examine the relative contributions of aerodynamic and wave loads imparted to the floating system and the benefits of a three-bladed VAWT over a two-bladed VAWT through dynamic and fatigue analysis.

17 WIND ENERGY↗

Deep Gaussian process-based cost-aware batch Bayesian optimization for complex materials design campaigns

The accelerating pace and expanding scope of materials discovery demand optimization frameworks that efficiently navigate vast design spaces with complex response surfaces while judiciously allocating limited evaluation resources. We present a cost-aware, batch Bayesian optimization scheme powered by deep Gaussian process (DGP) surrogates and a heterotopic querying strategy. Our DGP surrogate, formed by stacking GP layers, models complex hierarchical relationships among high-dimensional compositional features and captures correlations across multiple target properties, propagating uncertainty through successive layers. We integrate evaluation cost into an upper-confidence-bound acquisition extension, which, together with heterotopic querying, proposes small batches of candidates in parallel, balancing exploration of under-characterized regions with exploitation of high-mean, low-variance predictions across correlated properties. Applied to refractory high-entropy alloys for high-temperature applications, our framework converges to optimal formulations in fewer iterations with cost-aware queries than conventional GP-based BO, highlighting the value of deep, uncertainty-aware, cost-sensitive strategies in materials campaigns.

36 MATERIALS SCIENCE↗

Posterior Regularized Bayesian Neural Network incorporating soft and hard knowledge constraints

Neural Networks (NNs) have been widely used in supervised learning due to their ability to model complex nonlinear patterns, often presented in high-dimensional data such as images and text. However, traditional NNs often lack the ability for uncertainty quantification. Bayesian NNs (BNNS) could help measure the uncertainty by considering the distributions of the NN model parameters. Besides, domain knowledge is commonly available and could improve the performance of BNNs if it can be appropriately incorporated. In this work, we propose a novel Posterior-Regularized Bayesian Neural Network (PR-BNN) model by incorporating different types of knowledge constraints, such as the soft and hard constraints, as a posterior regularization term. Furthermore, we propose to combine the augmented Lagrangian method and the existing BNN solvers for efficient inference. Furthermore, the experiments in simulation and two case studies about aviation landing prediction and solar energy output prediction have shown the knowledge constraints and the performance improvement of the proposed model over traditional BNNs without the constraints.

14 SOLAR ENERGY↗

Deciphering enhancer sequence using thermodynamics-based models and convolutional neural networks

Abstract Deciphering the sequence-function relationship encoded in enhancers holds the key to interpreting non-coding variants and understanding mechanisms of transcriptomic variation. Several quantitative models exist for predicting enhancer function and underlying mechanisms; however, there has been no systematic comparison of these models characterizing their relative strengths and shortcomings. Here, we interrogated a rich data set of neuroectodermal enhancers in Drosophila, representing cis- and trans- sources of expression variation, with a suite of biophysical and machine learning models. We performed rigorous comparisons of thermodynamics-based models implementing different mechanisms of activation, repression and cooperativity. Moreover, we developed a convolutional neural network (CNN) model, called CoNSEPT, that learns enhancer ‘grammar’ in an unbiased manner. CoNSEPT is the first general-purpose CNN tool for predicting enhancer function in varying conditions, such as different cell types and experimental conditions, and we show that such complex models can suggest interpretable mechanisms. We found model-based evidence for mechanisms previously established for the studied system, including cooperative activation and short-range repression. The data also favored one hypothesized activation mechanism over another and suggested an intriguing role for a direct, distance-independent repression mechanism. Our modeling shows that while fundamentally different models can yield similar fits to data, they vary in their utility for mechanistic inference. CoNSEPT is freely available at: https://github.com/PayamDiba/CoNSEPT.

59 BASIC BIOLOGICAL SCIENCES↗

PayamDiba/CoNSEPT

Deciphering the sequence-function relationship encoded in enhancers holds the key to interpreting non-coding variants and understanding mechanisms of transcriptomic variation. Several quantitative models exist for predicting enhancer function and underlying mechanisms; however, there has been no systematic comparison of these models characterizing their relative strengths and shortcomings. Here, we interrogated a rich data set of neuroectodermal enhancers in Drosophila, representing cis- and trans- sources of expression variation, with a suite of biophysical and machine learning models. We performed rigorous comparisons of thermodynamics-based models implementing different mechanisms of activation, repression and cooperativity. Moreover, we developed a convolutional neural network (CNN) model, called CoNSEPT, that learns enhancer ‘grammar’ in an unbiased manner. CoNSEPT is the first general-purpose CNN tool for predicting enhancer function in varying conditions, such as different cell types and experimental conditions, and we show that such complex models can suggest interpretable mechanisms. We found model-based evidence for mechanisms previously established for the studied system, including cooperative activation and short-range repression. The data also favored one hypothesized activation mechanism over another and suggested an intriguing role for a direct, distance-independent repression mechanism. Our modeling shows that while fundamentally different models can yield similar fits to data, they vary in their utility for mechanistic inference.

Dibaeinia, Payam↗

Unveiling the Potential of MeshGraphNets for Predicting Subsurface Evolution in Carbon Storage Projects

This is the conference paper accompanying an oral presentation “Unveiling the Potential of MeshGraphNets for Predicting Subsurface Evolution in Carbon Storage Projects” at the 17th International Conference on Greenhouse Gas Control Technologies GHGT-17 held in Calgary, Canada, October 20-24 , 2024. Carbon capture and storage (CCS) technology is critical for mitigating climate change but requires effective subsurface reservoir management to ensure safe containment of injected CO2. Accurate predictions of reservoir pressure and saturation are essential for assessing long-term CCS performance. Traditional numerical simulations, while effective, are computationally intensive, time-consuming, and constrained by data discretization. Previous work has shown the effectiveness of MeshGraphNets (MGN), a graph-based machine learning framework, as an innovative alternative for predicting reservoir behavior. MGN leverages graph neural networks (GNNs) and mesh representations to model complex geological formations, offering superior adaptability across different discretizations and reservoir configurations. Classic MGN implementations utilize an autoregressive technique to predict future behavior based on current predictions, but this technique is hampered by error accumulation over time. To enhance the model accuracy in time-series predictions, this study implemented a multi-step rollout strategy that integrates autoregressive predictions during training to stabilize prediction of saturation over time. Using the Illinois Basin – Decatur Project (IBDP) dataset, comprising 100 simulations of CO2 injection, pressure, and saturation changes, the framework demonstrated its ability to learn spatial dependencies and temporal dynamics. With inputs including permeabilities, porosities, and injection rates, MGN accurately predicted CO2 plume evolution over time, even with limited training data. Moreover, the addition of a multi-step rollout procedure during training improved the ability of MGN to predict stably over time by ~15%. This research positions MGN, enhanced with multi-step rollout capabilities, as a robust and efficient tool for CCS applications. It advances the field by enabling precise, computationally efficient predictions of reservoir behavior, providing a foundation for the broader adoption of machine learning frameworks in CCS and other geoscience domains.

Holcomb, Paul↗