Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69

Model Calibration with Markov Chain Monte Carlo Tutorial

The purpose of this tutorial is to demonstrate how to use Markov chain Monte Carlo (MCMC) to calibrate a model. By calibration, we mean the selection of model parameters (and, when relevant, structures). A common goal in model development and diagnostics is calibration, or the identification of model structures and parameters which are consistent with data. While models can be calibrated through hand-tuning parameters or minimizing simple error metrics such as root-mean-square-error (RMSE), these approaches can underrepresent the probabilistic nature of the data-generating process, as well as the potential for multiple model configurations to be consistent with the data. Probabilistic uncertainty quantification, which is the topic of this notebook, can address these concerns. This tutorial is presented as an appendix to the e-book: Addressing Uncertainty in MultiSector Dynamics Research.

Markov chain Monte Carlo↗

Machine learning models of intermittent operation of RO wellhead water treatment for salinity reduction and nitrate removal

Machine learning models were developed for intermittent multi-mode operation of a wellhead reverse osmosis water purification and desalination system to predict salt passage, nitrate passage, and permeate flux. The models, based on long short-term memory (LSTM) recurrent neural network (RNN) architecture, included an attention mechanism to increase model performance in proximity of the regulatory limit for nitrate. Training and testing of the models for the Startup, Production, Shutdown and Flushing operational modes were based on operational data (consisting of 22 process variables per data sample) acquired every 2–5 s over a six-month period. The significant sets of model input attributes for the different operational modes were assessed via Spearman ranking correlation, Self-Organizing Map (SOM) analysis and feed forward feature selection (FFFS). Although the variability of nitrate passage, salt passage and permeate flux was significant over the four operational modes, prediction performance for the three outcomes were with R2 and Average Absolute Relative Error (AARE) of 0.78–0.95 and 2.96–6.16 %, respectively. Model updates post membrane elements replacement demonstrated similar levels of prediction accuracy. The study results suggest that there is merit in exploring the utility of multi-mode models for sensor fault detection, data imputation, and for potential use in model-predictive control.

Intermittent RO operation↗

Hyper Suprime-Cam Year 3 results: Cosmology from galaxy clustering and weak lensing with HSC and SDSS using the emulator based halo model

We present cosmology results from a blinded joint analysis of cosmic shear, galaxy-galaxy weak lensing, and projected galaxy clustering, measured from the Hyper Suprime-Cam three-year (HSC-Y3) shape catalog and the Sloan Digital Sky Survey (SDSS) DR11 spectroscopic galaxy catalog—a cosmology analysis. We define luminosity-cut, and therefore nearly volume-limited, samples of SDSS galaxies to serve as the tracers of w p and as the lens samples for Δ⁢Σ in three spectroscopic redshift bins spanning the range 0.15± and Δ⁢Σ measurements, we use a single sample of about seven million source galaxies over 416 deg 2 , selected from HSC-Y3 based on having photometric redshifts (photo-z) greater than 0.75. The deep, high-quality HSC-Y3 data enable significant detections of the Δ⁢Σ signals, with integrated signal-to-noise ratio S/N~24 in the range 3≤R/[ℎ –1 Mpc]≤30 over the three lens samples. ξ ± has S/N ~19 in the range 8' ≤$\theta$ ≤5⁢0' and 30' ≤$\theta$ ≤15⁢0' for ξ + and ξ – , respectively. For cosmological parameter inference, we use the dark emulator package, combined with a halo occupation distribution prescription for the relation between galaxies and halos, to model w p and Δ⁢Σ down to quasinonlinear scales, and we estimate cosmological parameters after marginalizing over nuisance parameters. In our baseline analysis we employ an uninformative flat prior of the residual photo-z error, given by Π⁡(Δz ph )=$U$⁡(–1,1), to model a residual bias in the mean redshift of HSC source galaxies. Comparing the relative lensing amplitudes for Δ⁢Σ in the three redshift bins and for ξ ± with the single HSC source galaxy sample allows us to calibrate the photo-z parameter Δ⁢z ph to the precision of σ⁡(Δ⁢z ph )≃0.09. With these methods, we obtain a robust constraint on the cosmological parameters for the flat Λ⁢CDM model: S 8 =σ 8 ⁢(Ω m /0.3) 0.5 =$0.763^{+0.040}_{–0.036}$, or the best-constrained parameter given by $S^{'}_{8}$ = σ 8 ⁢(Ω m /0.3) 0.22 =0.721±0.028, determined with about 4% fractional precision. Based on multidimensional tension metrics, HSC-Y3 data exhibits about 2.5σ tension with the cosmological constraint inferred by Planck for the Λ⁢CDM model, and hints at a nonzero residual photo-z bias implying that the true mean redshift of the HSC galaxies at z ≳0.75 is higher than that implied by the original photo-z estimates.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian learning for rapid prediction of lithium-ion battery-cycling protocols

Advancing lithium-ion battery technology requires the optimization of cycling protocols. A new data-driven methodology is demonstrated for rapid, accurate prediction of the cycle life obtained by new cycling protocols using a single test lasting only 3 cycles, enabling rapid exploration of cycling protocol design spaces with orders of magnitude reduction in testing time. We achieve this by combining lifetime early prediction with a hierarchical Bayesian model (HBM) to rapidly predict performance distributions without the need for extensive repetitive testing. The methodology is applied to a comprehensive dataset of lithium-iron-phosphate/graphite comprising 29 different fast-charging protocols. HBM alone provides high protocol-lifetime prediction performance, with 6.5% of overall test average percent error, after cycling only one battery to failure. Here, by combining HBM with a battery lifetime prediction model, we achieve a test error of 8.8% using a single 3-cycle test. In addition, the generalizability of the HBM approach is demonstrated for lithium-manganese-cobalt-oxide/graphite cells.

25 ENERGY STORAGE↗

A Simplified Method for Predicting Shaker Voltage in IMMATs

Impedance Matched Multi-Axis Tests (IMMATs) can replicate in-service vibration induced stress more accurately than single axis shaker table tests as they can better match a part’s operational boundary conditions and excite it in multiple degrees of freedom simultaneously. Here, the shakers used in IMMATs are less powerful than shaker tables, so shaker force limits can be exceeded during tests if they are not placed adequately for the desired environment. The ability to predict shaker voltage and force before performing a test is, therefore, helpful in selecting shaker locations so that their limits are not exceeded. In this study, electrodynamic shakers were modeled as discrete electromechanical systems, and the shaker parameters were chosen to match experimentally obtained acceleration/voltage frequency response functions (FRFs). These models were coupled to a finite element model of the device under test (DUT) via dynamic substructuring, and the substructured model was demonstrated to accurately predict shaker voltage as well as the error in reproducing the environment at multiple accelerometer locations. A simple method called the FRF Multiplication method, in which the FRF of the substructured system is approximated as the product of two separate FRFs of the shaker and DUT respectively, was proposed and applied to the same system, yielding similar voltage and error predictions to those obtained using substructuring. Simple case studies were presented to explore the applicability of the proposed method, and it was demonstrated to have similar accuracy to the substructuring method in a range of cases. Additionally, we showed that while it was not possible to derive a unique model of the shakers from acceleration/voltage FRFs alone, the models that could be obtained were sufficient to predict test error almost perfectly and shaker voltage with less than 40 percent error.

42 ENGINEERING↗

Axisymmetric hydrodynamics in numerical relativity: treating coordinate singularity, artificial heating and modeling MHD instabilities

Two-dimensional axisymmetric simulations of binary neutron star (BNS) merger remnant are a cheap alternative to 3D simulations. To maintain realism for secular timescales, simulations must avoid accumulated errors from drifts in conserved quantities and artificial heating, and they must model turbulent transport in a way that remains plausible throughout the evolution. It is also crucial to avoid numerical artifacts due to the polar coordinate axis singularity. Methods that behave well near the axis often break flux-conservative form of the hydrodynamic equations, resulting in significant drifts in conserved quantities. We present a flux-conservative scheme that maintains smoothness near the axis without sacrificing conservative formulation of the equations or incurring drifts in conserved global quantities. We compare the numerical performance of different treatments of the hydrodynamic equations when evolving a hypermassive neutron star resembling the remnant of a BNS merger. These simulations demonstrate that the new scheme combines the axis smoothness of non-conservative methods with the mass and angular momentum conservation of other conservative methods on $\sim 10^2$ ms timescales of viscous and neutrino-driven evolution. Because fluid profiles remain smooth in the remnant interior, it is possible to remove artificial heating by evolving the entropy density. We show how physical heating and cooling terms can be easily calculated from source terms of the conservative evolution variables and demonstrate our implementation. Finally, we discuss and implement improvements to the effective viscosity scheme to better model the effect of magnetohydrodynamic instabilities as the remnant evolves.

axisymmetry↗

Liquid and Gamma-BCC Phase Equilibria in the Uranium-Niobium System: A Simple Thermodynamic Model for Phase Diagram and Other Predictions

A simple thermodynamic model for the uranium-niobium (U-Nb) system was created using a Calphad-type approach, circa 2002. Only the liquid and gamma-BCC phases were modeled, with their subregular solution mixing terms optimized by trial and error. The custom (user-defined) database file (.tdb) and experimental data file (.exp) are listed, both of which are compatible with Thermo-Calc software. This model is used to calculate the solidus, liquidus, miscibility gap on the U-Nb phase diagram and also the enthalpy of melting in the U-6Nb alloy.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Lithium-Ion Battery Diagnostics Using Electrochemical Impedance via Machine-Learning

Diagnosing battery states such as health, state-of-charge, or temperature is crucial for ensuring the safety and reliability of electrochemical energy storage systems. While some states, such as temperature, may be measured using cheap sensors, accurate diagnosis of battery health metrics usually requires time-consuming performance measurements, making them infeasible for use in real-world operation. These health metrics can be measured during lab-testing and then estimated on-line using predictive life models or via state observer algorithms such as Kalman filters, but these predictive methods should be supplemented by actual measurement of battery health whenever possible to ensure reliability. Rapid measurement of battery health may be done by various types of fast diagnostic techniques such as electrochemical impedance spectroscopy (EIS), which can be performed in only a few minutes and require only a fraction of the energy and power needed for a full charge and discharge measurement. But there is a substantial challenge for estimating battery health using EIS data, as EIS is sensitive to cell temperature, state-of-charge, current, and resting time in addition to health. Thus, utilizing EIS data to predict battery capacity requires correcting for all these additional variables, a task that is extremely difficult to handle analytically. This talk utilizes machine-learning methods to estimate the effectiveness of battery capacity prediction from EIS data, leveraging a data set of hundreds of EIS measurements recorded at varying temperature and state-of-charge throughout a 500-day aging study of 32 commercial, large-format NMC-Graphite lithium-ion batteries. Using EIS as input to machine-learning models is complicated by the nonlinear response of impedance to battery health, temperature, and state-of-charge, as well as the collinearity between the impedance response at neighboring frequencies, which can easily lead to overfit models. To train robust models, features from EIS data need to be extracted from the data or some subset of critical frequencies selected. Many approaches for extracting and selecting features from EIS data from electrochemical analysis and machine-learning fields were identified for analysis: using the entire raw spectra; selection of one, two, or many frequencies from the entire spectra; selecting interesting points from the EIS measurement using domain knowledge; fitting EIS with an equivalent-circuit model; calculating statistics on the raw impedance values; and reducing the dimensionality of the data using unsupervised linear (principal component analysis) and non-linear (uniform manifold approximation and projection) methods. These approaches were rigorously compared using a machine-learning pipeline approach, training linear, Gaussian process, and random forest regression models and quantifying performance using cross-validation as well as a held-out test set. An artificial neural network model trained on the raw spectra was also tested. Promising pipelines were fine-tuned via Bayesian hyperparameter optimization using cross-validation loss and training with class-specific weights to counter data set imbalance. The most reliable method for utilizing impedance in this work was the selection of two optimal frequencies through an exhaustive search, resulting in about 2% mean absolute error on test data for both Gaussian process and random forest model architectures. Interrogation of a variety of models reveals critical frequencies of 100 Hz and 103 Hz for this data set, though the optimal set of frequencies is not necessarily intuitive, i.e., the best performing models are not simply those that use impedance at frequencies that have the highest correlation to the relative discharge capacity. The best performing model is an ensemble model, which is able to predict battery capacity with 1.9% mean absolute error for unseen cells using impedance recorded at a variety of temperatures and states-of-charge.

battery↗

Stochastic and a posteriori optimization to mitigate coil manufacturing errors in stellarator design

Abstract It was recently shown in Wechsung et al (2022 Proc. Natl Acad. Sci. USA 119 e2202084119) that there exist electromagnetic coils that generate magnetic fields, which are excellent approximations to quasi-symmetric fields and have very good particle confinement properties. Using a Gaussian process-based model for coil perturbations, we investigate the impact of manufacturing errors on the performance of these coils. We show that even fairly small errors result in noticeable performance degradation. While stochastic optimization yields minor improvements, it is not possible to mitigate these errors significantly. As an alternative to stochastic optimization, we then formulate a new optimization problem for computing optimal adjustments of the coil positions and currents without changing the shapes of the coil. These a-posteriori adjustments are able to reduce the impact of coil errors by an order of magnitude, providing a new perspective for dealing with manufacturing tolerances in stellarator design.

Physics↗

Analytic Theory for the Dynamics of Wide Quantum Neural Networks

Here, parametrized quantum circuits can be used as quantum neural networks and have the potential to outperform their classical counterparts when trained for addressing learning problems. To date, much of the results on their performance on practical problems are heuristic in nature. In particular, the convergence rate for the training of quantum neural networks is not fully understood. Here, we analyze the dynamics of gradient descent for the training error of a class of variational quantum machine learning models. We define wide quantum neural networks as parametrized quantum circuits in the limit of a large number of qubits and variational parameters. Then, we find a simple analytic formula that captures the average behavior of their loss function and discuss the consequences of our findings. For example, for random quantum circuits, we predict and characterize an exponential decay of the residual training error as a function of the parameters of the system. Finally, we validate our analytic results with numerical experiments.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An Automatic Processing Framework for In Situ Determination of Ecohydrological Root Water Content by Ground-Penetrating Radar

This report concerns Root water content (RWC) as a vital component in water flux in soil-plant-atmosphere continuum. Knowledge of RWC helps to better understand the root function and the soil-root interaction and improves water cycle modeling. However, due to the lack of appropriate methods, field monitoring of RWC is seriously constrained. In this study, we used ground-penetrating radar (GPR), a common geophysical technique, to characterize RWC of coarse roots noninvasively. An automatic GPR data processing framework was proposed to (1) identify hyperbolic root reflections and locate roots in GPR images and (2) extract waveform parameters from the reflected wave of identified roots. These waveform parameters were then used to establish an empirical model and a semiempirical model to determine RWC. We validated the developed models using GPR root data at three antenna center frequencies (500 MHz, 900 MHz, and 2 GHz) that were produced from simulation experiments (with RWC ranging from 70% to 150%) and field experiments in sandy soils (with RWC ranging from 66% to 144%). Our results show that both the empirical and the semiempirical models achieved a good performance in estimating RWC with similar accuracy, i.e., the prediction error [root-mean-square error (RMSE)] was less than 8% for the simulation data and 12% for the field data. For both models, the accuracy of RWC estimation was the highest when applied to 2-GHz data. This study renders a new opportunity to determine RWC under field conditions that enhances the application of GPR for root study and the understanding and modeling of ecohydrology in the rhizosphere.

54 ENVIRONMENTAL SCIENCES↗

Comparison of MeshGraphNet Techniques for Subsurface Behavior Prediction during CO2 Sequestration

Carbon sequestration is a vital part of the effort to mitigate anthropogenic climate change. Previously, we have shown that Graph Neural Networks (GNNs) provide the ability to extract meaningful insights during prediction of subsurface behavior in carbon storage projects. However, these models have struggled with long-term prediction accuracy due to error accumulation caused by autoregressive prediction. This research leverages the Illinois Basin – Decatur Project (IBDP) dataset to examine strategies for minimizing loss over time in a MeshGraphNet GNN model to improve reliability of predictions while minimizing inferencing time.

Holcomb, Paul↗

Tracing and Forecasting Metabolic Indices of Cancer Patients Using Patient-Specific Deep Learning Models

We develop a patient-specific dynamical system model from the time series data of the cancer patient’s metabolic panel taken during the period of cancer treatment and recovery. The model consists of a pair of stacked long short-term memory (LSTM) recurrent neural networks and a fully connected neural network in each unit. It is intended to be used by physicians to trace back and look forward at the patient’s metabolic indices, to identify potential adverse events, and to make short-term predictions. When the model is used in making short-term predictions, the relative error in every index is less than 10% in the L ∞ norm and less than 6.3% in the L 1 norm in the validation process. Once a master model is built, the patient-specific model can be calibrated through transfer learning. As an example, we obtain patient-specific models for four more cancer patients through transfer learning, which all exhibit reduced training time and a comparable level of accuracy. This study demonstrates that this modeling approach is reliable and can deliver clinically acceptable physiological models for tracking and forecasting patients’ metabolic indices.

60 APPLIED LIFE SCIENCES↗

QES-Plume v1.0: a Lagrangian dispersion model

Low-cost simulations providing accurate predictions of transport of airborne material in urban areas, vegetative canopies, and complex terrain are demanding because of the small-scale heterogeneity of the features influencing the mean flow and turbulence fields. Common models used to predict turbulent transport of passive scalars are based on the Lagrangian stochastic dispersion model. The Quick Environmental Simulation (QES) tool is a low-computational-cost framework developed to provide high-resolution wind and concentration fields in a variety of complex atmospheric-boundary-layer environments. Part of the framework, QES-Plume, is a Lagrangian dispersion code that uses a time-implicit integration scheme to solve the generalized Langevin equations which require mean flow and turbulence fields. Here, QES-Plume is driven by QES-Winds, a 3D fast-response model that computes mass-consistent wind fields around buildings, vegetation, and hills using empirical parameterizations, and QES-Turb, a local-mixing-length turbulence model. In this paper, the particle dispersion model is presented and validated against analytical solutions to examine QES-Plume’s performance under idealized conditions. In particular, QES-Plume is evaluated against a classical Gaussian plume model for an elevated continuous point-source release in uniform flow, the Lagrangian scaling of dispersion in isotropic turbulence, and a non-Gaussian plume model for an elevated continuous point-source release in a power-law boundary-layer flow. In these cases, QES-Plume yields a maximum relative error below 6 % when compared with analytical solutions. In addition, the model is tested against wind-tunnel data for a uniform array of cubical buildings. QES-Plume exhibits good agreement with the experiment with 99 % of matched zeros and 59 % of the predicted concentrations falling within a factor of 2 of the experimental concentrations. Furthermore, results also emphasize the importance of using high-quality turbulence models for particle dispersion in complex environments. Finally, QES-Plume demonstrates excellent computational performance.

58 GEOSCIENCES↗

Thermal performance and energy consumption validation of an occupied local government office building outfitted with ceiling tile phase change materials

Buildings present an opportunity for energy conservation and the modulation of peak energy demand through controlled Heating, Ventilation, and Air Conditioning (HVAC) energy use. The administrative and office building stock in the United States holds potential to achieve energy and demand savings through retrofits such as insulation, weatherization, and thermal energy storage. Specifically, there is a need to validate passive phase change material (PCM) applications in full scale in aging administrative buildings in the US to evaluate the energy benefits. Aim of this study was to conduct a whole building level thermal and energy validation of an operational building and explore an alternative method for evaluating energy efficiency. To accomplish this, the study employed PCMs in the drop ceiling and carry out an energy audit and on-site measurement of HVAC systems' energy demand and consumption. A full-scale EnergyPlus energy model, modeled by the authors, served as a baseline for evaluation. The results show that calibrated model's envelope temperature measures fall within the accepted errors. HVAC energy simulation results also fall within the accepted errors for monthly and hourly pre- and post- PCM retrofit electricity and natural gas data. The novelty of this study is that it employees energy scales per Heating Degree Hour and Cooling Degree Hour, in contrast to the commonly used Heating Degree Days and Cooling Degree Days as reported in the literature to analyze energy savings. These findings underscore the pivotal role of a calibrated model in assessing the efficacy of a singular energy measure, like a PCM-retrofitted ceiling, in an occupied office building.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Reducing Southern Ocean Shortwave Radiation Errors in the ERA5 Reanalysis with Machine Learning and 25 Years of Surface Observations

Earth system models struggle to simulate clouds and their radiative effects over the Southern Ocean, partly due to a lack of measurements and targeted cloud microphysics knowledge. We have evaluated biases of downwelling shortwave radiation in the ERA5 climate reanalysis using 25 years (1995–2019) of summertime surface measurements, collected on the Research and Supply Vessel (RSV) Aurora Australis, the Research Vessel (R/V) Investigator, and at Macquarie Island. During October–March daylight hours, the ERA5 simulation of SW down exhibited large errors (mean bias = 54 W m -2 , mean absolute error = 82 W m -2 , root-mean-square error = 132 W m -2 , and R 2 = 0.71). To determine whether we could improve these statistics, we bypassed ERA5’s radiative transfer model for SW down with machine learning–based models using a number of ERA5’s gridscale meteorological variables as predictors. These models were trained and tested with the surface measurements of SW down using a 10-fold shuffle split. An extreme gradient boosting (XGBoost) and a random forest–based model setup had the best performance relative to ERA5, both with a near complete reduction of the mean bias error, a decrease in the mean absolute error and root-mean-square error by 25% ± 3%, and an increase in the R 2 value of 5% ± 1% over the 10 splits. Large improvements occurred at higher latitudes and cyclone cold sectors, where ERA5 performed most poorly. We further interpret our methods using Shapley additive explanations. Our results indicate that data-driven techniques could have an important role in simulating surface radiation fluxes and in improving reanalysis products.

54 ENVIRONMENTAL SCIENCES↗

Continuum Correlations from CFD-DEM Modeling of Conduction Heat Transfer in Granular Flows

Heat transfer between a surface and flowing particles is analyzed to improve the accuracy of continuum models for wall-to-bed heat transfer in a fluidized bed. Discrete element modeling (DEM) is used to model a fluidized bed heat exchanger where heat enters the system through a heated wall. The DEM heat transfer predictions are validated against published experimental work (Brewster et al., 2024) with less than 15% error. In previous work by Morris et al. (2015), a continuum model was developed using data from high-fidelity DEM simulations of chute flows. In the current study, the continuum model is extended and validated for fluidized beds. The sensitivity of the continuum heat transfer model parameters, which was not quantified in previous studies, is also investigated. It is observed that for a given particle with specific properties, e.g. the particle size, roughness, and conduction lens radius, the continuum correlation developed for heat transfer from a heated boundary to the particle bed depends mainly on the solid fraction or porosity of the particle bed for a given fluid. The new continuum heat transfer model is then validated over a wide range of superficial velocities via comparisons to both discrete element and experimental data. It is shown that this correlation is valid for a large range of particle flow conditions from chute flows to fluidized beds with less than 10% error as compared to DEM predictions.

14 SOLAR ENERGY↗

Wave-by-Wave Forecasting via Assimilation of Marine Radar Data

Abstract This work describes a phase-resolving wave-forecasting algorithm that is based on the assimilation of marine radar image time series. The algorithm is tested against synthetic data and field observations. The algorithm couples X-band marine radar observations with a phase-resolving wave model that uses the linear mild slope equations for reconstruction of water surface elevations over a large domain of O (km) and a prescribed time window of O (min). The reconstruction also enables wave-by-wave forecasting through forward propagation in space and time. Marine radar image time series provide the input wave observations through a previously given relationship between backscatter intensity and the radial component of the sea surface slope. The algorithm assimilates the wave slope information into the model via a best-fit wave source function at the boundary that minimizes the slope reconstruction error over an annular region at the outer ranges of the radar images. The wave model is then able to propagate the waves across a polar domain to a location of interest at nearer ranges. The constraints on the method for achieving real-time forecasting are identified, and the algorithm is verified against synthetic data and tested using field observations.

Engineering↗