Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Benchmarking the performance of uncertainty quantification methods for neural network-based interatomic potentials

Machine-learned interatomic potentials (ML-IAPs) continue to gain popularity as accurate, computationally efficient replacements for traditional, physics-based interatomic potentials and expensive ab initio methods. Uncertainty quantification (UQ) of ML-IAPs is a growing area of research as UQ is critical in many applications of IAPs, such as developing curated datasets, active learning-based data augmentation, self-improving models, and estimating the uncertainty of molecular dynamics simulations. In this paper, we construct and benchmark a series of different neural network potentials (NNPs) with varying network architectures to determine the performance of these models with respect to both the mean and uncertainty calibration error. Each NNP method is specifically designed to predict either epistemic or aleatoric uncertainty with particular focus on the differences in behavior between the epistemic and aleatoric uncertainty estimates. We benchmark these methods using multiple datasets common in the ML-IAP literature. The results show that the aleatoric uncertainty from single-shot model architectures is a competitive alternative to ensemble-based epistemic uncertainty predictions in regions of sufficient data-density. However, in regions where the representative data is sparse, aleatoric uncertainty models tend to overpredict and epistemic methods tend to underpredict the actual model error. We conclude that the type of UQ is crucial when discussing performance of probabilistic model results as different methods have different performance characteristics depending on the regime in which they are evaluated. Therefore, the type of UQ method should be carefully evaluated against both the data characteristics and requirements for the intended application.

97 MATHEMATICS AND COMPUTING↗

Exploring Autoencoder-based Error-bounded Compression for Scientific Data

Error-bounded lossy compression is becoming an indispensable technique for the success of today's scientific projects with vast volumes of data produced during the simulations or instrument data acquisitions. Not only can it significantly reduce data size, but it also can control the compression errors based on user-specified error bounds. Autoencoder (AE) models have been widely used in image compression, but few AE-based compression approaches support error-bounding features, which are highly required by scientific applications. To address this issue, we explore using convolutional autoencoders to improve error-bounded lossy compression for scientific data, with the following three key contributions. (1) We provide an in-depth investigation of the characteristics of various autoencoder models and develop an error-bounded autoencoder-based framework in terms of the SZ model. (2) We optimize the compression quality for main stages in our designed AE-based error-bounded compression framework, fine-tuning the block sizes and latent sizes and also optimizing the compression efficiency of latent vectors. (3) We evaluate our proposed solution using five real-world scientific datasets and comparing them with six other related works. Experiments show that our solution exhibits a very competitive compression quality from among all the compressors in our tests. In absolute terms, it can obtain a much better compression quality (100%similar to 800% improvement in compression ratio with the same data distortion) compared with SZ2.1 and ZFP in cases with a high compression ratio.

Liu, Jinyang↗

Validation of Multiple Tools for Flat Plate Photovoltaic Modeling Against Measured Data

This report expands upon a previous work by the same authors, published in the 40th IEEE Photovoltaic Specialists conference. In this validation study, comprehensive analysis is performed on nine photovoltaic systems for which NREL could obtain detailed performance data and specifications, including three utility-scale systems and six commercial scale systems. Multiple photovoltaic performance modeling tools were used to model these nine systems, and the error of each tool was analyzed compared to quality-controlled measured performance data. This study shows that, excluding identified outliers, all tools achieve annual errors within +/-8% and hourly root mean squared errors less than 7% for all systems. It is further shown using SAM that module model and irradiance input choices can change the annual error with respect to measured data by as much as 6.6% for these nine systems, although all combinations examined still fall within an annual error range of +/-8.5%. Additionally, a seasonal variation in monthly error is shown for all tools. Finally, the effects of irradiance data uncertainty and the use of default loss assumptions on annual error are explored, and two approaches to reduce the error inherent in photovoltaic modeling are proposed.

14 SOLAR ENERGY↗

Verification of the 3-Region Advanced Test Reactor MCNP Model

The verification of the 3-region homogenized fuel Advanced Test Reactor MCNP model. The 3-region model was compared to the 19-plate model found in the 94-CIC report. Flux tallies, energy deposition tallies, and quarter core mesh tallies were used to compare the two models. The 3-region model needed updating in order to make good comparisons between the models. The percent error from the flux and energy deposition tallies data shows that experiment positions inside the flux trap have higher errors than positions outside the fuel ring. The standard deviation data obtained from the mesh tallies shows that the two models agree within two standard deviations throughout the reactor. It is concluded that the model works adequately for what it is used for.

99 GENERAL AND MISCELLANEOUS↗

Verification of the 3-Region Advanced Test Reactor MCNP Model

The verification of the 3-region homogenized fuel Advanced Test Reactor MCNP model. The 3-region model was compared to the 19-plate model found in the 94-CIC report. Flux tallies, energy deposition tallies, and quarter core mesh tallies were used to compare the two models. The 3-region model needed updating in order to make good comparisons between the models. The percent error from the flux and energy deposition tallies data shows that experiment positions inside the flux trap have higher errors than positions outside the fuel ring. The standard deviation data obtained from the mesh tallies shows that the two models agree within two standard deviations throughout the reactor. It is concluded that the model works adequately for what it is used for.

99 GENERAL AND MISCELLANEOUS↗

Calibration and Localization of Optically Pumped Magnetometers Using Electromagnetic Coils

In this paper, we propose a method to estimate the position, orientation, and gain of a magnetic field sensor using a set of (large) electromagnetic coils. We apply the method for calibrating an array of optically pumped magnetometers (OPMs) for magnetoencephalography (MEG). We first measure the magnetic fields of the coils at multiple known positions using a well-calibrated triaxial magnetometer, and model these discreetly sampled fields using vector spherical harmonics (VSH) functions. We then localize and calibrate an OPM by minimizing the sum of squared errors between the model signals and the OPM responses to the coil fields. We show that by using homogeneous and first-order gradient fields, the OPM sensor parameters (gain, position, and orientation) can be obtained from a set of linear equations with pseudo-inverses of two matrices. The currents that should be applied to the coils for approximating these low-order field components can be determined based on the VSH models. Computationally simple initial estimates of the OPM sensor parameters follow. As a first test of the method, we placed a fluxgate magnetometer at multiple positions and estimated the RMS position, orientation, and gain errors of the method to be 1.0 mm, 0.2°, and 0.8%, respectively. Lastly, we calibrated a 48-channel OPM array. The accuracy of the OPM calibration was tested by using the OPM array to localize magnetic dipoles in a phantom, which resulted in an average dipole position error of 3.3 mm. The results demonstrate the feasibility of using electromagnetic coils to calibrate and localize OPMs for MEG.

47 OTHER INSTRUMENTATION↗

Blind photovoltaic modeling intercomparison: A multidimensional data analysis and lessons learned

The Photovoltaic (PV) Performance Modeling Collaborative (PVPMC) organized a blind PV performance modeling intercomparison to allow PV modelers to blindly test their models and modeling ability against real system data. Measured weather and irradiance data were provided along with detailed descriptions of PV systems from two locations (Albuquerque, New Mexico, USA, and Roskilde, Denmark). Participants were asked to simulate the plane-of-array irradiance, module temperature, and DC power output from six systems and submit their results to Sandia for processing. The results showed overall median mean bias (i.e., the average error per participant) of 0.6% in annual irradiation and –3.3% in annual energy yield. While most PV performance modeling results seem to exhibit higher precision and accuracy as compared to an earlier blind PV modeling study in 2010, human errors, modeling skills, and derates were found to still cause significant errors in the estimates.

14 SOLAR ENERGY↗

High-Resolution Regional Wave Hindcast for Hawaii

This report summarizes modeling efforts for hindcasting of wave climate within the exclusive economic zone (EEZ) around the state of Hawaii. Specifically, the report provides detailed description of model mesh development, sensitivity analysis of the configuration of model parameters, data used for model forcing and validation, model skill assessment, and model outputs for resource characterization. The unstructured, nested-grid modeling approach incorporates a regional high-resolution SWAN (Simulating WAves Nearshore) model within the global-regional WAVEWATCH III® (WW3) wave model. The models were configured to comply with the International Electrotechnical Commission (IEC) Technical Standards for wave energy resource characterization. The SWAN model domain covers the entire EEZ with a spatial resolution of approximately 300 m in the nearshore region. Two levels of WW3 nested grids, from 0.5 arc-degree at global to 7.5 arc-minute at regional scale, were used to provide boundary conditions that drive the high-resolution nearshore SWAN model. The WW3 and SWAN models were forced by 0.5 arc-degree Climate Forecast System Reanalysis wind and 5 km regional Weather Research and Forecasting wind, respectively. Wave resource and bulk wave parameters were simulated for a 32-year period from 1979 to 2010, and were subsequently validated using wave buoy data within the model domain. Model performance was evaluated using a set of error statistics. Overall, the model shows good skills in reproducing the wave climate in the Hawaii EEZ in both spatial and temporal domains. Comparisons of time series and scatter plots for the six IEC resource parameters and the associated error statistics tables, and horizontal two-dimensional plots of annually averaged and monthly averaged IEC parameters are provided.

16 TIDAL AND WAVE POWER↗

Mitigative Strategies for Recovering From Large Language Model Trust Violations

In this study, we investigated strategies to address trust issues arising from errors in large language models (LLMs). The study examined the impact of confidence scores, system capability explanations, and user feedback on trust restoration post-error. 68 participants viewed the responses of an LLM to 20 general trivia questions, with an error introduced on the third trial. Each participant was presented with one mitigation strategy. Participants rated their overall trust in the model and the reliability of the answer. Results showed an immediate drop in trust after the error; however, there were no differences across the three strategies in trust recovery. All conditions had a logarithmic trend in trust recovery following error. Differences in overall trust were predicted by perceived reliability of the answer, suggesting that participants were evaluating results critically and using that to inform their trust in the model. Qualitative data supported this finding; participants expressed lasting distrust despite the LLM’s later accuracy. Results showcase the need to prioritize accuracy in LLM deployment, because early errors may irrevocably damage user trust calibration and later adoption.

97 MATHEMATICS AND COMPUTING↗

Real-Time Target Position Estimation Using Stereoscopic Kilovoltage/Megavoltage Imaging and External Respiratory Monitoring for Dynamic Multileaf Collimator Tracking

Purpose: To develop a real-time target position estimation method using stereoscopic kilovoltage (kV)/megavoltage (MV) imaging and external respiratory monitoring, and to investigate the performance of a dynamic multileaf collimator tracking system using this method. Methods and Materials: The real-time three-dimensional internal target position estimation was established by creating a time-varying correlation model that connected the external respiratory signals with the internal target motion measured intermittently using kV/MV imaging. The method was integrated into a dynamic multileaf collimator tracking system. Tracking experiments were performed for 10 thoracic/abdominal traces. A three-dimensional motion platform carrying a gold marker and a separate one-dimensional motion platform were used to reproduce the target and external respiratory motion, respectively. The target positions were detected by kV (1 Hz) and MV (5.2 Hz) imaging, and external respiratory motion was captured by an optical system (30 Hz). The beam-target alignment error was quantified as the positional difference between the target and circular beam center on the MV images acquired during tracking. The correlation model error was quantified by comparing a model estimate and measured target positions. Results: The root-mean-square errors in the beam-target alignment that had ranged from 3.1 to 7.6 mm without tracking were reduced to <1.5 mm with tracking, except during the model building period (6 s). The root-mean-square error in the correlation model was submillimeters in all directions. Conclusion: A novel real-time target position estimation method was developed and integrated into a dynamic multileaf collimator tracking system and demonstrated an average submillimeter geometric accuracy after initializing the internal/external correlation model. The method used hardware tools available on linear accelerators and therefore shows promise for clinical implementation.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

RDPM: An Extensible Tool for Resilience Design Patterns Modelling

Resilience to faults, errors, and failures in extreme-scale high-performance computing (HPC) systems is a critical challenge. Resilience design patterns offer a new, structured hardware and software design approach for improving resilience. While prior work focused on developing performance, reliability, and availability models for resilience design patterns, this paper extends it by providing a Resilience Design Patterns Modeling (RDPM) tool which allows (1) exploring performance, reliability, and availability of each resilience design pattern, (2) offering customization of parameters to optimize performance, reliability, and availability, and (3) allowing investigation of trade-off models for combining multiple patterns for practical resilience solutions.

Kumar, Mohit↗

Evaluation of an Automatic Registration-Based Algorithm for Direct Measurement of Volume Change in Tumors

Purpose: Assuming that early tumor volume change is a biomarker for response to therapy, accurate quantification of early volume changes could aid in adapting an individual patient's therapy and lead to shorter clinical trials. We investigated an image registration-based approach for tumor volume change quantification that may more reliably detect smaller changes that occur in shorter intervals than can be detected by existing algorithms. Methods and Materials: Variance and bias of the registration-based approach were evaluated using retrospective, in vivo, very-short-interval diffusion magnetic resonance imaging scans where true zero tumor volume change is unequivocally known and synthetic data, respectively. The interval scans were nonlinearly registered using two similarity measures: mutual information (MI) and normalized cross-correlation (NCC). Results: The 95% confidence interval of the percentage volume change error was (-8.93% to 10.49%) for MI-based and (-7.69%, 8.83%) for NCC-based registrations. Linear mixed-effects models demonstrated that error in measuring volume change increased with increase in tumor volume and decreased with the increase in the tumor's normalized mutual information, even when NCC was the similarity measure being optimized during registration. The 95% confidence interval of the relative volume change error for the synthetic examinations with known changes over {+-}80% of reference tumor volume was (-3.02% to 3.86%). Statistically significant bias was not demonstrated. Conclusion: A low-noise, low-bias tumor volume change measurement algorithm using nonlinear registration is described. Errors in change measurement were a function of tumor volume and the normalized mutual information content of the tumor.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

POPULATION EFFECTS ON THE METALLICITY DISTRIBUTION FUNCTION DERIVED FROM THE RED GIANT BRANCH

We have tested the reliability of the red giant branch (RGB) as a metallicity indicator accounting for observational errors as well as the complexity of star formation histories and chemical evolution histories observed in various stellar systems. We generate model color–magnitude diagrams (CMDs) produced with a variety of evolutionary histories and compare the resultant metallicity estimates from the colors and magnitudes of RGB stars to the true input metallicities. We include realistic models for photometric errors and completeness in our synthetic CMDs. As expected, for simple simple stellar populations dominated by old stars, the RGB provides a very accurate estimate of the modular metallicity value for a population. An error in the age of a system targeted for this type of study may produce metallicity errors of a few tenths of a dex. The size of this metallicity error depends linearly on the age error, and we find this dependence to be stronger with more precise photometry. If the population has experienced any significant star formation within the last ∼6 Gyr, the metallicity estimates, [M/H], derived from the RGB may be in error by up to ∼0.5 dex. Perhaps the most important consideration for this technique is an accurate, independent estimate of the average age for the target stellar system, especially if it is probable that a significant fraction of the population formed less than ∼6 Gyr ago.

79 ASTRONOMY AND ASTROPHYSICS↗

Spatially resolved X-ray emission measurements of the residual velocity during the stagnation phase of inertial confinement fusion implosion experiments

A technique for measuring residual motion during the stagnation phase of an indirectly driven inertial confinement experiment has been implemented. This method infers a velocity from spatially and temporally resolved images of the X-ray emission from two orthogonal lines of sight. This work investigates the accuracy of recovering spatially resolved velocities from the X-ray emission data. A detailed analytical and numerical modeling of the X-ray emission measurement shows that the accuracy of this method increases as the displacement that results from a residual velocity increase. For the typical experimental configuration, signal-to-noise ratios, and duration of X-ray emission, it is estimated that the fractional error in the inferred velocity rises above 50% as the velocity of emission falls below 24 μm/ns. By inputting measured parameters into this model, error estimates of the residual velocity as inferred from the X-ray emission measurements are now able to be generated for experimental data. Details of this analysis are presented for an implosion experiment conducted with an unintentional radiation flux asymmetry. The analysis shows a bright localized region of emission that moves through the larger emitting volume at a relatively higher velocity towards the location of the imposed flux deficit. This technique allows for the possibility of spatially resolving velocity flows within the so-called central hot spot of an implosion. This information would help to refine our interpretation of the thermal temperature inferred from the neutron time of flight detectors and the effect of localized hydrodynamic instabilities during the stagnation phase. Across several experiments, along a single line of sight, the average difference in magnitude and direction of the measured residual velocity as inferred from the X-ray and neutron time of flight detectors was found to be ∼13 μm/ns and ∼14°, respectively.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Optical galaxy cluster detection across a wide redshift range

The past decade is one of the most exciting period in the history of physics and astronomy. The discovery of cosmic acceleration dramatically changed our understanding about the evolution and constituents of the Universe. To accommodate the new acceleration phase into our well established Big Bang cosmological scenario under the frame work of General Relativity, there must exist a very special substance that has negative pressure and make up about 73% of the total energy density in our Universe. It is called Dark Energy. For the first time people realized that the vast majority of our Universe is made of things that are totally different from the things we are made of. Therefore, one of the major endeavors in physics and astronomy in the coming years is trying to understand, if we can, the nature of dark energy. Understanding dark energy cannot be achieved from pure logic. We need empirical evidence to finally determine about what is dark energy. The better we can constrain the energy density and evolution of the dark energy, the closer we will get to the answer. There are many ways to constrain the energy density and evolution of dark energy, each of which leads to degeneracy in certain directions in the parameter space. Therefore, a combination of complimentary methods will help to reduce the degeneracies and give tighter constraints. Dark energy became dominate over matter in the Universe only very recently (at about z ~ 1.5) and will affect both the cosmological geometry and large scale structure formation. Among the various experiments, some of them constrain the dark energy mainly via geometry (such as CMB, Supernovae) while some others provides constraints from both structures and geometry (such as BAO, Galaxy Clusters) Galaxy clusters can be used as a sensitive probe for cosmology. A large cluster catalog that extends to high redshift with well measured masses is indispensable for precisely constraining cosmological parameters. Detecting clusters in optical bands is very efficient. Multi-color CCD photometry allows combined detection and redshift estimation for clusters across broad redshift ranges. However, the lack of precise information about galaxy positions along the line of sight leads to contamination by projection, which plagues both cluster detection and the measurement of their properties. The dominance of red sequence galaxies, tightly clustered along the E/S0 ridgeline, provides a powerful method for de-projecting field galaxies. We developed an Error Corrected Gaussian Mixture Model to fit the galaxies color distribution around clusters by taking into account the measurement errors. By this technique, we can detect the red sequence color clustering and extract unbiased information about the evolution of the red sequence ridgeline and its width. Precision measurements of ridgelines yields better estimates of cluster richness and possibly their dynamical state, leading to better estimates of cluster mass. By using the red sequence clustering in color space identified from the Error Corrected Gaussian Mixture Model, together with the projected NFW filter in the projected RA/DEC plane, we developed a new and efficient cluster finding algorithm that can reliably detect galaxy clusters across the redshift range from 0.1 to 1.4. We have also run the cluster finder on legacy SDSS DR7 data and assembled an approximately volume limited cluster catalog across redshifts from 0.1 to 0.5. The algorithm has been tested against a Monte Carlo mock catalog, showing the identified clusters are highly complete and pure. With the completion of this thesis, we build the first and essential step towards precision cluster cosmology. Meanwhile, the large optical cluster catalog across a wide redshift range makes possible the systematic and detailed investigation of cluster formation and evolution.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Challenge Problem 1: Preliminary Model Development and Assessment of Flexible Heat Transfer Modeling Approaches

This report presents the modeling progress of a university consortium studying flexible modeling for turbulent heat transfer. In the context of advanced nuclear reactor design, where challenges include non-unity Prandtl fluids, free and mixed convection, and transitional flow, computational fluid dynamics methods are underutilized due to low confidence in modeling approaches and high computational cost. This report evaluates the performance of engineering CFD models in diabatic, buoyant turbulent flow. It finds that all turbulence models including several variants of the k-ε and k-ω models struggle to predict accurate turbulent momentum and heat transfer in such flows. The Nusselt numbers have been compared between the models and the DNS data, where calculations have been performed for each case and trends have shown a good agreement between DNS estimated Nusselt numbers and available correlations as well as experimental data. A novel DNS correlation for high Pr cases as they are transitioning from mixed convection to natural convection has been proposed. While Nusselt number errors relative to DNS range from 20% to 50%, the models capture similar trends to DNS with respect to Nusselt suppression and amplification under varying levels of buoyancy effect. This report also highlights model form error as a significant contributor to CFD predictions and proposes a framework for quantifying model error and improving confidence in CFD calculations. To improve the predictive capability of engineering CFD models, data-driven approaches for turbulence models are investigated. Theoretical frameworks based on the invariant tensor / vector basis neural networks for prediction of Reynolds stresses and turbulent heat fluxes are employed. The models are developed using direct numerical simulations data for forced convection flows of different fluids in vertical planar channel domain. The framework is implemented in spectral element solvers Nek5000 / nekRS and has shown a potential for future development and consideration of mixed convection flows.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Hydrodynamic Modeling Analysis of Tidal Wetland Restoration in Snohomish River, Washington

To re-establish the intertidal wetlands with full tidal interaction and improve salmonid rearing habitat in the Lower Snohomish River estuary, a diked wetland along Union Slough of the Snohomish River was restored by breaching the existing dike and constructing bridges across the breaches. However, post-restoration monitoring indicated that the restored project site could not drain as efficiently as desired. To improve the drainage conditions at the restoration site during low tides, a modeling study was conducted to evaluate additional restoration scenarios and to provide recommendations for finish-grade ground elevations to achieve the desired drainage. To accurately simulate the drainage of the project site, an unstructured-grid hydrodynamic model with fine-grid resolution down to a few meters was used in this study. The model was first validated with observed water level data collected in the project site and then applied to assess the feasibility of different proposed restoration scenarios. A spatial varying bottom roughness option in the model is also implemented to better represent the high roughness due to the presence of dense vegetation in the project site. The methodology, error statistics of model validation and uncertainty of the modeling analysis are presented and discussed.

Yang, Zhaoqing↗

Systematic study of the uncertainties in fitting the cosmic positron data by AMS-02

The operation of AMS-02 opens a new era for the study of cosmic ray physics with unprecedentedly precise data which are comparable with the laboratory measurements. The high precision data allow a quantitative study on the cosmic ray physics and give strict constraints on the nature of cosmic ray sources. However, the intrinsic errors from the theoretical models to interpret the data become dominant over the errors in the data. In the present work we try to give a systematic study on the uncertainties of the models to explain the AMS-02 positron fraction data, which shows the cosmic ray e{sup +}e{sup −} excesses together with the PAMELA and Fermi-LAT measurements. The excesses can be attributed to contributions from the extra e{sup +}e{sup −} sources, such as pulsars or the dark matter annihilation. The possible systematic uncertainties of the theoretical models considered include the cosmic ray propagation, the treatment of the low energy data, the solar modulation, the pp interaction models, the nuclei injection spectrum and so on. We find that in general a spectral hardening of the primary electron injection spectrum above ∼50–100 GeV is favored by the data. Furthermore, the present model uncertainties may lead to a factor of ∼2 enlargement in the determination of the parameter regions of the extra source, such as the dark matter mass, annihilation rate and so on.

79 ASTRONOMY AND ASTROPHYSICS↗