Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Multigroup Thermal Radiation Transport with Tensor Trains

We investigate the application of tensor-train (TT) algorithms to multigroup thermal radiation transport (i.e., photon radiation transport). The TT framework enables simulations at discretizations that might otherwise be computationally infeasible on conventional hardware. We show that solutions to certain multigroup problems possess an intrinsic low-rank structure, which the TT representation leverages effectively. This enables us to solve problems where the discretized solution size exceeds a trillion parameters on a single node. The solver is evaluated on a range of test problems with varying levels of complexity, consistently achieving compression factors greater than 100× and speedups exceeding 2×. We also investigate alternative TT topologies by analyzing the low-rank structure of the merged spatio-spectral core to assess the potential for greater compression. This analysis suggests that compression gains could increase by factors as large as 7. Our results indicate that the low-rank structure of the merged spatio-spectral core captures the spatio-spectral complexity of the solution, largely driven by the opacity structure of the medium. Beyond identifying opportunities for improved compression, this analysis highlights the types of errors that may arise in angle-integrated quantities when exploiting this low-rank structure.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian calibration of terrestrial ecosystem models: a study of advanced Markov chain Monte Carlo methods

Calibration of terrestrial ecosystem models is important but challenging. Bayesian inference implemented by Markov chain Monte Carlo (MCMC) sampling provides a comprehensive framework to estimate model parameters and associated uncertainties using their posterior distributions. The effectiveness and efficiency of the method strongly depend on the MCMC algorithm used. In this work, a differential evolution adaptive Metropolis (DREAM) algorithm is used to estimate posterior distributions of 21 parameters for the data assimilation linked ecosystem carbon (DALEC) model using 14 years of daily net ecosystem exchange data collected at the Harvard Forest Environmental Measurement Site eddy-flux tower. The calibration of DREAM results in a better model fit and predictive performance compared to the popular adaptive Metropolis (AM) scheme. Moreover, DREAM indicates that two parameters controlling autumn phenology have multiple modes in their posterior distributions while AM only identifies one mode. The application suggests that DREAM is very suitable to calibrate complex terrestrial ecosystem models, where the uncertain parameter size is usually large and existence of local optima is always a concern. In addition, this effort justifies the assumptions of the error model used in Bayesian calibration according to the residual analysis. Here, the result indicates that a heteroscedastic, correlated, Gaussian error model is appropriate for the problem, and the consequent constructed likelihood function can alleviate the underestimation of parameter uncertainty that is usually caused by using uncorrelated error models.

54 ENVIRONMENTAL SCIENCES↗

Solid phase sampling device and methods for point-source sampling of polar organic analytes

Sampling devices for sampling an aqueous source (e.g., field testing of ground water) for multiple different analytes are described. Devices include a solid phase extraction component for retention of a wide variety of targeted analytes. Devices include analyte derivatization capability for improved extraction of targeted analytes. Thus, a single device can be utilized to examine a sample source for a wide variety of analytes. Devices also include an isotope dilution capability that can prevent error introduction to the sample analysis and can correct for sample loss and degradation from the point of sampling until analysis as well as correction for incomplete or poor derivatization reactions. The devices can be field-deployable and rechargeable.

Boggess, Andrew J.↗

Solid-phase sampling device and methods for point-source sampling of polar organic analytes

Sampling devices for sampling an aqueous source (e.g., field testing of ground water) for multiple different analytes are described. Devices include a solid phase extraction component for retention of a wide variety of targeted analytes. Devices include analyte derivatization capability for improved extraction of targeted analytes. Thus, a single device can be utilized to examine a sample source for a wide variety of analytes. Devices also include an isotope dilution capability that can prevent error introduction to the sample analysis and can correct for sample loss and degradation from the point of sampling until analysis as well as correction for incomplete or poor derivatization reactions. The devices can be field-deployable and rechargeable.

Boggess, Andrew J.↗

Regularized Differentiation for Bioburden Density Estimation in Planetary Protection

In this paper, we propose and investigate the performance of two novel shrinkage estimators for bioburden density estimation in planetary protection. The estimators are based on the regularized differentiation of a cumulative count of colony forming units collected throughout the data collecting session or the life cycle of the entire mission. The regularized differentiation recasts the problem of bioburden density estimation as a linear least squares problem. The least squares problem is then solved through regularization techniques, such as truncated singular value decomposition and penalized least squares. The regularization is necessary to avoid noise amplification during the differentiation of noisy data. The two regularization estimators are compared with four other commonly used estimators to simultaneously evaluate the means of multivariable independent Poisson distributions: the maximum likelihood, noninformative Bayes estimator with Jeffreys prior, Empirical Bayes using conjugate gamma-Poisson model with gamma parameters selected by method of moments, and the Clevenson-Zidek estimator. It is shown through computer-simulated data that the regularized differentiation based on ridge regression has the smallest mean-squared error among all estimators. The analysis of shrinkage mechanism implemented by regularized differentiation is performed, and it is shown that the regularized differentiation amounts to performing a weighted averaging of all the samples. The weights are determined by the regularization parameter automatically selected by the L-curve technique. Since the method of least squares makes no distributional assumptions about the data, it presents an attractive technique for bioburden density estimation when there are concerns about the misspecification of the distributional model. The paper concludes with the analysis of the bioburden data collected during InSight mission and directions for future work.

97 - MATHEMATICS AND COMPUTING↗

An Analysis of Grid Operator Survey Responses: Inexperience, Workload and Fatigue in the Control Room

Although a wide array of tools and technologies have been developed over the last decade to support power grid operators, deployment of these tools has been less successful. One reason for unsuccessful deployment may be an inadequate understanding of the factors that contribute to operator error in the control room. An analysis of operators’ current vulnerabilities may provide the baseline understanding needed to inform new technology integration. In an attempt to learn more about these vulnerabilities and their perceived impact on human error we collected and analyzed survey data from 20 electric grid control room operators. We asked survey respondents to consider the various operator, technology and interaction vulnerabilities that may arise during work in the control room and record their attitudes and experiences toward each. Results suggest operator inexperience, high mental workload and fatigue are the most common vulnerabilities experienced during a shift. Survey results were analyzed to explore these vulnerabilities in greater depth.

Inexperience, Workload, Fatigue↗

Machine learning predictions of high-Curie-temperature materials

Technologies that function at room temperature often require magnets with a high Curie temperature, $T$ C , and can be improved with better materials. Discovering magnetic materials with a substantial $T$ C is challenging because of the large number of candidates and the cost of fabricating and testing them. Using the two largest known datasets of experimental Curie temperatures, we develop machine-learning models to make rapid $T$ C predictions solely based on the chemical composition of a material. We train a random-forest model and a k -NN one and predict on an initial dataset of over 2500 materials and then validate the model on a new dataset containing over 3000 entries. The accuracy is compared for multiple compounds' representations (“descriptors”) and regression approaches. A random-forest model provides the most accurate predictions and is not improved by dimensionality reduction or by using more complex descriptors based on atomic properties. Further, a random-forest model trained on a combination of both datasets shows that cobalt-rich and iron-rich materials have the highest Curie temperatures for all binary and ternary compounds. An analysis of the model reveals systematic error that causes the model to over-predict low-$T$ C materials and under-predict high-$T$ C materials. For exhaustive searches to find new high-$T$ C materials, analysis of the learning rate suggests either that much more data is needed or that more efficient descriptors are necessary.

36 MATERIALS SCIENCE↗

Interlaboratory Study of Digital Volume Correlation Error Due to X-Ray Computed Tomography Equipment and Scan Parameters: an Update from the DVC Challenge

Background: The quality of Digital Volume Correlation (DVC) full-field displacement measurements depends directly on the characteristics of the X-ray Computed Tomography (XCT) equipment, and scan procedures used to acquire the tomographic images. Objective: In this work, we seek to experimentally study the effects of XCT equipment and tomographic scan procedures on the quality of these images for DVC analysis, and to survey the level of DVC error that may be achieved using standard XCT operating procedures. Methods: Six participants in an interlaboratory study acquired high-quality XCT scans of a syntactic foam before and after rigid body motion. The resulting images were correlated using commercial DVC software to quantify error sources due to random image noise, reconstruction artifacts, as well as systematic spatial or temporal distortion. Results: In the absence of rigid body motion, the standard deviation of the displacement measurements ranged from 0.012 to 0.043 voxels using a moderate subvolume size, indicating that subvoxel measurement resolution could readily be achieved with a variety of XCT equipment and scan recipes. Comparison of consecutive scans without rigid body motion showed transient dilatational displacement gradients due to self-heating of the X-ray source and/or thermal expansion of the foam. Evaluation of the scans after rigid body motion showed significant, machine-specific spatial distortion in the displacement fields of up to 0.5 voxels; new approaches to remove this error need to be developed. Conclusions: Analysis of the scan protocols used in the interlaboratory study, as well as a complementary parametric sensitivity study, showed that the DVC error was strongly influenced by the XCT equipment, but could be mitigated by adjusting the total scan duration.

47 OTHER INSTRUMENTATION↗

Validation of mathematical models for the prediction of organs-at-risk dosimetric metrics in high-dose-rate gynecologic interstitial brachytherapy

Purpose: Given the complicated nature of an interstitial gynecologic brachytherapy treatment plan, the use of a quantitative tool to evaluate the quality of the achieved metrics compared to clinical practice would be advantageous. For this purpose, predictive mathematical models to predict the D{sub 2cc} of rectum and bladder in interstitial gynecologic brachytherapy are discussed and validated.Methods: Previous plans were used to establish the relationship between D2cc and the overlapping volume of the organ at risk with the targeted area (C0) or a 1-cm expansion of the target area (C1). Three mathematical models were evaluated: D{sub 2cc}=α*C{sub 1}+β (LIN); D{sub 2cc}=α– exp(–β*C{sub 0}) (EXP); and a mixed approach (MIX), where both C{sub 0} and C{sub 1} were inputs of the model. The parameters of the models were optimized on a training set of patient data, and the predictive error of each model (predicted D{sub 2cc}− real D{sub 2cc}) was calculated on a validation set of patient data. The data of 20 patients were used to perform a K-fold cross validation analysis, with K = 2, 4, 6, 8, 10, and 20.Results: MIX was associated with the smallest mean prediction error <6.4% for an 18-patient training set; LIN had an error <8.5%; EXP had an error <8.3%. Best case scenario analysis shows that an error ≤5% can be achieved for a ten-patient training set with MIX, an error ≤7.4% for LIN, and an error ≤6.9% for EXP. The error decreases with the increase in training set size, with the most marked decrease observed for MIX.Conclusions: The MIX model can predict the D{sub 2cc} of the organs at risk with an error lower than 5% with a training set of ten patients or greater. The model can be used in the development of quality assurance tools to identify treatment plans with suboptimal sparing of the organs at risk. It can also be used to improve preplanning and in the development of real-time intraoperative planning tools.

61 RADIATION PROTECTION AND DOSIMETRY↗

Suppression of vapor cell temperature error for spin-exchange-relaxation-free magnetometer

This paper presents a method to reduce the vapor cell temperature error of the spin-exchange-relaxation-free (SERF) magnetometer. The fluctuation of cell temperature can induce variations of the optical rotation angle, resulting in a scale factor error of the SERF magnetometer. In order to suppress this error, we employ the variation of the probe beam absorption to offset the variation of the optical rotation angle. The theoretical discussion of our method indicates that the scale factor error introduced by the fluctuation of the cell temperature could be suppressed by setting the optical depth close to one. In our experiment, we adjust the probe frequency to obtain various optical depths and then measure the variation of scale factor with respect to the corresponding cell temperature changes. Our experimental results show a good agreement with our theoretical analysis. Under our experimental condition, the error has been reduced significantly compared with those when the probe wavelength is adjusted to maximize the probe signal. The cost of this method is the reduction of the scale factor of the magnetometer. However, according to our analysis, it only has minor effect on the sensitivity under proper operating parameters.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Precision and Accuracy in PDV and VISAR

This is a technical report discussing our current level of understanding of a wide and varying distribution of uncertainties in velocity results from Photonic Doppler Velocimetry in its application to gas gun experiments. Using propagation of errors methods with statistical averaging of photon number fluctuation in the detected photocurrent and subsequent addition of electronic recording noise, we learn that the velocity uncertainty in VISAR can be written in closed form. For PDV, the non-linear frequency transform and peak fitting methods employed make propagation of errors estimates notoriously more difficult to write down in closed form expect in the limit of constant velocity and low time resolution (large analysis-window width). An alternative method of error propagation in PDV is to use Monte Carlo methods with a simulation of the time domain signal based on results from the spectral domain. A key problem for Monte Carlo estimation for an experiment is a correct estimate of that portion of the time-domain noise associated with the peak-fitting region-of-interesting in the spectral domain. Using short-time Fourier transformation spectral analysis and working with the phase dependent real and imaginary parts allows removal of amplitude-noise cross terms that invariably show up when working with correlation-based methods or FFT power spectra. Estimation of the noise associated with a given spectral region of interest is then possible. At this level of progress, we learn that Monte Carlo trials with random recording noise and initial (uncontrolled) phase yields velocity uncertainties that are not as large as those observed. In a search for additional noise sources, a speckleinterference modulation contribution with off axis rays was investigated, and was found to add a velocity variation beyond that from the recording noise (due to random interference between off axis rays), but in our experiments the speckle modulation precision was not as important as the recording noise precision. But from these investigations we do appreciate that the velocity-uncertainty itself has a wide distribution of values that varies with signal-amplitude modulation (is not a single value). To provide a rough rule of thumb for the velocity uncertainty, we computed the average of the relative standard deviation distributions from 60 recorded traces (with distributions of uncertainties roughly between 0.1 % to 1 % in each trace) and found a mean of the distribution of uncertainties for our experiments is not better than 0.4 % at an analysis window width of 5 ns (although for brief intervals it can be as good as 0.1 %). Further imagination and testing may be needed to reveal other possible hydrodynamics-related sources of velocity error in PDV.

47 OTHER INSTRUMENTATION↗

Large Ensemble Diagnostic Evaluation of Hydrologic Parameter Uncertainty in the Community Land Model Version 5 (CLM5)

Abstract Land surface models such as the Community Land Model version 5 (CLM5) seek to enhance understanding of terrestrial hydrology and aid in the evaluation of anthropogenic and climate change impacts. However, the effects of parametric uncertainty on CLM5 hydrologic predictions across regions, timescales, and flow regimes have yet to be explored in detail. The common use of the default hydrologic model parameters in CLM5 risks generating streamflow predictions that may lead to incorrect inferences for important dynamics and/or extremes. In this study, we benchmark CLM5 streamflow predictions relative to the commonly employed default hydrologic parameters for 464 headwater basins over the conterminous United States (CONUS). We evaluate baseline CLM5 default parameter performance relative to a large (1,307) Latin Hypercube Sampling‐based diagnostic comparison of streamflow prediction skill using over 20 error measures. We provide a global sensitivity analysis that clarifies the significant spatial variations in parametric controls for CLM5 streamflow predictions across regions, temporal scales, and error metrics of interest. The baseline CLM5 shows relatively moderate to poor streamflow prediction skill in several CONUS regions, especially the arid Southwest and Central U.S. Hydrologic parameter uncertainty strongly affects CLM5 streamflow predictions, but its impacts vary in complex ways across U.S. regions, timescales, and flow regimes. Overall, CLM5's surface runoff and soil water parameters have the largest effects on simulated high flows, while canopy water and evaporation parameters have the most significant effects on the water balance.

54 ENVIRONMENTAL SCIENCES↗

Probabilistic Error Bounds for Low-Rank Tensor Decompositions Used in Large-Scale Data Analysis Applications (LDRD Final Report)

This report documents a research project on analyzing low-rank tensor models for data analysis that took place at Sandia National Laboratories from October 2023–September 2025. The focus of this work was to extend theoretical frameworks from statistics and probability theory for use with models for scalar, vector, and matrix data to models with tensor, or general multi-dimensional array, data. Through this work, we have provided a new set of tools for bounding errors on low-rank tensor models of both complete and sampled data. The remainder of this report is organized as follows. In Section 1, we describe the proposed work at the start of the project. Section 2 describes the research advances made as part of the project. Other research contributions in the form of conference presentations and software development is provided in Section 3. Workforce development at Sandia and Florida Atlantic University (via a subcontract on this project) is provided in Section 4.

97 MATHEMATICS AND COMPUTING↗

InSAR Time Series Analysis of L-Band Wide-Swath SAR Data Acquired by ALOS-2

We present that operating at L-band (24 cm wavelength) in wide-swath modes is one of the characteristics of the new and next generation satellite synthetic aperture radar (SAR) missions. After 3 years of operation, the Japan Aerospace Exploration Agency Advanced Land Observing Satellite-2 (ALOS-2) satellite has acquired a wealth of L-band wide-swath SAR data over many areas using its ScanSAR mode. We present interferometry SAR (InSAR) time series analysis results from ALOS-2 ScanSAR data. We analyze the possible error sources in the InSAR and correct them if possible. We present different time series analysis results including azimuth frequency modulation rate error, line of sight (LOS) ionospheric phase, azimuth shift caused by the ionosphere, and LOS displacement processed using both full-aperture and burst-by -burst workflows. The final InSAR LOS displacement time series result reveals both large-scale tectonic and small-scale anthropogenic deformation components. In conclusion, the results demonstrate the potential for measuring continental or even global-scale tectonic deformation and illustrate the promise of upcoming L-band wide-swath SAR missions, such as the NASA-ISRO SAR mission.

47 OTHER INSTRUMENTATION↗

System Advisor Model: Flat Plate Photovoltaic Performance Modeling Validation Report

The System Advisor Model (SAM) is a free software tool that performs detailed analysis of both system performance and system financing for a variety of renewable energy technologies. This report provides detailed validation of the SAM flat plate photovoltaic performance model by comparing SAM-modeled PV system generation data to actual measured production data for nine PV systems ranging from 75 kW to greater than 25 MW in size. The results show strong agreement between SAM predictions and field data, with annualized prediction error below 3% for all fixed tilt cases and below 8% for all one axis tracked cases. The analysis concludes that snow cover and system outages are the primary sources of disagreement, and other deviations resulting from seasonal biases in the irradiation models and one axis tracking issues are discussed in detail.

14 SOLAR ENERGY↗

Kinetic isotope effects significantly influence intracellular metabolite 13 C labeling patterns and flux determination

Rigorous mathematical modeling of carbon-labeling experiments allows estimation of fluxes through the pathways of central carbon metabolism, yielding powerful information for basic scientific studies as well as for a wide range of applications. However, the mathematical models that have been developed for flux determination from 13 C labeling data have commonly neglected the influence of kinetic isotope effects on the distribution of 13 C label in intracellular metabolites, as these effects have often been assumed to be inconsequential. We have used measurements of the 13 C isotope effects on the pyruvate dehydrogenase enzyme from the literature to model isotopic fractionation at the pyruvate node and quantify the modeling errors expected to result from the assumption that isotope effects are negligible. We show that under some conditions kinetic isotope effects have a significant impact on the 13 C labeling patterns of intracellular metabolites, and the errors associated with neglecting isotope effects in 13 C-metabolic flux analysis models can be comparable in size to measurement errors associated with GC–MS. Thus, kinetic isotope effects must be considered in any rigorous assessment of errors in 13 C labeling data, goodness-of-fit between model and data, confidence intervals of estimated metabolic fluxes, and statistical significance of differences between estimated metabolic flux distributions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluation of image guided motion management methods in lung cancer radiotherapy

Purpose: To evaluate the accuracy and reliability of three target localization methods for image guided motion management in lung cancer radiotherapy. Methods: Three online image localization methods, including (1) 2D method based on 2D cone beam (CB) projection images, (2) 3D method using 3D cone beam CT (CBCT) imaging, and (3) 4D method using 4D CBCT imaging, have been evaluated using a moving phantom controlled by (a) 1D theoretical breathing motion curves and (b) 3D target motion patterns obtained from daily treatment of 3 lung cancer patients. While all methods are able to provide target mean position (MP), the 2D and 4D methods can also provide target motion standard deviation (SD) and excursion (EX). For each method, the detected MP/SD/EX values are compared to the analytically calculated actual values to calculate the errors. The MP errors are compared among three methods and the SD/EX errors are compared between the 2D and 4D methods. In the theoretical motion study (a), the dependency of MP/SD/EX error on EX is investigated with EX varying from 2.0 cm to 3.0 cm with an increment step of 0.2 cm. In the patient motion study (b), the dependency of MP error on target sizes (2.0 cm and 3.0 cm), motion patterns (four motions per patient) and EX variations is investigated using multivariant linear regression analysis. Results: In the theoretical motion study (a), the MP detection errors are −0.2 ± 0.2, −1.5 ± 1.1, and −0.2 ± 0.2 mm for 2D, 3D, and 4D methods, respectively. Both the 2D and 4D methods could accurately detect motion pattern EX (error < 1.2 mm) and SD (error < 1.0 mm). In the patient motion study (b), MP detection error vector (mm) with the 2D method (0.7 ± 0.4) is found to be significantly less than with the 3D method (1.7 ± 0.8,p < 0.001) and the 4D method (1.4 ± 1.0, p < 0.001) using paired t-test. However, no significant difference is found between the 4D method and the 3D method. Based on multivariant linear regression analysis, the variances of MP error in SI direction explained by target sizes, motion patterns, and EX variations are 9% with the 2D method, 74.4% with the 3D method, and 27% with the 4D method. The EX/SD detection errors are both < 1.0 mm for the 2D method and < 2.0 mm for the 4D method. Conclusions: The 2D method provides the most accurate MP detection regardless of the motion pattern variations, while its performance is limited by the accuracy of target identification in the projection images. The 3D method causes the largest error in MP determination, and its accuracy significantly depends on target sizes, motion patterns, and EX variations. The 4D method provides moderate MP detection results, while its accuracy relies on a regular motion pattern. In addition, the 2D and 4D methods both provide accurate measurement of the motion SD/EX, providing extra information for motion management.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Automated Voxel-Based Analysis of Volumetric Dynamic Contrast-Enhanced CT Data Improves Measurement of Serial Changes in Tumor Vascular Biomarkers

Objectives: Development of perfusion imaging as a biomarker requires more robust methodologies for quantification of tumor physiology that allow assessment of volumetric tumor heterogeneity over time. This study proposes a parametric method for automatically analyzing perfused tissue from volumetric dynamic contrast-enhanced (DCE) computed tomography (CT) scans and assesses whether this 4-dimensional (4D) DCE approach is more robust and accurate than conventional, region-of-interest (ROI)-based CT methods in quantifying tumor perfusion with preliminary evaluation in metastatic brain cancer. Methods and Materials: Functional parameter reproducibility and analysis of sensitivity to imaging resolution and arterial input function were evaluated in image sets acquired from a 320-slice CT with a controlled flow phantom and patients with brain metastases, whose treatments were planned for stereotactic radiation surgery and who consented to a research ethics board-approved prospective imaging biomarker study. A voxel-based temporal dynamic analysis (TDA) methodology was used at baseline, at day 7, and at day 20 after treatment. The ability to detect changes in kinetic parameter maps in clinical data sets was investigated for both 4D TDA and conventional 2D ROI-based analysis methods. Results: A total of 7 brain metastases in 3 patients were evaluated over the 3 time points. The 4D TDA method showed improved spatial efficacy and accuracy of perfusion parameters compared to ROI-based DCE analysis (P<.005), with a reproducibility error of less than 2% when tested with DCE phantom data. Clinically, changes in transfer constant from the blood plasma into the extracellular extravascular space (K{sub trans}) were seen when using TDA, with substantially smaller errors than the 2D method on both day 7 post radiation surgery (±13%; P<.05) and by day 20 (±12%; P<.04). Standard methods showed a decrease in K{sub trans} but with large uncertainty (111.6 ± 150.5) %. Conclusions: Parametric voxel-based analysis of 4D DCE CT data resulted in greater accuracy and reliability in measuring changes in perfusion CT-based kinetic metrics, which have the potential to be used as biomarkers in patients with metastatic brain cancer.

62 RADIOLOGY AND NUCLEAR MEDICINE↗