Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Quarter 4 Report: Report on Final Findings and Opportunities for Future Work in the Use of Mixed Precision in Iterative Solvers

The fourth quarter of the project was spent developing an error analysis of the s-step Lanczos and CG algorithms. Our theoretical bounds and numerical experiments show that the numerical behavior of the algorithm can be significantly improved by using extra precision in a small part of the computation related to the computation and application of the Gram matrix. We have published a technical report which includes all steps of the analysis [8]; a shortened version for journal submission is in preparation. We plan to submit this paper in the following weeks. Activities related to this also include a collaboration with Ichitaro Yamazaki on gathering performance results for these new mixed precision s-step Krylov subspace methods using single/double precision on GPUs. Namely, we would like to obtain performance results that show that the performance overhead of using double the working precision in these select computations is minimal. Other activities include attending biweekly xSDK meetings and presenting a pitch talk on this work to the group on February 25, 2021. In the remainder of the document, we summarize our findings on the potential for mixed precision in classical Krylov subspace methods and s-step Krylov subspace methods, as well as key opportunities for future work.

97 MATHEMATICS AND COMPUTING↗

ASCEND: Asymptotically compatible strong form foundations for nonlocal discretization

Nonlocal models naturally handle a range of physics of interest to SNL, but discretization of their underlying integral operators poses mathematical challenges to realize the accuracy and robustness commonplace in discretization of local counterparts. This project focuses on the concept of asymptotic compatibility, namely preservation of the limit of the discrete nonlocal model to a corresponding well-understood local solution. We address challenges that have traditionally troubled nonlocal mechanics models primarily related to consistency guarantees and boundary conditions. For simple problems such as diffusion and linear elasticity we have developed complete error analysis theory providing consistency guarantees. We then take these foundational tools to develop new state-of-the-art capabilities for: lithiation-induced failure in batteries, ductile failure of problems driven by contact, blast-on-structure induced failure, brittle/ductile failure of thin structures. We also summarize ongoing efforts using these frameworks in data-driven modeling contexts. This report provides a high-level summary of all publications which followed from these efforts.

97 MATHEMATICS AND COMPUTING↗

GraphAlign: Graph-Enabled Machine Learning for Seismic Event Filtering

This report summarizes results from a 2 year effort to improve the current automated seismic event processing system by leveraging machine learning models that can operated over the inherent graph data structure of a seismic sensor network. Specifically, the GraphAlign project seeks to utilize prior information on which stations are more likely to detect signals originating from particular geographic regions to inform event filtering. To date, the GraphAlign team has developed a Graphical Neural Network (GNN) model to filter out false events generated by the Global Associator (GA) algorithm. The algorithm operates directly on waveform data that has been associated to an event by building a variable sized graph of station waveforms nodes with edge relations to an event location node. This builds off of previous work where random forest models were used to do the same task using hand crafted features. The GNN model performance was analyzed using an 8 week IMS/IDC dataset, and it was demonstrated that the GNN outperforms the random forest baseline. We provide additional error analysis of which events the GNN model performs well and poorly against concluded by future directions for improvements.

58 GEOSCIENCES↗

Doppler-Free Saturation Spectroscopy (DFSS) for Magnetic and Electric Field Measurements in an FRC plasma

The Cooperative Research and Development Agreement (CRADA) between Oak Ridge National Laboratory (ORNL) and TAE Technologies (TAE) focused on a feasibility study of Doppler-free saturation spectroscopy (DFSS) as a diagnostic strategy to measure the internal magnetic and electric fields of TAE’s C-2W field-reversed configuration (FRC) fusion device. Non-perturbative measurements of magnetic and electric fields in the core of FRCs can provide critical information needed to constrain equilibrium models and for the continued advancement of the fusion research program at TAE. DFSS is a well-established, laser-based absorption spectroscopy technique used to suppress inhomogeneous (Doppler) broadening linewidths and reveal Zeeman/Stark split hyperfine structures of target emission lines. The collaboration involved the use of ORNL’s suite of experimentally validated quantum mechanical modelling codes to simulate theoretical atomic spectra for a variety of machine parameters and laser beam configurations. TAE’s expertise was heavily used to provide measurements/models of the required machine parameters needed as inputs to the simulations. Results of an all-encompassing error analysis demonstrate the favourable capabilities of the diagnostic and provided invaluable insights as to how DFSS can be best used to accurately measure internal B/E-fields in C-2W.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Commissioning of SRF Cavity Analyzer System

Research and development in Superconducting Radio Frequency (SRF) cavities manufacturing, surface treatment, preparation, and doping techniques for the improvement of cavities performance necessitate reliable cavities’ intrinsic quality factor measurement with accurate and repeatable results. Fermilab Vertical Test Stand facility (VTS) performs ~270 cavities tests per year, including R&D cavities as well as production cavities at each step of their preparation for the placement in accelerator’s cryomodules. Current Fermilab VTS testing system is based on the scalar approach of power measurement, which neglects potential error factors of the RF networks with distributed parameters, hence the assessed measurement errors of such a system might be slightly underestimated. Alternative approach, utilizing a vector measurement (amplitude and phase) of RF signals in the setup with a cavity as a device under test, promises an enhanced accuracy and results traceability. New cavity an alyser system based on this approach (Vector VTS) was developed by D. Frolov et al. and currently undergoes a commissioning process. Basic underlying principles of the system will be presented with the methods of quality factor extraction from S-parameters measurement of multiport cavities and brief error analysis will be discussed. The system architecture will be shown with main components parameters and ensuing testing capabilities. Multiple tests results will be discussed with a cross-check comparison of the results obtained with a conventional testing method. System advantages such as automated calibration process and additional features as a built- in microphonics measurement capability will be presented.

Netepenko, A.↗

Fast Evaluation of Aircraft Icing Severity Using Machine Learning Based on XGBoost

Aircraft icing represents a serious hazard in aviation which has caused a number of fatal accidents over the years. In addition, it can lead to substantial increase in drag and weight, thus reducing the aerodynamics performance of the airplane. The process of ice accretion on a solid surface is a complex interaction of aerodynamic and environmental variables. The complex relationship makes machine learning-based methods an attractive alternative to traditional numerical simulation-based approaches. In this study, we introduce a purely data-driven approach to find the complex pattern between different flight conditions and aircraft icing severity prediction. The supervised learning algorithm Extreme Gradient Boosting (XGBoost) is applied to establish the prediction framework which makes prediction based on any set of observations. The input flight conditions for the proposed prediction framework are liquid water content, droplet diameter and exposure time. The proposed approach is demonstrated in three cases: maximum ice thickness prediction, icing area prediction and icing severity level evaluation. Performance comparison studies and error analysis are also conducted to verify the effectiveness and performance of the proposed method. Results show that the proposed method has reasonable capability in evaluating aircraft icing severity.

Li, Sibo (ORCID:000000021705844X)↗

Intercomparability of X CO$_2$ and X CH$_4$ from the United States TCCON sites

The Total Carbon Column Observing Network (TCCON) has become the standard for long-term column-averaged measurements of CO 2 and CH 4 . Here, we use a pair of portable spectrometers to test for intra-network bias among the four currently operating TCCON sites in the United States (US). A previous analytical error analysis has suggested that the maximum 2 σ site-to-site relative (absolute) bias of TCCON should be less than 0.2 % (0.8 ppm) in X CO 2 and 0.4 % (7 ppb) in X CH 4 . We find here experimentally that the 95 % confidence intervals for maximum pairwise site-to-site bias among the four US TCCON sites are 0.05–0.14 % for X CO 2 and 0.08–0.24 % for X CH 4 . This is close to the limit of the bias we can detect using this methodology.

Hedelius, Jacob K. (ORCID:0000000320257519)↗

Synthetic ozone deposition and stomatal uptake at flux tower sites

Abstract. We develop and evaluate a method to estimate O 3 deposition and stomatal O 3 uptake across networks of eddy covariance flux tower sites where O 3 concentrations and O 3 fluxes have not been measured. The method combines standard micrometeorological flux measurements, which constrain O 3 deposition velocity and stomatal conductance, with a gridded dataset of observed surface O 3 concentrations. Measurement errors are propagated through all calculations to quantify O 3 flux uncertainties. We evaluate the method at three sites with O 3 flux measurements: Harvard Forest, Blodgett Forest, and Hyytiälä Forest. The method reproduces 83 % or more of the variability in daily stomatal uptake at these sites with modest mean bias (21 % or less). At least 95 % of daily average values agree with measurements within a factor of 2 and, according to the error analysis, the residual differences from measured O 3 fluxes are consistent with the uncertainty in the underlying measurements. The product, called synthetic O 3 flux or SynFlux, includes 43 FLUXNET sites in the United States and 60 sites in Europe, totaling 926 site years of data. This dataset, which is now public, dramatically expands the number and types of sites where O 3 fluxes can be used for ecosystem impact studies and evaluation of air quality and climate models. Across these sites, the mean stomatal conductance and O 3 deposition velocity is 0.03–1.0 cm s -1 . The stomatal O 3 flux during the growing season (typically April–September) is 0.5–11.0 nmol O 3 m -2 s -1 with a mean of 4.5 nmol O 3 m -2 s -1 and the largest fluxes generally occur where stomatal conductance is high, rather than where O 3 concentrations are high. The conductance differences across sites can be explained by atmospheric humidity, soil moisture, vegetation type, irrigation, and land management. These stomatal fluxes suggest that ambient O 3 degrades biomass production and CO 2 sequestration by 20 %–24 % at crop sites, 6 %–29 % at deciduous broadleaf forests, and 4 %–20 % at evergreen needleleaf forests in the United States and Europe.

59 BASIC BIOLOGICAL SCIENCES↗

Estimating surface carbon fluxes based on a local ensemble transform Kalman filter with a short assimilation window and a long observation window: an observing system simulation experiment test in GEOS-Chem 10.1

We developed a carbon data assimilation system to estimate surface carbon fluxes using the local ensemble transform Kalman filter (LETKF) and atmospheric transport model GEOS-Chem driven by the MERRA-1 reanalysis of the meteorological field based on the Goddard Earth Observing System model,version 5 (GEOS-5). This assimilation system is inspired by the method of Kang et al. (2011, 2012), who estimated the surface carbon fluxes in an observing system simulation experiment (OSSE) as evolving parameters in the assimilation of the atmospheric CO 2 , using a short assimilation window of 6 h. They included the assimilation of the standard meteorological variables, so that the ensemble provided a measure of the uncertainty in the CO 2 transport. After proposing new techniques such as “variablelocalization”, and increased observation weights near the surface, they obtained accurate surface carbon fluxes at grid-point resolution. We developed a new version of the local ensemble transform Kalman filter related to the “running-in-place”(RIP) method used to accelerate the spin-up of ensemble Kalman filter (EnKF) data assimilation(Kalnay and Yang, 2010; Wang et al., 2013; Yang et al., 2012). Like RIP, the new assimilation system uses the “no cost smoothing” algorithm for the LETKF (Kalnay et al., 2007b), which allows shifting the Kalman filter solution forward or backward within an assimilation window at no cost. In the new scheme a long “observation window” (e.g., 7 d or longer) is used to design a LETKF ensemble at 7 d. Then, the RIP smoother is used to obtain an accurate final analysis at 1 d. This new approach has the advantage of being based on a short assimilation window, which makes it more accurate,and of having been exposed to the future 7 d observations, which improves the analysis and accelerates the spin-up. The assimilation and observation windows are then shifted forward by 1 d, and the process is repeated.This reduces significantly the analysis error, suggesting that the newly developed assimilation method can be used with other Earth system models,especially in order to make greater use of observations in conjunction with models.

58 GEOSCIENCES↗

A Dynamic Amplitude-Correcting Gradient Estimation Technique to Align X-ray Focusing Optics

High-brightness X-rays, as produced at synchrotrons and X-ray free electron laser (XFEL) facilities, are used to characterize materials in a variety of scientific experiments. In most cases, effective use of the high-energy light requires precisely-aligned focusing optics; one example being a compound refractive lens (CRL). To align a CRL, the position and rotation must be optimized along four axes. In practice, this is a labor-intensive, time-consuming manual process that can monopolize scarce experimental time at the necessary X-ray facilities. Models of the expected Xray transmission function suggest that this task can be automated; however, the temporally-varying intensity at X-ray free electron laser facilities preclude the direct use of standard implementations of optimization solvers such as steepest descent algorithms. In this paper, we propose a novel technique to estimate the gradient of noisy functions with temporally-varying amplitudes. We construct this dynamicamplitude correction by systematically sampling a fixed central location within the standard finite difference stencil, accounting for the observed changes in time, and normalizing the difference quotients against those fluctuations. In addition to a rigorous error analysis of the sampling technique, we demonstrate its efficacy in stochastic descent optimization methods. Further, we demonstrate how this approach may be implemented to optimize X-ray focusing optics at synchrotrons or XFEL facilities

97 MATHEMATICS AND COMPUTING↗

Design Space Exploration of Emerging Memory Technologies for Machine Learning Applications

Memory design space exploration methods study memory systems’ performances and limitations before implementation. The computer memory design space has grown exponentially because of the enormous growth of memory types, memory controllers, and application software. Computer simulators are commonly used for memory design space exploration. However, complex memory simulations take an enormous amount of time. Hence, in this paper, we proposed a machine learning-based design space exploration method for dynamic random-access memory and non-volatile memory systems. We applied our method to the CosmoGAN and LeNet applications to predict the following six memory response parameters: (i) bandwidth, (ii) power, (iii) average latency, (iv) average total latency, (v) memory reads, and (vi) memory writes. Our experimental results show that machine learning models can predict memory response parameter values faster than simulations. We used support vector machine, random forest, and gradient boosting machine learning models. We observed that the support vector machine provides better performance for bandwidth, average latency, and average total latency. The random forest model works better for memory reads and writes. The gradient boosting model provides superior prediction performance for power. We provide a detailed discussion on learning curve characteristics, error analysis, and memory type recommendation.

Hasan, S M Shamimul↗

SU-E-T-374: Sensitivity of ArcCHECK to Tomotherapy Delivery Errors: Dependence On Analysis Technique

Purpose: ArcCHECK (Sun Nuclear) is a cylindrical diode array detector allowing three-dimensional sampling of dose, particularly useful in treatment delivery QA of helical tomotherapy. Gamma passing rate is a common method of analyzing results from diode arrays, but is less intuitive in 3D with complex measured dose distributions. This study explores the sensitivity of gamma passing rate to choice of analysis technique in the context of its ability to detect errors introduced into the treatment delivery. Methods: Nine treatment plans were altered to introduce errors in: couch speed, gantry/sonogram synchronization, and leaf open time. Each plan was then delivered to ArcCHECK in each of the following arrangements: “offset,” when the high dose area of the plan is delivered to the side of the phantom so that some diode measurements will be on the order of the prescription dose, and “centered,” when the high dose is in the center of the phantom where an ion chamber measurement may be acquired, but the diode measurements are in the mid to low-dose region at the periphery of the plan. Gamma analysis was performed at 3%/3mm tolerance and both global and local gamma criteria. The threshold of detectability for each error type was calculated as the magnitude at which the gamma passing rate drops below 90%. Results: Global gamma criteria reduced the sensitivity in the offset arrangement (from 2.3% to 4.5%, 8° to 21°, and 3ms to 8ms for couch-speed decrease, gantry-error, and leaf-opening increase, respectively). The centered arrangement detected changes at 3.3%, 5°, and 4ms with smaller variation. Conclusion: Each arrangement has advantages; offsetting allows more sampling of the higher dose region, while centering allows an ion chamber measurement and potentially better use of tools such as 3DVH, at the cost of positioning more of the diodes in the sometimes noisy mid-dose region.

60 APPLIED LIFE SCIENCES↗

Global Sensitivity Analysis and Estimation of Model Error, Toward Uncertainty Quantification in Scramjet Computations

The development of scramjet engines is an important research area for advancing hypersonic and orbital flights. Progress toward optimal engine designs requires accurate flow simulations together with uncertainty quantification. However, performing uncertainty quantification for scramjet simulations is challenging due to the large number of uncertain parameters involved and the high computational cost of flow simulations. These difficulties are addressed in this paper by developing practical uncertainty quantification algorithms and computational methods, and deploying them in the current study to large-eddy simulations of a jet in crossflow inside a simplified HIFiRE Direct Connect Rig scramjet combustor. First, global sensitivity analysis is conducted to identify influential uncertain input parameters, which can help reduce the system’s stochastic dimension. Second, because models of different fidelity are used in the overall uncertainty quantification assessment, a framework for quantifying and propagating the uncertainty due to model error is presented. In conclusion, these methods are demonstrated on a nonreacting jet-in-crossflow test problem in a simplified scramjet geometry, with parameter space up to 24 dimensions, using static and dynamic treatments of the turbulence subgrid model, and with two-dimensional and three-dimensional geometries.

33 ADVANCED PROPULSION SYSTEMS↗

Theoretical analysis on the measurement errors of local 2D DIC: Part I temporal and spatial uncertainty quantification of displacement measurements

This study presents a theoretical uncertainty quantification of displacement measurements by subset-based 2D-digital image correlation. A generalized solution to estimate the random error of displacement measurement is presented. The obtained solution suggests that the random error of displacement measurements is determined by the image noise, the summation of the intensity gradient in a subset, the subpixel part of displacement, and the interpolation scheme. The proposed method is validated with virtual digital image correlation tests.

2D-DIC↗

Error and Correction Analysis for the FFA@CEBAF Energy Upgrade

An energy upgrade design for the Continuous Electron Beam Accelerator Facility (CEBAF) is under development, using fixed field alternating gradient (FFA) return arcs to recirculate electron beam up to an additional five times through the accelerating structures at CEBAF. A necessary component of any large accelerator is a beam steering and optical correction system. Small environmental changes and system errors can lower beam quality or even shut down the machine; and in pursuit of the scientific mission of JLab, high quality electron beams must be delivered to the experimental halls on a predictable schedule. Correction in the novel FFA arcs of the current upgrade design is complicated by several factors. These complexities inform the choice of correction algorithm structure and parameter values. A baseline algorithm in addition to diagnostic and correction hardware configuration is presented. The effect of this correction protocol is shown with respect to estimated errors, and several possible extensions of the algorithm are discussed. This work presents an important proof of concept for the FFA@CEBAF design effort, and provides a functional correction strategy which may be simply adjusted and optimized for future design changes.

Coxe, Alex [Old Dominion Univ., Norfolk, VA (Unite↗

Ice storage model-predictive control in an office building with PV: scenario, error and sensitivity analysis

Thermal energy storage (TES) can enable more building-sited renewable electricity generation and lower utility bill costs for buildings owners and occupants, especially when there are high demand and variable time-of-use (TOU) charges. A model predictive control (MPC) strategy can offer additional savings over a schedule-based control with added complexity and reliance on forecasts. Here, this study examines savings for medium office buildings with chiller plants in three locations with building-installed solar photovoltaics (PV) to understand the impact of MPC. Control setpoints are fixed by a schedule-based control or optimized by nonlinear MPC. These control setpoints are actuated within EnergyPlus building models to simulate the utility cost of the chiller plant. NLP solutions can be unstable or unrealistic, but our results show that by regularizing the NLP, the solutions can be reasonably followed by the building model. MPC models make simplifications that lead to errors once the controller is participating in and changing the operation of the building. These errors average 9 % across the cases, showing that the most important parts of the system are represented. The no-thermal load costs are computed to show that the optimization can in some cases achieve both the minimum TOU and minimum monthly demand costs by demand management while reducing TOU energy costs by energy arbitrage. The MPC saves 35–66 % in the annual chiller plant operating costs, which is an additional savings above the schedule by 1–33 %. PV and TES are complementary and mostly independent, but a load with PV often results in better performance for the schedule. Our case study and sensitivity analysis show the importance of modeling and optimization for complex rates, but also the circumstances wherein a simpler strategy achieves the same performance with less potential for error.

14 SOLAR ENERGY↗

Unified analysis of finite-size error for periodic Hartree-Fock and second order Møller-Plesset perturbation theory

Despite decades of practice, finite-size errors in many widely used electronic structure theories for periodic systems remain poorly understood. For periodic systems using a general Monkhorst-Pack grid, there has been no comprehensive and rigorous analysis of the finite-size error in the Hartree-Fock theory (HF) and the second order Møller-Plesset perturbation theory (MP2), which are the simplest wavefunction based method, and the simplest post-Hartree-Fock method, respectively. Such calculations can be viewed as a multi-dimensional integral discretized with certain trapezoidal rules. Due to the Coulomb singularity, the integrand has many points of discontinuity in general, and standard error analysis based on the Euler-Maclaurin formula gives overly pessimistic results. The lack of analytic understanding of finite-size errors also impedes the development of effective finite-size correction schemes. We propose a unified analysis to obtain sharp convergence rates of finite-size errors for the periodic HF and MP2 theories. Our main technical advancement is a generalization of the result of Lyness [Math. Comp. 30 (1976), pp. 1–23] for obtaining sharp convergence rates of the trapezoidal rule for a class of non-smooth integrands. Our result is applicable to three-dimensional bulk systems as well as low dimensional systems (such as nanowires and 2D materials). Our unified analysis also allows us to prove the effectiveness of the Madelung-constant correction to the Fock exchange energy, and the effectiveness of a recently proposed staggered mesh method for periodic MP2 calculations (see X. Xing, X. Li, and L. Lin [J. Chem. Theory Comput. 17 (2021), pp. 4733–4745]). In conclusion, our analysis connects the effectiveness of the staggered mesh method with integrands with removable singularities, and suggests a new staggered mesh method for reducing finite-size errors of periodic HF calculations.

97 MATHEMATICS AND COMPUTING↗