Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

High Latitude Climate Modeling: ARM Takes Us Beyond Case Studies (Final Report)

The main thrust of this project was to devise a method by which the majority of North Slope of Alaska (NSA) meteorological and radiometric data, collected on a daily basis, could be used to evaluate and improve global climate model (GCM) simulations and their parameterizations, particularly for cloud microphysics. Although the standard ARM Program sensors for a less complete suite of instruments for cloud and aerosol studies than the instruments on an intensive field program such as the 2008 Indirect and Semi-Direct Aerosol Campaign (ISDAC), the advantage they offer lies in the long time base and large volume of data that covers a wide range of meteorological and climatological conditions. The challenge has been devising a method to interpret the NSA data in a practical way, so that a wide variety of meteorological conditions in all seasons can be examined with climate models. If successful, climate modelers would have a robust alternative to the usual “case study” approach (i.e., from intensive field programs only) for testing and evaluating their parameterizations’ performance. Understanding climate change on regional scales requires a broad scientific consideration of anthropogenic influences that goes beyond greenhouse gas emissions to also include aerosol-induced changes in cloud properties. For instance, it is now clear that on small scales, human-induced aerosol plumes can exert microclimatic radiative and hydrologic forcing that rivals that of greenhouse gas–forced warming. This project has made significant scientific progress by investigating what causes successive versions of climate models continue to exhibit errors in cloud amount, cloud microphysical and radiative properties, precipitation, and radiation balance, as compared with observations and, in particular, in Arctic regions. To find out what is going wrong, we have tested the models' cloud representation over the full range of meteorological conditions found in the Arctic using the ARM North Slope of Alaska (NSA) data.

54 ENVIRONMENTAL SCIENCES↗

Synthesis of Correct Digital Controller Models from Specifications by Model Transformation (21-0320)

The design of high consequence controllers (in weapons systems, autonomy, etc.) that do what they are supposed to do is a significant challenge. Testing simply does not come close to meeting the requirements for assurance. Today circuit designers at Sandia (and elsewhere) typically capture the core behavior of their components using state models in tools such as STATEFLOW. They then check that their models meet certain requirements (e.g. “The system bus must not deadlock” or “both traffic lights at an intersection must not be green at the same time”) using tools called model checkers. If the model checker returns “yes” then the property is guaranteed to be satisfied by the model. However, there are several drawbacks to this industry practice: (1) there is a lot of detail to get right, this is particularly challenging when there are multiple components requiring complex coordination (2) any errors returned by the model checker have to be traced back through the design and fixed, necessitating rework, (3) there are severe scalability problems with this approach, particularly when dealing with concurrency. All this places high demands on the designers who now face not only an accelerated schedule but also controllers of increasing complexity. This report describes a new and fundamentally different approach to the construction of safety-critical digital controllers. Instead of directly constructing a complete model and then trying to verify it, the designer can start with an initial abstract (think “sketch”) model plus the requirements, from which a correct concrete model is automatically synthesized. There is no need for post-hoc verification of required functional properties. Having tool to carry this out will significantly impact the nation’s ability to ensure the safety of high-consequence digital systems. The approach has been implemented in a prototype tool, along with a suite of examples, including ones that reflect actual problems faced by designers. Our approach operates on a variant of Statecharts developed at Sandia called Qspecs. Statecharts are a widely used formalism for developing concurrent reactive systems, supporting scalability through allowing state models containing composite states, which are the serial or parallel composition of substates which can themselves contain statecharts. Statecharts enable an incremental style of development, in which states are progressively refined to incorporate greater detail in an incremental model of software development. Our approach formulates a set of constraints from the structure of the models and the requirements and propagates these constraints to a fixpoint. The solution to the constraints is an inductive invariant along with guards on the transitions. We also show how our approach extends to implementation refinement, decomposition, composition, and elaboration. We currently handle safety requirements written in LTL (Linear Temporal Logic)

42 ENGINEERING↗

Integration of Small Angle X-Ray Scattering Data Into Structural Modeling of Proteins And Their Assemblies

A major challenge in structural biology is to determine the configuration of domains and proteins in multidomain proteins and assemblies, respectively. All available data should be considered to maximize the accuracy and precision of these models. Small-angle X-ray scattering (SAXS) efficiently provides low-resolution experimental data about the shapes of proteins and their assemblies. Thus, we integrated SAXS profiles into our software for modeling proteins and their assemblies by satisfaction of spatial restraints. Specifically, we modeled the quaternary structures of multidomain proteins with structurally defined rigid domains as well as quaternary structures of binary complexes of structurally defined rigid proteins. In addition to SAXS profiles and the component structures, we used stereochemical restraints and an atomic distance-dependent statistical potential. The scoring function is optimized by a biased Monte Carlo protocol, including quasi-Newton and simulated annealing schemes. The final prediction corresponds to the best scoring solution in the largest cluster of many independently calculated solutions. To quantify how well the quaternary structures are determined based on their SAXS profiles, we used a benchmark of 12 simulated examples as well as an experimental SAXS profile of the homotetramer D-xylose isomerase. Optimization of the SAXS-dependent scoring function generally results in accurate models if sufficiently precise approximations for the constituent rigid bodies are available; otherwise, the best scoring models can have significant errors. Thus, SAXS profiles can play a useful role in the structural characterization of proteins and assemblies if they are combined with additional data and used judiciously. Our integration of a SAXS profile into modeling by satisfaction of spatial restraints will facilitate further integration of different kinds of data for structure determination of proteins and their assemblies.

59 BASIC BIOLOGICAL SCIENCES↗

The GGCMI Phase 2 emulators: global gridded crop model responses to changes in CO 2 , temperature, water, and nitrogen (version 1.0)

Statistical emulation allows combining advantageous features of statistical and process-based crop models for understanding the effects of future climate changes on crop yields. We describe here the development of emulators for nine process-based crop models and five crops using output from the Global Gridded Model Intercomparison Project (GGCMI) Phase 2. The GGCMI Phase 2 experiment is designed with the explicit goal of producing a structured training dataset for emulator development that samples across four dimensions relevant to crop yields: atmospheric carbon dioxide (CO2) concentrations, temperature, water supply, and nitrogen inputs (CTWN). Simulations are run under two different adaptation assumptions: that growing seasons shorten in warmer climates, and that cultivar choice allows growing seasons to remain fixed. The dataset allows emulating the climatological-mean yield response of all models with a simple polynomial in mean growing-season values. Climatological-mean yields are a central metric in climate change impact analysis; we show here that they can be captured without relying on interannual variations. In general, emulation errors are negligible relative to differences across crop models or even across climate model scenarios; errors become significant only in some marginal lands where crops are not currently grown. We demonstrate that the resulting GGCMI emulators can reproduce yields under realistic future climate simulations, even though the GGCMI Phase 2 dataset is constructed with uniform CTWN offsets, suggesting that the effects of changes in temperature and precipitation distributions are small relative to those of changing means. The resulting emulators therefore capture relevant crop model responses in a lightweight, computationally tractable form, providing a tool that can facilitate model comparison, diagnosis of interacting factors affecting yields, and integrated assessment of climate impacts.

54 ENVIRONMENTAL SCIENCES↗

IMPROVED SPECTROPHOTOMETRIC CALIBRATION OF THE SDSS-III BOSS QUASAR SAMPLE

We present a model for spectrophotometric calibration errors in observations of quasars from the third generation of the Sloan Digital Sky Survey Baryon Oscillation Spectroscopic Survey (BOSS) and describe the correction procedure we have developed and applied to this sample. Calibration errors are primarily due to atmospheric differential refraction and guiding offsets during each exposure. The corrections potentially reduce the systematics for any studies of BOSS quasars, including the measurement of baryon acoustic oscillations using the Ly α forest. Our model suggests that, on average, the observed quasar flux in BOSS is overestimated by ∼19% at 3600 Å and underestimated by ∼24% at 10,000 Å. Our corrections for the entire BOSS quasar sample are publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗

Probabilistic Wind Power Ramp Forecasting Based on a Scenario Generation Method: Preprint

Wind power ramps (WPRs) are particularly important in the management and dispatch of wind power, and they are currently drawing the attention of balancing authorities. With the aim to reduce the impact of WPRs for power system operations, this paper develops a probabilistic ramp forecasting method based on a large number of simulated scenarios. An ensemble machine learning technique is first adopted to forecast the basic wind power forecasting scenario and calculate the historical forecasting errors. A continuous Gaussian mixture model (GMM) is used to fit the probability distribution function (PDF) of forecasting errors. The cumulative distribution function (CDF) is analytically deduced. The inverse transform method based on Monte Carlo sampling and the CDF is used to generate a massive number of forecasting error scenarios. An optimized swinging door algorithm is adopted to extract all the WPRs from the complete set of wind power forecasting scenarios. The probabilistic forecasting results of ramp duration and start time are generated based on all scenarios. Numerical simulations on publicly available wind power data show that within a predefined tolerance level, the developed probabilistic wind power ramp forecasting method is able to predict WPRs with a high level of sharpness and accuracy.

17 WIND ENERGY↗

Probabilistic Wind Power Ramp Forecasting Based on a Scenario Generation Method

Wind power ramps (WPRs) are particularly important in the management and dispatch of wind power and currently drawing the attention of balancing authorities. With the aim to reduce the impact of WPRs for power system operations, this paper develops a probabilistic ramp forecasting method based on a large number of simulated scenarios. An ensemble machine learning technique is first adopted to forecast the basic wind power forecasting scenario and calculate the historical forecasting errors. A continuous Gaussian mixture model (GMM) is used to fit the probability distribution function (PDF) of forecasting errors. The cumulative distribution function (CDF) is analytically deduced. The inverse transform method based on Monte Carlo sampling and the CDF is used to generate a massive number of forecasting error scenarios. An optimized swinging door algorithm is adopted to extract all the WPRs from the complete set of wind power forecasting scenarios. The probabilistic forecasting results of ramp duration and start-time are generated based on all scenarios. Numerical simulations on publicly available wind power data show that within a predefined tolerance level, the developed probabilistic wind power ramp forecasting method is able to predict WPRs with a high level of sharpness and accuracy.

17 WIND ENERGY↗

Comparison of Measured Direct Normal Irradiance Data to Calculated Using the Disc Model for the Texas Panhandle

It is important that we convert from fossil energy to wind and solar energy. Wind energy is currently the cheapest form of renewable energy, but it is usually a poor match to utility electrical generation in the Great Plains of the United States. Concentrating solar power (CSP) plants are a better match to utility electrical loading, but so far none of these plants have been constructed in the Great Plains. Part of the reason no CSP plants have been constructed is lack of confidence in the solar resource data required (direct normal irradiance or DNI for short). There are several models for converting global solar radiation to DNI, and one of them is the DISC model. Both DNI data and global radiation data were collected at the USDA-Agricultural Research Laboratory at Bushland, Texas, for the years 2009 and 2010. Using the DISC model and measured global radiation data, DNI was calculated and compared to measured DNI data. The total annual solar energy estimated with the model was 5% greater than what was actually measured which was fairly close. However, on a monthly or hourly basis, the percentage difference could be as high as 25%. Analysis of individual months and days resulted in some recommendations for improving the DISC model. Some of the poor correlations between measured solar energy and calculated solar energy using the DISC model implied that another model (DIRINDEX) might be better. Therefore, additional work is planned to investigate the DIRINDEX model with the same data set to see if the correlation improves. This work may potentially lead to the increased use of solar energy for electrical generation, which will decrease the use of fossil fuels and the environmental pollution from fossil fuel power plants. Direct normal irradiance (DNI) is required in the performance estimation of concentrating solar energy systems. The objective of this paper is to compare measured and modeled DNI data for a site in the Texas Panhandle (Bushland, Texas) to determine the accuracy of the model and where improvements might be required. The DNI model used was the Direct Insolation Simulation Code (DISC) which was developed at the National Renewable Energy Lab (NREL) in Boulder, Colorado. We have determined that a portion of the DISC standard deviation error is due to inaccurate modeling of the first and last hour of the day, but other inaccuracies of the DISC model are also discussed. The accuracy of the DISC model improves as the time scale increases (e.g. hour to month to year) due to errors cancelling, and for Bushland, Texas, the DISC model during 2009 predicted 5% more solar energy than the measured DNI.

14 SOLAR ENERGY↗

Sci—Sat AM: Stereo — 09: Accuracy of Liver Cancer Treatment on Cyberknife® with Synchrony™ Optical Tracking Throughout the Respiratory Cycle

The Cyberknife® robotic stereotactic body radiation therapy system is well-suited for treating liver lesions over the respiratory cycle as it includes room-mounted orthogonal x-ray tracking of internal fiducial markers and optical tracking of external markers. The Synchrony™ software generates a model of internal target positions during patient respiration and correlates it to the external optical tracking system for real-time optical-based position corrections of the linear accelerator during beam delivery. Although clinical studies have provided preliminary outcomes for liver lesions treated with the Cyberknife system, to date, there is little data demonstrating the ability of the Synchrony software to track targets in the liver, which deforms throughout the respiratory cycle. In this study, we investigated the respiratory motion model performance for predicting tumour motion. We conducted a retrospective analysis of fifteen liver cancer patients treated on the Cyberknife using the Synchrony optical tracking system. We analyzed Cyberknife tracking information stored in the log files to extract the left-right (LR), anterior-posterior (AP) and superior-inferior (SI) correlation errors between the model-predicted position and the internal fiducial centroid position determined by x-ray imaging. Only translational tracking and corrections were applied during treatment. Overall, the correlation errors were greatest in the SI direction. We calculated radial correlation errors, and determined that the 95{sup th}, 98{sup th} and 99{sup th} percentile errors were 3.4 mm, 4.4 mm and 5.1 mm, respectively. Based on translational correlation tracking errors we expect the clinical target volume will be within 3.4 mm of the planning target volume for 95 % of beam delivery time.

60 APPLIED LIFE SCIENCES↗

Verification and Validation of Corrected Versions of RELAP5 for ATR Reactivity Analyses

Two versions of the RELAP5 computer code, RELAP5/MOD2.5 and RELAP5/MOD3 Version 3.2.1.2, are used to support safety analyses of the Advanced Test Reactor (ATR). Both versions of RELAP5 contain a point reactor kinetics model that has been used to simulate power excursion transients at the ATR. Errors in the RELAP5 point kinetics model were reported to the RELAP5 code developers in 2007. These errors had the potential to affect reactivity analyses that are part of the ATR’s safety basis. Consequently, corrected versions of RELAP5 were developed for analysis of the ATR. Four reactivity transients were simulated to verify and validate the corrected codes for use in safety evaluations of the ATR. The objectives of this paper are to describe the verification and validation of the point kinetics model for ATR applications and to inform code users of the effects of the errors on representative reactivity analyses.

97 MATHEMATICS AND COMPUTING↗

Comments on “Comparison of energy consumption in desalination by capacitive deionization and reverse osmosis”

Capacitive deionization (CDI) is an emerging brackish water desalination technology in which ions are removed from water by electrostatically adsorbing them onto porous electrodes. Recently, Qin et al. presented an estimate of energy consumption for CDI schemes, and compared the energy consumption of CDI to the energy consumption of a particular reverse osmosis operation scheme which they propose. Qin et al. estimate very high values of energy consumption in CDI for brackish water desalination (e.g. ~1 to 2 g/L salt solution), and these values and trends do not agree with published experiments for CDI or with experimentally validated models for CDI. The current comment identifies important scaling errors and incorrect values in their model resistance parameters, and then discusses unphysical trends predicted by their model. We do not attempt provide a comprehensive review of their model, operation, estimates, and figures, but rather concentrate on several key issues. We present our comments in two sections dealing with resistances and energy metrics, respectively.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Structure Sensitive Reaction Kinetics of Chiral Molecules on Intrinsically Chiral Surfaces

Enantiospecific heterogeneous catalysis utilizes chiral surfaces to resolve enantiomers via structure sensitive surface chemistry. The catalyst design challenge is the identification of chiral surface structures that maximize enantiospecificity. Herein, we develop data driven models for the enantiospecificity of tartaric acid reactions on chiral Cu(hkl) R&S surfaces. Measurements of enantiospecific rate constants were obtained by using curved Cu(hkl) R&S surfaces that enable kinetic measurements on hundreds of chiral surface orientations. One model uses feature vectors derived from generalized coordination numbers to capture the local structure around Cu atoms exposed by the Cu(hkl) R&S surfaces. The second model introduces the use of chiral cubic harmonic functions to capture the symmetry constraints of the face-centered cubic Cu structure. The model using 58 generalized coordination numbers has a fitting error similar to that of the model using only 5 cubic harmonic functions. The two models predict maxima in the enantiospecificity on surfaces with very similar surface orientations. The models developed in this work are applicable for any enantiospecific reaction happening on any chiral material with a cubic lattice structure, opening the way to understanding the surface structure sensitivity of the enantiospecific reaction kinetics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Reduced‐Order Modeling for Linearized Representations of Microphysical Process Rates

Abstract Representing cloud microphysical processes in large scale atmospheric models is challenging because many processes depend on the details of the droplet size distribution (DSD, the spectrum of droplets with different sizes in a cloud). While full or partial statistical moments of droplet size distributions are the typical variables used in bulk models, prognostic moments are limited in their ability to represent microphysical processes across the range of conditions experienced in the atmosphere. Microphysical parameterizations employing prognostic moments are known to suffer from structural uncertainty in their representations of inherently higher dimensional cloud processes, which limit model fidelity and lead to forecasting errors. Here we investigate how data‐driven reduced‐order modeling can be used to learn predictors for microphysical process rates in bulk microphysics schemes in an unsupervised manner from higher dimensional bin distributions. Using simulations characteristic of marine stratiform clouds, we simultaneously learn lower dimensional representations of droplet size distributions and predict the evolution of the microphysical state of the system. Droplet collision‐coalescence, the main process for generating warm rain, is estimated to have an intrinsic dimension of three. This intrinsic dimension provides a lower limit on the number of degrees of freedom needed to accurately represent collision‐coalescence in models. We demonstrate how deep learning based reduced‐order modeling can be used to discover intrinsic coordinates describing the microphysical state of the system, where process rates such as collision‐coalescence are globally linearized. These implicitly learned representations of the DSD retain more information about the DSD than typical moment‐based representations.

54 ENVIRONMENTAL SCIENCES↗

A machine learning approach for efficient multi-dimensional integration

Many physics problems involve integration in multi-dimensional space whose analytic solution is not available. The integrals can be evaluated using numerical integration methods, but it requires a large computational cost in some cases, so an efficient algorithm plays an important role in solving the physics problems. We propose a novel numerical multi-dimensional integration algorithm using machine learning (ML). After training a ML regression model to mimic a target integrand, the regression model is used to evaluate an approximation of the integral. Then, the difference between the approximation and the true answer is calculated to correct the bias in the approximation of the integral induced by ML prediction errors. Because of the bias correction, the final estimate of the integral is unbiased and has a statistically correct error estimation. Three ML models of multi-layer perceptron, gradient boosting decision tree, and Gaussian process regression algorithms are investigated. The performance of the proposed algorithm is demonstrated on six different families of integrands that typically appear in physics problems at various dimensions and integrand difficulties. The results show that, for the same total number of integrand evaluations, the new algorithm provides integral estimates with more than an order of magnitude smaller uncertainties than those of the VEGAS algorithm in most of the test cases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Hierarchical top-down bottom-up calibration with consideration for uncertainty and inter-scale discrepancy of Peierls stress of bcc Fe

A hierarchical multiscale model of plasticity in single crystal bcc Fe, framed at the mesoscale pertaining to a statistically representative set of dislocations for each slip system, relies on specification of a set of parameters which are informed using both bottom-up (BU) (atomistic) and top-down (TD) (experimental) information. We term this specification process a 'connection' between BU and TD pathways to inform the mesoscale model. The connection is considered in the presence of error, uncertainty, and discrepancy between the models. Furthermore, we expand upon a previously developed reconciled TD and BU calibration method to account for anticipated discrepancy between information from different length scales. The results of a previously formulated likelihood-based connection test of the multiscale model suggest a 'missing link' may be responsible for part of the inter-scale discrepancy. In this case, this link is assumed to be a relation between the unit-process (single dislocation line) of coordinated kink-pair nucleation on a screw dislocation segment and the many-body dislocation process which manifests in the onset of experimentally observed plastic deformation in a single crystal. A physics-informed discrepancy layer is formulated to improve the connection in the presence of additional persistent uncertainties. This physics-informed hypothesis testing is demonstrated as an alternative to fully data-driven search methods, particularly applicable to datasets of limited size that are often encountered in such multiscale material modeling applications. Discrete dislocation dynamics simulations are used to investigate the effect of the Peierls stress on straight screw dislocations and in the operation of Frank–Read sources. Discussion concerns the critical role of uncertainty quantification in providing a basis for this form of incremental hypothesis testing.

42 ENGINEERING↗

Least H 2 norm updating of quadratic interpolation models for derivative-free trust-region algorithms

One particular class of derivative-free optimization algorithms is trust-region algorithms based on quadratic models given by the under-determined interpolation. Different techniques in updating the quadratic model from iteration to iteration will give different interpolation models. We propose a new way to update the quadratic model by minimizing the $H^{2}$ norm of the difference between neighboring quadratic models. The motivation for applying the $H^{2}$ norm is given. The theoretical properties of our new updating technique are also presented. We propose the projection in the sense of $H^{2}$ norm and the interpolation error analysis of our model function. We obtain the coefficients of the quadratic model function using the Karush–Kuhn–Tucker (KKT) conditions. Numerical results show the advantages of our model on the test set considered, and the derivative-free algorithms based on our least $H^{2}$ norm updating quadratic model functions can solve test problems with fewer function evaluations than the algorithm based on the least Frobenius norm updating model and the other compared methods.

derivative-free optimization↗

A Method for Estimating Time-Series PV Production Loss From Solar Tracking Failures

Solar tracking system failures can dramatically reduce photovoltaic (PV) system energy output through suboptimal irradiance capture and self-shading loss. Detecting tracker failures is not always straightforward; unlike other common PV system failures like inverter outages and blown fuses which take portions of a system completely offline, tracker failures only partially reduce output power and can go unnoticed as a result. Additionally, tracker failures can take one of several forms, each with their own loss characteristics. Here we present two methods of detecting tracker failure events from time-series production data and a method for estimating the associated production loss. Compared with existing detection methods, the proposed power-based detection method showed 0-17% reductions in Type I error rate depending on weather conditions. Here, the loss model estimated production loss with low error (mean bias error = -2.3 %, root-mean-squared error = 6%) in a rudimentary validation.

14 SOLAR ENERGY↗

A bone composition model for Monte Carlo x-ray transport simulations

In the megavoltage energy range although the mass attenuation coefficients of different bones do not vary by more than 10%, it has been estimated that a simple tissue model containing a single-bone composition could cause errors of up to 10% in the calculated dose distribution. In the kilovoltage energy range, the variation in mass attenuation coefficients of the bones is several times greater, and the expected error from applying this type of model could be as high as several hundred percent. Based on the observation that the calcium and phosphorus compositions of bones are strongly correlated with the bone density, the authors propose an analytical formulation of bone composition for Monte Carlo computations. Elemental compositions and densities of homogeneous adult human bones from the literature were used as references, from which the calcium and phosphorus compositions were fitted as polynomial functions of bone density and assigned to model bones together with the averaged compositions of other elements. To test this model using the Monte Carlo package DOSXYZnrc, a series of discrete model bones was generated from this formula and the radiation-tissue interaction cross-section data were calculated. The total energy released per unit mass of primary photons (terma) and Monte Carlo calculations performed using this model and the single-bone model were compared, which demonstrated that at kilovoltage energies the discrepancy could be more than 100% in bony dose and 30% in soft tissue dose. Percentage terma computed with the model agrees with that calculated on the published compositions to within 2.2% for kV spectra and 1.5% for MV spectra studied. This new bone model for Monte Carlo dose calculation may be of particular importance for dosimetry of kilovoltage radiation beams as well as for dosimetry of pediatric or animal subjects whose bone composition may differ substantially from that of adult human bones.

62 RADIOLOGY AND NUCLEAR MEDICINE↗