Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Application of PCM Validation to BFBT Experiments

In support of model validation, this summary applies a recently proposed methodology, denoted hereinafter by physics-guided coverage mapping (PCM), to the estimation of void fraction in heated channels using the OECD/NEA full size fine mesh bundle test (BFBT) data. PCM here is developed as a quantitative approach that allows for a rigorous scaling of experimental biases to the application domain, i.e., the range of the conditions intended for model application. PCM aims to address some of the conceptual and computational difficulties associated with model validation exercises where it is essential to establish with a certain confidence that the available experiments provide enough evidence to support the use of the model for its intended range of application. To our knowledge, this methodology represents a first-of-a-kind application of physics models to support validation, in a manner that precludes parameters calibration, and avoids the introduction of expert-based scale-distortion uncertainties. (authors)

42 ENGINEERING↗

Modeling and Validation of Offset Cancellation for Hybrid Photonic-Electronic Transimpedance Amplifier Using All-Electronic Circuits

Hybrid photonic-electronic circuits involving crossdomain feedback signals are difficult to validate and troubleshoot. This paper describes an approach to model and validate an offset-cancellation loop for a hybrid transimpedance amplifier (TIA) using all-electronic circuits. An equivalent electrical model is developed for the tunable interferometer attenuators used for offset trimming, and it includes test features to extract the system performance. The stability analysis of the system shows 75 ◦ of phase margin and 102 dB of gain margin. Measurement results demonstrate good agreement with analysis and successful TIA offset cancellation.

Marchant, Jared↗

Validating corrosion models: A comparison of governing equations

Experimental validation of Finite Element Method (FEM) models varying electrochemical governing equations, inclusion of chemical reactions, and time on the resultant damage profile for two galvanic couples is explored. Two anode materials (Magnesium AZ31 and Carbon Steel) in contact with a cathode (Stainless Steel 304 L) were modeled in/exposed to NaCl (1 and 0.1 M respectively for the anode materials) for up to one week. The physics approach, inclusion of chemical reactions, and the boundary conditions required to accurately represent the damage profile in FEM models depended on the galvanic couple materials and, ultimately, the corrosion rate. For high rates of corrosion (i.e., magnesium anode), the Nernst-Planck equation with Electroneutrality was sufficient to describe the damage, while, for low rates of corrosion (i.e., carbon steel anode), the Laplace equation was sufficient. In all cases, the most complete governing equation (Nernst-Planck-Poisson Equation) was not necessary to accurately describe the damage. Precipitation reactions in solution also played a critical role in the predicted damage profile, especially for high corrosion rate systems. Finally, for short time periods (< 6 h), the choice of governing equations does not significantly influence damage profile results. Overall, the choice of physics to reduce error in simulations relies on the boundary conditions, geometry, conductivity of the solution, electrochemical potential differences, and time of exposure. The above results are discussed with regard to accuracy and computational savings.

Carbon steel↗

Data-Driven Residential Load Modeling and Validation in GridLAB-D

Accurately characterizing the impacts of high penetrations of distributed energy resources (DER) on the electric distribution system has driven modeling methods from traditional static snap shots, often representing a critical point in time (e.g., summer peak load), to quasi-static time series (QSTS) simulations capturing all the effects of variable DER, associated controls and hence, impacts on the distribution system over a given time period. Unfortunately, the high time resolution DER source and load data required for model inputs is often scarce or non-existent. This paper presents work performed within the GridLAB-D model environment to synthesize, calibrate, and validate 1-second residential load models based on measured transformer loads and physics-based models suitable for QSTS electric distribution system modeling. The modeling and validation approach taken was to create a typical GridLAB-D model home that, when replicated to represent multiple diverse houses on a single transformer, creates a statistically similar load to a measured load for a given weather input. The model homes are constructed to represent the range of actual homes on an instrumented transformer: square footage, thermal integrity, heating and cooling system definition as well as realistic occupancy schedules. House model calibration and validation was performed using the distribution transformer load data and corresponding weather. The modeled loads were found to be similar to the measured loads for four evaluation metrics: 1) daily average energy, 2) daily average and standard deviation of power, 3) power spectral density, and 4) load shape.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Wind Energy Instrumentation Atlas

The US Department of Energy (DOE) A2e program is focused on developing the next generation of predictive tools to better understand wind plant performance and help industry lower the overall cost of energy. A formal verification and validation process is required to demonstrate improved accuracy of these new models beyond those currently employed. And a critical part of model validation is utilization of a diverse set of accurate observations of atmospheric forcing and wind plant response. A number of existing data sets that will be used for this purpose, as highlighted by Schreck and Maniaci (2017) but A2e researchers also realize that new datasets will be required to meet validation objectives. As such, plans for new experiments based on model validation priorities (NALU validation plan, 2017) are currently being developed. This document is intended to serve as a reference to experimental study planners that describes the capability, accuracy and resolution of existing and developing measurement technologies to observe quantities of interest for wind plant model validation. Such systems can be broken into two major categories: those that measure the flow field and surrounding atmosphere around and within a wind plant and those that measure the turbine response within the wind plant. The A2e validation team will use this catalogue of instrument capability in conjunction with the validation plan, to choose the optimal set of instruments to be deployed, inform instrument placement and operation and estimate the types of validation that may be gathered through new field campaigns. Where existing instrumentation is deficient, the document will also help guide DOE towards potential areas where instrumentation development is required to meet validation objectives and A2e technology development funding may be required. The domain of interest is the wind plant microscale, within and surrounding a single wind plant, typically, tens of kilometers on a side in horizontal directions and to the top of the atmospheric boundary layer (about 1km) in the vertical. Some observations of dominant mesoscale forcing phenomena are required, with the highest resolution measurements occurring in the wind turbine wakes and on the turbines themselves. The simulation tools to be validated are mesoscale driven large-eddy simulations of the atmosphere with full aeroelastic response of individual turbines within the plant. Use cases vary slightly among tool users, but should focus on the primary end customers of the simulations and research insights, which would be turbine manufacturers, wind plant developers and owners. Broadly speaking their interests are maximizing energy output, while maintaining turbine reliability and lifetime.

17 WIND ENERGY↗

Burst pressure models and validations for thick-walled pipelines containing corrosion defects

Corrosion is one major threat to pipeline integrity. Over the past decades, many corrosion models have been developed for determining the remaining strength of corroded pipelines, including ASME B31.G, Modified B31.G, LPC, PCORRC and their modified models. All these corrosion models are applicable only to large diameter, thin-walled pipelines with a diameter to wall thickness ratio D/t ≥ 20. In practice, many pipelines have a small diameter and thick wall with a D/t ratio < 20, and thus an adequate corrosion model is needed for assessing remaining strength for corroded thick-walled pipelines. This paper briefly reviews the theoretical burst pressure models for defect-free thin and thick-walled pipelines and four representative corrosion assessment models for thin-walled corroded pipelines. On this basis, two modified corrosion models are proposed to thick-walled pipelines in terms of the average shear stress yield theory. To verify the proposed corrosion models, comprehensive validations are performed. Numerical validations include the elastic-plastic finite element analysis to determine burst pressure for pipelines without and with corrosion defects and the model evaluation using a large dataset of available FEA results of burst pressure for machined defects. Experimental validations include a set of burst pressure tests for defect-free thick-walled pipes with different thicknesses and the model evaluation using one large burst dataset for machined defects with flat bottoms and another large dataset for real corrosion defects with curved river bottom profiles. Both numerical and experimental validations show that the proposed corrosion models can more accurately predict the remaining strength for corroded thin and thick-walled pipelines.

Pipeline↗

Recommended Research Directions for Improving the Validation of Complex Systems Models.

Improved validation for models of complex systems has been a primary focus over the past year for the Resilience in Complex Systems Research Challenge. This document describes a set of research directions that are the result of distilling those ideas into three categories of research -- epistemic uncertainty, strong tests, and value of information. The content of this document can be used to transmit valuable information to future research activities, update the Resilience in Complex Systems Research Challenge's roadmap, inform the upcoming FY18 Laboratory Directed Research and Development (LDRD) call and research proposals, and facilitate collaborations between Sandia and external organizations. The recommended research directions can provide topics for collaborative research, development of proposals, workshops, and other opportunities.

99 GENERAL AND MISCELLANEOUS↗

A Validated Prediction Model for Overall Survival From Stage III Non-Small Cell Lung Cancer: Toward Survival Prediction for Individual Patients

Purpose: Although patients with stage III non-small cell lung cancer (NSCLC) are homogeneous according to the TNM staging system, they form a heterogeneous group, which is reflected in the survival outcome. The increasing amount of information for an individual patient and the growing number of treatment options facilitate personalized treatment, but they also complicate treatment decision making. Decision support systems (DSS), which provide individualized prognostic information, can overcome this but are currently lacking. A DSS for stage III NSCLC requires the development and integration of multiple models. The current study takes the first step in this process by developing and validating a model that can provide physicians with a survival probability for an individual NSCLC patient. Methods and Materials: Data from 548 patients with stage III NSCLC were available to enable the development of a prediction model, using stratified Cox regression. Variables were selected by using a bootstrap procedure. Performance of the model was expressed as the c statistic, assessed internally and on 2 external data sets (n=174 and n=130). Results: The final multivariate model, stratified for treatment, consisted of age, gender, World Health Organization performance status, overall treatment time, equivalent radiation dose, number of positive lymph node stations, and gross tumor volume. The bootstrapped c statistic was 0.62. The model could identify risk groups in external data sets. Nomograms were constructed to predict an individual patient's survival probability ( (www.predictcancer.org)). The data set can be downloaded at (https://www.cancerdata.org/10.1016/j.ijrobp.2015.02.048). Conclusions: The prediction model for overall survival of patients with stage III NSCLC highlights the importance of combining patient, clinical, and treatment variables. Nomograms were developed and validated. This tool could be used as a first building block for a decision support system.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Validating Simulated Models of Energy Consumption by a Battery Electric Motorcoach: A real-world deployment in a harsh climate.

Many efforts have been made to simulate energy consumption of battery electric buses (BEBs) to optimize their deployment into existing fleets. The models produced, however, are rarely validated against real-world consumption data, limiting their generalizability and widespread application to fleets around the US. Furthermore, a major concern specific to BEBs is the effects of harsh climates on their performance. We build upon the state-of-the-art energy consumption modeling techniques developed for BEBs and apply them to a unique geographic context and a unique electrified vehicle. This geography, climate, and vehicle further the existing understanding of the factors affecting medium- and heavy-duty electric vehicles (MHDEVs) by allowing for new relationships to be tested and by assessing the generalizability of known relationships to new contexts. We find that temperature is less predictive of energy consumption for the battery electric motorcoach (BEM) in the case study environment than it is for BEBs in other studies. A mitigating factor that we presume to be working on the relationship between temperature and energy consumption is the fact that the BEM route does not stop between origin and destination to exchange passengers, and in turn, conditioned cabin air. Our model also incorporates wind speed and direction relative to travel, which is a novel contribution of our methodology. Results from our study are helpful for transit service planners, fleet operators, and logistics firms for improving their ability to predict performance of potential deployments of MHDEVs into existing operations.

32 - ENERGY CONSERVATION, CONSUMPTION, AND UTILIZA↗

FAST.Farm Development and Validation of Structural Load Prediction Against Large Eddy Simulations

FAST.Farm is a mid-fidelity engineering tool developed by the National Renewable Energy Laboratory targeted at accurately and efficiently predicting wind turbine power production and structural loading in wind farm settings, including wake interactions between turbines. FAST.Farm is based on several principles of the dynamic wake meandering (DWM) model, but also addresses limitations of previous DWM implementations. Previous FAST.Farm studies have shown the similarities and differences between FAST.Farm and large eddy simulations for rigid turbine cases. The objective of this work is to quantify the ability of FAST.Farm to accurately predict turbine structural response in a small wind farm. This is done by comparing FAST.Farm structural response to SOWFA-OpenFAST results for three laterally-aligned turbines. The purpose of this study is to characterize the similarities and differences between FAST.Farm and a higher fidelity model for predicting turbine structural response in a wind farm for differing atmospheric inflows. Strong statistical agreement was found between FAST.Farm and SOWFA-OpenFAST structural response for the non-waked upstream turbine, and good agreement was found for the downstream turbines for most structural quantities. Higher differences were seen for downstream turbines with low ambient turbulence intensity or yawed turbines, suggesting areas for FAST.Farm wake dynamics modeling improvements. For all cases and turbines, small statistical differences were seen between blade deflections and bending moments, with larger differences for tower-top and tower-base bending moments. Overall, the results establish confidence for applying FAST.Farm to wind farm power and loads analyses and identify areas where further model validations and model improvements should be targeted.

49 EE - Wind and Water Power Program - Wind (EE-4W↗

Using Measured Plane-of-Array Data Directly in Photovoltaic Modeling: Methodology and Validation

Measured plane-of-array (POA) irradiance may provide a lower-cost alternative to standard irradiance component data for photovoltaic (PV) system performance modeling without loss of accuracy. Previous work has shown that transposition models typically used by PV models to calculate POA irradiance from horizontal data introduce error into the POA irradiance estimates, and that measured POA data can correlate better to measured performance data. However, popular PV modeling tools historically have not directly used input POA data. This paper introduces a new capability in NREL's System Advisor Model (SAM) to directly use POA data in PV modeling, and compares SAM results from both POA irradiance and irradiance components inputs against measured performance data for eight operating PV systems.

14 SOLAR ENERGY↗

BISON High Burnup Structure Modeling Capabilities Validated with a Selection of the Halden IFA-650 Rods

The U.S. Department of Energy (DOE)’s Nuclear Energy Advanced Modeling and Simulation (NEAMS)program aims to develop predictive capabilities using computational methods for the analysis and design of advanced reactor and fuel cycle systems. This program has been supporting the development of BISON, a high-fidelity and high-resolution fuel performance tool at the engineering scale. This document continues analysis and refinement of capabilities added to BISON early this calendar year in regards to the incorporation of capabilities applicable to extended burnups in response to industry interest. Details are provided on high burnup thermal conductivity models, a refitting of the high-burnup structure (HBS) porosity formation model to include additional data, the coupling of the HBS volume fraction model to thermal conductivity and fine fragmentation models, and validation activities. The IFA-650.4 and IFA-650.9 loss of coolant accident (LOCA) analyses are revisited with the latest developments in this report. A new validation case, IFA-650.14 has also been added to the BISON test suite.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

SU-E-T-546: Modeling and Validation of the a New Proton Therapy System Using a Monte-Carlo Environment Optimized for Protons

8 particle histories were run. Results: Range measurements of the Monte-Carlo simulations matched the measured data within 1mm. Distal fall-off of the simulated fields matched within <1mm. Lateral penumbra and field size measurements of the standard-sized square and half-beam blocked fields matched within 1mm at all three planes compared. A small difference was seen in the in-air profiles at doses <0%. The suspected cause of the difference was the aperture shape. The measured data utilized a divergent aperture. The Monte-Carlo calculation used a non-divergent aperture. Conclusion: The validation measurements indicate that we were able to accurately model the MEVION s250 Proton therapy system using Monte-Carlo Calculations. This may reduce the commissioning time for future users. Purpose: Monte-Carlo modeling is an important tool for understanding the behavior of therapeutic proton beams in a heterogeneous media such as the patient. To gain confidence that a Monte-Carlo model is accurate in complex geometries and media, it must first be compared with measurement in simple situations. This study documents the validation of our Monte-Carlo Model. Methods: A model of the MEVION s250 Proton therapy system was created in the TOPAS Monte-Carlo environment using machine geometry and field shaping system information provided by the vendor. For each of 24 options, validation of the TOPAS model was performed by comparing the dose scored by TOPAS to the dose measurements obtained during the commissioning of the treatment planning system. The measurements compared consisted of: pristine peak depth-dose profiles, in-air profiles for a standard-sized square field (20cm×20cm or 10cm×10cm depending on the maximum field size for each option) at isocenter and at 20cm upstream and downstream of isocenter, and in-air profiles with a half-beam blocked aperture at isocenter and at 20cm upstream and downstream of isocenter. For all Monte-Carlo simulations,.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Multi-scale dynamic modeling and validation of radial flow fixed bed contactors for post-combustion CO 2 capture using bench scale and pilot plant data

Here, in this work, a multi-scale model of a radial flow fixed bed contactor packed with a carbon sorbent is developed and validated with laboratory-scale and pilot plant scale dynamic data. For the lab scale system, the model results were compared with low, medium and high gas and sweep flowrates, yielding root mean square error (RMSE) of 0.80, 0.63, 0.96 CO 2 mol%, respectively, for the outlet CO 2 concentration profile considering the entire A-D cycle. For the bed outer temperature profile, maximum RMSE was found to be 5.5 °C considering all flowrates and entire A-D cycles. An experimental campaign was developed and applied to a pilot plant at Technology Center Mongstad (TCM), Norway. Approaches were developed for pre-processing of data including consideration of the effect of gas mixing, measurement delay, and determination of cyclic steady-state conditions. Considering profiles during A-D cycles for all test runs, it was found that the maximum RMSE for pressure drop, temperature for the outer section of the bed, temperature for the middle section of the bed, and outlet CO 2 concentration profile remained less than 1.5 mbar, 3.5 °C, 2.8 °C, and 1.3 CO 2 mol%, respectively. The validated model was used to perform sensitivity studies on several key design operating variables for the adsorption-desorption cycle. It was found that the flow rate and concentration of flue gas have dominant nonlinear effects on the breakthrough time while the desorption time was strongly affected by the sweep gas flowrate for the specific sorbent being evaluated in this study.

20 FOSSIL-FUELED POWER PLANTS↗

Verifying and Validating Simulation Models

This presentation is a high-level discussion of the Verification and Validation (V&V) of computational models. Definitions of V&V are given to emphasize that “validation” is never performed in a vacuum; it accounts, instead, for the current state-of-knowledge in the discipline considered. In particular comparisons between physical measurements and numerical predictions should account for their respective sources of uncertainty. The differences between error (bias), aleatoric uncertainty (randomness) and epistemic uncertainty (ignorance, lack-of- knowledge) are briefly discussed. Four types of uncertainty in physics and engineering are discussed: 1) experimental variability, 2) variability and randomness, 3) numerical uncertainty and 4) model-form uncertainty. Statistical sampling methods are available to propagate, and analyze, variability and randomness. Numerical uncertainty originates from the truncation error introduced by the discretization of partial differential equations in time and space. Model-form uncertainty is introduced by assumptions often formulated to render a complex problem more tractable and amenable to modeling and simulation. The discussion concludes with high-level guidance to assess the “credibility” of numerical simulations, which stems from the level of rigor with which these various sources of uncertainty are assessed and quantified.

Mathematics & Computing(97)↗

Validating Irradiance Models for High-Latitude Vertical Bifacial Photovoltaic Systems

Bifacial photovoltaic systems oriented vertically facing east-west are an emerging design, targeting production in morning and afternoon hours and providing competitive annual energy yield to traditional south-tilted modules for high latitude locations. The accuracy of existing bifacial PV models when modules are oriented vertically has yet to be examined in detail. Here, we compare four bifacial PV irradiance models in ~150 locations between 15-80 degrees N on the utility-scale, finding higher inter-model deviations for vertical PV systems than south-tilted across all latitudes less than 75 degrees N. We validate model-predicted irradiance with test-site data collected in Golden, Colorado and Fairbanks, Alaska for E-W vertical and south-tilted arrays. View factor models agree with E-W vertical test-site data in Golden with RMSE=15%. Modelling error increases for the Alaskan test-site to RMSE values between 21-30%, driven in part by high albedo measurement uncertainty during snowy months.

bifacial↗

A GPU based high-resolution multilevel biomechanical head and neck model for validating deformable image registration

Purpose: Validating the usage of deformable image registration (DIR) for daily patient positioning is critical for adaptive radiotherapy (RT) applications pertaining to head and neck (HN) radiotherapy. The authors present a methodology for generating biomechanically realistic ground-truth data for validating DIR algorithms for HN anatomy by (a) developing a high-resolution deformable biomechanical HN model from a planning CT, (b) simulating deformations for a range of interfraction posture changes and physiological regression, and (c) generating subsequent CT images representing the deformed anatomy. Methods: The biomechanical model was developed using HN kVCT datasets and the corresponding structure contours. The voxels inside a given 3D contour boundary were clustered using a graphics processing unit (GPU) based algorithm that accounted for inconsistencies and gaps in the boundary to form a volumetric structure. While the bony anatomy was modeled as rigid body, the muscle and soft tissue structures were modeled as mass–spring-damper models with elastic material properties that corresponded to the underlying contoured anatomies. Within a given muscle structure, the voxels were classified using a uniform grid and a normalized mass was assigned to each voxel based on its Hounsfield number. The soft tissue deformation for a given skeletal actuation was performed using an implicit Euler integration with each iteration split into two substeps: one for the muscle structures and the other for the remaining soft tissues. Posture changes were simulated by articulating the skeletal structure and enabling the soft structures to deform accordingly. Physiological changes representing tumor regression were simulated by reducing the target volume and enabling the surrounding soft structures to deform accordingly. Finally, the authors also discuss a new approach to generate kVCT images representing the deformed anatomy that accounts for gaps and antialiasing artifacts that may be caused by the biomechanical deformation process. Accuracy and stability of the model response were validated using ground-truth simulations representing soft tissue behavior under local and global deformations. Numerical accuracy of the HN deformations was analyzed by applying nonrigid skeletal transformations acquired from interfraction kVCT images to the model’s skeletal structures and comparing the subsequent soft tissue deformations of the model with the clinical anatomy. Results: The GPU based framework enabled the model deformation to be performed at 60 frames/s, facilitating simulations of posture changes and physiological regressions at interactive speeds. The soft tissue response was accurate with a R{sup 2} value of >0.98 when compared to ground-truth global and local force deformation analysis. The deformation of the HN anatomy by the model agreed with the clinically observed deformations with an average correlation coefficient of 0.956. For a clinically relevant range of posture and physiological changes, the model deformations stabilized with an uncertainty of less than 0.01 mm. Conclusions: Documenting dose delivery for HN radiotherapy is essential accounting for posture and physiological changes. The biomechanical model discussed in this paper was able to deform in real-time, allowing interactive simulations and visualization of such changes. The model would allow patient specific validations of the DIR method and has the potential to be a significant aid in adaptive radiotherapy techniques.

60 APPLIED LIFE SCIENCES↗