Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Data Validation for Hosting Capacity Analyses

The usefulness of Hosting Capacity Analysis (HCA) is dependent on users' confidence that the results accurately reflect grid conditions. This report provides the findings and recommendations from research, conducted by The National Renewable Energy Lab (NREL) and The Interstate Renewable Energy Council (IREC), into HCA data validation best practices. The goal is to provide utilities, regulators, and stakeholders best practices for HCA data validation procedures so that future HCA deployments avoid uncertainties and potential mistakes from earlier rollouts and provide useful and accurate data from the day they are published. Utilities can use this report to develop or refine their HCA data validation procedures. Regulators can use the report to inform their oversight of utilities' HCA data validation practices, while stakeholders can use it to evaluate the effectiveness of utility efforts.

14 SOLAR ENERGY↗

Studies Related to the Oregon State University High Temperature Test Facility: Scaling, the Validation Matrix, and Similarities to the Modular High Temperature Gas-Cooled Reactor

The Oregon State University (OSU) High Temperature Test Facility (HTTF) is an integral experimental facility that will be constructed on the OSU campus in Corvallis, Oregon. The HTTF project was initiated, by the U.S. Nuclear Regulatory Commission (NRC), on September 5, 2008 as Task 4 of the 5 year High Temperature Gas Reactor Cooperative Agreement via NRC Contract 04-08-138. Until August, 2010, when a DOE contract was initiated to fund additional capabilities for the HTTF project, all of the funding support for the HTTF was provided by the NRC via their cooperative agreement. The U.S. Department of Energy (DOE) began their involvement with the HTTF project in late 2009 via the Next Generation Nuclear Plant project. Because the NRC interests in HTTF experiments were only centered on the depressurized conduction cooldown (DCC) scenario, NGNP involvement focused on expanding the experimental envelope of the HTTF to include steady-state operations and also the pressurized conduction cooldown (PCC). Since DOE has incorporated the HTTF as an ingredient in the NGNP thermal-fluids validation program, several important outcomes should be noted: 1. The reference prismatic reactor design, that serves as the basis for scaling the HTTF, became the modular high temperature gas-cooled reactor (MHTGR). The MHTGR has also been chosen as the reference design for all of the other NGNP thermal-fluid experiments. 2. The NGNP validation matrix is being planned using the same scaling strategy that has been implemented to design the HTTF, i.e., the hierarchical two-tiered scaling methodology developed by Zuber in 1991. Using this approach a preliminary validation matrix has been designed that integrates the HTTF experiments with the other experiments planned for the NGNP thermal-fluids verification and validation project. 3. Initial analyses showed that the inherent power capability of the OSU infrastructure, which only allowed a total operational facility power capability of 0.6 MW, is inadequate to permit steady-state operation at reasonable conditions. 4. To enable the HTTF to operate at a more representative steady-state conditions, DOE recently allocated funding via a DOE subcontract to HTTF to permit an OSU infrastructure upgrade such that 2.2 MW will become available for HTTF experiments. 5. Analyses have been performed to study the relationship between HTTF and MHTGR via the hierarchical two-tiered scaling methodology which has been used successfully in the past, e.g., APEX facility scaling to the Westinghouse AP600 plant. These analyses have focused on the relationship between key variables that will be measured in the HTTF to the counterpart variables in the MHTGR with a focus on natural circulation, using nitrogen as a working fluid, and core heat transfer. 6. Both RELAP5-3D and computational fluid dynamics (CD-Adapco’s STAR-CCM+) numerical models of the MHTGR and the HTTF have been constructed and analyses are underway to study the relationship between the reference reactor and the HTTF. The HTTF is presently being designed. It has ¼-scaling relationship to the MHTGR in both the height and the diameter. Decisions have been made to design the reactor cavity cooling system (RCCS) simulation as a boundary condition for the HTTF to ensure that (a) the boundary condition is well defined and (b) the boundary condition can be modified easily to achieve the desired heat transfer sink for HTTF experimental operations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Multimodel validation of single wakes in neutral and stratified atmospheric conditions

Previous research has revealed the need for a validation study that considers several wake quantities and code types so that decisions on the trade-off between accuracy and computational cost can be well informed and appropriate to the intended application. In addition to guiding code choice and setup, rigorous model validation exercises are needed to identify weaknesses and strengths of specific models and guide future improvements. Here, we consider 13 approaches to simulating wakes observed with a nacelle-mounted lidar at the Scaled Wind Technology Facility (SWiFT) under varying atmospheric conditions. We find that some of the main challenges in wind turbine wake modeling are related to simulating the inflow. In the neutral benchmark, model performance tracked as expected with model fidelity, with large-eddy simulations performing the best. In the more challenging stable case, steady-state Reynolds-averaged Navier–Stokes simulations were found to outperform other model alternatives because they provide the ability to more easily prescribe noncanonical inflows and their low cost allows for simulations to be repeated as needed. Dynamic measurements were only available for the unstable benchmark at a single downstream distance. These dynamic analyses revealed that differences in the performance of time-stepping models come largely from differences in wake meandering. This highlights the need for more validation exercises that take into account wake dynamics and are able to identify where these differences come from: mesh setup, inflow, turbulence models, or wake-meandering parameterizations. In addition to model validation findings, we summarize lessons learned and provide recommendations for future benchmark exercises.

17 WIND ENERGY↗

The role of experiments and of sensitivity analysis in simulation validation strategies with emphasis on reactor physics

The complementary role of experiments and of sensitivity analysis has been and still is a key feature of validation strategies used in the field of simulation tools for nuclear reactor design. The present paper gives a summary of the development of more and more sophisticated validation strategies up to the present trend for science-based validation approaches. Most examples and some very recent original developments are given, mostly in the field of neutronics that has traditionally provided cutting edge advances for simulation tools validation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Analysis of ZPPR-15 experimental data for VTR software validation

As part of the Versatile Test Reactor (VTR) program, extensive validation work is being performed to demonstrate the fidelity of the Argonne Reactor Code (ARC) software package presently used for the core design studies. It is anticipated that this software will be also used for initial operations although additional software may be introduced at a later time to supplement or replace some components. The validation work was focused on accumulating reactor models that are consistent with the VTR and thus can be used to validate the accuracy of predictions made by the software used to design and operate the VTR. The U.S. does not have any active experimental facilities that can neutronically mockup the VTR core design. However, in the past, the U.S. had extensive experimental facilities for fast reactor neutronics. In that regard, the ZPPR-15 experiments carried out at ANL during the 1980s work best because the fuel form is closest to the VTR design, there is a considerable amount of processed data available for use, and existing staff are already familiar with the experimental machine and measurements. Because of previous collaborative work, many of the ZPPR-15 loadings of interest have already been processed into MCNP and preliminary ARC models, and a full uncertainty quantification has already been completed for many of the ZPPR-15 measurements. This manuscript covers the recent analysis work on the ZPPR-15 experiments and compares it with the experimental results. With respect to the ARC software components, this manuscript focuses on validation of the MC 2 , DIF3D and GAMSOR using the ZPPR-15 experimental data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Verification and validation of the open-source plasma fluid code: Zapdos

Zapdos is an open-source finite element plasma fluid solver based on the MOOSE multiphysics framework. This paper outlines Zapdos verification, benchmarking, and validation efforts for 1D and 2D RF capacitively coupled plasma discharge models for mid-range pressures (0.1 - 1 Torr). The verification process involved using the method of manufactured solutions to assess Zapdos spatial and temporal error convergence. L2 errors ranged from 10 -2 to 10 -4 , while the convergence’s slope were in agreement with the predicted slopes for the tested variable and time integration orders. The benchmarking process involved comparisons to previously results from the validated finite element code, LSODI. These works included 1D and 2D simulations for a range of plasma parameters (densities, temperatures, voltage, etc.). For the 1D cases, Zapdos and LSODI results were in very good agreement. In the 2D cases, variable behaviors matched, with slight discrepancies in peak values. The validation process involved comparisons to experimental works including electron density measurements by microwave interferometry and metastable density measurements by planar laser-induced fluorescence imaging. Results shown reasonable agreement at higher pressure, with results starting to diverge at low pressures. Furthermore, probable causes for this diverges are the limitation of the fluid assumption for plasmas at low pressure, or the need for more robust boundary conditions. Overall, Zapdos shown reasonable results for the verification, benchmarking, and validation efforts, and Zapdos can be downloaded at https://github.com/shannon-lab/zapdos.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

OC5 Project Phase Ib: Validation of hydrodynamic loading on a fixed, flexible cylinder for offshore wind applications

This paper summarizes the findings from Phase Ib of the Offshore Code Comparison, Collaboration, Continued with Correlation (OC5) project. OC5 is a project run under the International Energy Agency (IEA) Wind Research Task 30, and is focused on validating the tools used for modelling offshore wind systems through the comparison of simulated responses of select offshore wind systems (and components) to physical test data. For Phase Ib of the project, simulated hydrodynamic loads on a flexible cylinder fixed to a sloped bed were validated against test measurements made in the shallow water basin at the Danish Hydraulic Institute (DHI) with support from the Technical University of Denmark (DTU). The first phase of OC5 examined two simple cylinder structures (Phase Ia and Ib) to focus on validation of hydrodynamic models used in the various tools before moving on to more complex offshore wind systems and the associated coupled physics. As a result, verification and validation activities such as these lead to improvement of offshore wind modelling tools, which will enable the development of more innovative and cost-effective offshore wind designs.

17 WIND ENERGY↗

Validation of strongly coupled geomechanics and gas hydrate reservoir simulation with multiscale laboratory tests

In this work, we validate a coupled flow-geomechanics simulator for gas hydrate deposits, named T+M AM , performing two meter-scale laboratory experiments of gas hydrates for production by depressurization, replicating the gas hydrate deposit in the Ulleung Basin, East Sea, South Korea. The first experiment with a sand-only specimen is a 1D 1 m-scale depressurization test based on the excess gas method, which represents the grain coating hydrate growth. On the other hand, the second is a 3D 1.5 m-scale test with the excess water method for a sand-mud alternating layer system, representing the pore filling hydrate growth. We measure production and displacement at the top with different depressurization levels. In particular, the 3D test exhibits high coupling strength of substantial deformation induced by incompressibility of water and high deformability of the specimen. For validation, we match pressure, flow rate, and displacement between the experimental data and numerical results. Thus, we identify that T+M AM is a reliable simulator, which can be applied to fields in both permafrost and deep oceanic hydrate deposits of strongly coupled flow and geomechanics systems. This validation also implies that other coupled simulators based on the same coupling formulation as T+M AM can be validated when individual flow and geomechanics simulators are stable and reliable.

02 PETROLEUM↗

Validation of a Predictive Model for Survival in Metastatic Cancer Patients Attending an Outpatient Palliative Radiotherapy Clinic

Purpose: To validate a predictive model for survival of patients attending a palliative radiotherapy clinic. Methods and Materials: We described previously a model that had good predictive value for survival of patients referred during 1999 (1). The six prognostic factors (primary cancer site, site of metastases, Karnofsky performance score, and the fatigue, appetite and shortness-of-breath items from the Edmonton Symptom Assessment Scale) identified in this training set were extracted from the prospective database for the year 2000. We generated a partial score whereby each prognostic factor was assigned a value proportional to its prognostic weight. The sum of the partial scores for each patient was used to construct a survival prediction score (SPS). Patients were also grouped according to the number of these risk factors (NRF) that they possessed. The probability of survival at 3, 6, and 12 months was generated. The models were evaluated for their ability to predict survival in this validation set with appropriate statistical tests. Results: The median survival and survival probabilities of the training and validation sets were similar when separated into three groups using both SPS and NRF methods. There was no statistical difference in the performance of the SPS and NRF methods in survival prediction. Conclusion: Both the SPS and NRF models for predicting survival in patients referred for palliative radiotherapy have been validated. The NRF model is preferred because it is simpler and avoids the need to remember the weightings among the prognostic factors.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Development and Validation of a Prognostic Model Using Blood Biomarker Information for Prediction of Survival of Non-Small-Cell Lung Cancer Patients Treated With Combined Chemotherapy and Radiation or Radiotherapy Alone (NCT00181519, NCT00573040, and NCT00572325)

Purpose: Currently, prediction of survival for non-small-cell lung cancer patients treated with (chemo)radiotherapy is mainly based on clinical factors. The hypothesis of this prospective study was that blood biomarkers related to hypoxia, inflammation, and tumor load would have an added prognostic value for predicting survival. Methods and Materials: Clinical data and blood samples were collected prospectively (NCT00181519, NCT00573040, and NCT00572325) from 106 inoperable non-small-cell lung cancer patients (Stages I-IIIB), treated with curative intent with radiotherapy alone or combined with chemotherapy. Blood biomarkers, including lactate dehydrogenase, C-reactive protein, osteopontin, carbonic anhydrase IX, interleukin (IL) 6, IL-8, carcinoembryonic antigen (CEA), and cytokeratin fragment 21-1, were measured. A multivariate model, built on a large patient population (N = 322) and externally validated, was used as a baseline model. An extended model was created by selecting additional biomarkers. The model's performance was expressed as the area under the curve (AUC) of the receiver operating characteristic and assessed by use of leave-one-out cross validation as well as a validation cohort (n = 52). Results: The baseline model consisted of gender, World Health Organization performance status, forced expiratory volume, number of positive lymph node stations, and gross tumor volume and yielded an AUC of 0.72. The extended model included two additional blood biomarkers (CEA and IL-6) and resulted in a leave-one-out AUC of 0.81. The performance of the extended model was significantly better than the clinical model (p = 0.004). The AUC on the validation cohort was 0.66 and 0.76, respectively. Conclusions: The performance of the prognostic model for survival improved markedly by adding two blood biomarkers: CEA and IL-6.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Validation that Metabolic Tumor Volume Predicts Outcome in Head-and-Neck Cancer

Purpose: We have previously reported that metabolic tumor volume (MTV) obtained from pretreatment {sup 18}F-fluorodeoxydeglucose positron emission tomography (FDG PET)/ computed tomography (CT) predicted outcome in patients with head-and-neck cancer (HNC). The purpose of this study was to validate these results on an independent dataset, determine whether the primary tumor or nodal MTV drives this correlation, and explore the interaction with p16{sup INK4a} status as a surrogate marker for human papillomavirus (HPV). Methods and Materials: The validation dataset in this study included 83 patients with squamous cell HNC who had a FDG PET/CT scan before receiving definitive radiotherapy. MTV and maximum standardized uptake value (SUV{sub max}) were calculated for the primary tumor, the involved nodes, and the combination of both. The primary endpoint was to validate that MTV predicted progression-free survival and overall survival. Secondary analyses included determining the prognostic utility of primary tumor vs. nodal MTV. Results: Similarly to our prior findings, an increase in total MTV of 17 cm{sup 3} (difference between the 75th and 25th percentiles) was associated with a 2.1-fold increase in the risk of disease progression (p = 0.0002) and a 2.0-fold increase in the risk of death (p = 0.0048). SUV{sub max} was not associated with either outcome. Primary tumor MTV predicted progression-free (hazard ratio [HR] = 1.94; p < 0.0001) and overall (HR = 1.57; p < 0.0001) survival, whereas nodal MTV did not. In addition, MTV predicted progression-free (HR = 4.23; p < 0.0001) and overall (HR = 3.21; p = 0.0029) survival in patients with p16{sup INK4a}-positive oropharyngeal cancer. Conclusions: This study validates our previous findings that MTV independently predicts outcomes in HNC. MTV should be considered as a potential risk-stratifying biomarker in future studies of HNC.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Highly Efficient Training, Refinement, and Validation of a Knowledge-based Planning Quality-Control System for Radiation Therapy Clinical Trials

Purpose: To demonstrate an efficient method for training and validation of a knowledge-based planning (KBP) system as a radiation therapy clinical trial plan quality-control system. Methods and Materials: We analyzed 86 patients with stage IB through IVA cervical cancer treated with intensity modulated radiation therapy at 2 institutions according to the standards of the INTERTECC (International Evaluation of Radiotherapy Technology Effectiveness in Cervical Cancer, National Clinical Trials Network identifier: 01554397) protocol. The protocol used a planning target volume and 2 primary organs at risk: pelvic bone marrow (PBM) and bowel. Secondary organs at risk were rectum and bladder. Initial unfiltered dose-volume histogram (DVH) estimation models were trained using all 86 plans. Refined training sets were created by removing sub-optimal plans from the unfiltered sample, and DVH estimation models… and DVH estimation models were constructed by identifying 30 of 86 plans emphasizing PBM sparing (comparing protocol-specified dosimetric cutpoints V{sub 10} (percentage volume of PBM receiving at least 10 Gy dose) and V{sub 20} (percentage volume of PBM receiving at least 20 Gy dose) with unfiltered predictions) and another 30 of 86 plans emphasizing bowel sparing (comparing V{sub 40} (absolute volume of bowel receiving at least 40 Gy dose) and V{sub 45} (absolute volume of bowel receiving at least 45 Gy dose), 9 in common with the PBM set). To obtain deliverable KBP plans, refined models must inform patient-specific optimization objectives and/or priorities (an auto-planning “routine”). Four candidate routines emphasizing different tradeoffs were composed, and a script was developed to automatically re-plan multiple patients with each routine. After selection of the routine that best met protocol objectives in the 51-patient training sample (KBP{sub FINAL}), protocol-specific DVH metrics and normal tissue complication probability were compared for original versus KBP{sub FINAL} plans across the 35-patient validation set. Paired t tests were used to test differences between planning sets. Results: KBP{sub FINAL} plans outperformed manual planning across the validation set in all protocol-specific DVH cutpoints. The mean normal tissue complication probability for gastrointestinal toxicity was lower for KBP{sub FINAL} versus validation-set plans (48.7% vs 53.8%, P<.001). Similarly, the estimated mean white blood cell count nadir was higher (2.77 vs 2.49 k/mL, P<.001) with KBP{sub FINAL} plans, indicating lowered probability of hematologic toxicity. Conclusions: This work demonstrates that a KBP system can be efficiently trained and refined for use in radiation therapy clinical trials with minimal effort. This patient-specific plan quality control resulted in improvements on protocol-specific dosimetric endpoints.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Three-Dimensional Dosimetric Validation of a Magnetic Resonance Guided Intensity Modulated Radiation Therapy System

Purpose: To validate the dosimetric accuracy of a commercially available magnetic resonance guided intensity modulated radiation therapy (MRgIMRT) system using a hybrid approach: 3-dimensional (3D) measurements and Monte Carlo calculations. Methods and Materials: We used PRESAGE radiochromic plastic dosimeters with remote optical computed tomography readout to perform 3D high-resolution measurements, following a novel remote dosimetry protocol. We followed the intensity modulated radiation therapy commissioning recommendations of American Association of Physicists in Medicine Task Group 119, adapted to incorporate 3D data. Preliminary tests (“AP” and “3D-Bands”) were delivered to 9.5-cm usable diameter cylindrical PRESAGE dosimeters to validate the treatment planning system (TPS) for nonmodulated deliveries; assess the sensitivity, uniformity, and rotational symmetry of the PRESAGE dosimeters; and test the robustness of the remote dosimetry protocol. Following this, 4 clinical MRgIMRT plans (“MultiTarget,” “Prostate,” “Head/Neck,” and “C-Shape”) were measured using 13-cm usable diameter PRESAGE dosimeters. For all plans, 3D-γ (3% or 3 mm global, 10% threshold) passing rates were calculated and 3D-γ maps were examined. Point doses were measured with an IBA-CC01 ionization chamber for validation of absolute dose. Finally, by use of an in-house-developed, GPU-accelerated Monte Carlo algorithm (gPENELOPE), we independently calculated dose for all 6 Task Group 119 plans and compared against the TPS. Results: For PRESAGE measurements, 3D-γ analysis yielded passing rates of 98.7%, 99.2%, 98.5%, 98.0%, 99.2%, and 90.7% for AP, 3D-Bands, MultiTarget, Prostate, Head/Neck, and C-Shape, respectively. Ion chamber measurements were within an average of 0.5% (±1.1%) from the TPS dose. Monte Carlo calculations demonstrated good agreement with the TPS, with a mean 3D-γ passing rate of 98.5% ± 1.9% using a stricter 2%/2-mm criterion. Conclusions: We have validated the dosimetric accuracy of a commercial MRgIMRT system using high-resolution 3D techniques. We have demonstrated for the first time that hybrid 3D remote dosimetry is a comprehensive and feasible approach to commissioning MRgIMRT. This may provide better sensitivity in error detection compared with standard 2-dimensional measurements and could be used when implementing complex new magnetic resonance guided radiation therapy technologies.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Validation of numerical models for seismic fluid-structure-interaction analysis of nuclear, safety-related equipment

Seismic design, qualification, and risk assessment of nuclear safety-related vessels filled with liquid will have to consider the interaction between the vessel (tank), the contained liquid, and submerged components, if any. Seismic fluid-structure-interaction (FSI) analysis of nuclear vessels will rely on numerical models, which are required to be verified and validated. This study validates previously-verified numerical models using test data generated from earthquake-simulator experiments involving a cylindrical tank. Two solvers in LS-DYNA for FSI simulations are used for the numerical analysis: Arbitrary-Lagrangian-Eulerian (ALE) and Incompressible Computational Fluid Dynamics (ICFD). Numerical and test results are compared for responses critical to seismic design of advanced reactor vessels: hydrodynamic pressures on the tank wall, reactions at the support, and wave heights of the contained liquid. Analysis is performed for one-, two-, and three-directional seismic inputs with a range of intensity, and rocking motions. The accuracy of the numerical results and different methods for outputting wave heights are discussed. Recommendations for validation of seismic FSI numerical models of advanced reactors are provided. As a result, the validation exercise presented in this study is broadly applicable to cylindrical tanks, regardless of industry sector.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

A framework for feasibility-level validation of high-resolution wave hindcast models

The value of long-term wave hindcasts for investigating wave climates, wave energy resources, and extreme wave conditions has motivated research developing, calibrating and validating wave hindcast models. Past hindcast model validation studies examined the accuracy in modeling bulk wave parameters of overall sea states without considering the dependency of the model's skill within different sea states. In the present study, a framework for wave hindcast model validation is developed by examining the model accuracy for the most frequently occurring sea states, sea states contributing the most energy to total wave power, sea states associated with hurricane events, and those with the largest model error. Here, validations using bulk wave parameters and frequency-directional spectra at these key sea states and extreme wave conditions based on univariate and bivariate-contour methods provide insights to improve model accuracy, identifying the model's strong and weak points, and pathways for improvement, e.g., modeling wave-current interactions and adjusting wind data. This study adds to a growing body of research demonstrating that a carefully calibrated and verified spectral wave hindcast model can be used to estimate key wave energy parameters over a wide range of wave energy climates, as well as their spatial, temporal, frequency, directional, and probabilistic distributions.

54 ENVIRONMENTAL SCIENCES↗

Characterization and validation of an in silico toxicology model to predict the mutagenic potential of drug impurities*

Control and minimization of human exposure to potential genotoxic impurities found in drug substances and products is an important part of preclinical safety assessments of new drug products. The FDA's 2008 draft guidance on genotoxic and carcinogenic impurities in drug substances and products allows use of computational quantitative structure–activity relationships (QSAR) to identify structural alerts for known and expected impurities present at levels below qualified thresholds. This study provides the information necessary to establish the practical use of a new in silico toxicology model for predicting Salmonella t. mutagenicity (Ames assay outcome) of drug impurities and other chemicals. We describe the model's chemical content and toxicity fingerprint in terms of compound space, molecular and structural toxicophores, and have rigorously tested its predictive power using both cross-validation and external validation experiments, as well as case studies. Consistent with desired regulatory use, the model performs with high sensitivity (81%) and high negative predictivity (81%) based on external validation with 2368 compounds foreign to the model and having known mutagenicity. A database of drug impurities was created from proprietary FDA submissions and the public literature which found significant overlap between the structural features of drug impurities and training set chemicals in the QSAR model. Overall, the model's predictive performance was found to be acceptable for screening drug impurities for Salmonella mutagenicity. -- Highlights: ► We characterize a new in silico model to predict mutagenicity of drug impurities. ► The model predicts Salmonella mutagenicity and will be useful for safety assessment. ► We examine toxicity fingerprints and toxicophores of this Ames assay model. ► We compare these attributes to those found in drug impurities known to FDA/CDER. ► We validate the model and find it has a desired predictive performance.

60 APPLIED LIFE SCIENCES↗

A practical method to test the validity of the standard Gumbel distribution in logit-based multinomial choice models of travel behavior

Most multinomial choice models (e.g., the multinomial logit model) adopted in practice assume an extreme-value Gumbel distribution for the random components (error terms) of utility functions. This distributional assumption offers a closed-form likelihood expression when the utility maximization principle is applied to model choice behaviors. As a result, model coefficients can be easily estimated using the standard maximum likelihood estimation method. However, maximum likelihood estimators are consistent and efficient only if distributional assumptions on the random error terms are valid. It is therefore critical to test the validity of underlying distributional assumptions on the error terms that form the basis of parameter estimation and policy evaluation. In this paper, a practical yet statistically rigorous method is proposed to test the validity of the distributional assumption on the random components of utility functions in both the multinomial logit (MNL) model and multiple discrete-continuous extreme value (MDCEV) model. Based on a semi-nonparametric approach, a closed-form likelihood function that nests the MNL or MDCEV model being tested is derived. The proposed method allows traditional likelihood ratio tests to be used to test violations of the standard Gumbel distribution assumption. Simulation experiments are conducted to demonstrate that the proposed test yields acceptable Type-I and Type-II error probabilities at commonly available sample sizes. The test is then applied to three real-world discrete and discrete-continuous choice models. For all three models, the proposed test rejects the validity of the standard Gumbel distribution in most utility functions, calling for the development of robust choice models that overcome adverse effects of violations of distributional assumptions on the error terms in random utility functions.

30 DIRECT ENERGY CONVERSION↗

Approaching the investigation of plasma turbulence through a rigorous verification and validation procedure: A practical example

In the present work, a Verification and Validation procedure is presented and applied showing, through a practical example, how it can contribute to advancing our physics understanding of plasma turbulence. Bridging the gap between plasma physics and other scientific domains, in particular, the computational fluid dynamics community, a rigorous methodology for the verification of a plasma simulation code is presented, based on the method of manufactured solutions. This methodology assesses that the model equations are correctly solved, within the order of accuracy of the numerical scheme. The technique to carry out a solution verification is described to provide a rigorous estimate of the uncertainty affecting the numerical results. A methodology for plasma turbulence code validation is also discussed, focusing on quantitative assessment of the agreement between experiments and simulations. The Verification and Validation methodology is then applied to the study of plasma turbulence in the basic plasma physics experiment TORPEX [Fasoli et al., Phys. Plasmas 13, 055902 (2006)], considering both two-dimensional and three-dimensional simulations carried out with the GBS code [Ricci et al., Plasma Phys. Controlled Fusion 54, 124047 (2012)]. The validation procedure allows progress in the understanding of the turbulent dynamics in TORPEX, by pinpointing the presence of a turbulent regime transition, due to the competition between the resistive and ideal interchange instabilities.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗