Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation Studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

In-Trail Procedure Air Traffic Control Procedures Validation Simulation Study

In August 2007, Airservices Australia (Airservices) and the United States National Aeronautics and Space Administration (NASA) conducted a validation experiment of the air traffic control (ATC) procedures associated with the Automatic Dependant Surveillance-Broadcast (ADS-B) In-Trail Procedure (ITP). ITP is an Airborne Traffic Situation Awareness (ATSA) application designed for near-term use in procedural airspace in which ADS-B data are used to facilitate climb and descent maneuvers. NASA and Airservices conducted the experiment in Airservices simulator in Melbourne, Australia. Twelve current operational air traffic controllers participated in the experiment, which identified aspects of the ITP that could be improved (mainly in the communication and controller approval process). Results showed that controllers viewed the ITP as valid and acceptable. This paper describes the experiment design and results.

Chartrand, Ryan C.↗

Total experimental uncertainty in hydrodynamic testing of a semisubmersible wind turbine, considering numerical propagation of systematic uncertainty

Quantifying the uncertainty in experimental results is a vital step in properly validating numerical simulation tools for designing floating wind turbines; without a good understanding of the experimental uncertainties, it is impossible to confirm if numerical simulation tools can capture the physics with acceptable accuracy. Recent validation studies suggest that the wave-induced, low-frequency surge and pitch motions of semisubmersible-type floating wind turbines are consistently underpredicted by numerical simulations, but it has not been possible to state whether or not this underprediction is within the level of experimental error. Here, previously assessed systematic uncertainty components in hydrodynamic tests of the OC5-DeepCwind semisubmersible are propagated to response metrics of interest using numerical simulation tools, and combined with the system's random uncertainty to obtain the total experimental uncertainty. The uncertainty in the low-frequency response metrics is found to be most sensitive to the system properties (e.g., mooring stiffness and center of gravity), and also the wave elevation. The results of the present study suggest that the underprediction of the low-frequency response behavior observed in previous validation studies is larger than the experimental uncertainty.

17 WIND ENERGY↗

OVERFLOW Validation for Predicting Plume Impingement of Underexpanded Axisymmetric Jets onto Angled Flat Plates

This report documents how OVERFLOW, a computational fluid dynamics code, predicts plume impingement of underexpanded axisymmetric jets onto both perpendicular and inclined flat plates. The effects of the plume impinging on a range of plate inclinations varying from 90deg to 30deg are investigated and compared to the experimental results in Reference 1 and 2. The flow fields are extremely complex due to the interaction between the shock waves from the free jet and those deflected by the plate. Additionally, complex mixing effects create very intricate structures in the flow. The experimental data is very limited, so these validation studies will focus only on cold plume impingement on flat and inclined plates. This validation study will help quantify the error in the OVERFLOW simulation when applied to stage separation scenarios.

Lee, Henry C.↗

Numerical studies and metric development for validation of magnetohydrodynamic models on the HIT-SI experiment

We present application of three scalar metrics derived from the Biorthogonal Decomposition (BD) technique to evaluate the level of agreement between macroscopic plasma dynamics in different data sets. BD decomposes large data sets, as produced by distributed diagnostic arrays, into principal mode structures without assumptions on spatial or temporal structure. These metrics have been applied to validation of the Hall-MHD model using experimental data from the Helicity Injected Torus with Steady Inductive helicity injection experiment. Each metric provides a measure of correlation between mode structures extracted from experimental data and simulations for an array of 192 surface-mounted magnetic probes. Numerical validation studies have been performed using the NIMROD code, where the injectors are modeled as boundary conditions on the flux conserver, and the PSI-TET code, where the entire plasma volume is treated. Initial results from a comprehensive validation study of high performance operation with different injector frequencies are presented, illustrating application of the BD method. Using a simplified (constant, uniform density and temperature) Hall-MHD model, simulation results agree with experimental observation for two of the three defined metrics when the injectors are driven with a frequency of 14.5 kHz.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Unmanned Aircraft Systems Detect and Avoid System: End-to-End Verification and Validation Simulation Study of Minimum Operations Performance Standards for Integrating Unmanned Aircraft into the National Airspace System

As Unmanned Aircraft Systems (UAS) make their way to mainstream aviation operations within the National Airspace System (NAS), research efforts are underway to develop a safe and effective environment for their integration into the NAS. Detect and Avoid (DAA) systems are required to account for the lack of "eyes in the sky" due to having no human on-board the aircraft. The technique, results, and lessons learned from a detailed End-to-End Verification and Validation (E2-V2) simulation study of a DAA system representative of RTCA SC-228's proposed Phase I DAA Minimum Operational Performance Standards (MOPS), based on specific test vectors and encounter cases, will be presented in this paper.

Ghatas, Rania W.↗

The Effects of Severity of Losses of Well Clear on Minimum Operations Performance Standards End-To-End Verification and Validation Simulation Study for Integrating Unmanned Aircraft Systems into the National Airspace System Using Detect and Avoid Systems

As Unmanned Aircraft Systems (UAS) make their way to mainstream aviation operations within the National Airspace System (NAS), research efforts are underway to develop a safe and effective environment for their integration into the NAS. Detect and Avoid (DAA) systems are required to account for the lack of “eyes in the sky” due to having no human on-board the aircraft. The technique, results, and lessons learned from a detailed End-to-End Verification and Validation (E2-V2) simulation study of a DAA system representative of RTCA Special Committee(SC)-228’s proposed Phase I DAA Minimum Operational Performance Standards (MOPS), based on specific test vectors and encounter cases, will be presented in this paper.

Ghatas, Rania W.↗

Study of Whisper Statistics for Criticality Safety Code Validation

Whisper is computational software designed to assist with validation studies with the Monte Carlo particle transport package MCNP. Historical approaches rely on expert based judgment to select benchmarks while Whisper uses sensitivity/uncertainty (S/U) methods to select relevant benchmarks to a particular application model. Whisper will also derive a calculational margin and margin of subcriticality (MOS) that may be used to generate an upper subcritical limit (USL) for a particular application model. Whisper finds benchmark experiments whose isotope sensitivity profiles align best with the MCNP model in question, and assign a correlation coefficient ('ck' in Whisper parlance) to each selected benchmark as a measure of how closely those profiles agree. When ck values are high, there is less uncertainty between model and benchmarks and a higher USL is possible, relative to cases when ck values are low. The default Whisper settings recommends a 100,000 particles per cycle run for 500 active cycles, resulting in 50 M active neutron histories per application run. This is computationally intensive and may not be necessary to produce accurate results. A Whisper statistical study was done varying the neutron histories per cycle from 10,000 to the default 100,000. A lower number of neutron histories will allow Whisper to be used on low memory systems such as laptops. The intent of this paper is to present the changes in the Whisper results as the number of neutrons histories run is varied.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Study of Radiative Heat Transfer and Flow Physics from Medium-scale Methanol Pool Fire Simulations [Slides]

Analysis of methanol pool fire conducted as part of validation study for SIERRA/Fuego. Radiation model was effectively calibrated by modifying radiation model parameters for methanol. Computing integrated buoyancy flux, entrainment rate, and turbulent kinetic energy allowed for evaluation of less typical quantities in this validation study. Quantities were compared with experimental data or correlations and generally showed agreement. TKE needed fine mesh to be computed accurately. Predicted flame height less sensitive to variations in mixture fraction than temperature. Mixture fraction is a preferable threshold variable for this application.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Internal Standard Triggered-Parallel Reaction Monitoring Mass Spectrometry Enables Multiplexed Quantification of Candidate Biomarkers in Plasma

Despite advances in proteomic technologies, clinical translation of plasma biomarkers remains low, partly due to a major bottleneck between the discovery of candidate biomarkers and costly clinical validation studies. Due to a dearth of multiplexable assays, generally only a few candidate biomarkers are tested, and the validation success rate is accordingly low. Previously, mass spectrometry-based approaches have been used to fill this gap but feature poor quantitative performance and were generally limited to hundreds of proteins. Here, we demonstrate the capability of an internal standard triggered-parallel reaction monitoring (IS-PRM) assay to greatly expand the numbers of candidates that can be tested with improved quantitative performance. The assay couples immunodepletion and fractionation with IS-PRM and was developed and implemented in human plasma to quantify 5176 peptides representing 1314 breast cancer biomarker candidates. Characterization of the IS-PRM assay demonstrated the precision (median % CV of 7.7%), linearity (median R 2 > 0.999 over 4 orders of magnitude), and sensitivity (median LLOQ < 1 fmol, approximately) to enable rank-ordering of candidate biomarkers for validation studies. Using three plasma pools from breast cancer patients and three control pools, 893 proteins were quantified, of which 162 candidate biomarkers were verified in at least one of the cancer pools and 22 were verified in all three cancer pools. The assay greatly expands capabilities for quantification of large numbers of proteins and is well suited for prioritization of viable candidate biomarkers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

siRNA high throughput screening identifies regulators of chloropicrin and hydrogen fluoride injury in human corneal epithelial cell models

Corneal injuries induced by various toxicants result in similar clinical presentations such as corneal opacity and neovascularization. Many studies suggest that several weeks post-exposure a convergence of the molecular mechanisms drives these progressive pathologies. However, chemical agents vary in toxicological properties, and early molecular responses are anticipated to be somewhat dissimilar for different toxicants. In this report we chose 3120 targets from the Dharmacon Human Druggable genome to screen for chloropicrin (CP) and hydrogen fluoride (HF) corneal injury as we hypothesized that targets identified in vitro may be effective as therapeutic targets in future studies. Human immortalized corneal epithelial cells (SV40-HCEC) were used for screening. Cell viability and IL-8 were analyzed to down-select hits into validation studies, where multiplex cytokine analysis and high content analysis were performed to understand toxicant effect and target function. Some endpoints were also evaluated in a second human immortalized corneal epithelial cell line, TCEpi. Over 20 targets entered validation studies for CP and HF; of these, only three targets were shared: NR3C1, RELA, and KMT5A. These findings suggest that early molecular responses to different toxicants may be somewhat distinctive and present dissimilar targets for possible early intervention.

60 APPLIED LIFE SCIENCES↗

Investigating Similarity Differences for Light-Water-Moderated and Polyethylene-Moderated Systems

Oak Ridge National Laboratory has performed validation studies in support of Pacific Northwest Laboratory’s analysis of the Sum-of-Fractions method. Work in a companion paper examines the validation methods and results for various mixtures of fissile isotopes in various concentrations moderated and reflected by light-water and polyethylene. Those results indicate a greater coverage of critical experiments for validating light water moderated and reflected systems vs. those with polyethylene. The work presented here details the analysis of differences between light-water and polyethylene systems developed from the different concentration mixtures utilized in the Sum-of-Fractions validation study. Differences in actinide contributions are detailed, explaining the differences in ck for the various systems. The available tools and analysis techniques in TSUNAMI are described to illustrate how these types of differences can be understood by practitioners.

07 ISOTOPE AND RADIATION SOURCES↗

Validation of the Nasa Integrated Medical Model: a Space Flight Medical Risk Prediction Tool

The Human Research Program funded the development of the Integrated Medical Model (IMM) to quantify the medical component of overall mission risk. The IMM uses Monte Carlo simulation methodology, incorporating space flight and ground medical data, to estimate the probability of mission medical outcomes and resource utilization. To determine the credibility of IMM output, the IMM project team completed two validation studies that compared IMM predicted output to observed medical events from a selection of Shuttle Transportation System (STS) and International Space Station (ISS) missions. The validation study results showed that the IMM underpredicted the occurrence of ~10% of the modeled medical conditions for the STS missions and overpredicted ~20% of the modeled medical conditions for the ISS missions. These findings imply that the strength of IMM predictions to inform decisions depends on simulated mission specifications including length. This discrepancy could result from medical recording differences between ISS and STS that possibly influence observed incidence rates, IMM combining all "mission type" data as constant occurrence rate or fixed proportion across both mission types, misspecification of symptoms to conditions, and gaps in the literature informing the model. Some of these issues will be alleviated by updating the IMM source data through incorporation of the observed validation data.

medical equipment↗

Validation of the NASA Integrated Medical Model: a Space Flight Medical Risk Prediction Tool

The Human Research Program funded the development of the Integrated Medical Model (IMM) to quantify the medical component of overall mission risk. The IMM uses Monte Carlo simulation methodology, incorporating space flight and ground medical data, to estimate the probability of mission medical outcomes and resource utilization. To determine the credibility of IMM output, the IMM project team completed two validation studies that compared IMM predicted output to observed medical events from a selection of Shuttle Transportation System (STS) and International Space Station (ISS) missions. The validation study results showed that the IMM underpredicted the occurrence of ~10% of the modeled medical conditions for the STS missions and overpredicted ~20% of the modeled medical conditions for the ISS missions. These findings imply that the strength of IMM predictions to inform decisions depends on simulated mission specifications including length. This discrepancy could result from medical recording differences between ISS and STS that possibly influence observed incidence rates, IMM combining all "mission type" data as constant occurrence rate or fixed proportion across both mission types, misspecification of symptoms to conditions, and gaps in the literature informing the model. Some of these issues will be alleviated by updating the IMM source data through incorporation of the observed validation data.

risk assessment↗

Evaluation of micromilling/conventional isotope ratio mass spectrometry and secondary ion mass spectrometry of δ 18 O values in fish otoliths for sclerochronology

Stable oxygen isotope ratios (δ 18 O values) measured in fish otoliths can provide valuable detailed information on fish life history, fish age determination, and ocean thermography. Traditionally, otoliths are sampled by micromilling followed by isotope ratio mass spectrometry (IRMS), but direct analysis by secondary ion mass spectrometry (SIMS) is becoming more common. However, these two methods have not been compared to determine which, if either, is better for fish age validation studies. Hence, the goals were to: (1) determine if the δ 18 O signatures from the two different methods are similar, (2) determine which method is better for fish age validation studies, and (3) examine biogeographic and migration history. Both analytical techniques, micromilling/IRMS and SIMS, were used to measure δ 18 O values in six Pacific cod (Gadus macrocephalus) otoliths. A series of measurements was made from the center of each otolith to its edge to develop a life-history δ 18 O signature for each fish. The sampling resolution of SIMS analyses was 2–3 times greater than that obtained by micromilling/IRMS. We found an offset between SIMS and micromilling/IRMS δ 18 O values, about 0.5‰ on average, with SIMS yielding lower values. However, the δ 18 O patterns from both methods (i.e., the number of δ 18 O maxima) correspond to the estimated age determined by otolith growth-zone counts, validating fish age determination methods. Both techniques resolved δ 18 O life-history signatures and showed patterns consistent with seasonal variation in temperatures and changes due to fish migration. When otoliths are large, micromilling/IRMS can provide adequate resolution for fish age validation. Finally, SIMS is the better option if greater sampling resolution is required, such as when otoliths are small or specimens are longer lived and have compact growth zones.

54 ENVIRONMENTAL SCIENCES↗

Continued Research into Characterizing the Preturbulence Environment for Sensor Development, New Hazard Algorithms and Experimental Flight Planning

The purpose of the research was to develop and test improved hazard algorithms that could result in the development of sensors that are better able to anticipate potentially severe atmospheric turbulence, which affects aircraft safety. The research focused on employing numerical simulation models to develop improved algorithms for the prediction of aviation turbulence. This involved producing both research simulations and real-time simulations of environments predisposed to moderate and severe aviation turbulence. The research resulted in the following fundamental advancements toward the aforementioned goal: 1) very high resolution simulations of turbulent environments indicated how predictive hazard indices could be improved resulting in a candidate hazard index that indicated the potential for improvement over existing operational indices, 2) a real-time turbulence hazard numerical modeling system was improved by correcting deficiencies in its simulation of moist convection and 3) the same real-time predictive system was tested by running the code twice daily and the hazard prediction indices updated and improved. Additionally, a simple validation study was undertaken to determine how well a real time hazard predictive index performed when compared to commercial pilot observations of aviation turbulence. Simple statistical analyses were performed in this validation study indicating potential skill in employing the hazard prediction index to predict regions of varying intensities of aviation turbulence. Data sets from a research numerical model where provided to NASA for use in a large eddy simulation numerical model. A NASA contractor report and several refereed journal articles where prepared and submitted for publication during the course of this research.

Kaplan, Michael L.↗

Numerical Study and Validation of Melting and Solidification in PCM Embedded Heat Exchangers with Straight Tube

Latent heat thermal energy storage (LHTES) systems have shown great potential to enable reliable use of renewable energy and load shifting. LHTES offer high storage density and release energy at near constant temperature because of its use of phase change materials (PCMs). The cylindrical PCM heat exchangers (PCMHX) are one of the most used technologies due to their simplicity. Numerical models for such PCMHX enable engineers to estimate their performance for different design parameters and operating conditions without having to test them all. However, modeling the phase change phenomena can be challenging. To better understand the difficulties involving accurate modeling of PCMHX, a cylindrical latent storage unit filled with PCM and water as in-tube heat transfer fluid (HTF) is numerically investigated. This paper presents a study based on a 2D-axisymmetric model of a straight tube embedded in PCM in a cylindrical container. CFD is used to study the charging (melting) and discharging (solidification) phenomena. The models are validated against experimental and numerical data from the literature. The predicted local PCM temperature profile over time agrees within 2K compared to the experimental values. The paper also presents a simple method to estimate the melting and solidification phase change temperature range from limited data provided by PCM manufacturers.

PCM, melting, solidification, CFD, heat exchanger↗

Development, verification, and validation of comprehensive acoustic fluid-structure interaction capabilities in an open-source computational platform

The acoustic fluid-structure interaction (FSI) formulation is a practical numerical approach for the seismic analysis of fluid-filled tanks. However, there are no verification and validation studies reported in the literature that demonstrate the ability of an acoustic FSI numerical model to predict responses important to structural and mechanical design for intense translational and rotational earthquake inputs. Herein, an acoustic FSI formulation is implemented in the open-source Multiphysics Object-Oriented Simulation Environment (MOOSE), and is formally verified and validated using analytical solutions and code-to-code verification, and experimental data, respectively. The analytical solutions are for small amplitude, unidirectional seismic inputs. The code-to-code verification utilizes a previously verified and validated Arbitrary Lagrangian-Eulerian (ALE) numerical model in the commercial finite element code LS-DYNA. The validation studies utilize a comprehensive data set assembled from results of 3D earthquake-simulator tests of a fluid-filled vessel. The acoustic numerical model in MOOSE is verified and validated for hydrodynamic pressures and support reactions except for cases that involve significant convective response. For small amplitude inputs, numerically predicted wave heights match those of the analytical solutions. The numerical model is not verified and validated for wave height calculations under intense 3D seismic inputs. The run times for the acoustic FSI simulations in MOOSE are an order of magnitude, or more, shorter than for the corresponding ALE simulations in LS-DYNA. The utility of the MOOSE acoustic FSI implementation is demonstrated by seismic analysis of a building equipped with a fluid-filled, advanced nuclear reactor.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Initial transport and turbulence analysis and gyrokinetic simulation validation in NSTX-U L-mode plasmas

Transport analysis, ion-scale turbulence measurements, and initial linear and nonlinear gyrokinetic simulations are reported for a transport validation study based on low aspect ratio NSTX-U L-mode discharges. The relatively long, stationary L-modes enabled by the upgraded centerstack provide a more ideal target for transport validation studies that were not available during NSTX operation. Transport analysis shows that anomalous electron transport dominates energy loss while ion thermal transport is well described by neoclassical theory. Linear gyrokinetic GYRO analysis predicts that ion temperature gradient (ITG) modes are unstable around normalized radii $\rho$=0.6-0.8, although $E\timesB$ shearing rates are larger than the linear growth rates over much of that region. Deeper in the core ($\rho$=0.4-0.6), electromagnetic microtearing modes (MTM) are unstable as a consequence of the relatively high beta and collisionality in these particular discharges. Consistent with the linear analysis, local, nonlinear ion-scale GYRO simulations predict strong ITG transport at $\rho$=0.76, whereas electromagnetic MTM transport is important at $\rho$=0.47. The prediction of ion-scale turbulence is consistent with 2D beam emission spectroscopy (BES) that measures the presence of broadband ion-scale fluctuations. Interestingly, the BES measurements also indicate the presence of bi-modal poloidal phase velocity propagation that could be indicative of two different turbulence types. However, in the region between ($\rho$=0.56, 0.66), ion-scale simulations are strongly suppressed by the locally large $E\timesB$ shear. Instead, electron temperature gradient (ETG) turbulence simulations predict substantial transport, illustrating electron-scale contributions can be important in low aspect ratio L-modes, similar to recent analysis at conventional aspect ratio. However, agreement within experimental uncertainties has not been demonstrated, which requires additional simulations to test parametric sensitivities. The potential need to include profile-variation effects (due to the relatively large value of $\rho_*$=$\rho_i$/a at low aspect ratio), including electromagnetic and possibly multi-scale effects, is also discussed.

Validation↗