Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Development and validation of an imaging and clinical scoring system to predict early mortality in spontaneous ruptured hepatocellular carcinoma treated with transarterial embolization

Purpose: To develop and validate a scoring system using a combination of imaging and clinical parameters to predict 30-day mortality in ruptured HCC (rHCC) patients after transarterial embolization (TAE). Methods: 98 consecutive patients with rHCC who underwent abdominal CT and subsequent TAE between January 2007 and December 2016 were retrospectively reviewed. The CT scans were reviewed by two radiologists blinded to the patient outcome. Clinical parameters including serum bilirubin, albumin, INR, creatinine, and hemoglobin were recorded. Independent risk factors for 30-day mortality after TAE were identified using multivariate binary logistic regression, for development of a scoring system. The scoring system was then validated in 20 patients between January 2017 and May 2018. Results: In the development cohort, bilobar tumor distribution (OR = 29.6), clinical parameters of bilirubin > 2.5 mg/dL (OR = 5.9), and albumin < 30 g/L (OR = 4.1) were independent predictors for 30-day mortality. A 6-point score was derived and yielded area-under-the-receiver-operating-characteristic-curve (AUC) of 0.904. A score ≥ 4 resulted in sensitivity of 80.5% and specificity of 91.2% for 30-day mortality. In the validation cohort, AUC for 30-day mortality was 0.939. A score ≥ 4 resulted in sensitivity of 81.2% and specificity of 88.9%. In both development and validation cohorts, the proposed scoring system was better than biochemical components of Child–Pugh score and serum bilirubin to predict 30-day mortality. Conclusion: Imaging and clinical parameters can be combined into a scoring system to accurately predict 30-day mortality after TAE in rHCC patients. The score may help identify and counsel high-risk patients.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Comparison and validation of the QuEChERSER mega-method for determination of per- and polyfluoroalkyl substances in foods by liquid chromatography with high-resolution and triple quadrupole mass spectrometry

Instances of food contamination with per- and polyfluoroalkyl substances (PFAS) continue to occur globally, but sample preparation and analytical methods are quite limited and often monitor for a small percentage of known PFAS. This study aimed to evaluate, validate, and compare performance of two instruments with the recently developed “quick, easy, cheap, effective, rugged, safe, efficient, and robust” (QuEChERSER) sample preparation mega-method – a method developed to monitor chemicals over a broad range of physicochemical properties. Initial evaluation of the QuEChERSER mega-method for determination of PFAS in food demonstrated recoveries, matrix interferences, and co-extractive removal comparable to (or better than) US Food and Drug Administration (FDA) and USDA Food Safety and Inspection Service (FSIS) methods. Subsequent validation of QuEChERSER in beef, catfish, chicken, pork, liquid eggs, and powdered eggs on a high-resolution mass spectrometer achieved acceptable recoveries (70–120%) and precision (RSDs ≤20%) for all 33 target analytes at the 1 and 5 ng g –1 levels and 67–88% of analytes at the 0.1 ng g –1 level, depending on the matrix. Additional validation was performed by tandem mass spectrometry on a triple quadrupole instrument. This approach provided no non-detects and better recoveries at the 0.1 ng g –1 level than the HRMS method but exhibited more variability at 1 and 5 ng g –1 spiking levels. Analysis of NIST SRMs 1946 and 1947 gave accuracies of 70–117%. Furthermore, these results demonstrate the capability of combining PFAS analysis with a mega-method previously validated for 350 analytes, while collecting non-target data for future retrospective analysis of emerging alternatives with a high-resolution mass spectrometry method.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A non-cooperative meta-modeling game for automated third-party calibrating, validating and falsifying constitutive laws with parallelized adversarial attacks

The evaluation of constitutive models, especially for high-risk and high-regret engineering applications, requires efficient and rigorous third-party calibration, validation and falsification. While there are numerous efforts to develop paradigms and standard procedures to validate models, difficulties may arise due to the sequential, manual, and often biased nature of the commonly adopted calibration and validation processes, thus slowing down data collections, hampering the progress towards discovering new physics, increasing expenses and possibly leading to misinterpretations of the credibility and application ranges of proposed models. This work attempts to introduce concepts from game theory and machine learning techniques to overcome many of these existing difficulties. Here, we introduce an automated meta-modeling game where two competing AI agents systematically generate experimental data to calibrate a given constitutive model and to explore its weakness such that the experiment design and model robustness can be improved through competitions. The two agents automatically search for the Nash equilibrium of the meta-modeling game in an adversarial reinforcement learning framework without human intervention. In particular, a protagonist agent seeks to find the more effective ways to generate data for model calibrations, while an adversary agent tries to find the most devastating test scenarios that expose the weaknesses of the constitutive model calibrated by the protagonist. By capturing all possible design options of the laboratory experiments into a single decision tree, we recast the design of experiments as a game of combinatorial moves that can be resolved through deep reinforcement learning by the two competing players. Our adversarial framework emulates idealized scientific collaborations and competitions among researchers to achieve a better understanding of the application range of the learned material laws and prevent misinterpretations caused by conventional AI-based third-party validation. Numerical examples are given to demonstrate the wide applicability of the proposed meta-modeling game with adversarial attacks on both human-crafted constitutive models and machine learning models.

97 MATHEMATICS AND COMPUTING↗

Quantitative validation of carbon-fiber laminate low velocity impact simulations

Simulations of low velocity impact with a flat cylindrical indenter upon a carbon fiber fabric reinforced polymer laminate are rigorously validated. Comparison of the impact energy absorption between the model and experiment is used as the validation metric. Additionally, non-destructive evaluation, including ultrasonic scans and three-dimensional computed tomography, provide qualitative validation of the models. The simulations include delamination, matrix cracks and fiber breaks. An orthotropic damage and failure constitutive model, capable of predicting progressive damage and failure, is developed in conjunction and described. An ensemble of simulations incorporating model parameter uncertainties is used to predict a response distribution which is then compared to experimental output using appropriate statistical methods. Lastly, the model form errors are exposed and corrected for use in an additional blind validation analysis. The result is a quantifiable confidence in material characterization and model physics when simulating low velocity impact in structures of interest.

36 MATERIALS SCIENCE↗

Experimental validation of solid oxide fuel cell polarization modeling: An LSM-YSZ/YSZ/Ni-YSZ case study

Polarization modeling based on the measured I-V curves is a useful tool for analyzing SOFC performance and diagnosing performance limitations. Using the polarization model, the overpotential of a cell is usually separated into different polarization contributions, including area specific ohmic polarization, activation polarization, and anodic and cathodic concentration polarizations. In this study, we aim to experimentally validate the accuracy of the polarization model. As a case study, anode-supported cells with LSM-YSZ/YSZ/Ni-YSZ configuration are used. By curve-fitting the I-V curves of a cell tested under different cathode oxygen partial pressures into the polarization model, the contributions of different polarization losses are quantified. To validate the polarization model, independent experiments/studies including electrochemical impedance spectroscopy, cathode kinetics study, ex-situ diffusivity measurement, and tortuosity measurement using 3D reconstructed anode are conducted. The results from polarization modeling and from validation studies are in good agreement, thereby validating the polarization model for SOFC performance analysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Modeling and Experimental Validation of a Direct-Contact Counter-Flow Fluidized Bed Heat Exchanger for Thermal Energy Storage (TES) Applications

Particle-based thermal energy storage (TES) systems are an emerging energy storage technology. The technological advances have reduced costs, making TES more competitive and reliable in the marketplace but an efficient and reliable operation is heavily dependent on coherent heat transfer between air to particles or vice versa. The particle-based TES technologies provide an intermediate system that can store energy for short (0-10 h), long (10-200 h) and seasonal (> 200 h) timescales. The TES systems store energy by converting electricity to thermal energy; electricity can be directly sourced intermittent generation technologies and/or the grid, helping manage peak loads and other mismatches in supply and demand. The overall efficiency of the TES system depends on the performance of system components (particle storage silos and particle transfer mechanism etc.). The particle heat exchanger is one of the key system components that affects the system efficiency. The pressurized fluidized bed heat exchanger (PFB HX) performance is challenging to predict due to the chaotic behavior of particle and fluid interaction. This research presents a computational study of a novel direct-contact, counter-flow and air-to-particles PFB HX, that contributes in advancing the particle-based long-duration TES technologies. For the current analysis an unsteady Eulerian-Eulerian CFD model was developed and validated against experiments performed at the National Laboratory of the Rockies for two particle sizes (600 ..mu..m and 825 ..mu..m ). Following validation, parametric simulations were conducted to evaluate the effects of interphase drag models (Syamlal-O'Brien and Gidaspow), particle size, bed height and the influence of a frictional-viscosity term on hydrodynamics and heat transfer between the air & particles. The key findings from the analysis are: (1) for the studied operating window Syamlal-O'Brien provides superior agreement with measured gas temperatures (errors generally < 10%) while Gidaspow shows large deviations for the coarse particle case; (2) model predictions are most sensitive in the lower 0.2 m above the air distributor where bubble initiation and local mixing dominate interphase heat transfer; (3) representation of the distributor (number of inlet ports) materially affects predicted local mixing and temperature stratification; and (4) the Eulerian-Eulerian framework reproduces bulk thermal trends but shows regime dependent limitations for coarse particles, motivating mesoscale informed closures for scale-up analysis for future studies. These results provide validated guidance for drag selection and distributor design in particle-based thermal energy storage applications. Collectively, the validated model and parametric results quantify key drivers of PHB-HX performance and provide practical guidance for design and optimization. The results provide confidence in the model predictability and provide a step forward to improve on heat exchange performance. The demonstrated performance and modeling approach support the deployment and further development of this novel PHB-HX concept for robust, particle-based long-duration thermal energy storage systems.

25 ENERGY STORAGE↗

Validation of two-layer model for underexpanded hydrogen jets

Previous studies have shown that the two-layer model more accurately predicts hydrogen dispersion than the conventional notional nozzle models without significantly increasing the computational expense. However, the model was only validated for predicting the concentration distribution and has not been adequately validated for predicting the velocity distributions. In the present study, particle imaging velocimetry (PIV) was used to measure the velocity field of an underexpanded hydrogen jet released at 10 bar from a 1.5 mm diameter orifice. The two-layer model was the used to calculate the inlet conditions for a two-dimensional axisymmetric CFD model to simulate the hydrogen jet downstream of the Mach disk. The predicted velocity spreading and centerline decay rates agreed well with the PIV measurements. The predicted concentration distribution was consistent with data from previous planar Rayleigh scattering measurements used to verify the concentration distribution predictions in an earlier study. The jet spreading was also simulated using several widely used notional nozzle models combined with the integral plume model for comparison. These results show that the velocity and concentration distributions are both better predicted by the two-layer model than the notional nozzle models to complement previous studies verifying only the predicted concentration profiles. Thus, this study shows that the two-layer model can accurately predict the jet velocity distributions as well as the concentration distributions as verified earlier. Though more validation studies are needed to improve confidence in the model and increase the range of validity, the present work indicates that the two-layer model is a promising tool for fast, accurate predictions of the flow fields of underexpanded hydrogen jets.

08 HYDROGEN↗

Burst pressure models and validations for thick-walled pipelines containing corrosion defects

Corrosion is one major threat to pipeline integrity. Over the past decades, many corrosion models have been developed for determining the remaining strength of corroded pipelines, including ASME B31.G, Modified B31.G, LPC, PCORRC and their modified models. All these corrosion models are applicable only to large diameter, thin-walled pipelines with a diameter to wall thickness ratio D/t ≥ 20. In practice, many pipelines have a small diameter and thick wall with a D/t ratio < 20, and thus an adequate corrosion model is needed for assessing remaining strength for corroded thick-walled pipelines. This paper briefly reviews the theoretical burst pressure models for defect-free thin and thick-walled pipelines and four representative corrosion assessment models for thin-walled corroded pipelines. On this basis, two modified corrosion models are proposed to thick-walled pipelines in terms of the average shear stress yield theory. To verify the proposed corrosion models, comprehensive validations are performed. Numerical validations include the elastic-plastic finite element analysis to determine burst pressure for pipelines without and with corrosion defects and the model evaluation using a large dataset of available FEA results of burst pressure for machined defects. Experimental validations include a set of burst pressure tests for defect-free thick-walled pipes with different thicknesses and the model evaluation using one large burst dataset for machined defects with flat bottoms and another large dataset for real corrosion defects with curved river bottom profiles. Both numerical and experimental validations show that the proposed corrosion models can more accurately predict the remaining strength for corroded thin and thick-walled pipelines.

Pipeline↗

On the validity of the dilute gas assumption for gap conductance calculations in nuclear fuel performance codes

Fill gas thermal conductivity’s dependence on pressure is neglected in today’s nuclear fuel performance codes. Current codes assume that gas behaves as a dilute gas, but the pressure effect is more pronounced at temperatures lower than ten times the critical temperature of each pure gas. The validity of this assumption for nuclear fuel performance is examined herein. Theories related to dilute and dense gas properties are presented, along with their validation against literature data at up to 30 MPa for selected inert gases. Underlying assumptions are clearly described for each model, and their possible impacts on gap conductance calculations are discussed. The dilute gas assumption is valid for helium because it behaves as a dilute gas. However, the assumption is not valid in most gap conductance calculations when the gap is mostly occupied with either lower conductivity gaseous fission products or an initial fill gas other than helium.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Application of research reactor environments for validation of the IRDFF-II dosimetry cross section library

Activation data from seven different reactor-based reference neutron fields are examined to provide enhanced validation evidence for the newly released IRDFF-II library. A least-squares based spectrum adjustment methodology is used and rigorous statistical metrics demonstrate the consistency of the set of IRDFF-II dosimetry cross sections. The use of these reactor-based neutron fields provides validation evidence for nine more reactions than have been addressed in the 252 Cf(sf) and 235 U(th) benchmark validation testing. The use of covers to shift their energy response increases the power of the response validation but makes it challenging to properly capture response correlations.

Griffin, Patrick↗

Validity conditions for moment closure approximations in stochastic chemical kinetics

Approximations based on moment-closure (MA) are commonly used to obtain estimates of the mean molecule numbers and of the variance of fluctuations in the number of molecules of chemical systems. The advantage of this approach is that it can be far less computationally expensive than exact stochastic simulations of the chemical master equation. Here, we numerically study the conditions under which the MA equations yield results reflecting the true stochastic dynamics of the system. We show that for bistable and oscillatory chemical systems with deterministic initial conditions, the solution of the MA equations can be interpreted as a valid approximation to the true moments of the chemical master equation, only when the steady-state mean molecule numbers obtained from the chemical master equation fall within a certain finite range. The same validity criterion for monostable systems implies that the steady-state mean molecule numbers obtained from the chemical master equation must be above a certain threshold. For mean molecule numbers outside of this range of validity, the MA equations lead to either qualitatively wrong oscillatory dynamics or to unphysical predictions such as negative variances in the molecule numbers or multiple steady-state moments of the stationary distribution as the initial conditions are varied. Our results clarify the range of validity of the MA approach and show that pitfalls in the interpretation of the results can only be overcome through the systematic comparison of the solutions of the MA equations of a certain order with those of higher orders.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Monte Carlo toolkit for designing and validating step-range-filter spectrometer designs

Here, we present a Monte Carlo toolkit for validating step range filter (SRF) spectrometer designs. Geant4 is used to transport charged particles through the SRF filters to generate synthetic SRF data that include realistic CR-39 effects. Synthetic SRF spectra generated by this method inherently account for instrument response and allow for the quantification of SRF performance before shots. The usefulness of this toolkit is demonstrated through its application to a number of problems. A new broadband SRF for the ∼10 MeV wide 3He3He proton spectrum is validated, and an analysis method for analyzing 3He3He-p SRF data that accounts for instrument response is put forth. In addition, an SRF design for the compact recoil-proton spectrometer (CRS) on the Z-machine is validated. Finally, a new calibration technique for the DD-p SRF is proposed and validated.

Johnson, T. M. (ORCID:0000000193032949)↗

Automated annotation of scientific texts for ML-based keyphrase extraction and validation

Advanced omics technologies and facilities generate a wealth of valuable data daily; however, the data often lack the essential metadata required for researchers to find, curate, and search them effectively. The lack of metadata poses a significant challenge in the utilization of these data sets. Machine learning (ML)–based metadata extraction techniques have emerged as a potentially viable approach to automatically annotating scientific data sets with the metadata necessary for enabling effective search. Text labeling, usually performed manually, plays a crucial role in validating machine-extracted metadata. However, manual labeling is time-consuming and not always feasible; thus, there is a need to develop automated text labeling techniques in order to accelerate the process of scientific innovation. This need is particularly urgent in fields such as environmental genomics and microbiome science, which have historically received less attention in terms of metadata curation and creation of gold-standard text mining data sets. In this paper, we present two novel automated text labeling approaches for the validation of ML-generated metadata for unlabeled texts, with specific applications in environmental genomics. Our techniques show the potential of two new ways to leverage existing information that is only available for select documents within a corpus to validate ML models, which can then be used to describe the remaining documents in the corpus. The first technique exploits relationships between different types of data sources related to the same research study, such as publications and proposals. The second technique takes advantage of domain-specific controlled vocabularies or ontologies. In this paper, we detail applying these approaches in the context of environmental genomics research for ML-generated metadata validation. Our results show that the proposed label assignment approaches can generate both generic and highly specific text labels for the unlabeled texts, with up to 44% of the labels matching with those suggested by a ML keyword extraction algorithm.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DES Y1 Results: validating cosmological parameter estimation using simulated Dark Energy Surveys

We use mock galaxy survey simulations designed to resemble the Dark Energy Survey Year 1 (DES Y1) data to validate and inform cosmological parameter estimation. When similar analysis tools are applied to both simulations and real survey data, they provide powerful validation tests of the DES Y1 cosmological analyses presented in companion papers. We use two suites of galaxy simulations produced using different methods, which therefore provide independent tests of our cosmological parameter inference. The cosmological analysis we aim to validate is presented in DES Collaboration et al. (2017) and uses angular two-point correlation functions of galaxy number counts and weak lensing shear, as well as their cross-correlation, in multiple redshift bins. While our constraints depend on the specific set of simulated realisations available, for both suites of simulations we find that the input cosmology is consistent with the combined constraints from multiple simulated DES Y1 realizations in the $\Omega_m-\sigma_8$ plane. For one of the suites, we are able to show with high confidence that any biases in the inferred $S_8=\sigma_8(\Omega_m/0.3)^{0.5}$ and $\Omega_m$ are smaller than the DES Y1 $1-\sigma$ uncertainties. For the other suite, for which we have fewer realizations, we are unable to be this conclusive; we infer a roughly 70% probability that systematic biases in the recovered $\Omega_m$ and $S_8$ are sub-dominant to the DES Y1 uncertainty. Furthermore, as cosmological analyses of this kind become increasingly more precise, validation of parameter inference using survey simulations will be essential to demonstrate robustness.

79 ASTRONOMY AND ASTROPHYSICS↗

Data-driven model validation for neutrino-nucleus cross section measurements

Neutrino-nucleus cross section measurements are needed to improve interaction modeling to meet the precision needs of neutrino experiments in efforts to measure oscillation parameters and search for physics beyond the Standard Model. We review the difficulties associated with modeling neutrino-nucleus interactions that lead to a dependence on event generators in oscillation analyses and cross section measurements alike. We then describe data-driven model validation techniques intended to address this model dependence. The method relies on utilizing various goodness-of-fit tests and the correlations between different observables and channels to probe the model for defects in the phase space relevant for the desired analysis. These techniques shed light on relevant mismodeling, allowing it to be detected before it begins to bias the cross section results. We compare more commonly used model validation methods which directly validate the model against alternative ones to these data-driven techniques and show their efficacy with fake data studies. These studies demonstrate that employing data-driven model validation in cross section measurements represents a reliable strategy to produce robust results that will stimulate the desired improvements to interaction modeling.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Validating first-principles molecular dynamics calculations of oxide/water interfaces with x-ray reflectivity data

Metal oxide/water interfaces play a crucial role in many electrochemical and photocatalytic processes, such as photoelectrochemical water splitting, the creation of fuel from sunlight, and electrochemical CO 2 reduction. First-principles electronic structure calculations can reveal unique insights into these processes, such as the role of the alignment of the oxide electronic energy levels with those of liquid water. An essential prerequisite for the success of such calculations is the ability to predict accurate structural models of these interfaces, which in turn requires careful experimental validation. Here we report a general, quantitative validation protocol for first-principles molecular dynamics simulations of oxide/aqueous interfaces. The approach makes direct comparisons of interfacial x-ray reflectivity (XR) signals from experimental measurements and those obtained from ab initio simulations with semilocal and van der Waals functionals. The protocol is demonstrated here for the case of the Al 2 O 3 (001)/water interface, one of the simplest oxide/water interfaces. We discuss the technical requirements needed for validation, including the choice of the density functional, the simulation cell size, and the optimal choice of the thermodynamic ensemble. Our results establish a general paradigm for the validation of structural models and interactions at solid/water interfaces derived from first-principles simulations. Furthermore, while there is qualitative agreement between the simulated structures and the experimental best-fit structure, direct comparisons of simulated and measured XR intensities show quantitative discrepancies that derive from both bulk regions (i.e., alumina and water) as well as the interfacial region, highlighting the need for accurate density functionals to properly describe interfacial interactions. Our results show that XR data are sensitive not only to the atomic structure (i.e., the atom locations) but also to the electron-density distributions in both the substrate and at the interface.

36 MATERIALS SCIENCE↗

An Innovative Software Tool Suite for Power Plant Model Validation and Parameter Calibration using PMU Measurements

Maintaining good quality of power plant stability models is of critical importance to ensure the secure and economic operation and planning of today’s power grid with its increasing stochastic and dynamic behavior. According to North American Electric Reliability (NERC) standards, all generators in North America with capacities larger than 10 MVA are required to validate their models every five years. Validation is quite costly and can significantly affect the revenue of generator owners, because the traditional staged testing requires generators to be taken offline. Over the past few years, validating and calibrating parameters using online measurements including phasor measurement units (PMUs) and digital fault recorders (DFRs) has been proven to be a cost-effective approach. In this paper, an innovative open-source tool suite is presented for validating power plant models using PPMV tool, identifying bad parameters with trajectory sensitivity analysis, and finally calibrating parameters using an ensemble Kalman filter (EnKF) based algorithm. The architectural design and the detailed procedures to run the tool suite are presented, with results of test on a realistic hydro power plant using PMU measurements for 12 different events. The calibrated parameters of machine, exciter, governor and PSS models demonstrate much better performance than the original models for all the events and show the robustness of the proposed calibration algorithm.

Li, Yuanyuan↗

Experimental validation benchmark data for CFD of transient convection from forced to natural with flow reversal on a vertical flat plate

Transient convection has been investigated experimentally for the purpose of providing Computational Fluid Dynamics (CFD) validation benchmark data. A specialized facility for validation benchmark experiments called the Rotatable Buoyancy Tunnel was used to acquire thermal and velocity measurements of flow over a smooth, vertical heated plate. The initial condition was forced convection downward with subsequent transition to mixed convection, ending with natural convection upward after a flow reversal. Data acquisition through the transient was repeated for ensemble-averaged results. With simple flow geometry, validation data were acquired at the benchmark level. All boundary conditions (BCs) were measured and their uncertainties quantified. Temperature profiles on all four walls and the inlet were measured, as well as as-built test section geometry. Inlet velocity profiles and turbulence levels were quantified using Particle Image Velocimetry. System Response Quantities (SRQs) were measured for comparison with CFD outputs and include velocity profiles, wall heat flux, and wall shear stress. Extra effort was invested in documenting and preserving the validation data. Details about the experimental facility, instrumentation, experimental procedure, materials, BCs, and SRQs are made available through this paper. As a result, the latter two are available for download and the other details are included in this work.

42 ENGINEERING↗