Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALID”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Cryo-EM model validation recommendations based on outcomes of the 2019 EMDataResource challenge

This paper describes outcomes of the 2019 Cryo-EM Model Challenge. The goals were to (1) assess the quality of models that can be produced from cryogenic electron microscopy (cryo-EM) maps using current modeling software, (2) evaluate reproducibility of modeling results from different software developers and users and (3) compare performance of current metrics used for model evaluation, particularly Fit-to-Map metrics, with focus on near-atomic resolution. Our findings demonstrate the relatively high accuracy and reproducibility of cryo-EM models derived by 13 participating teams from four benchmark maps, including three forming a resolution series (1.8 to 3.1 Å). The results permit specific recommendations to be made about validating near-atomic cryo-EM structures both in the context of individual experiments and structure data archives such as the Protein Data Bank. We recommend the adoption of multiple scoring parameters to provide full and objective annotation and assessment of the model, reflective of the observed cryo-EM map density.

59 BASIC BIOLOGICAL SCIENCES↗

Supervised enhancer prediction with epigenetic pattern recognition and targeted validation

Enhancers are important non-coding elements, but they have traditionally been hard to characterize experimentally. The development of massively parallel assays allows the characterization of large numbers of enhancers for the first time. Here, we developed a framework using Drosophila STARR-seq to create shape-matching filters based on meta-profiles of epigenetic features. We integrated these features with supervised machine-learning algorithms to predict enhancers. We further demonstrated that our model could be transferred to predict enhancers in mammals. We comprehensively validated the predictions using a combination of in vivo and in vitro approaches, involving transgenic assays in mice and transduction-based reporter assays in human cell lines (153 enhancers in total). The results confirmed that our model can accurately predict enhancers in different species without re-parameterization. Finally, we examined the transcription factor binding patterns at predicted enhancers versus promoters. Here, we demonstrated that these patterns enable the construction of a secondary model that effectively distinguishes enhancers and promoters.

59 BASIC BIOLOGICAL SCIENCES↗

Validating deep learning inference during chest X-ray classification for COVID-19 screening

Abstract The new coronavirus unleashed a worldwide pandemic in early 2020, and a fatality rate several times that of the flu. As the number of infections soared, and capabilities for testing lagged behind, chest X-ray (CXR) imaging became more relevant in the early diagnosis and treatment planning for patients with suspected or confirmed COVID-19 infection. In a few weeks, proposed new methods for lung screening using deep learning rapidly appeared, while quality assurance discussions lagged behind. This paper proposes a set of protocols to validate deep learning algorithms, including our ROI Hide-and-Seek protocol, which emphasizes or hides key regions of interest from CXR data. Our protocol allows assessing the classification performance for anomaly detection and its correlation to radiological signatures, an important issue overlooked in several deep learning approaches proposed so far. By running a set of systematic tests over CXR representations using public image datasets, we demonstrate the weaknesses of current techniques and offer perspectives on the advantages and limitations of automated radiography analysis when using heterogeneous data sources.

59 BASIC BIOLOGICAL SCIENCES↗

Design, construction, and validation of an in-situ groundwater trace element analyzer with applications in carbon storage

Abstract It is estimated that carbon emissions should reach net-zero by 2050 to meet important climate targets. Carbon capture is likely necessary to reach these targets, requiring a long-term storage solution such as geological carbon sequestration. However, as with any subsurface activity, leakage can occur, potentially impacting groundwater quality near the storage site. Rapid detection is essential to mitigate damage to this resource. Since CO 2 will acidify groundwater, the concentrations of acid soluble minerals and associated cations will increase. Thus, an in-situ, real-time element analysis system based on laser-induced breakdown spectroscopy (LIBS) is under development to monitor these elements. The system splits the traditional LIBS system into a miniature, all-optical sensor head built around a passively Q-switch laser fiber coupled to a control unit. Previous work has validated the LIBS technique for use at high pressure as well as the split system design. In this work, a fieldable prototype sensor is developed and tested in an onsite monitoring well where trace elements concentrations (approx. 0–3 ppm) were tracked over 20 days. These concentrations varied in response to local rainfall, diluting with increased rain, demonstrating the ability of a LIBS-based sensor to track trace elements under real-world conditions.

54 ENVIRONMENTAL SCIENCES↗

Validation of the Cossee–Arlman mechanism for propylene oligomerization on Ni/UiO-66

Steady state rate expressions can be derived to distinguish the Cossee–Arlman and metallacycle mechanisms postulated for propylene oligomerization on nickel-based catalysts based on product selectivities, where product selectivities for the former are a function of olefin pressure because sequential coordination and insertion steps lead to independent mechanistic pathways for different hexene isomers. In contrast, the metallacycle mechanism presents pressure-independent product selectivities due to successive coordination prior to the kinetically relevant steps in each mechanism. In this work, steady state propylene oligomerization rates and selectivities were measured in the absence of an activator on nickel functionalized UiO-66 metal organic framework (MOF), Ni/UiO-66, to validate the Cossee–Arlman mechanism for light olefin oligomerization. In situ NO titrations reveal that ~5% of nickel sites were active during the reaction, and thus, not all nickel sites are relevant for catalysis. Propylene dimerization was first order in propylene pressure from 5 to 500 kPa with an apparent activation energy of ~20 kJ mol -1 from 453 to 493 K. Calculated apparent activation energies with density functional theory (DFT) calculations on cluster models of Ni/UiO-66 are in agreement with experiment to corroborate the Cossee–Arlman mechanism. Selectivities of hexene products and the ratio of hexene product selectivities on Ni/UiO-66 are in accordance with selectivity expressions derived from the Cossee–Arlman mechanism. In conclusion, analysis of product selectivities can be used more extensively to demarcate the Cossee–Arlman and metallacycle mechanisms for olefin oligomerization on metal-based catalysts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Validation of Hygrothermal Simulations with Wall Performance Experiments in an Environmental Chamber

Oak Ridge National Laboratory is developing a web tool, built on a rule-based expert system, that aids stakeholders in designing energy-efficient moisture-durable walls. Currently, the tool’s expert system database is mostly populated with expert opinion, but work is being done to incorporate durability assessment based on stochastic hygrothermal modeling. Chamber experiments have been conducted to validate the hygrothermal models. The measured temperature and humidity have been compared with those predicted by the hygrothermal model. Experiments and comparison to one-dimensional hygrothermal modeling results were completed with two walls, a Structural Insulated Panel (SIP) based wall and a Concrete Masonry Unit (CMU) based wall. The two walls were succumbed to typical Chicago weather in ORNL’s Heat, Air and Moisture chamber. The walls were sequentially exposed to different scenarios, including diffusion, wetting, air leakage and solar radiation. For the most part, the hygrothermal simulations can be successfully used to predict the performance of these wall systems for the moisture transport phenomenon. Errors between measured and simulated values decreased as measurements got closer to the interior side of the wall. The root mean square error was larger for relative humidity (up to 17.5%-RH for CMU) than for temperature (up to 4.5°C for CMU wall). The errors were larger for the CMU wall than the wood frame wall. The phenomenon, including liquid water, caused large discrepancies between measurement and simulation results, and simulated results showed slower drying of materials than measured results. The one-dimensional nature of the simulation model made simulating air leaks difficult but not impossible.

Salonvaara, Mikael↗

The upgrade and re-validation of the Compact Muon Solenoid Electromagnetic Calorimeter Control and Safety Systems during the Second Long Shutdown of the Large Hadron Collider at CERN

The Electromagnetic Calorimeter (ECAL) is one of the subdetectors of the Compact Muon Solenoid (CMS), a general-purpose particle detector at the CERN Large Hadron Collider (LHC). The CMS ECAL Detector Control System (DCS) and the CMS ECAL Safety System (ESS) have supported the detector operations and ensured the detector’s integrity since the CMS commissioning phase, more than 10 years ago. Over this long period, several changes to both systems were necessary to correct issues, extend functionality and keep them in-line with current hardware technologies and the evolution of software platforms. Due to the constraints imposed on significant changes to a running system, major hardware and software upgrades were therefore deferred to the second LHC Long Shutdown (LS2). This paper presents the architectures of the CMS ECAL control and safety systems, discusses the ongoing and planned upgrades, details implementation processes and validation methods and highlights the expectations for the post-LS2 systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

MAPPER – A NOVEL CAPABILITY TO SUPPORT NUCLEAR MODEL VALIDATION AND MAPPING OF BIASES AND UNCERTAINTIES

This paper overviews the initial results of a new project at the Oak Ridge National Laboratory -- supported via an internal seed funding program -- focused on the development of a novel computational capability, called MAPPER, to support model validation. The MAPPER development aims to eliminate the need for empirical criteria, such as similarity indices, often employed to identify applicable experiments for given application conditions. To achieve that, MAPPER employs an information-theoretic-based approach, based on the Kullback-Leibler (KL) divergence principle, to combine responses of available or to-be-built experiments with application responses of interest using a training set of samples generated using randomized execution of the experiments and the application high fidelity analysis models. These samples are condensed using reduced order modeling techniques in the form of a joint probability distribution function (PDF) connecting each application response of interest with a new effective experimental response. The initial focus of the MAPPER capability will be to support the confirmatory analysis required for criticality safety analysis of storage facilities which require k-eff biases to be known for safe operation. This paper reports some of the initial results obtained with MAPPER as applied to a set of critical experiments for which existing similarity-based methods have been shown to provide inaccurate estimates of the biases.

Mertyurek, Ugur↗

Validation of Physics Models of Geant4 Versions 10.4.p03, 10.6.p02 and 10.7.p01 using Data from the CMS Experiment

CMS tuned its simulation program and chose a specific physics model of Geant4 by comparing the simulation results with dedicated test beam experiments. Test beam data provide measurements of energy response of the calorimeter as well as resolution for well identified charged hadrons over a large energy region. CMS continues to validate the physics models using the test beam data as well as collision data from the Large Hadron Collider. Isolated charged particles are measured simultaneously in the tracker as well as in the calorimeters. These events are selected using dedicated triggers and are used to measure the response in the calorimeter. Different versions of Geant4 (10.2.p02, 10.4.p03, 10.6.p02) have been used by CMS for its Monte Carlo production and a new version (10.7.p01) is now chosen for future productions. A suitable physics list (collection of physics models) is chosen by optimizing performance against accuracy. A detailed comparison between data and Geant4 predictions is presented in this paper.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Validation of 3D cryoEM single-particle reconstruction correctness and handedness with Ewald's sphere correction

The correct description of quantum scattering places the observed scattering contributions on the Ewald's sphere and its Friedel mate copy. In electron microscopy, due to the large radius of the Ewald's sphere, these scattering contributions are typically merged during data analysis. We present an approach that separates and factorizes those contributions into real and imaginary components of the image. When an inverted solution is calculated, the map derived from the real component of the image generates an inverted solution, while the map derived from the imaginary component of the image generates an inverted and sign-flipped solution. Therefore, the sign of correlation between reconstructions derived from the real and imaginary components provides the automatic determination of handedness and additional validation for the quality of 3D reconstructions. The factorization and its implementation are robust enough to be routinely used in single-particle reconstructions, even at resolutions below the limit where the curvature of the Ewald's sphere affects the overall signal-to-noise ratio.

Chemistry↗

Validation of gyrokinetic simulations in NSTX and projections for high-k turbulence measurements in NSTX-U

An extensive validation effort performed for a modest-beta NSTX NBI-heated H-mode discharge predicts that electron thermal transport can be entirely explained by electron-scale turbulence fluctuations driven by the electron temperature gradient mode (ETG), both in conditions of strong and weak ETG turbulence drive. Thermal power-balance estimates computed by TRANSP as well as the shape of the high-k density fluctuation wavenumber spectrum and the fluctuation level ratio between strongly driven and weakly driven ETG-turbulence conditions can be matched by nonlinear gyrokinetic simulations and a synthetic diagnostic for high-k scattering. Linear gyrokinetic simulations suggest that the ion-scale instability in the weak ETG condition is close to the critical threshold for the kinetic ballooning mode instability, and nonlinear ion-scale gyrokinetic simulations show that turbulence might be in a state reminiscent of a Dimits' shift regime, opening speculation on the role that ion-scale turbulence might play for the weak ETG condition. A simulation that matched all experimental constraints is chosen to project high-k turbulence spectra in NSTX-U, revealing that the new high-k system [R. Barchfeld et al., Rev. Sci. Instrum. 89, 10C114 (2018)] should be sensitive to density fluctuations from radially elongated streamer structures. In this study, two schemes are designed to characterize the radial and poloidal wavenumber dependence of the density fluctuation wavenumber power spectrum around the streamer peak, suggesting future high-k fluctuation measurements could be sensitive to an asymmetry in the k r spectrum introduced due to the presence of strong background flow shear.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Strength of porous α-SiO 2 in a shock loaded environment: Calibration via Richtmyer–Meshkov instability and validation via Mach lens

The strength of brittle porous media is of concern in numerous applications, for example, earth penetration, crater formation, and blast loading. Thus, it is of importance to possess techniques that allow for constitutive model calibration within the laboratory setting. The goal of the current work is to demonstrate an experimental technique allowing for strength assessment of porous media subjected to shock loading, which can be implemented into pressure-dependent yield surfaces within numerical simulation schemes. As a case study, the deviatoric response of distended α-SiO 2 has been captured in a tamped Richtmyer–Meshkov instability (RMI) environment at a pressure regime of 4–10 GPa. Hydrocode simulations were used to interpret RMI experimental data, and a resulting pressure-dependent yield surface akin to the often employed modified Drucker–Prager model was calibrated. Simulations indicate that the resulting jet length generated by the RMI is sensitive to the porous media strength, thereby providing a feasible experimental platform capable of capturing the pressurized granular deviatoric response. Furthermore, in efforts to validate the RMI-calibrated strength model, a set of Mach-lens experiments was performed and simulated with the calibrated pressure-dependent yield surface. Excellent agreement between the resulting Mach-lens length in experiment and simulation provides additional confidence to the RMI yield-surface calibration scheme.

36 MATERIALS SCIENCE↗

Model validation for inferred hot-spot conditions in National Ignition Facility experiments

Progress toward ignition requires accurately diagnosing current conditions and assessing proximity metrics for implosion experiments on the National Ignition Facility. Hot-spot conditions are not directly measured, but rather inferred, often using simple 0- and 1D models [P. Patel et al., Phys. Plasmas 27, 050901 (2020)]. In this work, we present a detailed accuracy validation exercise using a set of ~20,000 2D simulations encompassing a variety of performance and degradation levels. We find good agreement between the model-inferred pressure and the simulated burn-weighted pressure at peak neutron production and also present results on the precision of inferred quantities using a Markov-Chain Monte Carlo algorithm.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Code-to-code comparison and validation of the radiation-hydrodynamics capabilities of the FLASH code using a laboratory astrophysical jet

The potential for laser-produced plasmas to yield fundamental insights into high energy density physics (HEDP) and deliver other useful applications can sometimes be frustrated by uncertainties in modeling the properties and behavior of these plasmas using radiation-hydrodynamics codes. In an effort to overcome this and to corroborate the accuracy of the HEDP capabilities in the publicly available FLASH radiation-hydrodynamics code, we present detailed code-to-code comparisons between FLASH and the HYDRA code developed at Lawrence Livermore National Laboratory using previously published HYDRA simulations from Grava et al. [Phys. Rev. E 78, 016403 (2008)]. That study describes a laser experiment that produced a jet-like feature that the authors compare to astrophysical jets. Importantly, the Grava et al. [Phys. Rev. E 78, 016403 (2008)] experiment included detailed x-ray interferometric measurements of electron number densities and a time-integrated measurement of the soft x-ray spectrum. Despite markedly different methods for treating the computational mesh, and different equations of state and opacity models, the FLASH results resemble the results from HYDRA and, most importantly, the experimental measurements of electron density. Having validated the FLASH code in this way, we use the code to further investigate and understand the formation of the jet seen in the Grava et al. [Phys. Rev. E 78, 016403 (2008)] experiment and discuss its relation to the Wan et al. [Phys. Rev. E 55, 6293 (1997)] experiment at the NOVA laser.

Orban, Chris (ORCID:0000000312004538)↗

Validation of ablation model for polyethylene using pulsed x-ray and proton exposures

The surface erosion of polyethylene is interrogated using pulsed x rays at the Z Machine (Sandia National Laboratories) and with proton beams at the Gamble II generator (Naval Research Laboratory) to validate a coupled model for volumetric thermal ablation, photoionization, finite-rate decomposition, and molecular recombination of radicals. The intense radiation pulses (up to ∼1014W/m2 over tens of nanoseconds) are used to generate one-dimensional vapor flows with low ionization fractions and a simplified geometry compared to typical laser ablation, allowing for evaluation of the model under local thermal equilibrium conditions. Areal momentum carried by the ensuing uniaxial hydrodynamic shock is used to indicate the extent of ablation. The threshold fluence for ablation is found to be in close correspondence with the bulk melt transition, and reasonable agreement with the model is obtained for peak temperatures in polyethylene up to 5500 K and heating rates up to 1011K/s where thermal decomposition reactions are also active.

Moore, N. W. (ORCID:0000000272259674)↗

Validation of a detonation product equation of state for an insensitive high explosive via slab geometry expansion tests

Slab expansion (SLABEX) tests are conducted to validate a process for calibrating the detonation products equation of state (EOS) of a high explosive (HE). The SLABEX tests use rectangular slabs of PBX 9502, a polymer-bonded HE formulation consisting of 95 wt.% 1,3,5-triamino-2,4,6-trinitrobenzene bound with Kel F-800, a co-polymer of chlorotrifluoroethylene and vinylidene-fluoride. Three PBX 9502 slab thicknesses are examined, each confined symmetrically by two rectangular copper (Cu) plates approximately one-tenth the thickness of the HE slab. For the duration of each experiment, the detonation flow along the central axis of the PBX 9502 slab remains two-dimensional. The lateral flow velocity component of the outer surfaces of the expanding Cu plates is measured, along with the steady axial detonation speed along the central axis of the SLABEX. Hydrodynamic simulations of the Cu plate expansion in the SLABEX geometry, driven by the energy stored in the detonation products by the detonation combustion event, are conducted using a Jones–Wilkins–Lee EOS for the detonation products. This EOS form was recently parameterized for PBX 9502 in the cylinder expansion test geometry using a newly developed calibration technique [Voelkel et al., Combust. Flame 246, 112373 (2022)]. Good agreement between the experiment and prediction is found in each SLABEX test, demonstrating that the detonation product EOS calibration technique produces EOSs that are predictive when applied to other geometries.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Validity condition for the local sheath impedance boundary condition and a nonlocal generalization

ICRF sheaths can cause unwanted interactions of high-power RF waves with material surfaces in magnetic fusion devices. In previous work, a local RF sheath impedance boundary condition (BC) was derived for use in ICRF codes together with a microscale (i.e., Debye or sheath width scale) model for obtaining the sheath impedance used in that BC. This local RF sheath BC matches the normal component of current and electrostatic potential across the sheath-plasma interface. Collapsing the matching conditions at the sheath-plasma interface to a BC depends on the assumption of scale separation, which can be violated when conditions along the local radius of curvature of the surface vary sufficiently rapidly. The validity condition is explored in this contribution, with special attention to the case where the magnetic field approaches being tangent to the surface. When the local sheath BC no longer applies, a non-local sheath BC is developed under the assumption of a more relaxed scale separation assumption. It is shown that the non-local sheath BC reduces to the previous local sheath BC under appropriate conditions. Furthermore, a surface-integrated sheath admittance parameter describes the 2D physics in the new BC.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗