Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

VALIDATION OF OBSERVATIONS OBTAINED WITH A LIQUID MIRROR TELESCOPE BY COMPARISON WITH SLOAN DIGITAL SKY SURVEY OBSERVATIONS

The results of a search for peculiar astronomical objects using very low resolution spectra obtained with the NASA Orbital Debris Observatory (NODO) 3 m diameter liquid mirror telescope (LMT) are compared with results of spectra obtained with the Sloan Digital Sky Survey (SDSS). The main purpose of this comparison is to verify whether observations taken with this novel type of telescope are reliable. This comparison is important because LMTs are an inexpensive novel type of telescope that is very useful for astronomical surveys, particularly surveys in the time domain, and validation of the data taken with an LMT by comparison with data from a classical telescope will validate their reliability. We start from a published data analysis that classified as peculiar only 206 of the 18,000 astronomical objects observed with the NODO LMT. A total of 29 of these 206 objects were found in the SDSS. The reliability of the NODO data can be seen through the results of the detailed analysis that, in practice, incorrectly identified less than 0.3% of the 18,000 spectra as peculiar objects, most likely because they are variable stars. We conclude that the LMT gave reliable observations, comparable to those that would have been obtained with a telescope using a glass mirror.

79 ASTRONOMY AND ASTROPHYSICS↗

Validation of Kepler's multiple planet candidates. III. Light curve analysis and announcement of hundreds of new multi-planet systems

The Kepler mission has discovered more than 2500 exoplanet candidates in the first two years of spacecraft data, with approximately 40% of those in candidate multi-planet systems. The high rate of multiplicity combined with the low rate of identified false positives indicates that the multiplanet systems contain very few false positive signals due to other systems not gravitationally bound to the target star. False positives in the multi-planet systems are identified and removed, leaving behind a residual population of candidate multi-planet transiting systems expected to have a false positive rate less than 1%. We present a sample of 340 planetary systems that contain 851 planets that are validated to substantially better than the 99% confidence level; the vast majority of these have not been previously verified as planets. We expect ∼two unidentified false positives making our sample of planet very reliable. We present fundamental planetary properties of our sample based on a comprehensive analysis of Kepler light curves, ground-based spectroscopy, and high-resolution imaging. Since we do not require spectroscopy or high-resolution imaging for validation, some of our derived parameters for a planetary system may be systematically incorrect due to dilution from light due to additional stars in the photometric aperture. Nonetheless, our result nearly doubles the number verified exoplanets.

79 ASTRONOMY AND ASTROPHYSICS↗

VALIDATION OF 12 SMALL KEPLER TRANSITING PLANETS IN THE HABITABLE ZONE

We present an investigation of 12 candidate transiting planets from Kepler with orbital periods ranging from 34 to 207 days, selected from initial indications that they are small and potentially in the habitable zone (HZ) of their parent stars. Few of these objects are known. The expected Doppler signals are too small to confirm them by demonstrating that their masses are in the planetary regime. Here we verify their planetary nature by validating them statistically using the BLENDER technique, which simulates large numbers of false positives and compares the resulting light curves with the Kepler photometry. This analysis was supplemented with new follow-up observations (high-resolution optical and near-infrared spectroscopy, adaptive optics imaging, and speckle interferometry), as well as an analysis of the flux centroids. For 11 of them (KOI-0571.05, 1422.04, 1422.05, 2529.02, 3255.01, 3284.01, 4005.01, 4087.01, 4622.01, 4742.01, and 4745.01) we show that the likelihood they are true planets is far greater than that of a false positive, to a confidence level of 99.73% (3σ) or higher. For KOI-4427.01 the confidence level is about 99.2% (2.6σ). With our accurate characterization of the GKM host stars, the derived planetary radii range from 1.1 to 2.7 R {sub ⊕}. All 12 objects are confirmed to be in the HZ, and nine are small enough to be rocky. Excluding three of them that have been previously validated by others, our study doubles the number of known rocky planets in the HZ. KOI-3284.01 (Kepler-438b) and KOI-4742.01 (Kepler-442b) are the planets most similar to the Earth discovered to date when considering their size and incident flux jointly.

79 ASTRONOMY AND ASTROPHYSICS↗

OC7 Project Phase II: Code Comparison and Experimental Validation of Hydroelastic Effects and Member-Level Loads in Floating Structures

This paper presents results from Phase II of the OC7 project, focusing on hydroelastic modeling and member-level load prediction for a flexible floating offshore structure. Numerical predictions from 11 academic and industrial partners are validated against experimental measurements obtained from a 1:70-scale test of the VolturnUS-S semisubmersible platform. A comprehensive set of verification and validation cases is examined. The results demonstrate that hydrodynamic added mass has a significant impact on predicted elastic natural frequencies. Under regular wave excitation, the numerical models reproduce platform motions and mooring line tensions with good accuracy. Member-level loads are also predicted with reasonable accuracy. Some discrepancies are observed for potential-flow models not accounting for higher-order effects associated with the instantaneous wetted surface.

17 WIND ENERGY↗

A Quantitative Validation of the Control Banding Nanotool

Abstract Eleven years (by publication) years after the development and application of the control banding (CB) Nanotool for the qualitative assessment and control of engineered nanoparticles (ENP), there remains no quantitative gold standard to serve as an alternative to the qualitative assessment. Many CB models have been developed during the years subsequent to the initial development of the CB Nanotool and the literature continues to blossom with comparisons and applications of these various tools; however, these developments have hitherto been made in the absence of validating and verifying their effectiveness using existing, albeit limited, quantitative methods. This paper reviews the existing literature on the CB Nanotool to evaluate its effectiveness in a variety of settings and presents a summary of qualitative and quantitative information from its application in a broad range of ENP handling activities performed in two different research institutions. A total of 28 ENP activities were assessed using the CB Nanotool (Version 2.0). Due to the lack of guidance on a single exposure assessment methodology, a combination of real-time monitoring, filter analysis, and microscopic analysis was used to assess various quantitative metrics, including mass concentration, particle number concentration, and particle speciation. All the results indicated that the control outcomes from the CB Nanotool qualitative assessment were sufficient to prevent workers from being exposed to ENP at levels beyond established exposure limits or background levels. These data represent an independent quantitative validation of CB Nanotool risk level outcomes and give further credence to the use of the CB Nanotool to effectively control worker exposures in the absence of quantitative air monitoring results.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Analysis and validation of carbohydrate three-dimensional structures

The article summarizes the information that is gained from and the errors that are found in carbohydrate structures in the Protein Data Bank. Validation tools that can locate these errors are described. Knowledge of the three-dimensional structures of the carbohydrate molecules is indispensable for a full understanding of the molecular processes in which carbohydrates are involved, such as protein glycosylation or protein–carbohydrate interactions. The Protein Data Bank (PDB) is a valuable resource for three-dimensional structural information on glycoproteins and protein–carbohydrate complexes. Unfortunately, many carbohydrate moieties in the PDB contain inconsistencies or errors. This article gives an overview of the information that can be obtained from individual PDB entries and from statistical analyses of sets of three-dimensional structures, of typical problems that arise during the analysis of carbohydrate three-dimensional structures and of the validation tools that are currently available to scientists to evaluate the quality of these structures.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

MolProbity: all-atom structure validation for macromolecular crystallography

MolProbity structure validation will diagnose most local errors in macromolecular crystal structures and help to guide their correction. MolProbity is a structure-validation web service that provides broad-spectrum solidly based evaluation of model quality at both the global and local levels for both proteins and nucleic acids. It relies heavily on the power and sensitivity provided by optimized hydrogen placement and all-atom contact analysis, complemented by updated versions of covalent-geometry and torsion-angle criteria. Some of the local corrections can be performed automatically in MolProbity and all of the diagnostics are presented in chart and graphical forms that help guide manual rebuilding. X-ray crystallography provides a wealth of biologically important molecular data in the form of atomic three-dimensional structures of proteins, nucleic acids and increasingly large complexes in multiple forms and states. Advances in automation, in everything from crystallization to data collection to phasing to model building to refinement, have made solving a structure using crystallography easier than ever. However, despite these improvements, local errors that can affect biological interpretation are widespread at low resolution and even high-resolution structures nearly all contain at least a few local errors such as Ramachandran outliers, flipped branched protein side chains and incorrect sugar puckers. It is critical both for the crystallographer and for the end user that there are easy and reliable methods to diagnose and correct these sorts of errors in structures. MolProbity is the authors’ contribution to helping solve this problem and this article reviews its general capabilities, reports on recent enhancements and usage, and presents evidence that the resulting improvements are now beneficially affecting the global database.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Community recommendations on cryoEM data archiving and validation

In January 2020, a workshop was held at EMBL-EBI (Hinxton, UK) to discuss data requirements for the deposition and validation of cryoEM structures, with a focus on single-particle analysis. The meeting was attended by 47 experts in data processing, model building and refinement, validation, and archiving of such structures. This report describes the workshop's motivation and history, the topics discussed, and the resulting consensus recommendations. Some challenges for future methods-development efforts in this area are also highlighted, as is the implementation to date of some of the recommendations.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Evaluation of models determined by neutron diffraction and proposed improvements to their validation and deposition

The Protein Data Bank (PDB) contains a growing number of models that have been determined using neutron diffraction or a hybrid method that combines X-ray and neutron diffraction. The advantage of neutron diffraction experiments is that the positions of all atoms can be determined, including H atoms, which are hardly detectable by X-ray diffraction. This allows the determination of protonation states and the assignment of H atoms to water molecules. Because neutrons are scattered differently by hydrogen and its isotope deuterium, neutron diffraction in combination with H/D exchange can provide information on accessibility, dynamics and chemical lability. In this study, the deposited data, models and model-to-data fit for all PDB entries that used neutron diffraction as the source of experimental data have been analysed. In many cases, the reported R work and R free values were not reproducible. In such cases, the model and data files were analysed to identify the reasons for this mismatch. The issues responsible for the discrepancies are summarized and explained. The analysis unveiled limitations to the annotation, deposition and validation of models and data, and a lack of community-wide accepted standards for the description of neutron models and data, as well as deficiencies in current model refinement tools. Most of the issues identified concern the handling of H atoms. Since the primary use of neutron macromolecular crystallography is to locate and directly visualize H atoms, it is important to address these issues, so that the deposited neutron models allow the retrieval of the maximum amount of information with the smallest effort of manual intervention. A path forward to improving the annotation, validation and deposition of neutron models and hybrid X-ray and neutron models is suggested.

59 BASIC BIOLOGICAL SCIENCES↗

Field Validated Utility-Scale Battery Storage Control Models for Quasi-Static Analyses

This paper presents a co-simulation based approach to implement and validate advanced battery storage control modes in OpenDSS that replicate behavior of a utility scale vanadium red-ox flow battery (VRFB). Inverter-interfaced utiliy-scale battery storage systems (BSS) have modes of operation to facilitate multiple grid-support functions. In order to enable accurate understanding of the impacts from grid-support functions modes of operation it is required to develop validated models that replicates behavior of the actual control system. This paper presents the pseudo code for the implemented control schemes including peak shaving and capacity firming control modes. Additionally, this paper also provides insight on convergence sensitivity of the presented algorithms to related parameters. The results obtained from simulation studies will be compared against field operated utility-scale BSS measurements to verify the implemented algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Social Media and Social Reality - Theory, Evidence and Validation

Social Media provide an exciting and novel view into social phenomena. The vast amounts of data that can be gathered from the Internet coupled with massively parallel supercomputers such as the Cray XMT open new vistas for research. Conclusions drawn from such analysis must recognize that social media are distinct from the underlying social reality. Rigorous validation is essential. This paper briefly presents results obtained from computational analysis of social media - utilizing both blog and twitter data. Validation of these results is discussed in the context of a framework of established methodologies from the social sciences. Finally, an outline for a set of supporting studies is proposed.

99 GENERAL AND MISCELLANEOUS↗

Wave Energy Converter Power Take-Off Modeling and Validation From Experimental Bench Tests

This article describes the implementation of a new numerical model of the power take-off system installed in the Monterey Bay Aquarium Research Institute wave energy converter, a device developed to provide power to various oceanic research missions. The simultaneous presence of hydraulic, pneumatic, and electrical subsystems in the power take-off system represents a significant challenge in forging an accurate model able to replicate the main dynamic characteristics of the system. The validation of the new numerical model is addressed by comparing simulations with the measurements obtained during a series of bench tests. Data from the bench tests show good agreement with the numerical model. The validated model provides deeper insights into the complex nonlinear dynamics of the power take-off system and will support further performance improvements in the future.

16 TIDAL AND WAVE POWER↗

Clustering Methods and Validation of Representative Distribution Feeders

Clustering has received a lot of focus globally in recent years to determine representative feeders for validating smart grid technologies; however, clear reasoning on why a particular technique was used to accomplish a clustering step and whether similar results can be obtained from different techniques has not been reported. Further, and most importantly, validating final representative feeders and clusters when a sizeable feeder data set is used has not been completed. This paper addresses these issues. This paper also highlights the parameters that were determined to be critical for photovoltaic hosting capacity based on this analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Experimental Validation of a Command and Control Traffic Detection Model

Network intrusion detection systems (NIDS) are commonly used to detect malware communications, including command-and-control (C2) traffic from botnets. NIDS performance assessments have been studied for decades, but mathematical modeling has rarely been used to explore NIDS performance. This paper details a mathematical model that describes a NIDS performing packet inspection and its detection of malware's C2 traffic. Here, the paper further describes an emulation testbed and a set of cyber experiments that used the testbed to validate the model. These experiments included a commonly used NIDS (Snort) and traffic with contents from a pervasive malware (Emotet). Results are presented for two scenarios: a nominal scenario and a “stressed” scenario in which the NIDS cannot process all incoming packets. Model and experiment results match well, with model estimates mostly falling within 95 % confidence intervals on the experiment means. Model results were produced 70-3000 times faster than the experimental results. Consequently, the model's predictive capability could potentially be used to support decisions about NIDS configuration and effectiveness that require high confidence results, quantification of uncertainty, and exploration of large parameter spaces. Furthermore, the experiments provide an example for how emulation testbeds can be used to validate cyber models that include stochastic variability.

mathematical model↗

Ignition Delay Times and Chemical Kinetic Model Validation for Hydrogen and Ammonia Blending With Natural Gas at Gas Turbine Relevant Conditions

Ignition delay times from undiluted mixtures of natural gas (NG)/H 2 /Air and NG/NH 3 /Air were measured using a high-pressure shock tube at the University of Central Florida. The combustion temperatures were experimentally tested between 1000 and 1500 K near a constant pressure of 25 bar. As mentioned, mixtures were kept undiluted to replicate the same chemistry pathways seen in gas turbine combustion chambers. Recorded combustion pressures exceeded 200 bar due to the large energy release, hence why these were performed at the high-pressure shock tube facility. The data are compared to the predictions of the NUIGMech 1.1 mechanism for chemical kinetic model validation and refinement. An exceptional agreement was shown for stoichiometric conditions in all cases but strayed at lean and rich equivalence ratios, especially in the lower temperature regime of H 2 addition and all temperature ranges of the baseline NG mixture. Hydrogen addition also decreased ignition delay times by nearly 90%, while NH 3 fuel addition made no noticeable difference in ignition time. NG/NH 3 exhibited similar chemistry to pure NG under the same conditions, which is shown in a sensitivity analysis. Here, the reaction CH 3 + O 2 = CH 3 O + O is identified and suggested as a possible modification target to improve model performance. Increasing the robustness of chemical kinetic models via experimental validation will directly aid in designing next-generation combustion chambers for use in gas turbines, which in turn will greatly lower global emissions and reduce greenhouse effects.

33 ADVANCED PROPULSION SYSTEMS↗

DEVELOPMENT AND VALIDATION OF A MULTIFIELD MODEL OF CHURN-TURBULENT GAS/LIQUID FLOWS

The accuracy of numerical predictions for gas/liquid two-phase flows using Computational Multiphase Fluid Dynamics (CMFD) methods strongly depends on the formulation of models governing the interaction between the continuous liquid field and bubbles of different sizes. The purpose of this paper is to develop, test and validate a multifield model of adiabatic gas/liquid flows at intermediate gas concentrations (e.g., churn-turbulent flow regime), in which multiple-size bubbles are divided into a specified number of groups, each representing a prescribed range of sizes. The proposed modeling concept uses transport equations for the continuous liquid field and for each bubble field. The overall model has been implemented in the NPHASE-CMFD computer code. The results of NPHASE-CMFD simulations have been validated against the experimental data from the TOPFLOW test facility. Also, a parametric analysis on the effect of various modeling assumptions has been performed.

10 SYNTHETIC FUELS↗

Validation of Local Structural Loads Computed by OpenFAST Against Measurements From the FOCAL Experimental Campaign

This work presents the validation of the local structural load modeling capability in OpenFAST for floating substructures based on data from the FOCAL experimental campaign. Previously, OpenFAST could only represent the floating substructure as a rigid body, and though this approach can model the global response of the floater in most cases, it is not able to capture the structural loads within the floater's individual members. Consideration of local substructure loads is important for some floating designs, because the pursuit of cost reduction often results in lighter and more flexible structures. To address this limitation, the HydroDyn (hydrodynamics) and SubDyn (substructure dynamics) modules of OpenFAST have been recently extended to account for the flexibility of floating substructures. To validate this new capability, we compare the results obtained by OpenFAST with data measured during the FOCAL experimental campaign, which analyzed a 1:70 scale performance-matched model of the IEA 15-MW reference turbine atop a modified University of Maine VolturnUS-S semisubmersible in a wave basin under the action of both wind and waves. For the purposes of the present work, the most important feature of the experiment is the presence of load cells at the root of each pontoon, and our objective is to assess how well those loads are reproduced by OpenFAST. To model the distributed hydrodynamic and hydrostatic loads along the floating substructure, we adopt a strip-theory approach based on the Morison equation, and we discuss the impact of different hydrodynamic modeling options (wave stretching, MacCamy-Fuchs correction, and second-order wave kinematics) on both motions and loads. For simplicity, we focus on wave-only conditions, both regular and irregular. The results demonstrate good overall agreement for the loads at the root of the pontoons for the waves analyzed in this work, especially given the assumptions and simplifications inherent to a simple strip-theory model.

floating offshore wind turbine↗

Validation of CT dose-reduction simulation

The objective of this research was to develop and validate a custom computed tomography dose-reduction simulation technique for producing images that have an appearance consistent with the same scan performed at a lower mAs (with fixed kVp, rotation time, and collimation). Synthetic noise is added to projection (sinogram) data, incorporating a stochastic noise model that includes energy-integrating detectors, tube-current modulation, bowtie beam filtering, and electronic system noise. Experimental methods were developed to determine the parameters required for each component of the noise model. As a validation, the outputs of the simulations were compared to measurements with cadavers in the image domain and with phantoms in both the sinogram and image domain, using an unbiased root-mean-square relative error metric to quantify agreement in noise processes. Four-alternative forced-choice (4AFC) observer studies were conducted to confirm the realistic appearance of simulated noise, and the effects of various system model components on visual noise were studied. The ''just noticeable difference (JND)'' in noise levels was analyzed to determine the sensitivity of observers to changes in noise level. Individual detector measurements were shown to be normally distributed (p>0.54), justifying the use of a Gaussian random noise generator for simulations. Phantom tests showed the ability to match original and simulated noise variance in the sinogram domain to within 5.6%{+-}1.6% (standard deviation), which was then propagated into the image domain with errors less than 4.1%{+-}1.6%. Cadaver measurements indicated that image noise was matched to within 2.6%{+-}2.0%. More importantly, the 4AFC observer studies indicated that the simulated images were realistic, i.e., no detectable difference between simulated and original images (p=0.86) was observed. JND studies indicated that observers' sensitivity to change in noise levels corresponded to a 25% difference in dose, which is far larger than the noise accuracy achieved by simulation. In summary, the dose-reduction simulation tool demonstrated excellent accuracy in providing realistic images. The methodology promises to be a useful tool for researchers and radiologists to explore dose reduction protocols in an effort to produce diagnostic images with radiation dose ''as low as reasonably achievable.''.

61 RADIATION PROTECTION AND DOSIMETRY↗