SEARCH · Engineering Papers

Results for “validation method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Divide and conquer: using RhizoVision Explorer to aggregate data from multiple root scans using image concatenation and statistical methods

Roots are important in agricultural and natural systems for determining plant productivity and soil carbon inputs. Sometimes, the amount of roots in a sample is too much to fit into a single scanned image, so the sample is divided among several scans, and there is no standard method to aggregate the data. Here, we describe and validate two methods for standardizing measurements across multiple scans: image concatenation and statistical aggregation. We developed a Python script that identifies which images belong to the same sample and returns a single, larger concatenated image. These concatenated images and the original images were processed with RhizoVision Explorer, a free and open-source software. An R script was developed, which identifies rows of data belonging to the same sample and applies correct statistical methods to return a single data row for each sample. These two methods were compared using example images from switchgrass, poplar, and various tree and ericaceous shrub species from a northern peatland and the Arctic. Most root measurements were nearly identical between the two methods except median diameter, which cannot be accurately computed by statistical aggregation. We believe the availability of these methods will be useful to the root biology community.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS2003

Verification of International Space Station Component Leak Rates by Helium Accumulation Method

Discovery of leakage on several International Space Station U.S. Laboratory Module ammonia system quick disconnects (QDs) led to the need for a process to quantify total leakage without removing the QDs from the system. An innovative solution was proposed allowing quantitative leak rate measurement at ambient external pressure without QD removal. The method utilizes a helium mass spectrometer configured in the detector probe mode to determine helium leak rates inside a containment hood installed on the test component. The method was validated through extensive developmental testing. Test results showed the method was viable, accurate and repeatable for a wide range of leak rates. The accumulation method has been accepted by NASA and is currently being used by Boeing Huntsville, Boeing Kennedy Space Center and Boeing Johnson Space Center to test welds and valves and will be used by Alenia to test the Cupola. The method has been used in place of more expensive vacuum chamber testing which requires removing the test component from the system.

Underwood, Steve D.↗

NASA NTRS2009

Baseline Assessment and Prioritization Framework for IVHM Integrity Assurance Enabling Capabilities

Fundamental to vehicle health management is the deployment of systems incorporating advanced technologies for predicting and detecting anomalous conditions in highly complex and integrated environments. Integrated structural integrity health monitoring, statistical algorithms for detection, estimation, prediction, and fusion, and diagnosis supporting adaptive control are examples of advanced technologies that present considerable verification and validation challenges. These systems necessitate interactions between physical and software-based systems that are highly networked with sensing and actuation subsystems, and incorporate technologies that are, in many respects, different from those employed in civil aviation today. A formidable barrier to deploying these advanced technologies in civil aviation is the lack of enabling verification and validation tools, methods, and technologies. The development of new verification and validation capabilities will not only enable the fielding of advanced vehicle health management systems, but will also provide new assurance capabilities for verification and validation of current generation aviation software which has been implicated in anomalous in-flight behavior. This paper describes the research focused on enabling capabilities for verification and validation underway within NASA s Integrated Vehicle Health Management project, discusses the state of the art of these capabilities, and includes a framework for prioritizing activities.

Cooper, Eric G.↗

NASA NTRS2018

Impedance Eduction in a Duct Using the Linearized Euler Equations

An impedance eduction technique that is based upon a numerical solution to the linearized Euler equations coupled with the minimization of an objective function is presented. The linearized Euler equations are solved numerically using a cubic finite element method and the minimum of the objective function is obtained via a gradient based optimizer. The mean flow is allowed to have a gradient in two coordinate directions and the impedance of the liner may vary arbitrarily over the liner surface. A new regularized wall impedance boundary condition presented by Rienstra which contains the effects of the mean boundary layer thickness is implemented. Impedances are educed for a perforate over honeycomb liner using test data acquired in the Langley Grazing Flow Impedance Tube. The impedance of the liner is educed both with an upstream source and a downstream source. The method is validated by comparing the educed impedance to a benchmark method. The primary conclusion of the study is that the impedances educed for upstream and downstream sources are not well matched and that the primary effect of the boundary thickness is to reduce the resistance of the liner.

Watson, Willie R.↗

DOE OSTI2022

Development and validation of a quantitative proton NMR method for the analysis of pregnenolone

Pregnenolone (PREG) is an endogenous steroid frequently sold as an over-the-counter dietary supplement touted to promote neurological and immunological health. While the PREG dietary supplement is added to the diet for health benefits, there are no FDA approved PREG drugs. However, compounded PREG drug products are available to U.S. patients. The FDA works with state regulatory authorities on the oversight of compounding activities, including developing 503A and 503B lists of bulk substances that compounders are permitted to use. PREG is one of the substances publicly nominated to be included on the 503B list. Compounded hormone therapies such as those using PREG are of interest given the lack of standardization in compounded drug products which may increase the possibility of underdosing, overdosing, or contamination. However, no USP monograph currently exists to evaluate the quality of PREG drug substance or product. To address knowledge gaps and assist in quality control, a simple and rapid quantitative proton nuclear magnetic resonance spectroscopy (qNMR) method for the identification and assay of PREG in different types of PREG products was developed and validated. PREG samples were characterized using 1D 1 H and 2D 1 H– 13 C HSQC NMR spectra. The qNMR assay method (taking approximately 10 min per NMR spectrum) was validated for precision, accuracy, specificity, robustness and linearity per ICH Q2(R1) guidance. The method was validated in a range from 0.032 to 3.2 mg/mL. As a proof of concept, seven PREG bulk substance samples, three tablet and two capsule PREG dietary supplements were assessed by the qNMR analytical procedure. NMR data from all tested samples met the expected criteria for identification and assay. The results demonstrate the potential of qNMR for the quality assessment of different types of PREG samples.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Asteroids seen by JWST-MIRI: Radiometric size, distance, and orbit constraints

Infrared measurements of asteroids are crucial for the determination of physical and thermal properties of individual objects, and for understanding the small-body populations in the solar system as a whole. However, standard radiometric methods can only be applied if the orbit of an object is known, hence its position at the time of the observation. With JWST-MIRI observations the situation will change and many unknown, often very small, solar system objects will be detected. Later orbit determinations are difficult due to the faintness of the objects and the lack of dedicated follow-up concepts. We present MIRI observations of the outer-belt asteroid (10920) 1998 BC1 and an unknown object, detected in all nine MIRI bands in close apparent proximity to (10920). We developed a new method called STM-ORBIT to interpret the multi-band measurements without knowing the object’s true location. The power of the new technique is that it determines the most-likely heliocentric and observer-centric distance and phase angle ranges, allowing us to make a radiometric size estimate. The application to the MIRI fluxes of (10920) was used to validate the method. It leads to a confirmation of the known radiometric size-albedo solution, and puts constraints on the asteroid’s location and orbit in agreement with its true orbit. To back up the validation of the method, we obtained additional ground-based light curve observations of (10920), combined with Gaia data, which indicate a very elongated object (a/b ≥ 1.5), with a spin-pole at (λ, β) ecl = (178°, +81°), with an estimated error of about 20°, and a rotation period of 4.861191 ± 0.000015 h. A thermophysical study of all available JWST-MIRI and WISE measurements leads to a size of 14.5–16.5 km (diameter of an equal-volume sphere), a geometric albedo pV between 0.05 and 0.10, and a thermal inertia in the range 9–35 (best value 15) J m -2 s -0.5 K -1 . For the newly discovered MIRI object, the STM-ORBIT method revealed a size of 100–230 m. The new asteroid must be on a low-inclination orbit (0.7° < i < 2.0°) and it was located in the inner main-belt region during JWST observations. A beaming parameter η larger than 1.0 would push the size even below 100 meters, a main-belt regime that has escaped IR detections so far. This kind of MIRI observations can therefore contribute to formation and evolution studies via classical size-frequency studies, which are currently limited to objects larger than about one kilometer in size. We estimate that MIRI frames with pointings close to the ecliptic and short integration times of only a few seconds will always include a few asteroids; most of them will be unknown objects.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2019

THE INFLUENCE OF CHANGES IN NUCLEAR COVARIANCE DATA ON THE CALCULATION OF Ck FOR HIGHLY ENRICHED URANIUM SOLUTION SYSTEMS

Since their initial development nearly 20 years ago, sensitivity/uncertainty (S/U) techniques have been increasingly applied to criticality safety validation. These techniques can generally be applied quickly and for a range of purposes after the initial investment of calculating sensitivities for a safety analysis model and a range of potential benchmark experiments. This paper discusses these applications and how they have been affected by changes in covariance data libraries.Critical experiment selection is the most prominent area in which S/U methods impact validation efforts. These methods allow for rigorous calculation of similarity between safety analysis models and potential benchmarks. The most widely used of these methods is the integral parameter ck, although other integral parameters such as E and some non-integral parameters have also been explored. The ck parameter calculates the fraction of nuclear data–induced uncertainty shared between an application and an experiment; this metric is predicated on the assessment that nuclear data errors are the most likely source of computational bias. Therefore, values of ck are inherently dependent on the nuclear covariance library used to calculate them and inevitably change when these data change.Past studies have shown how much the ck values can vary, especially in difficult validation cases like burnup credit. These significant changes are the result of differences in the relative uncertainties of nuclides with large sensitivities, and they imply differences in benchmark applicability to the safety analysis model. This paper demonstrates that more common criticality safety models involving single fissile species have significantly less variability of ck between covariance libraries, thus enhancing confidence in the application of S/U methods for experiment selection in these scenarios. This paper presents case studies examining the impact of these changes on some hypothetical safety analysis systems.

Clarity, Justin↗

NASA NTRS2018

Trusted Communication: Utilizing Speech Communication to Enhance Human-Machine Teaming Success

An area of increasing interest for the next generation of aircraft is autonomy and the integration of increasingly autonomous systems into the national airspace. Such an integration requires humans to work closely with autonomous systems, forming teams. Our hypothesis is that a team composed of both humans and autonomous systems will operate better than either entity alone. We have existing procedures for certifying pilots to operate in the national airspace and are currently working on methods for validating the function of autonomous systems, however we have no method in place for assessing the interaction of these two disparate systems. Communication is one avenue. This paper will examine the use of language as a metric for ascertaining human-machine teaming effectiveness. A proof-of-concept of the application of two communication-based analysis techniques, Linguistic Inquiry and Word Count (LIWC) and Latent Semantic Analysis (LSA), for the prediction of success in human/chatbot teaming was conducted. By running these analyses over data from the 2014 and 2015 Loebner Prize competitions of human/chatbot teaming, numerical scores were obtained that can be associated with scores provided by human judges during the competition. Correlating their LIWC and LSA data with the scores provided by the judges, and using linear regression over this correlation, formulae were obtained that predict the score of human/chatbot interaction. These formulae were tested over the 2013 Loebner Prize transcripts, determining that, though there was strong correlation between predicted and actual scores, the predictive success of this method was not strong. However, with specialized topic spaces and lexica, as well as larger data sets, the predictive power of these metrics will improve. Given the importance of providing metrics for human-machine system team success and given the promise shown by the communication-basedLIWCand LSAmethods, continuing research in this area is necessary. After examining the potential for using communication and spoken language as a metric for the success of human/autonomous system teaming, this paper then examines aspects inherent to communication systems that may contribute to unreliability and reduced trust. Modern natural language processing tools rely on deep learning algorithms to create language rules that produce accurate results, but these rules are uninterpretable. The resulting blackbox system lacks transparency necessary for full validation and complete trust. Additionally, speech-based interfaces pose other difficulties to developing coordinated teamwork between humans and autonomous systems. Human communication is infrequently limited to speech only, instead usually relying on a combination of verbal, gestural, and general body language communication. Reducing an analysis of team effectiveness to a study of spoken language alone is problematic as it leaves these other equally important forms of communication out. This paper will examine these problems and the general deficiencies in speech-based metrics for human-machine teaming.

E L Meszaros↗

NASA NTRS1990

Development of a time-dependent incompressible Navier-Stokes solver based on a fractional-step method

The development, validation and application of a fractional step solution method of the time-dependent incompressible Navier-Stokes equations in generalized coordinate systems are discussed. A solution method that combines a finite-volume discretization with a novel choice of the dependent variables and a fractional step splitting to obtain accurate solutions in arbitrary geometries was previously developed for fixed-grids. In the present research effort, this solution method is extended to include more general situations, including cases with moving grids. The numerical techniques are enhanced to gain efficiency and generality.

Rosenfeld, Moshe↗

DOE OSTI2023

Quantifying metal-binding specificity of Cc NikZ-II from Clostridium carboxidivorans in the presence of competing metal ions

Many proteins bind transition metal ions as cofactors to carry out their biological functions. Despite binding affinities for divalent transition metal ions being predominantly dictated by the Irving-Williams series for wild-type proteins, in vivo metal ion binding specificity is ensured by intracellular mechanisms that regulate free metal ion concentrations. However, a growing area of biotechnology research considers the use of metal-binding proteins in vitro to purify specific metal ions from wastewater, where specificity is dictated by the protein's metal binding affinities. A goal of metalloprotein engineering is to modulate these affinities to improve a protein's specificity towards a particular metal; however, the quantitative relationship between the affinities and the equilibrium metal-bound protein fractions depends on the underlying binding mechanisms. Here we demonstrate a high-throughput intrinsic tryptophan fluorescence quenching method to validate binding models in multi-metal solutions for CcNikZ-II, a nickel-binding protein from Clostridium carboxidivorans. Using our validated models, we quantify the relationship between binding affinity and specificity in different classes of metal-binding models for CcNikZ-II. In conclusion, we further illustrate the potential relevance of data-informed models to predicting engineering targets for improved specificity.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS1991

A status report on a model for Benchmark active controls testing

This 'work-in-progress' paper presents a status report on an active controls flutter model which is currently in the design and fabrication phase. This model is a part of the Benchmark Models Program (BMP). The BMP is a NASA LaRC program that includes a series of models which will be used to study different aeroelastic phenomena and to validate aeroelastic methods. The objective of Benchmark Active Controls testing is to validate active control design tools. Flutter testing will be conducted with a pressure-instrumented rigid model attached to a flexible pitch and plunge mount system. Unsteady pressure distributions and transonic flutter boundaries will be measured with and without active control system engaged.

Durham, Michael H.↗

NASA NTRS2016

Improving Human/Autonomous System Teaming Through Linguistic Analysis

An area of increasing interest for the next generation of aircraft is autonomy and the integration of increasingly autonomous systems into the national airspace. Such integration requires humans to work closely with autonomous systems, forming human and autonomous agent teams. The intention behind such teaming is that a team composed of both humans and autonomous agents will operate better than homogenous teams. Procedures exist for licensing pilots to operate in the national airspace system and current work is being done to define methods for validating the function of autonomous systems, however there is no method in place for assessing the interaction of these two disparate systems. Moreover, currently these systems are operated primarily by subject matter experts, limiting their use and the benefits of such teams. Providing additional information about the ongoing mission to the operator can lead to increased usability and allow for operation by non-experts. Linguistic analysis of the context of verbal communication provides insight into the intended meaning of commonly heard phrases such as "What's it doing now?" Analyzing the semantic sphere surrounding these common phrases enables the prediction of the operator's intent and allows the interface to supply the operator's desired information.

Meszaros, Erica L.↗

DOE OSTI2024

Verification, Validation, and Calibration Through a Causal Lens

While typical validation and verification approaches focus on identifying the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on identifying causal relationships between data elements. Statistical and machine-learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between data sets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify, and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles, it is known as a directed acyclic graph. A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts can identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1990

Angle-of-attack validation of a new zonal CFD method for airfoil simulations

The angle-of-attack validation of a new concept suggested by Summa (1990) for coupling potential and viscous flow methods has been investigated for two-dimensional airfoil simulations. The fully coupled potential/Navier-Stokes code, ZAP2D (Zonal Aerodynamics Program 2D), has been used to compute the flow field around an NACA 0012 airfoil for a range of angles of attack up to stall at a Mach number of 0.3 and a Reynolds number of 3 million. ZAP2D calculation for various domain sizes from 25 to 0.12 chord lengths are compared with the ARC2D large domain solution as well as with experimental data.

Yoo, Sungyul↗

DOE OSTI2018

Simulation of kinematic Kikuchi diffraction patterns from atomistic structures

One of the limitations of atomistic simulations is that many of the computational tools used to extract structural information from atomic trajectories provide metrics that are not directly compatible with experiments for validation. In this work, to bridge between simulation and experiment, a method is presented to produce simulated Kikuchi diffraction patterns using data from atomistic simulations, without requiring a priori specification of the crystal structure or defect periodicity. The Kikuchi pattern simulation is based on the kinematic theory of diffraction, with Kikuchi line intensities computed via a discrete structure factor calculation. Reciprocal lattice points are mapped to Kikuchi lines using a geometric projection of the reciprocal space data. This method is validated using single crystal atomistic models, and the novelty of this approach is emphasized by simulating kinematic Kikuchi diffraction patterns from an atomistic model containing a nanoscale dislocation loop. Deviations in kinematic Kikuchi line intensities are explained considering the displacement field of the dislocation loop, as is done in diffraction contrast theory.

42 ENGINEERING↗

NASA NTRS1981

Heat flux estimates over vegetation derived using radiometric surface temperatures and a boundary layer model in comparison with sodar-derived values

An attempt was made to validate a method that uses radiometric surface temperatures and a boundary layer model to estimate surface energy budgets and characteristics. Surface temperatures from a hand-held radiometer and sodar data were collected simultaneously on seven days between mid-July and mid-October 1980. The comparison of the RDMS and sodar heat fluxes proved disappointing. Free convection conditions, required to produce sodar-derived heat fluxes, were inhibited by a terrain-induced low level inversion. Only three out of seven cases produced meaningful sodar heat fluxes. Of those three cases, one had good agreement and the other two had sodar heat fluxes 15 to 45 w/sq m lower than the RDMS values. Since the RDMS method is relatively untested, it was impossible to conclusively determine its validity from the results. There was evidence that the true heat flux was not underestimated by the RDMS, so it could be concluded that the Bowen ratios over well-watered vegetation were likely to be quite small.

Cooper, J. N.↗

NASA NTRS1989

Polarization analysis of optical systems

For most optical systems it is typically assumed that the transmitted wavefront has uniform (or Gaussian) amplitude and constant polarization state. This is the default assumption of geometrical optics. This paper considers methods suitable for analyzing systems for which this assumption is not valid. Such methods of polarization analysis include polarization ray tracing and polarization aberration theory. Definitions of the basic classes of polarization phenomena and a review of the Jones calculus are included to form a basis for the discussion.

Chipman, Russell A.↗

NASA NTRS1995

Design and Testing of an Automated System using Thermochromatic Liquid Crystals to Determine Local Heat Transfer Coefficients for an Impinging Jet

Using thermochromatic liquid crystal to measure surface temperature, an automated transient method with time-varying free-stream temperature is developed to determine local heat transfer coefficients. By allowing the free-stream temperature to vary with time, the need for complicated mechanical components to achieve a step temperature change is eliminated, and by using the thermochromatic liquid crystals as temperature indicators, the labor intensive task of installing many thermocouples is omitted. Bias associated with human perception of the transition of the thermochromatic liquid crystal is eliminated by using a high speed digital camera and a computer. The method is validated by comparisons with results obtained by the steady-state method for a circular Jet impinging on a flat plate. Several factors affecting the accuracy of the method are evaluated.

Tan, Benjamin↗