Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Benchmarking CME Arrival Time and Impact: Progress on Metadata, Metrics, and Events

Accurate forecasting of the arrival time and subsequent geomagnetic impacts of coronal mass ejections (CMEs) at Earth is an important objective for space weather forecasting agencies. Recently, the CME Arrival and Impact working team has made significant progress toward defining communit yagreed metrics and validation methods to assess the current state of CME modeling capabilities. This will allow the community to quantify our current capabilities and track progress in models over time. First, it is crucial that the community focuses on the collection of the necessary metadata for transparency and reproducibility of results. Concerning CME arrival and impact we have identified six different metadata types: 3D CME measurement, model description, model input, CME (non)arrival observation, model output data, and metrics and validation methods. Second, the working team has also identified a validation time period, where all events within the following two periods will be considered: 1 January 2011 to 31 December 2012 and January 2015 to 31 December 2015. Those two periods amount to a total of about 100 hit events at Earth and a large amount of misses. Considering a time period will remove any bias in selecting events and the event set will represent a sample set that will not be biased by user selection. Lastly, we have defined the basic metrics and skill scores that the CME Arrival and Impact working team will focus on.

Verbeke, C.↗
NASA NTRS1989

Evidence flow graph methods for validation and verification of expert systems

The results of an investigation into the use of evidence flow graph techniques for performing validation and verification of expert systems are given. A translator to convert horn-clause rule bases into evidence flow graphs, a simulation program, and methods of analysis were developed. These tools were then applied to a simple rule base which contained errors. It was found that the method was capable of identifying a variety of problems, for example that the order of presentation of input data or small changes in critical parameters could affect the output from a set of rules.

Becker, Lee A.↗
NASA NTRS1988

Evidence flow graph methods for validation and verification of expert systems

This final report describes the results of an investigation into the use of evidence flow graph techniques for performing validation and verification of expert systems. This was approached by developing a translator to convert horn-clause rule bases into evidence flow graphs, a simulation program, and methods of analysis. These tools were then applied to a simple rule base which contained errors. It was found that the method was capable of identifying a variety of problems, for example that the order of presentation of input data or small changes in critical parameters could effect the output from a set of rules.

Becker, Lee A.↗
DOE OSTI2026

Diesel Fuel Consumption in Prominent U.S. Open-Pit Mines: Site-Level Estimates

This report presents a comprehensive framework for estimating diesel fuel consumption and prices at open-pit mines in the United States. The framework includes transparent methods for calculating site-level diesel energy use when direct reporting is unavailable, and a structured confidence evaluation for each method. The framework is demonstrated to estimate current diesel consumption at 21 open-pit mines in the United States. Initial findings support ongoing efforts to strengthen the competitiveness and security of the U.S. industrial base by supporting data-driven supply chain analysis and decision-making, improved transparency in mining sector energy use, and targeted deployment of energy innovation and cost-reduction strategies. Future updates to the dataset—coupled with expanded data transparency and method validation—will help ensure that the findings remain relevant as the sector continues to evolve.

02 PETROLEUM↗
NASA NTRS1992

Evaluation of ultrasonic cavitation of metallic and non-metallic surfaces

1,1,2 trichloro-1,2,2 trifluoro ethane (CFC-113) commercially known as Freon-113 is the primary test solvent used for validating the cleaned hardware at the Kennedy Space Center (KSC). Due to the ozone depletion problem, the current United States policy calls for the phase out of Freons by 1995. NASAs chlorofluorocarbon (CFC) replacement group at KSC has opted to use water as a replacement fluid for the validation process since water is non-toxic, inexpensive, and is environmentally friendly. The replacement validation method calls for the ultrasonification of the small parts with water at 52 C for a cycle or two of 10 min duration wash using commercial ultrasonic baths. In this project, experimental data was obtained to assess the applicability of the proposed validation method for any damage of the metallic and non-metallic surfaces resulting from ultrasonic cavitation.

Mehta, Narinder K.↗
NASA NTRS1999

Lidar Altimeter Measurements of Canopy Structure: Methods and Validation for Closed Canopy, Broadleaf Forests

Lidar altimeter observations of vegetated landscapes provide a time-resolved measure of laser pulse backscatter energy from canopy surfaces and the underlying ground. Airborne lidar altimeter data was acquired using the Scanning Lidar Imager of Canopies by Echo Recovery (SLICER) for a successional sequence of four, closed-canopy, deciduous forest stands in eastern Maryland. The four stands were selected so as to include a range of canopy structures of importance to forest ecosystem function, including variation in the height and roughness of the outer-most canopy surface and the vertical organization of canopy stories and gaps. The character of the SLICER backscatter signal is described and a method is developed that accounts for occlusion of the laser energy by canopy surfaces, transforming the backscatter signal to a canopy height profile (CHP) that quantitatively represents the relative vertical distribution of canopy surface area. The transformation applies an increased weighting to the backscatter amplitude as a function of closure through the canopy and assumes a horizontally random distribution of the canopy components. SLICER CHPs, averaged over areas of overlap where lidar ground tracks intersect, are shown to be highly reproducible. CHP transects across the four stands reveal spatial variations in vegetation, at the scale of the individual 10 m diameter laser footprints, within and between stands. Averaged SLICER CHPs are compared to analogous height profile results derived from ground-based sightings to plant intercepts measured on plots within the four stands. Tbe plots were located on the segments of the lidar ground tracks from which averaged SLICER CHPs were derived, and the ground observations were acquired within two weeks of the SLICER data acquisition to minimize temporal change. The differences in canopy structure between the four stands is similarly described by the SLICER and ground-based CHP results, however a Chi-square test of similarity documents differences that are statistically significant. The differences are discussed in terms of measurement properties that define the smoothness of the resulting CHPs and Lidar Altimeter Measurements of Canopy Structure - Harding et al. canopy properties that may vertically bias the CHP representations of canopy structure. The statistical differences are most likely due to the more noisy character of the ground-based CHPs, especially high in the canopy where ground-based sightings are rare resulting in an underestimate of canopy surface area and height, and to departures from the assumption of horizontal randomness which bias the CHPs toward the observer (upward for SLICER and downward for ground-based CHPs). The results demonstrate that the SLICER observations reliably provide a measure of canopy structure that reveals ecologically interesting structural variations such as those characterizing a successional sequence of closed-canopy, broadleaf forest stands.

Harding, D. J.↗
NASA NTRS1987

Design and validation of fault-tolerant flight systems

Flight systems must be validated to show that they are consistent with the requirements of their intended applications. While high reliability is difficult to validate, the additional complexity of fault tolerance further compounds the validation problem. The objective of NASA’s research is to develop a methodology for designing validatable fault-tolerant systems. Under the design-for-validation philosophy, emphasis is placed on developing validation methods that can be incorporated into the design process right from the start and design methods and guidance which, while incorporating fault tolerance, can assure validatability. This paper examines the statistical issues of validating highly reliable, fault tolerant system. There are many problems associated with traditional methods of designing and validating these potentially complex hardware and software systems. Useful design-for-validation methods, which include structured specification and design methodologies, mathematical proof techniques, analytical modeling, simulation and emulation, and physical testing, are discussed. Important design issues associated with fault tolerance are presented along with the related validation concerns which must be addressed. Experience has shown that synchronization and Byzantine resilience must accompany fault tolerance. Other design attributes associated with fault tolerance may be used by a designer on the basis of cost, weight, performance, and validation considerations.

Computer systems↗
DOE OSTI2018

Clustering Methods and Validation of Representative Distribution Feeders

Clustering has received a lot of focus globally in recent years to determine representative feeders for validating smart grid technologies; however, clear reasoning on why a particular technique was used to accomplish a clustering step and whether similar results can be obtained from different techniques has not been reported. Further, and most importantly, validating final representative feeders and clusters when a sizeable feeder data set is used has not been completed. This paper addresses these issues. This paper also highlights the parameters that were determined to be critical for photovoltaic hosting capacity based on this analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Modeling Isothermal Reduction of Iron Ore Pellet Using Finite Element Analysis Method: Experiments & Validation

Iron ore pellet reduction experiments were performed with pure hydrogen (H2) and mixtures with carbon monoxide (CO) at different ratios. For direct reduction processes that switch dynamically between reformed natural gas and hydrogen as the reductant, it is important to understand the effects of the transition on the oxide reduction kinetics to optimize the residence time of iron ore pellets in a shaft reactor. Hence, the reduction rates were studied by varying experimental parameters such as the temperature (800, 850 & 900 °C), reactant gas flow rate (100, 150 & 200 cm3/min), pellet size and composition of the reactant gas mixture. The rate of reduction was observed to increase with an increase in temperature and reactant gas flow rate, but it decreased with an increase in pellet size. SEM greyscale analysis was performed to analyze the porosity and phase composition of partially reduced pellets. The porosity of the pellets was observed to increase from 0.3 for unreacted pellet to 0.42 for a completely reduced pellet. Energy-dispersive X-ray spectroscopy (EDAX) analysis was performed to identify the phases observed in the SEM images. The fraction of iron phase was observed to increase from the shell region of the pellet to the core region with an increase in the degree of reduction. A 2D-axisymmetric numerical model was developed on COMSOL Multiphysics, and it was validated using the conversion (X) vs. time curves obtained from each experiment. The model was able to accurately predict the total time needed for the complete conversion of a single iron ore pellet for multiple experiments. Effects of changes in the porosity and tortuosity of the pellet on the model were also studied and the rate of reduction was observed to be sensitive to changes in both porosity and tortuosity. The SEM analysis and the model results show that tortuosity is higher for pellets reduced with H2 than for pellets reduced with H2-CO gas mixtures.

08 HYDROGEN↗
NASA NTRS1975

Development and validation of methods for man-made machine interface evaluation

The alternate methods of conducting a man-machine interface evaluation are classified as static and dynamic, and are evaluated. A dynamic evaluation tool is presented to provide for a determination of the effectiveness of the man-machine interface in terms of the sequence of operations (task and task sequences) and in terms of the physical characteristics of the interface. This dynamic checklist approach is recommended for shuttle and shuttle payload man-machine interface evaluations based on reduced preparation time, reduced data, and increased sensitivity of critical problems.

Malone, T. B.↗
NASA NTRS1990

Prediction of forces and moments for flight vehicle control effectors. Part 1: Validation of methods for predicting hypersonic vehicle controls forces and moments

Many types of hypersonic aircraft configurations are currently being studied for feasibility of future development. Since the control of the hypersonic configurations throughout the speed range has a major impact on acceptable designs, it must be considered in the conceptual design stage. The ability of the aerodynamic analysis methods contained in an industry standard conceptual design system, APAS II, to estimate the forces and moments generated through control surface deflections from low subsonic to high hypersonic speeds is considered. Predicted control forces and moments generated by various control effectors are compared with previously published wind tunnel and flight test data for three configurations: the North American X-15, the Space Shuttle Orbiter, and a hypersonic research airplane concept. Qualitative summaries of the results are given for each longitudinal force and moment and each control derivative in the various speed ranges. Results show that all predictions of longitudinal stability and control derivatives are acceptable for use at the conceptual design stage. Results for most lateral/directional control derivatives are acceptable for conceptual design purposes; however, predictions at supersonic Mach numbers for the change in yawing moment due to aileron deflection and the change in rolling moment due to rudder deflection are found to be unacceptable. Including shielding effects in the analysis is shown to have little effect on lift and pitching moment predictions while improving drag predictions.

Maughmer, Mark D.↗
NASA NTRS2004

Methods for Validation and Intercomparison of Remote Sensing and In situ Ice Water Measurements: Case Studies from CRYSTAL-FACE and Model Results

Remote sensing observations, such as those from AURA, are necessary to understand the role of cirrus in determining the radiative and humidity budgets of the upper troposphere. Using these measurements quantitatively requires comparisons with in situ measurements that have previously been validated. However, a direct comparison of remote and in situ measurements is difficult due to the requirement that the spatial and temporal overlap be sufficient in order to guarantee that both instruments are measuring the same air parcel. A difficult as this might be for gas phase intercomparisons, cloud inhomogeneities significantly exacerbate the problem for cloud ice water content measurements. The CRYSTAL-FACE mission provided an opportunity to assess how well such intercomparisons can be performed and to establish flight plans that will be necessary for validation of future satellite instruments. During CRYSTAL-FACE, remote and in situ instruments were placed on different aircraft (NASA's ER-2 and WB-59, and the two planes flew in tandem so that the in situ payload flew in the field of view of the remote instruments. We show here that, even with this type of careful flight planning, it is not always possible to guarantee that remote and in situ instruments are viewing the same air parcel. We use ice water data derived from the in situ Harvard Total Water (HV-TW) instrument, and the remote Goddard Cloud Radar System (CRS) and show that agreement between HV-TW and CRS is a strong function of the horizontal separation and the time delay between the aircraft transects. We also use a cloud model to simulate possible trajectories through a cloud and evaluate the use of statistical analysis in determining the agreement between the two instruments. This type of analysis should guide flight planning for future intercomparison efforts, whether for aircraft or satellite-borne instrumentation.

Sayres, D.S.↗
NASA NTRS2022

A Global Evaluation of IMERG Precipitation Occurrence Using SMAP Detected Soil Moisture Change

A globally consistent ground validation method for remotely sensed precipitation products is crucial for building confidence in these products. This study develops a new methodology to validate the IMERG precipitation products through the use of SMAP soil moisture changes as a proxy for precipitation occurrence. Using a standard 2x2 contingency table method, preliminary results provide confidence in SMAP’s ability to be utilized as a validation tool for IMERG as results are comparable to previous validation studies. However, the method allows for an overestimate of false alarm frequency due to light precipitation events that can evaporate before the subsequent SMAP overpass and changes in overpass-to-overpass SMAP soil moisture that are within the range of SMAP uncertainty. To counter these issues, a 3x3 contingency table is used to reduce noise and extract more signal from the detection method. Through the use of this novel approach, the validation method produces a global mean POD of 0.64 and global mean FAR of 0.40, the first global-scale ground validation skill scores for the IMERG products. Advancing the method to validate precipitation quantity and the development of a real-time validation for the IMERG Early product are the crucial next developments.

Precipitation↗