Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “round-robin test”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Fracture toughness of advanced ceramics at room temperature

Results of round-robin fracture toughness tests on advanced ceramics are reported. A gas-pressure silicon nitride and a zirconia-toughened alumina were tested using three test methods: indentation fracture, indentation strength, and single-edge precracked beam. The latter two methods have produced consistent results. The interpretation of fracture toughness test results for the zirconia alumina composite is shown to be complicated by R-curve and environmentally assisted crack growth phenomena.

Quinn, George D.↗

Estimating the R-curve from residual strength data

A method is presented for estimating the crack-extension resistance curve (R-curve) from residual-strength (maximum load against original crack length) data for precracked fracture specimens. The method allows additional information to be inferred from simple test results, and that information can be used to estimate the failure loads of more complicated structures of the same material and thickness. The fundamentals of the R-curve concept are reviewed first. Then the analytical basis for the estimation method is presented. The estimation method has been verified in two ways. Data from the literature (involving several materials and different types of specimens) are used to show that the estimated R-curve is in good agreement with the measured R-curve. A recent predictive blind round-robin program offers a more crucial test. When the actual failure loads are disclosed, the predictions are found to be in good agreement.

Orange, T. W.↗

The 1st International Round-Robin on Bi-Facial Modules

This presentation discusses validation of methods and ensuring the validity of results when testing bifacial PV modules, both of which are requirements in ISO/IEC 17025:2017; electrical parameters to be reported per IEC TS 60904-1-2; and statistical design proficiency testing per ISO 17043.

14 SOLAR ENERGY↗

Applications of Automation Methods for Nonlinear Fracture Test Analysis

Using automated and standardized computer tools to calculate the pertinent test result values has several advantages such as: 1. allowing high-fidelity solutions to complex nonlinear phenomena that would be impractical to express in written equation form, 2. eliminating errors associated with the interpretation and programing of analysis procedures from the text of test standards, 3. lessening the need for expertise in the areas of solid mechanics, fracture mechanics, numerical methods, and/or finite element modeling, to achieve sound results, 4. and providing one computer tool and/or one set of solutions for all users for a more "standardized" answer. In summary, this approach allows a non-expert with rudimentary training to get the best practical solution based on the latest understanding with minimum difficulty.Other existing ASTM standards that cover complicated phenomena use standard computer programs: 1. ASTM C1340/C1340M-10- Standard Practice for Estimation of Heat Gain or Loss Through Ceilings Under Attics Containing Radiant Barriers by Use of a Computer Program 2. ASTM F 2815 - Standard Practice for Chemical Permeation through Protective Clothing Materials: Testing Data Analysis by Use of a Computer Program 3. ASTM E2807 - Standard Specification for 3D Imaging Data Exchange, Version 1.0 The verification, validation, and round-robin processes required of a computer tool closely parallel the methods that are used to ensure the solution validity for equations included in test standard. The use of automated analysis tools allows the creation and practical implementation of advanced fracture mechanics test standards that capture the physics of a nonlinear fracture mechanics problem without adding undue burden or expense to the user. The presented approach forms a bridge between the equation-based fracture testing standards of today and the next generation of standards solving complex problems through analysis automation.

Allen, Phillip A.↗

Reproducibility and Repeatability of Tensile and Low-Cycle Fatigue Properties in Propulsion Grade Hydrogen

Hydrogen has the potential of increased use in the future as an environmentally friendly fuel. It has, however, shown a tendency to embrittle some materials. To be used in a safe manner and to exploit its full potential, it will be necessary to develop a database of material properties in hydrogen environment. The tests needed to produce this data are costly to perform (tensile test cost 25 times more and low cycle fatigue test are 55 times as expensive). Moreover, there is presently a lack of universal test methods to ensure standardized data within the hydrogen community. Each of the industries that work with hydrogen (aerospace, petroleum, fuel cells, etc.) performs tests by their own laboratory-developed methods, thus rendering cross- comparisons of material property data highly questionable. It is extremely important that data generated in a hydrogen environment be done to a standard that reduces variance to a minimum and allows direct comparison of test results from different laboratories. Doing so will assure that all data generated can be used to further our understanding of the hydrogen effects and to make sure components/products designed for hydrogen are the safest and most reliable possible. This paper reviews the results of two 'round-robin' programs conducted by NASA-MSFC. These two programs examined the reproducibility and repeatability of tensile and low-cycle fatigue test results in high-pressure hydrogen environments. The studies indicated that even with the tightest controls available from current commercial standards, the reproducibility (between different laboratories) and repeatability (within a laboratory) results of the tensile tests exhibited five times the variance as in standard ambient air tests. The variance with the LCF tests were on the same order as with air tests, but that was due to the large variation present in the last Interlaboratory air program. The paper concludes with a recommendation for a program that would allow the development of improved test methods, leading to lower variance in the generation of mechanical property data in the future.

Vesely, E. J.↗

Space Environmental Effects Knowledgebase

This report describes the results of an NRA funded program entitled Space Environmental Effects Knowledgebase that received funding through a NASA NRA (NRA8-31) and was monitored by personnel in the NASA Space Environmental Effects (SEE) Program. The NASA Project number was 02029. The Satellite Contamination and Materials Outgassing Knowledgebase (SCMOK) was created as a part of the earlier NRA8-20. One of the previous tasks and part of the previously developed Knowledgebase was to accumulate data from facilities using QCMs to measure the outgassing data for satellite materials. The main object of this current program was to increase the number of material outgassing datasets from 250 up to approximately 500. As a part of this effort, a round-robin series of materials outgassing measurements program was also executed that allowed comparison of the results for the same materials tested in 10 different test facilities. Other programs tasks included obtaining datasets or information packages for 1) optical effects of contaminants on optical surfaces, thermal radiators, and sensor systems and 2) space environmental effects data and incorporating these data into the already existing NASA/SEE Knowledgebase.

Wood, B. E.↗

Advanced Graphite Creep Uncertainty Analysis

Radiation damage estimation is an important component of the post irradiation analysis of the Advanced Graphite Creep (AGC) experiment. It depends primarily on the fast fluence, which is determined using well established methods of spectral adjustment. These are based on best estimates from models such as Monte Carlo N-Particle (MCNP), input cross-sections, and measured activities from flux wires in the experiment. Each of these parameters can propagate uncertainties which will affect the uncertainty in the calculated dose levels for AGC, or any experiment irradiated within a reactor. While the methods of propagating uncertainty are well-established, the final uncertainty estimates they provide are only as good as the estimates of uncertainty in the inputs on which they are based. The purpose of this work is to outline some deficiencies in the ways these input uncertainties are presently estimated, and to outline a methodology by which they can be improved. The fast fluence and radiation damage received by graphite specimens irradiated in the Advanced Graphite Creep (AGC) experiments is presently estimated using spectral adjustment methods that are based on both flux wire activity measurements, and MCNP model predictions. This work describes an ongoing effort to quantify and propagate uncertainties in inputs to the spectral adjustment process, and thereby quantify the resultant error in radiation damage (dpa) estimates. The effort is multi-faceted, and we consider the impacts of both the set of flux wires selected, and the counting process. An expanded set of flux wires is identified that provides a more comprehensive data set on the fast spectrum. To address the counting process itself, a series of round-robin measurements in several reactor metrology laboratories across the Department of Energy (DOE) complex and nuclear industry are being undertaken to refine the American Society for Testing and Materials (ASTM) standards for flux wire measurements. To address the contribution of uncertainty in the MCNP model predictions, an uncertainty quantification (UQ) tool has been developed that statistically samples the model input parameters, runs a series of cases, and assimilates the results to provide an overall uncertainty. The impact of the MCNP UQ tool results is demonstrated by re-analyzing previous AGC flux wire and irradiation data. While the expanded flux wire set obviously cannot be added to these experiments retroactively, plans for future graphite irradiations are outlined.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Advanced Materials & Manufacturing Technology (AMMT): Process understanding for qualifying LPBF 316H SS

Investigations were conducted in fiscal years (FY) 2023 and 2024 to gather relevant data sets addressing challenges related to qualifying 316H stainless steel (SS) for use in future nuclear reactors. This work was a collaborative effort involving researchers from Idaho National Laboratory (INL), Argonne National Laboratory (ANL), and Oak Ridge National Laboratory (ORNL). Key outcomes included: • Development of process-structure-property data sets to better understand the relationships between manufacturing processes, material structure, and performance characteristics. • Establishment of an in-situ monitoring system to link these various data sets together. • Detailed characterization of the raw material feedstock to further strengthen the understanding of process-structure and process-property relationships. Building on this foundation, in FY25 there was interest in exploring the behavior of additively manufactured 316H SS under different test conditions to support the overall material qualification process. Los Alamos National Laboratory (LANL) was tasked with providing specimen samples to the collaborating labs, who then conducted a round-robin study examining factors like selective heat treatment, low-cycle fatigue (LCF), and tensile-creep (T-C) properties. Additionally, high-temperature differential scanning calorimetry (DSC) was performed by LANL to better understand how the material's thermal characteristics change as it is heated up to the melting point. This provided a more comprehensive understanding of the material's behavior. The combined results from these investigations could potentially be used to support the inclusion of 316H stainless steel in Section III, Division 5 of the relevant codes and standards, allowing its use in future nuclear reactor applications.

36 MATERIALS SCIENCE↗

High-Throughput Optical Mapping for Accelerated Stress Testing of PV Module Materials

The study will provide guidance towards the design and application of larger and/or outdoor-use intended instruments. Measurement capability will be benchmarked against existing specimens, examined in a round-robin study using conventional spectrophotometer instruments. Data acquisition and storage will be integrated into the DuraMAT DataHub network along with data visualization tool, facilitating sharing of information.

14 SOLAR ENERGY↗

A Custom High-Throughput Optical Mapping Instrument (OMI) for Accelerated Stress Testing of PV Module Materials

The performance and integrity of photovoltaic (PV) modules and materials may be assessed through optical characterizations. We have developed a custom Optical Mapping Instrument (OMI) to improve measurement throughput time, facilitate automated measurements, and obtain spatial information relative to commercial benchtop spectrophotometer instruments. Both the key components and the methods used to improve the measurements are described. The measurement precision for the OMI is benchmarked for hemispherical transmittance relative to a previous round-robin study for commercial spectrophotometers. Example mapping measurements and their implications are given for specimens from other studies, including: (1) the depletion of the UV absorber is revealed for specimens beyond a certain size after standardized artificial ultraviolet (UV) weathering, (2) an optical degradation by internal haze formation is confirmed following Damp Heat (85°C/85% relative humidity) testing, (3) the better uniformity of the wear pattern for falling sand abrasion is used to select the DIN 52348 fixture over the ASTM D968 fixture, and (4) the local (millimeter-scale) heterogeneity of surface contamination in the soiling-prone location of Dubai relative to Kuwait. The results of the UV study have already been used to improve the standardized weathering of encapsulants. The example for Damp Heat testing is given to increase awareness of a degradation believed to be ubiquitously occurring in safety and design-type qualification testing of PV modules.

41 EE - Solar Energy Technologies Office (EE-4S)↗

A Custom High-Throughput Optical Mapping Instrument for Accelerated Stress Testing of PV Module Materials

The performance and integrity of photovoltaic (PV) modules and materials may be assessed through optical characterizations. We have developed a custom optical mapping instrument (OMI) to improve measurement throughput time, facilitate automated measurements, allow for localized specimen examination, obtain spatial information relative to commercial benchtop spectrophotometer instruments, and provide automated data analysis. Both the key components and the methods used to improve the measurements are described. The measurement precision for the OMI is benchmarked for hemispherical transmittance relative to a previous round-robin study for commercial spectrophotometers. In addition to the unique instrument developed in this study, new insights have emerged from the examination of specimens from previous experiments, including: the depletion of the UV absorber is revealed for specimens beyond a certain size after artificial ultraviolet (UV) weathering; an optical degradation by internal haze formation is confirmed following Damp Heat (85 °C/85% relative humidity) testing; the better uniformity of the wear pattern for falling sand abrasion is used to select the DIN 52348 fixture over the ASTM D968 fixture; and the greater local (in the order of millimeters) heterogeneity of surface contamination in the soiling-prone location of Dubai relative to Kuwait. The results of the UV study have already been used to improve the standardized weathering of encapsulants. The example for Damp Heat testing is given to increase awareness of a degradation believed to be ubiquitously occurring in safety and design-type qualification testing of PV modules.

14 SOLAR ENERGY↗

How Should Machine Learning Be Successfully Used for Wind Speed Vertical Extrapolation?

An accurate characterization of the wind resource available at hub-height is required for an efficient and bankable wind farm project. However, direct measurement of wind speed at the constantly increasing height of the hub of commercial wind turbines is oftentimes challenging and expensive, so that it is common practice to vertically extrapolate the wind resource from lower and more easily accessible levels. Conventional techniques for wind speed vertical extrapolation include the use of a power law and a logarithmic profile. While simple, the limits in accuracy of these methods have been shown in various studies. Recently, machine learning has been proposed as a new method to vertically extrapolate winds. All the published studies on the topic assess the performance of machine learning techniques in vertically extrapolating the wind resource at the same location where the algorithm has been trained. However, in real-world applications, the wind resource is measured at the instrument location, but it then needs to be extrapolated at hub height at the location of the wind turbines within the find farm. To be able to fully recommend the use of machine learning techniques over the simple power law and logarithmic law, the spatial variability of the performance improvements of the machine learning approaches needs to be assessed. Here, we propose a round-robin validation of a machine learning-based method for wind speed extrapolation. We use 20 months of observations at four locations spanning a 100 km wide region at the Southern Great Plains (SGP) atmospheric observatory, in north-central Oklahoma. At each location, we train a random forest to predict 30-min average wind speed at 143 m AGL. We use as input features lidar wind speed at 65 m AGL, time of day, sonic anemometer wind speed at 4 m AGL, turbulent kinetic energy, and Obukhov length. First, we perform a same-site comparison of the performance of the proposed random forest against the conventional techniques for wind speed extrapolation (namely power law and logarithmic profile, with widely accepted stability corrections). We find that the random forest outperforms the power law in vertically extrapolating wind speed in all the considered stability regimes, with a 33% reduction in MAE for stable conditions, and a 31% reduction in unstable conditions. Similar results are found when comparing predictions of extrapolated winds from the logarithmic profile and the random forest with the observed values. Next, we propose a round-robin validation, to use the random forest trained at each site to extrapolate wind speed at the remaining three sites. We find that the performance of the random forest approach degrades when the algorithm is tested at a site different than the training one. However, even under those circumstances, the machine learning-based approach still outperforms the conventional techniques for wind speed extrapolation, with, on average, a reduction in mean absolute error between 15 and 20% over the conventional methods, with the largest benefits obtained under stable conditions.

Monte Carlo↗

Methods and models for predicting fatigue crack growth under random loading

Papers are presented in the volume summarizing the baseline data, methodology, procedures, and results of a round-robin analysis which was conducted to predict the fatigue crack growth in 2219-T851 aluminum center-cracked specimens subjected to flight loading in random cycle-by-cycle format. The objective of the analysis was to assess whether data from constant-amplitude fatigue crack growth tests on center-cracked specimens can be used to predict fatigue crack growth lives under random loading. The following approaches are discussed in detail: a root-mean-square approach, a crack-closure model, a multi-parameter yield zone model, and a load-interaction model.

Chang, J. B.↗

Membrane Pretreatment and Cell Conditioning for Proton Exchange Membrane Water Electrolysis

As the research community studying proton exchange membrane water electrolysis (PEMWE) grows, it is important to develop methods that achieve transparent, reproducible research. Reproducibility of performance and durability is a challenge facing the PEMWE field, as the published literature includes a wide spread of results obtained with nominally similar materials. Prior round-robin performance benchmarking efforts [1] have identified inadequate cell conditioning as a major source of variation in apparent cell performance. Inadequate pre-treatment and conditioning can lead to instability in initial performance and adds ambiguity to durability measurements. However, excessively prolonged conditioning procedures limit the throughput of testing and the pace of research. Pretreatment and conditioning methods vary significantly across the research literature, but little systematic investigation is available into the mechanisms of these procedures or how procedural differences may impact results. This presentation will discuss investigations into the effects of membrane pre-treatment and operating procedures during cell conditioning on initial performance and catalyst-specific accelerated stress tests, with the aim of recommending procedures to enable clear, reproducible, and high-throughput research. Methods investigated include the use of hydrogen peroxide, acids, and hydration at elevated temperature for membrane pretreatment, and conditioning procedures such as current or voltage holds and cycling. The investigations cover both the impacts of these procedures on cell performance and stability as well as underlying mechanisms and processes taking place in the cell materials.

cell↗

NASA-Langley Research Center's participation in a round-robin comparison between some current crack-propagation prediction methods

A round-robin study was conducted which evaluated and compared different methods currently in practice for predicting crack growth in surface-cracked specimens. This report describes the prediction methods used by the Fracture Mechanics Engineering Section, at NASA-Langley Research Center, and presents a comparison between predicted crack growth and crack growth observed in laboratory experiments. For tests at higher stress levels, the correlation between predicted and experimentally determined crack growth was generally quite good. For tests at lower stress levels, the predicted number of cycles to reach a given crack length was consistently higher than the experimentally determined number of cycles. This consistent overestimation of the number of cycles could have resulted from a lack of definition of crack-growth data at low values of the stress intensity range. Generally, the predicted critical flaw sizes were smaller than the experimentally determined critical flaw sizes. This underestimation probably resulted from using plane-strain fracture toughness values to predict failure rather than the more appropriate values based on maximum load.

Hudson, C. M.↗

SeaWiFS technical report series. Volume 19: Case studies for SeaWiFS calibration and validation, part 2

This document provides brief reports, or case studies, on a number of investigations and data set development activities sponsored by the Calibration and Validation Team (CVT) within the Sea-viewing Wide Field-of-view Sensor (SeaWiFS) Project. Chapter 1 is a comparison with the atmospheric correction of Coastal Zone Color Scanner (CZCS) data using two independent radiative transfer formulations. Chapter 2 is a study on lunar reflectance at the SeaWiFS wavelengths which was useful in establishing the SeaWiFS lunar gain. Chapter 3 reports the results of the first ground-based solar calibration of the SeaWiFS instrument. The experiment was repeated in the fall of 1993 after the instrument was modified to reduce stray light; the results from the second experiment will be provided in the next case studies volume. Chapter 4 is a laboratory experiment using trap detectors which may be useful tools in the calibration round-robin program. Chapter 5 is the original data format evaluation study conducted in 1992 which outlines the technical criteria used in considering three candidate formats, the hierarchical data format (HDF), the common data format (CDF), and the network CDF (netCDF). Chapter 6 summarizes the meteorological data sets accumulated during the first three years of CZCS operation which are being used for initial testing of the operational SeaWiFS algorithms and systems and would be used during a second global processing of the CZCS data set. Chapter 7 describes how near-real time surface meteorological and total ozone data required for the atmospheric correction algorithm will be retrieved and processed. Finally, Chapter 8 is a comparison of surface wind products from various operational meteorological centers and field observations. Surface winds are used in the atmospheric correction scheme to estimate glint and foam radiances.

Hooker, Stanford B.↗

The Ocean Colour Climate Change Initiative: III. A Round-Robin Comparison on In-Water Bio-Optical Algorithms

Satellite-derived remote-sensing reflectance (Rrs) can be used for mapping biogeochemically relevant variables, such as the chlorophyll concentration and the Inherent Optical Properties (IOPs) of the water, at global scale for use in climate-change studies. Prior to generating such products, suitable algorithms have to be selected that are appropriate for the purpose. Algorithm selection needs to account for both qualitative and quantitative requirements. In this paper we develop an objective methodology designed to rank the quantitative performance of a suite of bio-optical models. The objective classification is applied using the NASA bio-Optical Marine Algorithm Dataset (NOMAD). Using in situ Rrs as input to the models, the performance of eleven semianalytical models, as well as five empirical chlorophyll algorithms and an empirical diffuse attenuation coefficient algorithm, is ranked for spectrally-resolved IOPs, chlorophyll concentration and the diffuse attenuation coefficient at 489 nm. The sensitivity of the objective classification and the uncertainty in the ranking are tested using a Monte-Carlo approach (bootstrapping). Results indicate that the performance of the semi-analytical models varies depending on the product and wavelength of interest. For chlorophyll retrieval, empirical algorithms perform better than semi-analytical models, in general. The performance of these empirical models reflects either their immunity to scale errors or instrument noise in Rrs data, or simply that the data used for model parameterisation were not independent of NOMAD. Nonetheless, uncertainty in the classification suggests that the performance of some semi-analytical algorithms at retrieving chlorophyll is comparable with the empirical algorithms. For phytoplankton absorption at 443 nm, some semi-analytical models also perform with similar accuracy to an empirical model. We discuss the potential biases, limitations and uncertainty in the approach, as well as additional qualitative considerations for algorithm selection for climate-change studies. Our classification has the potential to be routinely implemented, such that the performance of emerging algorithms can be compared with existing algorithms as they become available. In the long-term, such an approach will further aid algorithm development for ocean-colour studies.

Phytoplankton↗

Astrobiology Sample Analysis Program (ASAP) for Advanced Life Detection Instrumentation Development and Calibration

Scientific ground-truth measurements for near-term Mars missions, such as the 2009 Mars Science Laboratory (MSL) mission, are essential for validating current in situ flight instrumentation and for the development of advanced instrumentation technologies for life-detection missions over the next decade. The NASA Astrobiology Institute (NAI) has recently funded a consortium of researchers called the Astrobiology Sample Analysis Program (ASAP) to analyze an identical set of homogenized martian analog materials in a "round-robin" style using both state-of-the-art laboratory techniques as well as in-situ flight instrumentation including the SAM gas chromatograph mass spectrometer and CHEMIN X-ray diffraction/fluorescence instruments on MSL and the Urey and MOMA organic analyzer instruments under development for the 2013 ExoMars missions. The analog samples studied included an Atacama Desert soil from Chile, the Murchison meteorite, a gypsum sample from the 2007 AMASE Mars analog site, jarosite from Panoche Valley, CA, a hydrothermal sample from Rio Tinto, Spain, and a "blind" sample collected during the 2007 MSL slow-motion field test in New Mexico. Each sample was distributed to the team for analysis to: (1) determine the nature and inventory of organic compounds, (2) measure the bulk carbon and nitrogen isotopic composition, (3) investigate elemental abundances, mineralogy and matrix, and (4) search for biological activity. The experimental results obtained from the ASAP Mars analog research consortium will be used to build a framework for understanding the biogeochemistry of martian analogs, help calibrate current spaceflight instrumentation, and enhance the scientific return from upcoming missions.

Glavin, Daniel↗