SEARCH · Engineering Papers

Results for “Sample size determination”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

All sources NASA NTRS DOE OSTI

DOE OSTI2023

A user-friendly plug-and-play cyclic olefin copolymer-based microfluidic chip for room-temperature, fixed-target serial crystallography

Over the past two decades, serial X-ray crystallography has enabled the structure determination of a wide range of proteins. With the advent of X-ray free-electron lasers (XFELs), ever-smaller crystals have yielded high-resolution diffraction and structure determination. A crucial need to continue advancement is the efficient delivery of fragile and micrometre-sized crystals to the X-ray beam intersection. This paper presents an improved design of an all-polymer microfluidic `chip' for room-temperature fixed-target serial crystallography that can be tailored to broadly meet the needs of users at either synchrotron or XFEL light sources. The chips are designed to be customized around different types of crystals and offer users a friendly, quick, convenient, ultra-low-cost and robust sample-delivery platform. Compared with the previous iteration of the chip [Gilbile et al. (2021), Lab Chip , 21 , 4831–4845], the new design eliminates cleanroom fabrication. It has a larger imaging area to volume, while maintaining crystal hydration stability for both in situ crystallization or direct crystal slurry loading. Crystals of two model proteins, lysozyme and thaumatin, were used to validate the effectiveness of the design at both synchrotron (lysozyme and thaumatin) and XFEL (lysozyme only) facilities, yielding complete data sets with resolutions of 1.42, 1.48 and 1.70 Å, respectively. Overall, the improved chip design, ease of fabrication and high modifiability create a powerful, all-around sample-delivery tool that structural biologists can quickly adopt, especially in cases of limited sample volume and small, fragile crystals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

Moving beyond the Solvent-Tip Approximation to Determine Site-Specific Variations of Interfacial Water Structure through 3D Force Microscopy

Although interfacial solution structure impacts environmental, biological, and technological phenomena, including colloidal stability, protein assembly, heterogeneous nucleation, and water desalination, its molecular details remain poorly understood. Here, we visualize the three-dimensional (3D) hydration structure at the boehmite(010)-water interface using fast force mapping (FFM). Using a self-consistent scheme to decouple long-range tip-sample interactions from short-range solvation forces, we obtain the solution structure with lattice resolution. The results are benchmarked against molecular dynamics simulations that explicitly include the effects of the tip with different levels of approximation and systematically account for tip size, chemistry, and confinement effects. We find four laterally structured water layers within 1 nm of the surface, with the highest water densities at sites adjacent to hydroxyl groups. The key features beyond the first two layers can only be predicted using a full-scale simulation of the boehmite-water-silica system. Our findings further reveal a complex relationship between site-specific chemistry, water density, and long-range particle interactions; and present important advances toward quantitative data interpretation in 3D FFM.

36 MATERIALS SCIENCE↗

DOE OSTI2022

To grind or not to grind? The influence of mechanical and thermal treatments on the $\mathrm{Cu/Zn}$ disorder in $\mathrm{Cu}$ 2 $\mathrm{ZnSn}$($\mathrm{S}$ x $\mathrm{Se}$ 1-x ) 4 monograins

We report that Kesterite-type based thin film solar cell technologies are mainly based on polycrystalline absorber layers. A promising low cost alternative technology uses Cu 2 ZnSn(S x Se 1-x ) 4 (CZTSSe) monograins (single crystals of 20–100 μm size) which are fixed in a polymer matrix to form a flexible solar cell. The Cu/Zn disorder is discussed as a possible reason for band tailing causing voltage losses limiting the efficiency of CZTSSe-based devices. The experimental determination of the order parameter Q which is a quantitative measure of Cu/Zn disorder, requires a differentiation between the isoelectronic cations Cu + and Zn 2+ . An in-depth analysis of neutron diffraction data allows the determination of type and concentration of intrinsic point defects including a distinction between Cu and Zn. Neutron diffraction requires large sample volumes, thus monograins offer the unique possibility to correlate structural disorder in CZTSSe with device performance parameters. In this study we tackle the influence of grinding the monograins on stoichiometry deviations, the Cu/Zn disorder as well as intrinsic point defects and optoelectronic properties of CZTSSe monograins. Moreover, an easy methodology based on Raman scattering spectroscopy is proposed for the assessment of Cu/Zn disorder in the CZTSSe compounds.

14 SOLAR ENERGY↗

DOE OSTI2025

Mitigation of Pitting on Nitrogen-Doped Niobium Surfaces through Two-Step Electropolishing

Surface processing of niobium superconducting RF cavities used in particle accelerators is crucial for determining their performance. The nitrogen (N)-doping method, developed at Fermilab, enhances the cavities’ quality factor by doping the cavity’s interior surface with N atoms at 800 °C. After N-doping, electropolishing (EP) is employed to remove the niobium nitride phases and attain the desired concentration of interstitial N atoms. This study explores the effects of EP conditions on N-doped niobium samples. The samples were electropolished at 5 to 40 °C and voltages between 3 and 22 V. Different EP voltage ranges produced two types of pits, classified based on their sizes. Larger pits, linked to higher voltages, are also affected by the reaction rate. Pitting could be reduced at a lower temperature and adequate EP voltage. However, to effectively minimize gas evolution forming large-sized pitting, peeling off the top nitride layer before EP might be beneficial. This was achieved through precise low-voltage etching, forming a two-step EP process. The process involves removing the top 100–200 nm layer at a low voltage, followed by standard EP to remove the required material. This two-step EP process effectively mitigated the pitting risk associated with gas evolution on N-doped surfaces.

43 PARTICLE ACCELERATORS↗

DOE OSTI2025

Detecting Unclassified Electromagnetic Signals for Secure Wireless Communication Using Open Set Recognition

We developed multiple machine learning methods for the detection and classification of new wireless communication waveforms, which is critical for targeted attacks in wireless networks and electronic warfare. Our machine learning models are capable of dynamically detecting security threats in near real time through our advanced open set recognition (OSR) approach. This model has demonstrated significant improvements in the detection of unknown waveforms, thereby enhancing the security and reliability of mission critical communications. Our approach to detecting uncertain security threats is novel; we advanced OSR techniques by incorporating domain knowledge of wireless signals. Specifically, we combined time and frequency domain model features to enhance the model’s performance. Utilizing an OSR approach eliminates the need for training data to be distributed similarly to the deployment environment and removes the requirement for the training set to contains all possible threat classes. This is crucial because it is often infeasible to determine and characterize all potential security threats in advance. Our model were trained on simulated data, generated in partnership with the University at Albany, State of New York. The data set contained a diverse array of wireless signals, including those with additive white Gaussian noise and multipath signals, with and without line of sight. This comprehensive training set allowed us to optimize our models to detect unknown waveforms under various challenging scenarios, such as low signal-to-noise ratios. By training on various waveforms, varying signal-to-noise ratio, and different sample sizes under normal conditions, our models were fine tuned to perform effectively in challenging environments.

99 - GENERAL AND MISCELLANEOUS↗

DOE OSTI2025

Physical and Hydraulic Properties of RCRA Borehole Samples from the Hanford Site : Final Report, Fiscal Years 2023-2024

Sediment from 44 core samples collected from Resource Conservation and Recovery Act (RCRA) boreholes drilled in the 200 East and 200 West areas of the Hanford Site were characterized for physical and hydraulic properties (Table S.1). Characterization data included gravimetric water contents and matric potentials, grain-size distributions, saturated hydraulic conductivity, water retention characteristics, and unsaturated hydraulic conductivity. These properties provide site-specific data and parameters that can be used in subsurface flow and contaminant transport models to assess the transport and fate of contaminants in the vadose zone and underlying aquifer systems. The analyzed core samples come from specific areas and depth intervals at the Hanford Site that were targeted for sampling to address data gaps identified by site contractors (Khaleel 2020). X-ray computed tomography (XCT) was used to evaluate the general textural characteristics of the samples and to determine which samples to use for further physical and hydraulic property characterization. Subsequent sample selection was determined by consensus after review of the XCT images by Pacific Northwest National Laboratory, Central Plateau Cleanup Company, and INTERA staff.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2020

Post-process annealing of large-scale 3D printed polyphenylene sulfide composites

Large-scale extrusion-based additive manufacturing of high-performance thermoplastic composites like fiber reinforced polyphenylene sulfide (PPS) is well-suited for tooling applications to lower manufacturing costs and lead times. Autoclave tooling requires good mechanical performance at temperatures even above the glass transition temperature (T g ). In this work, the authors have investigated a post-process isothermal annealing technique to improve the mechanical properties of various grades of carbon fiber reinforced PPS components printed on the Big Area Additive Manufacturing (BAAM) system. Since PPS is a semi-crystalline polymer, crystallinity can change during annealing and affect the mechanical properties of the part. In addition, isothermal annealing can also lead to solid-state structural changes in the form of thermal and oxidative branching and/or crosslinking reactions in some grades of PPS which can alter the crystallization process. This work reports the effect of annealing on dynamic mechanical properties of BAAM printed components, along with studies to determine the effect of annealing on crystallinity and the occurrence of oxidative reactions. Results showed that isothermal annealing at 250 °C for 18 h improved the storage modulus of all selected grades (neat and reinforced) of PPS at temperatures above T g . Annealing led to an overall increase in the degree of crystallinity, with secondary crystallization taking place. Although oxidative structural changes were observed to occur more on the surface of the PPS parts, they primarily influenced the size of crystals formed and did not significantly alter the degree of crystallinity at various regions within the sample.

36 MATERIALS SCIENCE↗

DOE OSTI2022

High-temperature compressive creep tests of U 3 Si 2 with spark plasma sintering: Experiments and finite element modeling

This paper reports a systematic high-temperature creep behavior of dense U 3 Si 2 pellets using a spark plasma sintering (SPS) apparatus at elevated temperatures and pressures under vacuum conditions. The stress exponent was subsequently derived to be 3.21 at 1173 K and 2.17 at 1223 K, respectively, indicating a grain boundary sliding creep mechanism. The creep activation energy was determined to be 203.6 ± 19.0 kJ/mol, which agrees well with the literature. Finite element modeling was performed using the creep parameters fitted from the strain-time plot. Additionally, the results suggest an excellent match with the experimental data, confirming the validity of the experiments. Microstructure characterizations indicate that the main phase of the specimens after creep tests remains to be U 3 Si 2 , with a 4 μm thick layer of nano-sized particles induced from the diffusion between U 3 Si 2 and alumina disc used to avoid electric current passing through the sample. The successful conduct of creep experiments demonstrates the great potential of SPS to perform high-temperature mechanical testing of nuclear fuels under vacuum conditions. The subsequent finite element modeling exhibits excellent capabilities for accurately predicting material performance in the creep tests and provides a practical tool in evaluating nuclear fuels’ performance for a much-extended time scale.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Dynamic behavior of reversible oxygen migration in irradiated-annealed high temperature superconducting wires

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2023

ANS MiNES 2023 Poster

The dynamic mechanical properties of four varieties of high purity graphite as well as the depth of penetration (DoP) of a small-scale shaped charge into these grades was experimentally determined. The grades chosen were PCEA, NBG-18, and NBG-25. These grades provide a wide range of physical properties: in density from 1.80 – 1.85 g/cc, in maximum particle size from 10s to 1000s of µm, and in porosity from 18% to 20%. The quasistatic and dynamic compressive strengths of each grade were determined and correlated to their physical properties. The split Hopkinson pressure bar experiments showed both the dynamic strength and dominant shear failure mechanisms. A small scale shaped charge was used to compare the resistance of graphite to hypervelocity jet impacts: the Teledyne RP-4. The RP-4 has a 1.01” outer diameter and 3.44 g of RDX with an RP-80 booster (86 mg PETN + 123 mg RDX). A select number of samples were analyzed using X-Ray Computed Tomography (XCT), allowing for the full characterization of the undisturbed wound channel. A selection of other samples were physically sectioned and wound channels mapped from the sections. In addition to DoP, the wound geometry was characterized in terms of total volume and diameter at different depths. The wound channel characteristics for each grade were correlated to the compressive strengths and physical properties. In several of the test samples, the wound channel diameter was smaller than the diameter of the shaped charge slug just behind where the slug had penetrated the sample. These results indicated that the wound geometry was dependent on the compressive hysteresis behavior of graphite.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Monitoring Sulfuric Acid and Temperature Using Raman Spectroscopy and Multivariate Chemometrics

Multivariate regression models were optimized for the quantification of sulfuric acid (H 2 SO 4 ) [0–8 M] and temperature (20 °C–80 °C) in the presence of ammonium sulfate ((NH 4 ) 2 SO 4 [0–0.6 M]) using Raman spectroscopy. Optical vibrational spectroscopy is a useful nondestructive technique for the in situ analysis of complex chemical systems notoriously difficult to monitor in situ and in real-time. Multivariate analysis, a chemometrics method, can be paired with these nondestructive optical methods for determining analyte concentration and speciation in complex solutions, such as dissociated species in polyprotic acids, e.g., H 2 SO 4 . The effect of temperature is often overlooked although it can have a major influence on speciation and the corresponding Raman spectra. Here, in this study, partial least squares regression models were optimized for the quantification of H 2 SO 4 and its two deprotonated forms as a function of temperature. Measuring bisulfate as a function of temperature is particularly challenging owing to changes in the second dissociation constant. A designed training set effectively minimized the sample set size and trained a robust predictive model with percent root mean square error of <3% for H 2 SO 4 . The practical strategy employed here was demonstrated to be effective for building chemometric models that directly account for dynamic temperatures with static samples and is shown to be amenable to flow cell analysis applications with a simple calibration transfer for process monitoring applications.

D-optimal design↗

DOE OSTI2020

MESOSCALE THERMAL TRANSPORT MEASUREMENTS OF MULTI-PHASE AND POROUS NUCLEAR FUELS USING A SQUARE-WAVE PULSE THERMOREFLECTANCE TECHNIQUE

The safe and efficient operation of nuclear reactors require accurate knowledge of peak temperatures in the fuel assemblies. The temperature profiles are governed by the thermal transport properties of the fuel, namely the thermal conductivities (k) and thermal diffusivities (D). These values can be very difficult to measure as they are known to vary considerably from the measured bulk values of the fresh fuel, and quickly degrade with increasing burnup [1 -3] . Laser-based techniques have been effectively used for non-destructive and non-contact thermal transport measurements of a wide variety of materials, including nuclear materials [4-6] that would otherwise prove too hazardous or difficult to measure otherwise. In this study, a new thermoreflectance technique known as square-pulse transient thermoreflectance (SPTR) is described and used to determine the mesoscale thermal diffusivity of both uranium sesquisilicide (U3Si2) and uranium nitride (UN) phases in a composite fuel with micron level spatial resolution [7]. This technique employs a rapid train of square-wave pulses from an excitation laser to create a periodic heat flux on a gold coated sample surface. Surface adsorption results in transient film temperatures and hence rapid fluctuations in thermoreflectance that can be measured via a detection laser coupled with a digital oscilloscope. The lasers are coaxially focused on the sample surface, allowing for a sample measurement area of a single convolved laser spot size (~2 µm). A sensitivity analysis was conducted to identify key measurement parameters of this technique using reference materials with a range of thermal conductivities comparable to those of both ceramic, composite, and metal nuclear fuel types (1.4 – 27.2 W/m-K). The reference materials were measured using the new technique as well as a spatial-domain thermoreflectance technique (SDTR) previously reported for a comparison [8]. Additionally, measurements of several U3Si2 and UN phase regions of a polished UN/U3Si2 (70/30 vol.%) sample were taken, and the resulting calculated D values are reported, with both techniques showing excellent agreement between samples. This technique was used to scan a multiphase region at 5 micron increments to generate a local diffusivity map, demonstrating the utility of the techniques for measuring thermal transport properties in specimens with precipitates and secondary phases. Furthermore, the technique is currently being applied to measure thermal properties of Fast Flux Test Reactor (FFTR) irradiated metal fuel specimens whose porous microstructure make it very difficult to measure using other techniques. Comparison of the local scale measurements are compared with the pre-irradiated fuel samples to show the degradation of thermal transport in fuels due to pores from fission gas bubbles and other irradiation induced defects.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2021

Identifying crystallographic faces of the fluorites urania and thoria with rotational polarized Raman spectroscopy

Crystallite orientation identification is invaluable, but is often limited to small area identification or requires a large area sample. Nondestructive optical methods such as polarized Raman spectroscopy, in contrast, can be used to completely map a variety of sample sizes, but their potential is not yet fully realized. Here, we report a systematic study of polarized Raman scattering of high-quality, hydrothermally grown, single crystals of urania and thoria. The peak intensity variations for as-grown major crystal planes, post-growth polished crystal planes, and a post-growth polished non-crystallographic plane are directly linked to crystallographic orientation and crystal rotation, and agree with computed models. In particular, the parallel polarized peak intensity results are directly correlated with metal–oxygen–metal chains in the fluorite structure and can be used to determine both orientation and rotational alignment of a given crystal face if sufficiently small rotational steps are applied. These results are structure based, being applicable to the larger fluorite phase space, which is useful for optical, semiconductor, nuclear, and solid oxide fuel cell industries. Further, these results suggest that Raman spectroscopy can identify non-crystallographic orientations that are not discernable by traditional means.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Kinetically Controlled Linker Binding in Rare Earth-2,5-Dihydroxyterepthalic Acid Metal–Organic Frameworks and Its Predicted Effects on Acid Gas Adsorption

In the pursuit of highly stable and selective metal–organic frameworks (MOFs) for the adsorption of caustic acid gas species, an entire series of rare earth MOFs have been explored. Each of the MOFs in this series (RE-DOBDC; RE = La, Ce, Pr, Nd, Sm, Eu, Gd, Tb, Dy, Ho, Er, Tm, Yb, and Lu; DOBDC = 2,5-dihydroxyterepthalic acid) was synthesized in the tetragonal space group I4/m. Crystallized MOF samples, specifically Eu-DOBDC, were seen to have a combination of monodentate and bidentate binding when synthesized under typical reaction conditions, resulting in a contortion of the structure. However, extended crystallization times determined that this binding is kinetically controlled and that the monodentate binding option was crystallographically eliminated by extended reaction times at higher temperatures. Furthermore, this series allows for the direct study of the effect of the metal center on the structure of the of the MOF; herein, the lanthanide metal ionic radii contraction across the periodic table results in a reduction of the MOF pore size and lattice parameters. Scanning electron microscopy–energy-dispersive spectroscopy was used to investigate the stages of crystal growth for these RE-DOBDC MOFs. All MOFs, except Er-DOBDC had a minimum of two stages of growth. These analogues were demonstrated by analysis of neutron diffraction (PND) to exhibit a cooperative rotational distortion of the secondary building unit, resulting in two crystallographically distinct linker sublattices. Computational modeling efforts were used to show distinct differences on acid gas (NO 2 and SO 2 ) binding energies for RE-DOBDC MOFs when comparing the monodentate/bidentate combined linker with the bidentate-only linker crystal structures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

New signature method for identifying organic material in atmosphere and water samples

The levels of plastic contamination in the earth’s oceans have steadily increased over the past century, creating a threat to marine life and increasing climate change. Several methods have been developed over the past decade to try to determine the amount and accumulation rate of plastic impurities in the ecosystem. These methods have proven promising but suffer from long measurement times, bulky non-mobile systems, and sample degradation. We propose a smaller, faster system that employs an electron beam to examine seawater samples for polyethylene contamination levels. This process generates a full electron and photon energy spectrum analyses based on the subatomic particles generated from electron interactions. Our simulations have already been developed based on the known molecular composition of seawater and polyethylene, showing the possibility of discerning molecular plastics from microorganisms. With a system the size of a suitcase, this system would be easily deployable to remote locations around the world or installed as a monitoring system for manufacturing facilities. This concept could lead to a new methodology for the science of signatures and be applied to other biological hazard investigations, such as general virus detection.

43 PARTICLE ACCELERATORS↗

DOE OSTI2025

Shielded magnetic small-angle neutron scattering for characterization of radioactive samples

The development of a Pb-shielded fixture for the execution of a small-angle neutron scattering (SANS)-based workflow for interrogation of highly irradiated nuclear materials has been explored. The Pb shielding was specially designed to reduce the detected radioactivity from the specimen during SANS experiments, and the overall configuration is termed shielded magnetic SANS (SM-SANS). Two FeCrAl-based alloys, C35M and 125YF, were examined with the SM-SANS technique using a free-form size distribution locally monodisperse model in both the as-received and irradiated states. Quantitative values derived from the free-form size distribution were compared with atom probe tomography experiments. Microstructural and compositional parameters determined using the two characterization techniques were complements of each other. The results demonstrate that the SM-SANS technique is an effective means of characterizing nanoscale clustering in irradiated material systems and provides new avenues for investigating radioactive material microstructures.

FeCrAl↗

DOE OSTI2024

Validation of the Scientific Program for the Dark Energy Spectroscopic Instrument

The Dark Energy Spectroscopic Instrument (DESI) was designed to conduct a survey covering 14,000 deg$^{2}$ over 5 yr to constrain the cosmic expansion history through precise measurements of baryon acoustic oscillations (BAO). The scientific program for DESI was evaluated during a 5 month survey validation (SV) campaign before beginning full operations. This program produced deep spectra of tens of thousands of objects from each of the stellar Milky Way Survey (MWS), Bright Galaxy Survey (BGS), luminous red galaxy (LRG), emission line galaxy (ELG), and quasar target classes. These SV spectra were used to optimize redshift distributions, characterize exposure times, determine calibration procedures, and assess observational overheads for the 5 yr program. In this paper, we present the final target selection algorithms, redshift distributions, and projected cosmology constraints resulting from those studies. We also present a One-Percent Survey conducted at the conclusion of SV covering 140 deg$^{2}$ using the final target selection algorithms with exposures of a depth typical of the main survey. The SV indicates that DESI will be able to complete the full 14,000 deg$^{2}$ program with spectroscopically confirmed targets from the MWS, BGS, LRG, ELG, and quasar programs with total sample sizes of 7.2, 13.8, 7.46, 15.7, and 2.87 million, respectively. These samples will allow exploration of the Milky Way halo, clustering on all scales, and BAO measurements with a statistical precision of 0.28% over the redshift interval z < 1.1, 0.39% over the redshift interval 1.1 < z < 1.9, and 0.46% over the redshift interval 1.9 < z < 3.5.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Accounting for Training Data Error in Machine Learning Applied to Earth Observations

Remote sensing, or Earth Observation (EO), is increasingly used to understand Earth system dynamics and create continuous and categorical maps of biophysical properties and land cover, especially based on recent advances in machine learning (ML). ML models typically require large, spatially explicit training datasets to make accurate predictions. Training data (TD) are typically generated by digitizing polygons on high spatial-resolution imagery, by collecting in situ data, or by using pre-existing datasets. TD are often assumed to accurately represent the truth, but in practice almost always have error, stemming from (1) sample design, and (2) sample collection errors. The latter is particularly relevant for image-interpreted TD, an increasingly commonly used method due to its practicality and the increasing training sample size requirements of modern ML algorithms. TD errors can cause substantial errors in the maps created using ML algorithms, which may impact map use and interpretation. Despite these potential errors and their real-world consequences for map-based decisions, TD error is often not accounted for or reported in EO research. Here we review the current practices for collecting and handling TD. We identify the sources of TD error, and illustrate their impacts using several case studies representing different EO applications (infrastructure mapping, global surface flux estimates, and agricultural monitoring), and provide guidelines for minimizing and accounting for TD errors. To harmonize terminology, we distinguish TD from three other classes of data that should be used to create and assess ML models: training reference data, used to assess the quality of TD during data generation; validation data, used to iteratively improve models; and map reference data, used only for final accuracy assessment. We focus primarily on TD, but our advice is generally applicable to all four classes, and we ground our review in established best practices for map accuracy assessment literature. EO researchers should start by determining the tolerable levels of map error and appropriate error metrics. Next, TD error should be minimized during sample design by choosing a representative spatio-temporal collection strategy, by using spatially and temporally relevant imagery and ancillary data sources during TD creation, and by selecting a set of legend definitions supported by the data. Furthermore, TD error can be minimized during the collection of individual samples by using consensus-based collection strategies, by directly comparing interpreted training observations against expert-generated training reference data to derive TD error metrics, and by providing image interpreters with thorough application-specific training. We strongly advise that TD error is incorporated in model outputs, either directly in bias and variance estimates or, at a minimum, by documenting the sources and implications of error. TD should be fully documented and made available via an open TD repository, allowing others to replicate and assess its use. To guide researchers in this process, we propose three tiers of TD error accounting standards. Finally, we advise researchers to clearly communicate the magnitude and impacts of TD error on map outputs, with specific consideration given to the likely map audience.

58 GEOSCIENCES↗