Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Measurement and Verification Plan”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Data Analysis of Energy Code Compliance in Commercial Buildings (Rev. 1)

What percent of newly constructed commercial buildings comply with the energy code? How much energy and cost could be saved if the compliance increased? Which code requirements have both low compliance rates and high savings potential? These are the questions U.S. Department of Energy (DOE) is trying to answer through its Commercial Energy Code Field Study. Previous commercial studies have been very limited and did not result in a widely accepted and tested methodology. DOE’s goal is to create a standardized methodology that can produce actionable results at a reasonable study cost, that can be used by state and local governments and utilities and provides valuable information to policy makers. The field study team implemented the pilot methodology, compiling a data set of 230 office and retail buildings in two climate zones. The approach is based on identifying lost savings on a total energy cost basis rather than simply counting the quantity of measures that do not meet code. This report is focused on the analysis of the collected data. The primary goal was to analyze the data collected during the field study and determine the actual energy cost impact of each measure in a non-compliance situation. The energy impact results allowed for ranking the measures to identify which have the highest potential for lost savings. These results combined with the time required to verify each measure will allow future compliance verification to focus on measures that had a large impact on energy use over the life of the building and those that have the greatest savings recovery potential per verification hour.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS2015

Understanding Community Needs and Desires

This panel exchange is focused on the Integration Test phase within the development lifecycle with special emphasis and dedicated discussion on integration and testing of complex systems. Layout and scheduling of integration tasks come from the verification of interface and performance requirements. However, planning for integration activities of complex systems is inherently different from traditional systems engineering integration planning activities. Decisions about the systems under development have to consider not only the technical and programmatic viewpoints but also the political, societal, operational, and economic viewpoints. Definition of performance measures, found intrinsic in the plan, with trans-disciplinary implications will be discussed. A scenario of integration of UAS in the NAS will be used as a benchmark of current views and lifecycle challenges.

Murphy, James R.↗
NASA NTRS1975

Bistatic radar sea state monitoring field test

Recent advances in understanding the physical phenomena controlling the interaction of electromagnetic energy with the ocean surface have revealed the possiblity of remote measurement of the two-dimensional surface wave height spectrum of the ocean using bistatic radar techniques. The basic feasibility of such a technique operating at frequencies in the HF region (3 to 30 MHz) was examined during previous studies and hardware for an experimental verification experiment was specified. The activities have resulted in a determination of the required hardware and system parameters for both satellite and aircraft systems, the development, assembly, and testing of hardware for an experimental aircraft system, the development and initial testing of data processing procedures, and the conduct of an initial flight test experiment. Activities were devoted to completing the assembly and testing of the experimental hardware, completing the experiment planning, conducting a field test experiment, and the processing and analysis of the experimental data. Even though directional spectrum maps of the test area cannot be generated from the measured data, the hardware concept employed appears viable, and solutions to the problems encountered have been identified.

Ruck, G. T.↗
DOE OSTI2025

Greenhouse Gas Accounting Procedures in Low Carbon Fuel Policies Overlook the Spatial Variability of Miscanthus-Derived Sustainable Aviation Fuel

Low carbon fuel policies such as the U.S. Renewable Fuel Standard (RFS), Canada Clean Fuel Regulations (CFR), and California Low Carbon Fuel Standard (LCFS) as well as the 45Z tax credit are intended to reduce greenhouse gas (GHG) emissions from transportation. Cellulosic feedstocks, optimized biorefineries, and favorable farming locations can significantly reduce biofuel carbon intensity (CI). Despite advances in field-to-fuel GHG monitoring and flexibility in resource allocation within biorefineries (e.g., governing net electricity production), rigid CI accounting procedures in current policies may limit CI responsiveness across candidate sites and processing facilities. Here, this work examines a hypothetical biomass-to-sustainable aviation fuel (SAF) pathway using miscanthus and alcohol-to-jet (i) to demonstrate how GHG accounting requirements drive estimates of biofuel CIs and (ii) to explore potential CI and financial implications of scenario-specific life cycle assessment (LCA). Results demonstrate that GHG accounting using the CFR/LCFS can reasonably account for distinct levels of net electricity production by a biorefinery, but only the CFR yields similar CI sensitivity to spatially explicit factors (feedstock CI, grid electricity CI) as scenario-specific LCA: most GHG accounting frameworks do not capture CI variation across candidate sites in the United States. Ultimately, this work demonstrates the importance of LCA methodological specifications in low carbon fuel policies and tax credits.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS2020

Environmental Verification of NASA’s Europa Clipper Mission

NASA’s Jet Propulsion Laboratory (JPL) and its partner are planning a mission to explore an icy moon of Jupiter, Europa. The objective of the planned Europa Clipper mission is to gain insight into the key ingredients for this potentially habitable world. This mission will conduct investigations using a suite of remote sensing and in-situ fields and particles instruments, and a two-channel ice-penetrating radar. Among its science objectives are to produce high-resolution images of Europa's surface, determine its composition, look for signs of recent or ongoing activity, measure the thickness of the ice shell, search for subsurface lakes, and determine the depth and salinity of Europa's ocean. Europa Clipper is expected to encounter very challenging environments. These environments include radiation, dynamics, thermal, and electromagnetics, which have been translated into a set of environmental requirements that are levied onto the Europa Clipper flight system design. This paper describes how the environmental requirements are specified and verified for each flight component and at which level of integration. A couple of examples will be provided to illustrate the process by which a comprehensive set of verification activities is specified and performed for individual subsystems and instruments to ensure mission success.

Man, Kin Fung↗
DOE OSTI2023

High-Resolution Synthetic Solar Irradiance Sequence Generation: An LSTM-Based Generative Adversarial Network

The rapid growth of renewable energy resources penetration is bringing more challenges to power system planning and operation. Relevant renewable energy integration studies, such as the capability and dynamic performance of inverter-based resources' primary frequency response and fast frequency response, require high-resolution renewable generation output data that are representative of renewable energy resources. This paper focuses on creating synthetic but realistic solar irradiance data and proposes a long short-term memory-based generative adversarial network to generate high-resolution (second-level) solar irradiance sequences from low-resolution (minute-level) measurements. Combined with a classifier to recognize the solar irradiance patterns, the proposed model is trained using multi-loss functions to accurately capture the temporal correlations among both high-resolution and low-resolution sequences. Verification of the proposed approach is performed on the data set of the Oahu Solar Measurement Grid collected through the National Renewable Energy Laboratory. The results of the case studies demonstrate the proposed approach's capability to capture the statistical characteristics of different solar irradiance patterns and to generate high-quality synthetic solar irradiance sequences in high resolution.

dynamic scheduling↗
NASA NTRSDate not supplied

Lunar Node – 1: Initial Flight Results and the Role of Surface Psuedolites in Lunar Navigation

On February 22, 2024, the Intuitive Machines IM-1 NOVA-C lander, nick-named Odysseus, landed on the lunar surface, carrying with it a cadre of NASA scientific and technology demonstration payloads. These payloads and missions marked the first delivery of NASA instruments to operate from the lunar surface since the Apollo landings. One of these payloads is Lunar Node -1 (LN-1), a navigation beacon demonstration mission. The payload was designed and built by NASA’s Marshall Space Flight Center. The payload’s main goal was to demonstrate and provide insight into the use of lunar surface-based radio navigation aids. As part of the mission, LN-1 successfully conducted multiple one-way transmissions from the NOVA-C vehicle to Deep Space Network ground receivers using its onboard S-band transmitter, while being disciplined by an onboard Space Chip Scale Atomic Clock. LN-1 transmitted to DSN on an almost daily basis during transit to the moon, including two surface passes. The payload was originally plan to conduct 7-10 days of surface operation as an always-on beacon. These passes focused on evaluating two main navigation approaches: performance and stability of ranging using time-based transfer techniques on a cubesat size and grade platform, as well as one-way psuedonoise ranging approaches. To assess performance, the measurements were compared to independent navigation solutions using multiple approaches including: one-way Doppler tracking, two-way Doppler Tracking, and visual verification of the landing location provided by visual observations from orbital platforms. While the mission only conducted limited surface operations, the data provides some initial insight to performance form the lunar surface. These results are compared with initial ground-based testing as well as continued evaluation of the flight-space platform using multiple grades of oscillators for maintaining clock and frequency stability. These focus on the timing stability of platform in a deep-space environment as well variations in state determination. Given these insights, this paper provides additional description and evaluation of how this approach can be utilized as part of a broader lunar navigation architecture, such as being developed and deployed across multiple international space agencies. Analysis is provided to develop overall timing requirements and assessment of operational scenarios, such as orbit and surface location determination. In addition, the results support discussion as to how surface pseudolites could best be used within existing standard signal definitions, such as defined in the LunaNet Interoperability Specifications. This will consider concerns such as the near-/far- problem as well as operational considerations, including whether a beacon is better suited as two- or one-way ranging platform. The use cases are focused on how these psuedolites can provide additional coverage to augment and support planned operational coverage. For example, this analysis provides analysis of mid-latitude surface missions, where there may be limited geometry and availability of orbital relays. The results will show how these navigation psuedolites can fit within the developing architecture to provide additional robustness, capability, and support multiple use cases. Lastly, the paper will discuss challenges and next steps to be addressed in the implementation and testing of a follow-on payload and a continued path towards demonstration and integration of this capability into Lunar PNT architectures.

Evan Anzalone↗
NASA NTRSDate not supplied

Lunar Node – 1: Initial Flight Results and the Role of Surface Psuedolites in Lunar Navigation

On February 22, 2024, Intuitive Machines NOVA-C lander, nick-named Odysseus, landed on the lunar surface, carrying with it a cadre of NASA scientific and technology demonstration payloads. These payloads and missions marked the first delivery of NASA instruments to operate from the lunar surface since the Apollo landings. One of these payloads is Lunar Node -1 (LN-1), a navigation beacon demonstration mission. The payload was designed and built by NASA’s Marshall Space Flight Center. The payload’s main goal was to demonstrate and provide insight into the use of lunar surface-based radio navigation aids. As part of the mission, LN-1 successfully conducted multiple one-way transmissions from the NOVA-C vehicle to Deep Space Network ground receivers using its onboard S-band transmitter, while being disciplined by an onboard Space Chip Scale Atomic Clock. LN-1 transmitted to DSN on an almost daily basis during transit to the moon, including two surface passes. The payload was originally plan to conduct 7-10 days of surface operation as an always-on beacon. These passes focused on evaluating two main navigation approaches: performance and stability of ranging using time-based transfer techniques on a cubesat size and grade platform, as well as one-way psuedonoise ranging approaches. To assess performance, the measurements were compared to independent navigation solutions using multiple approaches including: one-way Doppler tracking, two-way Doppler Tracking, and visual verification of the landing location provided by visual observations from orbital platforms. While the mission only conducted limited surface operations, the data provides some initial insight to performance form the lunar surface. These results are compared with initial ground-based testing as well as continued evaluation of the flight-space platform using multiple grades of oscillators for maintaining clock and frequency stability. These focus on the timing stability of platform in a deep-space environment as well variations in state determination. Given these insights, this paper provides additional description and evaluation of how this approach can be utilized as part of a broader lunar navigation architecture, such as being developed and deployed across multiple international space agencies. Analysis is provided to develop overall timing requirements and assessment of operational scenarios, such as orbit and surface location determination. In addition, the results support discussion as to how surface pseudolites could best be used within existing standard signal definitions, such as defined in the LunaNet Interoperability Specifications. This will consider concerns such as the near-/far- problem as well as operational considerations, including whether a beacon is better suited as two- or one-way ranging platform. The use cases are focused on how these psuedolites can provide additional coverage to augment and support planned operational coverage. For example, this analysis provides analysis of mid-latitude surface missions, where there may be limited geometry and availability of orbital relays. The results will show how these navigation psuedolites can fit within the developing architecture to provide additional robustness, capability, and support multiple use cases. Lastly, the paper will discuss challenges and next steps to be addressed in the implementation and testing of a follow-on payload and a continued path towards demonstration and integration of this capability into Lunar PNT architectures.

Evan J Anzalone↗
NASA NTRS2000

Microbial Impact on Success of Human Exploration Missions

The purpose of this study is to identify microbiological risks associated with space exploration and identify potential countermeasures available. Identification of microbial risks associated with space habitation requires knowledge of the sources and expected types of microbial agents. Crew data along with environmental data from water, surfaces, air, and free condensate are utilized in risk examination. Data from terrestrial models are also used. Microbial risks to crew health include bacteria, fungi, protozoa, and viruses. Adverse effects of microbes include: infections, allergic reactions, toxin production, release of volatiles, food spoilage, plant disease, material degradation, and environmental contamination. Risk is difficult to assess because of unknown potential changes in microbes (e.g., mutation) and the human host (e.g., immune changes). Prevention of adverse microbial impacts is preferred over remediation. Preventative measures include engineering measures (e.g., air filtration), crew microbial screening, acceptability standards, and active verification by onboard monitoring. Microbiological agents are important risks to human health and performance during space flight and risks increase with mission duration. Acceptable risk level must be defined. Prevention must be given high priority. Careful screening of crewmembers and payloads is an important element of any risk mitigation plan. Improved quantitation of microbiological risks is a high priority.

Pierson, Duane L.↗
DOE OSTI2022

Acceptance Test of WCTC with LEU Fuel at the IVG.1M Research Reactor Site in Kazakhstan

The water-cooled technological channels (WCTC) with low-enriched uranium (LEU) fuel, in the amount required for conversion, were delivered to the IVG.1M site by the manufacturer in February 2021 and thereafter the site acceptance test (SAT) of the WCTCs and the fuel elements started immediately. The paper provides an overview of the SAT conducted between March and November 2021 by the designated experts of the reactor operator and the manufacturer. It includes the introduction of the IVG.1M reactor and its unique WCTCs, and the inspection methodology to verify the conformity of the quality of the LEU fuel with the Technical Design (reference document). The paper presents results of the non-destructive and destructive tests, the outcomes of the thermohydraulic measurements, as well as the evaluation and corrective actions (if any), including the amendments (modifications) of the Technical Design initiated by the manufacturer based on the test results. Finally, the paper draws conclusions on the effectiveness of the SAT method used, captures consolidated experiential knowledge and shares lessons learned that can be used in general when planning and performing fuel verification.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1999

Dynamic Nucleation of Supercooled Melts and Measurement of the Surface Tension and Viscosity

We investigate the phenomenon of acoustic pressure-induced nucleation by using a novel approach involving the large amplitude resonant radial oscillations and collapse of a single bubble intentionally injected into a supercooled liquid. Using a combination of previously developed and proven techniques, the bubble is suspended in a fluid host by an ultrasonic field which supplies both the levitation capability as well as the forcing of the radial oscillations. We observe the effects of an increase in pressure (due to bubble collapse) in a region no larger than 100 microns within the supercooled melt to rigorously probe the hypothesis of pressure-induced nucleation of the solid phase. The use of single bubbles operating in narrow temporal and spatial scales will allow the direct and unambiguous correlation between the origin and location of the generation of the disturbance and the location and timing of the nucleation event. In a companion research effort, we are developing novel techniques for the non-contact measurements of the surface tension and viscosity of highly viscous supercooled liquids. Currently used non-invasive methods of surface tension measurement for the case of undercooled liquids generally rely of the quantitative determination of the resonance frequencies of drop shape oscillations, of the dynamics of surface capillary waves, or of the velocity of streaming flows. These methods become quickly ineffective when the liquid viscosity rises to a significant value. An alternate and accurate method which would be applicable to liquids of significant viscosity is therefore needed. We plan to develop such a capability by measuring the equilibrium shape of levitated undercooled melt droplets as they undergo solid-body rotation. The experimental measurement of the characteristic point of transition (bifurcation point) between axisymmetric and two-lobed shapes will be used to calculate the surface tension of the liquid. Such an approach has already been validated through the experimental verification of numerical modeling results. The experimental approach involves levitation, melting, and solidification of undercooled droplets using a hybrid ultrasonic-electrostatic technique in both a gaseous as well as a vacuum environment. A shape relaxation method will be investigated in order to derive a reliable method to measure the viscosity of undercooled melts. The analysis of the monotonic relaxation to equilibrium shape of a drastically deformed and super-critically damped free drop has been used to derive interfacial tension of immiscible liquid combinations where one of the component has high viscosity. A standard approach uses the initial elongation of a droplet through shear flows, but an equivalent method could involve the initial deformation of a drop levitated in a gas by ultrasonic radiation pressure, electric stresses, or even solid body rotation. The dynamic behavior of the free drop relaxing back to equilibrium shape will be modeled, and its characteristic time dependence should provide a quantitative means to evaluate the liquid viscosity.

Trinh, E. H.↗
NASA NTRS1991

The in-flight calibration of the Hubble Space Telescope attitude sensors

A detailed review of the in-flight calibration of the Hubble Space Telescope attitude sensors is presented. The review, which covers the period from the April 24, 1990, launch of the spacecraft until the time of this writing (June 1991), describes the calibrations required and accuracies achieved for the four principal attitude sensing systems on the spacecraft: the magnetometers, the fixed head star trackers, the gyroscopes, and the fine guidance sensors (FGS's). In contrast to the other three sensor groups, the Hubble Telecope's FGS's are unique in the precision and performance levels being attempted; spacecraft control and astrometric research at the near-milliarcsecond level are the ultimate goals. FGS calibration accuracies at the 20-milliarcsecond level have already been achieved, and plans for new data acquisitions and reductions that should substantially improve these results are in progress. A summary of the basic attributes of each of the four sensor groups with respect to its usage as an attitude measuring system is presented, followed by a discussion of the calibration items of interest for that group. The calibration items are as follows: for the magnetometers, the corrections for the spacecraft's static and time-varying magnetic fields; for the fixed-head star trackers, their relative alignments and use in performing onboard attitude updates; for the gyroscopes, their scale factors, alignments, and drift rate biases; and for the FGS's, their magnifications, optical distortions, and alignments. The discussion covers the procedures used for each calibration, as well as the order of the calibrations within the general flow of orbital verification activities. It also includes a synopsis of current plans for the eventual calibration of the FGS's to achieve their near-milliarcsecond design accuracy. The conclusions include a table indicating the current and predicted ultimate accuracies for each of the calibration items.

Welter, Gary L.↗
NASA NTRS1979

The MPD thruster development program

Recent research results have inferred that the self-field magnetoplasmadynamic (MPD) thruster can attain efficiency and specific impulse levels which are competitive with ion thrusters. Based on these results, a program was initiated at JPL to develop this thruster for application on future spacecraft. Preliminary mission analyses have shown that the high thrust density MPD arcjet is advantageous for high power missions, such as a short trip time earth orbit transfer vehicle or a nuclear powered outer planet explorer. Direct thrust stand verification of the inferred performance levels used in these analyses is planned for a facility being assembled at Princeton University. A parallel effort at JPL is considering various thruster system configurations, energy storage concepts and propellant control techniques. In addition, a one pulse per second thruster test facility is planned at JPL to be used for thruster optimization studies including erosion and lifetime measurements.

Rudolph, L. K.↗
NASA NTRS2002

Hubble Space Telescope On-orbit NiH2 Battery Performance

This paper summarizes the Hubble Space Telescope (HST) nickel-hydrogen (NiH2) battery performance from launch to the present time. Over the life of HST vehicle configuration, charge system degradation and failures together with thermal design limitations have had a significant effect on the capacity of the HST batteries. Changes made to the charge system configuration in order to protect against power system failures and to maintain battery thermal stability resulted in undercharging of the batteries. This undercharging resulted in decreased usable battery capacity as well as battery cell voltage/capacity divergence. This cell divergence was made evident during on-orbit battery capacity measurements by a relatively shallow slope of the discharge curve following the discharge knee. Early efforts to improve the battery performance have been successful. On-orbit capacity measurement data indicates increases in the usable battery capacity of all six batteries as well as improvements in the battery cell voltage/capacity divergence. Additional measures have been implemented to improve battery performance, however, failures within the HST Power Control Unit (PCU) have prevented verification of battery status. As this PCU fault prevents the execution of on-orbit capacity testing, the HST Project has based the battery capacity on trends, which utilizes previous on-orbit battery capacity test data, for science mission and servicing mission planning. The Servicing Mission 38 (SM-3B) in March 2002 replaced the faulty PCU. Following the servicing mission, on-orbit capacity test resumed. A summary of battery performance is reviewed since launch in this paper.

Rao, Gopalakrishna M.↗
DOE OSTI2021

First ITER CS module test results

The ITER Central Solenoid (CS) is under fabrication by the US ITER organization and its subcontractors. US ITER will supply seven modules to ITER IO, six of which will be assembled in a stack that forms the ITER Central Solenoid, with one as a spare. The first module fabrication has been completed by General Atomics (GA) at their facility and has begun testing including high voltage testing, Paschen testing in the vacuum and then testing at 4.5 K and up to 40 kA in order to demonstrate compliance of the coil to ITER requirements. In the paper we present the Test Plan and results of the CS Module performance tests, especially at 40 kA current. Herein, AC losses, joint resistances and hydraulic characteristics of the coil are all measured. Displacements of the coil height and hoop strain of the CS Module are also measured to verify structural and mechanical characteristics of the coil along with cooldown shrinkage of the coil. This information is used for verification of the stack behavior of CS in ITER operation. The test results and preliminary analyses results are presented, compared to expectations, and discussed. All measured parameters suggest that the CS module will perform well in ITER machine.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRSDate not supplied

Material Property Estimation in Thin Battery Components Using Guided Wave Measurement, Experimental Dispersion Curve Extraction and Finite Element Modeling

At NASA, we are investigating nondestructive evaluation (NDE) and structural health monitoring (SHM) techniques to detect precursors of thermal runaway failure in lithium metal based lithium ion batteries (LIB). The approach is centered on computational simulation models to guide inspection and aid in interpretation of results. Since lithium metal LIBs have combinations of solid and fluid-filled porous materials, obtaining accurate material properties is both challenging and critical for successful simulation of battery inspection. To this end, we investigated a multi-verification approach for material characterization of thin battery components. First, a laser Doppler vibrometer (LDV) was used to measure guided wave fields in thin (microns-thick) battery components subject to broadband excitation. The time-space wavefield data was converted to frequency-wave number data to extract guided wave dispersion curves. A data visualization and post processing graphics user interface (GUI) was developed at NASA to aid the data exploration and analysis. Due to the thinness of the samples, low frequency-thickness-product plate wave approximations allowed for the calculation of closed-form solutions for material elastic property estimation. These approximations were then verified by calculating the Lamb wave solutions using the previously obtained material properties. Finally, the estimated elastic material properties were implemented in a COMSOL simulation model, and dispersion curves were extracted from simulation results. The dispersion curves and derived material properties were then compared to the analysis results from the experimental data. These comparisons informed on the accuracy of the measured material properties and helped demonstrate the accuracy of the finite element analysis (FEA) computational models. This assessment will prove vital when we start simulating more complex multi-layer components and poroelastic media. This paper gives a brief background of the problem space, outlines the workflow for data analysis and verification, shows results from the workflow, and gives an overview of future plans for simulation of lithium metal LIB inspection.

Peter Juarez↗
NASA NTRS2009

Thermal Test Verification of Emission Control through Directional Baffles for the James Webb Space Telescope

The thermal performance of NASA s planned James Webb Space Telescope is highly reliant on a collection of directional baffles that are part of the Integrated Science Instrument Module Electronics Compartment. In order to verify the performance of the baffle concept, two test assemblies were recently fabricated and tested at the Goddard Space Flight Center. The centerpiece of the testing was a fixture that used bolometers to measure the emission field through the baffles while the radiator panels and baffles ran a flight-like temperature. Although not all test goals were able to be met due to facility malfunctions, the test was able to prove the design viability enough to gain approval to begin manufacturing the flight article.

Garrison, Matthew↗
DOE OSTI2023

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗