Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “statistically designed experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

QP Statistics Spotlight: Practical versus Statistical Priorities

Randomization during data collection in a designed experiment is an effective strategy for reducing system bias and ensuring independent observations1, but at what cost should it be fully implemented? We recently encountered a scenario that highlights an important aspect of collaboration2 between statisticians, scientists and engineers – the idea of compromise for the sake of achieving wins for all team members. In a multi-million-dollar experiment with a fixed amount of time on the test equipment, each experimental run involved resetting the input values and then waiting for the continuous process to reach a new equilibrium. For example, the temperature of the furnace could be reset, but it takes some time for the test chamber to reach the new temperature and rest at that temperature for a while until all components in the chamber settle at that new setting. Similarly, a critical gas flow component also required a settling period before data could be collected that would be representative of that input setting value. In all, the experiment involved 5 factors, where 4 of the 5 were time-consuming and costly to adjust, with the duration of time needed to reach new equilibrium being dependent on how far the previous setting was from the new one for the combination of these 4 factors. For example, changing from 150° to 200° would reach equilibrium faster than changing from 100° to 200°.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Nanofiber-Based Total Internal Reflection Microscopy for Characterizing Colloidal Systems at the Microscale

Bulk colloidal interactions are dictated by the physical properties of individual particles dispersed in solution. However, for many applications it remains challenging to predict system-level colloidal behavior. Comprehensive characterization typically requires disparate techniques that can observe correlations between microscale particle–surface interactions and physical properties of the particles. In this work, we present a unique tin dioxide (SnO2) nanofiber-based total internal reflection microscopy (TIRM) method to efficiently characterize colloidal behavior as a function of particle-level properties in complex fluidic conditions. We develop and model the device physics to understand the physical underpinnings of the raw device data and then use these models to design proof-of-concept experiments to verify device function. Statistical trends in the data collected from a nominal system of 80 nm gold nanoparticles correspond to theoretical predictions as we vary key design parameters such as particle size, surface charge, and solution ionic strength. Lastly, we consider the practical limitations of the technique gleaned from our studies and offer suggestions for utilizing the platform to quantitatively analyze nonideal colloidal systems with distributed or heterogeneous system parameters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Membrane Thickness Impact on Chemical Degradation Rates

Abstract A comprehensive investigation of PFSA membrane chemical degradation rates as a function of thickness (8-20 µm) is reported. The two-pronged study was conducted on bare membranes and as components of chemically-mitigated and mechanically-reinforced, state-of-the-art (SOA) membrane electrode assemblies (MEAs). The bare membranes were subjected to H2O2 vapor test and MEAs were degraded under OCV conditions, both at 90°C. Both test types employed fluoride release rates (FRR) to monitor chemical degradation rates. Vapor tests revealed that area-specific degradation rates were positively correlated with membrane thickness, but thickness normalized degradation rates were independent of thickness. Open-circuit voltage (OCV) investigations spanning the membrane thickness series of MEAs was probed via a 27-experiment 3(4-1) fractional factorial experimental design. Statistical analysis of the FRR values revealed that chemical degradation rates were dominated by the relative humidity value and that the area-specific degradation rates of MEAs were independent of membrane thickness. The OCV chemical durability insensitivity to membrane thickness is supported by on-load membrane chemical durability studies at the stack level. The results suggest that ,despite smaller ionomer inventory, SOA thin membranes and MEAs are not greatly disadvantaged relative to thicker membranes from a chemical durability perspective, provided oxidative stress levels are controlled throughout application lifetime.

Coms, Frank D. (ORCID:0000000249160350)↗
NASA NTRS2002

The Role of Formal Experiment Design in Hypersonic Flight System Technology Development

Hypersonic airbreathing engine (scramjet) powered vehicles are being considered to replace conventional rocket-powered launch systems. Effective utilization of scramjet engines requires careful integration with the air vehicle. This integration synergistically combines aerodynamic forces with propulsive cycle functions of the engine. Due to the highly integrated nature of the hypersonic vehicle design problem, the large flight envelope, and the large number of design variables, the use of a statistical design approach in design is effective. Modern Design-of-Experiments (MDOE) has been used throughout the Hyper-X program, for both systems analysis and experimental testing. Application of MDOE fall into four categories: (1) experimental testing; (2) studies of unit phenomena; (3) refining engine design; and (4) full vehicle system optimization. The MDOE process also provides analytical models, which are also used to document lessons learned, supplement low-level design tools, and accelerate future studies. This paper will discuss the design considerations for scramjet-powered vehicles, specifics of MDOE utilized for Hyper-X, and present highlights from the use of these MDOE methods within the Hyper-X Program.

McClinton, Charles R.↗
DOE OSTI2024

Inverse design of a pyrochlore lattice of DNA origami through model-driven experiments

Sophisticated statistical mechanics approaches and human intuition have demonstrated the possibility of self-assembling complex lattices or finite-size constructs. However, attempts so far have mostly only been successful in silico and often fail in experiment because of unpredicted traps associated with kinetic slowing down (gelation, glass transition) and competing ordered structures. Theoretical predictions also face the difficulty of encoding the desired interparticle interaction potential with the experimentally available nano- and micrometer-sized particles. To overcome these issues, we combine SAT assembly (a patchy-particle interaction design algorithm based on constrained optimization) with coarse-grained simulations of DNA nanotechnology to experimentally realize trap-free self-assembly pathways. In this paper, we use this approach to assemble a pyrochlore three-dimensional lattice, coveted for its promise in the construction of optical metamaterials, and characterize it with small-angle x-ray scattering and scanning electron microscopy visualization.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2019

Tripled yield in direct-drive laser fusion through statistical modelling [Tripling the yield in direct-drive laser fusion via predictive statistical modeling]

Focusing laser light onto a very small target can produce the conditions for laboratory-scale nuclear fusion of hydrogen isotopes. The lack of accurate predictive models, which are essential for the design of high-performance laser-fusion experiments, is a major obstacle to achieving thermonuclear ignition. Here we report a statistical approach that was used to design and quantitatively predict the results of implosions of solid deuterium–tritium targets carried out with the 30-kilojoule OMEGA laser system, leading to tripling of the fusion yield to its highest value so far for direct-drive laser fusion. When scaled to the laser energies of the National Ignition Facility (1.9 megajoules), these targets are predicted to produce a fusion energy output of about 500 kilojoules—several times larger than the fusion yields currently achieved at that facility. As a result, this approach could guide the exploration of the vast parameter space of thermonuclear ignition conditions and enhance our understanding of laser-fusion physics.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2014

Design of Experiments, Model Calibration and Data Assimilation

This presentation provides an overview of emulation, calibration and experiment design for computer experiments. Emulation refers to building a statistical surrogate from a carefully selected and limited set of model runs to predict unsampled outputs. The standard kriging approach to emulation of complex computer models is presented. Calibration refers to the process of probabilistically constraining uncertain physics/engineering model inputs to be consistent with observed experimental data. An initial probability distribution for these parameters is updated using the experimental information. Markov chain Monte Carlo (MCMC) algorithms are often used to sample the calibrated parameter distribution. Several MCMC algorithms commonly employed in practice are presented, along with a popular diagnostic for evaluating chain behavior. Space-filling approaches to experiment design for selecting model runs to build effective emulators are discussed, including Latin Hypercube Design and extensions based on orthogonal array skeleton designs and imposed symmetry requirements. Optimization criteria that further enforce space-filling, possibly in projections of the input space, are mentioned. Designs to screen for important input variations are summarized and used for variable selection in a nuclear fuels performance application. This is followed by illustration of sequential experiment design strategies for optimization, global prediction, and rare event inference.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2017

Trajectory Dispersed Vehicle Process for Space Launch System

The Space Launch System (SLS) vehicle is part of NASA's deep space exploration plans that includes manned missions to Mars. Manufacturing uncertainties in design parameters are key considerations throughout SLS development as they have significant effects on focus parameters such as lift-off-thrust-to-weight, vehicle payload, maximum dynamic pressure, and compression loads. This presentation discusses how the SLS program captures these uncertainties by utilizing a 3 degree of freedom (DOF) process called Trajectory Dispersed (TD) analysis. This analysis biases nominal trajectories to identify extremes in the design parameters for various potential SLS configurations and missions. This process utilizes a Design of Experiments (DOE) and response surface methodologies (RSM) to statistically sample uncertainties, and develop resulting vehicles using a Maximum Likelihood Estimate (MLE) process for targeting uncertainties bias. These vehicles represent various missions and configurations which are used as key inputs into a variety of analyses in the SLS design process, including 6 DOF dispersions, separation clearances, and engine out failure studies.

Statham, Tamara↗
DOE OSTI2023

AI ATAC 1: An Evaluation of Prominent Commercial Malware Detectors

This work presents an evaluation of six prominent commercial endpoint malware detectors, a network malware detector, and a file-conviction algorithm from a cyber technology vendor. The evaluation was administered as the first of the Artificial I ntelligence Applications t o Autonomous Cybersecurity (AI ATAC) prize challenges, funded by / completed in service of the US Navy. The experiment employed 100K files (50/50% benign/malicious) with a stratified distribution of file types, including ~1K zero-day program executables (increasing experiment size two orders of magnitude over previous work). We present an evaluation process of delivering a file to a fresh virtual machine donning the detection technology, waiting 90s to allow static detection, then executing the file and waiting another period for dynamic detection; this allows greater fidelity in the observational data than previous experiments, in particular, resource and time-to-detection statistics. To execute all 800K trials (100K files × 8 tools), a software framework is designed to choreograph the experiment into an automated, time-synced, and reproducible workflow with substantial parallelization. Software with base classes for this framework are provided. A cost-benefit model was configured to integrate the tools’ detection statistics into a comparable quantity by simulating costs of use. This provides a ranking methodology for cyber competitions and a lens for reasoning about the varied statistical results. The results provide insights on state of commercial malware detection.

Bridges, Robert↗
NASA NTRS1996

Experiences From NASA/Langley's DMSS Project

There is a trend in institutions with high performance computing and data management requirements to explore mass storage systems with peripherals directly attached to a high speed network. The Distributed Mass Storage System (DMSS) Project at the NASA Langley Research Center (LaRC) has placed such a system into production use. This paper will present the experiences, both good and bad, we have had with this system since putting it into production usage. The system is comprised of: 1) National Storage Laboratory (NSL)/UniTree 2.1, 2) IBM 9570 HIPPI attached disk arrays (both RAID 3 and RAID 5), 3) IBM RS6000 server, 4) HIPPI/IPI3 third party transfers between the disk array systems and the supercomputer clients, a CRAY Y-MP and a CRAY 2, 5) a "warm spare" file server, 6) transition software to convert from CRAY's Data Migration Facility (DMF) based system to DMSS, 7) an NSC PS32 HIPPI switch, and 8) a STK 4490 robotic library accessed from the IBM RS6000 block mux interface. This paper will cover: the performance of the DMSS in the following areas: file transfer rates, migration and recall, and file manipulation (listing, deleting, etc.); the appropriateness of a workstation class of file server for NSL/UniTree with LaRC's present storage requirements in mind the role of the third party transfers between the supercomputers and the DMSS disk array systems in DMSS; a detailed comparison (both in performance and functionality) between the DMF and DMSS systems LaRC's enhancements to the NSL/UniTree system administration environment the mechanism for DMSS to provide file server redundancy the statistics on the availability of DMSS the design and experiences with the locally developed transparent transition software which allowed us to make over 1.5 million DMF files available to NSL/UniTree with minimal system outage

Source record↗
DOE OSTI2015

Instrument for precision long-term β-decay rate measurements

We describe an experimental setup for making precision measurements of relative β-decay rates of {sup 22}Na, {sup 36}Cl, {sup 54}Mn, {sup 60}Co, {sup 90}Sr, {sup 133}Ba, {sup 137}Cs, {sup 152}Eu, and {sup 154}Eu. The radioactive samples are mounted in two automated sample changers that sequentially position the samples with high spatial precision in front of sets of detectors. The set of detectors for one sample changer consists of four Geiger-Müller (GM) tubes and the other set of detectors consists of two NaI scintillators. The statistical uncertainty in the count rate is few times 0.01% per day for the GM detectors and about 0.01% per hour on the NaI detectors. The sample changers, detectors, and associated electronics are housed in a sealed chamber held at constant absolute pressure, humidity, and temperature to isolate the experiment from environmental variations. The apparatus is designed to accumulate statistics over many years in a regulated environment to test recent claims of small annual variations in the decay rates. We demonstrate that absent this environmental regulation, uncontrolled natural atmospheric pressure variations at our location would imprint an annual signal of 0.1% on the Geiger-Müller count rate. However, neither natural pressure variations nor plausible indoor room temperature variations cause a discernible influence on our NaI scintillator detector count rate.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2016

Improved Test Planning and Analysis Through the Use of Advanced Statistical Methods

The goal of this work is, through computational simulations, to provide statistically-based evidence to convince the testing community that a distributed testing approach is superior to a clustered testing approach for most situations. For clustered testing, numerous, repeated test points are acquired at a limited number of test conditions. For distributed testing, only one or a few test points are requested at many different conditions. The statistical techniques of Analysis of Variance (ANOVA), Design of Experiments (DOE) and Response Surface Methods (RSM) are applied to enable distributed test planning, data analysis and test augmentation. The D-Optimal class of DOE is used to plan an optimally efficient single- and multi-factor test. The resulting simulated test data are analyzed via ANOVA and a parametric model is constructed using RSM. Finally, ANOVA can be used to plan a second round of testing to augment the existing data set with new data points. The use of these techniques is demonstrated through several illustrative examples. To date, many thousands of comparisons have been performed and the results strongly support the conclusion that the distributed testing approach outperforms the clustered testing approach.

Green, Lawrence L.↗
NASA NTRS1976

Statistical support for the ATL program

Statistical experimental designs are presented for various numbers of organisms and agar solutions pertinent to the experiment, ""colony growth in zero gravity''. Missions lasting 7 and 30 days are considered. For the designs listed, the statistical analysis of the observations obtained on the space shuttle are outlined.

Hinkelmann, K.↗
DOE OSTI2024

Expert‐in‐the‐loop design of integral nuclear data experiments

Abstract Nuclear data are fundamental inputs to radiation transport codes used for reactor design and criticality safety. The design of experiments to reduce nuclear data uncertainty has been a challenge for many years, but advances in the sensitivity calculations of radiation transport codes within the last two decades have made optimal experimental design possible. The design of integral nuclear experiments poses numerous challenges not emphasized in classical optimal design, in particular, constrained design spaces (in both a statistical and engineering sense), severely under‐determined systems, and optimality uncertainty. We present a design pipeline to optimize critical experiments that uses constrained Bayesian optimization within an iterative expert‐in‐the‐loop framework. We show a successfully completed experiment campaign designed with this framework that involved two critical configurations and multiple measurements that targeted compensating errors in 239 Pu nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1975

Requirements for space shuttle scatter radar experiments

The feasibility of carrying out scatter radar experiments on the space shuttle was analyzed. Design criteria considered were the required average transmitter power, frequency resolution, spatial resolution, and statistical accuracy. Experiments analyzed were measurement of the naturally enhanced plasma line and the ion component of the incoherent scatter spectrum, and the plasma line artificially enhanced by an intense HF radio wave. The ion component measurement does not appear feasible, while the other two appear reasonable for short ranges only.

Harker, K. J.↗
NASA NTRS1976

Requirements for Space Shuttle incoherent scatter experiments

The feasibility of carrying out incoherent-scatter experiments on the Space Shuttle has been analyzed. Design criteria considered were the required average transmitter power, frequency resolution, spatial resolution, and statistical accuracy. Experiments analyzed were measurement of the naturally enhanced plasma line and the ion component of the incoherent-scatter spectrum, as well as the plasma line artificially enhanced by an intense HF radiowave. The ion-component measurement does not appear feasible, while the other two appear reasonable for short ranges only.

Harker, K. J.↗
DOE OSTI2025

Learning plasma dynamics and robust rampdown trajectories with predict-first experiments at TCV

The rampdown phase of a tokamak pulse is difficult to simulate and often exacerbates multiple plasma instabilities. To reduce the risk of disrupting operations, we leverage advances in Scientific Machine Learning (SciML) to combine physics with data-driven models, developing a neural state-space model (NSSM) that predicts plasma dynamics during Tokamak à Configuration Variable (TCV) rampdowns. The NSSM efficiently learns dynamics from a modest dataset of 311 pulses with only five pulses in a reactor-relevant high-performance regime. The NSSM is parallelized across uncertainties, and reinforcement learning (RL) is applied to design trajectories that avoid instability limits. High-performance experiments at TCV show statistically significant improvements in relevant metrics. A predict-first experiment, increasing plasma current by 20% from baseline, demonstrates the NSSM’s ability to make small extrapolations. The developed approach paves the way for designing tokamak controls with robustness to considerable uncertainty and demonstrates the relevance of SciML for fusion experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS2003

Single-Vector Calibration of Wind-Tunnel Force Balances

An improved method of calibrating a wind-tunnel force balance involves the use of a unique load application system integrated with formal experimental design methodology. The Single-Vector Force Balance Calibration System (SVS) overcomes the productivity and accuracy limitations of prior calibration methods. A force balance is a complex structural spring element instrumented with strain gauges for measuring three orthogonal components of aerodynamic force (normal, axial, and side force) and three orthogonal components of aerodynamic torque (rolling, pitching, and yawing moments). Force balances remain as the state-of-the-art instrument that provide these measurements on a scale model of an aircraft during wind tunnel testing. Ideally, each electrical channel of the balance would respond only to its respective component of load, and it would have no response to other components of load. This is not entirely possible even though balance designs are optimized to minimize these undesirable interaction effects. Ultimately, a calibration experiment is performed to obtain the necessary data to generate a mathematical model and determine the force measurement accuracy. In order to set the independent variables of applied load for the calibration 24 NASA Tech Briefs, October 2003 experiment, a high-precision mechanical system is required. Manual deadweight systems have been in use at Langley Research Center (LaRC) since the 1940s. These simple methodologies produce high confidence results, but the process is mechanically complex and labor-intensive, requiring three to four weeks to complete. Over the past decade, automated balance calibration systems have been developed. In general, these systems were designed to automate the tedious manual calibration process resulting in an even more complex system which deteriorates load application quality. The current calibration approach relies on a one-factor-at-a-time (OFAT) methodology, where each independent variable is incremented individually throughout its full-scale range, while all other variables are held at a constant magnitude. This OFAT approach has been widely accepted because of its inherent simplicity and intuitive appeal to the balance engineer. LaRC has been conducting research in a "modern design of experiments" (MDOE) approach to force balance calibration. Formal experimental design techniques provide an integrated view to the entire calibration process covering all three major aspects of an experiment; the design of the experiment, the execution of the experiment, and the statistical analyses of the data. In order to overcome the weaknesses in the available mechanical systems and to apply formal experimental techniques, a new mechanical system was required. The SVS enables the complete calibration of a six-component force balance with a series of single force vectors.

Parker, P. A.↗