Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Design of experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Use of Design of Experiments and Rule-Based Inference in Determining Neural Network Architectures for Loss of Control Detection

In this work, we describe methods for selecting the neural network architectures and input spaces to implement belief state inference on generic commercial transport aircraft. First, we highlight a case study on the planning, execution, and analysis of a set of experiments to determine the configurations of a conditional variational autoencoder (CVAE). We present a structured method that can be used in a number of aerospace applications, to optimize the structure and training parameters of the CVAE for belief state inference, using Design of Experiments (DOE) statistical methodologies. The motivation for this specific DOE was to identify the appropriate hyperparameters for measuring the CVAE reconstruction probability and latent space, such that the measurements can be used to infer qualitative state changes for the aircraft. We demonstrate that this process yields information about a trained neural network’s utility for this specific application, along with a quantifiable range of certainty. We execute 84 experiments using loss-of-control flight maneuver data from a NASA T-2 aircraft, demonstrating that this empirical process allows us to construct cheap and simple models with specific attributes amenable to belief state inference in aerospace applications. While theoretically, we could create a single CVAE with an input space the size of all measurable flight variables and environmental dynamics, it becomes intractable to use such a neural network in an in-situ intelligent multi-agent system. Using the recommendations from our case study, we introduce a technical approach for feasibly describing the belief space by (1) identifying significant statistical relationships among flight variables using rule induction, (2) using a set of rules that cover all features to define the input space of multiple CVAEs, and (3) forming a belief space based on the joint probability density of their collective latent spaces. This results in a series of relatively small matrix multiplications that can be performed in real time, as opposed to large matrix computations in a single CVAE. We demonstrate the application of this approach on the T-2 flight loss-of control experiments, using the architecture and hyperparameter recommendations from the case study. We compare the utilities of an individual CVAE trained on all flight variables and multiple CVAEs defined on subsets of flight variables for detecting qualitative changes in flight. We demonstrate that the use of multiple CVAEs with smaller input spaces permits the CVAE to capture more granular relationships in the latent space, permitting better state space characterization and loss-of-control detection.

Design of experiments↗

Progress in hypersonic combustion technology with computation and experiment

Design of successful airbreathing engines for operation at near-orbital speeds presents significant challenges in all the disciplines involved, including propulsion. This paper presents a discussion of the important physics of hypersonic combustion and an assessment of the state of the art of ground simulations with pulse facilities and with computational techniques. Recent examples of experimental and computational simulations are presented and discussed. The need for continued application of these tools to establish the credibility and fidelity of engineering design methods for practical hypersonic combustors is emphasized along with the critical need for improved diagnostic methods for hypervelocity reacting flows.

Anderson, Griffin Y.↗

Application of Design of Experiments and Surrogate Modeling within the NASA Advanced Concepts Office, Earth-to-Orbit Design Process

Decisions made during early conceptual design can have a profound impact on life-cycle cost (LCC). Widely accepted that nearly 80% of LCC is committed. Decisions made during early design must be well informed. Advanced Concepts Office (ACO) at Marshall Space Flight Center aids in decision making for launch vehicles. Provides rapid turnaround pre-phase A and phase A studies. Provides customer with preliminary vehicle sizing information, vehicle feasibility, and expected performance.

Zwack, Matthew R.↗

Use of Design of Experiments in Determining Neural Network Architectures for Loss of Control Detection

Abstract—We describe empirical methods for selecting a neural network architecture to implement belief state inference on generic commercial transport aircraft. We highlight a case study on the planning, execution, and analysis of a set of experiments to determine the configurations of a conditional variational autoencoder (CVAE). Our main contribution is the application of a structured method that can be used for machine learning in many aerospace applications. This method optimizes the structure and training parameters of a neural network for belief state inference, using Design of Experiments (DOE) statistical methodologies. The motivation for this specific DOE analysis was to identify the appropriate hyperparameters for measuring the CVAE reconstruction probability and latent space, such that the measurements can be used to infer qualitative state changes for the aircraft. We demonstrate that this process yields information about a trained neural network’s utility for this specific application, along with a quantifiable range of certainty. We execute 84 experiments using loss-of-control flight maneuver data from the NASA T-2 aircraft, demonstrating that this empirical process allows us to construct cheap and simple models with specific attributes amenable to belief state inference in aerospace applications.

neural networks↗

Use of Design of Experiments in Determining Neural Network Architectures for Loss of Control Detection

We describe empirical methods for selecting a neural network architecture to implement belief state inference on generic commercial transport aircraft. We highlight a case study on the planning, execution, and analysis of a set of experiments to determine the configurations of a conditional variational autoencoder (CVAE). Our main contribution is the application of a structured method that can be used for machine learning in many aerospace applications. This method optimizes the structure and training parameters of a neural network for belief state inference, using Design of Experiments (DOE) statistical methodologies. The motivation for this specific DOE analysis was to identify the appropriate hyperparameters for measuring the CVAE reconstruction probability and latent space, such that the measurements can be used to infer qualitative state changes for the aircraft. We demonstrate that this process yields information about a trained neural network’s utility for this specific application, along with a quantifiable range of certainty. We execute 84 experiments using loss-of-control flight maneuver data from the NASA T 2 aircraft, demonstrating that this empirical process allows us to construct cheap and simple models with specific attributes amenable to belief state inference in aerospace applications.

Loss of Control↗

Use of Design of Experiments in Determining Neural Network Architectures for Loss of Control Detection

We describe empirical methods for selecting a neural network architecture to implement belief state inference on generic commercial transport aircraft. We highlight a case study on the planning, execution, and analysis of a set of experiments to determine the configurations of a conditional variational autoencoder (CVAE). Our main contribution is the application of a structured method that can be used for machine learning in many aerospace applications. This method optimizes the structure and training parameters of a neural network for belief state inference, using Design of Experiments (DOE) statistical methodologies. The motivation for this specific DOE analysis was to identify the appropriate hyperparameters for measuring the CVAE reconstruction probability and latent space, such that the measurements can be used to infer qualitative state changes for the aircraft. We demonstrate that this process yields information about a trained neural network’s utility for this specific application, along with a quantifiable range of certainty. We execute 84 experiments using loss-of-control flight maneuver data from the NASA T-2 aircraft, demonstrating that this empirical process allows us to construct cheap and simple models with specific attributes amenable to belief state inference in aerospace applications.

Loss of Control↗

Use of Taguchi Design of Experiments to Determine ALPLS Ascent Delta-5 Sensitivities and Total Mass Sensitivities to Release Conditions and Vehicle Parameters

The objective of this study is to evaluate the use of Taguchi's Design of Experiment Methods to improve the effectiveness of this and future parametric studies. Taguchi Methods will be applied in addition to the typical approach to provide a mechanism for comparing the results and the cost or effort necessary to complete the studies. It is anticipated that results of this study should include an improved systematic analysis process, an increase in information obtained at a lower cost, and a more robust, cost effective vehicle design.

Carrasco, Hector Ramon↗

Earth Radiation Budget Experiment instrument design status

The design configuration of Earth Radiation Budget Experiment (ERBE) instruments are presented. The ERBE scanners and nonscanners are discussed in terms of hardware and optical development, operational parameters, and calibration plans for ground and flight systems. The various instrument designs are given and described in detail. It is emphasized that the design goal is to approach state-of-the-art laboratory radiometric accuracies with spaceflight qualified hardware in an earth orbit environment with a projected operational lifetime of over two years. Accurate inputs to models of weather and climate are expected which will allow a better understanding of radiation transfer and the energy balance of the earth.

Kopia, L. P.↗

Verification and Validation of Requirements on the CEV Parachute Assembly System Using Design of Experiments

The Crew Exploration Vehicle Parachute Assembly System (CPAS) project conducts computer simulations to verify that flight performance requirements on parachute loads and terminal rate of descent are met. Design of Experiments (DoE) provides a systematic method for variation of simulation input parameters. When implemented and interpreted correctly, a DoE study of parachute simulation tools indicates values and combinations of parameters that may cause requirement limits to be violated. This paper describes one implementation of DoE that is currently being developed by CPAS, explains how DoE results can be interpreted, and presents the results of several preliminary studies. The potential uses of DoE to validate parachute simulation models and verify requirements are also explored.

Schulte, Peter Z.↗

DAMSA Experiment Conceptual Design White Paper

DAMSA (DArk Messenger Searches at an Accelerator) is a novel short-baseline accelerator experiment aimed at probing short-lived physics processes, including searches for evidence of a dark sector of particle physics and well-motivated Standard Model signals. Motivated by open questions in neutrino physics and the absence of conclusive evidence for conventional weakly interacting massive particles, DAMSA targets MeV-to-sub-GeV dark-sector messengers with feeble couplings that can be produced in abundance at the PIP-II LINAC. By employing an ultra-short baseline of order one meter, DAMSA is uniquely positioned to overcome the beam-dump "ceiling" that limits sensitivity to promptly decaying particles in longer-baseline experiments. The conceptual design emphasizes a beam-dump production scheme combined with a compact detector optimized for rare decays while mitigating intense neutron-induced backgrounds inherent to high-power proton beams. To validate the experimental strategy and detector technologies, the Little DAMSA Path-Finder (LDPF) proof-of-concept experiment is proposed, focusing on axion-like particles decaying to two photons and operating with 300 MeV electron beams at FAST. Successful realization of LDPF will establish the feasibility of the DAMSA approach, enabling a broad and powerful program to explore short-lived new physics and precision Standard Model processes in a previously inaccessible regime. This conceptual design document outlines the technical details of DAMSA's physics goals, the beam facility proposals, key experimental challenges and how to overcome them, and the proposed experimental staging campaigns.

Bhattarai, Prithak [Texas U., Arlington]↗

Creation of a High-Yield AAV Vector Production Platform in Suspension Cells Using a Design-of-Experiment Approach

Recombinant adeno-associated virus (rAAV) vectors are a leading gene delivery platform, but vector manufacturing remains a challenge. New methods are needed to increase rAAV yields and reduce costs. Past efforts to improve rAAV production have focused on optimizing a single variable at a time, but this approach does not account for the interactions of multiple factors that contribute to vector generation. Here, we utilized a design-of-experiment (DOE) methodology to optimize rAAV production in a HEK293T suspension cell system. We simultaneously varied the transgene, packaging, and helper plasmid ratios, the total DNA concentration, and the cell density to systematically evaluate the impact of each variable across 52 conditions. The results revealed a unique set of parameters with a lower concentration of transgene plasmid, a higher concentration of packaging plasmid, and a higher cell density than previously described protocols. Using this DOE-optimized protocol, we achieved unpurified yields approaching 3 × 10 14 viral genomes (VGs)/L of cell culture. Additionally, we incorporated polyethylene glycol (PEG)-based virus precipitation, pH-mediated protein removal, and affinity chromatography to our downstream processing, enabling average purified yields of >1 × 10 14 VGs/L for rAAV-EGFPs across 13 serotypes and capsid variants.

59 BASIC BIOLOGICAL SCIENCES↗

Statistical Multiobjective Optimization of Thiospinel CoNi 2 S 4 Nanocrystal Synthesis via Design of Experiments

Thiospinels, such as CoNi 2 S 4 , are showing promise for numerous applications, including as catalysts for the hydrogen evolution reaction, hydrodesulfurization, and oxygen evolution and reduction reactions; however, CoNi 2 S 4 has not been synthesized as small, colloidal nanocrystals with high surface-area-to-volume ratios. Traditional optimization methods to control nanocrystal attributes such as size typically rely upon one variable at a time (OVAT) methods that are not only time and labor intensive but also lack the ability to identify higher-order interactions between experimental variables that affect target outcomes. Herein, we demonstrate that a statistical design of experiments (DoE) approach can optimize the synthesis of CoNi 2 S 4 nanocrystals, allowing for control over the responses of nanocrystal size, size distribution, and isolated yield. After implementing a 2 5–2 fractional factorial design, the statistical screening of five different experimental variables identified temperature, Co:Ni precursor ratio, Co:thiol ratio, and their higher-order interactions as the most critical factors in influencing the aforementioned responses. Second-order design with a Doehlert matrix yielded polynomial functions used to predict the reaction parameters needed to individually optimize all three responses. A multiobjective optimization, allowing for the simultaneous optimization of size, size distribution, and isolated yield, predicted the synthetic conditions needed to achieve a minimum nanocrystal size of 6.1 nm, a minimum polydispersity (σ/$\bar{d}$) of 10%, and a maximum isolated yield of 99%, with a desirability of 96%. The resulting model was experimentally verified by performing reactions under the specified conditions. Furthermore, our work illustrates the advantage of multivariate experimental design as a powerful tool for accelerating control and optimization in nanocrystal syntheses.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

CheKiPEUQ Intro 2: Harnessing Uncertainties from Data Sets, Bayesian Design of Experiments in Chemical Kinetics**

When choosing experimental conditions, Bayesian statistical tools can predict the experimental choices which will yield the highest information gain. Experimental choices could be temperature, pressure, reaction time, number of measurements, reactor volume, etc.. Three example analyses are presented here, each using the software Chemical Kinetics Parameter Estimation and Uncertainty Quantification (CheKiPEUQ). Information gain is a measure of reduction of uncertainty in a model's parameters. The three chemical system examples presented each illustrate Bayesian Design of Experiments using information gain. In the first chemical example, temperature selection impacts the information gain for the free energy of reaction in a two-component equilibrium reaction. In the second example, temperature and pressure are explored for a competitive adsorption Langmuir replacement reaction system. Finally, the third example is a catalytic membrane reactor which is a culmination of the previous examples. The catalytic membrane reactor has a complex and nonlinear response in the observables which is solved by numerical evaluation. In the three examples, the experimental conditions are treated as design variables for maximizing information gain.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Throughput Optimization of Molybdenum Carbide Nanoparticle Catalysts in a Continuous Flow Reactor Using Design of Experiments

Transition metal carbides (TMCs) have attracted significant attention because of their applications toward a wide range of catalytic transformations. However, the practicality of their synthesis is still limited because of the harsh conditions in which most TMCs are prepared. Recently, a solution-phase synthesis of phase-pure a-MoC1-x nanoparticles was presented. While this synthetic route yielded nanoparticles with exceptional catalytic performance, the reaction parameter space was not explored, and catalyst throughput was not optimized for scale-up. Continuous flow platforms coupled with statistical design of experiments (DoE) can provide a powerful method for understanding the reaction parameter space for optimizations. Here, we demonstrate the use of statistical DoE in tandem with response surface methodology for a parametric screening analysis to optimize the throughput of a MoC1-x nanoparticle synthesis utilizing a millifluidic flow reactor. A full factorial design was implemented to evaluate four input variables (reaction temperature, flow rate, solvent fraction of oleylamine, and precursor concentration) that carry statistically significant effects on three responses (throughput, residence time, and isolated yield). A Doehlert matrix was implemented to investigate each significant variable at a higher number of levels to optimize throughput. Our results give a nonintuitive set of experimental conditions that resulted in an optimized throughput of 2.2 g h-1. This translates to a 50-fold increase in throughput compared to the previously reported batch method. The catalytic performance of the MoC1-x nanoparticles produced under optimized throughput was demonstrated in the CO2 hydrogenation reaction. This DoE screening analysis and throughput optimization of MoC1-x synthesis open the door to an increased feasibility for scale-up.

design of experiments↗