Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “testing data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

The Importance of Being Adaptable: An Exploration of the Power and Limitations of Domain Adaptation for Simulation-Based Inference with Galaxy Clusters

The application of deep machine learning methods in astronomy has exploded in the last decade, with new models showing remarkably improved performance on benchmark tasks. Not nearly enough attention is given to understanding the models' robustness, especially when the test data are systematically different from the training data, or "out of domain." Domain shift poses a significant challenge for simulation-based inference, where models are trained on simulated data but applied to real observational data. In this paper, we explore domain shift and test domain adaptation methods for a specific scientific case: simulation-based inference for estimating galaxy cluster masses from X-ray profiles. We build datasets to mimic simulation-based inference: a training set from the Magneticum simulation, a scatter-augmented training set to capture uncertainties in scaling relations, and a test set derived from the IllustrisTNG simulation. We demonstrate that the Test Set is out of domain in subtle ways that would be difficult to detect without careful analysis. We apply three deep learning methods: a standard neural network (NN), a neural network trained on the scatter-augmented input catalogs, and a Deep Reconstruction-Regression Network (DRRN), a semi-supervised deep model engineered to address domain shift. Although the NN improves results by 17% in the Training Data, it performs 40% worse on the out-of-domain Test Set. Surprisingly, the Scatter-Augmented Neural Network (SANN) performs similarly. While the DRRN is successful in mapping the training and Test Data onto the same latent space, it consistently underperforms compared to a straightforward Yx scaling relation. These results serve as a warning that simulation-based inference must be handled with extreme care, as subtle differences between training simulations and observational data can lead to unforeseen biases creeping into the results.

Ntampaka, Michelle [Baltimore, Space Telescope Sci↗

A preliminary analysis of flight data from the AFTI/F-16 airplane

Flight test data from the AFTI/F-16 airplane are analyzed. Two flight control system modes (Independent Backup Unit and Standard Normal Mode) are considered. Estimated stability and control derivatives are compared with values from the wind tunnel and F-16A flight tests. Modeling difficulties are shown to arise due to the near-neutral static stability of the airplane and the number of coordinated control surface movements commanded in the Standard Normal Mode.

Batterson, J. G.↗

Thermal Protection Test Bed Pathfinder Development Project

In order to increase thermal protection capabilities for future reentry vehicles, a method to obtain relevant test data is required. Although arc jet testing can be used to obtain some data on materials, the best method to obtain these data is to actually expose them to an atmospheric reentry. The overprediction of the Orion EFT-1 flight data is an example of how the ground test to flight traceability is not fully understood. The RED-Data small reentry capsule developed by Terminal Velocity Aerospace is critical to understanding this traceability. In order to begin to utilize this technology, ES3 needs to be ready to build and integrate heat shields onto the RED-Data vehicle. Using a heritage Shuttle tile material for the heat shield will both allow valuable insight into the environment that the RED-Data vehicle can provide and give ES3 the knowledge and capability to build and integrate future heat shields for this vehicle.

Snapp, Cooper↗

Correlation of full-scale drag predictions with flight measurements on the C-141A aircraft : Phase 2: Wind tunnel tests, analysis, and prediction techniques. Volume 2: Wind tunnel test and basic data

A research program has been conducted to determine the degree of cruise drag correlation on the C-141A aircraft between predictions based on wind tunnel test data, and flight test results. Information is presented on the wind tunnel test program and basic aerodynamic data on the C-141A wind-tunnel model used in the correlation studies.

Macwilkinson, D. G.↗

Resistive AC-Coupled Silicon Detectors: principles of operation and first results from a combined analysis of beam test and laser data

This paper presents the principles of operation of Resistive AC-Coupled Silicon Detectors (RSDs) and measurements of the temporal and spatial resolutions using a combined analysis of laser and beam test data. RSDs are a new type of n-in-p silicon sensor based on the Low-Gain Avalanche Diode (LGAD) technology, where the n+ implant has been designed to be resistive, and the read-out is obtained via AC-coupling. The truly innovative feature of RSD is that the signal generated by an impinging particle is shared isotropically among multiple read-out pads without the need for floating electrodes or an external magnetic field. Careful tuning of the coupling oxide thickness and the n+ doping profile is at the basis of the successful functioning of this device. Several RSD matrices with different pad width-pitch geometries have been extensively tested with a laser setup in the Laboratory for Innovative Silicon Sensors in Torino, while a smaller set of devices have been tested at the Fermilab Test Beam Facility with a 120 GeV/c proton beam. The measured spatial resolution ranges between 2.5μm for 70–100 pad-pitch geometry and 17μm with 200–500 matrices, a factor of 10 better than what is achievable in binary read-out (bin size/12). Beam test data show a temporal resolution of ~40ps for 200 μm pitch devices, in line with the best performances of LGAD sensors at the same gain.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Aerodynamic heating to representative SRB and ET protuberances

Heating data and data scaling methods which can be used on representative solid rocket booster and external tank (ET) protuberances are described. Topics covered include (1) ET geometry and heating points; (2) interference heating test data (51A); (3) heat transfer data from tests FH-15 and FH-16; (4) individual protuberance data; and (5) interference heating of paint data from test IH-42. A set of drawings of the ET moldline and protuberances is included.

Engel, C. D.↗

Physiologic and anti-G suit performance data from YF-16 flight tests

Biomedical data were collected during high-G portions of 11 YF-16 test flights. Test pilots monitored revealed increased respiratory rate and volume, decreased tidal volume, and increased heart rate at higher G levels, with one pilot exhibiting various cardiac arrhythmias. Anti-G suit inflation and pressurization lags varied inversely with G-onset rate, and suit pressurization slope was near the design value.

Gillingham, K. K.↗

Rotorcraft Blade Mode Damping Identification from Random Responses Using a Recursive Maximum Likelihood Algorithm

An on line technique is presented for the identification of rotor blade modal damping and frequency from rotorcraft random response test data. The identification technique is based upon a recursive maximum likelihood (RML) algorithm, which is demonstrated to have excellent convergence characteristics in the presence of random measurement noise and random excitation. The RML technique requires virtually no user interaction, provides accurate confidence bands on the parameter estimates, and can be used for continuous monitoring of modal damping during wind tunnel or flight testing. Results are presented from simulation random response data which quantify the identified parameter convergence behavior for various levels of random excitation. The data length required for acceptable parameter accuracy is shown to depend upon the amplitude of random response and the modal damping level. Random response amplitudes of 1.25 degrees to .05 degrees are investigated. The RML technique is applied to hingeless rotor test data. The inplane lag regressing mode is identified at different rotor speeds. The identification from the test data is compared with the simulation results and with other available estimates of frequency and damping.

Molusis, J. A.↗

A review of propeller noise prediction methodology: 1919-1994

This report summarizes a review of the literature regarding propeller noise prediction methods. The review is divided into six sections: (1) early methods; (2) more recent methods based on earlier theory; (3) more recent methods based on the Acoustic Analogy; (4) more recent methods based on Computational Acoustics; (5) empirical methods; and (6) broadband methods. The report concludes that there are a large number of noise prediction procedures available which vary markedly in complexity. Deficiencies in accuracy of methods in many cases may be related, not to the methods themselves, but the accuracy and detail of the aerodynamic inputs used to calculate noise. The steps recommended in the report to provide accurate and easy to use prediction methods are: (1) identify reliable test data; (2) define and conduct test programs to fill gaps in the existing data base; (3) identify the most promising prediction methods; (4) evaluate promising prediction methods relative to the data base; (5) identify and correct the weaknesses in the prediction methods, including lack of user friendliness, and include features now available only in research codes; (6) confirm the accuracy of improved prediction methods to the data base; and (7) make the methods widely available and provide training in their use.

Metzger, F. Bruce↗

Cryogenic Tank Modeling for the Saturn AS-203 Experiment

A computational fluid dynamics (CFD) model is developed for the Saturn S-IVB liquid hydrogen (LH2) tank to simulate the 1966 AS-203 flight experiment. This significant experiment is the only known, adequately-instrumented, low-gravity, cryogenic self pressurization test that is well suited for CFD model validation. A 4000-cell, axisymmetric model predicts motion of the LH2 surface including boil-off and thermal stratification in the liquid and gas phases. The model is based on a modified version of the commercially available FLOW3D software. During the experiment, heat enters the LH2 tank through the tank forward dome, side wall, aft dome, and common bulkhead. In both model and test the liquid and gases thermally stratify in the low-gravity natural convection environment. LH2 boils at the free surface which in turn increases the pressure within the tank during the 5360 second experiment. The Saturn S-IVB tank model is shown to accurately simulate the self pressurization and thermal stratification in the 1966 AS-203 test. The average predicted pressurization rate is within 4% of the pressure rise rate suggested by test data. Ullage temperature results are also in good agreement with the test where the model predicts an ullage temperature rise rate within 6% of the measured data. The model is based on first principles only and includes no adjustments to bring the predictions closer to the test data. Although quantitative model validation is achieved or one specific case, a significant step is taken towards demonstrating general use of CFD for low-gravity cryogenic fluid modeling.

Grayson, Gary D.↗

D2U: Data Driven User Emulation for the Enhancement of Cyber Testing, Training, and Data Set Generation

Whether testing intrusion detection systems, conducting training exercises, or creating data sets to be used by the broader cybersecurity community, realistic user behavior is a critical component of a cyber range. Existing methods either rely on network level data or replay recorded user actions to approximate real users in a network. Our work is the first to produce generative models trained on actual user data (sequences of application usage) collected on endpoints. Once trained to the user's behavioral data, these models can generate novel sequences of actions %that appear to come from the same distribution as the training data. These sequences of actions are then fed to our custom software via configuration files, which replicate those behaviors on end devices. Notably, our models are platform agnostic and could generate behavior data for any emulation software package. In this paper we present our model generation process, software architecture, and an initial evaluation of the fidelity of our models. Our software is currently deployed in a cyber range to help evaluate the efficacy of defensive cyber technologies. We suggest additional ways that the cyber community as a whole can benefit from more realistic user behavior emulation. The data used to train our model, as well as sample configuration files produced by the model, are available at [redacted].

Oesch, T↗

Integrated Structural Analysis and Test Program

An integrated structural-analysis and structure-testing computer program is being developed in order to: Automate repetitive processes in testing and analysis; Accelerate pre-test analysis; Accelerate reporting of tests; Facilitate planning of tests; Improve execution of tests; Create a vibration, acoustics, and shock test database; and Integrate analysis and test data. The software package includes modules pertaining to sinusoidal and random vibration, shock and time replication, acoustics, base-driven modal survey, and mass properties and static/dynamic balance. The program is commanded by use of ActiveX controls. There is minimal need to generate command lines. Analysis or test files are selected by opening a Windows Explorer display. After selecting the desired input file, the program goes to a so-called analysis data process or test data process, depending on the type of input data. The status of the process is given by a Windows status bar, and when processing is complete, the data are reported in graphical, tubular, and matrix form.

Kaufman, Daniel↗

Spacecraft Data Simulator for the test of level zero processing systems

The Microelectronic Systems Branch (MSB) at Goddard Space Flight Center (GSFC) has developed a Spacecraft Data Simulator (SDS) to support the development, test, and verification of prototype and production Level Zero Processing (LZP) systems. Based on a disk array system, the SDS is capable of generating large test data sets up to 5 Gigabytes and outputting serial test data at rates up to 80 Mbps. The SDS supports data formats including NASA Communication (Nascom) blocks, Consultative Committee for Space Data System (CCSDS) Version 1 & 2 frames and packets, and all the Advanced Orbiting Systems (AOS) services. The capability to simulate both sequential and non-sequential time-ordered downlink data streams with errors and gaps is crucial to test LZP systems. This paper describes the system architecture, hardware and software designs, and test data designs. Examples of test data designs are included to illustrate the application of the SDS.

Shi, Jeff↗

First Principles Modeling of the Thermal Amine Scrubber Flight Experiment’s Chemical Performance

The removal of atmospheric CO2 from a spacecraft is of particular importance to NASA’s mission, and is an area of continual study and technological advancement. One of the more recent advancements has been with reusable sorbents being regenerated with a combination of heat and vacuum. One such technology is the Thermal Amine Scrubber (TAS) flight experiment on the ISS, though several others are currently flying or preparing to fly. A model was created of the TAS to predict chemical performance, using fundamental chemistry and physics based on principles rather than empirical relations. Since the physical laws are true across all conditions, such a model enables greater model accuracy outside the bounds of test data, and allows for virtual testing of the hardware at conditions that are prohibitively difficult or expensive to actually test. This paper details the model’s development, operation, and correlation to data from the flight unit. The model is then compared to a data set taken from the flight unit under different flow, CO2 partial pressure, and bed configuration conditions, resulting in only a 2% error. The equations and principles laid forth in this paper are applicable to a wide range of thermally regenerated sorbents, and additional models of a similar nature would allow for potentially the most straightforward and direct method of comparison of technologies available to date.

CO2 removal↗

A Pattern Dictionary Method for Anomaly Detection

In this paper, we propose a compression-based anomaly detection method for time series and sequence data using a pattern dictionary. The proposed method is capable of learning complex patterns in a training data sequence, using these learned patterns to detect potentially anomalous patterns in a test data sequence. The proposed pattern dictionary method uses a measure of complexity of the test sequence as an anomaly score that can be used to perform stand-alone anomaly detection. We also show that when combined with a universal source coder, the proposed pattern dictionary yields a powerful atypicality detector that is equally applicable to anomaly detection. The pattern dictionary-based atypicality detector uses an anomaly score defined as the difference between the complexity of the test sequence data encoded by the trained pattern dictionary (typical) encoder and the universal (atypical) encoder, respectively. We consider two complexity measures: the number of parsed phrases in the sequence, and the length of the encoded sequence (codelength). Specializing to a particular type of universal encoder, the Tree-Structured Lempel–Ziv (LZ78), we obtain a novel non-asymptotic upper bound, in terms of the Lambert W function, on the number of distinct phrases resulting from the LZ78 parser. This non-asymptotic bound determines the range of anomaly score. As a concrete application, we illustrate the pattern dictionary framework for constructing a baseline of health against which anomalous deviations can be detected.

97 MATHEMATICS AND COMPUTING↗

Hypervelocity impact damage assessment for Space Station

To inhibit damage and limit the probability of penetration of the Space Station pressure wall by micrometeoroids and orbital debris, a shield placed away from the wall is used to form a double wall. To determine shield effectiveness and assess impact damage, existing test data were reviewed and additional testing was performed for Space Station double wall designs. Empirical spallation and penetration functions derived from the data show that shield thickness and impact angle affect the damage to the wall. Thick shields reduce wall damage for low angle impacts but increase damage for oblique impacts. Multilayer insulation between the shield and wall reduces impact damage to the wall. A relationship between impact velocity and spall damage to the wall is demonstrated. Preliminary test results on Li-Al shield material indicate possible improved effectiveness over Al shields.

Coronado, Alex R.↗