Engineering PapersSearch

SEARCH · Engineering Papers

Results for “performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

1,209 records · Page 3

Evaluation of Anomaly Detection Capability for Ground-Based Pre-Launch Shuttle Operations

This chapter will provide a thorough end-to-end description of the process for evaluation of three different data-driven algorithms for anomaly detection to select the best candidate for deployment as part of a suite of IVHM (Integrated Vehicle Health Management) technologies. These algorithms were deemed to be sufficiently mature enough to be considered viable candidates for deployment in support of the maiden launch of Ares I-X, the successor to the Space Shuttle for NASA's Constellation program. Data-driven algorithms are just one of three different types being deployed [3],[5]. The other two types of algorithms being deployed include a "rule-based" expert system, and a "model-based" system. Within these two categories, the deployable candidates have already been selected based upon qualitative factors such as flight heritage. For the rile-based system, SHINE (Spacecraft High-speed Inference Engine) has been selected for deployment, which is a component of BEAM (Beacon-based Exception Analysis for Multimissions) [4], a patented technology developed at NASA's JPL (Jet Propulsion Laboratory) and serves to aid in the management and identification of operational modes. For the "model-based" system, a commercially available package developed by QSI (Qualtech Systems, Inc.), TEAMS (Testability Engineering and Maintenance System) [1] has been selected for deployment to aid in diagnosis. In the context of this particular deployment, distinctions among the use of the terms "data-driven," "rule-based," and "model-based," call found in [5]. Although there are three different categories of algorithms that have been selected for deployment, our main focus in this chapter will be on the evaluation of three candidates for data-driven anomaly detection. These algorithms will be evaluated upon their capability for robustly detecting incipient faults or failures in the ground-based phase of pre-launch space shuttle operations, rather than based oil heritage as performed in previous studies [5]. Robust detection will allow for the achievement of pre-specified minimum false alarm and/or missed detection rates in the selection of alert thresholds. All algorithms will also be optimized with respect to all of these same criteria. Our study relies upon the use of Shuttle data to act as was a proxy for and in preparation for application to Ares I-X data, which uses a very similar hardware platform for the subsystems that are being targeted (TVC - Thrust Vector Control subsystem for the SRB (Solid Rocket Booster)).

False Alarms

Demonstration Trials of AI/ML Edge+Cloud Suite (CRADA Final Report)

PACE AI and LBNL partnered under this CRADA to test and evaluate the PACE5 edge node prototype, an AI/ML edge and cloud-based suite, at FLEXLAB.The objective of the test was to evaluate the PACE5 edge node prototype's ability to perform demand shed and take to dynamic price signals, and to demonstrate advanced fault detection and microgrid monitoring capabilities.

97 MATHEMATICS AND COMPUTING

Test Program

A test program was set up early in the Explorer XIII program to simulate as nearly as possible all expected environmental conditions to which the spacecraft would be subjected during the ascending phase of the trajectory and while in orbit. These tests included spin, acceleration, thermal-vacuum, vibration, and shock. Functional tests were performed on individual modules of the telemeter system. The test procedure started with breadboard construction of telemeter components. Circuits were evaluated in this phase, and components chosen for prototype construction. Prior to the prototype environmental tests, it was found desirable to construct a mock-up structure for preliminary evaluation of the spacecraft hardware.

Explorer XIII Satellite

Nickel hydrogen battery expert system

The Hubble Telescope Battery Testbed at MSFC uses the Nickel Cadmium (NiCd) Battery Expert System (NICBES-2) which supports the evaluation of performance of Hubble Telescope spacecraft batteries and provides alarm diagnosis and action advice. NICBES-2 provides a reasoning system along with a battery domain knowledge base to achieve this battery health management function. An effort is summarized which was used to modify NICBES-2 to accommodate Nickel Hydrogen (NiH2) battery environment now in MSFC testbed. The NICBES-2 is implemented on a Sun Microsystem and is written in SunOS C and Quintus Prolog. The system now operates in a multitasking environment. NICBES-2 spawns three processes: serial port process (SPP); data handler process (DHP); and the expert system process (ESP) in order to process the telemetry data and provide the status and action advice. NICBES-2 performs orbit data gathering, data evaluation, alarm diagnosis and action advice and status and history display functions. The adaptation of NICBES-2 to work with NiH2 battery environment required modification to all of the three component processes.

Shiva, Sajjan G.

Evaluation of Fatigue Damage Accumulation Functions for Delamination Initiation and Propagation

The present report follows on the cohesive fatigue damage model methodology proposed in NASA-TP-2018-219838. In that report, an empirical function describing the incremental damage due to cyclic loading was used to calculate fatigue damage within a cohesive formulation. The form of the function was developed such that, when integrated at a constant stress amplitude from no damage to failure, it produces a life versus load response that is consistent with an S-N diagram. Therefore, the parameters of the damage model could be obtained by fitting the model predictions to an S-N diagram. The finite element analyses performed demonstrate that the cohesive fatigue accumulation function provides a link between the S-N diagram that describes crack initiation, and the Paris law that characterizes the rate of crack propagation. However, when the model was proposed, it was not known whether the form of the damage accumulation function associated with a desired S-N diagram is unique and, if not, if the link between S-N and the Paris law is unique and independent of the fatigue function selected. In the effort described herein, several alternative forms of the damage function that reproduce the desired features of S-N diagrams were found and evaluated. The effects of each of these functions on the predicted parameters of the Paris law and the propagation threshold are discussed. The results indicate that the predicted exponent m of the Paris law is indeed independent of the damage accumulation function. However, different functions predict different values for the pre-factor C of the Paris law. Therefore, the proper damage accumulation function must be selected by comparison with experiments. One of the new damage accumulation functions proposed herein was found to be particularly useful for analysis because of the ease with which the model parameters can be determined with a minimal amount of experimental information. The effectiveness of the proposed methodology and damage function was demonstrated by conducting analyses of a double cantilever beam test, a mixed-mode bending test, and a three-point bending test of a skin/doubler specimen. The results indicate that the same set of model parameters can provide accurate predictions of the rate of fatigue crack propagation for a variety of material interfaces, mode mixities, load levels, and stress ratios.

DKIN/Stiffener Debonding

GPS on-orbit battery performance

Three batteries designed for the GPS system were evaluated. The batteries were wired together, and during the eclipse period were discharged through parallel diodes into a boost converter which then boosted the battery voltage up to the totally regulated bus voltage. Each battery, with a system life of approximately five years, had its own charger. During testing the battery was maintained or used on trickle charge. Data are presented for the battery capacity during the reconditioning. Raw data for each eclipse period and calculations for the average discharge voltage for each battery are given. Thermal cycling for one of the batteries and reconditioning cycles and regimes for all of the batteries are discussed. A reconditioning discharge curve is also given. The problem of temperature cycling in one of the batteries was resolved by redesigning the battery radiator system.

Kasten, J. L.

Multi-contrast machine learning improves schistosomiasis diagnostic performance

Schistosomiasis currently affects over 250 million people and remains a public health burden despite ongoing global control efforts. Conventional microscopy is a practical tool for diagnosis and screening ofSchistosoma haematobium, but identification of eggs requires a skilled microscopist. Here we present a machine learning (ML)-based strategy for automated detection ofS. haematobiumthat combines two imaging contrasts, brightfield (BF) and darkfield (DF), to improve diagnostic performance. We collected BF and DF images of urine samples, many of them containingS. haematobiumeggs, during two different field studies in Côte d’Ivoire using a mobile phone-based microscope, the SchistoScope. We then trained separate egg-detection ML models and compared the patient-level performance of BF and DF models alone to combinations of BF and DF models, using annotations from trained microscopists as the gold standard. We found that models trained on DF images, and almost all BF and DF combinations, performed significantly better than models trained on BF images only. When models were trained on images from the first field study (n = 349 patients, 748 images of each contrast), patient-level classification performance on patient images from the second study (n = 375 patients, 752 images of each contrast) met the WHO Diagnostic Target Product Profile (TPP) sensitivity and specificity for the monitoring and evaluation use case (sensitivity for all models and combinations was >75% when evaluated at a confidence score threshold that resulted in specificity >96.5%). When we used images from both field studies for the training set, performance of the models was improved. Overall, this work shows that the use of DF and BF increases the performance of ML models on images from devices with low-cost optics, while retaining the portability, power, and time-to-results of the WHO’s diagnostic TPP. DF requires no additional sample preparation and does not increase the complexity of the imaging system. It thus offers a practical means to improve performance of automated diagnostics forS. haematobiumas well as other microscopy-based diagnostics.

Infectious Diseases

SMS/GOES cell and battery data analysis report

The nickel-cadmium battery design developed for the Synchronous Meteorological Satellite (SMS) and Geostationary Operational Environmental Satellite (GOES) provided background and guidelines for future development, manufacture, and application of spacecraft batteries. SMS/GOES battery design, development, qualification testing, acceptance testing, and life testing/mission performance characteristics were evaluated for correlation with battery cell manufacturing process variables.

Armantrout, J. D.

The Flight Performance of the Galileo Orbiter USO

Results are presented from an analysis of radio metric data received by the DSN stations from the Galileo spacecraft using an Ultrastable Oscillator (USO) as a signal source. These results allow the health and performance of the Galileo USO to be evaluated, and are used to calibrate this Radio Science instrument and the data acquired for Radio Science experiments such as the Red-shift Observation, Solar Conjunction, and Jovian occultations. Estimates for the USO-referenced spacecraft-transmitted frequency and frequency stability were made for 82 data acquisition passes conducted between launch (October 1989) and November 1991. Analyses of the spacecraft-transmitted frequencies show that the USO is behaving as expected. The USO was powered off and then back on in August 1991 with no adverse effect on its performance. The frequency stabilities measured by Allan deviation are consistent with expected values due to thermal wideband noise and the USO itself at the appropriate time intervals. The Galileo USO appears to be healthy and functioning normally in a reasonable manner.

D D Morabito