Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

A Reynolds-Averaged Navier-Stokes Perspective for the High Lift Common Research Model Using the LAVA Framework

An in-depth assessment of the High Lift-Common Research Model (HL-CRM) aerodynamic performance is made using a Reynolds-Averaged Navier-Stokes (RANS) methodology. Results presented here were produced in support of the 4th AIAA High Lift Prediction Workshop(HLPW-4), with additional simulation results and analysis used to support findings from the workshop. Mesh resolution, RANS closure models, and tunnel effects were among the sources of simulation sensitivity addressed, all in the pursuit of evaluating best-practice simulation methods for complex high-lift configurations. In general, free-air simulations using RANS yield accurate predictions of integrated loads in the pre-stall regime for the HL-CRM, while strong sensitivity to simulation method is observed near CLmax. Additionally, a study assessing changes in aerodynamic performance due to flap deflection angle indicated strong sensitivity to turbulence model closure and mesh resolution, particularly at the highest deflection setting. Several available corrections for the Spalart-Allmaras (SA) turbulence model were tested and generally introduced more error relative to the experiment in comparison to the baseline SA closure model. The Standard Menter Baseline Two-Equation (k-ωBSL) turbulence model was also explored, which arguably yielded results highly consistent with experiment, but at a substantially higher computational cost. Therefore, as a compromise between computational cost and accuracy, the baseline SA closure model was selected for additional HL-CRM studies that assess alternative solution methods. These strategies include “warm start” approaches, which initialize the simulation from a previously converged solution at a nearby angle of attack, unsteady calculations, and simulations that model the experimental wind tunnel. Results from these studies would reinforce the shortcomings of RANS in predicting aircraft performance at high-lift conditions, namely at high-αand highly loaded flap conditions, while also answering questions about appropriate modeling techniques to minimize the errors associated with RANS where possible

TTT↗

Machine Learning Algorithms for Alignment Verification of the Roman Space Telescope

The Nancy Grace Roman Telescope is a NASA observatory designed to unravel the secrets of dark energy and dark matter, search for and image exoplanets, and explore many topics in infrared optics. Scheduled to launch no earlier than October 2026, this 2.4 meter aperture telescope has a field of view 100 times greater than the Hubble Space Telescope. The mission is currently in its construction phase, where the telescope and its two instruments will soon be aligned together to ensure proper pupil matching. To help verify this alignment, multiple point sources above the entrance pupil of the telescope will illuminate the optical path through the telescope-instrument system, and shadows of various obstructions in the system will be analyzed using machine learning algorithms to determine the pupil matching error. This presentation discusses the test approach and the machine learning algorithms employed, as well as our uncertainty predictions based on a modeled Monte-Carlo analysis of the test.

Telescope↗

Spectral Measurement Errors due to CCD Serial Pixel-to-Pixel Readout Interference in the Ocean Color Instrument of the NASA PACE Mission

The Ocean Color Instrument on NASA’s PACE mission is a hyperspectral imager with a spatial resolution of 1km x 1km and spectral resolution of 5nm in 2.5nm steps over 320-890nm. The detection system is based on two Charge-Coupled Devices (CCDs) operating in Time Delay Integration (TDI) mode to achieve high signal-to-noise ratio. The front-end optical imager is a rotating mirror-based system that images the ground-scene onto a slit with a field of view of 16km x 1km. The slit-image is re-imaged and wavelength dispersed on the CCDs. As the ground-scene moves through the slit, it moves along the CCD columns as charge is moved along with it. The accumulated charge at the end of each column is collected in a serial pixel. Each of the 16 CCD outputs read out 32 columns of the same ground scene spaced 0.625nm apart. The 32-pixel serial register is swiftly read out before the next TDI cycle. The telescope is spinning at 5.77Hz to achieve the required spatial resolution. This results in a serial pixel readout speed of 8.5MHz. Each serial read-cycle goes through a reset and video period that are each sampled to create a low-noise correlated double sample value. This only allows 59ns for the reset and video to be asserted and settled before sampling. Due to the short time period, the response of the CCD exhibits serial pixel-to-pixel readout interference as the reset and video signals do not have time to fully settle before sampling. Each serial pixel value therefore has a dependence on the value of the preceding pixel value. This leads to a spectral measurement error of up to 0.3%. We explain the operation of the detection system, the behavior of the interference and the resulting wavelength error with results from ground testing and on-orbit characterization.

Ulrik B Gliese↗

Thermal Modeling and Correlation of the Space Environments Complex Vacuum Chamber and Cryoshroud

A thermal model of the Space Environments Complex (SEC) vacuum chamber and cryoshroud has been developed in support of upcoming thermal vacuum/thermal balance testing for Orion EM-1. The model was developed in Thermal Desktop and includes the vacuum chamber itself, a fluid model of the gaseous nitrogen flowing through the cryoshroud and the chamber piping, the Heat Flux System (HFS) within the cryoshroud, and the mechanical ground support equipment (MGSE) that interfaces with the vehicle. It has been correlated with steady state data from three tests. Two tests ran the cryoshroud in hot mode at 170 °F, and one test ran the cryoshroud in cold mode at -263 °F. Correlation was done using an optimization algorithm to find values of unknown contact conductances that minimized the RMS error between the model predictions and the test data. Overall, model quality was very good with a total RMS error of 2.6 °F.

Stalcup, Erik J.↗

Flight Test Results: CTAS Cruise/Descent Trajectory Prediction Accuracy for En route ATC Advisories

The Center/TRACON Automation System (CTAS), under development at NASA Ames Research Center, is designed to assist controllers with the management and control of air traffic transitioning to/from congested airspace. This paper focuses on the transition from the en route environment, to high-density terminal airspace, under a time-based arrival-metering constraint. Two flight tests were conducted at the Denver Air Route Traffic Control Center (ARTCC) to study trajectory-prediction accuracy, the key to accurate Decision Support Tool advisories such as conflict detection/resolution and fuel-efficient metering conformance. In collaboration with NASA Langley Research Center, these test were part of an overall effort to research systems and procedures for the integration of CTAS and flight management systems (FMS). The Langley Transport Systems Research Vehicle Boeing 737 airplane flew a combined total of 58 cruise-arrival trajectory runs while following CTAS clearance advisories. Actual trajectories of the airplane were compared to CTAS and FMS predictions to measure trajectory-prediction accuracy and identify the primary sources of error for both. The research airplane was used to evaluate several levels of cockpit automation ranging from conventional avionics to a performance-based vertical navigation (VNAV) FMS. Trajectory prediction accuracy was analyzed with respect to both ARTCC radar tracking and GPS-based aircraft measurements. This paper presents detailed results describing the trajectory accuracy and error sources. Although differences were found in both accuracy and error sources, CTAS accuracy was comparable to the FMS in terms of both meter-fix arrival-time performance (in support of metering) and 4D-trajectory prediction (key to conflict prediction). Overall arrival time errors (mean plus standard deviation) were measured to be approximately 24 seconds during the first flight test (23 runs) and 15 seconds during the second flight test (25 runs). The major source of error during these tests was found to be the predicted winds aloft used by CTAS. Position and velocity estimates of the airplane provided to CTAS by the ATC Host radar tracker were found to be a relatively insignificant error source for the trajectory conditions evaluated. Airplane performance modeling errors within CTAS were found to not significantly affect arrival time errors when the constrained descent procedures were used. The most significant effect related to the flight guidance was observed to be the cross-track and turn-overshoot errors associated with conventional VOR guidance. Lateral navigation (LNAV) guidance significantly reduced both the cross-track and turn-overshoot error. Pilot procedures and VNAV guidance were found to significantly reduce the vertical profile errors associated with atmospheric and aircraft performance model errors.

Green, S.↗

Geodetic Accuracy of LANDSAT-4 Multispectral Scanner and Thematic Mapper Data

The geodetic accuracy of an MSS or TM scene is assessed using a minicomputer and appropriate software, a digitizer, and an image display device. The calculated image location of a selected feature is compared with the actual image location obtained though visual inspection of the image on the display. Measurements of 15 to 20 features evenly distributed throughout the image provide an estimate of the geodetic accuracy of the scene. Tests of two system-corrected MSS scenes measured geodetic registration root-mean-square (RMS) errors of approximately 3,200 m or 57 pixels. Tests of two TM system-corrected scenes measured RMS errors of approximately 1,250 and 1,000 m, or 44 and 35 pixels, respectively. All errors were primarily translational, implying good internal scene registration of both MSS and TM data. The one MSS GCP-corrected scene which was evaluated had an RMS error of approximately 325 m or 6 pixels.

Thormodsgard, J. M.↗

Within-Tunnel Variations in Pressure Data for Three Transonic Wind Tunnels

This paper compares the results of pressure measurements made on the same test article with the same test matrix in three transonic wind tunnels. A comparison is presented of the unexplained variance associated with polar replicates acquired in each tunnel. The impact of a significance component of systematic (not random) unexplained variance is reviewed, and the results of analyses of variance are presented to assess the degree of significant systematic error in these representative wind tunnel tests. Total uncertainty estimates are reported for 140 samples of pressure data, quantifying the effects of within-polar random errors and between-polar systematic bias errors.

DeLoach, Richard↗

A geopotential model from satellite tracking, altimeter, and surface gravity data: GEM-T3

An improved model of Earth's gravitational field, Goddard Earth Model T-3 (GEM-T3), has been developed from a combination of satellite tracking, satellite altimeter, and surface gravimetric data. GEM-T3 provides a significant improvement in the modeling of the gravity field at half wavelengths of 400 km and longer. This model, complete to degree and order 50, yields more accurate satellite orbits and an improved geoid representation than previous Goddard Earth Models. GEM-T3 uses altimeter data from GEOS 3 (1975-1976), Seasat (1978) and Geosat (1986-1987). Tracking information used in the solution includes more than 1300 arcs of data encompassing 31 different satellites. The recovery of the long-wavelength components of the solution relies mostly on highly precise satellite laser ranging (SLR) data, but also includes Tracking Network (TRANET) Doppler, optical, and satellite-to-satellite tracking acquired between the ATS 6 and GEOS 3 satellites. The main advances over GEM-T2 (beyond the inclusion of altimeter and surface gravity information which is essential for the resolution of the shorter wavelength geoid) are some improved tracking data analysis approaches and additional SLR data. Although the use of altimeter data has greatly enhanced the modeling of the ocean geoid between 65 deg N and 60 deg S latitudes in GEM-T3, the lack of accurate detailed surface gravimetry leaves poor geoid resolution over many continental regions of great tectonic interest (e.g., Himalayas, Andes). Estimates of polar motion, tracking station coordinates, and long-wavelength ocean tidal terms were also made (accounting for 6330 parameters). GEM-T3 has undergone error calibration using a technique based on subset solutions to produce reliable error estimates. The calibration is based on the condition that the expected mean square deviation of a subset gravity solution from the full set values is predicted by the solutions' error covariances. Data weights are iteratively adjusted until this condition for the error calibration is satisfied. In addition, gravity field tests were performed on strong satellite data sets withheld from the solution (thereby ensuring their independence). In these tests, the performance of the subset models on the withheld observations is compared to error projections based on their calibrated error covariances. These results demonstrate that orbit accuracy projections are reliable for new satellites which were not included in GEM-T3.

Lerch, F. J.↗

Rover mast calibration, exact camera pointing, and camara handoff for visual target tracking

This paper presents three technical elements that we have developed to improve the accuracy of the visual target tracking for single-sol approach-and-instrument placement in future Mars rover missions. An accurate, straightforward method of rover mast calibration is achieved by using a total station, a camera calibration target, and four prism targets mounted on the rover. The method was applied to Rocky8 rover mast calibration and yielded a 1.1-pixel rms residual error. Camera pointing requires inverse kinematic solutions for mast pan and tilt angles such that the target image appears right at the center of the camera image. Two issues were raised. Mast camera frames are in general not parallel to the masthead base frame. Further, the optical axis of the camera model in general does not pass through the center of the image. Despite these issues, we managed to derive non-iterative closed-form exact solutions, which were verified with Matlab routines. Actual camera pointing experiments aver 50 random target image paints yielded less than 1.3-pixel rms pointing error. Finally, a purely geometric method for camera handoff using stereo views of the target has been developed. Experimental test runs show less than 2.5 pixels error on high-resolution Navcam for Pancam-to-Navcam handoff, and less than 4 pixels error on lower-resolution Hazcam for Navcam-to-Hazcam handoff.

camera handoff↗

Standardizing Microprocessor and GPU Radiation Test Approaches

Microprocessor, Graphics Processing Units (GPUs) and DDRx memory devices have emerged as promising next-generation technologies that enables both high performance processing and acceleration of complex algorithms for the latest challenges in human spaceflight, autonomous vehicles and artificial intelligence (AI). The feature sets of these devices offer exponential increases to throughput, calculation capability and system autonomy when compared to legacy flight systems. NASA's Electronic Part and Packaging (NEPP) Program has conducted an investigation into the radiation susceptibility of leading edge devices and process technologies by establishing standardized test approaches. Unlike most discrete devices, these require state of the art test systems to induce specific hardware activity similar to application software, thus allowing the characterization of failure modes within the system. To best characterize the tested part, NEPP eliminates variables that may impact device performance under radiation. Simplification of remaining system-level variables leads to an improved understanding of complex computational devices and their intended applications. The failure modes and error signatures that are recorded during testing are used to determine radiation sensitivity of the semiconductor process and the microcode architecture of the design. This presentation will discuss the test methodology that NASA Electronic Parts and Packaging (NEPP) is working to establish for its microprocessor, GPU and DDRx memory test programs to provide guidance on these devices and their underlying technology, in regards to their potential usage in future space flight systems.

GPU↗

Cost optimization of spacecraft test levels

Common to all nondestructive type testing of hardware that provides the necessary confidence in the design is the question regarding the proper magnitude of the test level. The objective of this investigation was to study the possibility of establishing cost optimized test levels of a rather general nature. This investigation was based on studying the influence of test level on a cost of error cost model that reflects the adverse effects of 'undertesting' and 'overtesting'. For the assumed conditions of normal distribution for the random variables and a protoflight spacecraft case, the results indicated that the limits for an optimum test factor can range between slightly less than 1.0 to slightly more than 1.5.

Young, J. P.↗

Experimental analysis of thread movement in bolted connections due to vibrations

The objective of this study was to identify the main design parameters contributing to loosening of bolts due to vibration and to identify their relative importance and degree of contribution to bolt loosening. Vibration testing was conducted on a shaketable with a controlled-random input in the dynamic testing laboratory of the Structural Test Division of MSFC. Test specimens which contained one test bolt were vibrated for a fixed amount of time and percentage of pre-load loss was measured. Each specimen tested implemented some combination of eleven design parameters as dictated by the design of experiment methodology employed. The eleven design parameters were: bolt size (diameter), lubrication on bolt, hole tolerance, initial pre-load, nut locking device, grip length, thread pitch, lubrication between mating materials, class of fit, joint configuration and mass of configuration. These parameters were chosen for this experiment because they are believed to be the design parameters having the greatest impact on bolt loosening. Two values of each design parameter were used and each combination of parameters tested was subjected to two different directions of vibration and two different g-levels of vibration. One replication was made for each test to gain some indication of experimental error and repeatability and to give some degree of statistical credibility to the data, resulting in a total of 96 tests being performed. The results of the investigation indicated that nut locking devices, joint configuration, fastener size, and mass of configuration were significant in bolt loosening due to vibration. The results of this test can be utilized to further research the complex problem of bolt loosening due to vibration.

Ramey, G. ED↗

Experimental analysis of thread movement in bolted connections due to vibrations

This is the final report of research project NAS8-39131 #33 sponsored by NASA's George C. Marshall Space Flight Center (MSFC) and carried out by the Civil Engineering Department of Auburn University (Auburn, Alabama) and personnel of MSFC. The objective of this study was to identify the main design parameters contributing to the loosening of bolts due to vibration and to identify their relative importance and degree of contribution to bolt loosening. Vibration testing was conducted on a shaketable with a controlled-random input in the dynamic testing laboratory of the Structural Test Division of MSFC. Test specimens which contained one test bolt were vibrated for a fixed amount of time and a percentage of pre-load loss was measured. Each specimen tested implemented some combination of eleven design parameters as dictated by the design of experiment methodology employed. The eleven design parameters were: bolt size (diameter), lubrication on bolt, hole tolerance, initial pre-load, nut locking device, grip length, thread pitch, lubrication between mating materials, class of fit, joint configuration, and mass of configuration. These parameters were chosen for this experiment because they are believed to be the design parameters having the greatest impact on bolt loosening. Two values of each design parameter were used and each combination of parameters tested was subjected to two different directions of vibration and two different g-levels of vibration. One replication was made for each test to gain some indication of experimental error and repeatability and to give some degree of statistical credibility to the data, resulting in a total of 96 tests being performed. The results of the investigation indicated that nut locking devices, joint configuration, fastener size, and mass of configuration were significant in bolt loosening due to vibration. The results of this test can be utilized to further research the complex problem of bolt loosening due to vibration.

Ramsey, G. ED↗

Retrieving Storm Electric Fields From Aircraft Field Mill Data: Applications - Part 2

The Lagrange multiplier theory and "pitch down method" developed in Part I of this study are applied to complete the calibration of a Citation aircraft that is instrumented with six field mill sensors. When side constraints related to average fields are used, the method performs well in computer simulations. For mill measurement errors of 1 V/m and a 5 V/m error in the mean fair weather field function, the 3-D storm electric field is retrieved to within an error of about 12%. A side constraint that involves estimating the detailed structure of the fair weather field was also tested using computer simulations. For mill measurement errors of 1 V/m, the method retrieves the 3-D storm field to within an error of about 8% if the fair weather field estimate is typically within 1 V/m of the true fair weather field. Using this side constraint and data from fair weather field maneuvers taken on 29 June 2001, the Citation aircraft was calibrated. The resulting calibration matrix was then used to retrieve storm electric fields during a Citation flight on 2 June 2001. The storm field results are encouraging and agree favorably with the results obtained from earlier calibration analyses that were based on iterative techniques.

Koshak, W. J.↗

Monopulse receiver

A time division multiplexing and a quadraphase combining dual channel system were analyzed, designed, and tested. Analyses performed include the following: (1) boresight error as a function of the error channel bandwidth; (2) error channel interference with the sum channel functions; (3) threshold performance; and (4) error channel crosstalk, linearity, and drift as a function of signal level, Doppler, and environment. Test results indicate that the time division multiplexing system meets the design goals of the program. However, careful selection and alignment of all gain controlled amplifiers are required along with temperature compensation of the angle channel gain. The quadraphase system crosstalk performance is comparatively poor (-15 dB) with respect to the -30 dB requirements and this consequently affects gain tracking performance. Gain tracking was found to be + or - 20 percent rather than the + or - 5 percent specification. Data for the two systems is compared and recommendations are presented.

Source record↗

Backshell Radiative Heating and Shock Layer Kinetic Measurement in NASA’s Electric Arc Shock Tube Facility

A methodology for creating incident shocks with similarity to the backshell radiative heating environment on planetary probes is presented. Two test series were carried out in the Electric Arc Shock Tube (EAST) at NASA Ames to quantify the backshell environment for planned and executed missions entering the atmospheres of Mars and Titan. The comparison of measured radiance in the shock tube to predicted post shock radiation levels is used to quantify the uncertainty in the model. This model uncertainty may then be related back to the flight condition to assess the error in the flight heating prediction. Tests for Mars entry show the shock tube measurements to be bracketed between two kinetic models by 2-7%. This suggests an 8% error in predicting the measured heating cannot be attributed to radiation. Comparisons to planned Titan entry suggest a substantial overprediction of the backshell radiation, which suggests opportunity for future refinement of radiative heating models.

radiation↗

Post-Landing Major Element Quantification Using SuperCam Laser Induced Breakdown Spectroscopy

The SuperCam instrument on the PerseveranceMars 2020 rover uses a pulsed 1064 nm laser to ablate targets at a distance and conduct laser induced breakdown spectroscopy (LIBS) by analyzing the light from the resulting plasma. SuperCam LIBS spectra are preprocessed to remove ambient light, noise, and the continuum signal present in LIBS observations. Prior to quantification, spectra are masked to remove noisier spectrometer regions andspectra are normalized to minimize signal fluctuations and effectsof target distance.In some cases, the spectra are also standardized or binned prior to quantification. To determine quantitative elemental compositionsof diverse geologic materials at Jezero crater, Mars, we use a suite of 1198 laboratory spectra of 334 well-characterized reference samples. The samples were selected to span a wide range of compositions and include typical silicate rocks, pure minerals (e.g.,silicates, sulfates, carbonates, oxides),more unusual compositions (e.g.,Mn oreand sodalite), andreplicates of the sintered SuperCam calibration targets (SCCTs) onboardthe rover. For each major element (SiO2, TiO2, Al2O3, FeOT, MgO, CaO, Na2O, K2O), the database was subdivided into five“folds” with similar distributions of the element of interest. One fold was held out as an independent test set, and the remaining fourfolds were used to optimize multivariate regression models relating the spectrum to the composition. We considered a variety of models, and selected several for further investigation for each element, based primarily on the root mean squared error of prediction (RMSEP) on the test set, when analyzed at 3m. In cases with several models of comparable performance at 3 m, we incorporated the SCCT performance at different distances to choose the preferred model. Shortly after landing on Mars and collecting initial spectra of geologic targets, we selected one model per element. Subsequently, with additional data from geologic targets, some models were revised to ensure results that are more consistent with geochemical constraints. The calibration discussed here is a snapshot of an ongoing effort to deliver the most accurate chemical compositions with SuperCam LIBS.

Mars 2020↗

Systematic Errors in Stereo PIV When Imaging through a Glass Window

This document assesses the magnitude of velocity measurement errors that may arise when performing stereo particle image velocimetry (PIV) with cameras viewing through thick, refractive window and where the calibration is performed in one plane only. The effect of the window is to introduce a refractive error that increases with window thickness and the camera angle of incidence. The calibration should be performed while viewing through the test section window, otherwise a potentially significant error may be introduced that affects each velocity component differently. However, even when the calibration is performed correctly, another error may arise during the stereo reconstruction if the perspective angle determined for each camera does not account for the displacement of the light rays as they refract through the thick window. Care should be exercised when applying in a single-plane calibration since certain implicit assumptions may in fact require conditions that are extremely difficult to meet in a practical laboratory environment. It is suggested that the effort expended to ensure this accuracy may be better expended in performing a more lengthy volumetric calibration procedure, which does not rely upon the assumptions implicit in the single plane method and avoids the need for the perspective angle to be calculated.

Green, Richard↗