Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error indicators”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Retrieval of Aerosol Microphysical Properties from AERONET Photo-Polarimetric Measurements. 2: A New Research Algorithm and Case Demonstration

A new research algorithm is presented here as the second part of a two-part study to retrieve aerosol microphysical properties from the multispectral and multiangular photopolarimetric measurements taken by Aerosol Robotic Network's (AERONET's) new-generation Sun photometer. The algorithm uses an advanced UNified and Linearized Vector Radiative Transfer Model and incorporates a statistical optimization approach.While the new algorithmhas heritage from AERONET operational inversion algorithm in constraining a priori and retrieval smoothness, it has two new features. First, the new algorithmretrieves the effective radius, effective variance, and total volume of aerosols associated with a continuous bimodal particle size distribution (PSD) function, while the AERONET operational algorithm retrieves aerosol volume over 22 size bins. Second, our algorithm retrieves complex refractive indices for both fine and coarsemodes,while the AERONET operational algorithm assumes a size-independent aerosol refractive index. Mode-resolved refractive indices can improve the estimate of the single-scattering albedo (SSA) for each aerosol mode and thus facilitate the validation of satellite products and chemistry transport models. We applied the algorithm to a suite of real cases over Beijing_RADI site and found that our retrievals are overall consistent with AERONET operational inversions but can offer mode-resolved refractive index and SSA with acceptable accuracy for the aerosol composed by spherical particles. Along with the retrieval using both radiance and polarization, we also performed radiance-only retrieval to demonstrate the improvements by adding polarization in the inversion. Contrast analysis indicates that with polarization, retrieval error can be reduced by over 50% in PSD parameters, 10-30% in the refractive index, and 10-40% in SSA, which is consistent with theoretical analysis presented in the companion paper of this two-part study.

aerosol retrieval algorithm↗

Mass Inferencing Model Creation and Deployment to the RASSOR Lunar Excavation Robot

The Regolith Advanced Surface Systems Operations Robot (RASSOR) Excavator is a teleoperated mobile robotic platform with a unique space regolith excavation capability. The Intelligent Capabilities Enhanced RASSOR research project developed functionality for inferencing regolith mass ingested during RASSOR operation, enhancing RASSOR’s ability to successfully complete ISRU missions. To teleoperate or run autonomously, it is crucial for the quantity of regolith mass ingested by RASSOR to be available as a system state for efficient operation. For example, during autonomous operation, RASSOR should navigate and move to a processing plant to offload the collected regolith when the drums are full; without knowledge of how much mass is in the drums, this type of high-level planning is not possible. Four distinct modeling approaches were employed in developing a mass inferencing approach that could work on RASSOR. All take in system states, such as arm/drum positions, velocities, currents, voltages, and robot pose, and output a mass prediction for each set of the robot’s bucket drums.1) A neural network model that takes a vector of normalized system states; 2) A model that uses the integrated power consumption of an arm-raise (normalized by velocity); 3) A model that uses average drum current over a variable length interval of the drum disengaged from the surface; and 4) A real-time estimation model that aggregates excavation drum current. The developed models run in real time, outputting predictions for the front and rear drums, timestamp of the last prediction, and total mass in RASSOR’s drums. Further testing is required to validate the arm-raise model (2), though initial tests indicate reasonable performance (<10% mean error) on the hardware. The linear fit of average drum-current model (3) had a front value of r^2=0.99 and a rear value of r^2=0.98 on the validation dataset. This model currently has the best performance on unseen data. The real time model (4) is still in development, though initial results on a small subset of the training data show that it has high accuracy in predicting the increase in mass during excavation. Though work remains to be done with deploying a high-fidelity model to the physical system that makes predictions with error below the desired threshold, the modular architecture for model development allows quick adjustment of parameters to increase model fidelity. This architecture can also be adapted to use lunar excavation data to create models that are reflective of RASSOR’s dynamics when operating on the lunar surface. The results are promising as it has been shown that models can be developed that accurately estimate excavated regolith mass.

rassor↗

Model reduction for fractured porous media: a machine learning approach for identifying main flow pathways

Discrete fracture networks (DFN) are often used to model flow and transport in fractured porous media. The accurate resolution of flow and transport behavior on a large DFN involving thousands of fractures is computationally expensive. This makes uncertainty quantification studies of quantities of interest such as travel time through the network computationally intractable, since hundreds to thousands of runs of the DFN model are required to get bounds on the uncertainty of the predictions. Prior works on the subject demonstrated that the complexity of a DFN could be reduced by considering a sub-network of it (often termed a “backbone” sub-network), one whose flow and transport properties were then shown to be similar to that of the full network. The technique is tantamount to partitioning the complete set of fractures of a network into two disjoint sets, one of which is the backbone sub-network while the other its complement. It is in this context that we present a system-reduction technique for DFNs using supervised machine learning via a Random Forest Classifier that selects a backbone sub-network from the full set of fractures. The in-sample errors (in terms of precision and recall scores) of the trained classifier are found to be very accurate indicators of the out-of-sample errors, thus exhibiting that the classifier generalizes well to test data. Moreover, this system-reduction technique yields sub-networks as small as 12% of the full DFN that still recover transport characteristics of the full network such as the peak dosage and tailing behavior for late times. Most importantly, the sub-networks remain connected, and their size can be controlled by a single dimensionless parameter. Furthermore, measures of KL-divergence and KS-statistic for the breakthrough curves of the sub-networks with respect to the full network show physically realistic trends in that the measures decrease monotonically as the size of the sub-networks increase. In conclusion, the computational efficiency gained by this technique depends on the size of the sub-network, but large reductions in computational time can be expected for small sub-networks, yielding as much as 90% computational savings for sub-networks that are as small as 10-12% of the full network.

97 MATHEMATICS AND COMPUTING↗

Semi-Analytic Functions to Calculate the Deposition Coefficients for Ice Crystal Vapor Growth in Bin and Bulk Microphysical Models

Numerical cloud models require estimates of the vapor growth rate for ice crystals. Current bulk and bin microphysical parameterizations generally assume that vapor growth is diffusion limited, though some parameterizations include the influence of surface attachment kinetics through a constant deposition coefficient. A parameterization for variable deposition coefficients is provided herein. The parameterization is an explicit function of the ambient ice supersaturation and temperature, and an implicit function of crystal dimensions and pressure. The parameterization is valid for variable surface types including growth by dislocations and growth by step nucleation. Deposition coefficients are predicted for the two primary growth directions of crystals, allowing for the evolution of the primary habits. Comparisons with benchmark calculations of instantaneous mass growth indicate that the parameterization is accurate to within a relative error of 1%. Parcel model simulations using Lagrangian microphysics as a benchmark indicate that the bulk parameterization captures the evolution of mass mixing ratio and fall speed with typical relative errors of less than 10%, whereas the average axis lengths can have errors of up to 20%. The bin model produces greater accuracy with relative errors often less that 10%. The deposition coefficient parameterization can be used in any bulk and bin scheme, with low error, if an equivalent volume spherical radius is provided.

54 ENVIRONMENTAL SCIENCES↗

The Hubble Space Telescope optical systems failure report

The findings of the Hubble Space Telescope Optical Systems Board of Investigation are reported. The Board was formed to determine the cause of the flaw in the telescope, how it occurred, and why it was not detected before launch. The Board conducted its investigation to include interviews with personnel involved in the fabrication and test of the telescope, review of documentation, and analysis and test of the equipment used in the fabrication of the telescope's mirrors. The investigation proved that the primary mirror was made in the wrong shape (a 0.4-wave rms wavefront error at 632.8 nm). The primary mirror was manufactured by the Perkin-Elmer Corporation (Hughes Danbury Optical Systems, Inc.). The critical optics used as a template in shaping the mirror, the reflective null corrector (RNC), consisted of two small mirrors and a lens. This unit had been preserved by the manufacturer exactly as it was during the manufacture of the mirror. When the Board measured the RNC, the lens was incorrectly spaced from the mirrors. Calculations of the effect of such displacement on the primary mirror show that the measured amount, 1.3 mm, accounts in detail for the amount and character of the observed image blurring. No verification of the reflective null corrector's dimensions was carried out by Perkin-Elmer after the original assembly. There were, however, clear indications of the problem from auxiliary optical tests made at the time. A special optical unit called an inverse null corrector, designed to mimic the reflection from a perfect primary mirror, was built and used to align the apparatus; when so used, it clearly showed the error in the reflective null corrector. A second null corrector was used to measure the vertex radius of the finished primary mirror. It, too, clearly showed the error in the primary mirror. Both indicators of error were discounted at the time as being themselves flawed. The Perkin-Elmer plan for fabricating the primary mirror placed complete reliance on the reflective null corrector as the only test to be used in both manufacturing and verifying the mirror's surface with the required precision. This methodology should have alerted NASA management to the fragility of the process and the possibility of gross error. Such errors had been seen in other telescope programs, yet no independent tests were planned, although some simple tests to protect against major error were considered and rejected. During the critical time period, there was great concern about cost and schedule, which further inhibited consideration of independent tests.

Source record↗

Study of effects of uncertainties on comet and asteroid encounter and contact guidance requirements. Part 1: Guidance and navigation studies

A guidance algorithm that provides precise rendezvous in the deterministic case while requiring only relative state information is developed. A navigation scheme employing only onboard relative measurements is built around a Kalman filter set in measurement coordinates. The overall guidance and navigation procedure is evaluated in the face of measurement errors by a detailed numerical simulation. Results indicate that onboard guidance and navigation for the terminal phase of rendezvous is possible with reasonable limits on measurement errors.

Source record↗

Solar electric propulsion for terminal flight to rendezvous with comets and asteroids

A guidance algorithm that provides precise rendezvous in the deterministic case while requiring only relative state information is developed. A navigation scheme employing only onboard relative measurements is built around a Kalman filter set in measurement coordinates. The overall guidance and navigation procedure is evaluated in the face of measurement errors by a detailed numerical simulation. Results indicate that onboard guidance and navigation for the terminal phase of rendezvous is possible with reasonable limits on measurement errors.

Bennett, A.↗

Improving Modeled Snow Mass in GEOS with Snow Cover Fraction Assimilation

The NASA Goddard Earth Observing System (GEOS) Forward Processing (FP) global weather analysis often considerably underestimates near-surface air temperature during the spring snow melt season, which can be caused by excessive simulated snow cover. To mitigate such errors, we developed an empirical snow cover fraction (SCF) analysis to assimilate SCF observations from the Moderate Resolution Imaging Spectroradiometer (MODIS) into the GEOS Catchment land surface model. Results obtained with a land-only version of the system indicate that the SCF analysis reduces errors in snow mass and snow depth by ~10% when compared to in situ measurements from the Snow Telemetry (SNOTEL), Canadian historical Snow Water Equivalent dataset (CanSWE), and Global Historical Climatology Network - Daily (GHCN-Daily) networks.

Rolf Reichle↗

Updated dispersion analysis for the first Orbital Flight Test (OFT-1) mission

A dispersion analysis considering 3-sigma uncertainties (or perturbations) in platform, vehicle, and environmental parameters was performed for the first orbital flight test (OFT-1) mission. The dispersion analysis is based on the nominal trajectory for the OFT-1 reference flight profile and was performed to determine state vector and performance dispersions (or variations) which result from the indicated 3 sigma uncertainties. The dispersions are determined at major mission events and fixed times from liftoff (time slices). Principal error contributors to the covariance matrix are listed. The dispersion data indicates that the largest position error occurs in the down range component. At main engine cutoff and circularization, the vehicle performance uncertainties are the major contributors to down range error.

Snow, L. S.↗

LISA Parameter Estimation using Numerical Merger Waveforms

Coalescing supermassive black holes are expected to provide the strongest sources for gravitational radiation detected by LISA. Recent advances in numerical relativity provide a detailed description of the waveforms of such signals. We present a preliminary study of LISA's sensitivity to waveform parameters using a hybrid numerical/analytic waveform describing the coalescence of two equal-mass, nonspinning black holes. The Synthetic LISA software package is used to simulate the instrument response and the Fisher information matrix method is used to estimate errors in the waveform parameters. Initial results indicate that inclusion of the merger signal can significantly improve the precision of some parameter estimates. For example, the median parameter errors for an ensemble of systems with total redshifted mass of 10(exp 6) deg M solar mass at a redshift of z is approximately 1 were found to decrease by a factor of slightly more than two when the merger was included.

Thorpe, J. I.↗

On the appropriateness of applying chi-square distribution based confidence intervals to spectral estimates of helicopter flyover data

The validity of applying chi-square based confidence intervals to far-field acoustic flyover spectral estimates was investigated. Simulated data, using a Kendall series and experimental acoustic data from the NASA/McDonnell Douglas 500E acoustics test, were analyzed. Statistical significance tests to determine the equality of distributions of the simulated and experimental data relative to theoretical chi-square distributions were performed. Bias and uncertainty errors associated with the spectral estimates were easily identified from the data sets. A model relating the uncertainty and bias errors to the estimates resulted, which aided in determining the appropriateness of the chi-square distribution based confidence intervals. Such confidence intervals were appropriate for nontonally associated frequencies of the experimental data but were inappropriate for tonally associated estimate distributions. The appropriateness at the tonally associated frequencies was indicated by the presence of bias error and noncomformity of the distributions to the theoretical chi-square distribution. A technique for determining appropriate confidence intervals at the tonally associated frequencies was suggested.

Rutledge, Charles K.↗

Thermal-distortion analysis of a spacecraft box truss in geostationary orbit

The Mission to Planet Earth enlists the use of a geostationary platform to support Earth science monitoring instruments. The strongback for a proposed geostationary platform is a deployable box truss that supports two large diameter passive microwave radiometer (PMR) and several other science instruments. A study was performed to estimate the north-south and east-west pointing errors at the mounting locations of the two PMRs due to on-orbit thermal distortions of the main truss. The baseline configuration indicated that the east-west pointing error greatly exceeded the required limits. Primary origins of the pointing errors were identified, and methods for their reduction were discussed. Thermal performance enhancements to the truss structure were modeled and analyzed, including state-of-the-art surface coatings and insulation techniques. Comparisons of the thermal enhancements to the baseline were performed. Results demonstrated that using a thermal enclosure insulating technique reduced external heat fluxes, and distributed those heat fluxes more evenly throughout the structure, sufficiently reducing the pointing error to satisfy pointing accuracy requirements for the PMR's.

Cosgrove, Patrick A.↗

Assessment of the Impact of Realistic Sensor Physics and the Integration of Ex-Core Sensors on Reactor Power Synthesis

In the work documented in this report, a weighting function–based core power synthesis method was applied to multiple Monte Carlo N-Particle (MCNP) reactor models, which are informed based on simulated self-powered neutron detector (SPND) responses. The weighting function method used has been coined the point-based iterative (PBI) method. The goal of this application is to assess the impact of considering realistic sensor physics in the generation of the simulated SPND outputs as well as to consider how the synthesis is impacted based on the inclusion of ex-core detectors in the model. The NuScale small modular reactor (SMR) and Westinghouse AP1000 pressurized water reactor (PWR) are the models that served as the testbeds for the assessment of realistic sensor physics; this was achieved by using Geant4 SPND models in comparison with analytical models, such that the effect of electron transport in realistic SPND geometries in the Geant4 model can be understood in terms of synthesis error and convergence time. The comparison was considered for fuel burnup–induced perturbations, for a range of sensor string densities and synthesized power distribution axial fidelities. The Texas A&M Testing, Research, Isotopes, General Atomics Reactor (TAMU TRIGA) reactor MCNP model was used to assess the impact of ex-core sensors; this was done by performing synthesis with and without the ex-core detectors and by quantifying the synthesis error and number of iterations associated with Gaussian-type perturbations in many locations in the core. The TAMU TRIGA model was particularly pertinent for this study because of the interest in future experimental tests with SPNDs in this reactor, as well as the ease of modifying the MCNP model to include ex-core detectors with heterogeneously described response functions. Results from the comparison between the Geant4 and analytical SPND models indicate that similar average and maximum synthesis errors were obtained for burnup-induced perturbations in both the NuScale SMR and the AP1000. This was true for a range of sensor string densities and axial fidelities. However, there were marked differences between both the Geant4 and analytically informed models in terms of the iterations required to converge on the synthesized power distribution. Namely, the Geant4-informed models tended to lead to fewer iterations, except for a few sensor–core configurations that had particularly numerous iterations. Results from the ex-core sensor assessment with the TAMU TRIGA model indicate that the inclusion of ex-core sensors drastically reduces the synthesis error of Gaussian-type perturbations close to the edge of the core, and it slightly reduces synthesis errors for perturbations closer to the center of the core. This was achieved with a minimal increase in computational cost—that is, the number of iterations required for convergence. The errors were identified to be in the same location as the perturbation in the core, indicating that the methodology remains robust for unperturbed regions of the core. A secondary result from this study with the TAMU TRIGA was yielded by analysis of the neutron flux levels in the in-core and ex-core sensor locations of the core; these flux levels indicate that SPNDs could be used as both in-core and ex-core sensors, so long as the emitter material is sensitive to thermal neutrons. The results from these studies provide a quantitative understanding of the importance of considering realistic sensor physics and including ex-core sensors to perform accurate and timely power distribution synthesis of a reactor core.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Optical guidance vidicon test program

A laboratory and field test program was conducted to quantify the optical navigation parameters of the Mariner vidicons. A scene simulator and a camera were designed and built for vidicon tests under a wide variety of conditions. Laboratory tests characterized error sources important to the optical navigation process and field tests verified star sensitivity and characterized comet optical guidance parameters. The equipment, tests and data reduction techniques used are described. Key test results are listed. A substantial increase in the understanding of the use of selenium vidicons as detectors for spacecraft optical guidance was achieved, indicating a reduction in residual offset errors by a factor of two to four to the single pixel level.

Eiseman, A. R.↗

A general aviation simulator evaluation of a rate-enhanced instrument landing system display

A piloted-simulation study was conducted to evaluate the effect on instrument landing system tracking performance of integrating localizer-error rate with raw localizer and glide-slope error. The display was named the pseudocommand tracking indicator (PCTI) because it provides an indication of the change of heading required to track the localizer center line. Eight instrument-rated pilots each flew five instrument approaches with the PCTI and five instrument approaches with a conventional course deviation indicator. The results show good overall pilot acceptance of the display, a significant improvement in localizer tracking error, and no significant changes in glide-slope tracking error or pilot workload.

Hinton, D. A.↗

Dose Error Correction Using Simulation Extrapolation for Community Noise Dose-Response Modeling

The objective of this work is to provide a framework to account and correct for dose error in dose-response modeling due to measurement uncertainty. Error in noise measurements, especially in the case of limited monitoring locations in a community, can lead to an attenuation or misestimation of parameters in dose-response models. This error can result in overpredicted annoyance at lower doses and underpredicted annoyance at higher doses. Simulated data in the present work are based on previous NASA community studies and incorporate a notional design for future studies with the X-59 aircraft. Several populations of different annoyance response sensitivities are included. Simulation extrapolation (SIMEX, Cook and Stefanski 1994) is used to correct for the dose error in a simple, fully pooled logistic regression. Results indicate the negative impact of attenuation is greatly diminished for all amounts of dose error considered, regardless of a population’s annoyance sensitivity. Therefore, SIMEX can help produce a more accurate dose-response relationship.

SIMEX↗

Enter Gaussian Mixture Modeling Extensions for Improved False Discovery Rate Estimation in GC-MS Metabolomics

Identifying small molecules (e.g., metabolites) is key towards driving scientific advancement in metabolomics, and gas chromatography–mass spectrometry (GC-MS) is an analytic method that may be applied to facilitate this process. The typical GC-MS identification workflow involves quantifying the similarity of an observed sample spectrum and other features (e.g. retention index) to that of several references, noting the compound of the best-matching reference spectrum as the identified metabolite. While a deluge of similarity metrics exists, none characterize the error rate of generated identifications, thereby presenting an unknown risk of false identification or discovery. To quantify this unknown risk, we propose a model-based framework for estimating the false discovery rate (FDR) among a set of identifications. Extending the traditional mixture modeling framework, our method incorporates both similarity score and experimental information in estimating the FDR. We apply these models to identification lists derived from across 548 samples of varying complexity and sample type (e.g., fungal species, standard mixtures, etc.), comparing their performance to that of the traditional Gaussian mixture model (GMM). Through simulation, we additionally assess the impact of reference library size on the accuracy of FDR estimates. In comparing the best performing model extensions to the GMM, our results indicate relative decreases in median absolute estimation error (MAE) ranging from 12% to 70%, based on comparisons of the median MAEs across all hit-lists. Results indicate that these relative performance improvements generally hold despite library size, however FDR estimation error typically worsens as the set of reference compounds diminishes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Performance of Thermal Mass Flow Meters in a Variable Gravitational Environment

The performance of five thermal mass flow meters, MKS Instruments 179A and 258C, Unit Instruments UFM-8100, Sierra Instruments 830L, and Hastings Instruments HFM-200, were tested on the KC-135 Reduced Gravity Aircraft in orthogonal, coparallel, and counterparallel orientations relative to gravity. Data was taken throughout the parabolic trajectory where the g-level varied from 0.01 to 1.8 times normal gravity. Each meter was calibrated in normal gravity in the orthogonal position prior to flight followed by ground testing at seven different flow conditions to establish a baseline operation. During the tests, the actual flow rate was measured independently using choked-flow orifices. Gravitational acceleration and attitude had a unique effect on the performance of each meter. All meters operated within acceptable limits at all gravity levels in the calibrated orthogonal position. However, when operated in other orientations, the deviations from the reference flow became substantial for several of the flow meters. Data analysis indicated that the greatest source of error was the effect of orientation, followed by the gravity level. This work emphasized that when operating thermal flow meters in a variable gravity environment, it is critical to orient the meter in the same direction relative to gravity in which it was calibrated. Unfortunately, there was no test in normal gravity that could predict the performance of a meter in reduced gravity. When operating in reduced gravity, all meters indicated within 5 percent of the full scale reading at all flow conditions and orientations.

Brooker, John E.↗