Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “timing error evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Improved Stratospheric Temperature Retrievals for Climate Reanalysis

The Data Assimilation Office (DAO) is embarking on plans to generate a twenty year reanalysis data set of climatic atmospheric variables. One of the focus points will be in the evaluation of the dynamics of the stratosphere. The Stratospheric Sounding Unit (SSU), flown as part of the TIROS Operational Vertical Sounder (TOVS), is one of the primary stratospheric temperature sensors flown consistently throughout the reanalysis period. Seven unique sensors made the measurements over time, with individual instrument characteristics that need to be addressed. The stratospheric temperatures being assimilated across satellite platforms will profoundly impact the reanalysis dynamical fields. To attempt to quantify aspects of instrument and retrieval bias we are carefully collecting and analyzing all available information on the sensors, their instrument anomalies, forward model errors and retrieval biases. For the retrieval of stratospheric temperatures, we adapted the minimum variance approach of Jazwinski (1970) and Rodgers (1976) and applied it to the SSU soundings. In our algorithm, the state vector contains an initial guess of temperature from a model six hour forecast provided by the Goddard EOS Data Assimilation System (GEOS/DAS). This is combined with an a priori covariance matrix, a forward model parameterization, and specifications of instrument noise characteristics. A quasi-Newtonian iteration is used to obtain convergence of the retrieved state to the measurement vector. This algorithm also enables us to analyze and address the systematic errors associated with the unique characteristics of the cell pressures on the individual SSU instruments and the resolving power of the instruments to vertical gradients in the stratosphere. The preliminary results of the improved retrievals and their assimilation as well as baseline calculations of bias and rms error between the NESDIS operational product and col-located ground measurements will be presented.

Rokke, L.↗

High-resolution Wave Propagation Method for Stratified Flows

The implementation of the multidimensional f-waves Riemann solver for the time-dependent, three-dimensional, nonhydrostatic, meso- and microscale atmospheric flows is described in detail. The Riemann solver employs flux-based wave decomposition (f-waves) for the calculation of Godunov fluxes in which the flux differences are written directly as the linear combination of the right eigenvectors of the hyperbolic system. The scheme incorporates the source term due to gravity without introducing discretization errors which is an important property in the context of atmospheric flows. The resulting flow solver is conservative, accurate, stable, and well-balanced. The implementation of the solver is evaluated using benchmark test cases for atmospheric dynamics.

Riemann problem↗

Assessment of High Resolution Commercial Satellite Geolocation Accuracy

Commercial companies such as Maxar, PlanetScope, and BlackSky have launched many satellites with revisit times ranging from two hours to one day and have built large archives of high resolution (1-3 m) Earth observing data. The high temporal resolution and global coverage of these satellites makes commercial satellite images ideal for scientists studying rapidly changing processes such as flooding and fires. A key step in assessing changes in these images is co-registration of various images to each other. High geolocation accuracy (at most 0.5 pixels of offset) allows for easy co-registration of images across different times and sensors. Here, we assess the latest PlanetScope imagery and evaluate it for geolocation accuracy. For our assessment, we compare the target image to a reference image with known geolocation accuracy (WorldView imagery) and determine the offset between these images by shifting them to maximize their Pearson Cross-Correlation (PCC) value. Offsets required to maximize the PCC give the geolocation accuracy of the target image relative to the reference image. Previously, our global assessment of Planet data revealed large variability in geolocation accuracy from one continent to another. The measured root mean squared errors (RMSEs) range from 5.4 m in North America to 14.9 m in Africa. We have updated this previous assessment to include both their newest SuperDove series as well as a more robust assessment of the temporal stability of PlanetScope's geolocation accuracy.

Alana G. Semple↗

Quasi-stationary Planetary Scale Waves in Modern Climate Models

We evaluate climate model simulations of geopotential height at the largest space-time scales, considering the first Fourier components (in longitude) of long-term climatological means. Quasi-stationary planetary scale waves emerge from this analysis. Variations of these waves are important components of climate change, for example associated with regional drought. Systematic examination of their long-term climatology provides context for understanding their evolution in time. We compare four reanalysis datasets with “historical runs” from the latest version of the Coupled Model Intercomparison Project (CMIP) and find general agreement, but we also identify model errors outside the range of both observational uncertainty and the uncertainty implied by interannual variability. Errors in wave phase have possible implications for climate model projections of regional climate and of shifting weather patterns. One model in the set we examine, originally created nearly 20 years before the others, exhibits noticeably greater errors.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty in Thermal Modeling of Spent Nuclear Fuel Casks

Uncertainty is a key metric in computational modeling that must be evaluated for results to have wide ranging applicability. A well characterized uncertainty range is ideal with clear error bars on results that can be presented to stakeholders. In the field of spent fuel cask modeling, this ideal has been historically difficult to achieve in practice because of the computationally intensive nature of the models used and the difficulty assigning reasonable uncertainties to quantities in as-built systems. The work in this report has been conducted to evaluate the overall state of uncertainty and sensitivity in spent fuel cask models and develop methodologies for evaluating these uncertainties. These methodologies must be practical for engineering applications. They should not require excessive computational resources or calendar time to achieve results. In engineering, the model must be on a scale such that it can be changed and adapted throughout a project as new information is discovered and project goals evolve. This report covers three major modeling task areas that provide an overview of the types of sensitivity and uncertainty present in a spent fuel storage and transportation system. Section 3 discusses sensitivity and uncertainty analysis in the effective thermal conductivity model for the fuel region and applies these results to a single assembly model. Section 4 shows sensitivity analysis of a full cask model in the TN-32B and Section 5 demonstrates the overall uncertainty workflow using Coolant Boiling in Rod Arrays – Spent Fuel Storage and STAR-CCM+ developed from the sensitivity work in the preceding sections.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Navigation Sensor Technology Assessment Capability for Data-Driven Systems Analysis

The capability to assess the mission performance of novel navigation technologies from a systems-level approach and to provide quantitative results is crucial. With growing interest and innovations from NASA’s commercial partners, data-driven results that quantify the technological impact will guide research developments and facilitate stakeholder decision-making while requiring less time and resources. This paper presents a method to evaluate various sensor combinations and their impact on the overall system performance using an existing six degrees-of-freedom, physics-based engineering simulation for a government reference lunar lander as a testbed. Selected navigation technologies over various technology readiness levels, including Inertial Measurement Units, Navigation Doppler Lidar, and radar altimeter-radar velocimeter, were studied in this paper. Results using this testbed to perform sensitivity studies and to provide quantitative assessments are reported. One key finding is that there are diminishing returns for reducing sensor errors. The most influential sensor parameter to landing success are vehicle configuration and mission dependent. Results from this method could be used by stakeholders to make data-driven systems-based decisions and by technology developers as guidance for the specific parameter improvements that will have the most significant impact on mission success. This capability could be further used to assess alternative scenarios should one type of technology become unavailable or to re-assess initial assumptions and identify appropriate requirements from a system perspective.

Esther Lee↗

Evaluation of performance characteristics for a space antenna system subjected to stochastic disturbances

Control system synthesis for a large space antenna system is investigated based on stochastic linear optimal control techniques and the minimization of a quadratic Gaussian performance index. Parametric studies indicate that suitable combinations of plant and sensor noise characteristics, and state weighting matrices, can be found to meet the mission RMS pointing requirements. Using a combination of the Kalman filter and linear feedback, an optimal control law for the finite element model of the Hoop/Column structural system without damping is obtained. Removing the hoop-mounted actuator resulted in an increase in the RMS errors, an increased control effort, and an increase in the least damped modal time constant. Removing the hoop-mounted sensor resulted in an RMS error increase and estimator performance degradation, with less system RMS performance degradation than noted for removal of the hoop-mounted actuator.

Ananthakrishnan, S.↗

First Evaluation of the Climatological Calibration Algorithm in the Real-time TMPA Precipitation Estimates over Two Basins at High and Low Latitudes

The TRMM Multi-satellite Precipitation Analysis (TMPA) system underwent a crucial upgrade in early 2009 to include a climatological calibration algorithm (CCA) to its realtime product 3B42RT, and this algorithm will continue to be applied in the future Global Precipitation Measurement era constellation precipitation products. In this study, efforts are focused on the comparison and validation of the Version 6 3B42RT estimates before and after the climatological calibration is applied. The evaluation is accomplished using independent rain gauge networks located within the high-latitude Laohahe basin and the low-latitude Mishui basin, both in China. The analyses indicate the CCA can effectively reduce the systematic errors over the low-latitude Mishui basin but misrepresent the intensity distribution pattern of medium-high rain rates. This behavior could adversely affect TMPA's hydrological applications, especially for extreme events (e.g., floods and landslides). Results also show that the CCA tends to perform slightly worse, in particular, during summer and winter, over the high-latitude Laohahe basin. This is possibly due to the simplified calibration-processing scheme in the CCA that directly applies the climatological calibrators developed within 40 degrees latitude to the latitude belts of 40 degrees N-50 degrees N. Caution should therefore be exercised when using the calibrated 3B42RT for heavy rainfall-related flood forecasting (or landslide warning) over high-latitude regions, as the employment of the smooth-fill scheme in the CCA bias correction could homogenize the varying rainstorm characteristics. Finally, this study highlights that accurate detection and estimation of snow at high latitudes is still a challenging task for the future development of satellite precipitation retrievals.

TMPA-RT Precipitation Estimates↗

Feature review of photovoltaic modeling software utilizing blind performance assessment

While confidence in photovoltaic (PV) modeling software has always been essential, the rapid pace of new PV plant developments makes accuracy and credibility more critical than ever. Independent assessments, particularly through blind modeling comparisons, are therefore necessary to ensure unbiased benchmarking across PV modeling software. Previous studies have been limited by a narrow range of models compared, anonymized results, or system size. This study presents results from the first-ever onymous blind modeling comparison, evaluated using both lab- and utility-scale fixed-tilt, monofacial, south-facing systems at sub-hourly time intervals. Seven commercially used PV software tools were compared: 3E SynaptiQ, PlantPredict, PVsyst, RatedPower, SAM, SolarFarmer, and Solargis Evaluate. Predictions were submitted directly by software representatives, providing unique insights into each software’s implementation and resulting prediction behavior. Notable features, including plane-of-array (POA) transposition model, module temperature model, shading model, and performance model were analyzed and compared. Four summary tables compile these features of the software, serving as a resource to help users understand the methodological differences and select the most suitable software for their applications. The software tools show deviations from mean error in annual yield up to 2.5 % in the lab-scale system, increasing to 6.0 % for the utility-scale system. These differences arise from a combination of user decisions and the inherent behavior of the software, indicating the need for continuous and rigorous validation of modeling methods using these software tools against complex, real-world systems.

14 SOLAR ENERGY↗

Analytical noise bias correction for precise weak lensing shear inference

Noise bias is a significant source of systematic error in weak gravitational lensing measurements that must be corrected to satisfy the stringent standards of modern imaging surveys in the era of precision cosmology. This paper reviews the analytical noise bias correction method and provides analytical derivations demonstrating that we can recover shear to its second order using the ‘renoising’ noise bias correction approach introduced by METACALIBRATION. We implement this analytical noise bias correction within the AnaCal shear estimation framework and propose several enhancements to the noise bias correction algorithm. We evaluate the improved AnaCal using simulations designed to replicate Rubin Legacy Survey of Space and Time (LSST) imaging data. These simulations feature semi-realistic galaxies and stars, complete with representative distributions of magnitudes and Galactic spatial density. We conduct tests under various observational challenges, including cosmic rays, defective CCD columns, bright star saturation, bleed trails, and spatially variable point spread functions. Our results indicate a multiplicative bias in weak lensing shear recovery of less than a few tenths of a per cent, meeting LSST Dark Energy Science Collaboration requirements without requiring calibration from external image simulations. Additionally, our algorithm achieves rapid processing, handling one galaxy in less than a millisecond.

79 ASTRONOMY AND ASTROPHYSICS↗

Cartographic mapping study

The errors associated with planimetric mapping of the United States using satellite remote sensing techniques are analyzed. Assumptions concerning the state of the art achievable for satellite mapping systems and platforms in the 1995 time frame are made. An analysis of these performance parameters is made using an interactive cartographic satellite computer model, after first validating the model using LANDSAT 1 through 3 performance parameters. An investigation of current large scale (1:24,000) US National mapping techniques is made. Using the results of this investigation, and current national mapping accuracy standards, the 1995 satellite mapping system is evaluated for its ability to meet US mapping standards for planimetric and topographic mapping at scales of 1:24,000 and smaller.

Wilson, C.↗

A technique for evaluating the application of the pin-level stuck-at fault model to VLSI circuits

Accurate fault models are required to conduct the experiments defined in validation methodologies for highly reliable fault-tolerant computers (e.g., computers with a probability of failure of 10 to the -9 for a 10-hour mission). Described is a technique by which a researcher can evaluate the capability of the pin-level stuck-at fault model to simulate true error behavior symptoms in very large scale integrated (VLSI) digital circuits. The technique is based on a statistical comparison of the error behavior resulting from faults applied at the pin-level of and internal to a VLSI circuit. As an example of an application of the technique, the error behavior of a microprocessor simulation subjected to internal stuck-at faults is compared with the error behavior which results from pin-level stuck-at faults. The error behavior is characterized by the time between errors and the duration of errors. Based on this example data, the pin-level stuck-at fault model is found to deliver less than ideal performance. However, with respect to the class of faults which cause a system crash, the pin-level, stuck-at fault model is found to provide a good modeling capability.

Palumbo, Daniel L.↗

An Extended Objective Evaluation of the 29-km Eta Model for Weather Support to the United States Space Program

This report describes the Applied Meteorology Unit's objective verification of the National Centers for Environmental Prediction 29-km eta model during separate warm and cool season periods from May 1996 through January 1998. The verification of surface and upper-air point forecasts was performed at three selected stations important for 45th Weather Squadron, Spaceflight Meteorology Group, and National Weather Service, Melbourne operational weather concerns. The statistical evaluation identified model biases that may result from inadequate parameterization of physical processes. Since model biases are relatively small compared to the random error component, most of the total model error results from day-to-day variability in the forecasts and/or observations. To some extent, these nonsystematic errors reflect the variability in point observations that sample spatial and temporal scales of atmospheric phenomena that cannot be resolved by the model. On average, Meso-Eta point forecasts provide useful guidance for predicting the evolution of the larger scale environment. A more substantial challenge facing model users in real time is the discrimination of nonsystematic errors that tend to inflate the total forecast error. It is important that model users maintain awareness of ongoing model changes. Such changes are likely to modify the basic error characteristics, particularly near the surface.

Nutter, Paul↗

Modeling and Evaluating Pilot Performance in NextGen: Review of and Recommendations Regarding Pilot Modeling Efforts, Architectures, and Validation Studies

NextGen operations are associated with a variety of changes to the national airspace system (NAS) including changes to the allocation of roles and responsibilities among operators and automation, the use of new technologies and automation, additional information presented on the flight deck, and the entire concept of operations (ConOps). In the transition to NextGen airspace, aviation and air operations designers need to consider the implications of design or system changes on human performance and the potential for error. To ensure continued safety of the NAS, it will be necessary for researchers to evaluate design concepts and potential NextGen scenarios well before implementation. One approach for such evaluations is through human performance modeling. Human performance models (HPMs) provide effective tools for predicting and evaluating operator performance in systems. HPMs offer significant advantages over empirical, human-in-the-loop testing in that (1) they allow detailed analyses of systems that have not yet been built, (2) they offer great flexibility for extensive data collection, (3) they do not require experimental participants, and thus can offer cost and time savings. HPMs differ in their ability to predict performance and safety with NextGen procedures, equipment and ConOps. Models also vary in terms of how they approach human performance (e.g., some focus on cognitive processing, others focus on discrete tasks performed by a human, while others consider perceptual processes), and in terms of their associated validation efforts. The objectives of this research effort were to support the Federal Aviation Administration (FAA) in identifying HPMs that are appropriate for predicting pilot performance in NextGen operations, to provide guidance on how to evaluate the quality of different models, and to identify gaps in pilot performance modeling research, that could guide future research opportunities. This research effort is intended to help the FAA evaluate pilot modeling efforts and select the appropriate tools for future modeling efforts to predict pilot performance in NextGen operations.

pilot human performance models↗

Application of X-Ray Pulsar Navigation: A Characterization of the Earth Orbit Trade Space

The potential for pulsars as a navigation source has been studied since their discovery in 1967. X-ray pulsar navigation (XNAV) is a celestial navigation system that uses the consistent timing nature of x-ray photons from milli-second pulsars (MSP) to perform space navigation. By comparing the detected arrival of x-ray photons to a reference database of expected pulsar lightcurve timing models, one can infer a range and range rate measurement based on light time delay. Much of the challenge of XNAV comes from the faint signal, availability, and distant nature of pulsars. This is a study of potential pulsar XNAV measurements to measure extended Kalman filter (EKF) tracking performance with a wide trade space of bounded Earth orbits, using a simulation of existing x-ray detector space hardware. An example of an x-ray detector for XNAV is the NASA Station Explorer for X-ray Timing and Navigation (SEXTANT) mission, a technology demonstration of XNAV set to perform on the International Space Station (ISS) in late 2016early 2017. XNAV hardware implementation is driven by trajectory and environmental influences which add noise to the x-ray pulse signal. In a closed Earth orbit, the radiation environment can exponentially increase the signal noise from x-ray pulsar sources, decreasing the quality and frequency of measurements. The SEXTANT mission in particular improves on the signal to noise ratio by focusing an array of 56 x-ray silicon drift detectors at one pulsar target at a time. This reduces timing glitches and other timing noise contributions from ambient x-ray sources to within a 100 nanosecond resolution. This study also considers the SEXTANT scheduling challenges inherent in a single target observation. Finally, as the navigation sources are now relatively inertial targets, XNAV measurements are also subject to periods of occultation from various celestial bodies. This study focuses on the characterization of these drivers in closed Earth orbits and is not a tuning analysis of the EKF. The study shows that the closed Earth orbit for XNAV performance is reliant on the orbit semi-major axis and eccentricity as well as orbit inclination. These parameters are the primary drivers of pulsar measurement availability and significantly influence the natural spacecraft orbit dynamics. Sensitivity to initial orbit determination error growth due to the scarcity of XNAV measurements within an orbital period require appropriate timing of initial XNAV measurements. The orbit angles of argument of perigee and right ascension of the ascending node, alongside the other orbit parameters, complete the initial cadence of XNAV measurements. The performance of initial XNAV measurements then propagates throughout the experimental period. The study provides a basis to missions who wish to consider XNAV as a potential navigation source in a closed Earth orbit design. It provides a family of orbit trajectories as well as other modeling considerations needed to effectively evaluate if XNAV is an effective navigation source for a potential mission. As an EKF is sensitive to a linearized estimated state, this study has a direct benefit of providing effective XNAV measurements to maintain spacecraft tracking, independent of other navigation sources. In the particular use case of the SEXTANT mission, it also provides a novel scheduling algorithm which addresses the need to prioritize and manage pulsar observations for effective navigation.

PULSAR↗

Application of X-Ray Pulsar Navigation: A Characterization of the Earth Orbit Trade Space

The potential for pulsars as a navigation source has been studied since their discovery in 1967. X-ray pulsar navigation (XNAV) is a celestial navigation system that uses the consistent timing nature of x-ray photons from millisecond pulsars (MSP) to perform space navigation. By comparing the detected arrival of x-ray photons to a reference database of expected pulsar light-curve timing models, one can infer a range and range rate measurement based on light time delay. Much of the challenge of XNAV comes from the faint signal, availability, and distant nature of pulsars. This is a study of potential pulsar XNAV measurements to measure extended Kalman filter (EKF) tracking performance with a wide trade space of bounded Earth orbits, using a simulation of existing x-ray detector space hardware. An example of an x-ray detector for XNAV is the NASA Station Explorer for X-ray Timing and Navigation (SEXTANT) mission, a technology demonstration of XNAV set to perform on the International Space Station (ISS) in late 2016early 2017. XNAV hardware implementation is driven by trajectory and environmental influences which add noise to the x-ray pulse signal. In a closed Earth orbit, the radiation environment can exponentially increase the signal noise from x-ray pulsar sources, decreasing the quality and frequency of measurements. The SEXTANT mission in particular improves on the signal to noise ratio by focusing an array of 56 x-ray silicon drift detectors at one pulsar target at a time. This reduces timing glitches and other timing noise contributions from ambient x-ray sources to within a 100 nanosecond resolution. This study also considers the SEXTANT scheduling challenges inherent in a single target observation. Finally, as the navigation sources are now relatively inertial targets, XNAV measurements are also subject to periods of occultation from various celestial bodies. This study focuses on the characterization of these drivers in closed Earth orbits and is not a tuning analysis of the EKF. The study shows that the closed Earth orbit for XNAV performance is reliant on the orbit semi-major axis and eccentricity as well as orbit inclination. These parameters are the primary drivers of pulsar measurement availability and significantly influence the natural spacecraft orbit dynamics. Sensitivity to initial orbit determination error growth due to the scarcity of XNAV measurements within an orbital period require appropriate timing of initial XNAV measurements. The orbit angles of argument of perigee and right ascension of the ascending node, alongside the other orbit parameters, complete the initial cadence of XNAV measurements. The performance of initial XNAV measurements then propagates throughout the experimental period. The study provides a basis to missions who wish to consider XNAV as a potential navigation source in a closed Earth orbit design. It provides a family of orbit trajectories as well as other modeling considerations needed to effectively evaluate if XNAV is an effective navigation source for a potential mission. As an EKF is sensitive to a linearized estimated state, this study has a direct benefit of providing effective XNAV measurements to maintain spacecraft tracking, independent of other navigation sources. In the particular use case of the SEXTANT mission, it also provides a novel scheduling algorithm which addresses the need to prioritize and manage pulsar observations for effective navigation.

x-ray↗

Verification and validation of the NASA Terminal Configured Vehicle's /TCV/ Wind Analysis program using real-time digital simulation

NASA's Terminal Configured Vehicle (TCV) program has been established to develop and evaluate aircraft and flight management technology that will benefit conventional takeoff and landing operations in the terminal area. To this end, a process whereby estimates of longitudinal, lateral, and vertical winds are obtained using the present complement of sensors onboard the TCV aircraft (B737-100) is developed. The results of the simulation experiment to verify and validate the TCV B737 Data Merging and Wind Analysis program have shown that the wind analysis algorithms are correct and that very satisfactory estimates of all three wind components are obtained even in the presence of adverse atmospheric conditions and realistic measurement noise. In realistic worst case conditions, wind component errors of the order of + or - 2.0 knots longitudinally, + or - 0.5 knot laterally, and + or - 1.0 knot vertically are to be expected.

Dieudonne, J. E.↗

Evaluation of the SPAR thermal analyzer on the CYBER-203 computer

The use of the CYBER 203 vector computer for thermal analysis is investigated. Strengths of the CYBER 203 include the ability to perform, in vector mode using a 64 bit word, 50 million floating point operations per second (MFLOPS) for addition and subtraction, 25 MFLOPS for multiplication and 12.5 MFLOPS for division. The speed of scalar operation is comparable to that of a CDC 7600 and is some 2 to 3 times faster than Langley's CYBER 175s. The CYBER 203 has 1,048,576 64-bit words of real memory with an 80 nanosecond (nsec) access time. Memory is bit addressable and provides single error correction, double error detection (SECDED) capability. The virtual memory capability handles data in either 512 or 65,536 word pages. The machine has 256 registers with a 40 nsec access time. The weaknesses of the CYBER 203 include the amount of vector operation overhead and some data storage limitations. In vector operations there is a considerable amount of time before a single result is produced so that vector calculation speed is slower than scalar operation for short vectors.

Robinson, J. C.↗