Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Loss factors associated with spatial and temporal tracking errors in intersatellite PPM communication links

The performance of an optical PPM intersatellite link in the presence of spatial and temporal tracking errors is investigated. It is shown that for a given rms spatial tracking error, an optimal transmitter beamwidth exists which minimizes the probability of bit error. The power penalty associated with the spatial tracking error when the transmitter beamwidth is adjusted to achieve optimal performance is shown to be large (greater than 9 dB) when the rms pointing jitter becomes a significant fraction (greater than 30 percent) of the diffraction limited beamwidth. The power penalty due to temporal tracking error, on the other hand, is relatively small (less than 0.1 dB) when the tracking loop bandwidth is less than 0.1 percent of the slot frequency. By properly allocating losses to spatial and temporal tracking errors, it is seen that a 10 to the -9th error rate can be achieved for a realistic link design with an approximately 3 dB signal power margin.

Chen, C. C.↗

Leveraging Human Performance Data to Change the Narrative that People are the Safety Problem

The study of errors and failure has a long and productive history in the behavioral sciences. By studying how systems fail, we rule out various mechanisms for how those systems might work, thereby refining our theories of how they actually work. Human performance, however, includes more than errors; human performance comprises both failures and successes. A systematic bias to collect and analyze data only on error affects the decisions we make as a community by promoting the narrative that “people are the safety problem.” This narrative manifests in both obvious and subtle ways in the design of systems intended for human use. When the only safety data that are available are about human failure, then “data-driven” designs can only consider that humans fail. Changing this narrative will depend on new data and new ways to examine data – specifically, data on the processes by which human create and contribute to safety. An alternate narrative is that people represent a primary source of safety, through their capability to anticipate, monitor for, respond to, and learn from expected and unexpected change. This presentation will describe research efforts to expand the range of safety-relevant events to include not just rare safety failures but frequent safety successes. These efforts include use of data from both operations and simulations to develop methods and metrics for learning from structured observation, self-report, and system data.

Jon Holbrook↗

TRMM On-Orbit Performance Reassessed After Control Change

The Tropical Rainfall Measuring Mission (TRMM) spacecraft, a joint mission between the U.S. and Japan, launched onboard an H-I1 rocket on November 27, 1997, and transitioned in August, 2001, from an average operating altitude of 350 kilometers to 402.5 kilometers. Due to problems using the Earth Sensor Assembly (ESA) at the higher altitude, TRMM switched to a backup attitude control mode. Prior to the orbit boost TRMM controlled pitch and roll to the local vertical using ESA measurements while using gyro data to propagate yaw attitude between yaw updates from the Sun sensors. After the orbit boost, a Kalman filter used 3-axis gyro data with Sun sensor and magnetometers to estimate onboard attitude. While originally intended to meet a degraded attitude accuracy of 0.7 degrees, the new control mode met the original 0.2 degree attitude accuracy requirement after improving onboard ephemeris prediction and adjusting the magnetometer calibration onboard. Independent roll attitude checks using a science instrument, the Precipitation Radar (PR) which was built in Japan, provided a novel insight into the pointing performance. The PR data helped identify the pointing errors after the orbit boost, track the performance improvements, and show subtle effects from ephemeris errors and gyro bias errors. It also helped identify average bias trends throughout the mission. Roll errors tracked by the PR from sample orbits pre-boost and post-boost are shown in Figure 1. Prior to the orbit boost, the largest attitude errors were due to occasional interference in the ESA. These errors were sometime larger than 0.2 degrees in pitch and roll, but usually less, as estimated from a comprehensive review of the attitude excursions using gyro data. Sudden jumps in the onboard roll show up as spikes in the reported attitude since the control responds within tens of seconds to null the pointing error. The PR estimated roll tracks well with an estimate of the roll history propagated using gyro data. After the orbit boost, the attitude errors shown by the PR roll have a smooth sine-wave type signal because of the way that attitude errors propagate with the use of gyro data. Yaw errors couple at orbit period to roll with 1/4 orbit lag. By tracking the amplitude, phase, and bias of the sinusoidal PR roll error signal, it was shown that the average pitch rotation axis tends to be offset from orbit normal in a direction perpendicular to the Sun direction, as shown in Figure 2 for a 200 day period following the orbit boost. This is a result of the higher accuracy and stability of the Sun sensor measurements relative to the magnetometer measurements used in the Kalman filter. In November, 2001 a magnetometer calibration adjustment was uploaded which improved the pointing performance, keeping the roll and yaw amplitudes within about 0.1 degrees.

Bilanow, Stephen↗

Subjective rating scales as a workload

A multidimensional bipolar-adjective rating scale is employed as a subjective measure of operator workload in the performance of a one-axis tracking task. The rating scale addressed several dimensions of workload, including cognitive, physical, and perceptual task loading as well as fatigue and stress effects. Eight subjects performed a one-axis tracking task (with six levels of difficulty) and rated these tasks on several workload dimensions. Performance measures were tracking error RMS (root-mean square) and the standard deviation of control stick output. Significant relationships were observed between these performance measures and skill required, task complexity, attention level, task difficulty, task demands, and stress level.

Bird, K. L.↗

Validation of Subhourly Clipping Loss Error Corrections: Preprint

Under-performance of solar PV systems is an important issue that increases risks for stakeholders, including developers, investors and operators. Recently some attention has focused on underestimation of inverter clipping losses as a possible source of over-prediction where sub-hourly solar variability is high. Several models and data sets have been analyzed over the past few years, with the aim of quantifying, predicting, and correcting underestimated clipping loss errors for systems with high DC/AC ratio and solar variability. In this research, we apply a machine learning model developed at NREL to two physical PV systems, to correct for subhourly clipping losses. For each system, we compare overall AC power output for the model taken at 1-minute intervals to AC power output taken at 1-hour intervals with the addition of the subhourly clipping correction. Our findings consistently show that the addition of the clipping loss correction lead to a reduction in mean bias error of 0.6\% and 1.1\% for systems A and B, respectively, with no additional filtering applied. When examining high solar variability periods where clipping is more pronounced, system A and B experienced a 1.4\% and 2.5\% reduction in mean bias error, respectively, when the clipping correction was applied.

machine learning↗

Altitude deviations: Breakdowns of an error-tolerant system

Pilot reports of aviation incidents to the Aviation Safety Reporting System (ASRS) provide a window on the problems occurring in today's airline cockpits. The narratives of 10 pilot reports of errors made in the automation-assisted altitude-change task are used to illustrate some of the issues of pilots interacting with automatic systems. These narratives are then used to construct a description of the cockpit as an information processing system. The analysis concentrates on the error-tolerant properties of the system and on how breakdowns can occasionally occur. An error-tolerant system can detect and correct its internal processing errors. The cockpit system consists of two or three pilots supported by autoflight, flight-management, and alerting systems. These humans and machines have distributed access to clearance information and perform redundant processing of information. Errors can be detected as deviations from either expected behavior or as deviations from expected information. Breakdowns in this system can occur when the checking and cross-checking tasks that give the system its error-tolerant properties are not performed because of distractions or other task demands. Recommendations based on the analysis for improving the error tolerance of the cockpit system are given.

Palmer, Everett A.↗

Handling Trajectory Uncertainties for Airborne Conflict Management

Airborne conflict management is an enabling capability for NASA's Distributed Air-Ground Traffic Management (DAG-TM) concept. DAGTM has the goal of significantly increasing capacity within the National Airspace System, while maintaining or improving safety. Under DAG-TM, autonomous aircraft maintain separation from each other and from managed aircraft unequipped for autonomous flight. NASA Langley Research Center has developed the Autonomous Operations Planner (AOP), an onboard decision support system that provides airborne conflict management (ACM) and strategic flight planning support for autonomous aircraft pilots. The AOP performs conflict detection, prevention, and resolution from nearby traffic aircraft and area hazards. Traffic trajectory information is assumed to be provided by Automatic Dependent Surveillance Broadcast (ADS-B). Reliable trajectory prediction is a key capability for providing effective ACM functions. Trajectory uncertainties due to environmental effects, differences in aircraft systems and performance, and unknown intent information lead to prediction errors that can adversely affect AOP performance. To accommodate these uncertainties, the AOP has been enhanced to create cross-track, vertical, and along-track buffers along the predicted trajectories of both ownship and traffic aircraft. These buffers will be structured based on prediction errors noted from previous simulations such as a recent Joint Experiment between NASA Ames and Langley Research Centers and from other outside studies. Currently defined ADS-B parameters related to navigation capability, trajectory type, and path conformance will be used to support the algorithms that generate the buffers.

Barhydt, Richard↗

Development of a wideband pulse quaternary modulation system

Laboratory data verifying the pulse quaternary modulation (PQM) theoretical predictions is presented. The first laboratory PQM laser communication system was successfully fabricated, integrated, tested and demonstrated. System bit error rate tests were performed and, in general, indicated approximately a 2 db degradation from the theoretically predicted results. These tests indicated that no gross errors were made in the initial theoretical analysis of PQM. The relative ease with which the entire PQM laboratory system was integrated and tested indicates that PQM is a viable candidate modulation scheme for an operational 400 Mbps baseband laser communication system.

Federhofer, J. A.↗

Modeling error analysis of stationary linear discrete-time filters

The performance of Kalman-type, linear, discrete-time filters in the presence of modeling errors is considered. The discussion is limited to stationary performance, and bounds are obtained for the performance index, the mean-squared error of estimates for suboptimal and optimal (Kalman) filters. The computation of these bounds requires information on only the model matrices and the range of errors for these matrices. Consequently, a design can easily compare the performance of a suboptimal filter with that of the optimal filter, when only the range of errors in the elements of the model matrices is available.

Patel, R.↗

Manual Crew Override of Vehicle Landings Following G-Transitions

BACKGROUND Manual control during exploration spaceflight consists of both planned automated supervisory control and unplanned crew override. This crew override capability is critical to enable overall mission success during landing contingencies. However, the introduction of manual override capabilities must be implemented to enable crews to mitigate risks introduced by human error. Adaptive changes in the sensorimotor system can manifest during g-transitions as spatial disorientation. While training and landing aids enable successful landing through disorientation, these adaptive changes may increase cognitive demand that needs to be accounted for in the manual control strategy. It is important to characterize these effects as soon as possible following the G-transition to develop appropriate countermeasures. METHODS The following study seeks to inform the risk associated with altered sensorimotor and vestibular function impacting critical mission tasks. We aim to characterize the effects of short and long-duration weightlessness on manual control following G-transitions using simulated lunar landing on a six-degree-of-freedom (6DOF) motion base, a fixed base simulation, and a supervisory control tablet task. The primary goal is to understand the impact of spaceflight on crew ability to perform manual crew override and supervisory control. This aim will be assessed by comparing pre- versus postflight simulation performance in crewmembers assigned to either short duration (< 30 day) or long duration (~6- month) missions to the International Space Station (ISS). We hypothesize there will be postflight increases in the percent time that pilots are outside of the acceptable range for recommended vehicle state parameters and the reaction time for secondary cognitive tasks. Ground-based control subjects, who are demographically matched to the crew considering age (± 5 years) and gender, will undergo the same testing schedule as the crew to examine the effects of flight phase independent of microgravity exposure. The second aim is to examine how adaptive changes in vestibular and cognitive function relate to changes in manual crew override proficiency. Crew performance for a sensorimotor perceptual test battery will evaluate motion perception tracking, roll nulling, and/or vection sensitivity using the 6DOF motion base. We hypothesize that a higher severity of vestibular alterations will be associated with increased percent time outside of guidance limits. Motion sickness severity and sleepiness will also be evaluated. To determine the impact of “just-in-time” training, the third aim seeks to compare performance during on-board lunar landing tasks conducted late in-flight to early postflight. We hypothesize that proficiency on the “just-in-time” laptop trainer late in mission will be positively correlated with early postflight proficiency on the same task. The final aim will establish assessments of performance, training protocols, and the learning progression in a ground-control cohort of first-time users. RESULTS The assessment of the learning progression associated with the piloting task on the motion base system with thirty ground subjects will be reported. Learning curves will be established across four distinct sessions and within session considering trial difficulty. The difficulty of the landing task can be modulated with the landing divert distance and cross or downrange difficulty. Results may include changes in performance across multiple trials of a multi-attribute lunar tablet supervisory control task. Preliminary investigations of eighteen subjects who completed vestibular threshold and motion perception tasks offer expected performance ranges for upcoming preflight crew evaluations. The results yielded an average roll threshold of 0.46 ± 0.30 deg/s and an average roll nulling root mean square error performance of 2.52 ± 0.52 deg/s. RELEVANCE This project will deliver an operational demonstration of crew monitoring capability following spaceflight and identify potential deficits that may require remediation. Comparison of individual vestibular and cognitive changes with crew performance will help better characterize the manual control risks associated with sensorimotor alterations. Ground testing will evaluate learning progression, refine training protocols, and serve as a control cohort for comparisons to crew performance. ACKNOWLEDGEMENTS: The authors acknowledge contributions from Draper, the Dynamic Skills Trainer (DST) Lab, and the Software, Robotics, and Simulation Division toward the development of the lunar landing simulation platforms. This project is funded by the Human Health Countermeasures Element.

Hannah M. Weiss↗

Alternate Methods of Model Reduction to Avoid Dynamic Modal Truncation Error

Loads analysis is traditionally performed using dynamically reduced models, which provides the benefit to reduce run time. If the reduced model frequency cutoff is not chosen appropriately, the model will lack the dynamic content required to fully represent the response of the non-reduced model. Standard guidance for reduced model frequency content, provided in NASA-STD-5002, is to solve fixed base modes up to a minimum of 1.5x the model frequency content of interest and to employ static modal truncation methods such as residual vectors, the mode acceleration method, and the residual flexibility method to account for the truncated flexibility of the missing modes. Fixed base modes require the selection of a set of degrees of freedom to be constrained which, if not properly selected, may affect the accuracy of the reduced model by excluding some of the dynamic characteristic of the full model. In this case, the standard NASA guidance would be insufficient, but it may not be readily apparent that a portion of the reduced model response is missing. This error was encountered during an independent verification and validation (IV&V) effort, where it was observed that the resulting dynamic response was lower than the inline analysis. In this specific case, despite following the standard NASA model reduction guidelines in the selection of the frequency cutoff, the inline model still did not fully capture the necessary dynamic content. As part of the IV&V, an alternate reduction methodology was employed using an unconstrained mode acceleration method. The original model initially performed a constrained reduction to twice the frequency content of interest before doing a free-free run, employing the mode acceleration method to account for the truncated modes. In contrast in the IV&V, the unconstrained model reduced directly to the needed frequency content of the free-free run, avoiding any interactions between constraints and dynamic content. To verify the model, the original reduction methodology was used to generate a series of Hurty-Craig-Bampton reductions, each with a higher frequency cutoff than the previous. The results were shown to converge once the frequency cutoff increased past eight times the frequency content of interest. At the same frequency cutoff, the results of the Hurty-Craig-Bampton model converged with the results of the unconstrained mode acceleration model. This comparative study provided confidence that the results of the unconstrained modal acceleration reduced model were correct and that the Hurty-Craig-Bampton needed to increase its frequency cutoff to fully capture the dynamic response.

Erin Simmons↗

Alternate Methods of Model Reduction to Avoid Dynamic Modal Truncation Error

Loads analysis is traditionally performed using dynamically reduced models, which provides the benefit to reduce run time. If the reduced model frequency cutoff is not chosen appropriately, the model will lack the dynamic content required to fully represent the response of the non-reduced model. Standard guidance for reduced model frequency content, provided in NASA-STD-5002, is to solve fixed base modes up to a minimum of 1.5x the model frequency content of interest and to employ static modal truncation methods such as residual vectors, the mode acceleration method, and the residual flexibility method to account for the truncated flexibility of the missing modes. Fixed base modes require the selection of a set of degrees of freedom to be constrained which, if not properly selected, may affect the accuracy of the reduced model by excluding some of the dynamic characteristic of the full model. In this case, the standard NASA guidance would be insufficient, but it may not be readily apparent that a portion of the reduced model response is missing. This error was encountered during an independent verification and validation (IV&V) effort, where it was observed that the resulting dynamic response was lower than the inline analysis. In this specific case, despite following the standard NASA model reduction guidelines in the selection of the frequency cutoff, the inline model still did not fully capture the necessary dynamic content. As part of the IV&V, an alternate reduction methodology was employed using an unconstrained mode acceleration method. The original model initially performed a constrained reduction to twice the frequency content of interest before doing a free-free run, employing the mode acceleration method to account for the truncated modes. In contrast in the IV&V, the unconstrained model reduced directly to the needed frequency content of the free-free run, avoiding any interactions between constraints and dynamic content. To verify the model, the original reduction methodology was used to generate a series of Hurty-Craig-Bampton reductions, each with a higher frequency cutoff than the previous. The results were shown to converge once the frequency cutoff increased past eight times the frequency content of interest. At the same frequency cutoff, the results of the Hurty-Craig-Bampton model converged with the results of the unconstrained mode acceleration model. This comparative study provided confidence that the results of the unconstrained modal acceleration reduced model were correct and that the Hurty-Craig-Bampton needed to increase its frequency cutoff to fully capture the dynamic response.

Erin Simmons↗

How well do one-electron self-interaction-correction methods perform for systems with fractional electrons?

Recently developed locally scaled self-interaction correction (LSIC) is a one-electron SIC method that, when used with a ratio of kinetic energy densities (z σ ) as iso-orbital indicator, performs remarkably well for both thermochemical properties as well as for barrier heights overcoming the paradoxical behavior of the well-known Perdew–Zunger self-interaction correction (PZSIC) method. In this work, we examine how well the LSIC method performs for the delocalization error. Our results show that both LSIC and PZSIC methods correctly describe the dissociation of $H$$^{+}_{2}$ and $H$$^{+}_{2}$ but LSIC is overall more accurate than the PZSIC method. Likewise, in the case of the vertical ionization energy of an ensemble of isolated He atoms, the LSIC and PZSIC methods do not exhibit delocalization errors. For the fractional charges, both LSIC and PZSIC significantly reduce the deviation from linearity in the energy vs number of electrons curve, with PZSIC performing superior for C, Ne, and Ar atoms while for Kr they perform similarly. The LSIC performs well at the endpoints (integer occupations) while substantially reducing the deviation. The dissociation of LiF shows both LSIC and PZSIC dissociate into neutral Li and F but only LSIC exhibits charge transfer from Li + to F – at the expected distance from the experimental data and accurate ab initio data. Overall, both the PZSIC and LSIC methods reduce the delocalization errors substantially.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

\texttt{qec\_code\_sim}: An open-source Python framework for estimating the effectiveness of quantum-error correcting codes on superconducting qubits

Quantum computers are highly susceptible to errors due to unintended interactions with their environment. It is crucial to correct these errors without gaining information about the quantum state, which would result in its destruction through back-action. Quantum Error Correction (QEC) provides information about occurred errors without compromising the quantum state of the system. However, the implementation of QEC has proven to be challenging due to the current performance levels of qubits -- break-even requires fabrication and operation quality that is beyond the state-of-the-art. Understanding how qubit performance factors into the success of a QEC code is a valuable exercise for tracking progress towards fault-tolerant quantum computing. Here we present \texttt{qec\_code\_sim}, an open-source, lightweight Python framework for studying the performance of small quantum error correcting codes under the influence of a realistic error model appropriate for superconducting transmon qubits, with the goal of enabling useful hardware studies and experiments. \texttt{qec\_code\_sim} requires minimal software dependencies and prioritizes ease of use, ease of change, and pedagogy over execution speed. As such, it is a tool well-suited to small teams studying systems on the order of one dozen qubits.

Lopez, Santiago↗

A Monte Carlo Based Ray Tracing Tool for Evaluating Wolter-Type Prescriptions

Evaluating Wolter-like X-ray mirror prescriptions via ray tracing is useful for selecting and optimizing the right mirror prescriptions for a specified application. Moreover, incorporating real metrology data into a ray trace and simulating point spread functions (PSF) allows for performance predictions representative of real manufacturing errors and tolerances. In fulfillment of an internship project, an X-ray ray trace routine using a Monte-Carlo method has been developed to examine different Wolter-like prescriptions and characterize their theoretical performances over a specified field of view. This routine includes the ability to use real metrology data to evaluate the impact of figure error on imaging performance. As a test case, the Marshall Grazing Incidence X-ray Spectrometer (MaGIXS) Wolter-I mirror prescription and an equivalent Wolter-Schwarzschild prescription were traced and imaging performance of a specified field of view were mapped. Here we present the approach used in this routine, showcase example results, and discuss future goals for expanding the routine to address azimuthally varying figure errors and surface roughness.

X-ray optics↗

A 1 percent measurement of the temperature of the cosmic microwave radiation at lambda = 1.2 centimeters

Results are reported of a direct measurement of the cosmic microwave radiation temperature using a special Dicke radiometer (wavelength = 1.2 cm) designed to minimize the usual systematic errors. The experiment was performed at balloon altitudes to avoid atmospheric emission. The first flight gives a cosmic microwave radiation temperature of 2.783 + or - 0.025 K, where the error is due to several errors (mostly systematic) added by quadrature. This is the most accurate direct measurement (by a factor of 3) yet reported.

Johnson, David G.↗

Observation Error Specification for Near-Surface Soil Moisture Assimilation: Does It Matter?

The observation error variances assumed in the data assimilation (DA) of remotely sensed near-surface soil moisture observations are known to have unrealistic spatial patterns. The temporal variability in the errors is also typically neglected. Soil moisture errors cannot be directly calculated at large scales, and the globally distributed errors are unknown. We apply several approaches to estimating the observation errors (R matrix) for near-surface soil moisture DA experiments, to establish whether the assumed errors are important to the DA performance, and hence whether uncertainty in the observation error specification is a likely source of uncertainty in soil moisture DA output.

Draper, Clara↗