Engineering PapersSearch

SEARCH · Engineering Papers

Results for “performance assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Assessing Performance of Radar and Visual Sensing Techniques for Ground-To-Air Surveillance in Advanced Air Mobility

The safe integration of Unmanned Aircraft Vehicles (UAV) within the civil airspace is of great interest to NASA’s Advanced Air Mobility project, which envisions high density of operations in and around urban areas that include both UAV and AAM aircraft. To enable safe autonomous operations of both platforms, reliable airspace surveillance strategies must be designed and experimentally validated in relevant scenarios, where multiple small UAV operate flying in low altitude conditions. An example of such a scenario is described in this paper which provides performance assessment of various sensing strategies experimentally tested during flight campaigns with four UAV completing simultaneous missions from vertiports. Such campaigns are performed by the High Density Vertiplex subproject which assesses a prototype of Urban Air Mobility ecosystem. For the purposes of this work, the flights are observed from multiple sensing nodes each with radar and camera sensors. The visual detection and tracking algorithms achieved 96.1% to 99.9% average tracking coverage of the UAV above the horizon, reaching detection ranges larger than 1 kilometer for octocopter. Radar-based tracking shows a lower coverage mainly due to ground clutter removal challenges but provides comparable detection ranges and meter-level range accuracy.

Federica Vitiello

Risk and Performance Assessment of Generic Mission Architectures: Showcasing the Artemis Mission

A has initiated a strong push to return face. In this work, we astronaut assess performance and risk for proposed mission architectures using a new Mission Architecture Risk Assessment (MARA) tool. The MARA tool can produce statistics about the availability of components and overall performance of the mission considering potential failures of any of its components. In a Monte Carlo approach, the tool repeats the mission simulation multiple times while a random generator lets modules fail according to their failure rates. The results provide statistically meaningful insights into the overall performance of the chosen architecture. A given mission architecture can be freely replicated in the tool, with the mission timeline and basic characteristics of employed mission modules (habitats, rovers, power generation units, etc.) specified in a configuration file. Crucially, failure rates for each module need to be known or estimated. The tool performs an event-driven simulation of the mission and accounts for random failure events. Failed modules can be repaired, which takes crew time but restores operations. In addition to tracking individual modules, MARA can assess the availability of predefined functions throughout the mission. For instance, the function of resource collection would require a rover to collect the resources, a power generation unit to charge the rover, and a resource processing module. Together, the modules that are required for a given function are called a functional group. Similarly, we can assess how much crew time is available to achieve a mission benefit (e.g. research, building a base, etc) as opposed to spending crew time on repairs. Here we employ the method on the proposed NASA Artemis mission. Artemis aims to return United States astronauts to the lunar surface by 2024. Results provide insights into mission failure probabilities, up- and downtime for individual modules and crew-time resources spent on the repair of failed modules. The tool also allows us to tweak the mission architecture in order to find setups that produce more favorable mission performance. As such, the tool can be an aid in improving the mission architect abling cost-benefit analysis for mission improvement.

Rumpf, Clemens M.

Digital temperature sensor performance assessment report

Performance assessment data accumulated during exposure of the digital temperature sensor to simulated shuttle flight type environments are presented. The test parameters were specifically designed to check the sensor for its: (1) ability to resolve temperature relative to the design specifications; (2) ability to maintain accuracy after interchanging the temperature probes with each electronics interface assembly; (3) stability (i.e., satisfactory operation and accuracy during and after exposure to flight environments); and (4) repeatability, or its ability to produce the same output on subsequent exposures to the identical stimulus. Equipment list, test descriptions, data summary, and conclusions are included.

Canniff, J. H.

DAG-TM Concept Element 11 CNS Performance Assessment: ADS-B Performance in the TRACON

Distributed Air/Ground (DAG) Traffic Management (TM) is an integrated operational concept in which flight deck crews, air traffic service providers and aeronautical operational control personnel use distributed decision-making to enable user preferences and increase system capacity, while meeting air traffic management (ATM) safety requirements. It is a possible operational mode under the Free Flight concept outlined by the RTCA Task Force 3. The goal of DAG-TM is to enhance user flexibility/efficiency and increase system capacity, without adversely affecting system safety or restricting user accessibility to the National Airspace System (NAS). DAG-TM will be accomplished with a human-centered operational paradigm enabled by procedural and technological innovations. These innovations include automation aids, information sharing and Communication, Navigation, and Surveillance (CNS) / ATM technologies. The DAG-TM concept is intended to eliminate static restrictions to the maximum extent possible. In this paradigm, users may plan and operate according to their preferences - as the rule rather than the exception - with deviations occurring only as necessary. The DAG-TM concept elements aim to mitigate the extent and impact of dynamic NAS constraints, while maximizing the flexibility of airspace operations

Raghavan, Rajesh S.

Performance assessment of planetary missions as launched from an orbiting space station

Results presented are intended to assist planners and the mission analysis community in assessing the performance impact (pro or con) of launching planetary missions from an orbiting space station as compared to the usual, ground-based Shuttle launch of such missions. The analyses comprising this assessment include: (1) a basic understanding and description of the space station launch problem; (2) examination of alternative injection strategies and selection of the most appropriate strategy for minimizing performance penalties; and (3) quantitative comparison of station-launched and Shuttle-launched performance over a wide energy/mass range of planetary mission opportunities. Data for each mission covers a full 360 deg of possible nodal location of the space station orbit. The main results are that planetary missions can be launched from a space station within acceptable penalty bounds, and that the station serving as a staging base/propellant depot can benefit some missions requiring large payload mass or high injection energy.

Friedlander, A.

Performance assessment of the TDRSS Onboard Navigation System (TONS) experiment on EP/EUVE

The National Aeronautics and Space Administration (NASA) Goddard Space Flight Center (GSFC) is currently developing an operational Tracking and Data Relay Satellite (TDRS) System (TDRSS) Onboard Navigation System (TONS) to provide onboard knowledge of high-accuracy navigation products autonomously to users of TDRSS and its successor, TDRS-2. A TONS experiment has been implemented on the Explorer Platform/Extreme Ultraviolet Explorer (EP/EUVE) spacecraft, launched June 7, 1992, to flight qualify the TONS operational system using TDRSS forward-link communications services. This paper assesses the performance of the TONS flight hardware, an ultrastable oscillator (USO) and Doppler extractor (DE) card in one of the TDRSS user transponders, and the protoype flight software, based on the TONS experiment results. An overview of onboard navigation via TDRSS is also presented for both the EP/EUVE experiment and for future users of TONS. USO and DE short-term and long-term stability performance has been excellent. TONS Flight Software analysis indicates that position accuracies of better than 25 meters root-mean-square are achievable with tracking every one to two orbits, for the EP/EUVE 525-kilometer altitudes, 28.5-degree inclination orbit. The success of the TONS experiment demonstrates the flight readiness of TONS, which is scheduled to provide autonomous navigation for the Earth Observing System (EOS)-AM mission.

Gramling, C. J.

Performance Assessment of Two GPS Receivers on Space Shuttle

Space Shuttle STS-69 was launched on September 7, 1995, carrying the Wake Shield Facility (WSF-02) among its payloads. The mission included two GPS receivers: a Collins 3M receiver onboard the Endeavour and an Osborne flight TurboRogue, known as the TurboStar, onboard the WSF-02. Two of the WSF-02 GPS Experiment objectives were to: (1) assess the ability to use GPS in a relative satellite positioning mode using the receivers on Endeavour and WSF-02; and (2) assess the performance of the receivers to support high precision orbit determination at the 400 km altitude. Three ground tests of the receivers were conducted in order to characterize the respective receivers. The analysis of the tests utilized the Double Differencing technique. A similar test in orbit was conducted during STS-69 while the WSF-02 was held by the Endeavour robot arm for a one hour period. In these tests, biases were observed in the double difference pseudorange measurements, implying that biases up to 140 m exist which do not cancel in double differencing. These biases appear to exist in the Collins receiver, but their effect can be mitigated by including measurement bias parameters to accommodate them in an estimation process. An additional test was conducted in which the orbit of the combined Endeavour/WSF-02 was determined independently with each receiver. These one hour arcs were based on forming double differences with 13 TurboRogue receivers in the global IGS network and estimating pseudorange biases for the Collins. Various analyses suggest the TurboStar overall orbit accuracy is about one to two meters for this period, based on double differenced phase residuals of 34 cm. These residuals indicate the level of unmodeled forces on Endeavour produced by gravitational and nongravitational effects. The rms differences between the two independently determined orbits are better than 10 meters, thereby demonstrating the accuracy of the Collins-determined orbit at this level as well as the accuracy of the relative positioning using these two receivers.

Schroeder, Christine A.

Performance Assessment of Fluidic Oscillators Tested on the NASA Hump Model

Flow separation control over a wall-mounted hump model was studied experimentally to assess the performance of fluidic oscillators (sweeping jet actuators). An array of fluidic oscillators was used to control flow separation. The results showed that the fluidic oscillators were able to achieve substantial control over the separated flow by increasing the upstream suction pressure and downstream pressure recovery. Using the data available in the literature, the performance of the fluidic oscillators was compared to other active flow control (AFC) methods such as steady blowing, steady suction, and zero-net-mass-flux (ZNMF) actuators. Several integral parameters, such as the inviscid flow comparison coefficient, pressure drag coefficient, and modified normal force coefficient, were used as quality metrics in the performance comparison of the AFC methods. These quality metrics indicated the superiority of the steady suction method, especially at lower excitation amplitudes that is followed by the fluidic oscillators, steady blowing, and the ZNMF actuators, respectively. An aerodynamic figure of merit (AFM) was also constructed using the integral parameters and AFC power usage. The AFM results revealed that, for this study, steady suction was the most efficient AFC method at lower excitation amplitudes. The steady suction loses its efficiency as the excitation amplitude increases, and the fluidic oscillators become the most efficient AFC method. Both the steady suction and the fluidic oscillators have an AFM > 1 for the range tested in this study, indicating that they provide a net benefit when the AFC power consumption is also considered. On the other hand, both the steady blowing and ZNMF actuators were found to be inefficient AFC methods (AFM < 1) for the current configuration. Although they improved the flow field by controlling flow separation, the power requirement was more than their benefit.

Fluidic oscillators

A Performance Assessment of Eight Low-Boom High-Speed Civil Transport Concepts

A performance assessment of eight low-boom high speed civil transport (HSCT) configurations and a reference HSCT configuration has been performed. Although each of the configurations was designed with different engine concepts, for consistency, a year 2005 technology, 0.4 bypass ratio mixed-flow turbofan (MFTF) engine was used for all of the performance assessments. Therefore, all original configuration nacelles were replaced by a year 2005 MFRF nacelle design which corresponds to the engine deck utilized. The engine thrust level was optimized to minimize vehicle takeoff gross weight. To preserve the configuration's sonic-boom shaping, wing area was not optimized or altered from its original design value. Performance sizings were completed when possible for takeoff balanced field lengths of 11,000 ft and 12,000 ft, not considering FAR Part 36 Stage III noise compliance. Additionally, an arbitrary sizing with thrust-to-weight ratio equal to 0.25 was performed, enabling performance levels to be compared independent of takeoff characteristics. The low-boom configurations analyzed included designs from the Boeing Commercial Airplane Group, Douglas Aircraft Company, Ames Research Center, and Langley Research Center. This paper discusses the technology level assumptions, mission profile, analysis methodologies, and the results of the assessment. The results include maximum lift-to-drag ratios, total fuel consumption, number of passengers, optimum engine sizing plots, takeoff performance, mission block time, and takeoff gross weight for all configurations. Results from the low-boom configurations are also compared with a non-low-boom reference configuration. Configuration dependent advantages or deficiencies are discussed as warranted.

Baize, Daniel G.

Study to validate the Non-Interference Performance Assessment (NIPA) technique

The NIPA (Non-Interference Performance Assessment) technique involves direct observation of group verbal activities by trained observers who rate the emotional content (affect) of each verbal interaction as either positive, negative, or neutral. During the test, in which four men were confined for 90 consecutive days, feasibility of the NIPA technique was demonstrated and observer reliability was verified. However, the validity of the test was not proved because an independent criterion measure of morale for the confined crew was lacking. There were indications, however, that NIPA measures were tracking changes in crew morale. At approximately the two-thirds point (Days 60 to 70), morale apparently fell dramatically for a period of about ten days, and simultaneously NIPA measure of positive verbalization decreased in number. A need was indicated for a separate study to apply the NIPA technique under experimental conditions and using a clearly defined criterion measure against which the ability of NIPA observations to truly measure morale changes could be determined.

Seeman, J. S.

Sensor Performance Assessment for Terra and Aqua MODIS Using Unscheduled Lunar Observations

The Moderate Resolution Imaging Spectroradiometer (MODIS) has been in operation for over 18 and 16 years on the Terra and Aqua spacecrafts, respectively. In order to maintain long-term calibration stability over the life of each mission, MODIS uses a set of on-board calibrators as well as observations of the Moon and selected Earth-view targets. The lunar observations nominally occur in a narrow phase angle range, 55 degrees - 56 degrees, and use scheduled spacecraft maneuvers in order to bring the Moon into alignment with the MODIS space-view port. These observations are used to help characterize the MODIS scan-mirror response versus scan-angle. In addition to these scheduled lunar observations, MODIS also views the Moon through the space-view port without a spacecraft maneuver when the geometry is appropriately aligned. This occurs over a wider phase angle range, between 51 degrees - 82 degrees, than those of the scheduled moon observations. While the phase angle restriction of our scheduled observations provides consistency between the calibration events, the unscheduled Moon data can provide a valuable assessment of many calibration related investigations that use the Moon. In this paper, we compare the results of unscheduled versus scheduled lunar observations for several sensor calibration and performance assessments. These include the lunar calibration trending used to characterize the scan-mirror response versus scan angle and the electronic crosstalk correction of bands 27-30, which are currently used in the MODIS Level-1B data products, as well as sensor performance assessments such as band-to-band and detector-to-detector spatial registration.

Aqua

Evaluation of Geostationary Lightning Mapper (GLM) Navigation Performance with the INR Performance Assessment Toolset (IPATS)

The GOES-R flight project has developed the Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) to perform independent INR evaluations of the optical instruments on the GOES-R series spacecraft. In this presentation, we document the development of navigation (NAV) evaluation capabilities within IPATS for the Geostationary Lightning Mapper (GLM). We also discuss the post-processing quality filtering developed for GLM NAV, and present example results for several GLM background image datasets. Initial results suggest that GOES-16 GLM is compliant with navigation requirements.

Isaacson, Peter J.

InSight Entry, Descent and Landing Post-Flight Performance Assessment

On November 26, 2018, the Interior Exploration using Seismic Investigations, Geodesy and Heat Transport (InSight) lander successfully touched down on the surface of Mars. NASA Langley Research Center’s (LaRC) Program to Optimize Simulated Trajectories II (POST2) was used during both project development and flight operations to assess the Entry, Descent and Landing (EDL) vehicle performance against related requirements across the expected range of possible environmental and spacecraft conditions. During flight operations, these analyses were used to evaluate the need for updating flight software EDL parameters and the effects of executing a trajectory correction maneuver (TCM). Therefore, the NASA LaRC POST2 simulation had a critical role during the cruise, approach and ultimately EDL phases of the mission. This paper presents results of the final pre- and post- EDL flight performance assessments. A summary of the reconstructed “as-flown” trajectory with a comparison of key EDL metrics to the nominal and three-sigma bound pre-EDL predictions is also provided. Emphasis on the trajectory between entry interface and parachute deploy is provided as this is the period during which deviations from the pre-EDL prediction occurred. The post-flight assessment provides important verification of the POST2 models and analysis techniques used for InSight, providing critical feed-forward information to future lander missions.

Robert W Maddock

Photometer Performance Assessment in Kepler Science Data Processing

This paper describes the algorithms of the Photometer Performance Assessment (PPA) software component in the science data processing pipeline of the Kepler mission. The PPA performs two tasks: One is to analyze the health and performance of the Kepler photometer based on the long cadence science data down-linked via Ka band approximately every 30 days. The second is to determine the attitude of the Kepler spacecraft with high precision at each long cadence. The PPA component is demonstrated to work effectively with the Kepler flight data.

Li, Jie

Orion Exploration Flight Test-1 Post-Flight Navigation Performance Assessment Relative to the Best Estimated Trajectory

This paper details the post-flight navigation performance assessment of the Orion Exploration Flight Test-1 (EFT-1). Results of each flight phase are presented: Ground Align, Ascent, Orbit, and Entry Descent and Landing. This study examines the on-board Kalman Filter uncertainty along with state deviations relative to the Best Estimated Trajectory (BET). Overall the results show that the Orion Navigation System performed as well or better than expected. Specifically, the Global Positioning System (GPS) measurement availability was significantly better than anticipated at high altitudes. In addition, attitude estimation via processing GPS measurements along with Inertial Measurement Unit (IMU) data performed very well and maintained good attitude throughout the mission.

Gay, Robert S.

Performance Assessment of a Western Range 915-MHz Doppler Radar Wind Profiler

Please find enclosed the performance assessment for a Western Range 915-MHz Doppler Radar Wind Profiler (DRWP). This assessment was conducted following the installation of the new DRWP systems at the Western and Eastern Ranges. DRWP profiles were compared to Automated Meteorological Profiling System balloons launched from Vandenberg Space Force Base. Balloon data was collected from both normal synoptic and launch operations as well as some releases at the DRWP site. These results will include errors due to the spatial separation of winds. Root Mean Square wind speed deltas between the balloons and DRWP system mainly ranged between 1.0 and 2.3 m/s. Mean wind direction deltas mainly ranged between 10 and 28 degrees for wind speeds greater than or equal to 4 m/s. Data availability at discrete altitudes ranged from 20% to 94% with the least amount of available profiles being in the lower altitude ranges between 100 m and 500 m. The effective vertical resolution was determined to be approximately 250 m. The results from this analysis were requested by the United States Space Force for use of the acceptance of the DRWP system and for internal EV44 reference.

B J Barbre