Engineering PapersSearch

SEARCH · Engineering Papers

Results for “performance assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Assessing Performance of Radar and Visual Sensing Techniques for Ground-To-Air Surveillance in Advanced Air Mobility

The safe integration of Unmanned Aircraft Vehicles (UAV) within the civil airspace is of great interest to NASA’s Advanced Air Mobility project, which envisions high density of operations in and around urban areas that include both UAV and AAM aircraft. To enable safe autonomous operations of both platforms, reliable airspace surveillance strategies must be designed and experimentally validated in relevant scenarios, where multiple small UAV operate flying in low altitude conditions. An example of such a scenario is described in this paper which provides performance assessment of various sensing strategies experimentally tested during flight campaigns with four UAV completing simultaneous missions from vertiports. Such campaigns are performed by the High Density Vertiplex subproject which assesses a prototype of Urban Air Mobility ecosystem. For the purposes of this work, the flights are observed from multiple sensing nodes each with radar and camera sensors. The visual detection and tracking algorithms achieved 96.1% to 99.9% average tracking coverage of the UAV above the horizon, reaching detection ranges larger than 1 kilometer for octocopter. Radar-based tracking shows a lower coverage mainly due to ground clutter removal challenges but provides comparable detection ranges and meter-level range accuracy.

Federica Vitiello

Risk and Performance Assessment of Generic Mission Architectures: Showcasing the Artemis Mission

A has initiated a strong push to return face. In this work, we astronaut assess performance and risk for proposed mission architectures using a new Mission Architecture Risk Assessment (MARA) tool. The MARA tool can produce statistics about the availability of components and overall performance of the mission considering potential failures of any of its components. In a Monte Carlo approach, the tool repeats the mission simulation multiple times while a random generator lets modules fail according to their failure rates. The results provide statistically meaningful insights into the overall performance of the chosen architecture. A given mission architecture can be freely replicated in the tool, with the mission timeline and basic characteristics of employed mission modules (habitats, rovers, power generation units, etc.) specified in a configuration file. Crucially, failure rates for each module need to be known or estimated. The tool performs an event-driven simulation of the mission and accounts for random failure events. Failed modules can be repaired, which takes crew time but restores operations. In addition to tracking individual modules, MARA can assess the availability of predefined functions throughout the mission. For instance, the function of resource collection would require a rover to collect the resources, a power generation unit to charge the rover, and a resource processing module. Together, the modules that are required for a given function are called a functional group. Similarly, we can assess how much crew time is available to achieve a mission benefit (e.g. research, building a base, etc) as opposed to spending crew time on repairs. Here we employ the method on the proposed NASA Artemis mission. Artemis aims to return United States astronauts to the lunar surface by 2024. Results provide insights into mission failure probabilities, up- and downtime for individual modules and crew-time resources spent on the repair of failed modules. The tool also allows us to tweak the mission architecture in order to find setups that produce more favorable mission performance. As such, the tool can be an aid in improving the mission architect abling cost-benefit analysis for mission improvement.

Rumpf, Clemens M.

Digital temperature sensor performance assessment report

Performance assessment data accumulated during exposure of the digital temperature sensor to simulated shuttle flight type environments are presented. The test parameters were specifically designed to check the sensor for its: (1) ability to resolve temperature relative to the design specifications; (2) ability to maintain accuracy after interchanging the temperature probes with each electronics interface assembly; (3) stability (i.e., satisfactory operation and accuracy during and after exposure to flight environments); and (4) repeatability, or its ability to produce the same output on subsequent exposures to the identical stimulus. Equipment list, test descriptions, data summary, and conclusions are included.

Canniff, J. H.

RANGERS: Modeling Report on Integrity and Performance Assessment of Engineered Barrier Systems in a Salt Repository for HLW/SNF

The Engineered Barrier System (EBS) plays an important role in ensuring the long-term safety and containment of high-level waste (HLW) and spent nuclear fuel (SNF) in deep geological repositories in salt formation. As part of a multi-barrier system, the EBS works alongside the natural barrier, which is the salt formation itself and the technical barrier comprising the disposal casks. The primary function of the EBS is to maintain containment during a defined period until the backfill used in the repository made of crushed salt, develops its sealing capacity through compaction. Over the time, the backfill eventually compacts to a state of low porosity and permeability, acting as a long-term seal. However, until this process is complete, the EBS must retain its structural and functional integrity. Regulatory guidelines in Germany currently require the EBS to remain effective for up to next ice age, that is expected in 50,000 years. The significant hydro-geological and topographic changes expected during an ice age could make it impossible to accurately predict the hydro-chemical conditions within the repository system at that time. In response to these challenges, BGE TECHNOLOGY GmbH (BGE TEC) and Sandia National Laboratories (SNL) have jointly developed a comprehensive methodology for the design and safety assessment of engineered barrier systems within the scope of the RANGERS project. This methodology is tailored for repositories in salt formations. The developed methodology provides a structured approach for designing and assessing the performance of the EBS in salt-based repositories. It begins with defining a sealing concept based on the geological characteristics of the selected site and the overall repository design. The entire repository system, comprising the geological site, repository infrastructure, and EBS, is then subjected to a Features, Events, and Processes (FEP) analysis, focusing solely on those FEPs that affect the EBS. The derived FEPs help identify the loads and stresses acting on the EBS, which serve as the foundation for conducting an integrity assessment. This analysis helps predict the EBS’s evolution and performance over the regulatory time frame, feeding into integrated performance assessment simulations.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W

DAG-TM Concept Element 11 CNS Performance Assessment: ADS-B Performance in the TRACON

Distributed Air/Ground (DAG) Traffic Management (TM) is an integrated operational concept in which flight deck crews, air traffic service providers and aeronautical operational control personnel use distributed decision-making to enable user preferences and increase system capacity, while meeting air traffic management (ATM) safety requirements. It is a possible operational mode under the Free Flight concept outlined by the RTCA Task Force 3. The goal of DAG-TM is to enhance user flexibility/efficiency and increase system capacity, without adversely affecting system safety or restricting user accessibility to the National Airspace System (NAS). DAG-TM will be accomplished with a human-centered operational paradigm enabled by procedural and technological innovations. These innovations include automation aids, information sharing and Communication, Navigation, and Surveillance (CNS) / ATM technologies. The DAG-TM concept is intended to eliminate static restrictions to the maximum extent possible. In this paradigm, users may plan and operate according to their preferences - as the rule rather than the exception - with deviations occurring only as necessary. The DAG-TM concept elements aim to mitigate the extent and impact of dynamic NAS constraints, while maximizing the flexibility of airspace operations

Raghavan, Rajesh S.

Performance assessment of planetary missions as launched from an orbiting space station

Results presented are intended to assist planners and the mission analysis community in assessing the performance impact (pro or con) of launching planetary missions from an orbiting space station as compared to the usual, ground-based Shuttle launch of such missions. The analyses comprising this assessment include: (1) a basic understanding and description of the space station launch problem; (2) examination of alternative injection strategies and selection of the most appropriate strategy for minimizing performance penalties; and (3) quantitative comparison of station-launched and Shuttle-launched performance over a wide energy/mass range of planetary mission opportunities. Data for each mission covers a full 360 deg of possible nodal location of the space station orbit. The main results are that planetary missions can be launched from a space station within acceptable penalty bounds, and that the station serving as a staging base/propellant depot can benefit some missions requiring large payload mass or high injection energy.

Friedlander, A.

Working Fluid Characterization and Performance Assessment of Subcritical Organic Rankine Cycles Based on the Lee–Kesler Approach for Energy Recovery

Here, a generalized model using the Lee–Kesler approach based on the corresponding states principle is developed to assess the performance of subcritical Organic Rankine Cycles operating with different working fluids. Each fluid is characterized by five parameters: the acentric factor, critical temperature, critical pressure, molar mass, and the ideal-gas ratio of specific heats at the critical temperature. The model was developed using the compressibility factor modified version of the Benedict–Webb–Rubin equation proposed by Lee and Kesler and the enthalpy and entropy functions to calculate thermodynamic state properties. The model was validated by comparing the results calculated with the model and working fluid thermodynamic properties obtained with the CoolProp database. This comparison was conducted for 91 working fluids, obtaining a relative error below 5% for 88 out of the 91 fluids (∼97%). A generalized parametric study was conducted to determine the influence of the pinch point and each fluid parameter on the performance of Organic Rankine Cycle (ORC) systems. It was found that efficiency increases with critical temperature, ideal-gas ratio of specific heats at the critical temperature, and acentric factor, reaching up to 13%. The developed model enables the evaluation of ORC system performance for existing working fluids. It also allows the formulation and evaluation of new fluids to enhance the performance of the ORC while retrieving energy from any kind of source; and likewise, the methodology can be applied to other power generation cycles.

24 POWER TRANSMISSION AND DISTRIBUTION

Performance assessment of the TDRSS Onboard Navigation System (TONS) experiment on EP/EUVE

The National Aeronautics and Space Administration (NASA) Goddard Space Flight Center (GSFC) is currently developing an operational Tracking and Data Relay Satellite (TDRS) System (TDRSS) Onboard Navigation System (TONS) to provide onboard knowledge of high-accuracy navigation products autonomously to users of TDRSS and its successor, TDRS-2. A TONS experiment has been implemented on the Explorer Platform/Extreme Ultraviolet Explorer (EP/EUVE) spacecraft, launched June 7, 1992, to flight qualify the TONS operational system using TDRSS forward-link communications services. This paper assesses the performance of the TONS flight hardware, an ultrastable oscillator (USO) and Doppler extractor (DE) card in one of the TDRSS user transponders, and the protoype flight software, based on the TONS experiment results. An overview of onboard navigation via TDRSS is also presented for both the EP/EUVE experiment and for future users of TONS. USO and DE short-term and long-term stability performance has been excellent. TONS Flight Software analysis indicates that position accuracies of better than 25 meters root-mean-square are achievable with tracking every one to two orbits, for the EP/EUVE 525-kilometer altitudes, 28.5-degree inclination orbit. The success of the TONS experiment demonstrates the flight readiness of TONS, which is scheduled to provide autonomous navigation for the Earth Observing System (EOS)-AM mission.

Gramling, C. J.

Performance Assessment of Two GPS Receivers on Space Shuttle

Space Shuttle STS-69 was launched on September 7, 1995, carrying the Wake Shield Facility (WSF-02) among its payloads. The mission included two GPS receivers: a Collins 3M receiver onboard the Endeavour and an Osborne flight TurboRogue, known as the TurboStar, onboard the WSF-02. Two of the WSF-02 GPS Experiment objectives were to: (1) assess the ability to use GPS in a relative satellite positioning mode using the receivers on Endeavour and WSF-02; and (2) assess the performance of the receivers to support high precision orbit determination at the 400 km altitude. Three ground tests of the receivers were conducted in order to characterize the respective receivers. The analysis of the tests utilized the Double Differencing technique. A similar test in orbit was conducted during STS-69 while the WSF-02 was held by the Endeavour robot arm for a one hour period. In these tests, biases were observed in the double difference pseudorange measurements, implying that biases up to 140 m exist which do not cancel in double differencing. These biases appear to exist in the Collins receiver, but their effect can be mitigated by including measurement bias parameters to accommodate them in an estimation process. An additional test was conducted in which the orbit of the combined Endeavour/WSF-02 was determined independently with each receiver. These one hour arcs were based on forming double differences with 13 TurboRogue receivers in the global IGS network and estimating pseudorange biases for the Collins. Various analyses suggest the TurboStar overall orbit accuracy is about one to two meters for this period, based on double differenced phase residuals of 34 cm. These residuals indicate the level of unmodeled forces on Endeavour produced by gravitational and nongravitational effects. The rms differences between the two independently determined orbits are better than 10 meters, thereby demonstrating the accuracy of the Collins-determined orbit at this level as well as the accuracy of the relative positioning using these two receivers.

Schroeder, Christine A.

Performance Assessment of Fluidic Oscillators Tested on the NASA Hump Model

Flow separation control over a wall-mounted hump model was studied experimentally to assess the performance of fluidic oscillators (sweeping jet actuators). An array of fluidic oscillators was used to control flow separation. The results showed that the fluidic oscillators were able to achieve substantial control over the separated flow by increasing the upstream suction pressure and downstream pressure recovery. Using the data available in the literature, the performance of the fluidic oscillators was compared to other active flow control (AFC) methods such as steady blowing, steady suction, and zero-net-mass-flux (ZNMF) actuators. Several integral parameters, such as the inviscid flow comparison coefficient, pressure drag coefficient, and modified normal force coefficient, were used as quality metrics in the performance comparison of the AFC methods. These quality metrics indicated the superiority of the steady suction method, especially at lower excitation amplitudes that is followed by the fluidic oscillators, steady blowing, and the ZNMF actuators, respectively. An aerodynamic figure of merit (AFM) was also constructed using the integral parameters and AFC power usage. The AFM results revealed that, for this study, steady suction was the most efficient AFC method at lower excitation amplitudes. The steady suction loses its efficiency as the excitation amplitude increases, and the fluidic oscillators become the most efficient AFC method. Both the steady suction and the fluidic oscillators have an AFM > 1 for the range tested in this study, indicating that they provide a net benefit when the AFC power consumption is also considered. On the other hand, both the steady blowing and ZNMF actuators were found to be inefficient AFC methods (AFM < 1) for the current configuration. Although they improved the flow field by controlling flow separation, the power requirement was more than their benefit.

Fluidic oscillators

A Performance Assessment of Eight Low-Boom High-Speed Civil Transport Concepts

A performance assessment of eight low-boom high speed civil transport (HSCT) configurations and a reference HSCT configuration has been performed. Although each of the configurations was designed with different engine concepts, for consistency, a year 2005 technology, 0.4 bypass ratio mixed-flow turbofan (MFTF) engine was used for all of the performance assessments. Therefore, all original configuration nacelles were replaced by a year 2005 MFRF nacelle design which corresponds to the engine deck utilized. The engine thrust level was optimized to minimize vehicle takeoff gross weight. To preserve the configuration's sonic-boom shaping, wing area was not optimized or altered from its original design value. Performance sizings were completed when possible for takeoff balanced field lengths of 11,000 ft and 12,000 ft, not considering FAR Part 36 Stage III noise compliance. Additionally, an arbitrary sizing with thrust-to-weight ratio equal to 0.25 was performed, enabling performance levels to be compared independent of takeoff characteristics. The low-boom configurations analyzed included designs from the Boeing Commercial Airplane Group, Douglas Aircraft Company, Ames Research Center, and Langley Research Center. This paper discusses the technology level assumptions, mission profile, analysis methodologies, and the results of the assessment. The results include maximum lift-to-drag ratios, total fuel consumption, number of passengers, optimum engine sizing plots, takeoff performance, mission block time, and takeoff gross weight for all configurations. Results from the low-boom configurations are also compared with a non-low-boom reference configuration. Configuration dependent advantages or deficiencies are discussed as warranted.

Baize, Daniel G.

Study to validate the Non-Interference Performance Assessment (NIPA) technique

The NIPA (Non-Interference Performance Assessment) technique involves direct observation of group verbal activities by trained observers who rate the emotional content (affect) of each verbal interaction as either positive, negative, or neutral. During the test, in which four men were confined for 90 consecutive days, feasibility of the NIPA technique was demonstrated and observer reliability was verified. However, the validity of the test was not proved because an independent criterion measure of morale for the confined crew was lacking. There were indications, however, that NIPA measures were tracking changes in crew morale. At approximately the two-thirds point (Days 60 to 70), morale apparently fell dramatically for a period of about ten days, and simultaneously NIPA measure of positive verbalization decreased in number. A need was indicated for a separate study to apply the NIPA technique under experimental conditions and using a clearly defined criterion measure against which the ability of NIPA observations to truly measure morale changes could be determined.

Seeman, J. S.

Risk-informed Graded Approach for Reliability and Performance Assessment of Machine Learning and Artificial Intelligence for Advanced Condition Monitoring Techniques

With the shift away from time-based maintenance and toward condition-based maintenance, and to reduce overall maintenance costs, there has been an upsurge in the usage and development of advanced condition monitoring (ACM) techniques for real-time monitoring of nuclear power plant (NPP) components. ACM is particularly useful in the development of digital twins, which are designed to predict the failure or degradation of plant components. Successful implementation of ACM requires an assessment to inform the development of a risk-informed approach to evaluate the use of ACM to meet Nuclear Regulatory Committee (NRC) regulations for in-service testing (IST) programs. This includes the monitoring and diagnostics of reactor components and systems in current, new, and advanced reactors. A key component in ACM is the usage of machine learning (ML) and artificial intelligence (AI) algorithms that can employ real-time data from instrumentation and sensors to detect and predict reactor component degradations. Such predictive capabilities enable early detection of component degradation so as to help plant personnel plan and execute necessary maintenance. For successful implementation of ML/AI in ACM such that regulatory requirements are met, a risk-informed graded approach is needed to assess the reliability and performance of ML/AI for ACM. The American Society for Mechanical Engineers (ASME) developed their Operations and Maintenance (O&M) Code to provide guidance on safe, reliable O&M of NPPs. The IST section of the O&M Code specifically establishes requirements for IST and examination to gauge operational readiness of components in water-cooled NPPs. This paper presents a state-of-the-art review of how reliability and risk assessment can be integrated with ACM to assess component performance by non-nuclear industries. This is followed by different methodologies and approaches for conducting performance and reliability assessments so as to meet IST requirements for NPP components.

97 - MATHEMATICS AND COMPUTING

Risk-informed Graded Approach for Reliability and Performance Assessment for Advanced Condition Monitoring Techniques

With the shift away from time-based maintenance and toward condition-based maintenance, and to reduce overall maintenance costs, there has been an upsurge in the usage and development of advanced condition monitoring (ACM) techniques for real-time monitoring of nuclear power plant (NPP) components. ACM is particularly useful in the development of digital twins, which are designed to predict the failure or degradation of plant components. Successful implementation of ACM requires an assessment to inform the development of a risk-informed approach to evaluate the use of ACM to meet Nuclear Regulatory Committee (NRC) regulations for in-service testing (IST) programs. This includes the monitoring and diagnostics of reactor components and systems in current, new, and advanced reactors. A key component in ACM is the usage of machine learning (ML) and artificial intelligence (AI) algorithms that can employ real-time data from instrumentation and sensors to detect and predict reactor component degradations. Such predictive capabilities enable early detection of component degradation so as to help plant personnel plan and execute necessary maintenance. For successful implementation of ML/AI in ACM such that regulatory requirements are met, a risk-informed graded approach is needed to assess the reliability and performance of ML/AI for ACM. The American Society for Mechanical Engineers (ASME) developed their Operations and Maintenance (O&M) Code to provide guidance on safe, reliable O&M of NPPs. The IST section of the O&M Code specifically establishes requirements for IST and examination to gauge operational readiness of components in water-cooled NPPs. This paper presents a state-of-the-art review of how reliability and risk assessment can be integrated with ACM to assess component performance by non-nuclear industries. This is followed by different methodologies and approaches for conducting performance and reliability assessments so as to meet IST requirements for NPP components.

99 - GENERAL AND MISCELLANEOUS

Standard Analysis Report INV-SAR-81, Revision 0 Chemical and Cement Components 2023 Inventory Estimates for the Interim State Performance Assessment of the Waste Isolation Pilot Plant

This standard analysis report provides the estimates for the chemical (oxyanions and complexing agents) and cement components with a data collection cut-off date of December 31, 2023. These estimates will be included in a Performance Assessment Inventory Report developed for the U.S. Department of Energy (DOE) interim state repository configuration performance assessment (PA) for the 2026 Compliance Recertification Application (CRA).

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W

Modeling glass degradation and release of radionuclides from vitrified waste for performance assessment simulations

The release of radionuclides initially encapsulated in a slowly degrading solid waste form and contained in an eventually corroding canister defines the source term for numerical simulations for the assessment of a geologic repository for high-level radioactive waste. While the details of waste degradation, canister corrosion, and dissolution and mobilization of the radionuclides in pore water include complex chemical reaction and transport processes that are coupled to the thermal, hydrological, microbiological, and mechanical conditions in the repository, the source-term model suitable for use in a numerical performance assessment model should be a defensible abstraction of these mechanisms. We developed a radiological source-term model and implemented it into a non-isothermal flow and transport simulator. While the proposed source-term model is applicable to various waste forms, canister systems, and disposal concepts, we specifically considered radionuclide releases from vitrified high-level waste placed in a cylindrical canister disposed in a deep vertical borehole repository. In this model, waste degradation is a function of temperature, and it can be adjusted to evaluate the influence of and propagate uncertainties in pH, passivation reactions, and chemical conditions as well as geometrical factors. The time-dependent, congruent release of safety-relevant radionuclides present in the decaying inventory is then calculated. Finally, the radionuclides are mobilized by diffusive and advective transport according to the thermo-hydraulic conditions prevailing in the near field of the repository, from where they migrate through the geosphere to the accessible environment. We examine the influence of the source-term model’s parameters on performance assessment calculations through sensitivity and uncertainty propagation analyses, identifying influential factors and confirming the upper bound of their impact. These considerations align with the overarching goal of repository design, which is to demonstrate that engineered and natural barriers can collectively delay radionuclide migration for timescales far exceeding human planning, thereby providing multiple, redundant barriers against environmental contamination.

iTOUGH2

Sensor Performance Assessment for Terra and Aqua MODIS Using Unscheduled Lunar Observations

The Moderate Resolution Imaging Spectroradiometer (MODIS) has been in operation for over 18 and 16 years on the Terra and Aqua spacecrafts, respectively. In order to maintain long-term calibration stability over the life of each mission, MODIS uses a set of on-board calibrators as well as observations of the Moon and selected Earth-view targets. The lunar observations nominally occur in a narrow phase angle range, 55 degrees - 56 degrees, and use scheduled spacecraft maneuvers in order to bring the Moon into alignment with the MODIS space-view port. These observations are used to help characterize the MODIS scan-mirror response versus scan-angle. In addition to these scheduled lunar observations, MODIS also views the Moon through the space-view port without a spacecraft maneuver when the geometry is appropriately aligned. This occurs over a wider phase angle range, between 51 degrees - 82 degrees, than those of the scheduled moon observations. While the phase angle restriction of our scheduled observations provides consistency between the calibration events, the unscheduled Moon data can provide a valuable assessment of many calibration related investigations that use the Moon. In this paper, we compare the results of unscheduled versus scheduled lunar observations for several sensor calibration and performance assessments. These include the lunar calibration trending used to characterize the scan-mirror response versus scan angle and the electronic crosstalk correction of bands 27-30, which are currently used in the MODIS Level-1B data products, as well as sensor performance assessments such as band-to-band and detector-to-detector spatial registration.

Aqua