Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

A system performance throughput model applicable to advanced manned telescience systems

As automated space systems become more complex, autonomous, and opaque to the flight crew, it becomes increasingly difficult to determine whether the total system is performing as it should. Some of the complex and interrelated human performance measurement issues are addressed that are related to total system validation. An evaluative throughput model is presented which can be used to generate a human operator-related benchmark or figure of merit for a given system which involves humans at the input and output ends as well as other automated intelligent agents. The concept of sustained and accurate command/control data information transfer is introduced. The first two input parameters of the model involve nominal and off-nominal predicted events. The first of these calls for a detailed task analysis while the second is for a contingency event assessment. The last two required input parameters involving actual (measured) events, namely human performance and continuous semi-automated system performance. An expression combining these four parameters was found using digital simulations and identical, representative, random data to yield the smallest variance.

Haines, Richard F.↗

Algorithm for Fluid Networks

Algorithm performs either transient integration or steady-state relaxation of network that represents internal fluid system. Valid for both single and two-phase flow of any fluid and includes both heat-transfer and work terms. General enough to simulate almost any flow system to almost any degree of detail desired. Encoded into computer program FLUINT, will work in conjunction with SINDA-85 program to enable analysis of pipelines; heating, ventilating, and cooling systems; and almost any other system that involves both fluid flow and heat transfer. Other possible extensions includes effects of flexibilities of containers, high-velocity flow, gravitation, acceleration, and opening and closing valves.

Cullimore, Brent A.↗

Orbit transfer rocket engine integrated control and health monitoring system technology readiness assessment

The objectives of this task were to: (1) estimate the technology readiness of an integrated control and health monitoring (ICHM) system for the Aerojet 7500 lbF Orbit Transfer Vehicle engine preliminary design assuming space based operations; and (2) estimate the remaining cost to advance this technology to a NASA defined 'readiness level 6' by 1996 wherein the technology has been demonstrated with a system validation model in a simulated environment. The work was accomplished through the conduct of four subtasks. In subtask 1 the minimally required functions for the control and monitoring system was specified. The elements required to perform these functions were specified in Subtask 2. In Subtask 3, the technology readiness level of each element was assessed. Finally, in Subtask 4, the development cost and schedule requirements were estimated for bringing each element to 'readiness level 6'.

Bickford, R. L.↗

GTX Project Summary

The objectives of the GTX (Vertical Take-off/ Horizontal Landing reusable single-stage-to-orbit system) project this viewgraph presentation summarizes include the following: (1) Determine whether or not air-breathing propulsion can enable reusable single stage to orbit vehicles; (2) Provide validated system performance data, and a baseline system design; and (3) Develop technologies applicable to high-speed airbreathing propulsion

Source record↗

A Ground Validation Network for the Global Precipitation Measurement Mission

A prototype Validation Network (VN) is currently operating as part of the Ground Validation System for NASA's Global Precipitation Measurement (GPM) mission. The VN supports precipitation retrieval algorithm development in the GPM prelaunch era. Postlaunch, the VN will be used to validate GPM spacecraft instrument measurements and retrieved precipitation data products. The period of record for the VN prototype starts on 8 August 2006 and runs to the present day. The VN database includes spacecraft data from the Tropical Rainfall Measuring Mission (TRMM) precipitation radar (PR) and coincident ground radar (GR) data from operational meteorological networks in the United States, Australia, Korea, and the Kwajalein Atoll in the Marshall Islands. Satellite and ground radar data products are collected whenever the PR satellite track crosses within 200 km of a VN ground radar, and these data are stored permanently in the VN database. VN products are generated from coincident PR and GR observations when a significant rain event occurs. The VN algorithm matches PR and GR radar data (including retrieved precipitation data in the case of the PR) by calculating averages of PR reflectivity (both raw and attenuation corrected) and rain rate, and GR reflectivity at the geometric intersection of the PR rays with the individual GR elevation sweeps. The algorithm thus averages the minimum PR and GR sample volumes needed to "matchup" the spatially coincident PR and GR data types. The result of this technique is a set of vertical profiles for a given rainfall event, with coincident PR and GR samples matched at specified heights throughout the profile. VN data can be used to validate satellite measurements and to track ground radar calibration over time. A comparison of matched TRMM PR and GR radar reflectivity factor data found a remarkably small difference between the PR and GR radar reflectivity factor averaged over this period of record in stratiform and convective rain cases when samples were taken from high in the atmosphere. A significant difference in PR and GR reflectivity was found in convective cases, particularly in convective samples from the lower part of the atmosphere. In this case, the mean difference between PR and corrected GR reflectivity was −1.88 dBZ. The PR-GR bias was found to increase with the amount of PR attenuation correction applied, with the PR-GR bias reaching −3.07 dBZ in cases where the attenuation correction applied is greater than 6 dBZ. Additional analysis indicated that the version 6 TRMM PR retrieval algorithm underestimates rainfall in case of convective rain in the lower part of the atmosphere by 30%-40%.

Schwaller, Mathew R.↗

A Ground Validation Network for the Global Precipitation Measurement Mission

A prototype Validation Network (VN) is currently operating as part of the Ground Validation System for NASA's Global Precipitation Measurement (GPM) mission. The VN supports precipitation retrieval algorithm development in the GPM prelaunch era. Postlaunch, the VN will be used to validate GPM spacecraft instrument measurements and retrieved precipitation data products. The period of record for the VN prototype starts on 8 August 2006 and runs to the present day. The VN database includes spacecraft data from the Tropical Rainfall Measuring Mission (TRMM) precipitation radar (PR) and coincident ground radar (GR) data from operational meteorological networks in the United States, Australia, Korea, and the Kwajalein Atoll in the Marshall Islands. Satellite and ground radar data products are collected whenever the PR satellite track crosses within 200 km of a VN ground radar, and these data are stored permanently in the VN database. VN products are generated from coincident PR and GR observations when a significant rain event occurs. The VN algorithm matches PR and GR radar data (including retrieved precipitation data in the case of the PR) by calculating averages of PR reflectivity (both raw and attenuation corrected) and rain rate, and GR reflectivity at the geometric intersection of the PR rays with the individual GR elevation sweeps. The algorithm thus averages the minimum PR and GR sample volumes needed to "matchup" the spatially coincident PR and GR data types. The result of this technique is a set of vertical profiles for a given rainfall event, with coincident PR and GR samples matched at specified heights throughout the profile. VN data can be used to validate satellite measurements and to track ground radar calibration over time. A comparison of matched TRMM PR and GR radar reflectivity factor data found a remarkably small difference between the PR and GR radar reflectivity factor averaged over this period of record in stratiform and convective rain cases when samples were taken from high in the atmosphere. A significant difference in PR and GR reflectivity was found in convective cases, particularly in convective samples from the lower part of the atmosphere. In this case, the mean difference between PR and corrected GR reflectivity was -1.88 dBZ. The PR-GR bias was found to increase with the amount of PR attenuation correction applied, with the PR-GR bias reaching -3.07 dBZ in cases where the attenuation correction applied is greater than 6 dBZ. Additional analysis indicated that the version 6 TRMM PR retrieval algorithm underestimates rainfall in case of convective rain in the lower part of the atmosphere by 30%-40%.

Schwaller, Mathew R.↗

Expert system verification and validation study: ES V/V Workshop

The primary purpose of this document is to build a foundation for applying principles of verification and validation (V&V) of expert systems. To achieve this, some V&V as applied to conventionally implemented software is required. Part one will discuss the background of V&V from the perspective of (1) what is V&V of software and (2) V&V's role in developing software. Part one will also overview some common analysis techniques that are applied when performing V&V of software. All of these materials will be presented based on the assumption that the reader has little or no background in V&V or in developing procedural software. The primary purpose of part two is to explain the major techniques that have been developed for V&V of expert systems.

French, Scott↗

Expert system verification and validation study

Five workshops on verification and validation (V&V) of expert systems (ES) where taught during this recent period of performance. Two key activities, previously performed under this contract, supported these recent workshops (1) Survey of state-of-the-practice of V&V of ES and (2) Development of workshop material and first class. The first activity involved performing an extensive survey of ES developers in order to answer several questions regarding the state-of-the-practice in V&V of ES. These questions related to the amount and type of V&V done and the successfulness of this V&V. The next key activity involved developing an intensive hands-on workshop in V&V of ES. This activity involved surveying a large number of V&V techniques, conventional as well as ES specific ones. In addition to explaining the techniques, we showed how each technique could be applied on a sample problem. References were included in the workshop material, and cross referenced to techniques, so that students would know where to go to find additional information about each technique. In addition to teaching specific techniques, we included an extensive amount of material on V&V concepts and how to develop a V&V plan for an ES project. We felt this material was necessary so that developers would be prepared to develop an orderly and structured approach to V&V. That is, they would have a process that supported the use of the specific techniques. Finally, to provide hands-on experience, we developed a set of case study exercises. These exercises were to provide an opportunity for the students to apply all the material (concepts, techniques, and planning material) to a realistic problem.

French, Scott W.↗

Wind Energy Accomplishments and Year-End Performance Report: Fiscal Year 2023

As the United States' largest source of renewable energy, wind is already playing a vital role in the nation's shift to electricity generated from sustainable resources. Scientists, engineers, and analysts at the U.S. Department of Energy's (DOE's) National Renewable Energy Laboratory (NREL) are propelling our country closer to this clean energy future with new efficient, reliable, and cost-competitive wind technologies and deployment strategies. In Fiscal Year 2023 (FY 2023), NREL received national acclaim for recent wind technology breakthroughs, applauded sustained decades of progress in wind energy research, and heralded new initiatives to support the next generation of wind development. This report and NREL's achievements of the last year set the stage for innovative research to come. Two NREL software innovations used to assess wind technology options were recognized with R&D 100 Awards. The Renewable Energy Potential (reV) model helps planners, developers, and researchers calculate wind energy capacity, generation, and cost for specific facilities, fleets and scenarios. NREL's Simulation and Emulation for Advanced Systems validates transmission and distribution solutions to minimize implementation risks. Both of these tools can be applied to a range of renewable solutions to cut costs and improve the reliability of systems in even the most remote locations. The laboratory commemorated landmark anniversaries for wind energy research facilities and programs managed by NREL. The National Wind Technology Center (NWTC) celebrated 30 years as a world-class hub for renewable energy research. An important component of the NWTC on NREL's Flatirons Campus, the one-of-a-kind 7-megawatt (MW) Controllable Grid Interface wind energy research apparatus, turned 10 this year. The Collegiate Wind Competition completed its tenth annual competition in May 2023. Six years after the grand challenges in wind energy science were first compiled, NREL brought together more than 100 wind energy experts from 15 countries to revisit the field's most pressing research needs. Other key new research initiatives examined ways to simultaneously address the needs for skilled wind energy workers and equitable job opportunities. NREL released the first national-level report evaluating offshore wind industry workforce gaps and ways to build a large, diverse pool of job candidates. The lab also co-hosted the International Partnering Forum's Offshore Wind Workforce Summit as part of its ongoing efforts to address the special challenges of that industry sector. NREL research and development (R&D) for the DOE Wind Energy Technologies Office (WETO) continues to build momentum in its efforts to combat climate change, create clean energy jobs, and promote energy justice. This report provides more detail on these top achievements and other accomplishments made by NREL and its partners during FY 2023 (between Oct. 1, 2022, and Sept. 30, 2023).

accomplishments↗

Oxide_Oxide Ceramic Matrix Composite (CMC) Exhaust Mixer Development in the NASA Environmentally Responsible Aviation (ERA) Project

Rolls-Royce North American Technologies, Inc. (LibertyWorksLW) began considering the development of CMC exhaust forced mixers in 2008, as a means of obtaining reduced weight and hotter operating temperature capability, while minimizing shape distortion during operation, which would improve mixing efficiency and reduce fuel burn. Increased component durability, enhanced ability to fabricate complex-shaped components, and engine noise reduction are other potential advantages of CMC mixers (compared to metallic mixers). In 2010, NASA was pursuing the reduction of NOx emissions, fuel burn, and noise from turbine engines in Phase I of the Environmentally Responsible Aviation (ERA) Project. ERA subtasks, including those focused on CMC components, were formulated with the goal of maturing technology from proof of concept validation (TRL 3) to a systemsubsystem or prototype demonstration in a relevant environment (TRL 6). In April 2010, the NASA Glenn Research Center (GRC) and LibertyWorks jointly initiated a CMC Exhaust System Validation Program within the ERA Project, teaming on CMC exhaust mixer development for subsonic jet engines capable of operating with increased performance. Our initial focus was on designing, fabricating, and characterizing the thrust and acoustic performance of a roughly quarter-scale 16-lobe oxide oxide CMC mixer and tail cone along with a conventional low bypass exhaust nozzle. Support Services, LLC (Allendale, MI) and ATK COI Ceramics, Inc. (COIC, in San Diego, CA) supported the design of a subscale nozzle assembly that consisted of an oxide oxide CMC mixer and center body, with each component mounted on a metallic attachment ring. That design was based upon the operating conditions a mixer would experience in a turbofan engine. Validation of the aerodynamic and acoustic performance of the subscale mixer via testing and the achievement of TRL 4 encouraged the NASALWCOIC team to move to the next phase where a full scale CMC mixer sized for a RR AE3007 engine and a compatible attachment flange were designed, followed by CMC component fabrication by COIC, and vibration testing at GRC under conditions simulating the structural and dynamic environment encountered during engine operation. AFRL (WPAFB) supported this testing by performing 3D laser vibrometry to identify the mixer mode shapes and modal frequencies. The successful fabrication and testing of such a component has been achieved. The CMC mixer demonstrated good durability during vibration testing at room and elevated temperature (TRL5). This has cleared the article for a ground-based test on a Rolls-Royce AE3007 engine, where the performance and benefits of the component can be further assessed.

exhaust nozzles↗

Results of a 3-day Pilot Study to Validate Planetary Prebreathe Protocols Using a 56.5 kPa 34% O2, 66% N2 Saturation Cabin Atmosphere

INTRODUCTION: Apollo missions used 100% O2 cabin atmospheres which effectively eliminated the risk of decompression sickness (DCS) during extravehicular activities (EVAs, ‘spacewalks’); however, this atmosphere presented a flammability risk that is no longer acceptable to NASA. Denitrogenation prebreathe protocols used to mitigate DCS risk for Space Shuttle and International Space Station EVAs are validated for the microgravity environment, but the significantly increased risk of DCS during equivalent ambulatory surface EVAs make these protocols inapplicable to planetary/Lunar missions. An “exploration atmosphere” of 56.5 kPa (8.2 psia), 34% O2, 66% N2 has been recommended by NASA for future Moon and Mars missions as a compromise that balances subsequent pre-EVA prebreathe duration, hypoxia, and flammability risk, assuming a 29.6 kPa (4.3 psi) spacesuit. Prebreathe validation studies was initiated utilizing a three-story 6m diameter hypobaric chamber at NASA’s Johnson Space Center. Here, we report the results of a 3-day human-in-the-loop system checkout. METHODS: Six volunteers acclimated to the 56.6kPa/34% O2 66% N2 environment for 48hrs prior to conducting a 20-minute prebreathe and a 6-hour simulated EVA at 34kPa/85% O2 / 15% N2. The EVA simulation was designed to include tasks that are physically and ergonomically representative of future planetary EVAs. Decompression stress was evaluated by serial doppler and echocardiographs, as well as by clinical features of DCS signs/symptoms. RESULTS AND DISCUSSION: Preliminary data analysis noted venous gas emboli (VGE) in 3 of 6 subjects, with peak Grade II VGE by Doppler and peak E-B score of 5 by cardiac ultrasonography. No volunteers were diagnosed with DCS during this initial test. No acute hypoxic symptoms were noted. Musculoskeletal and gastrointestinal complaints were noted, likely associated with the exercise load and the food system. Validation of exploration prebreathe protocols has since been initiated with an 11-day saturation test using the same facility and protocol.

Alejandro Garbino↗

Adaptive Neuro Fuzzy Inference System for Cyber-Intrusion Detection in a Smart Grid

The evolution of the power grid has brought increasing deployment of advance metering infrastructure, penetration of intelligent electronic devices, and integration of physical power system components with information and communications technologies. With the fast-expanding connectivity, cyber vulnerabilities arise due to the use of internet-based communication systems. These systems are targets of cyber-intrusions which attempt to disturb the normal power system functions. Traditional intrusion detection algorithms have been developed without an explicit model of the cyber components. In this paper, an algorithm to detect false data injections in the power system is proposed considering both cyber and physical models of the power system. The algorithm is based on an Adaptive Neuro Fuzzy Inference System (ANFIS) which collects information from state variables of the cyber-physical system to meet the performance requirements of the grid. Simulations of the proposed approach using the IEEE 13-bus test system validate the effectiveness of this artificial intelligence-based algorithm.

Adaptive Neuro Fuzzy Inference System (ANFIS), cyb↗

Ground and Space Radar Volume Matching and Comparison Software

This software enables easy comparison of ground- and space-based radar observations. The software was initially designed to compare ground radar reflectivity from operational, ground based Sand C-band meteorological radars with comparable measurements from the Tropical Rainfall Measuring Mission (TRMM) satellite s Precipitation Radar (PR) instrument. The software is also applicable to other ground-based and space-based radars. The ground and space radar volume matching and comparison software was developed in response to requirements defined by the Ground Validation System (GVS) of Goddard s Global Precipitation Mission (GPM) project. This software innovation is specifically concerned with simplifying the comparison of ground- and spacebased radar measurements for the purpose of GPM algorithm and data product validation. This software is unique in that it provides an operational environment to routinely create comparison products, and uses a direct geometric approach to derive common volumes of space- and ground-based radar data. In this approach, spatially coincident volumes are defined by the intersection of individual space-based Precipitation Radar rays with the each of the conical elevation sweeps of the ground radar. Thus, the resampled volume elements of the space and ground radar reflectivity can be directly compared to one another.

Morris, Kenneth↗

Development of NASA/DOE NTP System Performance Models

A critical enabling technology in the evolutionary development of Nuclear Thermal Propulsion (NTP) is the ability to predict the system performance under a variety of operating conditions. The ability to predict the system performance is critical for mission analysis and for control subsystem testing, as well as for the modeling of various failure modes. Performance must be accurately predicted during steady-state and transient operation, such as start-up, shut-down and after-cooling. The development and application of verified and validated system models has the potential to reduce testing, cost and time required for the technology to again reach flight-ready status. An integrated NASA/DOE team was formed in late 1991 to develop and implement a strategy for modeling NTP systems. It is the intent of the interagency team to develop several levels of computer programs, which vary in detail, to simulate NTP systems based on either prismatic, particle or advanced fuel forms. This paper presents an overview of the models under development by the interagency team. In addition, the status of the development and validation efforts for the Level 1 steady-state parametric model is discussed.

Walton, James T.↗

Designing to Sample the Unknown: Lessons from OSIRIS-REx Project Systems Engineering

On September 8, 2016, the third NASA New Frontiers mission launched on an Atlas V 411. The Origins, Spectral Interpretation, Resource Identification, Security-Regolith Explorer (OSIRIS-REx) will rendezvous with asteroid Bennu in 2018, collect a sample in 2020, and return that sample to Earth in September 2023. The development team has overcome a number of challenges in order to design and build a system that will make contact with an unexplored, airless, low-gravity body. This paper will provide an overview of the mission, then focus in on the system-level challenges and some of the key system-level processes. Some of the lessons here are unique to the type of mission, like discussion of operating at a largely-unknown, low-gravity object. Other lessons, particularly from the build phase, have broad implications. The OSIRIS-REx risk management process was particularly effective in achieving an on-time and under-budget development effort. The systematic requirements management and verification and the system validation also helped identify numerous potential problems. The final assessment of the OSIRIS-REx performance will need to wait until the sample is returned in 2023, but this post-launch assessment will capture some of the key systems-engineering lessons from the development team.

Asteroid↗

Hardware-Based Demonstration of Temperature Control Functions for Reactor Systems

Establishing autonomy in reactor control systems has become essential for the expansion of nuclear technologies. Thermal regulation in particular remains crucial for maintaining stable operation and ensuring the integrity of fuel. To alleviate public skepticism of the safety of nuclear reactors, demonstrating control over this key factor is pivotal. Utilizing electric heat pads to simulate the heat released in a reactor core, thermocouples for temperature monitoring, and an Arduino micro programmable logic controller (PLC) for control, a hardware-based demonstration of a reactor heating system validates the efficacy of reactor control over this key parameter. To improve precision, a proportional-integral-derivative (PID) algorithm was implemented in the heating control loop to ensure meticulous control of reactor functions. In addition, the integration of this physical system with a digital simulator tool such as RELAP5-3D establishes a foundation for a comprehensive testing environment. This allows for a refinement of temperature control under various simulated reactor conditions, bringing another layer of reliability to the operation of the system. By facilitating a physical demonstration of reactor thermal management and control strategies, this project provides a foundation for expanded testing and educational outreach. Ultimately, this system advances the broader goal of demonstrating the safety and viability of autonomous reactor operations, contributing to public trust and future reactor deployment.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Improvements of Nuclear Data Evaluations for Lead Isotopes in Support of Next Generation Lead-Cooled Fast Systems

The neutron evaluation of the isotopes that comprise natural lead were undertaken as a part of DOE-NEUP Project #19-16739. The goal of the project was to update the neutron cross sections to account for new differential measurements and incorporate the most up-to-date physics. Shortcomings in the lead cross sections was made known by several independent reports. The work performed here repeated the simulation of all the “benchmark” validation systems and concluded that the major issue is the scattering cross sections in the major lead isotopes above 100 keV. Re-evaluation of 206,207,208 Pb included both the resolved resonance region and fast region evaluations of the cross sections. Combined these regions cover energies from thermal to 20 MeV. The most drastic improvement is the resolved resonance region evaluation of 208 Pb which is now extended from 1.0 to 1.5 MeV. Parameterization of these resonances in the R-matrix provides a superior reconstruction of not only the experimental cross section but also the scattering distributions via the Blatt-Biedenharn formalism. Fast region evaluations of the three major isotopes were done to include new inelastic experimental data from the neutron Time-of-Flight facility at CERN. The culmination of all the changes to the cross section is a drastic improvement in the scattering kernel as shown in Rensselaer Polytechnic Institute (RPI) Quasi-Differential scattering measurements and improved prediction of keff for fast integral experiments. Alongside the new cross sections, new nuclear data covariance (uncertainties) have been computed and are included in the evaluation. Little is changed in the magnitude of the uncertainties but the correlations within the covariance display non-trivial changes. The new evaluations of 206,207,208 Pb have been submitted to the National Nuclear Data Center to be included in the ENDF/B-VIII.1 library. While the cross sections have been updated extensively, knowledge and modeling of the cross sections between 1.0 and 3.0 MeV for the isotopes remain a challenge. Most notably is the double differential elastic cross section for 208 Pb and 206 Pb. New quasi-differential measurements for pure samples of these two nuclei would go a long way in reducing compensating errors in the evaluations. Qualitatively, the project has produced a prosperous collaboration between the nuclear data group at RPI with staff scientists at Brookhaven National Laboratory, Naval Nuclear Laboratory, Oak Ridge National Laboratory, Los Alamos National Laboratory, Lawrence Livermore National Laboratory, and Sandia National Laboratories. Quantitatively this is reflected in seven conference presentations, at least one journal submission, and one doctoral thesis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Formal Methods for Trusted Space Autonomy, Boon or Bane?

Trusted Space Autonomy is challenging in that space systems are complex artifacts deployed in a high stakes environment with complicated operational settings. Thus far these challenges have been met using the full arsenal of tools: formal methods, informal methods, testing, runtime techniques, and operations processes. Using examples from previous deployments of autonomy to the Remote Agent on DS-1, Autonomous Sciencecraft on EO-1, WATCH on MER, IPEX, AEGIS on MER, MSL, and M2020, and the M2020 Onboard planner, we discuss how each of these approaches have been used to enable successful deployment of autonomy. We next focus on relatively limited use of formal methods (both prior to deployment and runtime methods). From the needs perspective, formal methods represent the best chance for reliable autonomy as testing, informal methods, and operations accommodations do not scale well with increasing complexity of the autonomous system. However from the practice perspective, formal methods have been limited in their application due to difficulty in eliciting formal specifications and challenges in representing complex constraints such as metric time and resources. We discuss some of these challenges as well as the opportunity to extend formal and informal methods into runtime validation systems.

Chien, Steve↗