Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Global Aerosol Profiling by Orbital Lidar, GLAS Results and Validation

The Geoscience Laser Altimeter System (GLAS) launched in 2003 is the first polar orbiting satellite lidar. The instrument was designed for high performance observations of the distribution and optical scattering cross sections of clouds and aerosol. GLAS is approaching six months of on orbit data operation. These data from thousands of orbits illustrate the ability of space lidar to accurately and dramatically measure the height distribution of global aerosol to an unprecedented degree. There were many intended science applications of the GLAS data and significant results have already been realized. profiling is a fundamentally new measurement from space with multiple applications. A most important aerosol application is providing input to global aerosol generation and transport models. Another is improved measurement of aerosol optical depth. A main approach to verify the aerosol optical depth retrieval is comparison to surface measurements by Aeronet. A special feature of the GLAS satellite bus is to rapidly point the lidar instrument at off nadir targets with less than 100 m accuracy. About a dozen selected Aeronet sites were pointed at whenever the G U S lidar came within 5 degrees of zenith. These plus a more general comparison to nearby sites support the G U S data product values. In addition the GUS data can be used to add vertical distribution information to Aeronet aerosol measurements.. As an EOS project instrument, GLAS data products are openly available to the science community. First year results from G U S are summarized.

Spinhirne, J. D.↗

Handling Qualities Considerations in Control Allocation for Multicopters

Due to multicopters’ role in advanced air mobility, there has been an increasing interest in handling qualities. This paper investigates the effect of control allocation of multicopters on handling qualities. Typically, multicopter aircraft are trimmed with equal speed on each rotor. The force generated by each rotor can be modeled, where thrust and torque of the rotor are related to the square of the rotor speed. The dynamic equations indicate that trimming pairs of motors at different RPM results in an increase of control effectiveness in the associated axis, improving bandwidth and disturbance rejection. A tradeoff occurs where power usage is no longer optimized, but handling qualities are improved in that control axis. A blade element model for multicopter, RMAC, was used to simulate how this off-nominal control allocation would affect the dynamics of a multicopter. System identification flight tests were used to validate the trends seen in RMAC. Control systems were optimized to provide improved disturbance rejection bandwidth in the axis associated with increased rotational speed. Unmanned mission task elements were performed in flight test, showing improved tracking in the lateral axis by using off-nominal mixing to increase trim speed on the rolling motors.

Handling Qualities↗

Modeling and Simulation Plans in Support of Low Cost, Size, Weight, and Power Surveillance Systems for Detecting and Tracking Non-Cooperative Aircraft

RTCA Special Committee (SC) 228 has initiated a second phase for the development of minimum operational performance standards (MOPS) for UAS detect and avoid (DAA) systems. Technologies to enable UAS with less available Size, Weight, and Power (SWaP) will be considered. RTCA SC-228 has established sub-working groups and one of the sub-working groups is focused on aligning modeling and simulations activities across all participating committee members. This briefing will describe NASAs modeling and simulation plans for the development of performance standards for low cost, size, weight, and power (C-SWaP) surveillance systems that detect and track non-cooperative aircraft. The briefing will also describe the simulation platform NASA intends to use to support end-to-end verification and validation for these DAA systems. Lastly, the briefing will highlight the experiment plan for our first simulation study, and provide a high-level description of our future flight test plans. This briefing does not contain any results or data.

surveillance↗

Validation of Carbon Trace Gas Profile Retrievals from the NOAA-Unique Combined Atmospheric Processing System for the Cross-Track Infrared Sounder

This paper provides an overview of the validation of National Oceanic and Atmospheric Administration (NOAA) operational retrievals of atmospheric carbon trace gas profiles, specifically carbon monoxide (CO), methane (CH4) and carbon dioxide (CO2), from the NOAA-Unique Combined Atmospheric Processing System (NUCAPS), a NOAA enterprise algorithm that retrieves atmospheric profile environmental data records (EDRs) under global non-precipitating (clear to partly cloudy) conditions. Vertical information about atmospheric trace gases is obtained from the Cross-track Infrared Sounder (CrIS), an infrared Fourier transform spectrometer that measures high resolution Earth radiance spectra from NOAA operational low earth orbit (LEO) satellites, including the Suomi National Polar-orbiting Partnership (SNPP) and follow-on Joint Polar Satellite System (JPSS) series beginning with NOAA-20. The NUCAPS CO, CH4, and CO2 profile EDRs are rigorously validated in this paper using well-established independent truth datasets, namely total column data from ground-based Total Carbon Column Observing Network (TCCON) sites, and in situ vertical profile data obtained from aircraft and balloon platforms via the NASA Atmospheric Tomography (ATom) mission and NOAA AirCore sampler, respectively. Statistical analyses using these datasets demonstrate that the NUCAPS carbon gas profile EDRs generally meet JPSS Level 1 global performance requirements, with the absolute accuracy and precision of CO 5% and 15%, respectively, in layers where CrIS has vertical sensitivity; CH4 and CO2 product accuracies are both found to be within ±1%, with precisions of ≈1.5% and ⪅0.5%, respectively, throughout the tropospheric column.

satellite cal/val; error analysis; greenhouse gase↗

End-to-End Demonstrator of the Safe Affordable Fission Engine (SAFE) 30: Power Conversion and Ion Engine Operation

The Safe Affordable Fission Engine (SAFE) test series addresses Phase 1 Space Fission Systems issues in particular non-nuclear testing and system integration issues leading to the testing and non-nuclear demonstration of a 400-kW fully integrated flight unit. The first part of the SAFE 30 test series demonstrated operation of the simulated nuclear core and heat pipe system. Experimental data acquired in a number of different test scenarios will validate existing computational models, demonstrated system flexibility (fast start-ups, multiple start-ups/shut downs), simulate predictable failure modes and operating environments. The objective of the second part is to demonstrate an integrated propulsion system consisting of a core, conversion system and a thruster where the system converts thermal heat into jet power. This end-to-end system demonstration sets a precedent for ground testing of nuclear electric propulsion systems. The paper describes the SAFE 30 end-to-end system demonstration and its subsystems.

Hrbud, Ivana↗

An End-To-End Test of A Simulated Nuclear Electric Propulsion System

The Safe Affordable Fission Engine (SAFE) test series addresses Phase I Space Fission Systems issues in it particular non-nuclear testing and system integration issues leading to the testing and non-nuclear demonstration of a 400-kW fully integrated flight unit. The first part of the SAFE 30 test series demonstrated operation of the simulated nuclear core and heat pipe system. Experimental data acquired in a number of different test scenarios will validate existing computational models, demonstrated system flexibility (fast start-ups, multiple start-ups/shut downs), simulate predictable failure modes and operating environments. The objective of the second part is to demonstrate an integrated propulsion system consisting of a core, conversion system and a thruster where the system converts thermal heat into jet power. This end-to-end system demonstration sets a precedent for ground testing of nuclear electric propulsion systems. The paper describes the SAFE 30 end-to-end system demonstration and its subsystems.

VanDyke, Melissa↗

Upgrades at the NASA Langley Research Center National Transonic Facility

Several projects have been completed or are nearing completion at the NASA Langley Research Center (LaRC) National Transonic Facility (NTF). The addition of a Model Flow-Control/Propulsion Simulation test capability to the NTF provides a unique, transonic, high-Reynolds number test capability that is well suited for research in propulsion airframe integration studies, circulation control high-lift concepts, powered lift, and cruise separation flow control. A 1992 vintage Facility Automation System (FAS) that performs the control functions for tunnel pressure, temperature, Mach number, model position, safety interlock and supervisory controls was replaced using current, commercially available components. This FAS upgrade also involved a design study for the replacement of the facility Mach measurement system and the development of a software-based simulation model of NTF processes and control systems. The FAS upgrades were validated by a post upgrade verification wind tunnel test. The data acquisition system (DAS) upgrade project involves the design, purchase, build, integration, installation and verification of a new DAS by replacing several early 1990's vintage computer systems with state of the art hardware/software. This paper provides an update on the progress made in these efforts. See reference 1.

Paryz, Roman W.↗

Generation After Next Propulsor Research: Robust Design for Embedded Engine Systems

The National Aeronautics and Space Administration, United Technologies Research Center and Virginia Polytechnic and State University have contracted to pursue multi-disciplinary research into boundary layer ingesting (BLI) propulsors for generation after next environmentally responsible subsonic fixed wing aircraft. This Robust Design for Embedded Engine Systems project first conducted a high-level vehicle system study based on a large commercial transport class hybrid wing body aircraft, which determined that a 3 to 5 percent reduction in fuel burn could be achieved over a 7,500 nanometer mission. Both pylon-mounted baseline and BLI propulsion systems were based on a low-pressure-ratio fan (1.35) in an ultra-high-bypass ratio engine (16), consistent with the next generation of advanced commercial turbofans. An optimized, coupled BLI inlet and fan system was subsequently designed to achieve performance targets identified in the system study. The resulting system possesses an inlet with total pressure losses less than 0.5%, and a fan stage with an efficiency debit of less than 1.5 percent relative to the pylon-mounted, clean-inflow baseline. The subject research project has identified tools and methodologies necessary for the design of next-generation, highly-airframe-integrated propulsion systems. These tools will be validated in future large-scale testing of the BLI inlet / fan system in NASA's 8 foot x 6 foot transonic wind tunnel. In addition, fan unsteady response to screen-generated total pressure distortion is being characterized experimentally in a JT15D engine test rig. These data will document engine sensitivities to distortion magnitude and spatial distribution, providing early insight into key physical processes that will control BLI propulsor design.

Arend, David J.↗

Using A Model-Based Systems Engineering Approach For Exploration Medical System Development

NASA's Human Research Program's Exploration Medical Capabilities (ExMC) element is defining the medical system needs for exploration class missions. ExMC's Systems Engineering (SE) team will play a critical role in successful design and implementation of the medical system into exploration vehicles. The team's mission is to "Define, develop, validate, and manage the technical system design needed to implement exploration medical capabilities for Mars and test the design in a progression of proving grounds." Development of the medical system is being conducted in parallel with exploration mission architecture and vehicle design development. Successful implementation of the medical system in this environment will require a robust systems engineering approach to enable technical communication across communities to create a common mental model of the emergent engineering and medical systems. Model-Based Systems Engineering (MBSE) improves shared understanding of system needs and constraints between stakeholders and offers a common language for analysis. The ExMC SE team is using MBSE techniques to define operational needs, decompose requirements and architecture, and identify medical capabilities needed to support human exploration. Systems Modeling Language (SysML) is the specific language the SE team is utilizing, within an MBSE approach, to model the medical system functional needs, requirements, and architecture. Modeling methods are being developed through the practice of MBSE within the team, and tools are being selected to support meta-data exchange as integration points to other system models are identified. Use of MBSE is supporting the development of relationships across disciplines and NASA Centers to build trust and enable teamwork, enhance visibility of team goals, foster a culture of unbiased learning and serving, and be responsive to customer needs. The MBSE approach to medical system design offers a paradigm shift toward greater integration between vehicle and the medical system and directly supports the transition of Earth-reliant ISS operations to the Earth-independent operations envisioned for Mars. Here, we describe the methods and approach to building this integrated model.

Hanson, A.↗

NASA HRP Food and Nutrition Risk Strategy

The Human Health Countermeasures (HHC) Element of NASA’s Human Research Program (HRP), along with other organizations within NASA, conduct research and capability developments to buy down the risk of performance decrement and crew illness due to inadequate food and nutrition. Food and nutrition are critical for health and performance both in low Earth orbit and on exploration missions. On the International Space Station (ISS), crewmembers share a defined set of pantry foods, and have limited preference and shelf-life foods (e.g. fruits and vegetables) from resupply missions. Exploration design reference missions (DRMs) will likely be more constrained than missions to ISS, where those crewmembers would be subject to a more restricted food system due to resource limitations. HRP food and nutrition research consists of studies to close the following research gaps: determination of the nutritional requirements to maintain health and performance for the defined DRMs, determining the nutrient content, safety, and acceptability of the spaceflight food system specific to DRM and vehicle constraints, development of countermeasures either within or in addition to the food system to mitigate decrements to health and performance by DRM, and the validation and integration of food system countermeasures in analogs and in flight. The current spaceflight food system is shelf-stable, consisting of freeze-dried foods, thermostabilized foods, natural form foods, and powdered beverages. Crops represent a food system countermeasure that has the potential to supplement the pre-packaged food system. As an applied research program, HRP goals for crop research are centered around three main themes: nutrition, safety, and acceptability. As crops advance through Crop Readiness Level evaluations, HHC partners with the sponsoring organization to ensure that HRP goals are met for crops to be consumed in spaceflight.

food↗

Extending Validated Human Performance Models to Explore NextGen Concepts

To meet the expected increases in air traffic demands, NASA and FAA are researching and developing Next Generation Air Transportation System (NextGen) concepts. NextGen will require substantial increases in the data available to pilots on the flight deck (e.g., weather,wake, traffic trajectory predictions, etc.) to support more precise and closely coordinated operations (e.g., self-separation, RNAV/RNP, and closely spaced parallel operations, CSPOs). These NextGen procedures and operations, along with the pilot's roles and responsibilities, must be designed with consideration of the pilot's capabilities and limitations. Failure to do so will leave the pilots, and thus the entire aviation system, vulnerable to error. A validated Man-machine Integration and design Analysis System (MIDAS) v5 model was extended to evaluate anticipated changes to flight deck and controller roles and responsibilities in NextGen approach and Land operations. Compared to conditions when the controllers are responsible for separation on decent to land phase of flight, the output from these model predictions suggest that the flight deck response time to detect the lead aircraft blunder will decrease, pilot scans to the navigation display will increase, and workload will increase.

Gore, Brian Francis↗

Verification and Validation of a Conceptual Model of the Auto-Rigging Payload Handling and Off-Loading System Using LEGO Technic System and Three-Dimensional Printed Parts

A conceptual model (CM) can be used to validate a concept in modeling and simulation life cycles. During the 2020-2022 Coronavirus disease 2019 (COVID-19) pandemic, for employee safety NASA implemented center closures and mandatory telework for the entire workforce. During this challenging time, engineers and researchers at NASA Langley Research Center (LaRC) looked for safe and innovative approaches and methods to continue the development of CMs for various projects. Engineers and researchers at LaRC researched Auto-Rigging Payload Handling and Off-Loading System (ARPHOLS) for payload handing and off-loading a system on an inclined lunar lander deck. In this paper, the development of a CM and the verification and validation of a conceptual idea for ARPHOLS using a LEGO Technic system and three-dimensional printed parts is presented.

Design↗

OASSIS: Onboard Adaptive Safe-site Identification System Y3

The OASSIS Year 3 project continues to innovate with three goals: 1) transition to a generic configuration compatible with GNC flight software, 2) implement a new, computationally-efficient TRN algorithm for lunar landing, and 3) integrate with the a HWIL testbed to validate lunar landing GNC systems. This project enables lunar lander GNC flight software to be tested dynamically without the need of a costly flight campaign and without the risk of catastrophic hardware loss. Additionally, the TRN algorithm development and testing enhances the state-of-the-art in pinpoint landing navigation, ultimately improving the overall landing accuracy, safety, and reliability of a crewed lunar landing mission.

James S Mccabe↗

A Spatio-Temporal Approach for Global Validation and Analysis of MODIS Aerosol Products

With the launch of the MODIS sensor on the Terra spacecraft, new data sets of the global distribution and properties of aerosol are being retrieved, and need to be validated and analyzed. A system has been put in place to generate spatial statistics (mean, standard deviation, direction and rate of spatial variation, and spatial correlation coefficient) of the MODIS aerosol parameters over more than 100 validation sites spread around the globe. Corresponding statistics are also computed from temporal subsets of AERONET-derived aerosol data. The means and standard deviations of identical parameters from MOMS and AERONET are compared. Although, their means compare favorably, their standard deviations reveal some influence of surface effects on the MODIS aerosol retrievals over land, especially at low aerosol loading. The direction and rate of spatial variation from MODIS are used to study the spatial distribution of aerosols at various locations either individually or comparatively. This paper introduces the methodology for generating and analyzing the data sets used by the two MODIS aerosol validation papers in this issue.

Ichoku, Charles↗

Experimental Evaluation of Verification and Validation Tools on Martian Rover Software

To achieve its science objectives in deep space exploration, NASA has a need for science platform vehicles to autonomously make control decisions in a time frame that excludes intervention from Earth-based controllers. Round-trip light-time is one significant factor motivating autonomy capability, another factor is the need to reduce ground support operations cost. An unsolved problem potentially impeding the adoption of autonomy capability is the verification and validation of such software systems, which exhibit far more behaviors (and hence distinct execution paths in the software) than is typical in current deepspace platforms. Hence the need for a study to benchmark advanced Verification and Validation (V&V) tools on representative autonomy software. The objective of the study was to access the maturity of different technologies, to provide data indicative of potential synergies between them, and to identify gaps in the technologies with respect to the challenge of autonomy V&V. The study consisted of two parts: first, a set of relatively independent case studies of different tools on the same autonomy code, second a carefully controlled experiment with human participants on a subset of these technologies. This paper describes the second part of the study. Overall, nearly four hundred hours of data on human use of three different advanced V&V tools were accumulated, with a control group that used conventional testing methods. The experiment simulated four independent V&V teams debugging three successive versions of an executive controller for a Martian Rover. Defects were carefully seeded into the three versions based on a profile of defects from CVS logs that occurred in the actual development of the executive controller. The rest of the document is structured a s follows. In section 2 and 3, we respectively describe the tools used in the study and the rover software that was analyzed. In section 4 the methodology for the experiment is described; this includes the code preparation, seeding of defects, participant training and experimental setup. Next we give a qualitative overview of how the experiment went from the point of view of each technology; model checking (section 5), static analysis (section 6), runtime analysis (section 7) and testing (section 8). The find section gives some preliminary quantitative results on how the tools compared.

Brat, Guillaume↗

Acoustic Predictions of Manned and Unmanned Rotorcraft Using the Comprehensive Analytical Rotorcraft Model for Acoustics (CARMA) Code System

The Comprehensive Analytical Rotorcraft Model for Acoustics (CARMA) is being developed under the Quiet Aircraft Technology Project within the NASA Vehicle Systems Program. The purpose of CARMA is to provide analysis tools for the design and evaluation of efficient low-noise rotorcraft, as well as support the development of safe, low-noise flight operations. The baseline prediction system of CARMA is presented and current capabilities are illustrated for a model rotor in a wind tunnel, a rotorcraft in flight and for a notional coaxial rotor configuration; however, a complete validation of the CARMA system capabilities with respect to a variety of measured databases is beyond the scope of this work. For the model rotor illustration, predicted rotor airloads and acoustics for a BO-105 model rotor are compared to test data from HART-II. For the flight illustration, acoustic data from an MD-520N helicopter flight test, which was conducted at Eglin Air Force Base in September 2003, are compared with CARMA full vehicle flight predictions. Predicted acoustic metrics at three microphone locations are compared for limited level flight and descent conditions. Initial acoustic predictions using CARMA for a notional coaxial rotor system are made. The effect of increasing the vertical separation between the rotors on the predicted airloads and acoustic results are shown for both aerodynamically non-interacting and aerodynamically interacting rotors. The sensitivity of including the aerodynamic interaction effects of each rotor on the other, especially when the rotors are in close proximity to one another is initially examined. The predicted coaxial rotor noise is compared to that of a conventional single rotor system of equal thrust, where both are of reasonable size for an unmanned aerial vehicle (UAV).

Boyd, D. Douglas, Jr.↗

NASA's Commercial Crew Program, The Next Step in U.S. Space Transportation

The Commercial Crew Program (CCP) is leading NASA's efforts to develop the next U.S. capability for crew transportation and rescue services to and from the International Space Station (ISS) by the mid-decade timeframe. The outcome of this capability is expected to stimulate and expand the U.S. space transportation industry. NASA is relying on its decades of human space flight experience to certify U.S. crewed vehicles to the ISS and is doing so in a two phase certification approach. NASA Certification will cover all aspects of a crew transportation system, including development, test, evaluation, and verification; program management and control; flight readiness certification; launch, landing, recovery, and mission operations; sustaining engineering and maintenance/upgrades. To ensure NASA crew safety, NASA Certification will validate technical and performance requirements, verify compliance with NASA requirements, validate the crew transportation system operates in appropriate environments, and quantify residual risks.

Mango, Edward J.↗

Tradeoffs When Considering Deep Reinforcement Learning for Contingency Management in Advanced Air Mobility

Air transportation is undergoing a rapid evolution globally with the introduction of Advanced Air Mobility (AAM) and with it comes novel challenges and opportunities for transforming aviation. As AAM operations introduce increasing heterogeneity in vehicle capabilities and density, increased levels of automation are likely necessary to achieve operational safety and efficiency goals. This paper focuses on one example where increased automation has been suggested. Autonomous operations will need contingency management systems that can monitor evolving risk across a span of interrelated (or interdependent) hazards and, if necessary, execute appropriate control interventions via supervised or automated decision making. Accommodating this complex environment may require automated functions (autonomy) that apply artificial intelligence (AI) techniques that can adapt and respond to a quickly changing environment. This paper explores the use of Deep Reinforcement Learning (DRL) which has shown promising performance in complex and high-dimensional environments where the objective can be constructed as a sequential decision-making problem. An extension of a prior formulation of the contingency management problem as a Markov Decision Process (MDP) is presented and uses a DRL framework to train agents that mitigate hazards present in the simulation environment. A comparison of these learning-based agents and classical techniques is presented in terms of their performance, verification difficulties, and development process.

machine learningautonomous systems; flight simulat↗