Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “technology assessment framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

245 records · Page 14

Flight Demonstration of Novel Atmospheric Satellite Concept

The major focus of the Phase II effort described herein is to develop and demonstrate an aircraft capable of autonomously sailing (i.e., to cruise without propulsion or external assistance), and thereby prove that the dual-aircraft platform (DAP) atmospheric satellite concept is potentially viable. This sailing mode of flight was identified as the number-1 enabling technology required for the stratospheric DAP concept (also known as Stratosat) in the NIAC (NASA Innovative Advanced Concept) Phase I effort. No scientific demonstration of this technology has ever been done or documented to our knowledge. This report describes efforts to take a major step towards the sailing mode of flight capability using a single aircraft connected by cable to a moving ground vehicle which uses sufficient crosswind to cruise without propulsion while "pulling" the ground vehicle forward (i.e., without external assistance). The development of a prototype aircraft is described in terms of novel and key hardware and software elements. A specialized prototype aircraft is described, including a novel cable release mechanism, novel "lateron" control surfaces, and a highly-accurate onboard wind measurement system. Additionally, a novel means to safely connect the aircraft to the moving ground vehicle is described involving a fishing rod/reel and integrated load cell. All of these devices were designed and developed in-house and validated in flight testing. Software is developed to provide look-up tables that give the flight condition targets (i.e., 3-D position relative to ground vehicle, forward speed, aircraft orientation, etc.), based on current wind speed and direction. These tables are successfully validated in flight simulation and used onboard the aircraft. High fidelity analysis of the aircraft aerodynamics are described - required to produce accurate target sailing flight conditions. A novel wind tunnel measurement technique is developed to accurately assess the aerodynamics of the ultra-thin cable. A new specialized flight simulator is described which is utilized to develop and verify the flight software required onboard the aircraft, and to support training of pilots for flying the aircraft while tethered to a ground vehicle. The DAP flight simulator was developed within the Matlab-Simulink framework and included detailed treatment of aircraft/cable aerodynamics, cable dynamics, experimentally-derived propeller-motor thrust curves, actuator responsiveness, and realistic air turbulence. The specialized formation flight controller algorithm, developed using this flight simulator, and onboard the aircraft is described. Finally, a novel auto-tuning software is described and verified within the flight simulator that is shown to refine the sailing flight condition targets during flight using an optimization technique involving doublet maneuvers. Virtual flights using the auto-tuning software indicate that the prototype aircraft should be able to reach and hold sailing conditions despite moderate levels of turbulence provided there is sufficient mean wind available. An overview of the flight testing program is provided. Hundreds of short flights were conducted, primarily using a “dead” short runway at Deland Municipal Airport which permitted use of a moving ground vehicle. Additional flight tests at Space Florida’s Shuttle Landing Facility are also described. First year results from these tests in which the aircraft is controlled manually, demonstrated that excessive flight testing would be required for a pilot to learn to sail with visual cues. However, second year results from autonomous flight these tests included successful demonstration of the closed-loop autonomous formation flight capability (i.e., autonomously determine, reach, and hold the required 3-D location relative to the ground vehicle required for sailing). The next step of using the auto-tune software to autonomously refine the aircraft orientation targets to finally achieve sailing remains the primary goal of future work.

Flight↗

Harnessing Systems Engineering Methodology in Using Earth Science Research Data for Real Applications

For the last three decades, Earth science remote sensing technologies have been providing an enormous amount of useful data and information serving to broaden our understanding of the home planet as a system. NASA's Earth science program has deployed about 18 complex satellites and is in the process of defining and launching multiple observing systems in this decade. At the same time, the European Community and many other countries such as Russia, France, India, Japan, and China have also significantly contributed to Earth science research. To date, the majority of such efforts have concentrated on expanding our scientific understanding of the multiple nonlinear and chaotic processes of Earth's behavior. In recent years, legislators and stakeholders have put serious pressure on the science community to devote more attention to making use of scientific results for societal benefit. For instance, there are a number of areas such as energy forecasting, aviation safety, agricultural efficiency, disaster management, air quality and public health that can directly take advantage of Earth science results to analyze and predict large scale problems and conditions. This is becoming even more important now that we live in a global economy interconnected via the internet and transportation systems; regional environmental conditions can have far reaching impact across continental boundaries. These factors dictate requirements for global data that can help us assess and control the devastating problems of famine, water resources, wildfires, human health and more. To do this requires a serious, organized, and systematic approach that transfers fundamental research products to the applied sciences domain. This paper presents a systems engineering and management process that can effectively make such transfer of data to the user community. Examples are presented on how the above decision making framework can help in solving critical problems such as the spread of vector borne diseases, forecasts of harmful algal blooms as well as forest fires and wildfires, and the intercontinental transport of dust storms and pollution.

Habib, Shahid↗

Probabilistic Modeling of a Three-Stage Human Landing System Architecture

Space Policy Directive-1 has led to NASA partnerships with commercial entities on procurement which includes the development of the Human Landing System (HLS) [1]. With the goal of delivering human crew to the lunar surface by 2024, system uncertainties become an important obstacle to the maturation of multiple new, driving technologies and mission concepts of the HLS program. As unmitigated uncertainties have previously led to failed development programs, these risks and their impacts must be understood and handled to ensure program success [2]. Sources of uncertainty include novel engine designs and configurations, increased reliance on cryogenic fluid management(CFM), and refueling technologies—which propagate as high-level performance metrics such as overall propellant mass and engine performance. Also, the occurrence of operational uncertainties—e.g. launch conditions or need to abort during the mission—can cause cascading effects on the rest of the mission that are difficult to definitively quantify, and are outside the scope of control. These concrete examples and other occurrences can be categorized as either epistemic or aleatory uncertainties.Epistemic uncertainty arises due to a lack of knowledge and can be alleviated with design and program maturation. Aleatory uncertainty is due to the inherent randomness of the system and cannot be directly reduced, unlike epistemic uncertainty. Robust design and probabilistic methods can compensate for aleatory effects. A taxonomy of uncertainty is referred to for this work [3]. In this paper, a probabilistic methodology to handle uncertainties has been demonstrated on a three-element HLS concept [1, 4], which allows tracking of current best estimates of the concept and assessment of concept design robustness against uncertainties. A sample case has been completed for this abstract, and an expansion on the methodology will be included in the final paper. This methodology has two key parts: first, the creation of a dynamic architecture model of a three-element HLS concept; and second, its use with surrogate modeling and range estimating techniques to capture and propagate uncertainties. This abstract will cover the basics of the approach used, and further details and justifications will be in the final paper.The mission profile associated with this three-element concept (Fig 1) was modeled as a set of mission events that facilitated mass changes, idles, or spacecraft maneuvers. The mission profile scope starts with each element’s NRHO orbit insertion and aggregation and ends at post-sortie rendezvous with Orion. More detail on the mission profile will be in the final paper. The DYnamic Rocket EQuation Tool (DYREQT), a space systems synthesis and sizing framework used by NASA, was used as the physics framework to model the HLS architecture for applying the probabilistic methodology [5, 6]. Specifically, a parametric representation of the lander, ascent, and transfer elements and the mission profile of each element was established, with vehicle and mission parameters available as inputs to allow for a dynamic model. Each vehicle stage was modeled with high-level performance metrics, using Isp and propellant mass fraction (PMF) to remain parametric. For the probabilistic analysis, uncertainties of interest within the HLS concept were enumerated and represented as parameters within the DYREQT model as inputs for vehicle stages or mission profile events. These parameters were frozen at their nominal values for the purposes of baselining architecture performance and sizing the vehicle appropriately based on reference documentation [1]. Range estimating—a probabilistic method that combines Monte Carlo sampling, focus on critical parameters, and heuristics to assess risk and opportunities—is traditionally used with Mass Equipment Lists (MELs), but has been adapted with operational parameters as well as vehicle parameters in theDYREQT model to capture mission uncertainty alongside vehicle uncertainty [7, 3]. This method was selected due to its application and insight on a system from a bottom-up perspective, independence from historical rules of thumb, and ability to generate sensitivities based on design decisions and uncertainties. As a sample case for the abstract, the boiloff rates of the vehicle elements and the loiter times during the mission (simulating launch time variations and changing window of opportunities) were used with range estimating to provide preliminary results. To perform the range estimation portion of this methodology (depicted in Fig. 3, further details in final paper), the DYREQT model was sampled using a Design of Experiments (DoE) to efficiently explore the architecture design space with respect to the sample set of uncertainty parameters; 5,000 cases via Latin Hypercube Sampling were computed on the DYREQT architecture model. Then, the results were used to create surrogate models, multivariate regressions that can visualize hypercube trends in the design space, of the architecture with respect to the uncertainty parameters. Range estimating was applied to the surrogates instead of the actual models, which saves computational expense due to the bulk of cases needed for the Monte Carlo simulation as part of range estimating. Uncertainty parameters were sampled independently from triangular distributions using the DoE ranges as ‘min’ and ‘max’, and the nominal value as ‘most likely’. Based engineering intuition, some uncertainty parameters are correlated—e.g. if the main propellant has a high boil-off rate, the oxidizer should follow suit as both are related to CFM technology.While a Monte Carlo simulation samples all inputs as independent, the results would show model correlations; thus, it is efficient to sample the inputs as correlated. Using a correlation matrix constructed for the uncertainty parameters, previously independent samples were transformed to perform a Correlated Monte Carlo. A table for the DoE ranges and probability distribution parameters is shown in Table 1, and more details on Correlated Monte Carlo Simulations will be discussed in the final paper. The model’s resulting DoE showed that multivariate polynomial equations fit via least squares method captured its behavior accurately for the sample case. For the Correlated Monte Carlo Simulation, a positive correlation between fuel and oxidizer boiloff rates was used as a demonstration. 10,000 cases were computed with the surrogates and the launched masses for each vehicle element was collated. The results can be displayed in a probability density function (PDF), showing the impact of the uncertainty parameters chosen. Integrating the PDFs will yield a cumulative distribution function (CDF) that shows the cumulative probability of a given value on the x-axis. For the sample case, the elements’ launch mass margin was calculated and represented in as CDFs, as a demonstrated representation of figures of merit for the HLS concept. For the lander and ascent elements, the NRHO mass insertion limit is 16t; the transfer element has a limit of 30t [1]. It can be seen with Figure 2 that this probabilistic methodology can provide insight into mass margin with respect to the uncertainties being modeled. Currently, the results show that the lander (descent) vehicle element has the most restrictive design space; it is the only element to show a 10% probability of negative margin. Further analysis on the Monte Carlo results will show sensitivities for driving constraints and parameters for architecture feasibility, which can lead to establishing potential mission rules.The combination of range estimating with a parametric architecture model for HLS demonstrated the capability of this probabilistic methodology in a sample case. As the HLS development progresses, this methodology has the potential for keeping current best estimates of architecture performance for awarded concepts due to the flexibility in DYREQT’s modeling framework and its parametric nature. Concept maturation and increased epistemic knowledge can be injected into the model probabilistic modeling, and thus continue to track probability of mission success.

Stephanie Y Zhu↗

Formational History and Geomorphic Preservation of Sea Level Highstands Over the Last 150 ky Near Cape Canaveral, Florida, USA

Cape Canaveral, Florida, is perhaps one of the most important stretches of coastline in the United States of America (USA) due to its critical strategic role in the pursuit of space exploration and as the locus of advanced technological innovation. Due to its geographical setting, the entirety of Cape Canaveral, including its infrastructure, facilities, and important natural habitats (e.g., wetlands, estuaries and dunes) is vulnerable to coastal hazards such as continued sea level rise, storm surges, erosion and flooding. As such, accurate sea level characterization and coastal resiliency predictions are essential to promoting long-term coastal planning and sustainability in the area. This study aims to better understand the temporal and spatial evolution of this area with the purpose of more accurately documenting historical sea level fluctuations and calibrating more localized projections at this site. The Cape Canaveral coastline is situated on a passive margin mostly affected by oceanic (sea level change and wave impact) and atmospheric (aeolian) alteration. This sector is part of the east Florida coast microtidal (1.2 m) setting and low wave energy (1.2-1.6 m and 6.1-8.2 sec for average significant waves) regime and is defined by a well delineated set of beach ridge or cape systems. While the name “Cape Canaveral” is often used as a generic term to describe the geographic area, it is actually an amalgamation or complex of multiple preserved capes. The preserved Cape Canaveral beach ridge plain has largely documented the paleo-sea level highstand history over the last 150 ky. High-resolution mapping of these beach ridges is completed using GPS, LiDAR, aerial, as well as satellite imagery. In order to reconstruct the formational history of the Cape Kennedy Complex and the preserved record of sea level highstands, these detailed geomorphological observations are integrated with OSL and C14 dating techniques. The chronological framework delineated by the OSL dates coupled with detailed geomorphological mapping allows for the creation of high-resolution calibrated site-specific sea level curves that reflect the local environmental and geological conditions. This refinement has the potential to improve the understanding of past sea level variability which is crucial for predicting future trends and assessing the impacts on coastal regions such as Cape Canaveral.

geomorphology↗

Toward Right-Fidelity Rotorcraft Conceptual Design

The aviation Advanced Design Office (ADO) of the US Army Aeroflightdynamics Directorate (AMRDEC) performs conceptual design of advanced Vertical Takeoff and Landing (VTOL) concepts in support of the Army's development and acquisition of new aviation systems. In particular, ADO engages in system synthesis to assess the impact of new technologies and their application to satisfy emerging warfighter needs and requirements. Fundamental to ADO being successful in accomplishing its role; is the ability to evaluate a wide array of proposed air vehicle concepts, and independently synthesize new concepts to inform Army and DoD decision makers about the tradespace in which decisions will be made (Figure 1). ADO utilizes a conceptual design (CD) process in the execution of its role. Benefiting from colocation with NASA rotorcraft researchers at the Ames Research Center, ADO and NASA have engaged in a survey of the current rotorcraft PD practices and begun the process of improving those capabilities to enable effective design and development of the next generation of VTOL systems. A unique aspect of CD in ADO is the fact that actual designs developed in-house are not intended to move forward in the development process. Rather, they are used as reference points in discussions about requirements development and technology impact. The ultimate products of ADO CD efforts are technology impact assessments and specifications which guide industry design activity. The fact that both the requirement and design are variables in the tradespace adds to the complexity of the CD process. A frequent need is ability to assess the relative "cost" of variations in requirement for a diverse set of VTOL configurations. Each of these configurations may have fundamentally different response characteristics to this requirement variation, and such insight into how different requirements drive different designs is a critical insight ADO attempts to provide decision makers. The processes and tools utilized are driven by the timeline in which questions must be answered. This can range from quick "back-of-the-envelope" assessments of a configuration made in an afternoon, to more detailed tradespace explorations that can take upwards of a year to complete. A variety of spreadsheet based tools and conceptual design codes are currently in use. The in-house developed conceptual sizing code RC (Rotorcraft) has been the preferred tool of choice for CD activity for a number of years. Figure 2 illustrates the long standing coupling between RC and solid modeling tools for layout, as well as a number of ad-hoc interfaces with external analyses. RC contains a sizing routine that is built around the use of momentum theory for rotors, classic finite wing theory, a referred parameter engine model, and semi-emperical weight estimation techniques. These methods lend themselves to rapid solutions, measured in seconds and minutes. The successful use of RC, however requires careful consideration of model input parameters and judicious comparison with existing aircraft to avoid unjustified extrapolation of results. RC is in fact a legacy of a series of codes whose development started in the early 1970s, and is best suited to the study of conventional helicopters and XV-15 style tiltrotors. Other concepts have been analyzed with RC, but typically it became necessary to modify the source code and methods for each unique configuration. Recent activity has lead to the development of a new code, NASA Design and Analysis of Rotorcraft (NDARC). NDARC uses a similar level of analytical fidelity as RC, but is built on a new framework intended to improve modularity and ability to rapidly model a wider array of concepts. Critical to achieving this capability is the decomposition of the aircraft system into a series of fundamental components which can then be assembled to form a wide-array of configurations. The paper will provide an overview of NDARC and its capabilities.

Sinsay, Jeffrey D.↗

Autonomous Assessment and Predictive Capabilities for Low-Altitude Urban Flight Operations

The integration of unmanned aerial vehicles in the national airspace will introduce new vehicle types, technologies, and operational paradigms for which safety must be maintained and hazards mitigated. One approach is to attempt to design for possible hazards and unsafe incidents that can occur at different phases of flight (pre-flight, in-flight, and post-flight) and during ground operations. Another is to mitigate safety incidents by implementing changes to policies, procedures, regulations, and design to cover personnel, equipment, and aircraft during operations. These and other techniques, not described herein, are typically conservative or adhoc in that they reduce the likelihood of risk after safety incidents have occurred. In this work, the goal is to develop a more predictive capability to monitor and mitigate risk and hazards to safety “in-time” enough for decisions to be made. In line with NASA’s Aeronautics Mission Directorate Strategic Thrust 5 [1] (In-Time System-Wide Safety Assurance), the System-Wide Safety (SWS) project under which this work falls, is developing and demonstrating innovative and safety-oriented solutions that enable modernization and aviation transformation. To that effect, this work will detail data-driven efforts on the SWS project to develop a number of safety-critical services for in-time monitoring and mitigation of hazards to low-altitude flight operations. First, hazards to these operations are identified based on previous work by NASA [2,3] and others in the aerospace industry. These hazards include (i) unsafe proximity to other vehicles, property, and people on the ground, (ii) critical system failures such as communication signal/GPS loss, unexpected propulsion system degradation, engine/power failure, and (iii) operational/environmental issues such as severe weather and gusty winds. For these hazards, safety metrics, which can be quantified and assessed are defined, models to monitor and predict them are developed, and flight test data is generated to develop, validate, and test these models, considering the complex interplay of the different hazards that define them [4-6]. In addition, the uncertainty in the non-deterministic effects that cannot be modeled nor predicted and unknown unknowns that arise after design/testing and during operations must be handled in rigorous manner. As a result, for each of the developed safety metrics, their dependencies on one another are characterized and a framework for handling the uncertainties inherent in the modeling, algorithms, and measurements required for prediction is also developed [7]. To that effect, this presentation will describe the safety metrics and services already developed and underway under the System-Wide Safety project that utilize data-driven techniques for the identification of anomalies, precursors, and trends (APTs) to monitor and mitigate hazards to safety, in-time, for urban flight operations in low-altitude airspace.

Okolo, Wendy A.↗

Autonomous Navigation of a Lunar Relay Using GNSS and Other Measurements

Many of the highest priority destinations at the Moon lack a continuous view of Earth, such as the lunar poles or lunar far side. Exploration of these sites will require spacecraft in cislunar space to relay communications and provide position, navigation, and timing (PNT) services. Accurate knowledge of relay position, velocity, and time is essential to these services. This paper describes a concept for a PNT Instrument being developed for the Lunar Communications Relay and Navigation Systems (LCRNS) Project. The instrument is intended as a payload that would enable autonomous, on-board, real-time navigation and timing using Global Navigation Satellite System (GNSS), optical navigation, and one-way measurements from Earth-based ground stations. Hardware-in-the-loop simulations using flight software are used to realistically characterize performance on hardware platforms with a path to flight. These results provide preliminary validation of the proposed PNT Instrument, demonstrate the benefits of augmenting GNSS with other measurements, and serve as an insightful reference for the design of future lunar missions, including those that will operate within the LunaNet framework of standards. This instrument concept relies on several technologies developed at NASA Goddard Space Flight Center (GSFC). For GNSS observables, the instrument relies on the high-altitude NavCube 3 mini (NC3m) GNSS receiver specifically designed for cislunar applications. The autoNGC system, which consists of flight software and a hardware platform, is responsible for fusing the observables using its extended Kalman filter, the Goddard Enhanced Onboard Navigation System (GEONS). Optical navigation observables are processed within autoNGC (“autonomous Navigation, Guidance, and Control”) using the Goddard Image Analysis & Navigation Tool (GIANT) which is also responsible for simulating high-fidelity images for test and analysis. In addition to describing the PNT Instrument and its components, the paper will present predicted performance based on simulation results. As a baseline, it will present GNSS-only hardware-in-the loop results using a NC3m test unit to process Spirent-simulated GPS signals in a potential lunar relay trajectory: a 12-hour elliptical frozen lunar orbit (ELFO). GEONS then processes the GPS pseudorange and time differenced carrier phase measurements to estimate and propagate the relay state (position, velocity, and time). These results extend previously published work that showed preliminary ELFO performance. Previous work has shown the importance of other measurement types, so additional simulations are performed which augment GNSS with ground station observables and several methods of optical navigation, including celestial navigation, limb-finding (e.g., observations of the lunar horizon), and terrain relative navigation (TRN). TRN involves correlating simulated predicted images of the lunar surface with actual imagery; misalignments of landmarks identified in each image are translated into relay state updates. TRN is valuable as a measurement of the relay’s state relative to the Moon, especially during GNSS outages or after maneuvers. One-way Pseudorange and Doppler measurements from Earth-based ground stations are also simulated. The full set of observables is processed using autoNGC. These simulations make use of autoNGC and NC3m test units, a lab atomic clock, and a pulse-per-second (PPS) generation and distribution system. This combination of subsystems, and the hardware platforms used in this analysis, represents a PNT Instrument that could be flown on a lunar relay. Results from the hardware-in-the-loop simulations presented in this paper provide a preliminary assessment of the achievable navigation performance of this instrument concept. PNT Instrument performance is compared to the GPS-only performance, and a discussion is provided on the apparent merits and challenges of each measurement type.

Ben Ashman↗

Event Report for The Ethical Artificial Intelligence Quantification Workshop

Artificial Intelligence (AI) is a powerful emerging technology area which requires special attention to using it ethically. AI ethics is still an emerging field, and the partners for this workshop and report seek to move AI ethics discussion ahead by experimenting with ways to measure AI ethics criteria. The following document describes the outcomes and learnings from The Ethical Artificial Intelligence Quantification Workshop held at the National Institute for Aerospace (NIA), Hampton, Virginia on May 12th, 2022. The purpose of the workshop was for participants to evaluate and experiment-with the methodology and process presented by AIEthics.World in cooperation with Intel Corporation. The meeting participants learned about the Ethical AI Certification and Maturity Model™ and applied the methodology to selected notional AI systems. The workshop facilitated the evaluation of the maturity of the AI system according to ethical considerations relevant to NASA, NIA and other participants. The workshop consisted of three main phases. The first phase focused on understanding and summarizing NASA’s ethical approaches, mission and values based on published documentation, discussions and individual insights & opinions of participants. This information was prioritized, weighted, ordered, and quantified in phase two, to formulate an alignment between human values (ethics) and their applicability to AI systems during all lifecycle phases. The first two phases were summarized as a form of ethical genealogy for artificial intelligence, specific to NASA’s ethical approaches. In the third and last phase of the workshop the participants evaluated notional examples of artificial intelligence to qualify and quantify its ability to adhere to the organizational ethics approaches, using the Ethical AI Certification and Maturity Model™. The workshop uses the concept of genealogy, in the traditional sense: the study and traceability of lines of ancestors in the process of evolutionary development from earlier forms. However, as it is applied to an Ethical AI definition, it is providing the insights to the necessary and mandatory traceability of content, data, metrics, telemetry, elements, and structures which are used in the AI’s lifecycle to foster and measure AI ethics in all steps of its lifecycle. The Ethical Artificial Intelligence Quantification Workshop provided NASA with the opportunity to apply the Ethical AI Certification and Maturity Model™, in combination with existing and well-known decision-making and quality control methods to identify the metrics and measurements for an Ethical AI and assess its ethical condition and quality aligned with NASA ethics approaches. The result of the workshop is the capacity for NASA to apply the maturity model assessment to its AI Systems as desired and if necessary, publish the ability of these AI Systems to adhere to the organizational ethical goals. AI ethics frameworks need to be customized for each application domain, for example, individual NASA Mission Directorates. General principles that work in one area such as AI/Machine Learning-based text analysis (the ethics of information-extraction) may need to be adapted for another such as sense-and-avoid decision-making in a flight environment. The workshop was conducted among approximately twenty NASA subject matter experts, so the elements noted above should be considered examples, not definitive NASA ethical AI principles, genealogy, etc. Generating a definitive AI ethics framework for an organization as diverse as NASA would require far more discussion, debate, review, etc. However, the workshop provided valuable insight into mechanisms and processes for quantifying AI ethical qualities.

Artificial Intelligence↗

Development of a Ground Test and Analysis Protocol for NASA's NextSTEP Phase 2 Habitation Concepts

The NASA Next Space Technologies for Exploration Partnerships (NextSTEP) program is a public-private partnership model that seeks commercial development of deep space exploration capabilities to support human spaceflight missions around and beyond cislunar space. NASA first issued the Phase 1 NextSTEP Broad Agency Announcement to U.S. industries in 2014, which called for innovative cislunar habitation concepts that leveraged commercialization plans for low-Earth orbit. These habitats will be part of the Deep Space Gateway (DSG), the cislunar space station planned by NASA for construction in the 2020s. In 2016, Phase 2 of the NextSTEP program selected five commercial partners to develop ground prototypes. A team of NASA research engineers and subject matter experts (SMEs) have been tasked with developing the ground-test protocol that will serve as the primary means by which these Phase 2 prototypes will be evaluated. Since 2008, this core test team has successfully conducted multiple spaceflight analog mission evaluations utilizing a consistent set of operational tools, methods, and metrics to enable the iterative development, testing, analysis, and validation of evolving exploration architectures, operations concepts, and vehicle designs. The purpose of implementing a similar evaluation process for the Phase 2 Habitation Concepts is to consistently evaluate different commercial partner ground prototypes to provide data-driven, actionable recommendations for Phase 3. This paper describes the process by which the ground test protocol was developed and the objectives, methods, and metrics by which the NextSTEP Phase 2 Habitation Concepts will be rigorously and systematically evaluated. The protocol has been developed using both a top-down and bottom-up approach. Top-down development began with the Human Exploration and Operations Mission Directorate (HEOMD) exploration objectives and ISS Exploration Capability Study Team (IECST) candidate flight objectives. Strategic questions and associated rationales, derived from these candidate architectural objectives, provide the framework by which the ground-test protocol will address the DSG stack elements and configurations, systems and subsystems, and habitation, science, and EVA functions. From these strategic questions, high-level functional requirements for the DSG were drafted and associated ground-test objectives and analysis protocols were established. Bottom-up development incorporated objectives from NASA SMEs in autonomy, avionics and software, communication, environmental control and life support systems, exercise, extravehicular activity, exploration medical operations, guidance navigation and control, human factors and behavioral performance, human factors and habitability, logistics, Mission Control Center operations, power, radiation, robotics, safety and mission assurance, science, simulation, structures, thermal, trash management, and vehicle health. Top-down and bottom-up objectives were integrated to form overall functional requirements - ground-test objectives and analysis mapping. From this mapping, ground-test objectives were organized into those that will be evaluated through inspection, demonstration, analysis, subsystem standalone testing, and human-in-the-loop (HITL) testing. For the HITL tests, mission-like timelines, procedures, and flight rules have been developed to directly meet ground test objectives and evaluate specific functional requirements. Data collected from these assessments will be analyzed to determine the acceptability of habitation element configurations and the combinations of capabilities that will result in the best habitation platform to be recommended by the test team for Phase 3.

Gernhardt, Michael L.↗

Physics-Based Methods of Failure Analysis and Diagnostics in Human Space Flight

The Integrated Health Management (IHM) for the future aerospace systems requires to interface models of multiple subsystems in an efficient and accurate information environment at the earlier stages of system design. The complexity of modern aeronautic and aircraft systems (including e.g. the power distribution, flight control, solid and liquid motors) dictates employment of hybrid models and high-level reasoners for analysing mixed continuous and discrete information flow involving multiple modes of operation in uncertain environments, unknown state variables, heterogeneous software and hardware components. To provide the information link between key design/performance parameters and high-level reasoners we rely on development of multi-physics performance models, distributed sensors networks, and fault diagnostic and prognostic (FD&P) technologies in close collaboration with system designers. The main challenges of our research are related to the in-flight assessment of the structural stability, engine performance, and trajectory control. The main goal is to develop an intelligent IHM that not only enhances components and system reliability, but also provides a post-flight feedback helping to optimize design of the next generation of aerospace systems. Our efforts are concentrated on several directions of the research. One of the key components of our strategy is an innovative approach to the diagnostics/prognostics based on the real time dynamical inference (DI) technologies extended to encompass hybrid systems with hidden state trajectories. The major investments are into the multiphysics performance modelling that provides an access of the FD&P technologies to the main performance parameters of e.g. solid and liquid rocket motors and composite materials of the nozzle and case. Some of the recent results of our research are discussed in this chapter. We begin by introducing the problem of dynamical inference of stochastic nonlinear models and reviewing earlier results. Next, we present our analytical approach to the solution of this problem based on the path integral formulation. The resulting algorithm does not require an extensive global search for the model parameters, provides optimal compensation for the effects of dynamical noise, and is robust for a broad range of dynamical models. In the following Section the strengths of the algorithm are illustrated illustrated by inferring the parameters of the stochastic Lorenz system and comparing the results with those of earlier research. Next, we discuss a number of recent results in application to the development of the IHM for aerospace system. Firstly, we apply dynamical inference approach to a solution of classical three tank problems with mixed unknown continuous and binary parameters. The problem is considered in the context of ground support system for filling fuel tanks of liquid rocket motors. It is shown that the DI algorithm is well suited for successful solution of a hybrid version of this benchmark problem even in the presence of additional periodic and stochastic perturbation of unknown strength. Secondly, we illustrate our approach by its application to an analysis of the nozzle fault in a solid rocket motor (SRM). The internal ballistics of the SRM is modelled as a set of one-dimensional partial differential equations coupled to the dynamics of the propellant regression. In this example we are specifically focussed on the inference of discrete and continuous parameters of the nozzle blocking fault and on the possibility of an application of the DI algorithm to reducing the probability of "misses" of an on-board FD&P for SRM. In the next section re-contact problem caused by first stage/upper stage separation failure is discussed. The reaction forces imposed on the nozzle of the upper stage during the re-contact and their connection to the nozzle damage and to the thrust vector control (TVC) signal are obtained. It is shown that transient impact induced torquean be modelled as a response of an effective damped oscillator. A possible application of the DI algorithm to the inference of damage parameters and predicting fault dynamics ahead of time using the actuator signal is discussed. Finally, we formulate Bayesian inferential framework for development of the IHM system for in-flight structural health monitoring (SHM) of composite materials. We consider the signal generated by piezoelectric actuator mounted on composite structure generating elastic waves in it. The signal received by the sensor is than compared with the baseline signal. The possibility of damage inference is discussed in the context of development of the SHM.

Smelyanskiy, Vadim N.↗

NASA Software Engineering Benchmarking Study

To identify best practices for the improvement of software engineering on projects, NASA's Offices of Chief Engineer (OCE) and Safety and Mission Assurance (OSMA) formed a team led by Heather Rarick and Sally Godfrey to conduct this benchmarking study. The primary goals of the study are to identify best practices that: Improve the management and technical development of software intensive systems; Have a track record of successful deployment by aerospace industries, universities [including research and development (R&D) laboratories], and defense services, as well as NASA's own component Centers; and Identify candidate solutions for NASA's software issues. Beginning in the late fall of 2010, focus topics were chosen and interview questions were developed, based on the NASA top software challenges. Between February 2011 and November 2011, the Benchmark Team interviewed a total of 18 organizations, consisting of five NASA Centers, five industry organizations, four defense services organizations, and four university or university R and D laboratory organizations. A software assurance representative also participated in each of the interviews to focus on assurance and software safety best practices. Interviewees provided a wealth of information on each topic area that included: software policy, software acquisition, software assurance, testing, training, maintaining rigor in small projects, metrics, and use of the Capability Maturity Model Integration (CMMI) framework, as well as a number of special topics that came up in the discussions. NASA's software engineering practices compared favorably with the external organizations in most benchmark areas, but in every topic, there were ways in which NASA could improve its practices. Compared to defense services organizations and some of the industry organizations, one of NASA's notable weaknesses involved communication with contractors regarding its policies and requirements for acquired software. One of NASA's strengths was its software assurance practices, which seemed to rate well in comparison to the other organizational groups and also seemed to include a larger scope of activities. An unexpected benefit of the software benchmarking study was the identification of many opportunities for collaboration in areas including metrics, training, sharing of CMMI experiences and resources such as instructors and CMMI Lead Appraisers, and even sharing of assets such as documented processes. A further unexpected benefit of the study was the feedback on NASA practices that was received from some of the organizations interviewed. From that feedback, other potential areas where NASA could improve were highlighted, such as accuracy of software cost estimation and budgetary practices. The detailed report contains discussion of the practices noted in each of the topic areas, as well as a summary of observations and recommendations from each of the topic areas. The resulting 24 recommendations from the topic areas were then consolidated to eliminate duplication and culled into a set of 14 suggested actionable recommendations. This final set of actionable recommendations, listed below, are items that can be implemented to improve NASA's software engineering practices and to help address many of the items that were listed in the NASA top software engineering issues. 1. Develop and implement standard contract language for software procurements. 2. Advance accurate and trusted software cost estimates for both procured and in-house software and improve the capture of actual cost data to facilitate further improvements. 3. Establish a consistent set of objectives and expectations, specifically types of metrics at the Agency level, so key trends and models can be identified and used to continuously improve software processes and each software development effort. 4. Maintain the CMMI Maturity Level requirement for critical NASA projects and use CMMI to measure organizations developing software for NASA. 5.onsolidate, collect and, if needed, develop common processes principles and other assets across the Agency in order to provide more consistency in software development and acquisition practices and to reduce the overall cost of maintaining or increasing current NASA CMMI maturity levels. 6. Provide additional support for small projects that includes: (a) guidance for appropriate tailoring of requirements for small projects, (b) availability of suitable tools, including support tool set-up and training, and (c) training for small project personnel, assurance personnel and technical authorities on the acceptable options for tailoring requirements and performing assurance on small projects. 7. Develop software training classes for the more experienced software engineers using on-line training, videos, or small separate modules of training that can be accommodated as needed throughout a project. 8. Create guidelines to structure non-classroom training opportunities such as mentoring, peer reviews, lessons learned sessions, and on-the-job training. 9. Develop a set of predictive software defect data and a process for assessing software testing metric data against it. 10. Assess Agency-wide licenses for commonly used software tools. 11. Fill the knowledge gap in common software engineering practices for new hires and co-ops.12. Work through the Science, Technology, Engineering and Mathematics (STEM) program with universities in strengthening education in the use of common software engineering practices and standards. 13. Follow up this benchmark study with a deeper look into what both internal and external organizations perceive as the scope of software assurance, the value they expect to obtain from it, and the shortcomings they experience in the current practice. 14. Continue interactions with external software engineering environment through collaborations, knowledge sharing, and benchmarking.

Rarick, Heather L.↗