Results for “lessons learned process” — Page 38

NASA NTRSDate not supplied

Knowledge Discovery for Early Failure Assessment of Complex Engineered Systems Using Natural Language Processing

Emerging complex engineered systems may have unexpected safety issues due to novel operational environments, increasing autonomy, human-machine interaction, and other factors. To prevent failures in operation or testing that necessitate costly redesign, it is desirable to predict likely failure modes early in the design process. Information about past engineering failures in natural language format presents one possible solution by enabling the retrieval of information that can inform new designs. However, identifying documents containing usable information and extracting the required information can be prohibitively time-consuming when implemented at scale. In this research, an automated natural language processing (NLP) framework is proposed to discover relevant knowledge from documents containing failure-related design information. The framework is applied to NASA’s Lessons Learned Information System (LLIS),which is publicly available. Documents containing usable information are filtered using two different NLP-based models. Next, from the identified usable documents, a failure taxonomy is extracted using a partitioned hierarchical topic modeling approach. Partitions of the document describe different sections of the failure taxonomy – i.e., failure, cause of failure, and recommendations – as indicated by the structure of the original document. The extracted failure taxonomy can be leveraged in early design failure assessment methods. Moreover, the framework can be used to identify documents containing usable failure-related design information from other databases and extract relevant information from these documents.

Documentation and Information Science↗

NASA NTRSDate not supplied

Knowledge Discovery for Early Failure Assessment of Complex Engineered Systems Using Natural Language Processing

Emerging complex engineered systems may have unexpected safety issues due to novel operational environments, increasing autonomy, human-machine interaction, and other factors. To prevent failures in operation or testing that necessitate costly redesign, it is desirable to predict likely failure modes early in the design process. Information about past engineering failures in natural language format presents one possible solution by enabling the retrieval of information that can inform new designs. However, identifying documents containing usable information and extracting the required information can be prohibitively time-consuming when implemented at scale. In this research, an automated natural language processing (NLP) framework is proposed to discover relevant knowledge from documents containing failure-related design information. The framework is applied to NASA’s Lessons Learned Information System (LLIS),which is publicly available. Documents containing usable information are filtered using two different NLP-based models. Next, from the identified usable documents, a failure taxonomy is extracted using a partitioned hierarchical topic modeling approach. Partitions of the document describe different sections of the failure taxonomy – i.e., failure, cause of failure, and recommendations – as indicated by the structure of the original document. The extracted failure taxonomy can be leveraged in early design failure assessment methods. Moreover, the framework can be used to identify documents containing usable failure-related design information from other databases and extract relevant information from these documents.

Documentation and Information Science↗

NASA NTRS2020

MER Opportunity dust-storm recovery operations and implications for future Mars surface missions

In June 2018, NASA’s Mars Exploration Rover Opportunity became engulfed in the most intense global dust storm observed in its 14-year mission and in Mars’ recorded history. Sapped of life-giving solar energy, Opportunity fell silent to ground operators on June 11, in what would be its final call home. Over the course of the next eight months, the MER team employed numerous recovery efforts and radiated over one thousand commands to wake the silent rover. Although unsuccessful, MER’s dust-storm recovery team changed the paradigm of dust-storm operations from Opportunity’s survival of a previous global dust storm in 2007. In this paper, the authors offer a glimpse into MER’s recovery efforts and lessons learned from Opportunity dust-storm operations for future solar-powered Mars surface missions. In the first section, the authors discuss the indicators of the approaching dust storm and the actions the team employed to reduce Opportunity’s power consumption and preserve available battery charge prior to loss of contact. The second section discusses the team’s recovery efforts until Opportunity’s declared End-of-Mission, the steps the team took to re-establish contact with Opportunity, the assumptions made during each step of the recovery process, and the commanding actions employed. Finally, the authors discuss the operational impacts of global dust storms on the safe and successful operation of solar-powered spacecraft on the Martian surface, and offer design recommendations for future solar-powered missions from the lessons learned during Opportunity’s 14-year mission and experience through two global dust storms.

Nelson, Robert W.↗

NASA NTRS2007

A Return to Innovative Engineering Design, Critical Thinking and Systems Engineering

I believe we are facing a critical time where innovative engineering design is of paramount importance to the success of our aerospace industry. However, the very qualities and attributes necessary for enhancing, educating, and mentoring a creative spirit are in decline in important areas. The importance of creativity and innovation in this country was emphasized by a special edition of the Harvard Business Review OnPoint entitled: "The Creative Company" which compiled a series of past and present articles on the subject of creativity and innovation and stressed its importance to our national economy. There is also a recognition of a lack of engineering, critical thinking and problem-solving skills in our education systems and a trend toward trying to enhance those skills by developing K-12 educational programs such as Project Lead the Way, "Science for All Americans", Benchmarks 2061 , etc. In addition, with respect to spacecraft development, we have a growing need for young to mid-level engineers with appropriate experience and skills in spacecraft design, development, analysis, testing, and systems engineering. As the Director of Engineering at NASA's Johnson Space Center, I realized that sustaining engineering support of an operational human spacecraft such as the Space Shuttle is decidedly different than engineering design and development skills necessary for designing a new spacecraft such as the Crew Exploration Vehicle of the Constellation Program. We learned a very important lesson post Columbia in that the Space Shuttle is truly an experimental and not an operational vehicle and the strict adherence to developed rules and processes and chains of command of an inherently bureaucratic organizational structure will not protect us from a host of known unknowns let alone unknown unknowns. There are no strict rules, processes, or procedures for understanding anomalous results of an experiment, anomalies with an experimental spacecraft like Shuttle, or in the conceptual design of a spacecraft. Engineering design is as much an art as it is a science. The critical thinking skills necessary to uncover lurking problems in an experimental design and creatively develop solutions are some of the same skills necessary to design a new spacecraft. Thus, I believe engineers unfamiliar with or removed from design and development need time to transition and develop the required skill set to be effective spacecraft designers. I believe the creative process necessary in design can be enhanced and even taught as early as grades K-12 and should continue to be nurtured and developed at the university level and beyond. I am going to present a strategy for developing learning teams to address complex multidisciplinary problems and to creatively develop solutions to those problems rapidly at minimal cost. I will frame a real problem, the development of on-orbit thermal protection system repair of the Space Shuttle, and step through the series of skills necessary to enhance the creative process. The case study I will illustrate is based on a real project, the R&D Reinforced Carbon-Carbon (RCC) Repair Team's development of on-orbit repair concepts for damaged Space Shuttle RCC nose cap and/or leading edges.

Camarda, Charles J.↗

NASA NTRSDate not supplied

Identifying Human Errors and Error Mechanisms From Accident Reports Using Large Language Models

Emerging operational concepts for aviation hinge on novel paradigms for human machine interaction. Critical to their safe operation is early consideration of human error into the design process. Existing methods for consideration of human error require significant expert input, which is challenging both in early design and in novel systems for which there is little existing safety expertise. In this research, we propose a methodology for identifying human error, error producing factors, and mechanisms in early design from historical incident reports. Additionally, we hypothesize that cross-domain sharing of lessons learned can aid with early design human considerations in circumstances where data is not relevant or incomplete. This is addressed by identifying causes of human error in aviation and railway domains through applying state-of-the art natural language processing techniques to historical incident reports. Using this method, it is possible to extract extensive reports on human error from past incidents. Using the proposed approach, we identify nine human errors from railway reports and fourteen from aviation reports, with three errors common to both domains. There is at least one error producing conditions for each human error while a majority of the errors have more than one error mechanism. We also found that a majority of the human errors, error producing factors, and error mechanisms (even if they are not common between the domains) can be used to inform safe operations across domains as long as the errors are not domain specific and are interpreted and contextualized using engineering judgement.

Human Errors↗

NASA NTRS2023

The Trash Compaction Processing System (TCPS) Technology Demonstrations Science Objectives and Requirement Definitions

Throughout the Next STEP Phase A and Phase B, the Trash Compaction Processing System (TCPS) is being developed for a technology demonstration (TD) on the International Space Station (ISS) in 2025. For Phase A, two contractors built proof-of-concept hardware. One contractor was chosen to build the TD hardware for Phase B. Both Phase A lessons learned and risk reduction activities at Ames Research Center (ARC) were used to write the TD science objectives, scope, and requirements. The work at ARC aims to retire technical risks and provide design data to TCPS developers and the ISS system integrators. This paper will summarize the lessons learned from the proof-of-concept hardware, the risk reduction activities, and how these lessons learned form the basis of the TD requirement matrix.

TCPS↗

NASA NTRSDate not supplied

Bootstrapping Multi-Agent Unmanned Aerial Vehicle (UAV) System Integration Using Ground-Based Assets: Lessons Learned

The highly dynamic nature of UAVs imposes significant challenges when conducting initial testing ranging from safety risks posed by high-capacity lithium batteries and spinning propellers to rigorous timing demands on controllers and the consequences of failures mid-air. Flight testing of a single vehicle is time and labor intensive due to these challenges and more, and the complexity increases exponentially with the number of vehicles. While simulations and hardware-in-the-loop bench testing can provide adequate environments for preliminary validation, differences in system deployment architecture, software interfaces, and hardware infrastructure between simulation and a fleet of real UAVs create a sizable gap that must be navigated carefully during system integration. In support of the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project, which had the goal of establishing a basis of certification of trust and trustworthiness in multi-agent autonomous systems, this gap was tackled from two directions. First, a novel mixed-reality simulation environment was engineered to blur the transition from simulation to flight hardware. Second, a fleet of Unmanned Surface Vehicles (USVs) was developed as a test and evaluation platform that more closely represented the final aerial fleet while eliminating many of the risks associated with air vehicles. This paper delves into the second element, analyzing the efficacy of the USV platform in performing system integration testing for the UAV system. In this paper we present the USV fleet and its role in reducing the aforementioned gaps in deployment architecture, software interfaces, and hardware infrastructure when moving from simulation to flight. An overview of the hardware and software onboard the vehicles will be provided along with supporting infrastructure. The system integration process will be documented including results in supporting both the overarching design reference mission (DRM) of ATTRACTOR and individual research efforts conducted during the project. Finally, we will discuss some of the practical lessons learned regarding the testing, deployment, and operation of multi-agent autonomous systems.

Matthew P Vaughan↗

NASA NTRS1984

Flutter optimization in fighter aircraft design

The efficient design of aircraft structure involves a series of compromises among various engineering disciplines. These compromises are necessary to ensure the best overall design. To effectively reconcile the various technical constraints requires a number of design iterations, with the accompanying long elapsed time. Automated procedures can reduce the elapsed time, improve productivity and hold the promise of optimum designs which may be missed by batch processing. Several examples are given of optimization applications including aeroelastic constraints. Particular attention is given to the success or failure of each example and the lessons learned. The specific applications are shown. The final two applications were made recently.

Triplett, W. E.↗

NASA NTRS1989

Improving the on-board computing capability of the NASA Multimission Modular Spacecraft

This paper presents the development of onboard computing improvements for NASA's Multimission Modular Spacecraft. The first MMS spacecraft being enhanced by an additional flight computer is the Explorer Platform. The selection process for both the flight hardware (MIL-STD-1750A Co-Processor) and flight software (Ada high level language) are discussed, followed by the lessons learned during the last three years.

Scott, Barbara↗

NASA NTRS1992

Inertial navigation sensor integrated motion analysis for autonomous vehicle navigation

Recent work on INS integrated motion analysis is described. Results were obtained with a maximally passive system of obstacle detection (OD) for ground-based vehicles and rotorcraft. The OD approach involves motion analysis of imagery acquired by a passive sensor in the course of vehicle travel to generate range measurements to world points within the sensor FOV. INS data and scene analysis results are used to enhance interest point selection, the matching of the interest points, and the subsequent motion-based computations, tracking, and OD. The most important lesson learned from the research described here is that the incorporation of inertial data into the motion analysis program greatly improves the analysis and makes the process more robust.

Roberts, Barry↗

NASA NTRS1993

Superfluid Helium On-Orbit Transfer (SHOOT) flight demonstration

The Superfluid Helium On-Orbit Transfer (SHOOT) Flight Demonstration was an attached Shuttle payload mounted on a Hitchhiker cross-bay carrier which flew on STS-57 in June of 1993. SHOOT successfully demonstrated the handling and transfer of superfluid helium between two containers, called dewars, in low gravity. SHOOT was a class C payload and for the STS-57 mission was termed a complex secondary payload. The primaries were the retrieval of the EURECA carrier and a collection of modular experiments contained in SPACEHAB. Because the liquid helium was continuously boiling off, SHOOT's activities were scheduled for the first three days of the mission, concurrent with some SPACEHAB experiments, but well before the EURECA retrieval. Control of the SHOOT experiment was highly interactive and originated primarily from the Goddard Payload Operations and Control Center (POCC). Transfer and calibration activities required continuous command windows of up to 50 minutes duration and up to 80 minutes out of each orbit. Occasionally the crew controlled the experiment using the Payload General Support Computer (PGSC) when near-real time control and monitoring was required. SHOOT also placed considerable demands on the orbiter, including a pitch rotation of 3 deg./sec for 15 minutes, and translational burns using both the aft and forward RCS jets to generate accelerations up to 7 milli-g. The basis for these and other requirements are discussed. Interacion with the crew and timing of crew activity during the mission will be detailed. The processing flow of SHOOT at KSC is described with emphasis on the tradeoffs for vertical, as opposed to horizontal, installation in the orbiter. Finally, some lessons learned are presented that are relevant to future cryogenic and Hitchhiker payloads.

Shirron, Peter↗

NASA NTRS1999

Looking at NGST Through the Eyes of DCATT

The first phase of the Developmental Characterized Active Telescope Testbed (DCATT) hardware system was integrated at Goddard Space Flight Center in early March of 1999 and has been operational for almost a year. Experiments are currently being conducted on the testbed to quantify and refine various methods and techniques in the baseline wavefront sensing and control process. This paper addresses the actual optical design of the Phase 0 hardware configuration and discusses the open loop system level performance of the system. Lessons learned for NGST during the buildup and characterization of the system are presented.

Davila, Pam↗

NASA NTRS2006

Qualification and Issues with Space Flight Laser Systems and Components

The art of flight quality solid-state laser development is still relatively young, and much is still unknown regarding the best procedures, components, and packaging required for achieving the maximum possible lifetime and reliability when deployed in the harsh space environment. One of the most important issues is the limited and unstable supply of quality, high power diode arrays with significant technological heritage and market lifetime. Since Spectra Diode Labs Inc. ended their involvement in the pulsed array business in the late 1990's, there has been a flurry of activity from other manufacturers, but little effort focused on flight quality production. This forces NASA, inevitably, to examine the use of commercial parts to enable space flight laser designs. System-level issues such as power cycling, operational derating, duty cycle, and contamination risks to other laser components are some of the more significant unknown, if unquantifiable, parameters that directly effect transmitter reliability. Designs and processes can be formulated for the system and the components (including thorough modeling) to mitigate risk based on the known failures modes as well as lessons learned that GSFC has collected over the past ten years of space flight operation of lasers. In addition, knowledge of the potential failure modes related to the system and the components themselves can allow the qualification testing to be done in an efficient yet, effective manner. Careful test plan development coupled with physics of failure knowledge will enable cost effect qualification of commercial technology. Presented here will be lessons learned from space flight experience, brief synopsis of known potential failure modes, mitigation techniques, and options for testing from the system level to the component level.

Ott, Melanie N.↗

NASA NTRS2006

Qualification and Issues with Space Flight Laser Systems and Components

The art of flight quality solid-state laser development is still relatively young, and much is still unknown regarding the best procedures, components, and packaging required for achieving the maximum possible lifetime and reliability when deployed in the harsh space environment. One of the most important issues is the limited and unstable supply of quality, high power diode arrays with significant technological heritage and market lifetime. Since Spectra Diode Labs Inc. ended their involvement in the pulsed array business in the late 199O's, there has been a flurry of activity from other manufacturers, but little effort focused on flight quality production. This forces NASA, inevitably, to examine the use of commercial parts to enable space flight laser designs. System-level issues such as power cycling, operational derating, duty cycle, and contamination risks to other laser components are some of the more significant unknown, if unquantifiable, parameters that directly effect transmitter reliability. Designs and processes can be formulated for the system and the components (including thorough modeling) to mitigate risk based on the known failures modes as well as lessons learned that GSFC has collected over the past ten years of space flight operation of lasers. In addition, knowledge of the potential failure modes related to the system and the components themselves can allow the qualification testing to be done in an efficient yet, effective manner. Careful test plan development coupled with physics of failure knowledge will enable cost effect qualification of commercial technology. Presented here will be lessons learned from space flight experience, brief synopsis of known potential failure modes, mitigation techniques, and options for testing from the system level to the component level.

Ott, Melanie N.↗

NASA NTRS2014

Space Mission Operations Ground Systems Integration Customer Service

The facility, which is now the Huntsville Operations Support Center (HOSC) at Marshall Space Flight Center in Huntsville, AL, has provided continuous space mission and related services for the space industry since 1961, from Mercury Redstone through the International Space Station (ISS). Throughout the long history of the facility and mission support teams, the HOSC has developed a stellar customer support and service process. In this era, of cost cutting, and providing more capability and results with fewer resources, space missions are looking for the most efficient way to accomplish their objectives. One of the first services provided by the facility was fax transmission of documents to, then, Cape Canaveral in Florida. The headline in the Marshall Star, the newspaper for the newly formed Marshall Space Flight Center, read "Exact copies of Documents sent to Cape in 4 minutes." The customer was Dr. Wernher von Braun. Currently at the HOSC we are supporting, or have recently supported, missions ranging from simple ISS payloads requiring little more than "bentpipe" telemetry access, to a low cost free-flyer Fast, Affordable, Science and Technology Satellite (FASTSAT), to a full service ISS payload Alpha Magnetic Spectrometer 2 (AMS2) supporting 24/7 operations at three operations centers around the world with an investment of over 2 billion dollars. The HOSC has more need and desire than ever to provide fast and efficient customer service to support these missions. Here we will outline how our customer-centric service approach reduces the cost of providing services, makes it faster and easier than ever for new customers to get started with HOSC services, and show what the future holds for our space mission operations customers. We will discuss our philosophy concerning our responsibility and accessibility to a mission customer as well as how we deal with the following issues: initial contact with a customer, reducing customer cost, changing regulations and security, and cultural differences, to ensure an efficient response to customer issues using a small Customer Service Team (CST) and adaptability, constant communication with customers, technical expertise and knowledge of services, and dedication to customer service. The HOSC Customer Support Team has implemented a variety of processes, and procedures that help to mitigate the potential problems that arise when integrating ground system services for a variety of complex missions and the lessons learned from this experience will lead the future of customer service in the space operations industry.

Roth, Karl↗

NASA NTRS2015

FJET Database Project: Extract, Transform, and Load

The Data Mining & Knowledge Management team at Kennedy Space Center is providing data management services to the Frangible Joint Empirical Test (FJET) project at Langley Research Center (LARC). FJET is a project under the NASA Engineering and Safety Center (NESC). The purpose of FJET is to conduct an assessment of mild detonating fuse (MDF) frangible joints (FJs) for human spacecraft separation tasks in support of the NASA Commercial Crew Program. The Data Mining & Knowledge Management team has been tasked with creating and managing a database for the efficient storage and retrieval of FJET test data. This paper details the Extract, Transform, and Load (ETL) process as it is related to gathering FJET test data into a Microsoft SQL relational database, and making that data available to the data users. Lessons learned, procedures implemented, and programming code samples are discussed to help detail the learning experienced as the Data Mining & Knowledge Management team adapted to changing requirements and new technology while maintaining flexibility of design in various aspects of the data management project.

excel vba↗

DOE OSTI2021

Added value for integrated marine energy data systems

Launched in 2019, the Portal and Repository for Information on Marine Renewable Energy (PRIMRE) provides centralized access, standardization, community building, and integration of United States (U.S.) databases, tools and codes, and other resources that cover a range of marine energy information. The PRIMRE universe contains a series of Knowledge Hubs that represent data and information on testing of marine energy devices (MHKDR); environmental effects (Tethys); engineering and technical papers (Tethys Engineering); descriptions of marine energy companies and technologies (Marine Energy Projects Database); codes and models (Marine Energy Software); and guidance on testing and measurements (Telesto). Content is added to PRIMRE by applying a set of Guidelines and Best Practices (PRIMRE Guidelines). An aggregate search across the PRIMRE site enables users to find data and information from all the PRIMRE Knowledge Hubs simultaneously, using a single entry-point (PRIMRE Search). In addition to providing access to a range of data and information on marine energy development, testing, and effects, PRIMRE allows for the development of value added products and processes that will help move the marine energy industry forward. The PRIMRE team has recently launched two key initiatives in the U.S.—Signature Projects and Lessons Learned. Outputs and outcomes from these two initiatives will be highlighted in this paper. The Signature Projects initiative is intended to bring focus to a selection of ongoing and completed marine energy projects funded by the U.S. Department of Energy’s Water Power Technologies Office (WPTO), and to inform the marine energy community of what investigations have been undertaken, what tools are available, and where gaps in information persist. Each Signature Project tags papers, reports, and data from large marine energy research projects, providing easy access and attention to all the output and associated products from each project. The Lessons Learned initiative is intended to ensure that hard-won achievements are recognized and available for those who come later, that missteps and unfortunate outcomes can be prevented in future, and that efficiencies and effective shortcuts can be publicized and used as the marine energy industry moves forward. This initiative builds off the Knowledge Hubs and reaches out to members of the marine energy community, particularly technology developers and researchers, to integrate experience in the development, deployment, assessment, success, and challenges while creating this new industry and field of study.

Copping, Andrea E.↗

DOE OSTI2021

Added value for integrated marine energy data systems

Launched in 2019, the Portal and Repository for Information on Marine Renewable Energy (PRIMRE) provides centralized access, standardization, community building, and integration of United States (U.S.) databases, tools and codes, and other resources that cover a range of marine energy information. The PRIMRE universe contains a series of Knowledge Hubs that represent data and information on testing of marine energy devices (MHKDR); environmental effects (Tethys); engineering and technical papers (Tethys Engineering); descriptions of marine energy companies and technologies (Marine Energy Projects Database); codes and models (Marine Energy Software); and guidance on testing and measurements (Telesto). Content is added to PRIMRE by applying a set of Guidelines and Best Practices (PRIMRE Guidelines). An aggregate search across the PRIMRE site enables users to find data and information from all the PRIMRE Knowledge Hubs simultaneously, using a single entry-point (PRIMRE Search). In addition to providing access to a range of data and information on marine energy development, testing, and effects, PRIMRE allows for the development of value added products and processes that will help move the marine energy industry forward. The PRIMRE team has recently launched two key initiatives in the U.S.—Signature Projects and Lessons Learned. Outputs and outcomes from these two initiatives will be highlighted in this paper. The Signature Projects initiative is intended to bring focus to a selection of ongoing and completed marine energy projects funded by the U.S. Department of Energy’s Water Power Technologies Office (WPTO), and to inform the marine energy community of what investigations have been undertaken, what tools are available, and where gaps in information persist. Each Signature Project tags papers, reports, and data from large marine energy research projects, providing easy access and attention to all the output and associated products from each project. The Lessons Learned initiative is intended to ensure that hard-won achievements are recognized and available for those who come later, that missteps and unfortunate outcomes can be prevented in future, and that efficiencies and effective shortcuts can be publicized and used as the marine energy industry moves forward. This initiative builds off the Knowledge Hubs and reaches out to members of the marine energy community, particularly technology developers and researchers, to integrate experience in the development, deployment, assessment, success, and challenges while creating this new industry and field of study.

Copping, Andrea E.↗