Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “lessons learned process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

On the hitchhiker Robot Operated Materials Processing System: Experiment data system

The Space Shuttle Discovery STS-64 mission carried the first American autonomous robot into space, the Robot Operated Materials Processing System (ROMPS). On this mission ROMPS was the only Hitchhiker experiment and had a unique opportunity to utilize all Hitchhiker space carrier capabilities. ROMPS conducted rapid thermal processing of the one hundred semiconductor material samples to study how micro gravity affects the resulting material properties. The experiment was designed, built and operated by a small GSFC team in cooperation with industry and university based principal investigators who provided the material samples and data interpretation. ROMPS' success presents some valuable lessons in such cooperation, as well as in the utilization of the Hitchhiker carrier for complex applications. The motivation of this paper is to share these lessons with the scientific community interested in attached payload experiments. ROMPS has a versatile and intelligent material processing control data system. This paper uses the ROMPS data system as the guiding thread to present the ROMPS mission experience. It presents an overview of the ROMPS experiment followed by considerations of the flight and ground data subsystems and their architecture, data products generation during mission operations, and post mission data utilization. It then presents the lessons learned from the development and operation of the ROMPS data system as well as those learned during post-flight data processing.

Kizhner, Semion↗

TPSAS-NF1676L-32493-DND

The Committee on Earth Observation Satellites (CEOS) System Engineering Office (SEO) has supported the Open Data Cube (ODC) initiative to provide a data architecture solution that has value to its global users and increases the impact of EO satellite data. ODC is an open-source platform for processing satellite data. We have developed software products and tools around the core ODC that would help users perform machine learning on EO satellite data. The recent United Nations (UN) Sustainable Development Agenda provides a shared blueprint for peace and prosperity for people and for the planet, considering our current situation and helping to create a plan. The core of this agenda is a set of seventeen Sustainable Development Goals (SDGs), which represent an urgent call for action by all countries - both developed and developing - in a global partnership. The CEOS SEO team has recently developed and released a set of innovative Jupyter notebooks addressing UN SDGs 6.6.1 (spatial extents of water-related ecosystems), 11.3.1 (ratio of land consumption rate to population growth rate), and 15.3.1 (proportion of land that is degraded over total land area). These notebooks empower users by providing features that will assist with streamlining analysis ready data retrieval, processing, and visualization. We have recently incorporated several machine learning techniques in these notebooks. In this paper, we present the lessons learned from our experience on classifying land using supervised and unsupervised machine learning techniques using ODC framework for UN SDGs. We identify the current limitations of ODC to seamlessly support machine learning techniques. We propose features that would help machine learning, specifically within the ODC framework. We propose a thematic indexing/loading of data for both unsupervised learning as well as data annotation/labeling pipeline. Currently, ODC supports machine learning by separating data-management from the analysis process. It works as a mechanism to load cubes of data. ODC does not natively support features that are vital in machine learning such as validation splits, fair/balanced sampling, establishing load size constraints, etc. We believe that our proposed features will empower users by providing features that bring machine learning techniques closed to ODC. Enhancements to ODC to better accommodate machine learning techniques can assist in fulfilling UN SDGs such as 6.3.2, 6.4.2, 6.6.1, 11.3.1, 14.1.1, 15.1.1, 15.3.1, and 15.4.2.

Syed R Rizvi↗

Performance Characterization and Provenance of Distributed Task-based Workflows on HPC Platforms

Understanding performance and provenance of task-based workflows poses significant challenges, particularly in distributed configurations where resources are shared by multiple applications. Task-based workflow management systems further complicate performance predictability because of their dynamicity that subtly alters task execution order from run to run. In this paper we propose a layered characterization framework for performance and task provenance for Dask.distributed workflows running on high-performance computing (HPC) platforms. It collects data from jobs, the workflow management system, and the operating system to aid in understanding the performance of these workflows. Our approach encompasses three main contributions: first, an extension of Dask.distributed to capture high-fidelity task provenance using Mochi data services; second, the adaptation of the established HPC I/O characterization tool Darshan to gather high-fidelity I/O data, thereby enhancing the granularity of our analysis; and third, a framework to combine and process the collected data and provide helpful insights into performance characterization and reproducibility, alongside our lessons learned.

Dask↗

A Study of Technical Engineering Peer Reviews at NASA

This report describes the state of practices of design reviews at NASA and research into what can be done to improve peer review practices. There are many types of reviews at NASA: required and not, formalized and informal, programmatic and technical. Standing project formal reviews such as the Preliminary Design Review and Critical Design Review are a required part of every project and mission development. However, the technical, engineering peer reviews that support teams' work on such projects are informal, some times ad hoc, and inconsistent across the organization. The goal of this work is to identify best practices and lessons learned from NASA's experience, supported by academic research and methodologies to ultimately improve the process. This research has determined that the organization, composition, scope, and approach of the reviews impact their success. Failure Modes and Effects Analysis (FMEA) can identify key areas of concern before or in the reviews. Product definition tools like the Project Priority Matrix, engineering-focused Customer Value Chain Analysis (CVCA), and project or system-based Quality Function Deployment (QFD) help prioritize resources in reviews. The use of information technology and structured design methodologies can strengthen the engineering peer review process to help NASA work towards error-proofing the design process.

Chao, Lawrence P.↗

Orion Flight Performance Design Trades

A significant portion of the Orion pre-PDR design effort has focused on balancing mass with performance. High level performance metrics include abort success rates, lunar surface coverage, landing accuracy and touchdown loads. These metrics may be converted to parameters that affect mass, such as ballast for stabilizing the abort vehicle, propellant to achieve increased lunar coverage or extended missions, or ballast to increase the lift-to-drag ratio to improve entry and landing performance. The Orion Flight Dynamics team was tasked to perform analyses to evaluate many of these trades. These analyses not only provide insight into the physics of each particular trade but, in aggregate, they illustrate the processes used by Orion to balance performance and mass margins, and thereby make design decisions. Lessons learned can be gleaned from a review of these studies which will be useful to other spacecraft system designers. These lessons fall into several categories, including: appropriate application of Monte Carlo analysis in design trades, managing margin in a highly mass-constrained environment, and the use of requirements to balance margin between subsystems and components. This paper provides a review of some of the trades and analyses conducted by the Flight Dynamics team, as well as systems engineering lessons learned.

Jackson, Mark C.↗

Carbon Nanotubes for Human Space Flight

Single-wall carbon nanotubes offer the promise of a new class of revolutionary materials for space applications. The Carbon Nanotube Project at NASA Johnson Space Center has been actively researching this new technology by investigating nanotube production methods (arc, laser, and HiPCO) and gaining a comprehensive understanding of raw and purified material using a wide range of characterization techniques. After production and purification, single wall carbon nanotubes are processed into composites for the enhancement of mechanical, electrical, and thermal properties. This "cradle-to-grave" approach to nanotube composites has given our team unique insights into the impact of post-production processing and dispersion on the resulting material properties. We are applying our experience and lessons-learned to developing new approaches toward nanotube material characterization, structural composite fabrication, and are also making advances in developing thermal management materials and electrically conductive materials in various polymer-nanotube systems. Some initial work has also been conducted with the goal of using carbon nanotubes in the creation of new ceramic materials for high temperature applications in thermal protection systems. Human space flight applications such as advanced life support and fuel cell technologies are also being investigated. This discussion will focus on the variety of applications under investigation.

Scott, Carl D.↗

Achieving Maximum Integration Utilizing Requirements Flow Down

A robust and experienced systems engineering team is essential for a successful program. It is often a challenge to build a core systems engineering team early enough in a program to maximize integration and assure a common path for all supporting teams in a project. Ares I was no exception. During the planning of IVGVT, the team had many challenges including lack of: early identification of stakeholders, team training in NASA s system engineering practices, solid requirements flow down and a top down documentation strategy. The IVGVT team started test planning early in the program before the systems engineering framework had been matured due to an aggressive schedule. Therefore the IVGVT team increased their involvement in the Constellation systems engineering effort. Program level requirements were established that flowed down to IVGVT aligning all stakeholders to a common set of goals. The IVGVT team utilized the APPEL REQ Development Management course providing the team a NASA focused model to follow. The IVGVT team engaged directly with the model verification and validation process to assure that a solid set of requirements drove the need for the test event. The IVGVT team looked at the initial planning state, analyzed the current state and then produced recommendations for the ideal future state of a wide range of systems engineering functions and processes. Based on this analysis, the IVGVT team was able to produce a set of lessons learned and to provide suggestions for future programs or tests to use in their initial planning phase.

Archiable, Wes↗

Earth-Facing Antenna Characterization in Complex Ground Plane/Multipath Rich Environment

The Space Communications and Navigation (SCAN) Testbed was a Software Defined Radio (SDR)-based payload launched to the International Space Station (ISS) in July of 2012. The purpose of the SCAN Testbed payload was to investigate the applicability of SDRs to NASA space missions in an operational environment, which means that a proper model for system performance in said operational space environment is a necessary condition. The SCAN Testbed has line-of-sight connections to various ground stations with its S-Band Earth-facing Near-Earth-Network Low Gain Antenna (NEN-LGA). Any previous efforts to characterize the NEN-LGA proved difficult, therefore, the NASA Glenn Research Center built its own S-Band ground station, which became operational in 2015, and has been used successfully to characterize the NEN-LGA's in-situ pattern measurements. This methodology allows for a more realistic characterization of the antenna performance, where the pattern oscillation induced by the complex ISS ground plane, as well as shadowing effects due to ISS structural blockage are included into the final performance model. This paper describes the challenges of characterizing an antenna pattern in this environment. It will also discuss the data processing, present the final antenna pattern measurements and derived model, as well as discuss various lessons learned

ground station↗

Earth-Facing Antenna Characterization in a Complex Ground Plane/Multipath Rich Environment

The Space Communications and Navigation (SCAN) Testbed was a Software Defined Radio (SDR)-based payload launched to the International Space Station (ISS) in July of 2012. The purpose of the SCAN Testbed payload was to investigate the applicability of SDRs to NASA space missions in an operational space environment, which means that a proper model for system performance in said operational space environment is a necessary condition. The SCAN Testbed has line-of-sight connections to various ground stations with its S-Band Earth-facing Near-Earth Network Low Gain Antenna (NEN-LGA). Any previous efforts to characterize the NEN-LGA proved difficult, therefore, the NASA Glenn Research Center built its own S-Band ground station, which became operational in 2015, and has been successfully used to characterize the NEN-LGAs in-situ pattern measurements. This methodology allows for a more realistic characterization of the antenna performance, where the pattern oscillation induced by the complex ISS ground plane, as well as shadowing effects due to ISS structural blockage are included into the final performance model. This paper describes the challenges of characterizing an antenna pattern in this environment. It will also discuss the data processing, present the final antenna pattern measurements and derived model, as well as discuss various lessons learned.

software defined radio↗

Assessments and Applications of Terra and Aqua MODIS On-Orbit Electronic Calibration

MODIS has 36 spectral bands located on four focal plane assemblies (FPAs), covering wavelengths from 0.41 to 14.4 micrometers. MODIS bands 1-30 collect data using photovoltaic (PV) detectors and, therefore, are referred to as the PV bands. Similarly, bands 31-36 using photoconductive (PC) detectors are referred to as the PC bands.The MODIS instrument was built with a set of on-board calibrators (OBCs) in order to track on-orbit changes of its radiometric, spatial, and spectral characteristics. In addition, an electronic calibration (ECAL) function can be used to monitor on-orbit changes of its electronic responses (gains). This is accomplished via a series of stair step signals generated by the ECAL function. These signals, in place of the FPA detector signals, are amplified and digitized just like the detector signals. Over the entire mission of both Terra and Aqua MODIS,the ECAL has been performed for the PV bands and used to assess their on-orbit performance. This paper provides an overview of MODIS on-orbit calibration activities with a focus on the PV ECAL, including its calibration process and approaches used to monitor the electronic performance. It presents the results derived and lessons learned from Terra and Aqua MODIS on-orbit ECAL. Also discussed are some of the applications performed with the information provided by the ECAL data.

Xiong, Xiaoxiong↗

IV&V Planning & Execution Initiative

Independent verification and validation (IV&V) is a systems engineering discipline which seeks to provide confidence that mission-critical software-dependent systems will operate safely and achieve all mission objectives. In order to optimize application of IV&V resources, it is necessary to identify specific assurance objectives that are most likely to reveal difficulty and therefore to increase confidence. Software assurance literature deals predominantly with the code itself. However, our experience is that the most significant software-related issues are discovered via analysis of other system artifacts such as operations concepts, requirements and design. Consequently, it is desirable to, when assessing risk and defining assurance objectives, consider all facets of the software system architecture. We describe in this presentation progress and lessons learned from an IV&V capability development initiative to enhance the IV&V project planning process using all available architecture information.

Risk↗

Planetary Surface Operations and Utilization: How ISS and Artemis Missions Can Be Used to Model Human Exploration of Mars

As NASA moves forward with plans to send astronauts to the Moon under Artemis missions and prepare for human exploration of Mars, the Agency is developing a set of high-level objectives for human spaceflight, identifying 50 points falling into four overarching categories of exploration. An element in NASA’s overall process of achieving these objectives is to leverage its assets and missions – such as the many crew increments sent to the International Space Station and future Artemis expeditions sent to the Moon – to develop more robust spaceflight systems and build a culture of interplanetary human exploration. This paper describes several examples of how NASA is exercising a process to achieve these objectives for future human Mars surface missions; both (a) building on lessons learned from ISS missions and maturing plans for Artemis missions, and (b) using human Mars mission planning to inform the plans for future ISS and Artemis missions so that the knowledge gained will reduce uncertainty and risk for Mars. One focal point for this two-way interaction between ISS and Artemis with future human Mars missions is a document titled “Reference Surface Activities for Crewed Mars Mission Systems and Utilization” (HEOMD-415), which describes the systems and operations of the crew thought necessary for the first human Mars surface mission. The details described in this paper will address three specific aspects of HEOMD-415 that have been influenced by ISS and where HEOMD-415 is influencing plans in ISS, Artemis, research and technology development, and other related aspects: (1) crew (activity planning and medical), (2) Mars surface infrastructure, and (3) communication and navigation support. The paper will close by describing near-term opportunities for tests and analogs relevant to these aspects of HEOMD-415.

Mars↗

PLANETARY SURFACE OPERATIONS AND UTILIZATION: HOW ISS AND ARTEMIS MISSIONS CAN BE USED TO MODEL HUMAN EXPLORATION OF MARS

As NASA moves forward with plans to send astronauts to the Moon under Artemis missions and prepare for human exploration of Mars, the Agency is developing a set of high-level objectives for human spaceflight, identifying 50 points falling into four overarching categories of exploration. An element in NASA’s overall process of achieving these objectives is to leverage its assets and missions – such as the many crew increments sent to the International Space Station and future Artemis expeditions sent to the Moon – to develop more robust spaceflight systems and build a culture of interplanetary human exploration. This paper describes several examples of how NASA is exercising a process to achieve these objectives for future human Mars surface missions; both (a) building on lessons learned from ISS missions and maturing plans for Artemis missions, and (b) using human Mars mission planning to inform the plans for future ISS and Artemis missions so that the knowledge gained will reduce uncertainty and risk for Mars. One focal point for this two-way interaction between ISS and Artemis with future human Mars missions is a document titled “Reference Surface Activities for Crewed Mars Mission Systems and Utilization” (HEOMD-415), which describes the systems and operations of the crew thought necessary for the first human Mars surface mission. The details described in this paper will address three specific aspects of HEOMD-415 that have been influenced by ISS and where HEOMD-415 is influencing plans in ISS, Artemis, research and technology development, and other related aspects: (1) crew (activity planning and medical), (2) Mars surface infrastructure, and (3) communication and navigation support. The paper will close by describing near-term opportunities for tests and analogs relevant to these aspects of HEOMD-415.

Mars↗

NASA Conjunction Assessment Risk Analysis (CARA) Ground Systems, Software and Operations Infrastructure Cloud Implementation

The growing number of large-scale constellations and the improvements made in the tracking and detection of resident space objects have contributed to the increase of satellite conjunction events. As a result of the increase of objects in Earth orbit, the timeline for risk analysis computations for satellite collision avoidance is more urgent when conjunctions occur. It is imperative NASA maintains a space environment safety functionality for the agency that allows CARA remote access to the ground system while maintaining redundancy. CARA’s On-premises (On-prem) ground system would no longer be able to meet these access and redundancy requirements, hence the investigation and eventual implementation of a Cloud-based ground station infrastructure as a viable solution. This paper will provide an overview of the principal parts of the Conjunction Assessment (CA) risk analysis process used at CARA, summarize the key drivers towards the Cloud solution, and share key lessons learned that are significant for any operational entity considering a cloud solution for real-time satellite operations to ensure a sustainable space traffic environment for all.

Sustainability↗

D and D Research on KM-IT Platform - 20494

The Knowledge Management Information Tool (KM-IT) is a web-based system developed to maintain and preserve the Department of Energy's (DoE's) knowledge base. The system was developed by Florida International University's Applied Research Center (FIU-ARC) with the support of the D and D community including the DOE Office of Environmental Management, and with the collaboration and support of the DoE's Energy Facility Contractors Group (EFCOG) and the former ALARA Centers at Hanford and Savannah. The KM-IT system is a community driven system tailored to serve the technical issues faced by the workforce across the DOE Complex. This KM-IT web-based interactive system is operational and available for use at www.dndkm.org and is currently comprised of the following modules: Web Crawler, Hotline, Technology, Hanford's ALARA Center Reports, Specialist Directory, Lessons Learned, Best Practices, Video/Picture Library, Vendors and Industry News. The Web Crawler dynamically searches through the KM-IT repository as well as the web and displays search results based on the search criteria. The Hotline allows registered users to post questions/problems related to D and D and to receive solutions from a subject-matter specialist. The Technology module serves as repository of D and D technologies and contains technology/ demonstration fact sheets and vendor information. D and D community members can add Lessons Learned, Best Practices, and Pictures/Videos to the D and D repository, after a formal approval process. The Vendor module provides a directory of commercial vendors who provide D and D related technologies, supplies, and services. KM-IT makes an excellent use of the knowledge that exists within the D and D community by allowing D and D project managers around the DOE complex to collaborate by sharing innovative ideas, past experiences, and practices and by maintaining a directory of subject matter specialists. FIU has developed the dedicated module on KM-IT platform to publish D and D research being performed at FIU. This module highlights current EM research efforts and activities in support of D and D being performed at FIU/SRNL associated with fixatives and intumescent products. FIU will expand this module to include the recent and current D and D research being performed across multiple DOE EM sites, national labs and universities. FIU will collaborate with SRNL, INL, ANL and other universities to explore and publish D and D research activities on KM-IT. As a result, the user community will have a centralized location to review new D and D related research across the DOE EM complex. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Lessons Learned from Recent Failure and Incident Investigations of Composite Structures

During the past few decades, NASA Langley Research Center (LaRC) has supported several large-scale failure and incident investigations and numerous requests for engineering consultations. Although various extenuating circumstances contributed to each of these incidents, in all cases, the failure resulted from accumulation and/or propagation of damage that reduced the load carrying capability of the structure to a level below that which was needed to sustain structural loads. A brief overview of various failure and incident investigations supported by LaRC, including some of the computational and experimental methodologies that have been applied, is presented. An important outcome of many of these failure and incident investigations is the development of an improved understanding of not only the state-of-the-art in experimental and analytical methods but also the state-of-the-art in the design and manufacturing processes that may contribute to such failures. In order to provide insight into such large-scale investigations, a series of lessons learned were captured. Awareness of these lessons learned is highly beneficial to engineers involved in similar investigations. Therefore, it is prudent that the lessons learned are disseminated such that they can be built upon in other investigations and in ensuing research and development activities.

Ransom, J. B.↗

Performance measurement for information systems: Industry perspectives

Performance measurement has become a focal topic for information systems (IS) organizations. Historically, IS performance measures have dealt with the efficiency of the data processing function. Today, the function of most IS organizations goes beyond simple data processing. To understand how IS organizations have developed meaningful performance measures that reflect their objectives and activities, industry perspectives on IS performance measurement was studied. The objectives of the study were to understand the state of the practice in IS performance techniques for IS performance measurement; to gather approaches and measures of actual performance measures used in industry; and to report patterns, trends, and lessons learned about performance measurement to NASA/JSC. Examples of how some of the most forward looking companies are shaping their IS processes through measurement is provided. Thoughts on the presence of a life-cycle to performance measures development and a suggested taxonomy for performance measurements are included in the appendices.

Bishop, Peter C.↗

Orion Heat Shield Manufacturing Producibility Improvements for the EM-1 Flight Test Program

This paper describes how the Orion program is incorporating improvements in the heat shield design and manufacturing processes reducing programmatic risk and ensuring crew safety in support of NASA’s Exploration Missions. The Orion program successfully completed the EFT-1 flight test in 2014 and is currently developing the EM-1 spacecraft to meet the test objectives of an orbital mission to the moon and return to earth in 2019. Lessons learned from the EFT-1 manufacturing and flight test experience are being incorporated into a wide variety of vehicle systems and manufacturing processes to reduce risk to the Orion missions and flight crew. A critical contributor to crew safety is the heat shield that protects the crew capsule during re-entry through the earth’s atmosphere for return from deep space. The first flight test vehicle, EFT-1, was manufactured and tested in the Neil Armstrong Operations and Checkout (O&C) facility at KSC to demonstrate early risk reduction including the functionality of the Thermal Protection Systems (TPS) for capsule safe return to earth. The approach for the EFT-1 heat shield utilized a low risk approach using Apollo heritage design and manufacturing processes using an Avcoat TPS ablator with a honeycomb substrate to provide a one piece heat shield to meet the mission re-entry heating environments. The manufacturing processes used honeycomb cell injection guns which were redeveloped from the Apollo Lunar Program processes to build the EFT-1 heat shield. The completed heat shield was transported across the country by aircraft to the O&C at KSC for installation onto the capsule. The EFT-1 heat shield successfully performed its mission and experienced ~80% of the re-entry velocity (50% heating rate) for a lunar return for an Exploration Mission. The second flight test vehicle is the EM-1 mission which will have additional flight systems installed to fly to the moon and return. Heat shield design and producibility improvements have been incorporated in the EM-1 vehicle to meet deep space mission and programmatic requirements. The design continues to use the Avcoat material, but in a “block” configuration to enable improvements in the application processes as well as additional improvements in the carrier structure design and manufacturing operations. Incorporating flight test results and producibility improvements from EFT-1 for the heat shield system design and processes have improved the thermal protection capability, improved the producibility, and cost for EM-1 flight test.

Producibility↗