Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “training data quality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

248 records · Page 14

Human Factors and Habitability Challenges for Mars Missions

As NASA is planning to send humans deeper into space than ever before, adequate crew health and performance will be critical for mission success. Within the NASA Human Research Program (HRP), the Space Human Factors and Habitability (SHFH) team is responsible for characterizing the risks associated with human capabilities and limitations with respect to long-duration spaceflight, and for providing mitigations (e.g., guidelines, technologies, and tools) to promote safe, reliable and productive missions. SHFH research includes three domains: Advanced Environmental Health (AEH), Advanced Food Technology (AFT), and Space Human Factors Engineering (SHFE). The AEH portfolio focuses on understanding the risk of microbial contamination of the spacecraft and on the development of standards for exposure to potential toxins such as chemicals, bacteria, fungus, and lunar/Martian dust. The two risks that the environmental health project focuses on are adverse health effects due to changes in host-microbe interactions, and risks associated with exposure to dust in planetary surface habitats. This portfolio also proposes countermeasures to these risks by making recommendations that relate to requirements for environmental quality, foods, and crew health on spacecraft and space missions. The AFT portfolio focuses on reducing the mass, volume, and waste of the entire integrated food system to be used in exploration missions, and investigating processing methods to extend the shelf life of food items up to five years, while assuring that exploration crews will have nutritious and palatable foods. The portfolio also delivers improvements in both the food itself and the technologies for storing and preparing it. SHFE sponsors research to establish human factors and habitability standards and guidelines in five risk areas, and provides improved design concepts for advanced crew interfaces and habitability systems. These risk areas include: Incompatible vehicle/habitat design, inadequate human-computer interaction, inadequate critical task design, inadequate human-automation/robotic interaction, and performance errors due to training deficiencies. To address the identified research gaps within each risk, SHFH's research plan includes studies in the laboratory, in analogs, and on International Space Station (ISS). In addition to establishing and maintaining the risk-based research portfolio, SHFH is also implementing a qualitative approach to determine how we at NASA evaluate human performance. Via interviews with experts, such as trainers, flight controllers, and flight surgeons, we are collecting the metrics by which they assess human performance, evidence of performance issues, and potential or actual consequences. The Human Performance Data Project will determine what human performance data have been collected in the past at NASA, and what data should be collected in the future in order to complete our knowledgebase and reduce risks related to human factors and habitability.

Whitmore, Mihriban↗

Assessing the Needs of NASA's Near Real-Time Earth Observation Products

"The 2017-2027 Decadal Survey for Earth Science and Applications from Space stated that NASA's Earth Science with planned implementation of applications provides sustained earth observations for societal benefits [1]. The Decadal Survey indicated that data latency is invaluable for time-sensitive applications including disaster risk reduction, wildland fire carbon emissions quantification, real-time measurements of the state of the hydrologic systems and many more. Data latency refers to the time between earth observation and data products available to users. During the past 13 years, NASA's Land, Atmosphere Near Real-Time Capability for Earth Observing Systems (LANCE) continues to provide free access to earth observation products that are made available much quicker than routine processing allows. The latency of most LANCE data products is Near Real-time (NRT) which is defined as less than three hours from satellite observations [2]. LANCE is managed by the Earth Science Data and Information System (ESDIS) Project at NASA Goddard Space Flight Center [3], and a User Working Group (UWG) is responsible for providing guidance to LANCE. LANCE data are used by direct users and brokers who add value to the data [4]. NASA Earth Applied Sciences Program (ASP) is one of the primary users of LANCE, which collaborates with partner organizations and provides support to scientists to solve problems in applications of earth observations. ASP promotes the use of LANCE NRT data products to demonstrate applications in decision making, facilitates end-user feedback to the science team to improve data products, and provides information on future demands for research. LANCE supports applications that need a rapid response including detecting wildland fires and volcanic eruptions, tracking smoke, ash and dust plumes, monitoring air quality and tracking extreme weather events such as hurricanes, landslides, and floods. To gather feedback regarding the availability, accessibility and actionability of NASA's NRT data products for societal benefit, three surveys and a few discussions with experts involved in the topic within ASP were conducted from the perspective of users. Feedback has been collected from users who are interested in using low latency NASA data within application communities of agriculture, disasters, water resources, health and air quality, ecological conservation, wildland fires and capacity building. Analysis-ready NRT data products in a variety of formats have been mentioned many times in the collected feedback, especially for applied users with little to no experience using research-grade earth observation products. Users prefer to have products that can be easily integrated into their existing workflows and take their analysis to the data. HDF5 is a commonly used data format for research, but typically requires some conversion to a more friendly format for applications and regular use in decision-making. Users prefer the GeoTIFF data format that can be directly ingested into a GIS mapping software and platform for data analysis and visualization. For example, LANCE’s fire, flood, SO2 and Black Marble Nighttime Blue/Yellow Composite data products have been integrated into NASA Disasters Mapping Portal, which is an GIS-based open data portal, for users in the disaster management community. There are 291 LANCE NRT layers available through GIBS and Worldview, where users can download a snapshot in GeoTIFF format. Operational users expect data to be processed as close to the user as possible. The collected feedback indicates that LANCE fire products within 3 hours latency would meet the needs of the wildland fire community. The ideal latency for volcanic application is 10-15 minutes. Users in Volcanic Ash Advisory Centers (VAAC) reported that the first forecast volcanic product should be issued within 75 minutes from the volcano eruption [5]. Overall, for disaster applications, data latency within 3 hours is useful while latency greater than 12 hours is not timely enough for operational use. Capacity building and training are critical for users to be able to access, interpret and use data products and tools for their decision making, especially for applied users with limited experience using earth observation products. LANCE data products have been used in a number of capacity building projects domestically and internationally [6]. As LANCE continues to bring new products into the system, users request training to utilize LANCE new and upcoming data products and capabilities in their applications. Due to the limitation of bandwidth and downstream flow paths, users in some developing countries need tools to select and download data for a specific area of interest instead of bulk downloads. The collected feedback also shows the lack of available SAR satellite low latency data products. The advantages of SAR to monitor conditions and changes on the ground through darkness, clouds, volcanic ash, and other atmospheric conditions, are appealing to low latency users. For example, terabytes of low latency but cloudy optical images are not helpful in rapidly identifying the extent of flood or fire impacts. LANCE could be complemented with low latency measurements via the upcoming NASA-ISRO Synthetic Aperture Radar (NISAR) mission [7]. Requests for higher spatial resolution products are expressed. A user from the wildland fire management community reported that products with 30-m spatial resolution could be used to detect small fires. The 30-m Landsat OLI fire data is now part of NASA’s Fire Information for Resource Management System (FIRMS) US/Canada [8]. Within the open and free NASA resources, LANCE disseminates NRT data products in a manner that allows them to be accessible and understandable to both scientific and applied users. In many application areas, latency plays an important or even decisive role where low latency earth observations help people to observe areas of interest, detect and track changes in the environment and make timely decisions. NASA’s Earth Applied Sciences Program promotes the use of LANCE NRT products and builds a bridge between application users and research teams. The collected feedback indicates data latency within 3 hours is useful for most of the applications, and shows the needs of user-friendly, analysis-ready products, and requests training on LANCE’s new and upcoming data products. User feedback has been provided to LANCE UWG for guidance and recommendations, and for translating findings into something actionable.

Tian Yao↗

Beyond Fair: Engagement, Data Usability, and Open Community Productivity through the NASA Open Science Data Repository

The FAIR principle (findable, accessible, interoperable, and reusable) governs the storage and sharing of NASA space biology and health data[1]. These guiding principles maximize reuse of data and the reproducibility of scientific findings. The NASA Open Science Data Repository (OSDR; an expansion of NASA GeneLab) was built on the FAIR principles and houses over 500 studies and close to 1000 datasets from decades of space life sciences experiments. OSDR embodies the FAIR principles through data governance that includes mediated, embargoed, and fully open access data. The FAIR data governance principles were recently proposed to be expanded to encompass a FAIREST framework for assessing research data repositories (FAIR + Engagement, Social connections, and Trust)[2]. FAIREST emphasizes the importance of data repositories engaging with the scientific community and gaining the trust of researchers regarding data quality. Trust also refers to the TRUST principles developed for assessment of digital repositories: Transparency, Responsibility, User Focus, Sustainability, Technology[3]. We present the “Open Science for Life in Space” Analysis Working Groups (AWGs) as evidence regarding the power of engagement, social connections, and trust which has enhanced OSDR’s capabilities and productivity. AWG members engage in two main activities. One, members provide feedback on OSDR scientific standards for data ingestion, curation, and reuse (study, subject and assay metadata; processing pipelines; dataset formats and uniformed structures for machine-readability). Two, AWG members collaborate to mine-reuse OSDR data to conduct scientific analysis. With nearly 800 active members, the AWGs have resulted in 32 publications re-using OSDR data and contributed many papers in two major special issues in Cell (2020) and Nature (2024). AWGs also serve as networking groups, facilitate social connections between researchers at all levels of experience, and also have a social online ‘Forum’ used to keep members informed on projects and opportunities. This community-centric, productive, and trustworthy data culture has resulted in a broader effect with international space agencies, academics, and the commercial space sector wanting to submit their data to OSDR. Ten studies of Inspiration 4 data were recently publicly released by OSDR, as were some JAXA human data. Coming up soon in OSDR are data submissions from the European Space Agency, Virgin Galactic PIs, and SpaceX Polaris Dawn. A major benefit of OSDR is the array of standardized and uniformly formatted data (which was developed through AWG member consensus), from which visualization tools, analysis tools, and machine learning models can be built or trained. This talk will cover the Multi-Study Visualization Tool, the Environmental Data Application, RadLab, and a UCSF-NSF funded knowledge graph biomedical health discovery tool ‘SPOKE’ currently being integrated with OSDR. OSDR also provides training programs in bioinformatics and machine learning to improve the scientific community’s awareness of data availability and to boost their ability to perform data analysis. The increasing engagement of the scientific community and the public with technologies powered by artificial intelligence (AI) heightens the need for data analysis to be transparent. The AI for Life in Space initiative leverages the data products provided in OSDR to train AI models, with an emphasis on explainable and trustworthy AI, which would not be possible without FAIR data and metadata. Overall, here we will demonstrate the importance for NASA life sciences data repositories to adhere to the FAIREST framework, by providing examples and success stories from different aspects of OSDR.

data↗

Decision Making in Action: Applying Research to Practice

The importance of decision-making to safety in complex, dynamic environments like mission control centers, aviation, and offshore installations has been well established. NASA-ARC has a program of research dedicated to fostering safe and effective decision-making in the manned spaceflight environment: Because access to spaceflight is limited, environments with similar characteristics, including aviation and nuclear power plants, serve as analogs from which space-relevant data can be gathered and theories developed. Analyses of aviation accidents cite crew judgement and decision making as causes or contributing factors in over half of all accidents. Yet laboratory research on decision making has not proven especially helpful in improving the quality of decisions in these kinds of environments. One reason is that the traditional, analytic decision models are inappropriate to multi-dimensional, high-risk environments, and do not accurately describe what expert human decision makers do when they make decisions that have consequences. A new model of dynamic, naturalistic decision making is offered that may prove useful for improving decision making in complex, isolated, confined and high-risk environments. Based on analyses of crew performance in full-mission simulators and accident reports, features that define effective decision strategies in abnormal or emergency situations have been identified. These include accurate situation assessment (including time and risk assessment), appreciation of the complexity of the problem, sensitivity to constraints on the decision, timeliness of the response, and use of adequate information. More effective crews also manage their workload to provide themselves with time and resources to make good good decisions are appropriate to the demands of the situation. Effective crew decision making and overall performance are mediated by crew communication. Communication contributes to performance because it assures that all crew members have essential information, but it also regulates and coordinates crew actions and is the medium of collective thinking in response to a problem. This presentation will examine the relations between leadership, communication, decision making and overall crew performance. Implications of these findings for training will be discussed.

Orasanu, Judith↗

Decision Making in the Airplane

The Importance of decision-making to safety in complex, dynamic environments like mission control centers, aviation, and offshore installations has been well established. NASA-ARC has a program of research dedicated to fostering safe and effective decision-making in the manned spaceflight environment. Because access to spaceflight is limited, environments with similar characteristics, including aviation and nuclear power plants, serve as analogs from which space-relevant data can be gathered and theories developed. Analyses of aviation accidents cite crew judgement and decision making as causes or contributing factors in over half of all accidents. Yet laboratory research on decision making has not proven especially helpful In improving the quality of decisions in these kinds of environments. One reason is that the traditional, analytic decision models are inappropriate to multi-dimensional, high-risk environments, and do not accurately describe what expert human decision makers do when they make decisions that have consequences. A new model of dynamic, naturalistic decision making is offered that may prove useful for improving decision making in complex, isolated, confined and high-risk environments. Based on analyses of crew performance in full-mission simulators and accident reports, features that define effective decision strategies in abnormal or emergency situations have been identified. These include accurate situation assessment (including time and risk assessment), appreciation of the complexity of the problem, sensitivity to constraints on the decision, timeliness of the response, and use of adequate information. More effective crews also manage their workload to provide themselves with time and resources to make good decisions. In brief, good decisions are appropriate to the demands of the situation. Effective crew decision making and overall performance are mediated by crew communication. Communication contributes to performance because it assures that all crew members have essential information, but it also regulates and coordinates crew actions and is the medium of collective thinking In response to a problem, This presentation will examine the relations between leadership, communication, decision making and overall crew performance. Implications of these findings for training will be discussed.

Orasanu, Judith↗

In-Situ and Remote-Sensing Data Fusion Using Machine Learning Techniques to Infer Urban and Fire Related Pollution Plumes

Airmass type characterization is key in understanding the relative contribution of various emission sources to atmospheric composition and air quality and can be useful in bottom-up model validation and emission inventories. However, classification of pollution plumes from space is often not trivial. Sub-orbital campaigns, such as SEAC4RS (Studies of Emissions, Atmospheric Composition, Clouds and Climate Coupling by Regional Surveys) give us a unique opportunity to study atmospheric composition in detail, by using a vast suite of in-situ instruments for the detection of trace gases and aerosols. These measurements allow identification of spatial and temporal atmospheric composition changes due to various pollution plumes resulting from urban, biogenic and smoke emissions. Nevertheless, to transfer the knowledge gathered from such campaigns into a global spatial and temporal context, there is a need to develop workflow that can be applicable to measurements from space. In this work we rely on sub-orbital in-situ and total column remote sensing measurements of various pollution plumes taken aboard the NASA DC-8 during 2013 SEAC4RS campaign, linking them through a neural-network (NN) algorithm to allow inference of pollution plume types by input of columnar aerosol and trace-gas measurements. In particular, we use the 4STAR (Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research) airborne measurements of wavelength dependent aerosol optical depth (AOD), particle size proxies, O3, NO2 and water vapor to classify different pollution plumes. Our method relies on assigning a-priori ground-truth labeling to the various plumes, which include urban pollution, different fire types (i.e. forest and agriculture) and fire stage (i.e. fresh and aged) using cluster analysis of aerosol and trace-gases in-situ and auxiliary (e.g. trajectory) data and the training of a NN scheme to fit the best prediction parameters using 4STAR measurements as input. We explore our misclassification rates as related to our ground-truth labels, and with multi-layered pollution plume cases. The next step in our analysis is to optimize parameter selection for a scheme that can be applied to space-borne aerosol and trace-gas observation platforms such as OMI, and future geostationary satellites such as TEMPO and GEO-CAPE.

Neural-network↗

Launch Control System Software Development System Automation Testing

The Spaceport Command and Control System (SCCS) is the National Aeronautics and Space Administration's (NASA) launch control system for the Orion capsule and Space Launch System, the next generation manned rocket currently in development. This system requires high quality testing that will measure and test the capabilities of the system. For the past two years, the Exploration and Operations Division at Kennedy Space Center (KSC) has assigned a group including interns and full-time engineers to develop automated tests to save the project time and money. The team worked on automating the testing process for the SCCS GUI that would use streamed simulated data from the testing servers to produce data, plots, statuses, etc. to the GUI. The software used to develop automated tests included an automated testing framework and an automation library. The automated testing framework has a tabular-style syntax, which means the functionality of a line of code must have the appropriate number of tabs for the line to function as intended. The header section contains either paths to custom resources or the names of libraries being used. The automation library contains functionality to automate anything that appears on a desired screen with the use of image recognition software to detect and control GUI components. The data section contains any data values strictly created for the current testing file. The body section holds the tests that are being run. The function section can include any number of functions that may be used by the current testing file or any other file that resources it. The resources and body section are required for all test files; the data and function sections can be left empty if the data values and functions being used are from a resourced library or another file. To help equip the automation team with better tools, the Project Lead of the Automated Testing Team, Jason Kapusta, assigned the task to install and train an optical character recognition (OCR) tool to Brandon Echols, a fellow intern, and I. The purpose of the OCR tool is to analyze an image and find the coordinates of any group of text. Some issues that arose while installing the OCR tool included the absence of certain libraries needed to train the tool and an outdated software version. We eventually resolved the issues and successfully installed the OCR tool. Training the tool required many images and different fonts and sizes, but in the end the tool learned to accurately decipher the text in the images and their coordinates. The OCR tool produced a file that contained significant metadata for each section of text, but only the text and coordinates of the text was required for our purpose. The team made a script to parse the information we wanted from the OCR file to a different file that would be used by automation functions within the automated framework. Since a majority of development and testing for the automated test cases for the GUI in question has been done using live simulated data on the workstations at the Launch Control Center (LCC), a large amount of progress has been made. As of this writing, about 60% of all of automated testing has been implemented. Additionally, the OCR tool will help make our automated tests more robust due to the tool's text recognition being highly scalable to different text fonts and text sizes. Soon we will have the whole test system automated, allowing for more full-time engineers working on development projects.

Automation↗

A New Concurrent Engineering Tool for the New Mission Design Center at NASA Ames Research Center

The NASA Ames Mission Design Center (MDC) has undergone a significant transformation process in recent years, culminating in becoming a true Concurrent Engineering Center. The underlying goal of this transformation is to better serve the Ames PI community in a cost-effective and rapidly-responsive way, providing quality products pivotal to the decision-making proposal strategy of our center. The four pillars of the change focus on four areas: personnel, physical places, tools, and training. Personnel: the MDC switched from using a dedicated pool of engineers—mostly entry-level career—for a matrixed approach with more experienced Subject Matter Experts, usually involved in spaceflight projects. These SMEs get detailed to the MDC for the duration of the study on a part-time or full-time basis. Physical places: The physical aspect pertains mostly to the layout of the new Engineering building and the dedicated concurrent engineering layout to foster collaboration. The current plan includes a dedicated space for concurrent engineering sessions as well as dedicated project rooms for concept studies. Tool: the MDC team is developing a new in-house concurrent engineering tool to facilitate concurrent engineering sessions. The team leveraged the many lessons learned and insight gained from using the current concurrent engineering tool, in use since 2007. SMEs have been involved throughout its design and development, ensuring accuracy and providing validity to the implementation approach. This new tool is database-driven and allows a team to work concurrently on the same model of a mission concept. “Workspaces” are provided for each of the traditional spacecraft mission design disciplines, including cost accounting and systems engineering. There are multiple tiers of fidelity available within each workspace, which can be completed parametrically or independently from the other disciplines as needed or synchronously with the other disciplines. A “commit” step synchronizes a workspace with the mission database and identifies any potential conflicts, along with the user who entered the conflicting data. A Mission Summary workspace enables a Study Lead to run an effective CE session, displaying key graphics, workspace status information, and technical and monetary budget information. This new CE tool will be undergoing Beta Testing with its primary user base and a limited Parts database in the summer of 2020. The team plans to release the first fully operational version in December 2020. Training: working in early concept development and maturation for a space mission requires a unique mindset and being comfortable with uncertainties in an environment where requirements are not yet fully developed, and where changes and trade-offs happen at a high tempo. The MDC started a weekly training program to ensure a common knowledge base on how do develop and mature early concept studies, as well as how to operate in a concurrent engineering environment. In conclusion, the MDC transformation will provide the overall PI community focused on cost-effective small satellite scientific missions with a powerful tool to address and mature early concepts more effectively and efficiently.

David Mauro↗

Decision Making in Action: Applying Research to Practice

The importance of decision-making to safety in complex, dynamic environments like mission control centers and offshore installations has been well established. NASA-ARC has a program of research dedicated to fostering safe and effective decision-making in the manned spaceflight environment. Because access to spaceflight is limited, environments with similar characteristics, including aviation and nuclear power plants, serve as analogs from which space-relevant data can be gathered and theories developed. Analyses of aviation accidents cite crew judgement and decision making as causes or contributing factors in over half of all accidents. A similar observation has been made in nuclear power plants. Yet laboratory research on decision making has not proven especially helpful in improving the quality of decisions in these kinds of environments. One reason is that the traditional, analytic decision models are inappropriate to multidimensional, high-risk environments, and do not accurately describe what expert human decision makers do when they make decisions that have consequences. A new model of dynamic, naturalistic decision making is offered that may prove useful for improving decision making in complex, isolated, confined and high-risk environments. Based on analyses of crew performance in full-mission simulators and accident reports, features that define effective decision strategies in abnormal or emergency situations have been identified. These include accurate situation assessment (including time and risk assessment), appreciation of the complexity of the problem, sensitivity to constraints on the decision, timeliness of the response, and use of adequate information. More effective crews also manage their workload to provide themselves with time and resources to make good decisions. In brief, good decisions are appropriate to the demands of the situation. Effective crew decision making and overall performance are mediated by crew communication. Communication contributes to performance because it assures that all crew members have essential information, but it also regulates and coordinates crew actions and is the medium of collective thinking in response to a problem. This presentation will examine the relations between leadership, communication, decision making and overall crew performance. Implications of these findings for spaceflight and training for offshore installations will be discussed.

Orasanu, Judith↗

Decision Making in Action

The importance of decision-making to safety in complex, dynamic environments like mission control centers and offshore installations has been well established. NASA-ARC has a program of research dedicated to fostering safe and effective decision-making in the manned spaceflight environment. Because access to spaceflight is limited, environments with similar characteristics, including aviation and nuclear power plants, serve as analogs from which space-relevant data can be gathered and theories developed. Analyses of aviation accidents cite crew judgement and decision making as causes or contributing factors in over half of all accidents. A similar observation has been made in nuclear power plants. Yet laboratory research on decision making has not proven especially helpful in improving the quality of decisions in these kinds of environments. One reason is that the traditional, analytic decision models are inappropriate to multidimensional, high-risk environments, and do not accurately describe what expert human decision makers do when they make decisions that have consequences. A new model of dynamic, naturalistic decision making is offered that may prove useful for improving decision making in complex, isolated, confined and high-risk environments. Based on analyses of crew performance in full-mission simulators and accident reports, features that define effective decision strategies in abnormal or emergency situations have been identified. These include accurate situation assessment (including time and risk assessment), appreciation of the complexity of the problem, sensitivity to constraints on the decision, timeliness of the response, and use of adequate information. More effective crews also manage their workload to provide themselves with time and resources to make good decisions. In brief, good decisions are appropriate to the demands of the situation. Effective crew decision making and overall performance are mediated by crew communication. Communication contributes to performance because it assures that all crew members have essential information, but it also regulates and coordinates crew actions and is the medium of collective thinking in response to a problem. This presentation will examine the relations between leadership, communication, decision making and overall crew performance. Implications of these findings for spaceflight and training for offshore installations will be discussed.

Orasanu, Judith↗

Full Life-Cycle Defect Management Assessment: Initial Inspection Data Collection Results and Research Questions for Further Study

It is often the case in software projects that when schedule and budget resources are limited, the Verification and Validation (V&V) activities suffer. Fewer V&V activities can be afforded and moreover, short-term challenges can result in V&V activities being scaled back or dropped altogether. As a result, too often the default solution is to save activities for improving software quality until too late in the life-cycle, relying on late-term code inspections followed by thorough testing activities to reduce defect counts to acceptable levels. As many project managers realize, however, this is a resource-intensive way of achieving the required quality for software. The Full Life-cycle Defect Management Assessment Initiative, funded by NASA s Office of Safety and Mission Assurance under the Software Assurance Research Program, aims to address these problems by: Improving the effectiveness of early life-cycle V&V activities to make their benefits more attractive to team leads. Specifically, we focus on software inspection, a proven method that can be applied to any software work product, long before executable code has been developed; Better communicating this effectiveness to software development teams, along with suggestions for parameters to improve in the future to increase effectiveness; Analyzing the impact of early life-cycle V&V on the effectiveness and cost required for late life-cycle V&V activities, such as testing, in order to make the tradeoffs more apparent. This white paper reports on an initial milestone in this work, the development of a preliminary model of inspection effectiveness across multiple NASA Centers. This model contributes toward reaching our project goals by: Allowing an examination of inspection parameters, across different types of projects and different work products, for an analysis of factors that impact defect detection effectiveness. Allowing a comparison of this NASA-specific model to existing recommendations in the literature regarding how to plan effective inspections. Forming a baseline model which can be extended to incorporate factors describing: the numbers and types of defects that are missed by inspections; how such defects flow downstream through software development phases; how effectively they can be caught by testing activities in the late stages of development. The model has been implemented in a prototype web-enabled decision-support tool which allows developers to enter their inspection data and receive feedback based on a comparison against the model. The tool also allows users to access reusable materials (such as checklists) from projects included in the baseline. Both the tool itself and the model underlying it will continue to be extended throughout the remainder of this initiative. As results of analyzing inspection effectiveness for defect containment are determined, they can be shared via the tool and also via updates to existing training courses on metrics and software inspections. Moreover, the tool will help satisfy key CMMI requirements for the NASA Centers, as it will enable NASA to take a global view across peer review results for various types of projects to identify systemic problems. This analysis can result in continuous improvements to the approach to verification.

Shull, Forrest↗

NASA Space Environment Analog for Training, Engineering, Science, and Technology (SEATEST) 6 Detailed Final Report

After more than 50 years since the last crewed lunar landing, plans for more missions to the moon are in development. For these missions, efficient and sustainable logistics will be critical. Additionally, innovative methods of cargo transfer to and from a lunar outpost should be considered for successfully establishing a permanent presence on the moon. SEATEST (Space Environment Analog for Training, Engineering, Science, and Technology) is an immersive mission-analogous operational atmosphere where buoyancy effects and supplemental weights can simulate partial gravity conditions similar to those astronauts will experience on the moon. SEATEST 6 took place at the University of Southern California (USC) Wrigley Marine Science Center on Santa Catalina Island from July 18-30, 2023. The analog was used to collect preliminary logistics data on two different offloading conceptual methods (a davit and a zipline) during a simulated lunar mission. Pre-test analysis indicated for a crew of two on a 14-day mission, approximately three Medium Pressurized Logistics Containers (MPLC) sized logistics containers (or a total of 37.5 single Cargo Transfer Bag Equivalents (CTBE)) would be needed to support a mission. A Computer-Aided Design (CAD) analysis was employed on the SEATEST airlock mockup to determine how many logistic containers would fit with two suited crewmembers, don/doff stands, and hatch operations. It was determined that for SEATEST, a total of 15 1.0 Small Pressurized Logistics Containers (SPLCs) and 8 2.0 SPLCs would adequately fit into the approximate 9.5 cubic meter airlock volume. This does not fully represent a complete 14-day logistic supply; however, it does provide a preliminary estimate to initiate design conversations between logistics teams and crew at this early stage of development. Data were collected in eight logistics transfer scenarios over two days with four scenarios per day. Five test subject crew participated in scenarios as pairs. Scenarios included two sizes of logistics containers – 1.0 SPLC (equivalent to a single Cargo Transfer Bag (CTB) and 2.0 SPLC (equivalent to two CTBs). Planed evaluations included the use of a logistics port compared to transfer through an Airlock hatch, offloading methods based on either a davit or a zipline system, choreography of cargo in the airlock to permit ingress and suit doffing, and dust removal protocols for an understanding of the overall impact to transfer ops. Data collected included objective data (task times for conducting overall tasks and subtasks, full audio/video of test activities, and inadvertent “dings” on hardware) and subjective data (crew consensus of: task acceptability and capability assessment ratings related to best practices, considerations, and constraints for EVA-driven logistics transfer ConOps, sim quality of the test environment, and more general debrief comments). The two logistic offloading transfer concepts (davit, zipline) presented both advantages and limitations. The davit’s flexibility in allowing the crew to pick up the containers without physical interaction was well regarded by the crew. Some limitations of select davit hardware components were noted, but the overall concept was acceptable. The zipline system proved to be the most efficient way of moving logistics from the lander to the airlock and eliminated the need for dust operations. However, extended and repetitive lifting of containers to the line could be fatiguing. In conclusion, logistics transfer could hypothetically be achieved without an offloading method; however, the time requirement for such operations would be prohibitive. Results of crew subjective feedback proposed a combined or hybrid davit/zipline method to increase efficiency.

Logistics↗

ARES Biennial Report 2012 Final

Since the return of the first lunar samples, what is now the Astromaterials Research and Exploration Science (ARES) Directorate has had curatorial responsibility for all NASA-held extraterrestrial materials. Originating during the Apollo Program (1960s), this capability at Johnson Space Center (JSC) included scientists who were responsible for the science planning and training of astronauts for lunar surface activities as well as experts in the analysis and preservation of the precious returned samples. Today, ARES conducts research in basic and applied space and planetary science, and its scientific staff represents a broad diversity of expertise in the physical sciences (physics, chemistry, geology, astronomy), mathematics, and engineering organized into three offices (figure 1): Astromaterials Research (KR), Astromaterials Acquisition and Curation (KT), and Human Exploration Science (KX). Scientists within the Astromaterials Acquisition and Curation Office preserve, protect, document, and distribute samples of the current astromaterials collections. Since the return of the first lunar samples, ARES has been assigned curatorial responsibility for all NASA-held extraterrestrial materials (Apollo lunar samples, Antarctic meteorites - some of which have been confirmed to have originated on the Moon and on Mars - cosmic dust, solar wind samples, comet and interstellar dust particles, and space-exposed hardware). The responsibilities of curation consist not only of the longterm care of the samples, but also the support and planning for future sample collection missions and research and technology to enable new sample types. Curation provides the foundation for research into the samples. The Lunar Sample Facility and other curation clean rooms, the data center, laboratories, and associated instrumentation are unique NASA resources that, together with our staff's fundamental understanding of the entire collection, provide a service to the external research community, which relies on access to the samples. The curation efforts are greatly enhanced by a strong group of planetary scientists who conduct peerreviewed astromaterials research. Astromaterials Research Office scientists conduct peer-reviewed research as Principal or Co-Investigators in planetary science (e. g., cosmochemistry, origins of solar systems, Mars fundamental research, planetary geology and geophysics) and participate as Co-Investigators or Participating Scientists in many of NASA's robotic planetary missions. Since the last report, ARES has achieved several noteworthy milestones, some of which are documented in detail in the sections that follow. Within the Human Exploration Science Office, ARES is a world leader in orbital debris research, modeling and monitoring the debris environment, designing debris shielding, and developing policy to control and mitigate the orbital debris population. ARES has aggressively pursued refinements in knowledge of the debris environment and the hazard it presents to spacecraft. Additionally, the ARES Image Science and Analysis Group has been recognized as world class as a result of the high quality of near-real-time analysis of ascent and on-orbit inspection imagery to identify debris shedding, anomalies, and associated potential damage during Space Shuttle missions. ARES Earth scientists manage and continuously update the database of astronaut photography that is predominantly from Shuttle and ISS missions, but also includes the results of 40 years of human spaceflight. The Crew Earth Observations Web site (http://eol.jsc.nasa.gov/Education/ESS/crew.htm) continues to receive several million hits per month. ARES scientists are also influencing decisions in the development of the next generation of human and robotic spacecraft and missions through laboratory tests on the optical qualities of materials for windows, micrometeoroid/orbital debris shielding technology, and analog activities to assess surface science operations. ARES serves as host to numerous students and visiting scientists as part of the services provided to the research community and conducts a robust education and outreach program. ARES scientists are recognized nationally and internationally by virtue of their success in publishing in peer-reviewed journals and winning competitive research proposals. ARES scientists have won every major award presented by the Meteoritical Society, including the Leonard Medal, the most prestigious award in planetary science and cosmochemistry; the Barringer Medal, recognizing outstanding work in the field of impact cratering; the Nier Prize for outstanding research by a young scientist; and several recipients of the Nininger Meteorite Award. One of our scientists received the Department of Defense (DoD) Joint Meritorious Civilian Service Award (the highest civilian honor given by the DoD). ARES has established numerous partnerships with other NASA Centers, universities, and national laboratories. ARES scientists serve as journal editors, members of advisory panels and review committees, and society officers, and several scientists have been elected as Fellows in their professional societies. This biennial report summarizes a subset of the accomplishments made by each of the ARES offices and highlights participation in ongoing human and robotic missions, development of new missions, and planning for future human and robotic exploration of the solar system beyond low Earth orbit.

Stansbery, Eileen↗

Teacher Enhancement Institute

During the 1980's, a period of intense concern over educational quality in the United States, few indicators of U.S. student achievement garnered the interest of policy makers and pundits as successfully as the results of international testing in mathematics and science. This concern was so great that as a part of the Goals 2000 initiative, President George Bush indicated that 'By the year 2000, U.S. students should be first in the world in mathematics and science.' The Clinton Administration is placing a major emphasis, not only on rigorous academic standards and creating a new system for assessing students' progress, but also including professional development as a major focus. The argument being that teachers need more sustained, intensive training to prepare them to teach to higher standards. Executive order 12821 mandates that national laboratories 'assist in the mathematics and science education of our Nation's students, teachers, parents and the public by establishing programs at their agency to provide for training elementary and secondary school teachers to improve their knowledge of mathematics and science'. These and other issues led to the development of ideas for a project that addresses the need for excellence in mathematics, science and technology instruction. In response to these initiatives the NASA/LaRC Teacher Enhancement Institute was proposed. The TEI incorporated systemic reform perspectives, enhanced content knowledge for teachers, and teacher preparation. Emphasis was also placed on recruiting those educators who teach in impoverished urban school districts with at-risk student populations who have been traditionally under represented in science, mathematics, technology and engineering. Participants in the Teacher Enhancement Institute were 37 teachers from grades K-8, teaching in Region 2 in the state of Virginia, as well as 2 preservice teachers from Norfolk State University and one teacher from Dublin, Virginia, where a Science/Mathematics model school has been established. Teachers selected for this project represented school systems where income levels are extremely low, and students served tend not to receive innovative instruction in mathematics and science and their use of technology is limited. The Teacher Enhancement Institute contained several features, that when combined, allowed for a unique experience. Some of these features included local teachers, administrators and school board members as presenters, instruction and use of technology every day, tours of select features of the research facility, briefings by NASA/LaRC scientists, engineers and researchers as well as individuals from the Continuous Electron Beam Accelerator Facility (CEBAF). Another unique feature of this program is to have participants convene on three separate occasions throughout the academic year to discuss strategies for information dissemination and implementation results. Teachers' attitudes towards the use of technology, their ability to develop lessons using technology and their ability to develop lessons using information obtained through TEI were assessed using instruments developed by TEI summer faculty members. Data from these instruments were analyzed and reported in a final report submitted to the director of the Office of Education.

Marshall-Bradley, Tina↗