Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “TEAM”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Examining Performance and Usability of Situation Awareness Communication Tool for NASA's High Density Vertiplex (HDV) Team

Purpose: As cities get more crowded, the roadway infrastructure cannot keep up with the travel demands. Aviation can be a solution. Organizations supporting NASA’s Urban Air Mobility (UAM) concept are conducting studies on feasible concepts of operations for the new air traffic management system required to implement UAM. NASA’s High Density Vertiplex (HDV) team conducts studies using both live flights and simulations. Significance: The goal of this study is to evaluate the effectiveness of a communication tool developed for this team to enhance team situation awareness. Specifically, the study aims to determine if the communication tool is effective in allowing NASA-Langley and NASA-Ames team members playing different roles to understand what others are doing so that completed steps can be communicated to the whole team. Methods: This study asks participants to conduct four distinct scenarios using an Adobe XD prototype. Participants included five members of the target audience, who each received up to 15 minutes of training on how to use the Adobe XD prototype. The participants were NASA-Ames or NASA-Langley researchers, developers or tech leads who had 0 to 15 years of experience. Their ages ranged from 20 to 40 years old, and they were of both genders. After training, each participant was asked to do 4 tasks of varying difficulty, using the prototype testbed. After each task they reported on task difficulty and after all tasks were completed they were asked to fill out the System Usability Survey (SUS). Performance will be assessed through task completion time and accuracy rating. Results: User perception was evaluated by the SUS which showed a mean score over the six participants of 84. All the participants were above the acceptable range which was 70 and nobody was in the marginal usability zone between 50 and 70. In addition, most of the participants did well in terms of time on task, success rate and task difficulty on all the tasks except for Task 3. Participants had two minutes to do the task correctly to succeed at the task, otherwise it was marked as a failure. The geomean for Task 1 for completion time was 22.20; Task 2 was 58.28; Task 3 was 84.68 and Task 4 was 19.61. In Task 3, three out of six people failed this task but all five scored this with an average score 4.2 out of 5 for self-rating on task difficulty.

human factors↗

A Preliminary Study on the Feasibility of Large Language Models for Detecting Micro-Behaviors Among Team Members in Space Missions

Large-language models (LLMs) have been recently used for spoken language understanding (SLU) to infer meaning and semantics from speech in tasks such as speaker intent and sentiment classification. Due to being trained on large amounts of data, and their ability to understand context and relationships between words, LLMs are competent, enabling them to generalize across tasks without requiring many task-specific training samples. This research examines the feasibility of few-shot learning in LLMs for detecting subtle, brief, and possibly unconscious interactions between team members, called ``micro-behaviors," and provides insights into the appropriate design of LLMs for this task. Our data came from 5 teams participating in a 45-day mission at the US National Aeronautics and Space Administration’s (NASA) Human Exploration Research Analog (HERA). More specifically we used data collected from team interaction battery (TIB) tasks teams performed five times in-mission which comprise an average 1.5 hours of conversation data per day. Micro-behaviors were coded according to an adapted version of Smith & Griffins (2022) theoretical framework in terms of Violation (i.e., presence of valenced behavior, uplifting/positive or discouraging/negative), Intensity (i.e., force of behavior in terms of how uplifting or discouraging is the behavior), and Intent (i.e., motive of the behavior in terms of whether it was deliberate or unintentional). We explore the ability of LLMs to detect the presence and intensity of micro-behaviors. We examine employing and fine-tuning readily available LLMs (i.e., RoBERTa, DistilBERT), as well as prompting state-of-the-art sequence classification models (i.e., Llama-2, Llama-3). In a total of 13,058 conversational turns (17.8% uplifting, 3.3% discouraging, 75.76% neutral, 3.14% nulls), we compute the macro F1-score of the 3-way micro-behavior classification task (i.e., classifying among uplifting, discouraging, and neutral; 33% chance). Results indicate that the RoBERTa model achieves a F1-score of 36.2% (uplift: 43.3% precision (P), 15.1% recall (R); discourage: 20% P, 0.5% R). These results significantly improve when we augment the data via paraphrasing in the RoBERTa model, reaching a 41.2% macro F1-score (uplift: 37.7% P, 86.3% R; discourage: 3.5% P, 1.8% R). Finally, the Llama-2 model with 3-shot prompting yields 38% macro F1-score (uplift: 28.7% P, 20% R; discourage: 7.2% P, 18% R), which is slightly better compared to the RoBERTa model without data augmentation, highlighting the effectiveness of sequence classification models in detecting minority classes with a small sample size. Findings indicate that LLMs hold potential to detect subtle behaviors in conversations, which could be valuable in assessing team behavior in space exploration missions. Future studies will evaluate the performance of different LLM prompting strategies or fine-tuning methods.

Ankush Raut↗

Communication Delays in Cislunar Space: A Lab Study Examining Human System Integration Architecture (HSIA) and Team Risk Concerns

BACKGROUND: Communication delays are an inherent challenge of space missions to the Moon and beyond. Past research studies showed that 50+ second delays adversely affected individual well-being, team cohesion, and overall task performance (Kintz et al., 2016; Larson et al., 2019). However, there is a dearth of research on the effects of shorter delays (on the order of 4-12 seconds one-way) that may present a more immediate challenge during the upcoming Artemis missions. Even these shorter delays could make it difficult or infeasible for ground control to provide real-time support to Artemis astronauts, especially in complex and time-critical tasks such as extra-vehicular activities (EVAs). Results from studies on longer or Mars-like delays cannot be directly applied to Artemis-like delays, due to the large differences in delay magnitude and task types between these mission categories. For example, real-time oversight and guidance from ground control is impossible under Mars-like delays but may be performed under Artemis-like delays, albeit with potentially high workload and communication difficulty. Thus, a better understanding of the effects of Artemis-like communication delays on collaborative task performance is needed. Additionally, there is a need to develop reliable task paradigms that can be used in future studies on communication delays. METHODS: This project will study the effects of Artemis-like communication delays on collaborative task performance in a simulated space-to-ground team task via a lunar Gateway-like interface prototype. Teams of two astronaut-like participants - one serving as “crewmember” and one as “flight controller” - will perform a spaceflight-relevant task under six delay conditions (i.e., 0, 4, 6, 8, 10, and 12 seconds). Audio, video, texting, and file transfer will be delayed between the participants to mimic lunar-like communication delays. Measures related to workload, situation awareness, system usability, task performance, team cohesion, well-being, and communication strategies will be collected. These measures will be compared across delay levels, participant roles, and off-nominal and nominal tasks. Participants will be given the choice to use any combination of video and text communication in order to study preferences in interaction modality. RESEARCH AIMS: One aim is to identify a delay level or range of levels at which there may be significant decrements in individual and team-based measures. Identifying such ranges may help design novel workload management or communication countermeasures for future space missions. Also, the spaceflight-relevant research tasks and corresponding communication delay technology developed as part of this effort may be used for future studies on communication delays. Results from this work are also expected to inform study scenarios in the Human Exploration Research Analog (HERA) Campaign.

S Upasani↗

Using a Crew Resource Management Framework to Develop Human-Autonomy Teaming Measures

Recent developments in technology have permitted an increased use of autonomy. To work best with humans, autonomy should have the qualities of a good team member. But how can these qualities be measured? One way is to use similar measures to those used to measure good teams with human members. For example, the Non-Technical Skills (NOTECHS) framework measures Crew Resource Management (CRM) skills that allow pilots to work together as a team. The framework consists of skill categories, elements of those categories, and behavioral markers that demonstrate good or poor performance in the elements. This paper introduces CMSD (CooperationManagementSituation AwarenessDecision Making), a measurement system based on NOTECHS and other widely-used skill level systems, which provides quantitative measures of Human-Autonomy Teaming (HAT).

Crew Resource Manaagement↗

Measuring the Effectiveness of Human Autonomy Teaming

Human-Automation Teaming (HAT), is now recognized as a promising solution to the problems of humans managing increasingly complex work systems. A human-automation team can be defined as the interdependent coupling between one or more human operators and one or more autonomous systems requiring collaboration and coordination to accomplish system and task goals (e.g., Langan-Fox et al., 2009). In this conception, automated agents are considered team members that can operate at various levels of automation, be focused on one or more human-information-processing stages, and the interactions with human operators may be adaptable, adjustable or mixed initiative. We investigated some metrics for assessing HAT effectiveness in a demonstration of a HAT tool used by ground station operators in a Reduced Crew Operations project that was conducted at NASA Ames Human Automation Teaming Laboratory. In this paper, we focus on operator metrics of HAT effectiveness, specifically workload and operator behaviors.

measurements↗

Modeling and Quantification of Team Performance in Human Reliability Analysis for Probabilistic Risk Assessment

Probabilistic Risk Assessment (PRA) and Human Reliability Assessment (HRA) are important technical contributors to the United States (U.S.) Nuclear Regulatory Commission’s (NRC) risk-informed and performance based approach to regulating U.S. commercial nuclear activities. Furthermore, all currently operating commercial NPPs in the U.S. are required by federal regulation to be staffed with crews of operators. Yet, aspects of team performance are underspecified in most HRA methods that are widely used in the nuclear industry. There are a variety of "emergent" team cognition and teamwork errors (e.g., communication errors) that are 1) distinct from individual human errors, and 2) important to understand from a PRA perspective. The lack of robust models or quantification of team performance is an issue that affects the accuracy and validity of HRA methods and models, leading to significant uncertainty in estimating HEPs. This paper describes research that has the objective to model and quantify team dynamics and teamwork within NPP control room crews for risk informed applications, thereby improving the technical basis of HRA, which improves the risk-informed approach the NRC uses to regulate the U.S. commercial nuclear industry.

99 GENERAL AND MISCELLANEOUS↗

Using AI Simulations to Dynamically Model Multi-agent Multi-team Energy Systems

The complexity of energy systems is well known as they are complex and intricate systems. As a result, many extant studies have used many simplifications or generalizations that do not accurately reflect the nature of this complex system. In particular, most HVAC systems are modeled as a single unit, or several large units, rather than as a hierarchical composite (e.g., as a floor rather than as a collection of disparate rooms). The net result of this is that the simulations are too generic to perform meaningful analysis, machine learning, or integrated simulation. We propose using a multi-agent multi-team strategic simulations framework called SiMAMT to better define, model, simulate, and learn the HVAC environment. SiMAMT allows us to create distinct models for each type of room, hierarchically aggregate them into units (like floors, or sections), and then into larger sets (like buildings or a campus), and then perform a simulation that interacts with each sub-element individually, the teams of sub-elements collectively, and the entire set in aggregation. Further, and most importantly, we additionally model another ‘team’ within the simulation framework - the users of the systems. Again, each individual is modeled distinctly, aggregated into sub-sets, then collected into large sets. Each user, or agent, is performing on their own but with respect to the larger team goals. This provides a simulation that has a much higher model fidelity and more applicable results that match the real-world.

Franklin, D. Michael↗

Review Team Focused Modeling Analysis of Radial Collector Well Operation on the Hypersaline Groundwater Plume beneath the Turkey Point Site near Homestead, Florida

Researchers at Pacific Northwest National Laboratory served as members of a U.S. Nuclear Regulatory Commission review team for the Florida Power & Light Company’s application for two combined construction permits and operating licenses (combined licenses or COLs) for two proposed new reactor units—Turkey Point Units 6 and 7. The review team evaluated the environmental impacts of the proposed action based on the October 29, 2014 revision of the COL application, including the Environmental Report, responses to requests for additional information, and supplemental information. As part of this effort, team members tasked with assessing the environmental effects of proposed construction and operation of Units 6 and 7 at the Turkey Point site reviewed two separate modeling studies that analyzed the interaction between surface water and groundwater that would be altered by the operation of radial collector wells (RCWs) at the site. To further confirm their understanding of the groundwater hydrodynamics and to consider whether certain actions, proposed after the two earlier modeling studies were completed, would alter the earlier conclusions documented by the review team in their draft environmental impact statement (EIS; NRC 2015), a third modeling analysis was performed. The third modeling analysis is discussed in this report.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Final Review Memo from ATDM L2 Milestone Review Panel to ATDM L2 Milestone Team and Associated Management

On Thursday, August 25, 2016, the ATDM L2 milestone review panel met with the milestone team to conduct a final assessment of the completeness and quality of the work performed. First and foremost, the panel would like to congratulate and commend the milestone team for a job well done. The team completed a significant body of high-quality work toward very ambitious goals. Additionally, their persistence in working through the technical challenges associated with evolving technology, the nontechnical challenges associated with integrating across multiple software development teams, and the many demands on their time speaks volumes about their commitment to delivering the best work possible to advance the ATDM program. The panel’s comments on the individual completion criteria appear in the last section of this memo.

97 MATHEMATICS AND COMPUTING↗

A status of the activities of the NASA/MSFC pump stage technology team

The Consortium for Computational Fluid Dynamics (CFD) Application in Propulsion Technology was established to aid the transfer of CFD related advancements among academia, government agencies, and industry. The specific goals of the Consortium are to develop CFD methodologies necessary to solve propulsion problems, to validate these methodologies, and to apply these methodologies in the design process. To accomplish these goals, a team of experts in various related fields was formed, a schedule of activities necessary to meet the goals was generated, and funding for the activities was obtained from NASA. During the past year (Mar. 1991 - Mar. 1992) the team's activities have focused on preliminary code validation and on the design of an advanced impeller. Six codes were used to calculate the flow in a Rocketdyne 0.3 flow coefficient inducer, and the results were compared to L2F data available for the inducer. This activity identified shortcomings in the experimental data sets and in the analytical solutions which must be surmounted in any future team activity. The design of the advanced impeller relied heavily on CFD results to obtain an optimized geometry. The optimized geometry was analyzed using four different codes, at design and off-design conditions. Activities for the next year include the optimization of a tandem blade impeller design, benchmark of CFD codes for diffuser and volute flows, the collection of L2F data for 'state-of-the-art' impeller and inducer, and the verification of the advanced pump team impeller design in a water rig.

Garcia, R.↗

Magellan spacecraft team remote mission operations - Experience and application to future operations systems

The Magellan Venus radar mapping mission was NASA's first planetary launch in 11 years, heralding a successful return to unmanned planetary exploration. This paper first describes the spacecraft, its mission, and its Mission Operations System, including the remotely located spacecraft team. It then discusses how the flight team achieved mission success, in spite of the obstacles imposed by challenges from the spacecraft and its environment, which had to be resolved with the spacecraft team nearly 1000 miles distant from the rest of the flight team. Benefits of remotely distributed spacecraft operations are summarized and suggestions offered, based on Magellan experience, for future mission operations systems considering the use of distributed elements.

Ledbetter, Kenneth W.↗

Activities of the NASA/Marshall Space Flight Center pump stage technology team

In order to advance rocket propulsion technology, the Consortium for Computational Fluid Dynamics (CFD) Application in Propulsion Technology has been formed at Marshall Space Flight Center (MSFC). The Consortium consists of three Teams: the turbine stage team, the pump stage team (PST), and the combustion devices team. The PST has formulated and is implementing a plan for pump technology development whose end product will be validated CFD codes suitable for application to pump components, test data suitable for validating CFD codes, and advanced pump components optimized using CFD codes. The PST's work during the fall of 1991 and the winter and spring of 1992 is discussed in this paper. This work is highlighted by CFD analyses of an advanced impeller design and collection of laser two-focus velocimeter data for the Space Shuttle Main Engine High Pressure Fuel Pump impeller.

Garcia, R.↗

Combustion devices technology team - An overview and status of STME-related activities

The Consortium for CFD applications in propulsion technology has been formed at NASA/Marshall Space Flight Center. The combustion devices technology team is one of the three teams that constitute the Consortium. While generally aiming to advance combustion devices technology for rocket propulsion, the team's efforts for the last 1 and 1/2 years have been focused on issues relating to the Space Transportation Main Engine (STME) nozzle. The nozzle design uses hydrogen-rich turbine exhaust to cool the wall in a film/dump scheme. This method of cooling presents challenges and associated risks for the nozzle designers and the engine/vehicle integrators. Within the nozzle itself, a key concern is the ability to effectively and efficiently film cool the wall. From the National Launch System vehicle base standpoint, there are concerns with dumping combustible gases at the nozzle exit and their potential adverse effects on the base thermal environment. The Combustion Team has developed and is implementing plans to use validated CFD tools to aid in risk mitigation for both areas.

Tucker, P. K.↗

Kennedy Space Center's NASA/Contractor Team-Centered Total Quality Management Seminar: Results, methods, and lessons learned

It is apparent to everyone associated with the Nation's aeronautics and space programs that the challenge of continuous improvement can be reasonably addressed only if NASA and its contractors act together in a fully integrated and cooperative manner that transcends the traditional boundaries of proprietary interest. It is, however, one thing to assent to the need for such integration and cooperation; it is quite another thing to undertake the hard tasks of turning such a need into action. Whatever else total quality management is, it is fundamentally a team-centered and team-driven process of continuous improvement. The introduction of total quality management at KSC, therefore, has given the Center a special opportunity to translate the need for closer integration and cooperation among all its organizations into specific initiatives. One such initiative that NASA and its contractors have undertaken at KSC is a NASA/Contractor team-centered Total Quality Management Seminar. It is this seminar which is the subject of this paper. The specific purposes of this paper are to describe the following: Background, development, and evolution of Kennedy Space Center's Total Quality Management Seminar; Special characteristics of the seminar; Content of the seminar; Meaning and utility of a team-centered design for TQM training; Results of the seminar; Use that one KSC contractor, EG&G Florida, Inc. has made of the seminar in its Total Quality Management initiative; and Lessons learned.

Kinlaw, Dennis C.↗

A Modified NASA Team Sea Ice Algorithm for the Antarctic

A recent comparative study of the NASA Team and Bootstrap passive microwave sea ice algorithms revealed significantly different sea ice concentration retrievals in some parts of the Antarctic. The study identified potential reasons for the discrepancies including the influence of sea ice temperature variability on the Bootstrap retrievals and the influence of ice surface reflectivity on the horizontally polarized emissivity in the NASA Team retrievals. In this study, we present a modified version of the NASA Team algorithm which reduces the error associated with the use of horizontally polarized radiance data, while retaining the relative insensitivity to ice temperature variations provided by radiance ratios. By retaining the 19 GHz polarization as an independent variable, we also maintain a relatively large dynamic range in sea ice concentration. The modified algorithm utilizes the 19 GHz polarization (PR19) and both gradient ratios, GRV and GRH defined by (37V-19V)/(37V+19V) and (37H-19H)/(37H+19H), respectively, rather than just GRV used in the current NASA Team algorithm. A plot of GRV versus GRH shows that the preponderance of points lie along a quadratic curve, whereas those points affected by surface reflectivity anomalies deviate from this curve. This serves as a method of identifying the problems points. The 19H brightness temperature of these problem points is increased so they too fall along quadratic curve. Sea ice concentrations derived from AVHRR imagery illustrate the extent to which this method reduces the error associated with surface layering.

Cavalieri, Donald J.↗

Team Formation and Communication Restrictions in Collectives

A collective of agents often needs to maximize a "world utility" function which rates the performance of an entire system, while subject to communication restrictions among the agents. Such communication restrictions make it difficult for agents which try to pursue their own "private" utilities to take actions that also help optimize the world utility. Team formation presents a solution to this problem, where by joining other agents, an agent can significantly increase its knowledge about the environment and improve its chances of both optimizing its own utility and that its doing so will contribute to the world utility. In this article we show how utilities that have been previously shown to be effective in collectives can be modified to be more effective in domains with moderate communication restrictions resulting in performance improvements of up to 75%. Additionally we show that even severe communication constraints can be overcome by forming teams where each agent of a team shares the same utility, increasing performance an additional 25%. We show that utilities and team sizes can be manipulated to form the best compromise between how "aligned" an agent s utility is with the world utility and how easily an agent can learn that utility.

Agogino, Adrian K.↗

Effective Team Support: From Modeling to Software Agents

The purpose of this research contract was to perform multidisciplinary research between CMU psychologists, computer scientists and engineers and NASA researchers to design a next generation collaborative system to support a team of human experts and intelligent agents. To achieve robust performance enhancement of such a system, we had proposed to perform task and cognitive modeling to thoroughly understand the impact technology makes on the organization and on key individual personnel. Guided by cognitively-inspired requirements, we would then develop software agents that support the human team in decision making, information filtering, information distribution and integration to enhance team situational awareness. During the period covered by this final report, we made substantial progress in modeling infrastructure and task infrastructure. Work is continuing under a different contract to complete empirical data collection, cognitive modeling, and the building of software agents to support the teams task.

Remington, Roger W.↗

Advances in space technology: the NSBRI Technology Development Team

As evidenced from Mir and other long-duration space missions, the space environment can cause significant alterations in the human physiology that could prove dangerous for astronauts. The NASA programme to develop countermeasures for these deleterious human health effects is being carried out by the National Space Biomedical Research Institute (NSBRI). The NSBRI has 12 research teams, ten of which are primarily physiology based, one addresses on-board medical care, and the twelfth focuses on technology development in support of the other research teams. This Technology Development (TD) Team initially supported four instrumentation developments: (1) an advanced, multiple projection, dual energy X ray absorptiometry (AMPDXA) scanning system: (2) a portable neutron spectrometer; (3) a miniature time-of-flight mass spectrometer: and (4) a cardiovascular identification system. Technical highlights of the original projects are presented along with an introduction to the five new TD Team projects being funded by the NSBRI.

Non-NASA Center↗