Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

pyQuARC: Open Source Library for Earth Observation Metadata Quality Assessment

Metadata quality is essential to effective data discovery and has become increasingly vital as more Earth Science data sets become available. The Common Metadata Repository (CMR) hosts metadata describing NASA’s Earth Observation data products, which are archived across 12 Distributed Active Archive Centers (DAACs). The Analysis and Review of CMR (ARC) Team, located at Marshall Space Flight Center, conducts metadata quality assessments to ensure that these data products are discoverable, accessible, and usable. To achieve these goals, the ARC team has developed a metadata quality assessment framework to evaluate metadata completeness, correctness, and consistency. ARC uses a combination of manual and automated methods to assess these three components and identify areas of improvement; the team then collaborates with the DAACs to resolve any findings. To streamline this process, ARC is currently developing a host of scripts, known as pyQuARC, to automate metadata quality assessments as much as possible. pyQuARC is an open source library for Earth Observation Metadata Quality Assessment, and the tool utilizes ARC’s metadata quality assessment framework to make basic validation checks, pinpoint inconsistencies between dataset-level (i.e. collection) and file-level (i.e. granule) metadata, and identify opportunities for more descriptive and robust information. Since pyQuARC is also customizable, other users can make modifications as needed, and future metadata standards can also be implemented. Once pyQuARC is fully developed, it will support multiple schema types to serve the broader EOSDIS metadata community. This presentation will provide an overview of pyQuARC and its process of development while showcasing the tool’s valuable features and uses.

Jenny Wood↗
NASA NTRSDate not supplied

Can Resilience Assessments Inform Early Design Human Factors Decision-making?

There is a growing call among researchers for tighter coupling between human factors and human reliability assessments. In this research, we explore if early design stage resilience assessments can help bridge some of the gaps between human factors and human reliability assessments. Resilience in systems is their ability to recover reasonably and operate within acceptable bounds during failures and unexpected events. The fmdtools toolkit allows designers to assess the resilience of a system by modeling the human error and machine-related failure propagation in both nominal and faulty scenarios during the early design stages. As a result, the fmdtools toolkit has a low-fidelity dynamic human reliability assessment component built into it. In this paper, we study if the results from the fmdtools simulations can help inform and prioritize human factors design decision-making, resulting in tighter coupling between human factors and human reliability assessments during the design process. Specifically, we explore the results from a rover design example to understand the types of information that can help guide human factor-related decision-making.

Resilience-based Design↗
NASA NTRSDate not supplied

Connecting Federal Agencies to Satellite Earth Observations: NASA’s Satellite Needs Working Group Assessment Process

The Satellite Needs Working Group (SNWG), part of the U.S. Group on Earth Observations (USGEO), surveys agencies across the U.S. Government to identify the satellite Earth observations each agency needs to fulfill its high-priority objectives and responsibilities. Around 20 civilian agencies participate in the SNWG survey every two years. After receiving the surveys, the National Aeronautics and Space Administration (NASA) conducts an in-depth evaluation of each agency's needs in collaboration with fellow satellite Earth data providers, the National Oceanic and Atmospheric Administration (NOAA) and the U.S. Geological Survey (USGS). This assessment process, which takes place over an eight-month period, is divided into distinct phases. NASA first assembles an assessment team with the necessary subject matter expertise to evaluate each submitted need. An in-depth interview with each submitting agency then follows, featuring discussion of current and upcoming satellite missions as well as potential new activities that NASA, NOAA, and/or USGS could undertake to meet the agency's needs. The assessment teams then further evaluate these potential activities or solutions to identify how many agencies would benefit and estimate how much their level of satisfaction would increase. Solutions expected to have broad-reaching and significant agency benefits are proposed by NASA for funding. SNWG agencies receive an assessment report for each submitted need, in which the tri-agency assessment teams provide a detailed evaluation of the agency need, information on relevant satellite missions, and links to specific datasets or training resources. The SNWG Management Office at NASA’s Interagency Implementation and Advanced Concepts Team (IMPACT) contributes to NASA’s SNWG assessment in a variety of capacities, including statistical analysis of the survey responses to identify trends and similar needs across multiple agencies. The Management Office also provides analytics for the new proposed solutions, demonstrating and quantifying their potential value. For activities that receive funding, the Management Office manages the implementation process and works to maximize the benefit to SNWG agencies via a Stakeholder Engagement Program.

Katrina Virts↗
NASA NTRSDate not supplied

Independent Reliability Assessment of the Laser Transmitter for the ESA-NASA Laser Interferometer Space Antenna (LISA) Program

As part of the laser development process, NASA’s Goddard Space Flight Center (GSFC) requested support from the NASA Engineering and Safety Center (NESC) to independently assess the Technology Readiness Level (TRL) of the LISA Laser System (LS). The independent assessment included the following tasks: (a) assess the design for weaknesses and suggest improvements to mitigate risks, (b) assess the laser reliability plan for weaknesses and suggest improvements to mitigate risks and improve effectiveness, and (c) assess the current redundancy plan on laser subsystems for weaknesses and suggest improvements to mitigate risks and improve effectiveness. The presentation will focus on the assessment findings and the current development progress of the LISA laser to meet the mission requirements with a delivery of a form, fit, and functional TRL6 laser to the LISA mission by late 2023.

Laser Interferometry↗
NASA NTRSDate not supplied

Independent Technical Assessment of NASA and External Quantum Sensing Capability

The recent FY 2020 federal Research and Development Budget Priorities memo addresses the leadership need in Quantum Information Science (QIS) directing agencies to “prioritize QIS research and development (R&D), which will build the technical and scientific base necessary to explore the next generation of QIS theory, devices, and applications.” Quantum Sensing (QS) is an integral part of QIS. NASA is a key part of the directive to forward American space exploration and commercialization by providing “capabilities that have broad potential applications in space and on Earth.” QS provides an arena for NASA to demonstrate leadership in both areas of the administrative directive. QS uses quantum properties to achieve unprecedented measurement sensitivity and performance, including quantum-enhanced methodologies that outperform their classical counterparts. Typical quantum sensors exploit techniques such as atomic systems, matter waves, quantum entanglement, quantum superposition of states, quantum illumination methods, and manipulation of photons and atoms, in general. Guided by advancements in our ability to generate, manipulate, and control quantum systems, the emerging quantum sensing technologies promise unrivalled sensitivity, resolution, and precision, potentially leading to game-changing applications. Significant gains include technologies important for a range of NASA missions such as remote sensing, in situ measurements, metrology, interferometry, quantum communication, ranging, imaging, radar and lidar receivers, and gravity measurements. NASA Engineering and Safety Center has convened an independent external panel, comprising of Quantum Sensing Experts from Government, DoD, academia, and Federally funded Research and Development Center to conduct an independent technical assessment of the agency's capabilities in Quantum Sensing to understand NASA's internal needs and competencies related to Quantum Sensing and compare agency capabilities with those available externally including industry, academia, and other government agencies. The outcomes of the assessment will help the agency in establishing appropriate strategies and investments to develop and maintain the state-of-the-art sensing competence and capabilities required to meet the agency’s future needs. The External Experts Panel (EEP) is collaborating with HQ, various NASA Center and the representatives in the NASA Quantum Sensing Community of Practice (QS CoP), a part of NASA Sensors and Instrumentation Technical Fellow Technical Discipline Team, in obtaining common, current understanding of agency mission needs where QS can be an important enabler for future needs, and any programs, projects, assets, and technologists working in QS. The EEP organized a Quantum Sensing Workshop of practitioners from industry, academia, other government agencies, external experts, and interested NASA personnel to gather the assessment information. EEP also conducted information gathering on the industry at large, educational institutions, and other government agency research efforts for capture in the assessment database. At the conclusion of this assessment, EEP team will develop findings and conclusions describing NASA’s capabilities for the mission needs, NASA's relative position on new, enabling technologies, and an analysis of the gaps that may present any risks to near-term or far-term mission needs. This presentation will give details of the NASA and External Quantum Sensing Assessment outcomes, findings, observations, and its recommendation to NASA as how it can advance Quantum Sensing technologies and techniques for its science and explorations related missions.

External Quantum Sensing Capability↗
NASA NTRSDate not supplied

Assessment of High Resolution Commercial Satellite Geolocation Accuracy

Commercial companies such as Maxar, PlanetScope, and BlackSky have launched many satellites with revisit times ranging from two hours to one day and have built large archives of high resolution (1-3 m) Earth observing data. The high temporal resolution and global coverage of these satellites makes commercial satellite images ideal for scientists studying rapidly changing processes such as flooding and fires. A key step in assessing changes in these images is co-registration of various images to each other. High geolocation accuracy (at most 0.5 pixels of offset) allows for easy co-registration of images across different times and sensors. Here, we assess the latest PlanetScope imagery and evaluate it for geolocation accuracy. For our assessment, we compare the target image to a reference image with known geolocation accuracy (WorldView imagery) and determine the offset between these images by shifting them to maximize their Pearson Cross-Correlation (PCC) value. Offsets required to maximize the PCC give the geolocation accuracy of the target image relative to the reference image. Previously, our global assessment of Planet data revealed large variability in geolocation accuracy from one continent to another. The measured root mean squared errors (RMSEs) range from 5.4 m in North America to 14.9 m in Africa. We have updated this previous assessment to include both their newest SuperDove series as well as a more robust assessment of the temporal stability of PlanetScope's geolocation accuracy.

Alana G. Semple↗
NASA NTRSDate not supplied

Volumetric Assessment of UPRITE Exercises From Marker-Based Motion Capture

BACKGROUND Lack of volumetric data on full-body movement of exercises presents a challenge to ensuring the fit of crew member’s full range of motion on the International Space Station (ISS). The Upright Proprioception Retention via In-flight Training and Evaluation (UPRITE) is a sensorimotor countermeasure device designed for maintaining crew members’ proprioception in a microgravity environment. A footplate—attached to a static base—rotates in two degrees of freedom (pitch and roll) up to a 20 deg angle. An initial volumetric assessment assuming an upright standing posture produced a cone-like shape with a narrow bottom and wide top. Such general volumetric assessments risk creating an overly conservative volume estimate, taking up more space than is necessary on the already limited interior space of the ISS, and neglecting necessary volume due to oversimplifying assumptions. Rather, higher-fidelity volumetric assessments offer more comprehensive insights in an environment where every area counts. The main objective of this work is to provide the spatial parameters of exercises on the UPRITE such that it is placed on the ISS according to its volumetric demands or that usage is adjusted to fit the available space. METHODS In 2023, a data collection was performed originally to inform loads and dynamics of system use and was recently leveraged for volumetric assessment. Three human subjects representing different body types (~63-76 inches in stature) performed a variety of board manipulations using UPRITE with body weight offload. The test collected the 3D positional data of a modified full-body Plug-in Gait marker set [1] via a 16-camera OptiTrack MoCap system. After processing – filling marker gaps and trimming data – in OptiTrack Motive, the recorded marker location data, which included device markers, was exported to a readable trajectory file. To accurately represent the full volume defining landmarks, additional markers were digitally added to an unscaled Modified Full Body Model [2]. The model was then scaled according to its subject parameters upon which an inverse kinematics analysis was performed. A custom plugin yielded model marker location data files. Volumetric analyses were performed on the recorded trajectory and model trajectory files using a custom Python-built tool that extracted the marker location data and plotted it in a 3D space. Concerned with only the maximum volume of the motion, a 3D convex hull analysis was applied to the plot, extracting the vertices or external points of the eventual 3D CAD output, dubbed aptly as a “volume shell”. This overall approach was based on guidance in a NASA-STD-3001 Technical Brief [3]. RESULTS AND DISCUSSION Batch volumetric assessment on the exercises for each subject was performed, producing high-fidelity volume shells in minimal time. Preliminary results highlighted the value in higher-fidelity volumes based on collected data when possible. For example, revolving a single posture in the cone assessment would not have sufficiently captured a single leg stance; rather, it would need to involve swinging the leg both forward and back. Additional observations and the maximal dimensions of the volumes, including those based on scaled data for ISS anthropometric requirements, will be presented at the Human Research Program Investigator’s Workshop. CONCLUSIONS While this work’s primary objective was for the UPRITE-to-ISS integration, the tool built to conduct this analysis has wide applications for future exercise systems as an informational tool for optimal device placement. The tool and its findings also have implications for exercise device design and spacecraft interior considerations on Gateway, the Lunar Pressurized Rover, and beyond. REFERENCES [1] Bell, C. A., et al. (2023) Recent Improvements and Verification of a Full Body Model in OpenSim. NASA Human Research Program Investigator’s Workshop. https://ntrs.nasa.gov/citations/20230001080 [2] Lostroscio, K., et al (2023) The Digital Astronaut Simulation. AHFE International Conference on Human Factors in Design, Engineering, and Computing for All. [3] Exercise Overview. (2023) NASA-STD-3001 Technical Brief. https://www.nasa.gov/wp-content/uploads/2023/12/ochmo-tb-031-exercise-overview.pdf?emrc=9d454c?emrc=9d454c

L D Quinto↗
NASA NTRSDate not supplied

Mars Sample Return: Risk Management & Sample Safety Assessment

Returning samples from Mars has long been a major planetary science objective due to the high scientific value and transformative potential of the resulting data. An exciting dimension of this objective is the potential for the detection of ancient microbiological life, and the possibility of improving our understanding of the evolution of habitable environments on Mars and the development of life on Earth. To ensure that returned samples meet stringent planetary protection requirements and do not expose Earth to potential biohazards, the joint NASA/ESA Sample Receiving Project (SRP) assembled the Sample Safety Assessment Protocol Tiger Team (SSAP-TT). Members were recruited with the specific goal of creating a multi-disciplinary and internationally distributed team of experts in their respective fields across the federal government, academia, and private industry. This team was chartered with reassessing previous sample safety assessment strategies, defining what constitutes a biological hazard, developing a protocol to test for potential biohazards, and establishing a statistical framework to determine if samples are “safe” for release. The team developed a three-step protocol, supported by a Bayesian statistical framework, to assess whether returned samples contain potential biohazards that could present a risk to Earth’s biosphere. Initial conclusions indicated that an effective and comprehensive safety assessment protocol is feasible using modern techniques and does not require an excessive amount of sample consumption or traditional microbiological detection methodology. Herein, we will present an overview of the MSR SRP, the proposed safety assessment protocol, and how aspects of this novel approach can be applied to biological assessment in healthcare product manufacturing practices.

Alvin L Smith↗
DOE OSTI2026

A rapid embodied carbon assessment tool for priority materials

Embodied carbon limits within building materials are a driving factor in global trade, generating new research and analysis tools in industry. These product assessments, which require utilizing life-cycle assessment (LCA) across broad supply chains, can be expensive, time and data-intensive, and subject to significant variations. Existing methods and tools, such as specific environmental product declarations, typically do not capture these variations and dynamics in supply and manufacturing. Moreover, models and tools must enable stakeholders to assess customized supply chains and future scenarios. In this study, we present the Rapid Embodied Carbon Assessment and Target-setting for Emissions-intensive Materials (REDuCE) tool for building materials. We developed a tool that allows users to select production technologies, transportation mode and distances, concrete carbonation, fuel sources, and regional electricity mixes to supply customization for cement and concrete produced and consumed in California. We generated and integrated a material demand model using residential building stock projections. We provide the user with a wide range of mitigation alternatives through low-carbon production pathways, material use efficiency, transportation modes, and projected electricity grid mixes. In a case study application through four mitigation scenarios, we find emission savings up to 80% by maximizing user mitigation alternatives, primarily driven by reductions in material use intensities. This work represents a foundation for expanding LCA and embodied carbon tools to better enable stakeholders to rapidly and accurately assess customized supply chains while meeting trade requirements.

building materials↗
DOE OSTI2024

An Integrated Framework for Risk Assessment of Safety-related Digital Instrumentation and Control Systems in Nuclear Power Plants: Methodology Advancement and Application

This report documents activities performed by Idaho National Laboratory (INL) during fiscal year (FY) 2024 for the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program, Risk Informed Systems Analysis (RISA) Pathway, Digital Instrumentation and Control (DI&C) Risk Assessment project. The goal of the RISA Pathway is to optimize safety margins and minimize uncertainties to achieve economic efficiencies while maintaining high levels of safety. This is accomplished by providing scientific basis to better represent safety margins and factors that contribute to cost and safety, and by developing new technologies that reduce operating costs. The research efforts for FY 2024 encompass methodology refinement and exploration. The efforts include: (1) The implementation of a natural language processing tool to expedite key aspects of the reliability analysis methods developed by INL; (2) advances to support intersystem CCF analysis by providing guidance for and identification of coupling mechanisms that may contribute to CCF; (3) the investigation of how generative artificial intelligence tools can aid in hazard analysis and diversity and defense in depth (i.e., D3) assessments; (4) Industry collaboration, allowing the demonstration of and INL's risk assessment tools to support risk assessment of DI&C systems at early and late stages of development; (4) a roadmap for the development of a software for each of INL's risk assessment tools; (5) The development of a theory and methodology manual for a risk quantification methodology; (6) the development of a reliability analysis for machine learning (ML)-integrated control systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Large-scale Hydrogen Storage Risk Assessment

This project investigated risks involved in deploying a large-scale hydrogen storage system at the Port of Seattle (hereafter, the Port) for its on-terminal and maritime applications in an urban industrial setting. Alongside, the project attempted to address some of the barriers to risk assessment such as need for an exact system design for a systematic investigation, direct access to surrounding communities to gauge their perceptions, and an integrated software required to undertake a full-fledged risk assessment. These barriers were overcome using illustrative reference station designs, engaging with community-facing agencies through Port support, and pooling national laboratory capabilities available for risk assessments. The project identified relevant public safety risk metrics, compared various hydrogen carriers, engaged with community-facing agencies, and explored potential gaps in existing safety codes and standards. The primary impacts of this project include the development of risk assessment guidance for ports and utilities, informing them of the trade-offs in the choice of hydrogen carriers, and the ability to increase public capacity for dialog and engagement. This paves the way toward decarbonization of the Port activities, bringing about awareness around jobs in the market for risk assessments, and the need to ramp up community engagement long before any hydrogen system deployment is undertaken.

08 HYDROGEN↗
NASA NTRS2015

Technology Readiness Level Assessment Process as Applied to NASA Earth Science Missions

Technology assessments of fourteen science instruments were conducted within NASA using the NASA Technology Readiness Level (TRL) Metric. The instruments were part of three NASA Earth Science Decadal Survey missions in pre-formulation. The Earth Systematic Missions Program (ESMP) Systems Engineering Working Group (SEWG), composed of members of three NASA Centers, provided a newly modified electronic workbook to be completed, with instructions. Each instrument development team performed an internal assessment of its technology status, prepared an overview of its instrument, and completed the workbook with the results of its assessment. A team from the ESMP SEWG met with each instrument team and provided feedback. The instrument teams then reported through the Program Scientist for their respective missions to NASA's Earth Science Division (ESD) on technology readiness, taking the SEWG input into account. The instruments were found to have a range of TRL from 4 to 7. Lessons Learned are presented; however, due to the competition-sensitive nature of the assessments, the results for specific missions are not presented. The assessments were generally successful, and produced useful results for the agency. The SEWG team identified a number of potential improvements to the process. Particular focus was on ensuring traceability to guiding NASA documents, including the NASA Systems Engineering Handbook. The TRL Workbook has been substantially modified, and the revised workbook is described.

Systems Engineering↗
NASA NTRSDate not supplied

Developing a Dashboard Interface to Display Assessment of Hazards and Risks to sUAS Flights

The Supplemental Data Services Provider-Consolidated Dashboard (SDSP-CD) is a graphical user interface (GUI) that displays the results of predictive tools in a single location. It is intended to be used in the preflight planning phase of an operation to allow users to proactively assess predicted flight hazards off-line; expanding an operator’s overall situational awareness of a flight plan and providing an opportunity for decision making and assessing the associated risks prior to flight. Hazard data and risk predictions are informative but can be complex to read and understand. However, presented visually and in relation to flight parameters (such as flight path), the nature and significance of hazards become much more evident. The SDSP-Consolidation Dashboard interface was designed to offer a means to present the results of hazard services in an easy to-use format. Two usability studies were run to explore what features might make a suite of hazard assessment services easy to use, and to assess the SDSP-CD interface. The first study evaluated the presentation of information on the GUI and the second evaluated users’ ability to understand and use the information. The studies gathered valuable information about how users approach a hazard assessment task and interpret information from the interface. Many suggestions were given for improving the interface’s information display, to allow users to more quickly understand and interpret the information being presented.

UAV display↗
NASA NTRSDate not supplied

Developing a Dashboard Interface to Display Assessment of Hazards and Risks to sUAS Flights

The Supplemental Data Services Provider-Consolidated Dashboard (SDSP-CD) is a graphical user interface (GUI) that displays the results of predictive tools in a single location. It is intended to be used in the prefight planning phase of an operation to allow users to proactively assess predicted flight hazards off-line; expanding an operator’s overall situational awareness of a flight plan and providing an opportunity for decision making and assessing the associated risks prior to flight. Hazard data and risk predictions are informative but can be complex to read and understand. However, presented visually and in relation to flight parameters (such as flight path), the nature and significance of hazards become much more evident. The SDSP-Consolidation Dashboard interface was designed to offer a means to present the results of hazard services in an easy to-use format. Two usability studies were run to explore what features might make a suite of hazard assessment services easy to use, and to assess the SDSP-CD interface. The first study evaluated the presentation of information on the GUI and the second evaluated users’ ability to understand and use the information. The studies gathered valuable information about how users approach a hazard assessment task and interpret information from the interface. Many suggestions were given for improving the interface’s information display, to allow users to more quickly understand and interpret the information being presented

UAV display↗
NASA NTRSDate not supplied

Independent Technical Assessment of NASA and External Quantum Sensing Capability

- The Subject Matter Experts in the Sensors & Instrumentation Quantum Sensing Community of Practice (CoP) requested an independent technical assessment of the agency's capabilities in QS to understand NASA's internal needs and competencies related to QS and compare agency capabilities with those available externally including industry, academia, and other government agencies. - The outcomes of the assessment will help the agency in establishing appropriate strategies and investments to develop and maintain the state-of-the-art sensing competence and capabilities required to meet the agency’s future needs. - NASA Engineering and Safety Center Review Board approved the assessment request and assigned NASA Technical Fellow to lead and conduct the assessment by engaging NASA Centers, NASA HQ and an independent, non-commercial, and highly credible Quantum Sensing Experts from Academia, Department of Defense, other Government Agencies. The assessment duration is for one year, starting October 2021 and ending December 2022.

Independent Technical Assessment↗
NASA NTRSDate not supplied

Development of a Safety Hazards Risk Assessment Tool for Uncrewed Aircraft System Traffic Management during Preflight Planning

Tremendous growth in the uncrewed and remotely piloted vehicle market is expected in low-altitude, uncontrolled airspace, resulting in potential decreases in safety without systems that support monitoring, assessing, and mitigating risk. At NASA, the System-Wide Safety (SWS) project has been developing a suite of data-driven tools to predict hazards so that the potential risks that these hazards pose can be mitigated. Services to predict various hazards have been developed, including battery capacity, proximity to static obstacles, population risks, global positioning system signal strength, radio frequency spectrum interference risk, and vertiport congestion. These services can monitor hazards along a flight path and if any risks posed by these hazards exceed a threshold, the uncrewed aircraft system (UAS) fleet manager can be alerted to mitigate the risk by modifying the flight path, changing the scheduled departure or arrival times, and/or diverting the vehicle to an alternate vertiport. These services were originally developed to monitor and assess risks during flight, but they have been adapted to assess hazard risks prior to departure so that a fleet manager can evaluate the potential risks for a fleet of UAS along their planned flight paths. These services have been integrated into a prototype tool called the Supplemental Data Service Provider-Consolidated Dashboard (SDSP-CD), developed at NASA Ames Research Center. The tool consists of a dashboard which provides a comprehensive overview for a number of risks and a map display that shows the details of the hazards along each flight’s path. Based on the findings from three previous studies, the SDSP-CD has been updated with new design elements and functions. In this paper, we describe lessons learned from the previous studies, changes made to the interface, and the feedback received during a follow-up usability study. Overall, participants reported that there is a substantial benefit of having a fleet manager use a consolidated dashboard to assess hazards for the vehicles in their fleet and to provide situational awareness to potential risks so that they can be mitigated prior to flight. Once the SDSP-CD matures, it will need to be integrated into flight and mission planning tools. Some initial thoughts on how this integration should be accomplished are shared in this paper. Finally, the functional differences between preflight vs. in-flight risk assessment and the differences in fleet manager vs. UAS pilot roles that may require different information and user interactions are discussed.

preflight↗
NASA NTRSDate not supplied

Scenario-Based Task Design for Airline Pilot Anticipatory Behaviors: Asynchronous Assessment of Complex Cognitive Skills

Airline pilots must anticipate potential threats to passenger safety and efficient flight. Such anticipation needs to occur at both the system and individual levels, yet no formal training for these anticipatory behaviors currently exists. The emerging field of resilience engineering provides a framework to explore this problem. Given the complex nature of this problem, the assessment portion of the project constituted a challenge. Simulator time is expensive as simulators are costly to run, and they are extremely limited in number. Also, by the nature of their work, pilots as a group are hard to connect with in person; thus, asynchronous methods were adopted. Further, to ensure that authentic pilot behaviors were observed, task-based scenarios were used rather than focus group or interview protocols. This session explores the design of asynchronous learning and a measure for assessing pilot anticipatory behaviors outside of a simulator to help design learning opportunities for pilots. The scenario-based and active assessment items will be discussed in detail, and demonstrations of these items will be shared. These items constitute the bulk of the challenge for this work. At the time of this writing, data is being collected to assess the effectiveness of the interactive training module and validate the measures. This data will be analyzed and presented as part of the session. This will include any linkages between the scenario-based and traditional assessment items.

task design↗
DOE OSTI2025

Multi-agent AI collaboration for digital twin development and assessment

Developing a digital twin (DT) model involves different steps that encompass formulating requirements, model development, implementation, and assessment with respect to real applications. Human expertise is required to coordinate and implement different steps in the DT development and assessment process. However, certain parts of this process can be automated using artificial intelligence (AI) agents for efficient workflow development. In this work, we test and analyze a multiagent AI collaboration with humans in the loop to automate different elements of the DT development and assessment process. To implement the workflow for multiagent AI DT development and assessment, we use Autogen, a multiagent framework developed by Microsoft. Autogen offers a modular and flexible framework for configuring and designing task-specific multiagent workflows. In this framework, large language models (LLMs) form the core intelligence of the AI agents where the quality and performance of the automated element is governed by the inherent capabilities and knowledge base of the LLM. We use retrieval augmented generation to supplement the LLM with relevant domain-specific information for DT requirement formulation. We illustrate this multiagent workflow using a case study on a thermal energy storage system, focusing on how AI agents can collaborate with humans to expedite and optimize different elements of DT development and assessment process.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗