Engineering Papers⌕ Search

Engineering topics

Misty Davies

Publications and source records attributed to Misty Davies.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

A Model-Based Systems Engineering Evaluation of the Evolution to an In-Time Aviation Safety Management System

In 2018, as result of a recommendation from the National Academies, NASA began to prototype an In-Time Aviation Safety Management System(IASMS). The purpose of the IASMS is to enable innovative aviation operations and greater heterogeneity of the overall National Airspace (NAS) by automating much of the safety monitoring, assessment, and risk and hazard mitigation functionspresent in today’s Safety Management Systems (SMS). NASA has worked together with early industry collaborators to understand how such a system might work and has published several early Concepts of Operation (ConOps) and other technical memoranda that illustrate the primary considerations for selected aviation domains. The shift from an SMS to an IASMS is predicated on several assumptions, including: 1.) automating safety functions will decrease the amount of time necessary for risk and hazard identification and analysis, making it more likely that safety concerns are understood ‘in-time’ to mitigate them, and 2.) an IASMS will allow easier tailoring of safety management processes to the particular risks and hazards inherent to that aviation operation. In this paper, we begin to validate these assumptions through the use of Model-Based Systems Engineering (MBSE).

In-time Aviation Safety Management System↗
NASA NTRSDate not supplied

Visualizing Corridors in Terminal Airspace Using Trajectory Clustering

Context: Advances in battery and automation technology have made routine air taxi and cargo transport in urban areas a business model that can be attained by emerging aviation innovators. The community vision and work to enable these novel operations is discussed using the term ‘Urban Air Mobility’ or UAM. Small, piloted, airspace vehicles that fly with a few passengers do operate in urban areas today, and these vehicles can be studied as an early proxy for this future UAM traffic. Aim: We seek to identify corridors already in daily operation and their properties. Method: We applied DBSCAN and HDBSCAN to Dallas Forth-Worth TRACON flight data to identify corridors in use, their density, and devised a method to annotate landing sites used in these corridors with site metadata. Results: While DBSCAN was unable to group similar trajectories, we we were able to successfully identify corridors using HDBSCAN, measure their density and annotate them. Conclusion: The applied method can successfully identify corridors in daily operation with additional metadata to help domain expert understand the intent of UAM corridors.

UAM Trajectory, TRACON, Clustering, DBSCAN, HDBSCA↗
NASA NTRSDate not supplied

Assessing the Use of UAS-Related Terms in ASRS using Seeds for Topic Modeling

Context: The NASA Aviation Safety Reporting System (ASRS) is a voluntary confidential system that disseminates reports received from personnel involved in aviation operations after de-identifying them. These reports are used by the community to improve overall aviation system safety. Aim: We propose and execute an experiment to assess the use of seed term topic modeling over the database narratives to identify Unmanned Aircraft System (UAS) reports. The use of seed term topic modeling enables users to identify groups of conceptually similar narratives associated to a topic of their interest. Method: We use a collection of narratives, expert-selected words, and report metadata that separates UAS from non-UAS reports to assess if seed topic modeling can be used to improve ASRS searches. Results: For simpler queries, seed topic search observes a higher recall and lower precision than the existing DBOL (DataBase OnLine) search in operation. However, the best results are obtained when seed topic search is used as a search suggestion system to be executed on the DBOL. Conclusion: Utilizing a combination of both the existing method and the proposed method, users can expand their search vocabulary about subjects of interest while improving the quality of results.

LDA↗
NASA NTRSDate not supplied

BERT-based Topic Modeling and Information Retrieval to Support Fishbone Diagramming for Safe Integration of Unmanned Aircraft Systems in Wildfire Response

Recent concepts for emerging wildfire response operations have included unmanned aircraft systems (UAS) due to their increasing accessibility and capabilities. To integrate UAS into wildfire response safely, researchers have studied the use of large repositories of historic incident reports to improve the scope of root cause analysis. Recent work has emphasized applying state-of-the-art natural language processing techniques to extract useful information from these repositories. However, it has not yet been studied how these results can be interpreted and integrated into the systems engineering process. In this work, we propose a process in which Bidirectional Encoder Representations from Transformers (BERT)-based topic modeling and information retrieval are applied to a relevant set of documents in order to support the development of a fishbone diagram in a semiautomated process. High-level themes in the document set are identified using topic modeling, which are then refined and interpreted by a human analyst. Then, the themes are used to guide a finer search using information retrieval, which returns specific incident reports of relevance. This provides traceability to specific incidents as well as broader categorizations that comprise the fishbone branches. We apply the proposed process to relevant documents from NASA’s Aviation Safety Reporting System (ASRS). The proposed process is widely applicable when relevant documents are available, and the results from this study will be useful to identifying potential causes of wildfire response UAS incidents.

hazard analysis↗
NASA NTRSDate not supplied

From BERTopic to SysML: Informing Model-Based Failure Analysis With Natural Language Processing for Complex Aerospace Systems

The development of emerging complex aerospace systems will require new approaches for capturing safety incident scenarios as early as possible in the design phase. However, for novel systems, relevant data available is limited. In this work, we propose a framework informing model-based mission assurance activities with historical incident reports, lessons learned, or other relevant engineering documents using natural language processing. In doing so, we investigate whether there is useful information in data sets that are relevant, if not identical, to the system under design and whether, through rigorous systems engineering practice, this information can be effectively leveraged through model-based failure analysis. In a worked case study, we apply state-of-the-art topic modeling techniques to two data sets, a mission relevant data set and a system relevant data set. The sets of topics are merged and interpreted to form a preliminary list of failure topics that can be used to inform the identification of off-nominal modes in the model-based failure modes and effects analysis development. Once data from the system in operation is available, it can be used to update the topics identified. By extracting information about likely failures from relevant historical data sets and utilizing model-based mission assurance to ensure relevance and rigor, unanticipated failures can be reduced, and projects can more effectively learn from past missions.

Failure Analysis↗
NASA NTRSDate not supplied

BERT-based Topic Modeling and Information Retrieval to Support Fishbone Diagramming for Safe Integration of Unmanned Aircraft Systems in Wildfire Response

Recent concepts for emerging wildfire response operations have included unmanned aircraft systems (UAS) due to their increasing accessibility and capabilities. To integrate UAS into wildfire response safely, researchers have studied the use of large repositories of historic incident reports to improve the scope of root cause analysis. Recent work has emphasized applying state-of-the-art natural language processing techniques to extract useful information from these repositories. However, it has not yet been studied how these results can be interpreted and integrated into the systems engineering process. In this work, we propose a process in which Bidirectional Encoder Representations from Transformers (BERT)-based topic modeling and information retrieval are applied to a relevant set of documents in order to support the development of a fishbone diagram in a semiautomated process. High-level themes in the document set are identified using topic modeling, which are then refined and interpreted by a human analyst. Then, the themes are used to guide a finer search using information retrieval, which returns specific incident reports of relevance. This provides traceability to specific incidents as well as broader categorizations that comprise the fishbone branches. We apply the proposed process to relevant documents from NASA’s Aviation Safety Reporting System (ASRS). The proposed process is widely applicable when relevant documents are available, and the results from this study will be useful to identifying potential causes of wildfire response UAS incidents.

hazard analysis↗
NASA NTRSDate not supplied

Textual and Network Analysis of Part 107 Waivers

Context: The management of hazards in sUAS operations is not as well defined as today's commercial operations despite sUAS widespread use. Part 107 waived operations' provisions, which manage hazards for higher risk operations that require approval, can offer insight to organizations establishing UAS Programs in managing their own operation hazards. Aim: We seek to understand how the FAA Part 107 waived operations manage hazards. Method: We used the constant comparative method to identify hazard mitigation textual categories from provisions and use networks to assess the dispersion of provisions and the identified categories across issued waivers. Results: Eight mitigation categories and twenty-four sub-categories were identified. Most provisions present in waivers are mostly reused in one waiver. Conclusion: While there is a broad range of provisions to control for hazard mitigations in the Part 107 issued waivers analyzed regulations, they require case-by-case modifications.

Urban Air Mobility↗
NASA NTRSDate not supplied

Textual and Network Analysis of Title 14 CFR Part107 Waivers

Context: The management of hazards in small unmanned aircraft systems (sUAS) operations is not as well defined as today's commercial operations despite sUAS widespread use. FAA Title 14 Code of Federal Regulations (CFR) Part 107 waived operations' provisions, which manage hazards for higher risk operations that require approval, can offer insight to organizations establishing UAS Programs in managing their own operation hazards. Aim: We seek to understand how the Title 14 CFR Part 107 waived operations manage hazards. Method: We used the constant comparative method to identify hazard mitigation textual categories from provisions and use networks to assess the dispersion of provisions and the identified categories across issued waivers. Results: Eight mitigation categories and twenty-four sub-categories were identified. Most provisions present in waivers are mostly reused in one waiver. Conclusion: While there is a broad range of provisions to control for hazard mitigations in the Title 14 CFR Part 107 issued waivers analyzed regulations, they require case-by-case modifications.

Urban Air Mobility↗
NASA NTRSDate not supplied

Evaluating Faulty State Occurrence in Wildfire UAS Missions Using Markov Chains

As autonomous technology advances, unmanned aircraft systems are increasingly integrated into emergency response missions, such as wildfire response. These systems must be be safe with less risk than non-autonomous counter parts, yet quantifying the risk associated with present-day and future systems conventionally relies solely on expert opinion and little data. Instead, combining narrative mishap reports with probabilistic analysis can provide a method for evolutionary and timely risk analysis. In this paper, we present a framework for a data-driven probabilistic risk assessment style analysis, where hazard events and rates originate from documented UAS mishaps. The framework is applied to a UAS mapping mission in wildfire response, including a fault tree analysis, event tree analysis, and probabilistic analysis using Markov Chains. The analysis provides an enumeration of hazards in the system, hazard events that can lead to faults, the probability of a mission experiencing any fault, the probability of experiencing a specific fault, and the expected time spent until faulty states occur in present-day operations.

risk analysis↗
NASA NTRSDate not supplied

Informing NLP Learning Tasks by Tracking User Features: An ASRS Use Case using Kaona

There has been growing interest in utilizing natural language processing (NLP) algorithms in Aviation Safety. This interest has extended to leveraging the decades of records publicly available on the Aviation Safety Reporting System (ASRS). While related literature has given more emphasis in lessons learned from the narratives, our prior work has focused on using NLP to support narrative search in the ASRS. Specifically, we evaluated if the use of alternative search mechanisms to keyword search, such as the retrieval of related narratives even without matching keywords could improve narrative discovery. A difficulty in experimenting alternative search mechanisms in any information retrieval task is the lack of ground truth. To address this limitation, we propose Kaona, a lightweight interface which enables the prototyping of alternative search retrieval tasks, by tracking user experience both explicitly (user-specified feedback), or implicitly (user navigation through interface affordances). Differently from distracting requests for feedback during user navigation, Kaona collects explicit feedback from users by mapping them to affordances which support the user workflow, while obtaining ground truth information for learning tasks.

human-computer-interaction↗
NASA NTRSDate not supplied

Kaona: Deep Searching and Curating Aviation Safety Reporting Systems

Context: Several works in the literature have examined how safety narrative databases can be leveraged to share lessons learned. However, less attention has been given in augmenting existing processes of safety reporting systems. Aim: In this work, we introduce Kaona: An interface that weaves machine learning in existing aviation safety reporting systems activities. Method: We provide a use case of search, curation and newsletter writing to showcase how Kaona features build on existing processes and on its own to enhance information retrieval, curation and synthesis of narratives. Results: We created two instances of Kaona internally for evaluation, one using all public NASA's ASRS narratives and another using all public C3RS narratives. Data ranged from 1998 to 2024. Conclusion: Our tool provides a new way to explore safety narratives, serving to re-imagine how text databases can benefit of novel information retrieval mechanisms in the era of large language models.

asrs↗
NASA NTRSDate not supplied

Kaona: Deep Searching and Curating Safety Reporting Systems

Context: Several works in the literature have examined how safety narrative databases can be leveraged to share lessons learned. However, less attention has been given in augmenting existing processes of safety reporting systems. Aim: In this work, we introduce Kaona: An interface that weaves machine learning in existing aviation safety reporting systems activities. Method: We provide a use case of search, curation and newsletter writing to showcase how Kaona features build on existing processes and on its own to enhance information retrieval, curation and synthesis of narratives. Results: We created two instances of Kaona internally for evaluation, one using all public NASA's ASRS narratives and another using all public C3RS narratives. Data ranged from 1998 to 2024. Conclusion: Our tool provides a new way to explore safety narratives, serving to re-imagine how text databases can benefit of novel information retrieval mechanisms in the era of large language models.

asrs↗
NASA NTRSDate not supplied

Determining Optimal Asset Location for Rapid and Efficient Wildfire Suppression: A Simulation-Based Approach

The impact of wildfire incidents has been growing in recent years, posing a serious threat to communities at the urban-wildland interface. To address this problem, there have been growing calls to use UAVs to increase the capacity of responsible agencies to quickly and effectively suppress fires and to reduce risks associated with firefighting. One of the opportunities associated with UAVs is the ability to rapidly and autonomously operate from limited-access air bases where fires are expected to burn. This study provides an approach to determine where these air bases should be placed in order to most rapidly extinguish fires, given provided fuel distributions. This approach uses an integrated simulation of fire propagation and UAV-based suppression actions to determine how much of a given environment was burned over a range of scenarios. It then uses an optimization method to explore the space and determine the location with the least burned area. Results show the approach to efficiently and effectively provide optimal bases for single-base placements over a range of scenarios, though future work is required to adequately calibrate the model and study how it can be used in multiple-base placement problems.

Daniel Hulse↗