Results for “Analyst” — Page 99

NASA NTRSDate not supplied

Assessing the use of UAS-related terms in ASRS using Seed Topic Modeling

Context: The NASA Aviation Safety Reporting System (ASRS) is a voluntary confidential aviation safety reporting system. The ASRS receives reports from pilots, air traffic controllers, flight attendants and other involved in aviation operations. The reports are de-identified and coded by ASRS expert safety analysts. The de-identified reports are then disseminated to the aviation community in a number of ways including entry into an online database. Augmenting the discovery of topics of user interest in this online database would therefore be beneficial to the community it serves. Aim: We propose and execute an experiment to assess the use of seed term topic modeling using the database narratives to identify UAS reports. The use of seed term topic modeling would enable users to identify groups of related narratives associated to a topic of their interest. Method: We use a newly curated field in ASRS reports which identify UAS from non-UAS reports in combination of different set of UAS related terms to assess if seed topic modeling can be used in ASRS.

LDA↗

NASA NTRSDate not supplied

System Safety Analysis of Complex NASA Systems with Model-Based Engineering

The emergence of model-based engineering is transforming design and analysis methodologies [5]. A recognized benefit of model-based engineering is the existence of a “single source of truth” about the system that becomes the authoritative source of data and information for designers, analysts, and developers. This promotes consistency and efficiency as the design emerges and can be used to further optimize the design. Integrating System Safety Engineers to the “single source of truth” will ensure that the outputs of their assessments and analyses are relevant to the design as it evolves. Use of an integrated system model enables near immediate evaluation of a design change as well as development of operational processes for risk assessment and communication. Such models can enable efficient and timely analysis of system hazards (e.g., hazard fault tree analysis and procedure simulations) and produce complete, accurate, and more consistent products (e.g., hazard reports and safety requirement evaluations). Therefore, an agency-sponsored team at Goddard Space Flight Center (GSFC) recently completed a System Safety Study of modeling and testing capabilities as part of a Model-Based Safety and Mission Assurance Initiative (MBSMAI). Using an existing model developed for reliability analyses [1], GSFC modeling and system safety experts performed system safety analysis/modeling and produced safety products. The team evaluated model-based feasibility to support System Safety Engineering, developed safety analysis modeling processes, and identified tool capability advancement/development needs. These study results indicate model-based engineering is valid and useable for System

NASA↗

NASA NTRSDate not supplied

System Safety Analysis of Complex NASA Systems with Model Based Engineering

The emergence of model-based engineering is transforming design and analysis methodologies [5]. A recognized benefit of model-based engineering is the existence of a “single source of truth” about the system that becomes the authoritative source of data and information for designers, analysts, and developers. This promotes consistency and efficiency as the design emerges and can be used to further optimize the design. Integrating System Safety Engineers to the “single source of truth” will ensure that the outputs of their assessments and analyses are relevant to the design as it evolves. Use of an integrated system model enables near immediate evaluation of a design change as well as development of operational processes for risk assessment and communication. Such models can enable efficient and timely analysis of system hazards (e.g., hazard fault tree analysis and procedure simulations) and produce complete, accurate, and more consistent products (e.g., hazard reports and safety requirement evaluations). Therefore, an agency-sponsored team at Goddard Space Flight Center (GSFC) recently completed a System Safety Study of modeling and testing capabilities as part of a Model-Based Safety and Mission Assurance Initiative (MBSMAI). Using an existing model developed for reliability analyses [1], GSFC modeling and system safety experts performed system safety analysis/modeling and produced safety products. The team evaluated model-based feasibility to support System Safety Engineering, developed safety analysis modeling processes, and identified tool capability advancement/development needs. These study results indicate model-based engineering is valid and useable for System

Model Based Engineering↗

NASA NTRSDate not supplied

Detecting Satellite Laser Ranging Station Data and Operational Anomalies with Machine Learning Isolation Forests at NASA's CDDIS

The International Laser Ranging Service (ILRS) is currently composed of 45 active satellite laser ranging (SLR) stations with several more set to join the network over the next several years. Station changes and histories are logged to files, but not always in real time. Sometimes these details are not added until long after changes have been made to the station –on occasion, years later. This in addition to unexpected hardware errors and other system issues that are not immediately detected impact the products generated by analysts. The ILRS Central Bureau (CB) and NASA’s Crustal Dynamics Data Information System (CDDIS) have worked to provide tools for station engineers to use. This includes the creation of station plots which contain temperature and pressure information along with LAser GEOdynamic Satellite (LAGEOS) and LAser RElativity Satellite (LARES) tracking information that enable the monitoring of station performance and todetermine whether the station has undergone any changes. As next steps, the CDDIS is working to enhance these station performance monitoring tools through machine learning. Isolation forest is an unsupervised machine learning algorithm commonly applied to anomaly detection. In this poster, the CDDIS details the steps taken to track anomalies within SLR station performance using isolation forest with LAGEOS and LARES satellite data.

Benjamin P Michael↗

NASA NTRSDate not supplied

What Went Wrong: A Survey of Wildfire UAS Mishaps through Named Entity Recognition

Increasingly, unmanned aircraft systems (UAS) are being applied to wildfire incidents for tasks such as mapping, aerial ignition, and delivery. As a result, aviation incident reporting systems for wildfires are beginning to accumulate data related to UAS mishaps in wildfire response. In this research, we apply state-of-the-art natural language processing (NLP) techniques to develop a custom Named Entity Recognition (NER) model which extracts entities relevant to safety analysts. The custom NER model is built by fine-tuning an existing Bidirectional Encoder Representations from Transformers (BERT) model, resulting in a generalizable NER model that can extract engineering relevant entities including failure modes, causes, effects, control processes, and recommendations from failure-relevant text. This model performs passably, with a weighted average f1 score of 0.33 across entity types, indicating more labeled training data is needed. Extracted entities are used to form a Failure Modes and Effects Analysis (FMEA)-style survey of wildfire UAS mishaps reported using the SAFECOM system. Similar mishaps are manually clustered and reported as single rows within an FMEA. Foreach cluster, we compute frequency, severity, and overall riskin accordance with FAA standards. This methodology can beapplied as part of a broader safety management system totrack trends in mishaps (e.g., likelihood, severity) and discoverknowledge (e.g., causes, effects) that can be utilized to improvesafety outcomes and system performance.

Machine Learning↗

NASA NTRS2022

Lunar Thermal Analysis Guidebook (L-TAG): Thermo-physical and Optical Properties of Lunar Regolith

The purpose of the Human Landing System (HLS) Lunar Thermal Analysis Guidebook (L-TAG) is to provide guidance to experienced thermal engineering personnel on how to conduct worst-case hot and cold lunar thermal analyses for the design of HLS hardware in both lunar orbit and lunar surface environments. The HLS L-TAG will include pointers to the Cross-Program Design Specification for Natural Environments (DSNE), SLS-SPEC-159, and best practices/approaches for interpreting and complying with the DSNE lunar thermal environments in the analysis of HLS spacecraft, vehicles and systems. The HLS L-TAG is a reference document that is available to all HLS thermal analysts. In the event of a conflict with the descriptions provided herein, the DSNE takes precedence. This document represents the best available information at the time of publication and will undergo updates as the HLS program evolves. Feedback from the user community is encouraged to support further refinement of the Guidebook.

Thermal Analysis↗

NASA NTRS2022

Lunar Thermal Analysis Guidebook (L-TAG)

The purpose of the Human Landing System (HLS) Lunar Thermal Analysis Guidebook (L-TAG) is to provide guidance to experienced thermal engineering personnel on how to conduct worst-case hot and cold lunar thermal analyses for the design of HLS hardware in both lunar orbit and lunar surface environments. The HLS L-TAG will include pointers to the Cross-Program Design Specification for Natural Environments (DSNE), SLS-SPEC-159, and best practices/approaches for interpreting and complying with the DSNE lunar thermal environments in the analysis of HLS spacecraft, vehicles and systems. The HLS L-TAG is a reference document that is available to all HLS thermal analysts. In the event of a conflict with the descriptions provided herein, the DSNE takes precedence. This document represents the best available information at the time of publication and will undergo updates as the HLS program evolves. Feedback from the user community is encouraged to support further refinement of the Guidebook.

Thermal Analysis↗

NASA NTRS2022

Lunar Thermal Analysis Guidebook (L-TAG)

The purpose of the Human Landing System (HLS) Lunar Thermal Analysis Guidebook (L-TAG) is to provide guidance to experienced thermal engineering personnel on how to conduct worst-case hot and cold lunar thermal analyses for the design of HLS hardware in both lunar orbit and lunar surface environments. The HLS L-TAG will include pointers to the Cross-Program Design Specification for Natural Environments (DSNE), SLS-SPEC-159, and best practices/approaches for interpreting and complying with the DSNE lunar thermal environments in the analysis of HLS spacecraft, vehicles and systems. The HLS L-TAG is a reference document that is available to all HLS thermal analysts. In the event of a conflict with the descriptions provided herein, the DSNE takes precedence. This document represents the best available information at the time of publication and will undergo updates as the HLS program evolves. Feedback from the user community is encouraged to support further refinement of the Guidebook.

Thermal Analysis↗

NASA NTRSDate not supplied

It Depends - An Overview of Probabilistic Risk Analysis Concepts

How do you understand the data and assumptions in your probabilistic analysis? The PRA analyst needs to understand the data and input assumptions to effectively communicate the system/mission's risks. The decision maker also needs to understand conservatisms and how to interpret uncertainty in the PRA results. Properties such as assumptions on the distributions, uncertainty, use of test data, and common cause modeling can be the subject of much discussion, but often are the leading drivers of a risk profile.

risk assessment↗

NASA NTRSDate not supplied

NASA’s Safety, Reliability, and Mission Assurance Digital Future

The evolution from “document-centric” to “data-centric” and “model-centric” information leveraging structured data and model-based approaches is at the heart of digital engineering transformational efforts underway across industry and government. It is these approaches that pave the way for data lakes, Authoritative Sources of Truth (ASOTs), and systems- of-systems interoperability and the corresponding transformational benefits thereof. Such benefits include increased data availability, data access equity, data traceability, real-time analytics, batch analytics, and (most importantly) acceleration of the time-to-value and time-to-insights associated with engineering products and analyses. The longer-term benefits of reusability, customization and traceability are even more promising. For Safety and Mission Assurance (SMA), and Mission Success (SMS) activities; realization of such benefits is essential to provide engineers and analysts alike vital information when needed to support critical decision making throughout the entire life cycle. The SMA community often operate in parallel with engineering activities, for which information exchange with relevant context is paramount. Far too often, such information lags key decision points and/or is absent of the robust, integrated, knowledge needed, given inherent barriers associated with traditional document-centric means to data sharing, analysis, and reporting. This paper provides an overview of how NASA’s Office of Safety and Mission Assurance (OSMA) is evolving its policies, standards, guidance, and training to transform to eliminate such barriers, thus realizing the benefits emerging in this new digital era. A roadmap for achieving this digital future is presented along with key building blocks involving use and implementation of concepts such as: Objectives-Hierarchies, Objective-Driven Requirements, Accepted Standards, Safety and Assurance Cases, data digitization (i.e., ontologies, structured data, and model-centric data), FAIR (Findable, Accessible, Interoperable, & Reusable) and/or FAIRUST (Findable, Accessible, Interoperable, Reusable, Understandable, Secure, and Trusted) principles [1]. This paper also describes how OSMA, leveraging the Agency’s overall commitment to Digital Transformation (DT), is using the power of Policy, “Digital” Domain representation, Product Evolution, and Community Outreach and Engagement as part of a strategic vision and roadmap to evolve and transform its SMA organizations to become better able to serve its stakeholders and customers. Future publications will elaborate on these building blocks and deeper concepts.

Authoritative Source of Truth (ASOT),↗

NASA NTRSDate not supplied

System Safety Analysis of Complex NASA Systems with Model-Based Engineering (REV B)

The emergence of model-based engineering is transforming design and analysis methodologies. A recognized benefit of model-based engineering is the existence of a “single source of truth” about the system that becomes the authoritative source of data and information for designers, analysts, and developers. This promotes consistency and efficiency as the design emerges and can be used to further optimize the design. Integrating System Safety Engineers to the “single source of truth” will ensure that the outputs of their assessments and analyses are relevant to the design as it evolves. Use of an integrated system model enables near immediate evaluation of a design change as well as development of operational processes for risk assessment and communication. Such models can enable efficient and timely analysis of system hazards (e.g., hazard fault tree analysis and procedure simulations) and produce complete, accurate, and more consistent products (e.g., hazard reports and safety requirement evaluations). Therefore, an agency-sponsored team at Goddard Space Flight Center (GSFC) recently completed a System Safety Study of modeling and testing capabilities as part of a Model-Based Safety and Mission Assurance Initiative (MBSMAI). Using an existing model developed for reliability analyses, GSFC modeling and system safety experts performed system safety analysis/modeling and produced safety products. The team evaluated model-based feasibility to support System Safety Engineering, developed safety analysis modeling processes, and identified tool capability advancement/development needs. These study results indicate model-based engineering is valid and useable for System Safety Engineering for NASA if adequate modeling processes and environment are established.

NASA↗

NASA NTRSDate not supplied

An Overview of NASA’s Newest Engineering Model, ORDEM 4.0

Since the mid-1990s, one of the most important products produced by the NASA Orbital Debris Program Office (ODPO) has been the Orbital Debris Engineering Model (ORDEM). This series of models distills down our knowledge of the orbital debris environment to compute debris fluxes on satellites in a given orbit. This information can be used by spacecraft and upper stage designers and operators to design missions for better protection against the debris environment. The current version of the model is ORDEM 3.2, but the ODPO is working on the next generation of ORDEM, to be designated ORDEM 4.0. ORDEM 4.0 will include many known features from previous models, such as the ability to input a spacecraft orbit and time and to compute the flux as a function of debris size, impact speed, impact direction, and debris material densities, as well as uncertainty information on the flux. ORDEM 4.0 will update debris populations using the most recent measurements, including radar observations by the Haystack Ultrawideband Satellite Imaging Radar (HUSIR), NASA’s Goldstone radar, data from the new Space Surveillance Network Space Fence, and observations of Geosynchronous Earth Orbits (GEO) using the Eugene Stansbery-Meter Class Autonomous Telescope (ES-MCAT). The latest in situ impact data from returned hardware surfaces will be used. In addition, ORDEM 4.0 will introduce a parameterized debris shape model based on laboratory hypervelocity impact tests, such as DebriSat. This will allow analysts to implement shape characteristics in their damage equations and more accurately predict impact damage risk by debris of different shapes and orientations. This paper provides an overview of some of the new features forthcoming in ORDEM 4.0 and a status report on its development.

Mark Matney↗

NASA NTRS2023

BERT-Based Topic Modeling and Information Retrieval to Support Fishbone Diagramming for Safe Integration of Unmanned Aircraft Systems in Wildfire Response

Recent concepts for emerging wildfire response operations have included unmanned aircraft systems (UAS) due to their increasing accessibility and capabilities. To integrate UAS into wildfire response safely, researchers have studied the use of large repositories of historic incident reports to improve the scope of root cause analysis. Recent work has emphasized applying state-of-the-art natural language processing techniques to extract useful information from these repositories. However, it has not yet been studied how these results can be interpreted and integrated into the systems engineering process. In this work, we propose a process in which Bidirectional Encoder Representations from Transformers (BERT)-based topic modeling and information retrieval are applied to a relevant set of documents in order to support the development of a fishbone diagram in a semiautomated process. High-level themes in the document set are identified using topic modeling, which are then refined and interpreted by a human analyst. Then, the themes are used to guide a finer search using information retrieval, which returns specific incident reports of relevance. This provides traceability to specific incidents as well as broader categorizations that comprise the fishbone branches. We apply the proposed process to relevant documents from NASA’s Aviation Safety Reporting System (ASRS). The proposed process is widely applicable when relevant documents are available, and the results from this study will be useful to identifying potential causes of wildfire response UAS incidents.

Hazard analysis↗

NASA NTRS2021

High Performance, Web-Based, Real-Time Telemetry Visualization for Deep Space Mission Support and Operations

The Jet Propulsion Laboratory’s Mission ControlSystems Section and Mobility and Robotic Systems Section havepartnered to developed a high-performance telemetry visualizationsystem, based on our mature, web-based, 3D visualizationsoftware technology, that provides mission trajectory designers,operations personnel and reconstruction analysts with a highlyaccurate, re-usable, multi-mission solution to interactively visualizeresults from Entry, Descent and Landing (EDL) simulations,real-time mission test beds, live telemetry streams during criticalmission events, such as landing, as well as post-event reconstructionanalysis. This work builds on previous mission visualizationsystems that we have deployed for a variety of flight missions andJPL organizations including NASA’s Mars Science Laboratory(MSL), NASA’S Low Density Supersonic Decelerator (LDSD),NASA’s Soil Moisture Active Passive (SMAP), JPL’s MoonRiseLunar sample return proposal. JPL’s mission design teams, JPL’sOffice of Naval Research tasks, and JPL’s Education and PublicOutreach Office.

Wenzel, Sean↗

NASA NTRSDate not supplied

Trajectory Operations of the Artemis I Mission

This paper describes the operational design and execution of the Artemis I trajectory. It was an operationally complex trajectory with powered lunar flybys and insertion into a Distant Retrograde Orbit (DRO). A joint team of trajectory analysts at the NASA Johnson Space Center (JSC) were responsible for the design and operation of nominal and off-nominal in-space trajectories. A process was developed to convert optimized reference trajectories into Orion burn plans that could be uplinked to the vehicle. During the mission, the joint flight controller and engineering team continuously evaluated upcoming translational burns using actual vehicle conditions, monitored the trajectory for opportunities to re-optimize the trajectory in order to reduce propellant usage, and prepared for potential off-nominal scenarios. Overall Orion in-space trajectory performance is compared tomission designs to demonstrate the success of the design and operations work-flows.

Artemis I↗

NASA NTRSDate not supplied

Modeling Spacecraft Power Systems Using the SPACE Code

The NASA Glenn Research Center’s Power Architecture and Analysis Branch performs spacecraft electrical power system (EPS) performance analysis using the System Power Analysis for Capability Evaluation (SPACE) model. Accurately predicting EPS performance requires a wide range of inputs, including the spacecraft’s position, attitude, solar array temperature, load demand, and data on the EPS itself. By operating as a combined analysis tool with integrated orbit mechanics, attitude, shadowing, thermal, solar array, battery, and electrical component models, SPACE provides flexibility for the analyst to examine various scenarios without a time-consuming iterative process involving separate analysis tools and groups. SPACE also achieves short run times by tailoring the complexity of the included models, providing enough fidelity to ensure accurate EPS performance predictions without being bogged down by unnecessary detail. These advantages that SPACE has over similar power system models has contributed to its successful use on a variety of human spaceflight programs for over three decades, and makes it applicable across the development cycle from early conceptual design up through on-orbit operations.

Electrical Power System↗

NASA NTRSDate not supplied

Real-Time Pilot Inputs for Aircraft Dynamic Modeling

Real-time dynamic modeling and pilot displays are used to enable pilots to intuitively discover effective multi-axis inputs for aircraft dynamic modeling during flight tests. An F-16 nonlinear simulation flown by a pilot using a joystick and a laptop computer with real-time displays of relevant information is used to demonstrate the approach. Results show that pilots can use the real-time display to discover and implement effective and efficient multi-axis inputs for accurate dynamic modeling in flight. The real-time dynamic modeling results driving the pilot display can be used to certify that the acquired flight data are adequate for accurate dynamic modeling, thus avoiding postflight data analysis and modeling by an analyst to make that determination. Implications for pilot training and efficient flight testing are discussed.

Pilot Inputs↗

NASA NTRSDate not supplied

BERT-based Topic Modeling and Information Retrieval to Support Fishbone Diagramming for Safe Integration of Unmanned Aircraft Systems in Wildfire Response

Recent concepts for emerging wildfire response operations have included unmanned aircraft systems (UAS) due to their increasing accessibility and capabilities. To integrate UAS into wildfire response safely, researchers have studied the use of large repositories of historic incident reports to improve the scope of root cause analysis. Recent work has emphasized applying state-of-the-art natural language processing techniques to extract useful information from these repositories. However, it has not yet been studied how these results can be interpreted and integrated into the systems engineering process. In this work, we propose a process in which Bidirectional Encoder Representations from Transformers (BERT)-based topic modeling and information retrieval are applied to a relevant set of documents in order to support the development of a fishbone diagram in a semiautomated process. High-level themes in the document set are identified using topic modeling, which are then refined and interpreted by a human analyst. Then, the themes are used to guide a finer search using information retrieval, which returns specific incident reports of relevance. This provides traceability to specific incidents as well as broader categorizations that comprise the fishbone branches. We apply the proposed process to relevant documents from NASA’s Aviation Safety Reporting System (ASRS). The proposed process is widely applicable when relevant documents are available, and the results from this study will be useful to identifying potential causes of wildfire response UAS incidents.

hazard analysis↗