Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “TRUST”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Research and Technology Challenges for Human Data Analysts in Future Safety Management Systems

Enabling new and novel concepts of operations for Advanced Air Mobility poses an important need to evolve current safety management systems (SMS) and is posited to be realized through advances in Machine Learning (ML) Data Sciences and Artificial Intelligence. The “In-time Aviation Safety Management System” (IASMS) concept of operations supports the need to evolve today’s SMS to become more tailorable, scalable, and interoperable in response to forecasted changes expected for the future airspace system. Key to IASMS is integration of proactive and predictive ML algorithms trained to provide “in time” detection and mitigation of hazards and emergent risks through new methods and novel data types. IASMS research and technology development includes human factors design considerations for these systems to include human-system teaming, innovations in human interfaces and management of complex digital data information, human-system interaction/model-based system engineering, and verification and validation for data assurance and trust.

Chad L Stephens↗

NASA’s Digital Information Platform to Accelerate the Transformation of the National Airspace System

In order to accelerate the digital transformation of airspace operations, a foundational framework and infrastructure for providing sustainable, data-driven, and cohesive decision-making digital services for both traditional and emergent air vehicles is being developed. The reference implementation of Digital Information Platform builds an ecosystem for the aviation community by providing access to a secure and trusted source of aviation data and services. Several key features and services have been implemented to enable secure data sharing, communication, and service registration on the Platform. The technical approach used to implement these features is presented here. NASA-developed integrated aviation data and machine learning based prediction services to optimize airspace operations are available on the Platform. These services are being evaluated in an operational environment by flight operators and the real-world benefits are being captured. The Platform fosters collaboration among industry and researchers to develop complex aviation services and the aim is to make it publicly accessible for consumption by the aviation community.

Digital Transformation↗

NASA’s Digital Information Platform to Accelerate the Transformation of the National Airspace System

In order to accelerate the digital transformation of airspace operations, a foundational framework and infrastructure for providing sustainable, data-driven, and cohesive decision-making digital services for both traditional and emergent air vehicles is being developed. The reference implementation of Digital Information Platform builds an ecosystem for the aviation community by providing access to a secure and trusted source of aviation data and services. Several key features and services have been implemented to enable secure data sharing, communication, and service registration on the Platform. The technical approach used to implement these features is presented here. NASA-developed integrated aviation data and machine learning based prediction services to optimize airspace operations are available on the Platform. These services are being evaluated in an operational environment by flight operators and the real-world benefits are being captured. The Platform fosters collaboration among industry and researchers to develop complex aviation services and the aim is to make it publicly accessible for consumption by the aviation community.

Digital Transformation↗

Virtual Assistant for First Responders Using Natural Language Understanding and Optical Character Recognition

Commercial deep learning capabilities are available for many applications such as computer vision processing and intelligent chat bots. The Google Cloud Platform product Google Dialogflow provides lifelike conversational artificial intelligence (AI) using machine learning (ML) to generate natural conversations between computers and humans. This ML utilizes natural language understanding (NLU) to recognize a user’s intent and extracts key information into a form of entities. We have developed a user-friendly application through understanding the hazardous material database, first aid safety guidelines and observing the process of first responders who access this information in the field. We created the Trusted and Explainable Artificial Intelligence for Saving Lives (TruePAL) virtual assistant using Dialogflow1 and TensorFlow2 paired with EasyOCR.3 The chatbot supports first responders by providing voice interaction which helps limit additional steps such as browsing through multiple categories when searching for information. Using feedback from our field interviews, the voice interface has been developed to enable the first responder to focus on the immediate emergency. With less distractions, the first responder is able to engage the incident more effectively. The partial hands-free TruePAL chatbot assistant improves the accessibility to the correct guidance by an average of 1.9 seconds compared to the widely used application, NIH WISER, which requires full attention to operate. We combined this intelligent chatbot with a separate visual processing capability to produce hazardous signage analysis and generate the proper guidance for first responders. With the evolving functionality of AI tools, the use of virtual assistants in first responder technology will be an advancement, benefiting the safety of both first responders and civilians.

Chow, Edward↗

The Open Data Repository - an Open Science Platform for Long-Tail Research Data

Introduction: ‘Long-tail’ research is performed by individual PIs and small research teams, producing what are often highly diverse, but relatively small da-tasets that span a variety of traditional scientific disci-plines. ‘Long-tail’ research is a fundamental part of realizing NASA’s goals in planetary sciences and a key input feeding into mission life cycles. The ‘long-tail’ has traditionally lacked the resources (available to larg-er groups and missions) to overcome barriers inhibit-ing the adoption of open science practices, including lack of acknowledgment, time, money, guidance, ex-pertise, and trust in available platforms1. Here we show how the Open Data Repository’s (ODR) data publish-ing platform could help lower some of these barriers and accelerate the adoption of open-science practices in planetary science.

‘Long-tail’ research↗

Guiding Integration of Formal Verification in Assurance Cases

Assurance cases are being increasingly acknowledged as away to build trust in complex systems with autonomous capabilities. An assurance case is a comprehensive, defensible, and valid justification that a system will function as intended for a specific mission and operating environment. Formal verification is often reserved for the most critical components of such systems. However, formal verification tools are often complex, and their usage is subject to many constraints and contextual dependencies. This can raise challenges both for performing the verification as well as reflecting the verification results appropriately in the assurance case, especially for non-expert users of the verification tool. To address these challenges, we present a tool-supported methodology for integrating formal verification results in an assurance case by capturing key verification method information in a rigorously constructed assurance case. In particular, we capture the tool specification in terms of its inputs, outputs, and assurance constraints as assumptions over inputs and guarantees provided over its outputs. The tool specification is parametrized over the inputs and outputs to both guide the intended application of the tool, as well as to check that the tool has been applied following the stated assumptions and that the guarantees hold. We define a generic tool assurance argument pattern that enables integration of the verification results in the assurance case by allowing custom refinement and automated instantiation for each tool use. We demonstrate our methodology on two formal verification tools and their applications to the verification of neural network properties for the aircraft domain.

Assurance Cases↗

Dynamic Assurance of Autonomous Systems through Ground Control Software∗

Assurance cases are being increasingly acknowledged as a way to build trust in complex systems with autonomous capabilities [1]. An assurance case is a comprehensive, defensible, and valid justification that a system will function as intended for the specific mission and operating environment. Such justifications for systems with autonomous capabilities are often based on various probabilistic quantifications [2]. Due to the dynamic nature of the environmental conditions in which these systems operate, as well as the changing nature of the autonomous systems themselves, these probabilistic quantifications cannot be simply estimated once during design time. Rather, they need to be continually evaluated during systems operations to ensure that the assurance case justifications are valid. We refer to the assurance case that combines both the static and dynamic elements as a Dynamic Assurance Case (DAC).

dynamic assurance case↗

Lessons Learned With Risk Management: A Systems Engineer's Perspective

Risk management is a communications device that, when executed as an essential task, enables systems engineering to effectively balance risk across the project. Developing and baselining risks is an essential continuous task to ensure top project concerns both from bottom up and top down are being mitigated. Risk management provides the opportunity to avoid the consequence of the risk when mitigation steps start early enough. Just discussing risk with all the project flight elements during development, even if no risks are open, provides an excellent communication opportunity between systems engineering and those elements, ensuring concerns and worries have a platform for discussion. A well-managed risk identification process will identify concerns that are serious but not being clearly communicated, and it will enable mitigation of those potential problems before they cause a failure. Effective risk management requires considerable time and effort, but that effort will save time and money across the development. Risk management must be frequent enough to be useful and in depth enough to bring out emerging issues. It also requires a trusting relationship between the lead systems engineer and element and/or subsystem leads. The discussions need to be with the right number of individuals (typically a handful) and the right duration in time (typically an hour a month). Outside of these risk working groups, there is a formal management process to input, status, and disposition risks, and a monthly Risk Management Board meeting where key project stakeholders are informed. This paper provides good guidance on effective risk management from a systems engineering perspective and provides project lessons learned from the NASA spaceflight missions NICER, Landsat 9, LRO, and OSIRIS-REx to demonstrate the effectiveness of risk management.

Lessons Learned↗

Lessons Learned With Risk Management: A Systems Engineer’s Perspective

Risk management is a communications device that, when executed as an essential task, enables systems engineering to effectively balance risk across the project. Developing and baselining risks is an essential continuous task to ensure top project concerns both from bottom up and top down are being mitigated. Risk management provides the opportunity to avoid the consequence of the risk when mitigation steps start early enough. Just discussing risk with all the project flight elements during development, even if no risks are open, provides an excellent communication opportunity between systems engineering and those elements, ensuring concerns and worries have a platform for discussion. A well-managed risk identification process will identify concerns that are serious but not being clearly communicated, and it will enable mitigation of those potential problems before they cause a failure. Effective risk management requires considerable time and effort, but that effort will save time and money across the development. Risk management must be frequent enough to be useful and in depth enough to bring out emerging issues. It also requires a trusting relationship between the lead systems engineer and element and/or subsystem leads. The discussions need to be with the right number of individuals (typically a handful) and the right duration in time (typically an hour a month). Outside of these risk working groups, there is a formal management process to input, status, and disposition risks, and a monthly Risk Management Board meeting where key project stakeholders are informed. This paper provides good guidance on effective risk management from a systems engineering perspective and provides project lessons learned from the NASA spaceflight missions NICER, Landsat 9, LRO, and OSIRIS-REx to demonstrate the effectiveness of risk management.

Lessons Learned↗

Performance of Two Battery Prognostic Applications used by Two Octocopters for Safe Low Altitude Autonomous Flight Operations

This paper addresses the problem of building trust in online predictions of the remaining available flying time for two different electric Unmanned Aerial Vehicles (eUAVs) powered by lithium-ion-polymer batteries. Flight tests for various automation research missions for the two vehicles were monitored using two on-board battery health management applications to make predictions of the remaining flying time (RFT) for each eUAV and to predict the state of the battery. Playback of the voltage, current and temperature profiles of the battery discharge were used to assess the accuracy of the estimation of the voltage and the charge states of the models as well as the estimate of the RFT. The reference ground truth values were the observed landing time and the measured battery pack resting pack voltage 20 minutes after the flight. The predicted RFT, state of charge (SoC), and state of energy (SoE) were compared with the observed results. Noise values of one standard deviation from the mean values of the internal charge states of the battery model during a reference run were used to vary the states during simulation. One application used an equivalent circuit model of the electrical dynamics of the battery pack, and the other application used a reduced-order electrochemistry model. The variation of the model state components was compared to the variation in the estimate of the RFT and the variation in the SoE to estimate a confidence factor. Variation in the estimates caused by factors affecting the off-line laboratory parameter identification experiments is considered. Variation in the estimates due to environmental factors are discussed.

Assurance↗

National Campaign Development Test Executive Summary

NASA’s vision for Advanced Air Mobility (AAM) is to provide safe, sustainable, accessible, and affordable aviation for transformational local and intraregional missions and includes the transportation of passengers and cargo as well as aerial work missions, such as infrastructure inspection or search and rescue operations. NASA’s technical expertise, intergovernmental relationships, and high level of public trust will help this technology come to market concurrent with infrastructure readiness, public acceptance, and constructive regulation. By advising and integrating disparate AAM efforts across the country and working collaboratively with the FAA, the National Campaign (NC) objective is to motivate industry progress and support the development of policy, regulatory, and technical standards in a manner that best ensures public safety and benefit to the American people. NC began with the Dry Run and Developmental Test (NC-DT), which served as a pathfinder for collaboration and direct involvement with industry partners in integrated simulation exercises and flight tests. NC-DT culminated with an acoustics-gathering flight test in September 2021 with industry partner Joby’s prototype S4 2.0 air vehicle, which delivered the first foundational baseline of noise levels present in Electric Vertical Takeoff and Landing (eVTOL) vehicles. Through the DT phase, the NC team built and tested the airspace and range infrastructure while assessing the readiness level of industry partners leading up to future NC events. The purpose of this paper is to provide an overview of NC-DT.

National Campaign↗

Introduction of an Agile Systems Engineering Process to the NASA Armstrong Flight Research Center

This paper will provide background on the National Aeronautics and Space Administration (NASA) Aeronautics Research Mission Directorate (ARMD) ARMD Test Data Portal (ATDP) effort along with the rationale that motivated the ATDP team to consider implementing an agile systems engineering (SE) process. The primary motivation for using this new SE process was based on the desire to mitigate a major risk to project success. Since the agile SE process had never been used before at the NASA Armstrong Flight Research Center (AFRC), utilizing this new SE process required a trailblazing effort to introduce it to NASA AFRC leadership. As a result, the ATDP team chose to adhere to the agile SE process in addition to the trusted classical waterfall SE process on ATDP. Through successful execution of this hybrid SE process during Phase I, along with demonstrating the value and rigor of the agile SE process, NASA AFRC leadership ultimately permitted the ATDP project to solely use the agile SE process for developments beyond Phase I. While it is the opinion of the authors that the classical SE process is more effective for most projects at NASA AFRC, some projects may deem that the agile SE process is more advantageous. Although this paper is focused on introducing the agile SE process to NASA AFRC, lessons learned will be valuable to other organizations as well. Details of how the ATDP team implemented the agile SE process during Phase I will be summarized, along with how the team met all required classical SE milestones. Lessons learned throughout Phase I of this effort will also be highlighted.

Daniel S. Jones↗

Pathways to International Coordination in Space Weather

The United Nations Committee for the Peaceful Uses of Outer Space(UN-COPUOS) in its 2022 Space Weather Expert Group report, called upon the World Meteorological Organization (WMO), the InternationalSpace Environment Service (ISES) and the Committee on Space Research (COSPAR) to take a leadership role in improving the global coordination of space weather activities in consultation and collaboration with other relevant actors and international organizations. The three organizations have established a framework for trusting partnership while minimizing duplication of efforts and have agreed on three distinct domains in which the particular expertise and strengths of each of the three were identified: Research and Development (COSPAR), Facilitating Integration (WMO), andServices (ISES). The next stage in building a pathway to improved coordination is to lay the same foundation with other relevant organizations and actors engaged in space weather. We will present outcomes of the first International Space Weather Coordination Forum intending to shape the future of international collaboration on space weather with the ultimate aim of increasing the community’s ability to mitigate space environment threats. We will discuss approaches to alignments of bottom-up initiatives and community-driven roadmaps with national/regional strategic planning activities and funding programs. We will also review opportunities for taking advantage ofInternational Space Weather Action Teams (ISWAT) for planning pilot projects to demonstrate the value of collaboration and coordination.

Maria M Kuznetsova↗

Human-Autonomy Teaming Assistant to Support Small Uncrewed Aircraft Systems for Wildland Firefighting Operations

An exploratory human-in-the-loop simulation was conducted to investigate and characterize a Human-Autonomy Teaming (HAT) Assistant to support a remote operator of multiple small Uncrewed Aircraft Systems (sUAS) using a ground control station (GCS) in the context of a wildland fire surveillance mission. Operator performance using the GCS with the HAT Assistant (Assisted Mode) was compared to operator performance using the GCS without the HAT Assistant (Unassisted Mode) during two types of contingency-event scenarios (Low and High Complexity). In the Assisted Mode, the HAT Assistant provided updates to the level of risk to the mission along with recommendations for risk mitigation, which were not provided in the Unassisted Mode. No significant differences in objective performance and subjective ratings of workload, situation awareness, and trust in automation between the Assisted and Unassisted Modes were detected, however there were indications that participants preferred the Assisted GCS over the Unassisted GCS and directions for further development were explored. Additional work is necessary to further refine the HAT Assistant and better characterize its effects on remote operator performance while managing multiple sUAS assets. Future work is recommended to optimize the implementation of an assistant to support operator performance during different missions and across vehicle classes.

Human-Autonomy Teaming↗

Effective Engagement for Community Action with NASA’s Indigenous Peoples Initiative

NASA’s Indigenous Peoples Initiative (IPI) seeks to support and cultivate efforts within Indigenous communities and NASA to increase the use of Earth Observations (EO) to inform decisions, policies, and actions. IPI is dedicated to building lasting relationships with Indigenous communities by creating a trusted, reliable, and Indigenous-centric geospatial community with a focus on environmental justice and climate issues on Indigenous lands and territories. Indigenous communities through conservation, restoration, and adaptation have the opportunity to further empower their landscape work through the potential use of EO and other NASA data and tools. We will outline our guiding principles, multiple approaches, and lessons learned for working alongside Indigenous communities in a respectful and reciprocal manner. These include the recognition of multiple ways of knowing, co-development of trainings, acknowledgement of all sovereignty, maintaining healthy relationships with tribal natural resource managers and building bridges for their engagement with NASA researchers and other federal agency partners, and making space for reflection and adaptation of our practices as we grow. Future activities, such as dialogue sessions with Indigenous communities around EO needs, aim to enhance these practices and ultimately benefit the ability for Indigenous communities to maintain and protect their lands, people, and practices in the face of environmental injustices and climate change.

Effective↗

A Formal Verification Framework for Runtime Assurance

The simplex architecture is an instance of Runtime Assurance (RTA) where a trusted component takes control of a safety-critical system when an untrusted component violates a safety property. This paper presents a formalization of the simplex RTA framework in the language of hybrid programs. A feature of this formal verification framework is that, for a given system, a specific instantiation can be created and its safety properties are guaranteed by construction. Instantiations may be kept at varying levels of generality, allowing for black box components, such as ML/AI-based controllers, to be modeled. The framework is written in the Prototype Verification System (PVS) using Plaidypvs, an embedding of differential dynamic logic in PVS. As a proof of concept, the framework is illustrated on an automatic vehicle braking system.

Runtime assurance↗

Breaking Barriers: Integrating Geo-Leo Aerosol Data with an Open-Source Approach

The scientific community is still examining the novel data from geostationary satellite observations and evaluating methods for effectively fusing the polar observations with various spatial and temporal resolutions. However, the merged data will present a significant ""Big Data"" challenge, including processing, storage, data discoverability, accessibility, and migration within cloud computing environments. We have developed an open-source package to fuse aerosol optical depths (AOD) products from six satellite sensors in the past four years (2019~2023), and this presentation will update our recent progress. Using this Python-based package, we produced a level 3 global (AOD) product in a quarter-degree spatial resolution every half-hour, fusing the Level 2 AOD data with the Dark Target aerosol retrieval algorithm from six satellites: three geostationary (GOES-16/17 and Himawari-8) with high temporal resolution, and three polar orbiting (TERRA/MODIS, AQUA/MODIS, and SNPP-VIIRS) with global coverage. By integrating these observations, the diurnal cycle of global AOD in this fused product can be characterized at local, regional, and global scales. Furthermore, we are committed to openness and transparency by providing our package and its associated functionalities as open-source. Our dedication to adhering to the FAIR, CARE, and TRUST principles ensures that our users can rely on the integrity and ethical standards of our work. For instance of Interoperability, this package fuses remote sensing products on demand into desired temporal and spatial domains. It can be run in a central processing unit (CPU) or a Graphics processing unit (GPU) mode. This package will empower researchers and practitioners to use satellite and sensor data efficiently in various applications and research.

Xiaohua Pan↗

Estimating Future Changes of Energy Demand for Heating and Cooling Buildings at NASA Centers GC23J-1198

With its unique and trusted earth observations, NASA is a critical source in informing decisions that will help achieve the U.S. goal of Net-Zero Greenhouse Gas (GHG) Emissions by 2050. NASA’s Prediction of Worldwide Energy Resource (POWER) project facilitates the use of NASA Earth Science data holdings within the energy, agricultural, and building heating/cooling design industries. POWER packages solar and meteorological data from several NASA projects in a user friendly GIS-enabled web services system (https://power.larc.nasa.gov). As part of the development of new data products to support the energy and building heating/cooling design communities, we estimate the changes in energy required to heat and cool buildings in the future climate at 14 different NASA site locations spread throughout the continental United States, as projected by CMIP6 climate models under different emissions scenarios. Bias-corrected downscaled time series of meteorological variables are taken from NASA Earth Exchange (NEX) Global Daily Downscaled Projections (GDDP-CMIP6) downscaled climate model data. The spread between the different model projections is accounted for by analyzing both the ensemble average of 22 CMIP6 models and 6 representative models with different climate sensitivities and different interannual variability. Changes in energy use are estimated in two ways. First, changes in the total annual heating and cooling degree days (HDD and CDD, respectively) are calculated relative to the current climate. This is done at all 14 sites. Second, the downscaled time series are used as inputs into RETScreen(R), a clean energy management decision tool, to give an estimate of heating/cooling energy use for a typical office building. We use this estimation method with model data at Langley Research Center. In the next 50 years, the annual total of HDD (CDD) is projected to decrease by 8-38% (increase by 5-28%) at all sites, with the increase in CDD typically a larger magnitude the decrease in HDD. For a typical small office building at Langley Research Center, the amount of energy needed to cool increases by 33-54% and the amount of energy to heat decreases by 29-40%. POWER is working to develop long term climate data services based on these results to include in future data products to provide to users.

Bradley M. Hegyi↗