Soft Actor-Critic Reinforcement Learning Improves Distillation Column Internals Design Optimization
Explore the source record for details and available documents.
Dhan Lord B. Fortela↗
SEARCH · Engineering Papers
Results for “actor critic”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Microservice Architecture for Cognitive Networks
This develops the concept of a cognitive network and describes a microservice based architecture which could be used to implement such a system. Delay tolerant networking (DTN) influences the design of the architecture as well as the networking scenarios that the system attempts to address. A cognitive storage and fragmentation service is developed based on existing artificial intelligence techniques such as Advantage Actor Critic (A2C) and Deep Q-Networks. The system is simulated using OpenAI Gym in a custom developed DTN environment.
cognitive networks↗
Cooperative and Non-Cooperative UAS Detection
This paper describes a system that enhances airspace situational awareness by detecting and identifying Unmanned Aerial Systems (UAS). This multi-domain solution tracks both cooperative scientific flights as well as non-cooperative intrusions from "bad actors." The system supports a critical push towards safety within NASA’s advanced air mobility mission. After surveying the existing technologies at Langley Research Center, the radar and visual systems were chosen for the primary and secondary detection mechanisms, respectively. These systems were tuned an upgraded to become more sensitive to UAS activity. Additionally, a Remote Identification receiver was procured and integrated into the flight surveillance system.
Lucas Barduson↗
Experiments for Securing Air Traffic Against Cyber-Physical System Attacks
This presentation describes experiments conducted with single board computers to investigate methods for creating trust for enabling the development of cyber-resilient air transportation systems. Methods included secure communication to prevent unauthorized access to data, consistency of data obtained via sensors and by processing, and built-in safeguards to prevent mission failure. The motivation for this work are the following. The future air transportation system needs to ensure availability, integrity, confidentiality and safety of operations. Safety of vehicles and operations is paramount for successful integration of Urban Air Mobility (UAM), Unmanned Aerial Systems (UAS), supersonic aircraft and launch vehicles with conventional aviation operations in the National Airspace System. Security is becoming critical because the sensors, networks and computers are far more vulnerable to bad actors than their mechanical or human predecessors. The goal therefore is to design and develop cyber-resilient systems that continue to function even in degraded states. The main findings are (1) off-the-shelf hardware can support development of cyber-resilient onboard flight computers and (2) trust in system design and implementation can be accomplished by integrating layers in depth (detail) and in breadth (scope).
cyber-resilient autonomy, trust, secure communicat↗
NOAA-17 Break-up Engineering Investigation Board Final Report
The NOAA-17 break-up was found to be a single, localized debris event producing about100 trackable pieces; there is likely no catastrophic damage to the whole spacecraft. NOAA-17 debris is very much in family with NOAA-16 debris, and DMSP F11 and F13 are very much in family with each other and share similarities with NOAA-16 and 17; it is likely all four (“The Big Four”) share the same debris source. DMSP F13 break-up occurred simultaneous with a known battery overcharge and therefore battery rupture is most likely intermediate cause of the Big Four break-ups; this is a low confidence assessment since other debris sources cannot be definitively ruled out. No root cause was found as the NOAA-17 batteries were all confirmed to have been disconnected from the charge path as intended. Possible conditions for reconnection are all unlikely including short circuits and commanding from a “bad actor.” All related spacecraft pose a risk of similar break-ups for decades to come and are a threat to the critical 800-850 km polar orbit regime; even appropriately decommissioned spacecraft appear to be at risk. Recommendations include an update to the decommissioning procedure and consideration of further investigations and active debris removal, consistent with national policy.
Maggie Atkinson↗
Informing New Concepts for UAS and Autonomous System Safety Management using Disaster Management and First Responder Scenarios
As emerging flight operations become more prevalent and increasingly automated and distributed, the capabilities for managing safety of vehicles and operations will also need to evolve. To address this challenge, the National Academies has envisioned an In-Time Aviation Safety Management System (IASMS) capability for a wide range of aviation operations including current commercial operations as well as new entrants envisioned with advanced air mobility (AAM). The suite of IASMS services, functions, and capabilities (SFCs) would be implemented in a federated approach and would address trends as well as individual operations. Through predictive modeling and data analysis, IASMS is envisioned to identify arising risks so that they can be mitigated, in-time, before a safety incident occurs. IASMS and its requisite set of SFCs must leverage a wide range of information to perform. To better understand these new needs, FSF worked with the aviation and humanitarian communities to develop and validate scenarios that include traditional aviation operations and UAS operations intermingled as they are deployed for disaster management and first responder (DMFR) situations. The three scenarios developed include: • Post Natural disaster response, such as a hurricane, involving multiple parties utilizing traditional aviation and UAS to support rescue operations, surveil damage, and locate survivors needing assistance. • Wildfire fighting in remote locations with traditional aircraft for transport and fire-retardant delivery combined with UAS for surveillance of fire locations as well as to track individual firefighter locations. • Medical Operations and AAM in Urban Environments including passenger-carrying helicopters and AAM vehicles, medical missions (such as transport of radio-pharmaceuticals), and other UAS delivery operations (such as the delivery of defibrillators). Each scenario was developed and validated by representatives with expertise in humanitarian operations, urban and rural emergency response, air traffic management, UAS operations, and traditional flight operations. The scenario definitions address roles and responsibilities of individual actors, the appropriate utilization of UAS, and the actions taken by those actors to appropriately manage risks associated with the mission and environment. The risks to aviation traffic and to people on the ground explored included potential risks arising from incompatibilities in calculating reference altitudes (eg, differing uses of AGL, MSL, barometric, or GPS-derived values), loss of command and control (C2) communications, rapid changes in weather and winds, and physical interference. For each risk, IASMS SFCs were postulated in the context of monitoring services, risk assessment capabilities, and identifying appropriate mitigation strategies. The identified SFC capabilities were envisioned from known services postulated for IASMS and for UTM. For these unique environments, IASMS SFCs are needed to address conditions such as hazardous payloads, micro-climates and urban canyons, and the need to keep uninvolved air traffic out of the area where DMFR operations are being conducted. The second phase of analysis focused on inferring the specific information needs and the SFCs for IASMS, utilizing a structure of 16 information classes to organize requirements. For each of the risks identified in the workshops, it was postulated what data sources would be necessary to monitor critical aspects of the risk (eg, surrounding air traffic, ground population, terrain, etc). to be directly measured as well as data that would be derived, which implies additional SFCs for different actors to understand what information would likely be exchanged between parties. For an IASMS to be effective, additional research is needed to develop the advanced algorithms that can address the increasingly autonomous and complex operations in differing environments and to develop means of identifying unknown risks. Looking at these scenarios highlighted a number of research issues. These include the ability to quickly "cordon off" airspace thru temporary flight restrictions (TFRs) or other means, developing clear definitions to enable automation-based algorithms for prioritizing operations, defining airspace density metrics, standardization of altitude reporting, and establishing a basis for safety data metrics definition and collection. This paper seeks to outline the development of an IASMS in the context of the DMFR scenarios and resulting demonstrations. Utilizing this contextual approach, NASA will generate recommendations for an assured safety framework for AAM operations that enables AAM operations to safely access the NAS.
In Time Aviation Safety Management System↗
Human Factors Virtual Analysis Techniques for NASA's Space Launch System Ground Support using MSFC's Virtual Environments Lab (VEL)
Using virtual environments to assess complex large scale human tasks provides timely and cost effective results to evaluate designs and to reduce operational risks during assembly and integration of the Space Launch System (SLS). NASA's Marshall Space Flight Center (MSFC) uses a suite of tools to conduct integrated virtual analysis during the design phase of the SLS Program. Siemens Jack is a simulation tool that allows engineers to analyze human interaction with CAD designs by placing a digital human model into the environment to test different scenarios and assess the design's compliance to human factors requirements. Engineers at MSFC are using Jack in conjunction with motion capture and virtual reality systems in MSFC's Virtual Environments Lab (VEL). The VEL provides additional capability beyond standalone Jack to record and analyze a person performing a planned task to assemble the SLS at Kennedy Space Center (KSC). The VEL integrates Vicon Blade motion capture system, Siemens Jack, Oculus Rift, and other virtual tools to perform human factors assessments. By using motion capture and virtual reality, a more accurate breakdown and understanding of how an operator will perform a task can be gained. By virtual analysis, engineers are able to determine if a specific task is capable of being safely performed by both a 5% (approx. 5ft) female and a 95% (approx. 6'1) male. In addition, the analysis will help identify any tools or other accommodations that may to help complete the task. These assessments are critical for the safety of ground support engineers and keeping launch operations on schedule. Motion capture allows engineers to save and examine human movements on a frame by frame basis, while virtual reality gives the actor (person performing a task in the VEL) an immersive view of the task environment. This presentation will discuss the need of human factors for SLS and the benefits of analyzing tasks in NASA MSFC's VEL.
Searcy, Brittani↗
Spot: A Programming Language for Verified Flight Software
The C programming language is widely used for programming space flight software and other safety-critical real time systems. C, however, is far from ideal for this purpose: as is well known, it is both low-level and unsafe. This paper describes Spot, a language derived from C for programming space flight systems. Spot aims to maintain compatibility with existing C code while improving the language and supporting verification with the SPIN model checker. The major features of Spot include actor-based concurrency, distributed state with message passing and transactional updates, and annotations for testing and verification. Spot also supports domain-specific annotations for managing spacecraft state, e.g., communicating telemetry information to the ground. We describe the motivation and design rationale for Spot, give an overview of the design, provide examples of Spot's capabilities, and discuss the current status of the implementation.
validation↗
Near-Term Policy Considerations for Lunar Missions
Near-Term Policy Considerations for Lunar Missions. Therese Jones1, Gabriel Swiney,1 and Katie McBrayer,2 1NASA HQ, 300 Hidden Figures Way SW, Washington, D.C. 20546, 2NASA Langley Re-search Center, 1 NASA Drive, Hampton, VA, 23666. (Contact: therese.m.jones@nasa.gov) Introduction: More than two dozen lunar missions are planned prior to the Artemis III crewed lunar landing, from Russian, Chinese, Indian, Japanese and U.S. government orbiters and landers to Commercial Lunar Payload Ser-vices missions to commercial crewed flybys. While the Artemis Accords have established an international consortium of countries seeking to mitigate interference between operations on the Moon, a number of unaddressed policy issues remain that may be critical to lunar operations. In this lightning talk, we build upon NASA’s Of-fice of Technology, Policy, and Strategy’s Sep-tember 2022 Report “Lunar Landing and Oper-ations Policy Analysis” [1], to give an overview of policy questions that remain open, including: whether to prioritize certain landing locations or avoid certain scientifically valuable locations, design and coordination of safety zones, notifi-cation of other actors of potential dangers posed by landing, whether to avoid placing equipment in operationally valuable locations, and end-of-life disposal. We will also discuss how these policy implications could apply to planned missions.. References: [1] Swiney, G., and Hernandez, A. Lunar Landing and Operations Policy Analy-sis, NASA Office of Technology, Policy, and Strategy, September 30, 2022 https://www.nasa.gov/sites/default/files/atoms/files/nasa-otps-lunar-landing-and-operations-policy-analysis-final-report_2.pdf
Therese Jones↗
Development and Implementation of A Small Satellite Systems Engineering Webinar Series: A Collaboration Between the United Nations Office for Outer Space Affairs and the National Aeronautics and Space Administration
The United Nations Office for Outer Space Affairs (UNOOSA) in collaboration with the National Aeronautics and Space Administration (NASA) established a webinar series on NASA systems engineering standards and practices for the purpose of sharing knowledge in this area. UNOOSA’s “Access to Space for All” initiative provides capacity-building opportunities in space science, technology, and space applications for United Nations member states. Due to the cooperation among established space actors, the United Nations, and emerging space entities, the initiative enables students from developing countries from all over the world to carry out projects using technologies and space applications. Through NASA’s Small Spacecraft Systems Virtual Institute (S3VI), the four-part webinar series was designed to cover basic systems engineering and project management skills that are fundamental to planning, developing, and implementing an experiment or a space project and that serve as critical knowledge for those engaged in space activities, whether as a designer, builder, or manager of space infrastructure and services. The first series of webinars was convened over the course of November 2023 through February 2024.
Systems Engineering↗
Remote ID for Rapid Assessment of Flight and Vehicle Information
The ability to rapidly identify UAS (Unmanned Aircraft Systems) in the field has emerged as a critical need for the integration of small UASs into the national airspace and counter-UAS operations. This paper proposes an architecture for rapid retrieval of UAS information leveraging NASA's current Unmanned Aircraft System (UAS) Traffic Management (UTM) system. The proposed architecture utilizes UTM components: FIMS (Flight Information Management System), USS (UAS Service Supplier), and vehicle registration and model database in order to provide assessment of the UAS reported in the field including the ability to distinguish between participating and non- participating UTM actors. Detailed system descriptions are provided and preliminary results from field tests conducted during UTM TCL (Technical Capability Level) 3 are discussed. It is found that 94 percent of the remote ID look-ups were successful. The average time of a look-up is found to be 1.2 seconds. Failure cases are examined and recommendations on next steps to advance UAS remote identification are provided.
USS (UAS Service Supplier)↗
Remote ID for Rapid Assessment of Flight and Vehicle Information
The ability to rapidly identify UAS in the field has emerged as a critical need for the integration of small UASs into the national airspace and counter-uas operations. This paper proposes an architecture for rapid retrieval of UAS information leveraging NASA's current Unmanned Aircraft System (UAS) Traffic Management (UTM) system. The proposed architecture utilizes UTM components: FIMS (Flight Information Management System), USS (UAS Service Supplier), and vehicle registration and model database in order to provide assessment of the UAS reported in the field including the ability to distinguish between participating and non- participating UTM actors. Detailed system descriptions are provided and preliminary results from field tests conducted during UTM TCL (Technical Capability Level) 3 are discussed. It is found that 94% of the remote ID look-ups were successful. The average time of a look-up is found to be 1.2 seconds. Failure cases are examined and recommendations on next steps to advance UAS remote identification are provided.
Ishihara, Abraham K.↗
Report of the Panel on Materials
Materials and manufacturing technology are critical to advanced aircraft and permeate all disciplines. Current aircraft systems employ a variety of materials, each selected to provide the best vehicle design in terms of performance, safety, reliability, manufacturability, and life cycle cost. However, a mistake in materials selection could bankrupt an airframe or engine manufacturer. Thus, the introduction of new materials is a slow process. Generally, new materials are used initially in noncritical components until their performance in service can be confirmed. Then, as confidence grows, they are used in more and more critical applications. Finally, if appropriate, new materials are used in critical, static elements and then in dynamic components. Thus, because the nominal time for development of a conventional monolithic material ranges from 5 to 10 years there is a 10- to 15- year lag between laboratory effort and introduction into service. Therefore, to assure the availability of materials suitable for production aircraft and engines in the year 2000, the concepts already must have been identified and must be progressing along evolutionary paths toward application. Trends, actual and projected, in the use of materials for commercial engines are shown in Figure 4-1. Related military applications are projected to follow similar paths. The new actor will be composites. The panel examined a wide range of materials important to all aspects of aircraft development, airframe structures, propulsion systems and for other important aircraft subsystems. These are addressed in the body of the report in terms of the current state of the art, opportunities for improvement, and barriers to achievement of projected benefits. This is followed by projections of the progress of technology that could be realized by the year 2000 with the application of appropriate resources.
Diefendorf, Russell J.↗
Airspace Integration Considerations for Increasingly Autonomous Flight and Operations
There is much interest in autonomous systems and their operations. When it comes to autonomous systems, it is critical to understand various levels of proposed autonomy, reasons for selecting autonomous capabilities, certification approaches and various challenges or research needs associated with the integration of autonomous systems in the National Airspace System (NAS). Furthermore, there are levels of autonomous systems proposed for different types of aircraft including: single pilot operations, remotely piloted operations, fully autonomous operations, and multiple aircraft managed by a single, remote pilot. This preliminary article aims to provide a broad overview rather than concentrate on a specific element of autonomous flight. Hence, the focus of this article is on enabling various types of increasingly autonomous aircraft and their operations routinely within the next five to ten years, consistent with the FAA’s Info-Centric NAS (ICN) vision. Under ICN, a fully integrated information environment supports collaboration across diverse traffic management services and shifts decision-making to the most appropriate actor supported by automation. However, the roles and responsibilities of Air Traffic Services (ATS) personnel providing traditional services are likely to be very similar to today in that humans will still be responsible for majority of decision making. There is another NASA research effort beyond ICN is underway called Sky For All which is not covered in this article as it is in the planning stages.
autonomy↗
Cognitive Systems Modeling and Analysis of Command and Control Systems
Military operations, counter-terrorism operations and emergency response often oblige operators and commanders to operate within distributed organizations and systems for safe and effective mission accomplishment. Tactical commanders and operators frequently encounter violent threats and critical demands on cognitive capacity and reaction time. In the future they will make decisions in situations where operational and system characteristics are highly dynamic and non-linear, i.e. minor events, decisions or actions may have serious and irreversible consequences for the entire mission. Commanders and other decision makers must manage true real time properties at all levels; individual operators, stand-alone technical systems, higher-order integrated human-machine systems and joint operations forces alike. Coping with these conditions in performance assessment, system development and operational testing is a challenge for both practitioners and researchers. This paper reports on research from which the results led to a breakthrough: An integrated approach to information-centered systems analysis to support future command and control systems research development. This approach integrates several areas of research into a coherent framework, Action Control Theory (ACT). It comprises measurement techniques and methodological advances that facilitate a more accurate and deeper understanding of the operational environment, its agents, actors and effectors, generating new and updated models. This in turn generates theoretical advances. Some good examples of successful approaches are found in the research areas of cognitive systems engineering, systems theory, and psychophysiology, and in the fields of dynamic, distributed decision making and naturalistic decision making.
Norlander, Arne↗
Using Satellite Remote Sensing and Modelling for Insights into N02 Air Pollution and NO2 Emissions
Nitrogen oxides (NO(x)) are key actors in air quality and climate change. Satellite remote sensing of tropospheric NO2 has developed rapidly with enhanced spatial and temporal resolution since initial observations in 1995. We have developed an improved algorithm and retrieved tropospheric NO2 columns from Ozone Monitoring Instrument. Column observations of tropospheric NO2 from the nadir-viewing satellite sensors contain large contributions from the boundary layer due to strong enhancement of NO2 in the boundary layer. We infer ground-level NO2 concentrations from the OMI satellite instrument which demonstrate significant agreement with in-situ surface measurements. We examine how NO2 columns measured by satellite, ground-level NO2 derived from satellite, and NO(x) emissions obtained from bottom-up inventories relate to world's urban population. We perform inverse modeling analysis of NO2 measurements from OMI to estimate "top-down" surface NO(x) emissions, which are used to evaluate and improve "bottom-up" emission inventories. We use NO2 column observations from OMI and the relationship between NO2 columns and NO(x) emissions from a GEOS-Chem model simulation to estimate the annual change in bottom-up NO(x) emissions. The emission updates offer an improved estimate of NO(x) that are critical to our understanding of air quality, acid deposition, and climate change.
Lamsal, L. N.↗
Establishment of a Spaceport Network Architecture
Since the beginning of the space age, the main actors in space exploration have been governmental agencies, enabling a privileged access to space, but with very restricted and rare missions. The last decade has seen the rise of space tourism, and the founding of ambitious private space mining companies, showing the beginnings of a new exploration era, that is based on a more generalized and regular access to space and which is not limited to the Earth's vicinity. However, the cost of launching sufficient mass into orbit to sustain these inspiring challenges is prohibitive, and the necessary infrastructures to support these missions is still lacking. To provide easy and affordable access into orbital and deep space destinations, there is the need to create a network of spaceports via specific waypoint locations coupled with the use of natural resources, or In Situ Resource Utilization (ISRU), to provide a more economical solution. As part of the International Space University Space Studies Program 2012, the international and intercultural team of Operations and Service Infrastructure for Space (OASIS) proposes an interdisciplinary answer to the problem of economical space access and transportation. This paper presents a summary of a detailed report [1] of the different phases of a project for developing a network of spaceports throughout the Solar System in a timeframe of 50 years. The requirements, functions, critical technologies and mission architecture of this network of spaceports are outlined in a roadmap of the important steps and phases. The economic and financial aspects are emphasized in order to allow a sustainable development of the network in a public-private partnership via the formation of an International Spaceport Authority (ISPA). The approach includes engineering, scientific, financial, legal, policy, and societal aspects. Team OASIS intends to provide guidelines to make the development of space transportation via a spaceports logistics network feasible, and believes that this pioneering effort will revolutionize space exploration, science and commerce, ultimately contributing to permanently expand humanity into space.
Larson, Wiley J.↗
NASA Data Acquisition System Software Development for Rocket Propulsion Test Facilities
Current NASA propulsion test facilities include Stennis Space Center in Mississippi, Marshall Space Flight Center in Alabama, Plum Brook Station in Ohio, and White Sands Test Facility in New Mexico. Within and across these centers, a diverse set of data acquisition systems exist with different hardware and software platforms. The NASA Data Acquisition System (NDAS) is a software suite designed to operate and control many critical aspects of rocket engine testing. The software suite combines real-time data visualization, data recording to a variety formats, short-term and long-term acquisition system calibration capabilities, test stand configuration control, and a variety of data post-processing capabilities. Additionally, data stream conversion functions exist to translate test facility data streams to and from downstream systems, including engine customer systems. The primary design goals for NDAS are flexibility, extensibility, and modularity. Providing a common user interface for a variety of hardware platforms helps drive consistency and error reduction during testing. In addition, with an understanding that test facilities have different requirements and setups, the software is designed to be modular. One engine program may require real-time displays and data recording; others may require more complex data stream conversion, measurement filtering, or test stand configuration management. The NDAS suite allows test facilities to choose which components to use based on their specific needs. The NDAS code is primarily written in LabVIEW, a graphical, data-flow driven language. Although LabVIEW is a general-purpose programming language; large-scale software development in the language is relatively rare compared to more commonly used languages. The NDAS software suite also makes extensive use of a new, advanced development framework called the Actor Framework. The Actor Framework provides a level of code reuse and extensibility that has previously been difficult to achieve using LabVIEW. The
Herbert, Phillip W., Sr.↗