Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Low latency”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Low-Latency Science Exploration of Planetary Bodies: How ISS Might Be Used as Part of a Low-Latency Analog Campaign for Human Exploration

We suggest that the International Space Station be used to examine the application and validation of low-latency telepresence for surface exploration from space as an alternative, precursor, or potentially as an adjunct to astronaut "boots on the ground." To this end, controlled experiments that build upon and complement ground-based analog field studies will be critical for assessing the effects of different latencies (0 to 500 milliseconds), task complexity, and alternate forms of feedback to the operator. These experiments serve as an example of a pathfinder for NASA's roadmap of missions to Mars with low-latency telerobotic exploration as a precursor to astronaut's landing on the surface to conduct geological tasks.

robotic space exploration↗

Simulation Based Studies of Low Latency Teleoperations for NASA Exploration Missions

Human exploration of Mars will involve both crewed and robotic systems. Many mission concepts involve the deployment and assembly of mission support assets prior to crew arrival on the surface. Some of these deployment and assembly activities will be performed autonomously while others will be performed using teleoperations. However, significant communications latencies between the Earth and Mars make teleoperations challenging. Alternatively, low latency teleoperations are possible from locations in Mars orbit like Mars' moons Phobos and Deimos. To explore these latency opportunities, NASA is conducting a series of studies to investigate the effects of latency on telerobotic deployment and assembly activities. These studies are being conducted in laboratory environments at NASA's Johnson Space Center (JSC), the Human Exploration Research Analog (HERA) at JSC and the NASA Extreme Environment Mission Operations (NEEMO) underwater habitat off the coast of Florida. The studies involve two human-in-the-loop interactive simulations developed by the NASA Exploration Systems Simulations (NExSyS) team at JSC. The first simulation investigates manipulation related activities while the second simulation investigates mobility related activities. The first simulation provides a simple real-time operator interface with displays and controls for a simulated 6 degree of freedom end effector. The initial version of the simulation uses a simple control mode to decouple the robotic kinematic constraints and a communications delay to model latency effects. This provides the basis for early testing with more detailed manipulation simulations planned for the future. Subjects are tested using five operating latencies that represent teleoperation conditions from local surface operations to orbital operations at Phobos, Deimos and ultimately high Martian orbit. Subject performance is measured and correlated with three distance-to-target zones of interest. Each zone represents a target distance ranging from beyond 10m in Zone 1, through 1 cm to contact in Zone 5 with a step size factor of 10. Collected data consists of both objective simulation data (time, distance, hand controller inputs, velocity) and subjective questionnaire data. The second simulation provides a simple real-time operator interface with displays and control of a simulated surface rover. The rover traverses a synthetic Mars-like terrain and must be maneuvered to avoid obstacles while progressing to its destination. Like the manipulator simulation, subjects are tested using five operating latencies that represent teleoperation conditions from local surface operations to orbital operations at Phobos, Deimos and ultimately high Martian orbit. The rover is also operated at three different traverse speeds to assess the correlation between latency and speed. Collected data consisted of both objective simulation data (time, distance, hand controller inputs, braking) and subjective questionnaire data. These studies are exploring relationships between task complexity, operating speeds, operator efficiencies, and communications latencies for low latency teleoperations in support of human planetary exploration. This paper presents early results from these studies along with the current observations and conclusions. These and planned future studies will help to inform NASA on the potential for low latency teleoperations to support human exploration of Mars and inform the design of robotic systems and exploration missions.

Gernhardt, Michael L.↗

Outcomes of a NASA Workshop to Develop a Portfolio of Low Latency Datasets for Time-Sensitive Applications

It is widely accepted that time-sensitive remote sensing data serve the needs of decision makers in the applications communities and yet to date, a comprehensive portfolio of NASA low latency datasets has not been available. This paper will describe the NASA low latency, or Near-Real Time (NRT), portfolio, how it was developed and plans to make it available online through a portal that leverages the existing EOSDIS capabilities such as the Earthdata Search Client (https:search.earthdata.nasa.gov), the Common Metadata Repository (CMR) and the Global Imagery Browse Service (GIBS). This paper will report on the outcomes of a NASA Workshop to Develop a Portfolio of Low Latency Datasets for Time-Sensitive Applications (27-29 September 2016 at NASA Langley Research Center, Hampton VA). The paper will also summarize findings and recommendations from the meeting outlining perceived shortfalls and opportunities for low latency research and application science.

remote sensing↗

Low-Latency Teleoperations for Human Exploration and Evolvable Mars Campaign

NASA has been analyzing a number of mission concepts and activities that involve low-latency telerobotic (LLT) operations. One mission concept that will be covered in this presentation is Crew-Assisted Sample Return which involves the crew acquiring samples (1) that have already been delivered to space, and or acquiring samples via LLT from orbit to a planetary surface and then launching the samples to space to be captured in space and then returned to the earth with the crew. Both versions of have key roles for low-latency teleoperations. More broadly, the NASA Evolvable Mars Campaign is exploring a number of other activities that involve LLT, such as: (a) human asteroid missions, (b) PhobosDeimos missions, (c) Mars human landing site reconnaissance and site preparation, and (d) Mars sample handling and analysis. Many of these activities could be conducted from Mars orbit and also with the crew on the Mars surface remotely operating assets elsewhere on the surface, e.g. for exploring Mars special regions and or teleoperating a sample analysis laboratory both of which may help address planetary protection concerns. The operational and technology implications of low-latency teleoperations will be explored, including discussion of relevant items in the NASA Technology Roadmap and also how previously deployed robotic assets from any source could subsequently be used by astronauts via LLT.

crew autonomy↗

HyspIRI Low Latency Concept and Benchmarks

Topics include HyspIRI low latency data ops concept, HyspIRI data flow, ongoing efforts, experiment with Web Coverage Processing Service (WCPS) approach to injecting new algorithms into SensorWeb, low fidelity HyspIRI IPM testbed, compute cloud testbed, open cloud testbed environment, Global Lambda Integrated Facility (GLIF) and OCC collaboration with Starlight, delay tolerant network (DTN) protocol benchmarking, and EO-1 configuration for preliminary DTN prototype.

Mandl, Dan↗

Low-Latency Teleoperations: Operational Implications for Human Space Exploration

Low-latency teleoperations (LLT) is envisioned to be an element of human exploration missions in a number of different applications. LLT can be broadly considered to encompass any remote operation of an asset with a communication delay that is less than the human response time to allow for what is effectively "real-time" or "near real-time" operations. This paper will explore motivations and operational implications for why and how LLT might be used for human exploration space missions. LLT analyses have been performed under the auspices of the NASA Human Spaceflight Architecture Team (HAT) and Evolvable Mars Campaign (EMC). The EMC created a flexible, evolvable, capability-driven architectural strategy to enable a sustainable long-term human presence at Mars. LLT is envisioned to be part of that strategy for both in-space and on-surface applications, and this paper will expand on operational considerations within that broader strategic context, as well additional contexts. Some operational implications explored in this paper, derived largely from previous work, are: (1) crew mission support, for which we will address roles for Mission Control on earth, balanced with the capability for crew and robotic assets to operate independently, (2) science operations, with a focus on "backroom" support, highly dynamic science, and enhanced science return and efficiency, and (3) operational efficiency at a deep-space destination such as Mars, including implications for communications infrastructures and how to leverage and balance system autonomy with crew operations, both of which can inform the overall operational "choreography" between crew members, multiple shifts, and exploration assets.

human spaceflight↗

The Impact and Usage of Near Real-Time and Low Latency Solutions from the Satellite Needs Working Group

The Satellite Needs Working Group (SNWG) is an interagency effort of the U.S. Government to identify the Earth observation gaps and data needs across civilian U.S. federal agencies. Within short time frames of 2 to 5 years, on behalf of SNWG, NASA formulates and implements a range of remote sensing-based solutions that benefit the entire Earth Science community and society at large. More than 20 such solutions are underway, with several addressing needs for near real-time and low latency information as a result of priorities identified in the survey. In this talk, we will present and discuss the impact and usage of such solutions, including ICESat-2 Atlas products (data delivered within 72 hours instead of the standard 45-day latency for ATLAS science products), near real-time air quality TEMPO products derived from the recently launched TEMPO mission (these products include SO 2 , NO 2 , HCHO, O 2 -O 2 cloud cover, and aerosols with a planned latency of one hour), and low latency Harmonized Landsat-Sentinel-2 (HLS) data (HLS data with a latency of 6 hours). We will talk about how these solutions are being co-designed by federal agencies to maximize their impact and usage by the scientific community. Finally, we will also invite additional stakeholders and users to get involved in the formulation, implementation, and operationalization of these solutions.

Pontus Olofsson↗

Low-latency Science Exploration of Planetary Bodies: a Demonstration Using ISS in Support of Mars Human Exploration

We summarize a proposed experiment to use the International Space Station to formally examine the application and validation of low-latency telepresence for surface exploration from space as an alternative, precursor, or potentially as an adjunct to astronaut "boots on the ground." The approach is to develop and propose controlled experiments, which build upon previous field studies and which will assess the effects of different latencies (0 to 500 msec), task complexity, and alternate forms of feedback to the operator. These experiments serve as an example of a pathfinder for NASA's roadmap of missions to Mars with low-latency telerobotic exploration as a precursor to astronaut's landing on the surface to conduct geological tasks.

ISS in Support↗

Low-latency digital frequency synthesizer using the residue number system

A low-latency frequency synthesizer using the Direct Digital Synthesis (DDS) technique has been designed. Called the Residue Assisted Frequency Synthesizer (RAFS), it exhibits frequency switching times which are reduced by more than 50 percent below previously published designs. The switching speed advantage is made possible by the use of the Residue Number System, which allows the pipeline lengths in the Phase Accumulator and other circuitry to be reduced significantly.

Chren, William A., Jr.↗

Mars Surface Operations via Low-Latency Telerobotics from Phobos

To help assess the feasibility and timing of Low-Latency Telerobotics (LLT) operations on Mars via a Phobos telecommand base, operations concepts (ops cons) and timelines for several representative sequences for Mars surface operations have been developed. A summary of these LLT sequences and timelines will be presented, along with associated assumptions, operational considerations, and challenges.

telerobotics↗

Towards Fully Secure 5G Ultra-Low Latency Communications: A Cost-Security Functions Analysis

Future components to enhance the basic, native security of 5G networks are either complex mechanisms whose impact in the requiring 5G communications are not considered, or lightweight solutions adapted to ultra-reliable low-latency communications (URLLC) but whose security properties remain under discussion. Although different 5G network slices may have different requirements, in general, both visions seem to fall short at provisioning secure URLLC in the future. In this work we address this challenge, by introducing cost-security functions as a method to evaluate the performance and adequacy of most developed and employed non-native enhanced security mechanisms in 5G networks. We categorize those new security components into different groups according to their purpose and deployment scope. We propose to analyze them in the context of existing 5G architectures using two different approaches. First, using model checking techniques, we will evaluate the probability of an attacker to be successful against each security solution. Second, using analytical models, we will analyze the impact of these security mechanisms in terms of delay, throughput consumption, and reliability. Finally, we will combine both approaches using stochastic cost-security functions and the PRISM model checker to create a global picture. Our results are first evidence of how a 5G network that covers and strengthened all security areas through enhanced, dedicated non-native mechanisms could only guarantee secure URLLC with a probability of ~55%.

5G networks↗

A low-latency graph computer to identify metastable particles at the Large Hadron Collider for real-time analysis of potential dark matter signatures

Abstract Image recognition is a pervasive task in many information-processing environments. We present a solution to a difficult pattern recognition problem that lies at the heart of experimental particle physics. Future experiments with very high-intensity beams will produce a spray of thousands of particles in each beam-target or beam-beam collision. Recognizing the trajectories of these particles as they traverse layers of electronic sensors is a massive image recognition task that has never been accomplished in real time. We present a real-time processing solution that is implemented in a commercial field-programmable gate array using high-level synthesis. It is an unsupervised learning algorithm that uses techniques of graph computing. A prime application is the low-latency analysis of dark-matter signatures involving metastable charged particles that manifest as disappearing tracks.

47 OTHER INSTRUMENTATION↗

(ODIN): An Open Source, Low-Latency Data Integration & Visualization Framework for the NASA System Wide Safety Project's Disaster Response Safety Demonstration Series

The Open Data Integration Framework (ODIN) is an open source, low latency data integration and visualization framework (https://github.com/NASARace/race-odin) developed under NASA’s System WideSafety Program to demonstrate new safety capabilities designed to improve US airspace operations. Safety demonstrations are a set of increasingly complex (from public safety perspective) disaster response scenarios under which air systems must operate with increased capacity and include: 1) Wildland fire response, 2) Hurricane relief and recovery, 4) Emergency medical delivery via UAS and 4) Urban disaster relief. To accommodate disaster response, ODIN is field deployable and can scale on one or more multi-core, commodity laptops operating with full to limited or intermittent internet connectivity, conditions likely encountered during operations. ODIN runs as webserver with local, persistent data storage to serve either public or a secured, ad hoc network (e.g., an incident command post). The current released ODIN, ODIN-Fire is tailored for wildland fire management incorporating information on satellite overpasses with links to the near real-time data and imagery from the respective agencies. Included are winds data, an important variable for emergency responders and airspace operations, and high-resolution wind forecasts generated by super-computing resources and ingested into ODIN. As an open-source project, ODIN has attracted interest from multiple entities. We will show how 1) a commercial field instrument and data provider uses ODIN to help users visualize, publish and integrate their in-situ sensor network data and 2) ODIN’s capabilities to ingest, integrate and display near-real time satellite data with air traffic and a USFS winds forecast model used in fire response and post-fire assessment. Within NASA ODIN demonstrated novel, near terminal airspace safety capabilities for a project close-out event and previously it monitored the national airspace in real-time to meet an agency milestone. ODIN is presently under development for the anticipated hurricane relief and response demonstration notionally scheduled for the 2025-27 time frame and is available from NASA's github at the above link.

Aeronautics↗

Low Latency Flux and Concentration Datasets in Support of Greenhouse Gas Monitoring Based on NASA's GEOS Modeling and Data Assimilation System

We present efforts to develop space-based greenhouse gas monitoring systems that can provide low latency information and traceability to independent observations. Through support from its Carbon Monitoring System program, NASA has developed the capability to assimilate XCO2 retrievals from the Orbiting Carbon Observatory, 2 (OCO-2) into the Goddard Earth Observing System (GEOS) Constituent Data Assimilation System (CoDAS) to create gap-filled, three-dimensional (3D) estimates of CO2 mixing ratio. When OCO-2 data are not available, concentration fields are further informed by a bottom-up flux package based on remotely sensed fire radiative power, nighttime lights, and vegetation reflectance combined with estimates of atmospheric growth rate based on surface in situ data. The 3D nature of this dataset supports evaluation with independent aircraft data, helping to ensure transparency of remotely sensed data products. These quasi-operational data are currently produced 2-3 months behind real time and are distributed via NASA and international dashboard services to a variety of end users. In this presentation, we provide an overview of the system as well as remaining data gaps and modeling challenges. We also highlight the application of this dataset for detecting emissions anomalies associated with COVID-19 and comparing against independent emissions estimates. Finally, we highlight a new NASA initiative called the Earth Information System (EIS), which aims to support open science and applications by leveraging emerging cloud computing capabilities to increase access to NASA’s greenhouse gas datasets, opportunities for co-development, and transparency in methods for analysis and flux attribution.

Lesley Ott↗

Ultra-low latency recurrent neural network inference on FPGAs for physics applications with hls4ml

Abstract Recurrent neural networks have been shown to be effective architectures for many tasks in high energy physics, and thus have been widely adopted. Their use in low-latency environments has, however, been limited as a result of the difficulties of implementing recurrent architectures on field-programmable gate arrays (FPGAs). In this paper we present an implementation of two types of recurrent neural network layers—long short-term memory and gated recurrent unit—within the hls4ml framework. We demonstrate that our implementation is capable of producing effective designs for both small and large models, and can be customized to meet specific design requirements for inference latencies and FPGA resources. We show the performance and synthesized designs for multiple neural networks, many of which are trained specifically for jet identification tasks at the CERN Large Hadron Collider.

97 MATHEMATICS AND COMPUTING↗

Low-latency Jet Tagging for HL-LHC Using Transformer Architectures

Transformers are the state-of-the-art model architectures and widely used in application areas of machine learning. However the performance of such architectures is less well explored in the ultra-low latency domains where deployment on FPGAs or ASICs is required. Such domains include the trigger and data acquisition systems of the LHC experiments. We present a transformer-based algorithm for jet tagging built with the HGQ2 framework, which is able to produce a model with heterogeneous bitwidths for fast inference on FPGAs, as required in the trigger systems at the LHC experiments. The bitwidths are acquired during training by minimizing the total bit operations as an additional parameter. By allowing a bitwidth of zero, the model is pruned in-situ during training. Using this quantization-aware approach, our algorithm achieves state-of-the-art performance while also retaining permutation invariance which is a key property for particle physics applications. Due to the strength of transformers in representation learning, our work also serves as a stepping stone for the development of a larger foundation model for trigger applications.

Laatu, Lauri [Imperial Coll., London]↗

Low-Latency Telerobotics from Mars Orbit: The Case for Synergy Between Science and Human Exploration

Initial, science-directed human exploration of Mars will benefit from capabilities in which human explorers remain in orbit to control telerobotic systems on the surface (Figure 1). Low-latency, high-bandwidth telerobotics (LLT) from Mars orbit offers opportunities for what the terrestrial robotics community considers to be high-quality telepresence. Such telepresence would provide high quality sensory perception and situation awareness, and even capabilities for dexterous manipulation as required for adaptive, informed selection of scientific samples [1]. Astronauts on orbit in close communication proximity to a surface exploration site (in order to minimize communication latency) represent a capability that would extend human cognition to Mars (and potentially for other bodies such as asteroids, Venus, the Moon, etc.) without the challenges, expense, and risk of putting those humans on hazardous surfaces or within deep gravity wells. Such a strategy may be consistent with goals for a human space flight program that, are currently being developed within NASA.

Valinia, A.↗

Low-Latency Lunar Surface Telerobotics from Earth-Moon Libration Points

Concepts for a long-duration habitat at Earth-Moon LI or L2 have been advanced for a number of purposes. We propose here that such a facility could also have an important role for low-latency telerobotic control of lunar surface equipment, both for lunar science and development. With distances of about 60,000 km from the lunar surface, such sites offer light-time limited two-way control latencies of order 400 ms, making telerobotic control for those sites close to real time as perceived by a human operator. We point out that even for transcontinental teleoperated surgical procedures, which require operational precision and highly dexterous manipulation, control latencies of this order are considered adequate. Terrestrial telerobots that are used routinely for mining and manufacturing also involve control latencies of order several hundred milliseconds. For this reason, an Earth-Moon LI or L2 control node could build on the technology and experience base of commercially proven terrestrial ventures. A lunar libration-point telerobotic node could demonstrate exploration strategies that would eventually be used on Mars, and many other less hospitable destinations in the solar system. Libration-point telepresence for the Moon contrasts with lunar telerobotic control from the Earth, for which two-way control latencies are at least six times longer. For control latencies that long, telerobotic control efforts are of the "move-and-wait" variety, which is cognitively inferior to near real-time control.

Lester, Daniel↗