Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Deep Operator Networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

A Deep Learning Filter for the Intraseasonal Variability of the Tropics

Abstract This paper presents a novel application of convolutional neural network (CNN) models for filtering the intraseasonal variability of the tropical atmosphere. In this deep learning filter, two convolutional layers are applied sequentially in a supervised machine learning framework to extract the intraseasonal signal from the total daily anomalies. The CNN-based filter can be tailored for each field similarly to fast Fourier transform filtering methods. When applied to two different fields (zonal wind stress and outgoing longwave radiation), the index of agreement between the filtered signal obtained using the CNN-based filter and a conventional weight-based filter is between 95% and 99%. The advantage of the CNN-based filter over the conventional filters is its applicability to time series with the length comparable to the period of the signal being extracted. Significance Statement This study proposes a new method for discovering hidden connections in data representative of tropical atmosphere variability. The method makes use of an artificial intelligence (AI) algorithm that combines a mathematical operation known as convolution with a mathematical model built to reflect the behavior of the human brain known as artificial neural network. Our results show that the filtered data produced by the AI-based method are consistent with the results obtained using conventional mathematical algorithms. The advantage of the AI-based method is that it can be applied to cases for which the conventional methods have limitations, such as forecast (hindcast) data or real-time monitoring of tropical variability in the 20–100-day range.

Stan, Cristiana↗
DOE OSTI2024

Evaluating large scale aqueous organic redox flow battery performance with a hybrid numerical and machine learning framework

Aqueous organic redox flow battery (AORFB) is a promising cost-competitive technology for large-scale energy storage. Among existing work, the dihydroxyphenazine (DHP)-based AORFB has demonstrated high energy density and low-capacity degradation in 10 cm$^2$ cells during lab tests. However, its commercial-scale performance in more complex environments remains unknown, posing a barrier to commercialization. To address this gap, this work presents a comprehensive performance evaluation of a 780 cm$^2$ DHP-based AORFB by combining a physics-based numerical model, machine learning (ML)-based surrogate models, and ML-derived sensitivity quantification. Specifically, we first select 12 key battery parameters that include 10 physicochemical and 2 operation quantities, then select 6 performance metrics that include energy efficiency (EE), discharging capacity, charging energy, and power losses due to concentration, activation, and ohmic over-potentials. With such selection, 12800 combinations of the 12 parameters are subsequently generated using the Latin Hypercube Sampling method. Such combinations, together with 38 pre-defined State of Charge, are then integrated to a validated AORFB model developed in COMSOL to compute the performance metrics. With both input parameters and performance metrics, 60 deep neural network (DNN) surrogate models are then trained to approximate the relationship between the 10 physicochemical quantities and 6 performance metrics at each flow rate and current density. Sensitivity scores are then calculated based on the DNN models. Two additional sensitivity analysis tools, i.e., MARS, and SHAP, are also used to cross-validate the sensitivity scores from the DNN. The results demonstrate that 1) the standard potential ranks first in controlling EE and charging energy, 2) the membrane conductivity is most critical for power loss and EE, and 3) specific area and reaction rate control activation power loss.

25 ENERGY STORAGE↗
NASA NTRS1974

Deep space network support of the manned space flight network for Apollo, volume 3

The Deep Space Network (DSN) activities in support of Project Apollo during the period of 1971 and 1972 are reported. Beginning with the Apollo 14 mission and concluding with the Apollo 17 mission, the narrative includes, (1) a mission description, (2) the NASA support requirements placed on the DSN, and, (3) a comprehensive account of the support activities provided by each committed DSN deep space communication station. Associated equipment and activities of the three elements of the DSN (the Deep Space Instrumentation Facility (DSIF), the Space Flight Operations Facility (SFOF), and the Ground Communications Facility (GCF)) used in meeting the radio-metric and telemetry demands of the missions are documented.

Hartley, R. B.↗
NASA NTRS2012

Integrated RF/Optical Interplanetary Networking Preliminary Explorations and Empirical Results

Over the last decade interplanetary telecommunication capabilities have been significantly expanded--specifically in support of the Mars exploration rover and lander missions. NASA is continuing to drive advances in new, high payoff optical communications technologies to enhance the network to Gbps performance from Mars, and the transition from technology demonstration to operational system is examined through a hybrid RF/optical approach. Such a system combines the best features of RF and optical communications considering availability and performance to realize a dual band trunk line operating within characteristic constraints. Disconnection due to planetary obscuration and solar conjunction, link delays, timing, ground terminal mission congestion and scheduling policy along with space and atmospheric weather disruptions all imply the need for network protocol solutions to ultimately manage the physical layer in a transparent manner to the end user. Delay Tolerant Networking (DTN) is an approach under evaluation which addresses these challenges. A multi-hop multi-path hybrid RF and optical test bed has been constructed to emulate the integrated deep space network and to support protocol and hardware refinement. Initial experimental results characterize several of these challenges and evaluate the effectiveness of DTN as a solution to mitigate them.

Raible, Daniel E.↗
NASA NTRSDate not supplied

Exploring Lightning and Convective Processes Using the Ground-Radar Multiplatform Precipitation Feature Database

The Multiplatform Precipitation Feature (MPF) database synthesizes coincident spaceborne and ground-based lightning and radar data in a framework of storm-based features, fusing broader spaceborne detection capabilities with process-based, storm-level analysis practices. The MPF database was designed to extend the scale and scope of investigations into the complex connections between precipitation, updrafts, and lightning. The NASA International Space Station Lightning Imaging Sensor (ISS LIS) serves as the source of lightning information for the database. The first iteration of the MPF database leveraged the NASA Global Precipitation Measurement (GPM) mission spaceborne Dual-frequency Precipitation Radar (DPR) to define features, along with contributions of microphysics data and vertical wind retrievals from the GPM Validation Network (VN) of ground-based radar data. The dependency on coincident ISS and GPM satellite overpasses of radars in a dual-Doppler configuration significantly limited the size of the initial database of features, referred to as VNMPFs, but established the database infrastructure and feasibility. We present here a second iteration of the MPF database that omits the GPM DPR and VN, instead incorporating data directly from selected proximal installations of the operational Next Generation Radar (NEXRAD) network that facilitate vertical wind retrievals via dual-Doppler analysis. These features based exclusively on ground-based polarimetric Doppler radar are hereafter referred to as Ground-Radar MPFs (GRMPFs). Removing the restriction of a coincident GPM overpass appreciably increases the size of the GRMPF database while incorporating more detailed information from higher-resolution radar data and retrievals. This expansion allows for unprecedented broad, robust statistical analyses of the electrical, kinematic, and microphysical characteristics of deep convective processes. These results highlight the potential for advancements in lightning meteorology made possible by combining multiple perspectives from global lightning measurements and ground-based radar data.

Lightning↗
DOE OSTI2024

Techno-Economic Simulation Results Using dGeo for EGS-Based District Heating in the Northeastern United States

This dataset presents the results of techno-economic simulations performed using the Distributed Geothermal Market Demand Model (dGeo) to evaluate the feasibility of Enhanced Geothermal Systems (EGS)-based district heating in the Northeastern United States. Developed by the National Renewable Energy Laboratory (NREL), dGeo is a geospatially resolved, bottom-up modeling framework designed to explore the deployment potential of geothermal distributed energy resources. The dataset, created as part of the Cornell EGS Ground-Truthing Project, provides census tract-level data that includes inputs and outputs such as thermal demand, road length, energy prices, geothermal system sizing, annual energy contributions from geothermal and natural gas peaking boilers, system capital costs (CAPEX), operation and maintenance costs (OPEX), and the levelized cost of heat (LCOH). Key simulation parameters include geothermal gradients, measured well depths, production temperatures, and district heating piping lengths based on S1400 neighborhood road lengths. The simulations assume a target bottom hole temperature of 80C and the development of new district heating networks in each census tract.

15 GEOTHERMAL ENERGY↗
DOE OSTI2021

Stopping criteria for ending autonomous, single detector radiological source searches

While the localization of radiological sources has traditionally been handled with statistical algorithms, such a task can be augmented with advanced machine learning methodologies. The combination of deep and reinforcement learning has provided learning-based navigation to autonomous, single-detector, mobile systems. However, these approaches lacked the capacity to terminate a surveying/search task without outside influence of an operator or perfect knowledge of source location (defeating the purpose of such a system). Two stopping criteria are investigated in this work for a machine learning navigated system: one based upon Bayesian and maximum likelihood estimation (MLE) strategies commonly used in source localization, and a second providing the navigational machine learning network with a “stop search” action. A convolutional neural network was trained via reinforcement learning in a 10 m × 10 m simulated environment to navigate a randomly placed detector-agent to a randomly placed source of varied strength (stopping with perfect knowledge during training). The network agent could move in one of four directions (up, down, left, right) after taking a 1 s count measurement at the current location. During testing, the stopping criteria for this navigational algorithm was based upon a Bayesian likelihood estimation technique of source presence, updating this likelihood after each step, and terminating once the confidence of the source being in a single location exceeded 0.9. A second network was trained and tested with similar architecture as the previous but which contained a fifth action: for self-stopping. The accuracy and speed of localization with set detector and source initializations were compared over 50 trials of MLE-Bayesian approach and 1000 trials of the CNN with self-stopping. The statistical stopping condition yielded a median localization error of ~1.41 m and median localization speed of 12 steps. The machine learning stopping condition yielded a median localization error of 0 m and median localization speed of 17 steps. This work demonstrated two stopping criteria available to a machine learning guided, source localization system.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
NASA NTRS1992

The goldstone real-time connected element interferometer

Connected element interferometry (CEI) is a technique of observing a celestial radio source at two spatially separated antennas and then interfering the received signals to extract the relative phase of the signal at the two antennas. The high precision of the resulting phase delay data type can provide an accurate determination of the angular position of the radio source relative to the baseline vector between the two stations. This article describes a recently developed connected element interferometer on a 21-km baseline between two antennas at the Deep Space Network's Goldstone, California, tracking complex. Fiber-optic links are used to transmit the data to a common site for processing. The system incorporates a real-time correlator to process these data in real time. The architecture of the system is described, and observational data are presented to characterize the potential performance of such a system. The real-time processing capability offers potential advantages in terms of increased reliability and improved delivery of navigational data for time-critical operations. Angular accuracies of 50-100 nrad are achievable on this baseline.

Edwards, C., Jr.↗
NASA NTRS2011

Automated scheduling for NASA’s Deep Space Network

This paper describes the DSN Scheduling Engine (DSE) component of a new scheduling system being deployed for NASA’s Deep Space Network. The DSE provides core automation functionality for scheduling the network, including the interpretation of scheduling requirements expressed by users, their elaboration into tracking passes, and resolving conflicts and constraint violations. The DSE incorporates both systematic search and repair-based algorithms, used for different phases and purposes in the overall system. It has been integrated in with a web application which provides its functionality to all DSN users through a standard web browser. The system is in the process of deployment to operational status.

Tran, Daniel↗
NASA NTRS0202

Rest architecture for link analysis tools portal

A web portal is under development to improve overall services provided by NASA networks that support near-­‐Earth missions. These networks are managed by Space Communication and Navigation (SCaN) Program of NASA and include the following: Deep Space Network (DSN), Space Network (SN), and Near-­‐Earth Network (NEN). DSN is a network of antennas located in three longitudinally separated sites and supports interplanetary spacecraft missions, radio science, and radar astronomy observations. SN consists of a number of geostationary Tracking and Data Relay Satellites (TDRS) and associated ground stations. NEN consists of both NASA-­‐owned ground stations and those owned by international, commercial, and academic partners. This study investigates different web access techniques for mission users to use link analysis tools that aid in operating NASA networks. We developed a web portal prototype following principles of Representational state transfer (REST) architecture to leverage scalability, independent deployment of tools, and generic interfaces. In REST architectures, requests and responses between clients and servers are built around transferring representations of resources that can be addressed in memory. We demonstrate the feasibility of using REST architecture to facilitate web-­‐service transactions via web-­‐portal.

Lee, Carlyn-­‐Ann↗
NASA NTRS2017

Near Earth Network (NEN) CubeSat Communications

The NASA Near Earth Network (NEN) consists of globally distributed tracking stations, including NASA, commercial, and partner ground stations, that are strategically located to maximize the coverage provided to a variety of orbital and suborbital missions, including those in LEO (Low Earth Orbit), GEO (Geosynchronous Earth Orbit), HEO (Highly Elliptical Orbit), lunar and L1-L2 orbits. The NEN's future mission set includes and will continue to include CubeSat missions. The first NEN-supported CubeSat mission will be the Cubesat Proximity Operations Demonstration (CPOD) launching into LEO in 2017. The majority of the CubeSat missions destined to fly on EM-1, launching in late 2018, many in a lunar orbit, will communicate with ground-based stations via X-band and will utilize the NASA Jet Propulsion Laboratory (JPL)-developed IRIS (Satellite Communication for Air Traffic Management) radio. The NEN recognizes the important role CubeSats are beginning to play in carrying out NASAs mission and is therefore investigating the modifications needed to provide IRIS radio compatibility. With modification, the NEN could potentially expand support to the EM-1 (Exploration Mission-1) lunar CubeSats. The NEN could begin providing significant coverage to lunar CubeSat missions utilizing three to four of the NEN's mid-latitude sites. This coverage would supplement coverage provided by the JPL Deep Space Network (DSN). The NEN, with smaller apertures than DSN, provides the benefit of a larger beamwidth that could be beneficial in the event of uncertain ephemeris data. In order to realize these benefits the NEN would need to upgrade stations targeted based on coverage ability and current configuration ease of upgrade, to ensure compatibility with the IRIS radio. In addition, the NEN is working with CubeSat radio developers to ensure NEN compatibility with alternative CubeSat radios for Lunar and L1-L2 CubeSats. The NEN has provided NEN compatibility requirements to several radio developers who are developing radios that offer lower cost and, in some cases, more capabilities with fewer constraints. The NEN is ready to begin supporting CubeSat missions. The NEN is considering network upgrades to broaden the types of CubeSat missions that can be supported and is supporting both the CubeSat community and radio developers to ensure future CubeSat missions have multiple options when choosing a network for their communications support.

CubeSat↗
DOE OSTI2022

A Length Adaptive Algorithm-Hardware Co-design of Transformer on FPGA Through Sparse Attention and Dynamic Pipelining

Transformers are considered one of the most important deep learning models since 2018, in part because it establishes state-of-the-art (SOTA) records and could potentially replace existing Deep Neural Networks (DNNs). Despite the remarkable triumphs, the prolonged turnaround time of Transformer models is a widely recognized roadblock. The variety of sequence lengths imposes additional computing overhead where inputs need to be zero-padded to the maximum sentence length in the batch to accommodate the parallel computing platforms. This paper targets the field-programmable gate array (FPGA) and proposes a coherent sequence length adaptive algorithm–hardware co-design for Transformer acceleration. Particularly, we develop a hardware-friendly sparse attention operator and a length-aware hardware resource scheduling algorithm. The proposed sparse attention operator brings the complexity of attention-based models down to linear complexity and alleviates the off-chip memory traffic. The proposed length-aware resource hardware scheduling algorithm dynamically allocates the hardware resources to fill up the pipeline slots and eliminates bubbles for NLP tasks. Experiments show that our design has very small accuracy loss and has 80.2 × and 2.6 × speedup compared to CPU and GPU implementation, and 4 × higher energy efficiency than state-of-the-art GPU accelerator optimized via CUBLAS GEMM.

Peng, Hongwu↗
NASA NTRS2005

Clocks and timing in the NASA Deep Space Network

A new timing system has been developed for the NASA Deep Space Network (DSN) and is currently in the final stages of integration, testing and implementation in all three DSN sites. The DSN is a distributed antenna network for deep space communication, whose facilities are continuously engaged in spacecraft tracking, Very Long Baseline Interferometry (VLBI) or Radio Astronomy activities. Its primary components consist of three Deep Space Communication Centers (DSCC) separated nearly equidistant around the Earth in California, USA; Spain; and Australia. Within each DSCC, synchronized, low jitter timing signals must be distributed to many users over distances of up to 30 kilometers. The design criteria for the timing system required state of the art stability and jitter performance, but also extremely high operability and reliability. This paper describes some of the key features and recent system performance data as measured both in the laboratory and the operational DSN.

clocks↗
NASA NTRS2009

DSN Data Visualization Suite

The DSN Data Visualization Suite is a set of computer programs and reusable Application Programming Interfaces (APIs) that assist in the visualization and analysis of Deep Space Network (DSN) spacecraft-tracking data, which can include predicted and actual values of downlink frequencies, uplink frequencies, and antenna-pointing angles in various formats that can include tables of values and polynomial coefficients. The data can also include lists of antenna-pointing events, lists of antenna- limit events, and schedules of tracking activities. To date, analysis and correlation of these intricately related data before and after tracking have been difficult and time-consuming. The DSN Data Visualization Suite enables operators to quickly diagnose tracking-data problems before, during, and after tracking. The Suite provides interpolation on demand and plotting of DSN tracking data, correlation of all data on a given temporal point, and display of data with color coding configurable by users. The suite thereby enables rapid analysis of the data prior to transmission of the data to DSN control centers. At the control centers, the same suite enables operators to validate the data before committing the data to DSN subsystems. This software is also Web-enabled to afford its capabilities to international space agencies.

Bui, Bach X.↗
DOE OSTI2022

Predicting Solar Energetic Particles Using SDO/HMI Vector Magnetic Data Products and a Bidirectional LSTM Network

Solar energetic particles (SEPs) are an essential source of space radiation, and are hazardous for humans in space, spacecraft, and technology in general. In this paper, we propose a deep-learning method, specifically a bidirectional long short-term memory (biLSTM) network, to predict if an active region (AR) would produce an SEP event given that (i) the AR will produce an M- or X-class flare and a coronal mass ejection (CME) associated with the flare, or (ii) the AR will produce an M- or X-class flare regardless of whether or not the flare is associated with a CME. The data samples used in this study are collected from the Geostationary Operational Environmental Satellite's X-ray flare catalogs provided by the National Centers for Environmental Information. We select M- and X-class flares with identified ARs in the catalogs for the period between 2010 and 2021, and find the associations of flares, CMEs, and SEPs in the Space Weather Database of Notifications, Knowledge, Information during the same period. Each data sample contains physical parameters collected from the Helioseismic and Magnetic Imager on board the Solar Dynamics Observatory. Experimental results based on different performance metrics demonstrate that the proposed biLSTM network is better than related machine-learning algorithms for the two SEP prediction tasks studied here. We also discuss extensions of our approach for probabilistic forecasting and calibration with empirical evaluation

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1993

New approaches for tracking earth orbiters using modified GPS ground receivers

A Global Positioning System (GPS) flight receiver provides a means to precisely determine orbits for satellites in low to moderate altitude orbits. Above a 5000-km altitude, however, relatively few GPS satellites are visible. New approaches to orbit determination for satellites at higher altitudes could reduce DSN antenna time needed to provide navigation and orbit determination support to future missions. Modification of GPS ground receivers enables a beacon from the orbiter to be tracked simultaneously with GPS data. The orbit accuracy expected from this GPS-like tracking (GLT) technique is expected to be in the range of a few meters or better for altitudes up to 100,000 km with a global ground network. For geosynchronous satellites, however, there are unique challenges due to geometrical limitations and to the lack of strong dynamical signature in tracking data. We examine two approaches for tracking the Tracking and Data Relay Satellite System (TDRSS) geostationary orbiters. One uses GLT with a global network; the other relies on a small 'connected element' ground network with a distributed clock for short-baseline differential carrier phase (SB Delta Phi). We describe an experiment planned for late 1993, which will combine aspects of both GLT and SB Delta Phi, to demonstrate a new approach for tracking the Tracking and Data Relay Satellites (TDRSs) that offers a number of operationally convenient and attractive features. The TDRS demonstration will be in effect a proof-of-concept experiment for a new approach to tracking spacecraft which could be applied more generally to deep-space as well as near-Earth regimes.

Lichten, S. M.↗
NASA NTRS2021

Time series comparisons in Deep Space Network

The Deep Space Network (DSN) is NASA’s international array of antennas that support interplanetary spacecraft missions. DSN provides radar and radio astronomy observations that enhance our understanding of the solar system and the larger universe. A track is a block of continuous multi-dimensional time series from the beginning to end of DSN communication with the target spacecraft, containing 129 monitor data items lasting several hours at a frequency of 0.2-1Hz. Monitor data on each track reports on the performance of specific spacecraft operations and the DSN itself. DSN is receiving signals from 32 spacecraft across the solar system. DSN has pressure to reduce costs while maintaining the quality of support for DSN mission users. DSN operators need to simultaneously monitor multiple tracks and identify anomalies in real time. DSN has seen that as the number of missions increases, the data that needs to be processed increases over time. In this project, we look at the last 8 years of data for analysis. Any anomaly in the track indicates a problem with either the spacecraft, DSN equipment, or weather conditions. DSN operators typically write “discrepancy reports” for further analysis. It is recognized that it would be quite helpful to identify 10 similar historical tracks out of the huge database to quickly find/match anomalies. This tool has three functions: (1) identification of the top 10 similar historical tracks, (2) detection of anomalies compared to the reference normal track, and (3) comparison of statistical differences between two given tracks. The requirements for these features were confirmed by survey responses from 21 DSN operators and engineers. The preliminary machine learning model has shown promising performance (AUC=0.92). We plan to increase the number of data sets and perform additional testing to improve performance further before its planned integration into the Track Visualizer to assist DSN field operators and engineers.

Rebbapragada, Umaa↗
DOE OSTI2025

Identifying environmentally induced calibration changes in cryogenic RF axion detector systems using deep neural networks

The axion is a compelling hypothetical particle that could account for the dark matter in our universe while simultaneously solving the strong CP problem in quantum chromodynamics. The most sensitive axion detection technique demonstrated so far makes use of a high Q cavity immersed in a strong magnetic field, where axions are converted to microwave photons. This is called an axion haloscope and has primarily targeted the 1–10 GHz range. As searches scan up in axion mass, toward the parameter space favored by theoretical predictions, individual cavity sizes decrease in order to achieve higher frequencies. This shrinking cavity volume translates directly to a loss in signal-to-noise, motivating the plan to replace individual cavity detectors with arrays of cavities. When the transition from one to (N) multiple cavities occurs, haloscope searches are anticipated to become much more complicated to operate, requiring N times as many measurements but also the new requirement that N detectors operate in unison, which can be achieved by locking them to a common frequency. To offset this anticipated increase in detector complexity, we aim to develop new tools for diagnosing experiments using neural networks. Current experiments monitor scattering parameters of their receiver for periodically measuring cavity quality factor and coupling. However, off-resonant data remain relatively useless. In this paper, we ask if it is possible that off-resonant information contained in vector network analyzer scans could be used to diagnose equipment failures/anomalies and measure physical conditions (e.g., temperatures and ambient magnetic field). We demonstrate a proof-of-concept that AI techniques can help manage the complexity of an axion haloscope search for operators.

Engel, Andrew W. [Pacific Northwest National Labor↗