Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Deep Operator Networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Exact block encoding of imaginary time evolution with universal quantum neural networks

We develop a constructive approach to generate quantum neural networks capable of representing the exact thermal states of all many-body qubit Hamiltonians. The Trotter expansion of the imaginary time propagator is implemented through an exact block encoding by means of a unitary, restricted Boltzmann machine architecture. Marginalization over the hidden-layer neurons (auxiliary qubits) creates the nonunitary action on the visible layer. Then, we introduce a unitary deep Boltzmann machine architecture in which the hidden-layer qubits are allowed to couple laterally to other hidden qubits. We prove that this wave-function is closed under the action of the imaginary time propagator and, more generally, can represent the action of a universal set of quantum gate operations. We provide analytic expressions for the coefficients for both architectures, thus enabling exact network representations of thermal states without stochastic optimization of the network parameters. In the limit of large imaginary time, the yields the ground state of the system. The number of qubits grows linearly with the number of interactions and total imaginary time for a fixed interaction order. Both networks can be readily implemented on quantum hardware via midcircuit measurements of auxiliary qubits. If only one auxiliary qubit is measured and reset, the circuit depth scales linearly with imaginary time and number of interactions, while the width is constant. Alternatively, one can employ a number of auxiliary qubits linearly proportional to the number of interactions, and circuit depth grows linearly with imaginary time only. Every midcircuit measurement has a postselection success probability, and the overall success probability is equal to the product of the probabilities of the midcircuit measurements.

97 MATHEMATICS AND COMPUTING↗

Neural-based time series forecasting of loss of coolant accidents in nuclear power plants

During the last few years, deep learning in neural networks has demonstrated impressive successes in the areas of computer vision, speech and image recognition, text generation, and many others. However, sensitive engineering areas such as nuclear engineering benefited less from these efficient techniques. In this work, deep learning expert systems are utilized to model and predict time series progression of a design-basis nuclear accident, featuring a loss of coolant accident. Two major findings are accomplished in this work. First, the ability to train expert systems with high accuracy, which could help nuclear power plant operators to figure out plant responses during the accident. Second, building fast, efficient, and accurate deep models to simulate nuclear phenomena, which could be valuable to nuclear computational science. In this work, large amount of time series data is obtained from simulation tools by simulating different conditions of the base-case/nominal accident scenario. Four critical outputs/responses are monitored during the accident (e.g. temperature, pressure, break flow rate, water level). Two approaches are adopted in this work. The first approach is to use feedforward deep neural networks (DNN) to fit all time steps and outputs in a single model. The second approach is to use long short-term memory (LSTM) to fit all time steps together for each reactor response separately. Both DNN and LSTM demonstrate very good performance in predicting the test and base-case scenarios, with accuracy as low as 92% and as high as 99%, where these test scenarios are unknown to the expert systems and are not included in the model training. In addition, both approaches demonstrate a significant reduction in computational costs, as the deep expert system is able to accurately predict the accident 100,000 times faster than the original simulation tool. Given sufficient data, the methodology adopted in this study demonstrates that DNN/LSTM expert systems can be used as a decision support system to model advanced time series phenomena within nuclear power plants with high accuracy and negligible computational costs.

42 ENGINEERING↗

Block 1, phase 1 very long baseline interferometry implementation

The Block 1, phase 1 VBLI System, implemented in the Deep Space Network and currently undergoing system testing, is discussed. The system can be characterized as the modification of existing equipment and the addition of new software in the 64 m subnet and the addition of new hardware and software in the Network Operations and Control Center. It is to be operational to support Voyager project navigation requirements and is to provide, on a weekly basis, the information related to station clock synchronization, UT1, and polar motion.

Wilcher, J. H.↗

FLEET: Flexible Efficient Ensemble Training for Heterogeneous Deep Neural Networks

Parallel training of an ensemble of Deep Neural Networks (DNN) on a cluster of nodes is an effective approach to shorten the process of neural network architecture search and hyper-parameter tuning for a given learning task. Prior efforts have shown that data sharing, where the common preprocessing operation is shared across the DNN training pipelines, saves computational resources and improves pipeline efficiency. Data sharing strategy, however, performs poorly for a heterogeneous set of DNNs where each DNN has varying computational needs and thus different training rate and convergence speed. This paper proposes FLEET, a flexible ensemble DNN training framework for efficiently training a heterogeneous set of DNNs. We build FLEET via several technical innovations. We theoretically prove that an optimal resource allocation is NP-hard and propose a greedy algorithm to efficiently allocate resources for training each DNN with data sharing. We integrate data-parallel DNN training into ensemble training to mitigate the differences in training rates and introduce checkpointing into this context to address the issue of different convergence speeds. Experiments show that FLEET significantly improves the training efficiency of DNN ensembles without compromising the quality of the result.

Guan, Hui↗

DownScaleBench for developing and applying a deep learning based urban climate downscaling- first results for high-resolution urban precipitation climatology over Austin, Texas

Abstract Cities need climate information to develop resilient infrastructure and for adaptation decisions. The information desired is at the order of magnitudes finer scales relative to what is typically available from climate analysis and future projections. Urban downscaling refers to developing such climate information at the city (order of 1 – 10 km) and neighborhood (order of 0.1 – 1 km) resolutions from coarser climate products. Developing these higher resolution (finer grid spacing) data needed for assessments typically covering multiyear climatology of past data and future projections is complex and computationally expensive for traditional physics-based dynamical models. In this study, we develop and adopt a novel approach for urban downscaling by generating a general-purpose operator using deep learning. This ‘DownScaleBench’ tool can aid the process of downscaling to any location. The DownScaleBench has been generalized for both in situ (ground- based) and satellite or reanalysis gridded data. The algorithm employs an iterative super-resolution convolutional neural network (Iterative SRCNN) over the city. We apply this for the development of a high-resolution gridded precipitation product (300 m) from a relatively coarse (10 km) satellite-based product (JAXA GsMAP). The high-resolution gridded precipitation datasets is compared against insitu observations for past heavy rain events over Austin, Texas, and shows marked improvement relative to the coarser datasets relative to cubic interpolation as a baseline. The creation of this Downscaling Bench has implications for generating high-resolution gridded urban meteorological datasets and aiding the planning process for climate-ready cities.

Singh, Manmeet (ORCID:0000000233747149)↗

Learning macroscopic internal variables and history dependence from microscopic models

This paper concerns the study of history dependent phenomena in heterogeneous materials in a two-scale setting where the material is specified at a fine microscopic scale of heterogeneities that is much smaller than the coarse macroscopic scale of application. Here, we specifically study a polycrystalline medium where each grain is governed by crystal plasticity while the solid is subjected to macroscopic dynamic loads. The theory of homogenization allows us to solve the macroscale problem directly with a constitutive relation that is defined implicitly by the solution of the microscale problem. However, the homogenization leads to a highly complex history dependence at the macroscale, one that can be quite different from that at the microscale. In this paper, we examine the use of machine-learning, and especially deep neural networks, to harness data generated by repeatedly solving the finer scale model to: (i) gain insights into the history dependence and the macroscopic internal variables that govern the overall response; and (ii) to create a computationally efficient surrogate of its solution operator, that can directly be used at the coarser scale with no further modeling. We do so by introducing a recurrent neural operator (RNO), and show that: (i) the architecture and the learned internal variables can provide insight into the physics of the macroscopic problem; and (ii) that the RNO can provide multiscale, specifically FE 2 , accuracy at a cost comparable to a conventional empirical constitutive relation.

36 MATERIALS SCIENCE↗

ReLIC: Full-Scale Realization of Reinforcement Learning for Infrastructure Control

Prior efforts have shown that deep reinforcement learning (DRL) may provide a new method for controlling networked power systems. Though successful, prior approaches have not yet demonstrated their behavior on systems of realistic scale. This effort examined multiple theoretical and technical approaches to allow a DRL model to operate over a system of 2,000 buses or more. We find that allowing the DRL models to run training episodes in parallel provides near limitless efficiency gains, allowing us to train successful agents to behave on our Kuramoto transmission model of up to 4,000 buses. We further show that we can expand our PowerWorld DRL implementation to systems of up to 25 buses but struggle to go beyond this limit due to PowerWorld’s inability to run multiple instances at once. Finally, we examine a multi-agent approach and find that it performs as well if not better than our existing centralized approach.

97 MATHEMATICS AND COMPUTING↗

The Telecommunications and Data Acquisition Report

This quarterly publication provides archival reports on developments in programs managed by JPL's Office of Telecommunications and Data Acquisition (TDA). In space communications, radio navigation, radio science, and ground-based radio and radar astronomy, it reports on activities of the Deep Space Network (DSN). Also included is standards activity at JPL for space data and information systems and reimbursable DSN work performed for other space agencies through NASA. In the search for extraterrestrial intelligence (SETI), 'The TDA Progress Report' reports on implementation and operations for searching the microwave spectrum. In solar system radar, it reports on the uses of the Goldstone Solar System Radar for scientific exploration of the planets, their rings and satellites, asteroids, and comets. In radio astronomy, the areas of support include spectroscopy, very long baseline interferometry, and astrometry.

Posner, Edward C.↗

Learning from the Mars Rover Mission: Scientific Discovery, Learning and Memory

Purpose: Knowledge management for space exploration is part of a multi-generational effort. Each mission builds on knowledge from prior missions, and learning is the first step in knowledge production. This paper uses the Mars Exploration Rover mission as a site to explore this process. Approach: Observational study and analysis of the work of the MER science and engineering team during rover operations, to investigate how learning occurs, how it is recorded, and how these representations might be made available for subsequent missions. Findings: Learning occurred in many areas: planning science strategy, using instrumen?s within the constraints of the martian environment, the Deep Space Network, and the mission requirements; using software tools effectively; and running two teams on Mars time for three months. This learning is preserved in many ways. Primarily it resides in individual s memories. It is also encoded in stories, procedures, programming sequences, published reports, and lessons learned databases. Research implications: Shows the earliest stages of knowledge creation in a scientific mission, and demonstrates that knowledge management must begin with an understanding of knowledge creation. Practical implications: Shows that studying learning and knowledge creation suggests proactive ways to capture and use knowledge across multiple missions and generations. Value: This paper provides a unique analysis of the learning process of a scientific space mission, relevant for knowledge management researchers and designers, as well as demonstrating in detail how new learning occurs in a learning organization.

Linde, Charlotte↗

Integrated Dispatching and Charging Management of an Autonomous Electric Vehicle Ride-Hailing Fleet

Electrification and autonomous driving are two important trends in transportation systems. The convergence of these two technologies will introduce opportunities to improve transportation systems' operation and energy efficiency. One potential application is the commercial ride-hailing fleet with autonomous electric vehicles (AEVs). In order to harvest promising benefits from introducing AEVs into ride-hailing fleets, some unavoidable challenges will need to be resolved to ensure the fleets operates functionally and efficiently. This paper discusses the challenges of dispatching AEVs and their interactions with charging infrastructure. An integrated decision making framework for dispatching and charging has been designed using a system optimization approach to study the AEVs' management within the period when they drop off passengers and pick up the next passengers. Its potential fleet-wide benefits have been illustrated by comparing operations under a heuristic approach. A simulation platform has been designed to test different decision making strategies for the ride-hailing AEV fleets operational performance. Using this platform, detailed case studies have been performed with different fleet sizes, dispatching strategies, and charging infrastructure network settings. Comprehensive analyses from various aspects have been conducted to understand the AEVs' fleet operation performance, (e.g., zero occupancy vehicle miles traveled, successfully served ratio of ride-hailing requests, fleet vehicle charging downtime, and charging infrastructure utilization). Results have provided a deep understandings on operation's dynamics under various fleet system configurations and also have demonstrated advantages of the optimization-based approach for the AEV fleet management. Studies in this paper inform better designs on the future of sophisticated management strategies and charging infrastructure to support ride-hailing AEV fleet operation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Automated Operations for Galileo Communications

Following the deployment failure of Galileo's high gain antenna, the downlink had to be redesigned so as to effectively use the low gain antenna. The downlink was redesigned to maximize the data return and increase the reliability which required the reconfiguration of the onboard software and the deep space network. The revised downlink features: data compression; antenna arraying; the recoding and reprocessing of telemetry; suppressed carrier tracking, and error-correction coding. The deep space network Galileo telemetry (DGT) subsystem was developed and deployed at three sites in Australia, Spain and the U.S. The DGT was designed as an automated system that continuously monitors and adjusts its parameters and environment in response to either pre-loaded sequences or changes in the internal status.

Statman, Joseph I.↗

Reconstruction of fast neutron direction in segmented organic detectors using deep learning

A method for reconstructing the direction of a fast neutron source using a segmented organic scintillator-based detector and deep learning model is proposed and analyzed. Here, the model is based on recurrent neural network, which can be trained by a sequence of data obtained from an event recorded in the detector and suitably pre-processed. The performance of deep learning-based model is compared with the conventional double-scatter detection algorithm in reconstructing the direction of a fast neutron source. With the deep learning model, the uncertainty in source direction of 0.301 rad is achieved with 100 neutron detection events in a segmented cubic organic scintillator detector with a side length of 46 mm. To reconstruct the source direction with the same angular resolution as the double-scatter algorithm, the deep learning method requires 75% fewer events. Application of this method could augment the operation of segmented detectors operated in the neutron scatter camera configuration for applications such as special nuclear material detection.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Venus Station operations

Venus station transmitting and receiving systems during Mariner IV tracking

MARINER IV SPACE PROBE↗

Deep Space navigation for the BioSentinel spacecraft science orbit

BioSentinel is an astrobiology small spacecraft mission. The payload consists of two parts, the first has optical and microfluidics sensors, and the second is a Linear Energy Transfer spectrometer that has the objective to measure deep space radiation from events such as coronal mass ejections. The goal of the mission is to observe potential DNA damage due to the radiation in heliocentric space on the living organism Saccharomyces cerevisiae, which is a budding yeast. Two types of this living organism are included in the payload. The first is a natural type that is more radiation tolerant, while the second is a mutant strain that has a deficiency in a gene that allows DNA repair once damage occurs. The impact caused by the radiation on the DNA is compared to an identical sample aboard the International Space Station, as well as another identical sample at a laboratory on the ground. The BioSentinel mission consists of a 6U CubeSat currently ,as of January 2024, active in heliocentric orbit. The spacecraft was launched aboard the first SLS flight as part of the Artemis-I campaign in November 2022. After successful deployment from the launch vehicle, it performed a lunar flyby with an altitude of 406 km. The delta-V imparted by the flyby provided the necessary energy to achieve a heliocentric orbit, in an Earth-trailing pattern. The navigation analysis consisted of a Kalman-filter that utilized data from the Deep Space Network and the ESA Estrack network. All those antennas were needed since the Artemis-1 campaign included the deployment of several other cubesats, therefore the scheduling process required more antenna assets than usual due to simultaneous demands from various missions. The processed tracking data was later also refined with a smoother in order to obtain a more accurate solution. The type of tracking data included TCP, Sequential Range, Doppler and Range formats. The solar radiation pressure coefficient, as well as the delta-V from the deployment and the flyby were modeled to obtain suitable solutions that could decrease the position and velocity uncertainties at several steps along the mission concept of operations. The final product each time resulted in updated ephemeris files that were used by the mission and the antenna networks as the mission progressed. Once in the final science orbit, the utilized antennas are only from the DSN network and the data format is bounded to just TCP. Regular orbit determination is performed, every two weeks. The spacecraft is in a nominal well-known orbit, performing regular operations. This paper includes an analysis of the final science orbit, the techniques and procedures utilized to perform orbit determination and a description of the overall navigation campaign produced during the mission and, more specifically, during the final science operations in Deep Space.

BioSentinel↗

Applying Deep Learning for Wildfire Identification: Economical and Accessible Solutions Leveraging Small Datasets

Wildfires significantly impact human health, air quality, visibility, weather, and climate change and cause substantial economic losses. While state and county-operated air quality monitors provide critical insights during wildfires, they are not available in all regions. This highlights the need for affordable, accessible tools that allow the general public to assess air quality impacts. In this study, we apply machine learning with deep neural networks to diagnose air quality rapidly from sky images taken at the Pacific Northwest National Laboratory in Richland, WA, USA. Using a convolutional neural network (CNN) framework, we trained a deep learning model to classify air quality indices based on sky images. By leveraging transfer learning, our approach fine-tunes a pre-trained model on a small dataset of sky images, significantly reducing training time while maintaining high accuracy. Our results demonstrate the potential of deep learning to provide rapid air quality diagnostics during wildfire episodes, offering early warnings to the public and enabling timely mitigation strategies, particularly for vulnerable populations. Additionally, we show that lower respiratory infections pose the highest health risk during acute smoke exposures. Reactive oxygen species (ROS) from wildfire particles further exacerbate health risks by triggering inflammation and other adverse effects.

54 ENVIRONMENTAL SCIENCES↗

Orbit determination support for Hiten's aerobraking in the Earth's atmosphere

Two passes of the ISAS (Japan's Institute of Space and Astronautical Science) Hiten spacecraft through the Earth's atmosphere, at perigee altitudes of 125 km and 120 km, during Mar. 1991 marked the first aerobraking technology demonstrations for an object in cis-lunar orbit traveling at near Earth escape velocity. Prediction and control of perigee altitude to better than 1 km was desired to assure spacecraft survival. Covariance analysis provided confidence that prediction accuracy better than 200 m for support of final trim maneuver design was achievable with NASA DSN (Deep Space Network) tracking support. ISAS used orbit determination results in their decisions to cancel final trim maneuvers. Post flight reconstructions, marking the first combined use of DSN and ISAS tracking data, yielded perigee altitude solutions which agree with the near real time mission operations support predictions to better than 50 m.

Efron, L.↗

Systems analysis for ground-based optical navigation

Deep-space telecommunications systems will eventually operate at visible or near-infrared regions to provide increased information return from interplanetary spacecraft. This would require an onboard laser transponder in place of (or in addition to) the usual microwave transponder, as well as a network of ground-based and/or space-based optical observing stations. This article examines the expected navigation systems to meet these requirements. Special emphasis is given to optical astrometric (angular) measurements of stars, solar system target bodies, and (when available) laser-bearing spacecraft, since these observations can potentially provide the locations of both spacecraft and target bodies. The role of astrometry in the navigation system and the development options for astrometric observing systems are also discussed.

Null, G. W.↗

Networks Technology Conference

The papers included in these proceedings represent the most interesting and current topics being pursued by personnel at GSFC's Networks Division and supporting contractors involved in Space, Ground, and Deep Space Network (DSN) technical work. Although 29 papers are represented in the proceedings, only 12 were presented at the conference because of space and time limitations. The proceedings are organized according to five principal technical areas of interest to the Networks Division: Project Management; Network Operations; Network Control, Scheduling, and Monitoring; Modeling and Simulation; and Telecommunications Engineering.

Tasaki, Keiji K.↗