Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network baseline”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

A hypersonic vehicle approach to planetary exploration

An enhanced Mars network class mission using a lifting hypersonic entry vehicle is proposed. The basic vehicle, derived from a mature hypersonic flight system called SWERVE, offers several advantages over more conventional low L/D or ballistic entry systems. The proposed vehicle has greatly improved lateral and cross range capability (e.g., it is capable of reaching the polar regions during less than optimal mission opportunities), is not limited to surface target areas of low elevation, and is less susceptible to problems caused by Martian dust storms. Further, the integrated vehicle has attractive deployment features and allows for a much improved evolutionary path to larger vehicles with greater science capability. Analysis of the vehicle is aided by the development of a Mars Hypersonic Flight Simulator from which flight trajectories are obtained. Atmospheric entry performance of the baseline vehicle is improved by a deceleration skirt and transpiration cooling system which significantly reduce TPS (Thermal Protection System) and flight battery mass. The use of the vehicle is also attractive in that the maturity of the flight systems make it cost-competitive with the development of a conventional low L/D entry system. Finally, the potential application of similar vehicles to other planetary missions is discussed.

Murbach, Marcus S.↗
DOE OSTI2024

Addressing GPU memory limitations for Graph Neural Networks in High-Energy Physics applications

Introduction Reconstructing low-level particle tracks in neutrino physics can address some of the most fundamental questions about the universe. However, processing petabytes of raw data using deep learning techniques poses a challenging problem in the field of High Energy Physics (HEP). In the Exa.TrkX Project, an illustrative HEP application, preprocessed simulation data is fed into a state-of-art Graph Neural Network (GNN) model, accelerated by GPUs. However, limited GPU memory often leads to Out-of-Memory (OOM) exceptions during training, due to the large size of models and datasets. This problem is exacerbated when deploying models on High-Performance Computing (HPC) systems designed for large-scale applications. Methods We observe a high workload imbalance issue during GNN model training caused by the irregular sizes of input graph samples in HEP datasets, contributing to OOM exceptions. We aim to scale GNNs on HPC systems, by prioritizing workload balance in graph inputs while maintaining model accuracy. Our paper introduces diverse balancing strategies aimed at decreasing the maximum GPU memory footprint and avoiding the OOM exception, across various datasets. Results Our experiments showcase memory reduction of up to 32.14% compared to the baseline. We also demonstrate the proposed strategies can avoid OOM in application. Additionally, we create a distributed multi-GPU implementation using these samplers to demonstrate the scalability of these techniques on the HEP dataset. Discussion By assessing the performance of these strategies as data loading samplers across multiple datasets, we can gauge their effectiveness in both single-GPU and distributed environments. Our experiments, conducted on datasets of varying sizes and across multiple GPUs, broaden the applicability of our work to various GNN applications that handle input datasets with irregular graph sizes.

Lee, Claire Songhyun↗
NASA NTRS1994

Scientific analysis of satellite ranging data

A network of satellite laser ranging (SLR) tracking systems with continuously improving accuracies is challenging the modelling capabilities of analysts worldwide. Various data analysis techniques have yielded many advances in the development of orbit, instrument and Earth models. The direct measurement of the distance to the satellite provided by the laser ranges has given us a simple metric which links the results obtained by diverse approaches. Different groups have used SLR data, often in combination with observations from other space geodetic techniques, to improve models of the static geopotential, the solid Earth, ocean tides, and atmospheric drag models for low Earth satellites. Radiation pressure models and other non-conservative forces for satellite orbits above the atmosphere have been developed to exploit the full accuracy of the latest SLR instruments. SLR is the baseline tracking system for the altimeter missions TOPEX/Poseidon, and ERS-1 and will play an important role in providing the reference frame for locating the geocentric position of the ocean surface, in providing an unchanging range standard for altimeter calibration, and for improving the geoid models to separate gravitational from ocean circulation signals seen in the sea surface. However, even with the many improvements in the models used to support the orbital analysis of laser observations, there remain systematic effects which limit the full exploitation of SLR accuracy today.

Smith, David E.↗
DOE OSTI2020

Potential virus-mediated nitrogen cycling in oxygen-depleted oceanic waters

Viruses play an important role in the ecology and biogeochemistry of marine ecosystems. Beyond mortality and gene transfer, viruses can reprogram microbial metabolism during infection by expressing auxiliary metabolic genes (AMGs) involved in photosynthesis, central carbon metabolism, and nutrient cycling. While previous studies have focused on AMG diversity in the sunlit and dark ocean, less is known about the role of viruses in shaping metabolic networks along redox gradients associated with marine oxygen minimum zones (OMZs). Here, we analyzed relatively quantitative viral metagenomic datasets that profiled the oxygen gradient across Eastern Tropical South Pacific (ETSP) OMZ waters, assessing whether OMZ viruses might impact nitrogen (N) cycling via AMGs. Identified viral genomes encoded six N-cycle AMGs associated with denitrification, nitrification, assimilatory nitrate reduction, and nitrite transport. The majority of these AMGs (80%) were identified in T4-like Myoviridae phages, predicted to infect Cyanobacteria and Proteobacteria, or in unclassified archaeal viruses predicted to infect Thaumarchaeota. Four AMGs were exclusive to anoxic waters and had distributions that paralleled homologous microbial genes. Together, these findings suggest viruses modulate N-cycling processes within the ETSP OMZ and may contribute to nitrogen loss throughout the global oceans thus providing a baseline for their inclusion in the ecosystem and geochemical models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2020

Evaluation of Global Fire Weather Database Reanalysis and Short-Term Forecast Products

Daily Fire Weather Index (FWI) System components calculated from the NASA Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2), are compared to FWI calculations from a global network of weather stations over 2004–2018, and short-term, experimental (8 d) daily FWI forecasts are evaluated for their skill across the Terrestrial Ecoregions of the World for 2018. FWI components from MERRA-2 were, in general, biased low compared to station data, but this reflects a mix of coherent low and high biases of different magnitudes. Biases in different MERRA-2 FWI components were related to different biases in weather input variables for different regions, but temperature and relative humidity biases were the most important overall. FWI forecasts had high skill for 1–2 d lead times for most of the world. For longer lead times, forecast skill decreased most quickly at high latitudes and was most closely related to decreasing skill of relative humidity forecasts. These results provide a baseline for the evaluation and use of fire weather products calculated from global analysis and forecast fields.

Global Fire Weather Database↗
DOE OSTI2025

A Novel LDPP-MADDPG Approach for Distributed Power Allocation in mmWave Cellular Networks

This paper considers the problem of distributed beam scheduling and power allocation problem in millimeter- Wave (mmWave) cellular networks, in which multiple Base Stations (BSs) operate as individual operators over a shared spectrum. We propose a novel learning-aided approach that integrates the Lyapunov Drift-Plus-Penalty (LDPP) framework and Multi-agent Deep Deterministic Policy Gradient (MADDPG) reinforcement learning algorithms. This offers a powerful approach to learning stable and constraint-aware policies, reaping the joint benefit of both LDPP and MADDPG, in complex multiagent environments. The major challenge for this approach is to integrate these two approaches in a meaningful and effective manner. The key idea to solve this problem is to introduce a novel feature of local observation that incorporates potential negative value of the reward function due to the stochastic constraints introduced by the LDPP framework. Empirical results demonstrate that our proposed scheme outperforms the baseline methods under various conditions.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

SympNets: Intrinsic structure-preserving symplectic networks for identifying Hamiltonian systems

Here, we propose new symplectic networks (SympNets) for identifying Hamiltonian systems from data based on a composition of linear, activation and gradient modules. In particular, we define two classes of SympNets: the LA-SympNets composed of linear and activation modules, and the G-SympNets composed of gradient modules. Correspondingly, we prove two new universal approximation theorems that demonstrate that SympNets can approximate arbitrary symplectic maps based on appropriate activation functions. We then perform several experiments including the pendulum, double pendulum and three-body problems to investigate the expressivity and the generalization ability of SympNets. The simulation results show that even very small size SympNets can generalize well, and are able to handle both separable and non-separable Hamiltonian systems with data points resulting from short or long time steps. In all the test cases, SympNets outperform the baseline models, and are much faster in training and prediction. We also develop an extended version of SympNets to learn the dynamics from irregularly sampled data. This extended version of SympNets can be thought of as a universal model representing the solution to an arbitrary Hamiltonian system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

A Mass Conservation Relaxed (MCR) LSTM Model for Streamflow Simulation Across CONUS

The recent development of the physics-aware Mass-Conserving Long Short-Term Memory network (MC-LSTM) provides an alternative to other data-driven Deep Learning (DL) models in hydrology. Mass-Conserving Long Short-Term Memory incorporates mass conservation directly into the LSTM architecture. Despite the theoretical advancements, studies have reported a surprisingly limited performance of the MC-LSTM in streamflow simulation. We hypothesize that such a limitation is due to the unrealistic mass conservation scheme in MC-LSTM, which overlooks unobserved incoming water fluxes beyond precipitation. As an attempt to verify this hypothesis, we propose a Mass Conservation Relaxed LSTM (MCR-LSTM), which incorporates a bi-directional mass relaxation (MR) component to account for potential incoming water fluxes beyond precipitation. We train and test the proposed MCR-LSTM model across 531 watersheds in the contiguous United States (CONUS) against three baseline models: the Sacramento Soil Moisture Accounting, LSTM, and MC-LSTM. Our results show that MCR-LSTM outperforms MC-LSTM despite its underperformance compared to LSTM. Specifically, MCR-LSTM's advantage over MC-LSTM is mainly seen in the Plains and Western U.S., where the newly incorporated MR component better simulates water loss and suggests the likely existence of additional incoming water fluxes beyond precipitation, respectively. The novelty and contribution of this study are twofold: firstly, it introduces an alternative physics-aware DL tool (i.e., MCR-LSTM) in hydrology with higher accuracy in specific regions compared to MC-LSTM. Secondly, it provides a diagnosis of regions where strict, precipitation-based mass conservation constraints may be unrealistic in streamflow simulation.

deep learning↗
NASA NTRS2016

Faint-Source-Star Planetary Microlensing: The Discovery of the Cold Gas-Giant Planet OGLE-2014-BLG-0676Lb

We report the discovery of a planet OGLE-2014-BLG-0676Lb via gravitational microlensing. Observations for the lensing event were made by the following groups: Microlensing Observations in Astrophysics; Optical Gravitational Lensing Experiment; Wise Observatory; RoboNETLas Cumbres Observatory Global Telescope; Microlensing Network for the Detection of Small Terrestrial Exoplanets; and -FUN. All analyses of the light-curve data favoura lens system comprising a planetary mass orbiting a host star. The most-favoured binary lens model has a mass ratio between the two lens masses of (4.78 +/- 0.13) 10(exp -3). Subject to some important assumptions, a Bayesian probability density analysis suggests the lens system comprises a 3.09(+1.02/-1.12) MJ planet orbiting a 0.62(+0.20/-0.22) solar mass host star at a deprojected orbital separation of 4.40(+2.16/-1.46) au. The distance to the lens system is 2.22(+0.96/-0.83) kpc. Planet OGLE-2014-BLG-0676Lb provides additional data to the growing number of cool planets discover redusing gravitational microlensing against which planetary formation theories may be tested. Most of the light in the baseline of this event is expected to come from the lens and thus high-resolution imaging observations could confirm our planetary model interpretation.

OGLE-2014-BLG-0676Lb↗
DOE OSTI2025

Evaluating the Effectiveness of Soil Profile Rehabilitation for Pluvial Flood Mitigation Through Two-Dimensional Hydrodynamic Modeling

Pluvial flooding, driven by increasingly impervious surfaces and intense storm events, presents a growing challenge for urban areas worldwide. In Baltimore City, MD, USA, climate change, rapid urbanization, and aging stormwater infrastructure are exacerbating flooding impacts, resulting in significant socio-economic consequences. This study evaluated the effectiveness of a soil profile rehabilitation scenario using a 2D hydrodynamic modeling approach for the Tiffany Run watershed, Baltimore City. This study utilized different extreme storm events, a high-resolution (1 m) LiDAR Digital Terrain Model (DTM), building footprints, and hydrological soil data. These datasets were integrated into a fully coupled 2D hydrodynamic model, the City Catchment Analysis Tool (CityCAT), to simulate urban flood dynamics. The pre-soil rehabilitation simulation revealed a maximum water depth of 3.00 m in most areas, with hydrologic soil groups C and D, especially downstream of the study area. The post-soil rehabilitation simulation was targeted at vacant lots and public parcels, accounting for 33.20% of the total area of the watershed. This resulted in a reduced water depth of 2.50 m. Additionally, the baseline runoff coefficient of 0.49 decreased to 0.47 following the rehabilitation, and the model consistently recorded a peak runoff reduction rate of 4.10 across varying rainfall intensities. The validation using a contingency matrix demonstrated true-positive rates of 0.75, 0.50, 0.64, and 0 for the selected events, confirming the model’s capability at capturing real-world flood occurrences.

Baltimore City↗
DOE OSTI2024

Semi-supervised Learning of Dynamical Systems with Neural Ordinary Differential Equations: A Teacher-Student Model Approach

Modeling dynamical systems is crucial for a wide range of tasks, but it remains challenging due to complex nonlinear dynamics, limited observations, or lack of prior knowledge. Recently, data-driven approaches such as Neural Ordinary Differential Equations (NODE) have shown promising results by leveraging the expressive power of neural networks to model unknown dynamics. However, these approaches often suffer from limited labeled training data, leading to poor generalization and suboptimal predictions. On the other hand, semi-supervised algorithms can utilize abundant unlabeled data and have demonstrated good performance in classification and regression tasks. We propose TS-NODE, the first semi-supervised approach to modeling dynamical systems with NODE. TS-NODE explores cheaply generated synthetic pseudo rollouts to broaden exploration in the state space and to tackle the challenges brought by lack of ground-truth system data under a teacher-student model. TS-NODE employs an unified optimization framework that corrects the teacher model based on the student's feedback while mitigating the potential false system dynamics present in pseudo rollouts. TS-NODE demonstrates significant performance improvements over a baseline Neural ODE model on multiple dynamical system modeling tasks.

Wang, Yu↗
DOE OSTI2022

Capsule network-based semantic segmentation model for thermal anomaly identification on building envelopes

Thermography technology is widely used to inspect thermal anomalies in building façade systems. Computer vision-based techniques provide opportunities to autonomously detect such heat anomalies to significantly improve the efficiency of decision-making for building envelope retrofitting and maintenance. Here, in this work, we propose a novel Capsule Network-based deep learning model – CapsLab – that detects and identifies thermal anomalies by semantic segmentation. CapsLab is built based on our proposed prediction-tuning capsule (PT-Capsule) layer. Different from a traditional capsule layer, which consists of part-whole transformation and capsule-routing process, the proposed layer is composed of a prediction and tuning process, which helps decreasing the number of model parameters significantly. While the applicability of traditional Capsule Networks (CapsNets) has been limited to simpler tasks and smaller datasets due to their scalability issue, we can leverage the lightweight of the proposed PT-Capsule layer, and apply it to the semantic segmentation task. In this work, we also employ our previously presented performance metric, referred to as the Anomaly Identification Metric (AIM) (Kakillioglua et al. 2021), to evaluate the segmentation outputs. Traditional performance metrics do not accurately reflect the true performance of the segmentation models in thermal anomaly identification due to the high subjectivity in the annotation process and higher overlap ratio sensitivity of the standard metrics. AIM, on the other hand, is robust to these drawbacks. Experimental results show, both qualitatively and quantitatively, that our proposed segmentation method can effectively segment the thermal anomalies. Specifically, our model provides 9.38% and 13.53% improvements over the baseline model – DeepLabV3+ – based on traditional mIoU score and the AIM score, respectively, while requiring less model parameters and less computation at the same time. In addition, the scores that the AIM metric generates better align with the scores provided by building performance experts.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2010

Path Length Fluctuations Derived from Site Testing Interferometer Data

To evaluate possible sites for NASA's proposed Ka-band antenna array, the NASA Glenn Research Center has constructed atmospheric phase monitors (APM) which directly measure the tropospheric phase stability. These instruments observe an unmodulated 20.2 GHz beacon signal broadcast from a geostationary satellite (Anik F2) and measure the phase difference between the signals received by the two antennas. Two APM's have been deployed, one at the NASA Deep Space Network (DSN) Tracking Complex in Goldstone, California, and the other at the NASA White Sands Complex, in Las Cruces, New Mexico. Two station-years of atmospheric phase fluctuation data have been collected at Goldstone since operations commenced in May 2007 and 0.5 station-years of data have been collected at White Sands since operations began February 2009. With identical instruments operating simultaneously, we can directly compare the phase stability at the two sites. Phase stability is analyzed statistically in terms of the root-mean-square (rms) of the tropospheric path length fluctuations over 10 min blocks. Correlation between surface wind speed and relative humidity with interferometer phase are discussed. For 2 years, the path length fluctuations at the DSN site in Goldstone, California, have been better than 757 micrometer (with reference to a 300 m baseline and to Zenith) for 90 percent of the time. For the 6 months of data collected at White Sands, New Mexico, the path length fluctuations have been better than 830 micrometers (with reference to a 300 m baseline and to Zenith) for 90 percent of the time. This type of data analysis, as well as many other site quality characteristics (e.g., rain attenuation, infrastructure, etc.), will be used to determine the suitability of both sites for NASA s future communication services at Ka-band using an array of antennas.

Acosta, Roberto J.↗
NASA NTRS1991

NSI directed to continue SPAN's functions

During a series of network management retreats in June and July 1990, representatives from NASA Headquarters Codes O and S agreed on networking roles and responsibilities for their respective organizations. The representatives decided that NASA Science Internet (NSI) will assume management of both the Space Physics Analysis Network (SPAN) and the NASA Science Network (NSN). SPAN is now known as the NSI/DECnet, and NSN is now known as the NSI/IP. Some management functions will be distributed between Ames Research Center (ARC) and Goddard Space Flight Center (GSFC). NSI at ARC has the lead role for requirements generation and networking engineering. Advanced Applications and the Network Information Center is being developed at GSFC. GSFC will lead the NSI User Services, but NSI at Ames will continue to provide the User Services during the transition. The transition will be made as transparent as possible for the users. DECnet service will continue, but is now directly managed by NSI at Ames. NSI will continue to work closely with routing center managers at other NASA centers, and has formed a transition team to address the change in management. An NSI/DECnet working group had also been formed as a separate engineering group within NSI to plan the transition to Phase 5, DECnet's approach to Open System Integration (OSI). Transition is not expected for a year or more due to delays in produce releases. Plans to upgrade speeds in tail circuits and the backbone are underway. The proposed baseline service for new connections is up to 56 Kbps; 9.6 Kbps lines will gradually be upgraded as requirements dictate. NSI is in the process of consolidating protocol traffic, tail circuits, and the backbone. Currently NSI's backbone is fractional T1; NSI will go to full T1 service as soon as it is feasible.

Rounds, Fred↗
NASA NTRS2006

Relationship between Weather, Traffic and Delay Based on Empirical Methods

The steady rise in demand for air transportation over the years has put much emphasis on the need for sophisticated air traffic flow management (TFM) within the National Airspace System (NAS). The NAS refers to hardware, software and people, including runways, radars, networks, FAA, airlines, etc., involved in air traffic management (ATM) in the US. One of the metrics that has been used to assess the performance of NAS is the actual delays provided through FAA's Air Traffic Operations Network (OPSNET). The OPSNET delay data includes those reportable delays, i.e. delays of 15 minutes or more experienced by Instrument Flight Rule (IFR) flights, submitted by the FAA facilities. These OPSNET delays are caused by the application of TFM initiatives in response to, for instance, weather conditions, increased traffic volume, equipment outages, airline operations, and runway conditions. TFM initiatives such as, ground stops, ground delay programs, rerouting, airborne holding, and miles-in-trail restrictions, are actions which are needed to control the air traffic demand to mitigate the demand-capacity imbalance due to the reduction in capacity. Consequently, TFM initiatives result in NAS delays. Of all the causes, weather has been identified as the most important causal factor for NAS delays. Therefore, in order to accurately assess the NAS performance, it has become necessary to create a baseline for NAS performance and establish a model which characterizes the relation between weather and NAS delays.

Sridhar, Banavar↗
NASA NTRS2018

Recommendations Emerging from an Analysis of NASA's Deep Space Communications Capacity

During 2016-2017, NASA’s Space Communications and Navigation (SCaN) Office chartered a study of Deep Space Network (DSN) communications capacity relative to projected future-mission demand over the next 30 years. In this paper, we briefly describe the methodology used to analyze capacity vs. demand over such a broad timeframe, summarize key findings emerging from the analysis, and discuss the associated recommendations. Performing the analysis entailed: identifying key factors shaping the anticipated future mission set, identifying several alternative future mission set scenarios consistent with these factors, and then analyzing each mission set scenario in terms of required antenna capacity, downlink and uplink capabilities, and spectrum as a function of time. On the basis of these aggregate requirements, DSN loading simulations were then conducted that examined how well each of the postulated mission sets could load up onto the the DSN’s “in-plan” architecture. To the extent that capacity shortfalls emerged during these baseline simulations, architectural solutions to the shortfalls were then postulated and tested via additional simulations. In general, the trend analyses and baseline loading simulations indicated a significant progression in challenges over the next three decades. In the current decade, the DSN appeared to be operating very close to capacity. The first human exploration mission and its secondary payload launch opportunities for cubesats traveling beyond GEO contributed to this loading. As a consequence, the main challenge appeared to be managing peak assetcontention periods. In the next decade, the DSN continued to operate close to capacity but also began transitioning to more frequent human mission support. Upgrading for, and operating, a human-rated system while continuing to meet robotic mission customer requirements emerged as the key challenge. In the 2030’s and beyond, simulations suggested a need for fundamentally new capability and capacity. The high data rates and long link distances characteristic of human Mars exploration drove requirements far beyond what is currently “in plan.” The key challenge then became determining the most cost-effective combination of RF and optical assets for communicating with the postulated human Mars assets while still providing for the needs of all the other missions across the solar system. Various link budget, visibility, and loading analyses ultimately suggested that the human Mars exploration demands of the 2030’s could best be addressed with two cross-linked RF-optical areostationary relays (or an areostationary relay and deep space habitat) providing a dual “trunk link” to an array of 2-to-3 additional 34m beam waveguide antennas and an ~8.5m optical antenna at each DSN Complex. The dual “trunk link” would enable the same amount of total data return to Earth as a single trunk link at twice the data rate, but with only half the required array size on the ground, assuming use of Multiple Spacecraft Per Antenna (MSPA) techniques. MSPA techniques, including a Multiple Uplink Per Antenna (MUPA) technique currently under investigation, also showed promise for reducing asset contention in the decades prior to human Mars exploration.

Lee, Carlyn-Ann↗
DOE OSTI2024

Gene-Metabolite Association Prediction with Interactive Knowledge Transfer Enhanced Graph for Metabolite Production

Identifying gene targets for enhancing metabolite production in metabolic engineering is challenging due to the vast research literature and the approximation in genome-scale metabolic model (GEM) simulations. Here, to address this, we propose the Gene-Metabolite Association Prediction task, which automates gene discovery for given metabolite-gene pairs, accompanied by a benchmark dataset of 2474 metabolites and 1947 genes for Saccharomyces cerevisiae (SC) and Issatchenkia orientalis (IO). This task is complicated by incomplete metabolic graphs and metabolic heterogeneity. We introduce an Interactive Knowledge Transfer mechanism based on Metabolism Graphs (IKT4Meta) to enhance prediction accuracy by integrating cross-metabolism knowledge. Using Pretrained Language Models (PLMs) to generate inter-graph links mitigates heterogeneity issues, while intra-graph links are propagated via these anchors. Gene-metabolite predictions are then performed on the enriched graphs integrating multiple microorganisms’ knowledge. Experiments show that IKT4Meta outperforms baselines by up to 12.3% in link prediction.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Streamlining Ocean Dynamics Modeling with Fourier Neural Operators: A Multiobjective Hyperparameter and Architecture Optimization Approach

Training an effective deep learning model to learn ocean processes involves careful choices of various hyperparameters. We leverage DeepHyper’s advanced search algorithms for multiobjective optimization, streamlining the development of neural networks tailored for ocean modeling. The focus is on optimizing Fourier neural operators (FNOs), a data-driven model capable of simulating complex ocean behaviors. Selecting the correct model and tuning the hyperparameters are challenging tasks, requiring much effort to ensure model accuracy. DeepHyper allows efficient exploration of hyperparameters associated with data preprocessing, FNO architecture-related hyperparameters, and various model training strategies. We aim to obtain an optimal set of hyperparameters leading to the most performant model. Moreover, on top of the commonly used mean squared error for model training, we propose adopting the negative anomaly correlation coefficient as the additional loss term to improve model performance and investigate the potential trade-off between the two terms. The numerical experiments show that the optimal set of hyperparameters enhanced model performance in single timestepping forecasting and greatly exceeded the baseline configuration in the autoregressive rollout for long-horizon forecasting up to 30 days. Utilizing DeepHyper, we demonstrate an approach to enhance the use of FNO in ocean dynamics forecasting, offering a scalable solution with improved precision.

97 MATHEMATICS AND COMPUTING↗