Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data landscape”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Meeting Global Health Needs via Infectious Disease Forecasting: Development of a Reliable Data-Driven Framework

Infectious diseases (IDs) have a significant detrimental impact on global health. Timely and accurate ID forecasting can result in more informed implementation of control measures and prevention policies. To meet the operational decision-making needs of real-world circumstances, we aimed to build a standardized, reliable, and trustworthy ID forecasting pipeline and visualization dashboard that is generalizable across a wide range of modeling techniques, IDs, and global locations. We forecasted 6 diverse, zoonotic diseases (brucellosis, campylobacteriosis, Middle East respiratory syndrome, Q fever, tick-borne encephalitis, and tularemia) across 4 continents and 8 countries. We included a wide range of statistical, machine learning, and deep learning models (n=9) and trained them on a multitude of features (average n=2326) within the One Health landscape, including demography, landscape, climate, and socioeconomic factors. The pipeline and dashboard were created in consideration of crucial operational metrics—prediction accuracy, computational efficiency, spatiotemporal generalizability, uncertainty quantification, and interpretability—which are essential to strategic data-driven decisions. While no single best model was suitable for all disease, region, and country combinations, our ensemble technique selects the best-performing model for each given scenario to achieve the closest prediction. For new or emerging diseases in a region, the ensemble model can predict how the disease may behave in the new region using a pretrained model from a similar region with a history of that disease. The data visualization dashboard provides a clean interface of important analytical metrics, such as ID temporal patterns, forecasts, prediction uncertainties, and model feature importance across all geographic locations and disease combinations. As the need for real-time, operational ID forecasting capabilities increases, this standardized and automated platform for data collection, analysis, and reporting is a major step forward in enabling evidence-based public health decisions and policies for the prevention and mitigation of future ID outbreaks.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

B-DeepONet: An enhanced Bayesian DeepONet for solving noisy parametric PDEs using accelerated replica exchange SGLD

Here, the Deep Operator Network (DeepONet) is a neural network architecture used to approximate operators, including the solution operator of parametric PDEs. DeepONets have shown remarkable approximation ability. However, the performance of DeepONets deteriorates when the training data is polluted with noise, a scenario that occurs in practice. To handle noisy data, we propose a Bayesian DeepONet based on replica exchange Langevin diffusion (reLD). Replica exchange uses two particles. The first particle trains a DeepONet to exploit the loss landscape and make predictions. The other particle trains a different DeepONet to explore the loss landscape and escape local minima via swapping. Compared to DeepONets trained with state-of-the-art gradient-based algorithms (e.g., Adam), the proposed Bayesian DeepONet greatly improves the training convergence for noisy scenarios and accurately estimates the uncertainty. To further reduce the high computational cost of the reLD training of DeepONets, we propose (1) an accelerated training framework that exploits the DeepONet's architecture to reduce its computational cost up to 25% without compromising performance and (2) a transfer learning strategy that accelerates training DeepONets for PDEs with different parameter values. Finally, we illustrate the effectiveness of the proposed Bayesian DeepONet using four parametric PDE problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A phenology- and trend-based approach for accurate mapping of sea-level driven coastal forest retreat

The rapid replacement of upland forest by encroaching marshland is a striking manifestation of global sea-level rise (SLR). Timely and high-resolution information on the location and extent of transition forest (the ecotone between upland forest and marsh where tree mortality due to seawater intrusion begins) is fundamental to understanding the processes and patterns of SLR-driven landscape reorganization. Despite its significance, accurate characterization of salt-impacted transition forest remains challenging due to the complexity of coastal environments, scarcity of ground-truth data, and the lack of effective mapping algorithms. Here we use the full archive of Landsat images between 1984 and 2021 to investigate the spectral, temporal, and phenological characteristics of transition forest, and develop a robust framework for monitoring coastal vegetation shifts in the mid-Atlantic U.S., a global SLR hotspot. Here, we found that transition forest exhibits strong negative NDVI trends and a deviation of land surface phenology from marsh and upland forest that distinguishes itself from surrounding vegetation. By integrating temporal trends and land surface phenology, our results demonstrate superior discrimination between marsh and coastal forests to existing map products (e.g. NOAA Coastal Change Analysis Program, National Land Cover Database) that allows a reliable identification of the coastal treeline. We applied the approach to map regional land cover in 1985, 2000 and 2020 (overall classification accuracy >92%) and found that the area of coastal forest decreased by 22.0% from 1985 to 2020, the majority of which transitioned to marshland (92.3%, 5.3 × 10 3 ha). Based upon fine-scale patterns of coastal transgression, we created a practical workflow for spatially explicit quantification of forest retreat rates. Concurrent with rising sea level, coastal forests migrated upslope from 0.63 (± 0.27) m above sea level in 1985 to 0.78 (± 0.32) m above sea level in 2020, and horizontal forest retreat rates accelerated from 3.1 (range of 0–36) m yr -1 during 1985–2000 to 4.7 (0–55) m yr -1 during 2001–2020. As SLR continues to accelerate, our study may serve as a scalable solution for consistent tracking of coastal landscape evolution that is urgently needed for sustainable forest and wetland management.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Discovery of False Data Injection Attacks on Power Grid Frequency Controllers with Reinforcement Learning [Poster]

While inverter-based DER (distributed energy resources) are instrumental to integrating renewable energy into the power grid, they reduce the grid's mechanical inertia, thereby increasing the risk of frequency instabilities. To compensate for frequency instability risks, the grid must also undergo a transformation to include digital technologies that allow for two-way communication between the utility and customers. The current and future state of the power grid allows for building a cleaner energy landscape. However, the grid may also become vulnerable to novel cyber threats. To preemptively protect the power grid against elaborate cyber-attacks, we propose to discover potential threats via reinforcement learning. In this work, the focus is on studying false data injection attacks that target the control logic of frequency controllers. We show that a reinforcement learning agent can successfully discover how to best inject false data into linear droop controllers.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Probabilistic partition of unity networks for high–dimensional regression problems

We explore the probabilistic partition of unity network (PPOU-Net) model in the context of high-dimensional regression problems and propose a general framework focusing on adaptive dimensionality reduction. With the proposed framework, the target function is approximated by a mixture of experts model on a low-dimensional manifold, where each cluster is associated with a fixed-degree polynomial. We present a training strategy that leverages the expectation maximization (EM) algorithm. During the training, we alternate between (i) applying gradient descent to update the DNN coefficients; and (ii) using closed-form formulae derived from the EM algorithm to update the mixture of experts model parameters. Under the probabilistic formulation, step (ii) admits the form of embarrassingly paralleliazable weighted least-squares solves. The PPOU-Nets consistently outperform the baseline fully-connected neural networks of comparable sizes in numerical experiments of various data dimensions. Here, we also explore the proposed model in applications of quantum computing, where the PPOU-Nets act as surrogate models for cost landscapes associated with variational quantum circuits.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

DyG-DPCD: A Distributed Parallel Community Detection Algorithm for Large-Scale Dynamic Graphs

Dynamic (Temporal) graphs capture the valuable evolution of real-world systems, from the continuously evolving patterns of social interactions and genetic pathways to the dynamic fluctuations of economic forces. Detecting communities for such evolving networks poses unique challenges. Detecting and analyzing the evolution of communities within dynamic graphs unlocks valuable insights into the underlying structural and temporal patterns of real-world systems. However, the sheer volume of modern graph data and the inherent complexity of the temporal dimension pose significant challenges to scalable community detection algorithms. Addressing this gap, our work explores the limited landscape of scalable distributed-memory parallel methods specifically designed for dynamic network community detection. We propose a novel parallel algorithm, DyG-DPCD (Dynamic Graph Distributed Parallel Community Detection), to detect communities in dynamic networks using the Message Passing Interface (MPI) framework. We present a vertex-centric approach, allowing us to detect communities through local optimization. Furthermore, we enhance our baseline algorithm by incorporating three heuristics, which improve the algorithm’s performance significantly while maintaining the quality of the solutions. We demonstrate the efficiency of our algorithm by experimenting on several real-world large-scale networks with hundreds of millions of edges spanning diverse domains. Notably, DyG-DPCD achieves speedups between 25× and 30× for large networks that we experimented on using NERSC compute nodes. In conclusion, our algorithm outperforms the STINGER parallel re-agglomeration algorithm by 30×.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A regression algorithm for accelerated lattice QCD that exploits sparse inference on the D-Wave quantum annealer

We propose a regression algorithm that utilizes a learned dictionary optimized for sparse inference on a D-Wave quantum annealer. In this regression algorithm, we concatenate the independent and dependent variables as a combined vector, and encode the high-order correlations between them into a dictionary optimized for sparse reconstruction. On a test dataset, the dependent variable is initialized to its average value and then a sparse reconstruction of the combined vector is obtained in which the dependent variable is typically shifted closer to its true value, as in a standard inpainting or denoising task. Here, a quantum annealer, which can presumably exploit a fully entangled initial state to better explore the complex energy landscape, is used to solve the highly non-convex sparse coding optimization problem. The regression algorithm is demonstrated for a lattice quantum chromodynamics simulation data using a D-Wave 2000Q quantum annealer and good prediction performance is achieved. The regression test is performed using six different values for the number of fully connected logical qubits, between 20 and 64. The scaling results indicate that a larger number of qubits gives better prediction accuracy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Peatland hydrology across scale: a probabilistic framework for confronting variability, heterogeneity, and uncertainty (Final Report)

Our project aimed to guide the representations of peatland hydrology and water-carbon feedbacks within Earth System Models, by improving process understanding and developing parsimonious models that elucidate the effects of hydroclimatic variability and spatial heterogeneity. Our research questions centered on the three key drivers of peatland hydrology: (1) seasonal and interannual hydroclimatic fluctuations, (2) spatial heterogeneity of peatland microtopography, and (3) hydrological connectivity across landscape units within a peatland watershed. Our analyses and model testing used existing long-term datasets within the Marcell Experimental Forest (MEF), with new data collected whenever necessary. To date, we have demonstrated the strong influence of water table elevations on the temperature sensitivity of CH 4 emissions, using a newly developed eddy covariance dataset spanning eleven years at MEF. Specifically, higher water tables dampen the increase in CH 4 emissions in the spring as well as their decrease in the fall, resulting in hysteresis. These results imply that any hydroclimatological changes in peatlands that shift seasonal water availability from winter to summer will increase annual CH 4 emissions, even if soil temperature remains unchanged. To further investigate water table elevation change within the peatland microtopography, we installed automated water table gauges across four bog-forest transects (the “lagg”) in two peatland watersheds at MEF, which are hotspots of intense biogeochemical activity. These measurements will give us new information about the extent of lagg expansion and contraction during snowmelt and high intensity rainfall events, as well as the directionality of water and nutrient flow into the bog from the surrounding forests. Finally, we investigated the hydrological connectivity across the peatland watershed complex during early spring – a critical period where water table is elevated from snowmelt – using extended hydrological records from MEF (e.g., snow and frost depths, water table elevations, streamflow). The importance of thermal and wintertime processes within the Energy Exascale Earth System Model (E3SM) was determined through sensitivity analyses. Results from data analyses show that (i) streamflow has decreased over decades likely due to increased evapotranspiration rates (despite no detectable trends in precipitation), (ii) spring streamflow generation is controlled by a sequence of fill-and-spill pathways from the snowpack to the stream through peatland water stores, and (iii) frost depth is a key explanatory variable for the timing and magnitude of streamflow. These results suggest that frost plays an important role in connecting surface water storage in peatlands to stream outlets, and that the hydrological connectivity across the peatland watershed complex can mediate the sensitivity of hydrological responses to climate variations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Disparities in the air quality monitoring stations and PM₂.₅ in Chicago’s air quality landscape

Fine particulate matter (PM₂.₅) poses significant public and environmental health risks in urban areas. Chicago’s dense industry and traffic create variable air quality, yet monitoring is unevenly distributed, resulting in undersampling of air quality data in some city areas. This study applied a hybrid approach using GIS-based kernel density mapping, interpolation modeling (IDW, Spline, Kriging) of USEPA monitoring data, multi-scale temporal trend analyses (hourly to annual), and ESDA. Accordingly, the density surface showed that monitors are concentrated in the affluent north, northwest, and southwest sides of Chicago (up to ~ 0.07 stations per sq mile), while the south and southeast regions, with predominantly minority communities, have virtually no coverage. Overall, citywide coverage is minimal (~ 4–5 monitors total; ~0.02 per sq mile; ≈1 per 600,000 residents). Temporal analyses showed that the city’s mean annual PM₂.₅ (~ 10.8 µg/m³) exceeds USEPA/WHO standards (9 µg/m³), with summer means (~ 17.1 µg/m³) significantly higher than other seasons. Diurnally, a clear pattern was observed, with PM₂.₅ concentrations peaking overnight (00:00–03:00) and during the morning rush hours, and dipping during midday to late afternoon. Spatial distribution of PM₂.₅ identified hotspots near O’Hare Airport, the downtown Loop area, and south-side neighborhoods, contrasting with lower concentrations on the north side, revealing Chicago’s socioeconomic divides and resulting environmental inequities. The findings underscore the need for expanded monitoring and targeted interventions in under-monitored, high-pollution communities to advance equitable community health.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Ecologically-Informed Precision Conservation: A framework for increasing biodiversity in intensively managed agricultural landscapes with minimal sacrifice in crop production

Conservation actions are urgently needed to tackle biodiversity loss in intensively managed agricultural landscapes. Production lands are usually heterogeneous and contain low-yield areas that can be set aside for biodiversity conservation without serious yield losses. Here, we introduce Ecologically-Informed Precision Conservation, a framework that integrates yield mapping and ecological theory to select the best areas to create new set-asides while ensuring high crop yields at the farm/landscape level. Long-term yield maps can be generated using globally available satellite data and basic information on field/farm crop yield from farmers. Ecological principles are then used to select the subset of areas with the highest potential for biodiversity conservation by prioritising those that increase connectivity, maximise habitat heterogeneity and decrease landscape grain size. Here, the created non-crop habitats can be permanent and thus ensure biodiversity support over time. In addition, agricultural management efficiency can be enhanced by improving field shapes. The framework provides the basis for a practical, user-friendly tool that informs all interested stakeholders on how to rationalise existing agricultural landscapes using already-existing farming systems and available technologies. High cost-effectiveness from an economic and conservation perspective, along with the creation of heterogeneous non-crop habitats, make our framework a promising solution to re-design agricultural landscapes.

Precision agriculture↗
DOE OSTI2025

Data for Stetten et al. (2025), "Biogeochemical controls on iron speciation and cycling across upland to shoreline gradients in freshwater and estuarine coastal soils (Lake Erie and Chesapeake Bay, United States)"

Coastal environments are dynamic interfaces that mediate carbon and nutrient exchanges between terrestrial landscapes and open waters, but it is unclear how biogeochemical reactions, in particular iron (Fe) redox transformations, affect the understanding and prediction of coastal ecosystem functions. This dataset includes measurements from two freshwater sites in the Western and Central basins of Lake Erie (Ohio, United States) and two estuarine sites in the Chesapeake Bay (Maryland, United States); the analytical results were reported by Stetten et al. (2025) in Science of the Total Environment. It was produced as part of the COMPASS-FME project, which seeks to advance a scalable, predictive understanding of the fundamental biogeochemical processes, ecological structure, and ecosystem dynamics that distinguish coastal terrestrial-aquatic interfaces from the purely terrestrial or aquatic systems to which they are coupled. The sites were sampled in November 2022 (CRC), December 2022 (MSM), February 2023 (GCW), and March 2023 (OWC); site codes follow those used by Pennington et al. (2025).The dataset consists of the following soil data:- Solid data (Fe concentration, etc.)- Porewater data (sulfate, sulfide, etc.)- Linear combination fitting results of X-ray absorption near edge structure (XANES) spectra; i.e., quantitative results of the oxidation state of Fe, indicated as a proportion of pure Fe(III) and Fe(II) model compounds- Linear combination fitting results of EXAFS (extended X-ray absorption fine structure) spectra, indicated as proportion of of Fe-model compounds (illite, smectite, etc.)Each data type has a single file in comma-separated value (CSV) format. No special software is required to read it.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Systematic mapping of the conformational landscape and dynamism of soluble fibrinogen

Background: Fibrinogen is a soluble, multisubunit, and multidomain dimeric protein, which, upon its proteolytic cleavage by thrombin, is converted to insoluble fibrin, initiating polymerization that substantially contributes to clot growth. Fibrinogen contains numerous, transiently accessible “cryptic” epitopes for hemostatic and immunologic proteins, suggesting that fibrinogen exhibits conformational flexibility, which may play functional roles in its temporal and spatial interactions. Hitherto, there have been limited integrative approaches characterizing the solution structure and internal flexibility of fibrinogen. Methods: Here, utilizing a multipronged, biophysical approach involving 2 solution-based techniques, temperature-dependent hydrogen-deuterium exchange mass spectrometry and small angle X-ray scattering, corroborated by negative stain electron microscopy, we present a holistic, conformationally dynamic model of human fibrinogen in solution. Results: Our data reveal 4 major and distinct conformations of fibrinogen accommodated by a high degree of internal protein flexibility along its central scaffold. We propose that the fibrinogen structure in the solution consists of a complex, conformational landscape with multiple local minima. This is further supported by the location of numerous point mutations that are linked to dysfibrinogenemia and posttranslational modifications, residing near the identified fibrinogen flexions. Conclusion: Further, this work provides a molecular basis for the structural “dynamism” of fibrinogen that is expected to influence the broad swath of its functionally diverse macromolecular interactions and fine-tune the structural and mechanical properties of blood clots.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Resolve the Clear-Sky Continuous Diurnal Cycle of High-Resolution ECOSTRESS Evapotranspiration and Land Surface Temperature

Although numerous evapotranspiration (ET) estimates have been developed from remote sensing measurements, a diurnally resolved product with high spatial resolution (<100 m) is still lacking, which is critically needed for agricultural and ecological monitoring. The ECOsystem Spaceborne Thermal Radiometer Experiment on Space Station (ECOSTRESS) provides, for the first time, ET at 70 m resolution with diurnal samplings, enabling a step toward filling this data gap. This study developed the first framework to resolve the full diurnal cycle of ET and Land Surface Temperature (LST) from sporadic ECOSTRESS measurements. We first constructed 70 m diurnal LST utilizing a diurnal temperature cycle (DTC) model that fused ECOSTRESS and Geostationary Operational Environmental Satellite (GOES) LST. Next, we derived 70 m diurnal ET from the diurnally resolved LST, along with ancillary meteorological and reflectance data sets, using the Priestley-Taylor Jet Propulsion Laboratory (PT-JPL) algorithm. This framework was tested in two regions: A relatively homogeneous semiarid grassland landscape (centered at the US-Seg Ameriflux site) and a heterogeneous humid cropland landscape (centered at US-ARM). Our diurnally resolved LST and ET successfully reproduced the spatial patterns in the native ECOSTRESS measurements during overpasses for both landscapes (LST: r > 0.97, RMSE ~2°C; ET: r > 0.99, and RMSE = 1–7 W m -2 ). The constructed time series also well captured the temporal variability of the in situ measurements (especially under clear-sky conditions) at both US-Seg and US-ARM, albeit performance varying with availability and quality of ECOSTRESS samples. This study sets the stage for testing and applying our framework to broader climates, biomes, and landscapes toward eventually generating diurnally resolved 70 m global operational LST/ET products to enhance ecological/agricultural applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Improving Robustness of Spectrogram Classifiers with Neural Stochastic Differential Equations

Signal analysis and classification is fraught with high levels of noise and perturbation. Computer-vision-based deep learning models applied to spectrograms have proven useful in the field of signal classification and detection; however, these methods aren't designed to handle the low signal-to-noise ratios inherent within non-vision signal processing tasks. While they are powerful, they are currently not the method of choice in the inherently noisy and dynamic critical infrastructure domain, such as smart-grid sensing, anomaly detection, and non-intrusive load monitoring. Currently, these models can be brittle, which makes them susceptible to noisy input. This also means they have sub-optimal stability of explanation outputs. Experts and technicians using these models to make decisions in real world scenarios need assurance that a model is performing as it is supposed to. The classification or prediction outputs it generates should be sound and grounded, not likely to change in the presence of shifting noise landscapes. In this work, we explore the idea of Neural Stochastic Differential Equations (NSDE's) to improve the robustness of models trained to classify time series data and the effect of NSDE's on the explainability of outputs. We then test the effectiveness of these approaches by applying them to a non-intrusive load monitoring (NILM) dataset that consists of simulated harmonic signals injected into a real building.

Brogan, Joel↗
DOE OSTI2026

NGEE Arctic Authorship Guidelines

Authorship Guidelines were developed to help facilitate trust among team members as we span multiple institutions, scientific disciplines, and career stages. NGEE Arctic was built on a foundation of open science, data sharing, and collaboration. In Phase 4 of the project, it was particularly important to keep this foundation in mind as we develop new collaborations across the Arctic. Included in this package is one *.pdf. The Next-Generation Ecosystem Experiments in the Arctic (NGEE Arctic) project is a research effort to reduce uncertainty in the Department of Energy’s Energy Exascale Earth System Model (E3SM) by developing a predictive understanding of Arctic tundra ecosystems underlain by permafrost and to quantify feedbacks from the Arctic tundra to the Earth system. NGEE Arctic is supported by the Department of Energy's Office of Biological and Environmental Research. Over Phases 1–3, observations made by the NGEE Arctic team across a gradient of permafrost landscapes in Arctic Alaska improved the representation of tundra processes in the land surface component of E3SM (the E3SM Land Model, ELM). Model improvements emphasized unique aspects of permafrost environments and explored reductions in model complexity while retaining predictive power. The Arctic-informed ELM developed by NGEE Arctic has been used to make novel predictions on processes ranging from permafrost thaw to soil biogeochemical cycling to Earth system feedbacks associated with the unique characteristics of tundra plants. In Phase 4, the NGEE Arctic team is evaluating our new predictive understanding under novel conditions across the Arctic domain. In collaboration with partners at long-term pan-Arctic research sites we are examining whether an Arctic-informed ELM can faithfully simulate interactions among surface and subsurface processes at site, regional, and pan-Arctic scales. In turn, we are using variety of tools to dynamically extend and evaluate ELM inference, with an emphasis on data synthesis and pan-Arctic model evaluation, reintegration of code with an evolving E3SM, scaling across heterogeneous Arctic landscapes, and the appropriate representation of the impacts of increasingly frequent Arctic disturbances.

Iversen, Colleen [ORNL] (ORCID:0000000182933450)↗
DOE OSTI2023

DEPRECATED - State Policies and Programs for Community Solar (2022)

This data set is no longer current – The most current data and all historical data sets can be found at https://data.nlr.gov/submissions/249 The purpose of this dataset is to summarize current community solar policies and low-income stipulations by the state in the United States as of December 2022. The "State_Program" sheet summarizes the key policy details for each state. This dataset is associated with the National Renewable Energy Laboratory (NREL) publication "Expanding Solar Access: State Community Solar Landscape (2022)." https://www.nlr.gov/docs/fy23osti/84247.pdf This list has been reviewed, but errors may exist, and the list may not be comprehensive. NREL invites input to update or add to the database. Please submit updates, additions, or corrections please find contact information on the current data set page linked above.

14 SOLAR ENERGY↗
DOE OSTI2024

Divide and conquer: Learning chaotic dynamical systems with multistep penalty neural ordinary differential equations

Forecasting high-dimensional dynamical systems is a fundamental challenge in various fields, such as geosciences and engineering. Neural Ordinary Differential Equations (NODEs), which combine the power of neural networks and numerical solvers, have emerged as a promising algorithm for forecasting complex nonlinear dynamical systems. However, classical techniques used for NODE training are ineffective for learning chaotic dynamical systems. In this work, we propose a novel NODE-training approach that allows for robust learning of chaotic dynamical systems. Here, our method addresses the challenges of non-convexity and exploding gradients associated with underlying chaotic dynamics. Training data trajectories from such systems are split into multiple, non-overlapping time windows. In addition to the deviation from the training data, the optimization loss term further penalizes the discontinuities of the predicted trajectory between the time windows. The window size is selected based on the fastest Lyapunov time scale of the system. Multi-step penalty(MP) method is first demonstrated on Lorenz equation, to illustrate how it improves the loss landscape and thereby accelerates the optimization convergence. MP method can optimize chaotic systems in a manner similar to least-squares shadowing with significantly lower computational costs. Our proposed algorithm, denoted the Multistep Penalty NODE, is applied to chaotic systems such as the Kuramoto-Sivashinsky equation, the two-dimensional Kolmogorov flow, and ERA5 reanalysis data for the atmosphere. It is observed that MP-NODE provide viable performance for such chaotic systems, not only for short-term trajectory predictions but also for invariant statistics that are hallmarks of the chaotic nature of these dynamics.

Chaotic dynamical systems↗
DOE OSTI2023

Permutationally Invariant Networks for Enhanced Sampling (PINES): Discovery of Multimolecular and Solvent-Inclusive Collective Variables

The typically rugged nature of molecular free energy landscapes can frustrate efficient sampling of the thermodynamically relevant phase space due to the presence of high free energy barriers. Enhanced sampling techniques can improve phase space exploration by accelerating sampling along particular collective variables (CVs). A number of techniques exist for data-driven discovery of CVs parameterizing the important large scale motions of the system. A challenge to CV discovery is learning CVs invariant to symmetries of the molecular system, frequently rigid translation, rigid rotation, and permutational relabeling of identical particles. Of these, permutational invariance has proved a persistent challenge in frustrating the data-driven discovery of multi-molecular CVs in systems of self-assembling particles and solvent-inclusive CVs for solvated systems. In this work, we integrate Permutation Invariant Vector (PIV) featurizations with autoencoding neural networks to learn nonlinear CVs invariant to translation, rotation, and permutation, and perform interleaved rounds of CV discovery and enhanced sampling to iteratively expand sampling of configurational phase space and obtain converged CVs and free energy landscapes. Here, we demonstrate the Permutationally Invariant Network for Enhanced Sampling (PINES) approach in applications to the self-assembly of a 13-atom Argon cluster, association/dissociation of a NaCl ion pair in water, and hydrophobic collapse of a C 45 H 92 n-pentatetracontane polymer chain. We make the approach freely available as a new module within the PLUMED2 enhanced sampling libraries.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗