Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Mathematics and Computing, Geosciences”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Learning from learning machines: improving the predictive power of energy-water-land nexus models with insights from complex measured and simulated data

Focal Area(s): Insights gleaned from complex data (observed and simulated) using AI; Predictive modeling through the use of AI techniques and AI-derived model components, including physics- and knowledge-informed models; Energy-water-land nexus and integrated energy systems – models of MultiSector dynamics. Science Challenge: Scientific communities are in need of tools for the computational integration of physics-based models, experimental data, and empirical/observational studies across a broad range of temporal and spatial scales to explore and meet EESSD grand challenges. We require AI algorithms for the discovery of process-drivers in the Earth-energy-human system and to link them with complex measured and simulated data. We aim to understand the energy-water-land nexus, particularly under extreme forcing scenarios and rare events, leveraging scale-aware AI process models, including probabilistic uncertainties, and benefiting from the emerging 5G-enabled landscape-scale sensing and edge computing capabilities. These models are needed to identify instabilities and tipping points that manifest extreme system behaviors with consequences for integrated energy systems and the environment. This work requires fundamental advances in uncertainty quantification, in particular, to identify and model unlikely but catastrophic outliers. Specifically, we need models that are interpretable to domain scientists and, essentially, explainable to public and private stake holders.

54 ENVIRONMENTAL SCIENCES↗

A general approach to seismic inversion with automatic differentiation

Imaging Earth structure or seismic sources from seismic data involves minimizing a target misfit function, and is commonly solved through gradient-based optimization. The adjoint-state method has been developed to compute the gradient efficiently; however, its implementation can be time-consuming and difficult. We develop a general seismic inversion framework to calculate gradients using reverse-mode automatic differentiation. The central idea is that adjoint-state methods and reverse-mode automatic differentiation are mathematically equivalent. Here, the mapping between numerical PDE simulation and deep learning allows us to build a seismic inverse modeling library, ADSeismic, based on deep learning frameworks, which supports high performance reverse-mode automatic differentiation on CPUs and GPUs. We demonstrate the performance of ADSeismic on inverse problems related to velocity model estimation, rupture imaging, earthquake location, and source time function retrieval. ADSeismic has the potential to solve a wide variety of inverse modeling applications within a unified framework.

58 GEOSCIENCES↗

High order explicit local time stepping methods for hyperbolic conservation laws

In this paper we present and analyze a general framework for constructing high order explicit local time stepping (LTS) methods for hyperbolic conservation laws. In particular, we consider the model problem discretized by Runge-Kutta discontinuous Galerkin (RK-DG) methods and design LTS algorithms based on the strong stability preserving Runge-Kutta (SSP-RK) schemes, that allow spatially variable time step sizes to be used for time integration in different regions of the computational domain. The proposed algorithms are of predictor-corrector type, in which the interface information along the time direction is first predicted based on the SSP-RK approximations and Taylor expansions, and then the fluxes over the region of the interface are corrected to conserve mass exactly at each time step. Following the proposed framework, we detail the corresponding LTS schemes with accuracy up to the fourth order, and prove their conservation property and nonlinear stability for the scalar conservation laws. Numerical experiments are also presented to demonstrate excellent performance of the proposed LTS algorithms.

58 GEOSCIENCES↗

Physically regularized machine learning emulators of aerosol activation

Abstract. The activation of aerosol into cloud droplets is an important step in the formation of clouds and strongly influences the radiative budget of the Earth. Explicitly simulating aerosol activation in Earth system models is challenging due to the computational complexity required to resolve the necessary chemical and physical processes and their interactions. As such, various parameterizations have been developed to approximate these details at reduced computational cost and accuracy. Here, we explore how machine learning emulators can be used to bridge this gap in computational cost and parameterization accuracy. We evaluate a set of emulators of a detailed cloud parcel model using physically regularized machine learning regression techniques. We find that the emulators can reproduce the parcel model at higher accuracy than many existing parameterizations. Furthermore, physical regularization tends to improve emulator accuracy, most significantly when emulating very low activation fractions. This work demonstrates the value of physical constraints in machine learning model development and enables the implementation of improved hybrid physical and machine learning models of aerosol activation into next-generation Earth system models.

58 GEOSCIENCES↗

Develop a weather-aware climate model to understand and predict extremes and associated power outages and renewable energy shortages with uncertainty-aware and physics-informed machine learning

Focal Area(s): The focus area is predictive modeling through the use of AI techniques and AI-derived model components with a particular emphasis on extreme weather in Atmospheric Science and power outages and shortages in Energy Science. Science Challenge: Predicting weather extremes (e.g., heavy precipitation, strong wind, and large hailstones), and weather-related power system outages and shortages can mitigate economic losses, save lives, support renewables integration, and improve power system resiliency. However, currently, the poor reliability and large uncertainty associated with the weather extreme prediction in the current climate models make the problem intractable. The key challenges are: (1) physical factors like green-house gases (GHGs), aerosols, and land use and land cover (LULC) can significantly impact extreme storms, but the understanding of these impacts is limited, particularly globally; (2) the convective permitting resolutions needed to model severe convective storms and their impacts are computationally prohibitive with global climate models (GCMs); (3) interactions between weather extremes and power system outages are complex and subject to great uncertainty. Current outage prediction models are short lead (~ 3 days), which do not allow for long-time planning of energy production and distribution. Moreover, we have limited capacity to predict weather events leading to sustained shortages in a renewable-energy-dominated power system. These challenges drive motivation for mechanistic understanding and reliable and efficient predictive modeling of extremes and their impacts from the sub-seasonal to long term projections.

54 ENVIRONMENTAL SCIENCES↗

Perspectives on AI Architectures and Co-design for Earth System Predictability

Recently, the U.S. Department of Energy (DOE), Office of Science, Biological and Environmental Research (BER), and Advanced Scientific Computing Research (ASCR) programs organized and held the Artificial Intelligence for Earth System Predictability (AI4ESP) workshop series. From this workshop, a critical conclusion that the DOE BER and ASCR community came to is the requirement to develop a new paradigm for Earth system predictability focused on enabling artificial intelligence (AI) across the field, laboratory, modeling, and analysis activities, called model experimentation (ModEx). BER’s ModEx is an iterative approach that enables process models to generate hypotheses. The developed hypotheses inform field and laboratory efforts to collect measurement and observation data, which are subsequently used to parameterize, drive, and test model (e.g., process based) predictions. A total of 17 technical sessions were held in this AI4ESP workshop series. This paper discusses the topic of the AI Architectures and Codesign session and associated outcomes. The AI Architectures and Codesign session included two invited talks, two plenary discussion panels, and three breakout rooms that covered specific topics, including 1) DOE high-performance computing (HPC) systems, 2) cloud HPC systems, and 3) edge computing and Internet of Things (IoT). We also provide forward-looking ideas and perspectives on potential research in this codesign area that can be achieved by synergies with the other 16 session topics. These ideas include topics such as 1) reimagining codesign, 2) data acquisition to distribution, 3) heterogeneous HPC solutions for integration of AI/ML and other data analytics like uncertainty quantification with Earth system modeling and simulation, and 4) AI-enabled sensor integration into Earth system measurements and observations. Such perspectives are a distinguishing aspect of this paper.

58 GEOSCIENCES↗

Learning Physically Interpretable Atmospheric Models From Data With WSINDy

The multiscale and turbulent nature of Earth's atmosphere has historically rendered accurate weather modeling a hard problem. Recently, there has been an explosion of interest surrounding data-driven approaches to weather modeling, which in many cases show improved forecasting accuracy and computational efficiency when compared to traditional methods. However, many of the current data-driven approaches employ highly parameterized neural networks, often resulting in uninterpretable models and limited gains in scientific understanding. In this work, we address the interpretability problem by explicitly discovering partial differential equations governing atmospheric phenomena, identifying symbolic mathematical models with direct physical interpretations. The purpose of this paper is to demonstrate that, in particular, the weak-form sparse identification of nonlinear dynamics (WSINDy) algorithm can learn effective atmospheric models from both simulated and assimilated data. Our approach adapts the standard WSINDy algorithm to work with high-dimensional fluid data of arbitrary spatial dimension.

58 GEOSCIENCES↗

Multiscale Reduced Order Modeling and Parameter Estimation for Climate Sciences

Several problems in earth system modeling are dependent on highly multiscale phenomena, such as turbulence, where computational modeling is challenging and expensive. This issue is exacerbated in atmospheric and oceanic domains, due to inherent high-dimensionality of the problem. One approach to this problem has been reduced order modeling (ROM); which aims to represent the key physics of the phenomena as a low-dimensional system. AI methods have huge potential in building accurate, stable ROMs and parameter estimation for these ROMs, as it requires extracting nonlinearities and patterns from simulation and/or observational data. Developing physics-based AI approaches specialized for the complexities of multiscale data, along with strategies to account for uncertainties, will revolutionize rapid modeling, analysis and decision making for earth system problems of practical interest.

58 GEOSCIENCES↗

CMIP6-based Multi-model Streamflow Projections over the Conterminous US, Version 1.1

This dataset presents an ensemble of streamflow projections covering the conterminous United States (CONUS), developed to support the SECURE Water Act Section 9505 Assessment for the US Department of Energy (DOE) Water Power Technologies Office (WPTO). Multiple Coupled Models Intercomparison Project phase 6 (CMIP6) Global Climate Models (GCMs) were downscaled using either statistical (DBCCA) or dynamical (RegCM) downscaling methods, based on two meteorological reference datasets (Daymet and Livneh). Subsequently, the downscaled precipitation, temperature, and wind speed data were used to drive two calibrated hydrologic models (VIC and PRMS), with total runoff routed through the Routing Application for Parallel computatIon of Discharge (RAPID) routing model, producing an ensemble of streamflow projections across 2.7 million NHDPlusV2 stream reaches across the CONUS. Each ensemble member covers the 1980-2019 baseline and 2020-2059 near-future periods under the high-end (SSP585) emission scenario. Additionally, using only DBCCA and Daymet, the projections extend to the 2060-2099 far-future period and encompass three additional emission scenarios (SSP370, SSP245, and SSP126). This dataset is designed to support the SECURE Water Act Section 9505 Assessment for the US Department of Energy (DOE) Water Power Technologies Office (WPTO). For further details, refer to Kao et al. (2022), Rastogi et al. (2022), and Ghimire et al. (2023).

13 HYDRO ENERGY↗

Probabilistic predictions and uncertainty estimation for radiological and nuclear effects modeling

Better characterization of meteorological uncertainty is needed to predict the effects of radiological and nuclear releases in the atmosphere. Multi-physics ensembles of atmospheric simulations can estimate uncertainty of physical processes, but they are often limited for computational reasons. Because weather uncertainty is important for emergency response applications, but the conventional way of running multi-physics ensembles is infeasible, we have developed new machine learning-based methods that quickly estimate and identify key sources of meteorological uncertainty. Machine learning accelerates the analysis of weather uncertainty by iteratively learning about model physics options that affect plume predictions. We have demonstrated the power of machine learning by creating a large multi-physics weather and dispersion ensemble dataset containing 1,200 simulations for two hypothetical radiological release scenarios. By training on less than 10% of the ensemble, we can quickly and accurately predict different outcomes, including the mass of radiological material deposited and spatial distribution and extent of contaminated areas.

54 ENVIRONMENTAL SCIENCES↗

Computed Tomography Scanning and Geophysical Measurements of the Fayetteville Shale Formation from the Nixon B #1-7 Well

The computed tomography (CT) facilities and the Multi-Sensor Core Logger (MSCL) at the National Energy Technology Laboratory (NETL) in Morgantown, West Virginia were used to characterize core from the Fayetteville and Pitkin formations. This core came from a vertical well drilled by Southwestern Energy (Nixon B #1-7 well) and characterized as part of the U.S. Department of Energy’s (DOE) Fossil Energy and Carbon Management Onshore portfolio’s focus on unconventional shale plays. The primary impetus of this work is to characterize Fayetteville Shale core, from an unconventional shale play in Northwestern Arkansas, that is relatively under-reported on when compared to larger unconventional resources in the continental U.S.

58 GEOSCIENCES↗

Emulation With Uncertainty Quantification of Regional Sea‐Level Change Caused by the Antarctic Ice Sheet

Abstract Projecting regional sea‐level change under various climate‐change scenarios typically involves running forward simulations of the Earth's gravitational, rotational and deformational (GRD) response to ice‐mass change, which requires substantial computational cost if applied to probabilistic frameworks requiring thousands to millions of samples. Here we build emulators of regional sea‐level change at 27 coastal locations, due to the GRD effects associated with future Antarctic Ice Sheet mass change over the 21st century. The emulators are evaluated against a numerical sea‐level model applied to an ensemble of ice‐sheet model simulations of the Antarctic Ice Sheet through 2100. We build a physics‐based emulator using a recent sensitivity kernel approach and compare it to machine learning based emulators (neural network and conditional variational autoencoder methods). In order to quantify uncertainty, we derive well‐calibrated prediction intervals for regional sea‐level change via split‐conformal inference and linear regression, and show that Monte Carlo dropout does not yield well‐calibrated uncertainties in this instance. We also demonstrate substantial gains in computational efficiency using both the physics‐based emulator and neural networks in comparison to the numerical model for the complete regional sea‐level solution. Overall, we find the physics‐based emulator modestly outperforms the machine learning emulators for this problem.

58 GEOSCIENCES↗

LocOO3D User's Manual

LocOO3D is a software tool that computes geographical locations for seismic events at regional to global scales. This software has a rich set of features, including the ability to use custom 3D velocity models, correlated observations and master event locations. The LocOO3D software is especially useful for research related to seismic monitoring applications, since it allows users to easily explore a variety of location methods and scenarios and is compatible with the CSS3.0 data format used in monitoring applications. The LocOO3D software, User's Manual, and Examples are available on the web at: https://github.com/sandialabs/LocOO3D For additional information on GeoTess, SALSA3D, RSTT, and other related software, please see: https://github.com/sandialabs/GeoTessJava, www.sandia.gov/geotess, www.sandia.gov/salsa3d, and www.sandia.gov/rstt

58 GEOSCIENCES↗

Testing Paired Neural Network Models for Aftershock Identification

Aftershock sequences are a burden to real-time seismic monitoring. Cross-correlation can be used because aftershocks exhibit similar waveforms, but the method is computationally expensive. Deep learning may be an alternative, as it is computationally efficient, but great attention to training and testing is required in order to trust that the model can generalize to new aftershock sequences. This is problematic for aftershock sequences, because large-magnitude earthquakes are unpredictable and are globally widespread. Here, we test several paired neural network (PNN) models trained on a augmented (noise-added) earthquake dataset, to determine whether they can be generalized to process real aftershock sequences. Two aftershock datasets that were originally detected by cross-correlation and subsequently validated by an expert analyst were used. We found that current PNN models struggle to generalize to aftershock sequences. However, we identify approaches to improve training future PNN models and believe that improvements may be achieved by transfer learning.

58 GEOSCIENCES↗

Computed Tomography Scanning and Geophysical Measurements of the Wellington 1-32 Core

The computed tomography (CT) facilities and the Multi-Sensor Core Logger (MSCL) at the U.S. Department of Energy’s (DOE), National Energy Technology Laboratory (NETL) in Morgantown, West Virginia were used to characterize core from the Wellington 1-32 well (API 15-191-22591), a small-scale field test site in the Wellington Field, in Sumner County, Kansas. Wellington 1-32 was drilled in association with the Kansas Geologic Survey’s (KGS) Phase I pre-feasibility study under the DOE-NETL Carbon Storage Assurance Facility Enterprise (CarbonSAFE) program, with the goal of utilizing the Arbuckle Group as a reservoir for CO 2 storage and the potential for stacked reservoir enhanced oil recovery from Mississippian reservoirs.

58 GEOSCIENCES↗

Computed Tomography Scanning and Geophysical Measurements of Core from the Boggess 17H Well

The computed tomography (CT) facilities and the Multi-Sensor Core Logger (MSCL) at the National Energy Technology Laboratory (NETL) in Morgantown, West Virginia were used to characterize the Marcellus Shale and underlying formations. The core is from a vertical pilot well (Boggess 17H) drilled in western Monongalia County near Core, West Virginia by Northeast Natural Energy for the second Marcellus Shale Energy and Environmental Laboratory (MSEEL). MSEEL is a joint venture between NETL, Northeast Natural Energy, and West Virginia University. The primary impetus for this report is to characterize the core to better understand the structure and variation of the Marcellus Shale and surrounding formations. This report, and the associated scans, provide detailed datasets not typically available from unconventional shales for analysis.

58 GEOSCIENCES↗

Early detection and uncertainty quantification of rapid sea-level rise from Antarctica

Focal Areas: (i) classification and/or anomaly detection methods applied towards identifying critical climate system thresholds; improved emulator design for (ii) reducing computational costs relative to full-physics models and (iii) improved uncertainty quantification workflows. Rationale: The evolution of the Antarctic ice sheet in response to climate change remains the single largest uncertainty in projecting future sea-level rise (SLR), with risk-averse projections for 2100 spanning between zero and a half meter. During the past decade, DOE has made substantial investments in new ice sheet and Earth system models needed to improve both understanding and predictive capability in this area. Yet major challenges remain, including better understanding when and under what circumstances significant increases in SLR from Antarctica may be initiated and better quantifying uncertainties in model-based SLR projections. Here, we discuss the potential for transformative advances in these areas through the application of machine learning and artificial intelligence (ML and AI, respectively).

54 ENVIRONMENTAL SCIENCES↗

Enhancing Resilience of Urban Systems Against Climate-Induced Floods Using Advanced Data-Driven and Computing Techniques: A Driver-Pressure-State-Impact-Response (DPSIR) Framework

Focal Area: This white paper proposes advanced data-driven and computing techniques to improve the predictability of extreme climate events (precipitation) and focuses on comprehending their impact dynamics to enhance resilience of urban systems. Science Challenge: In urban systems, climate change has presented significant challenges related to accurate spatiotemporal prediction of extreme climate events (heavy precipitation) and their impacts, i.e. flooding. The occurrence of extreme climate events and their compounding repercussions on the built environment make urban systems increasingly more vulnerable. The interactions between extreme climate events, urban systems, and the corresponding impacts are irregular, non-linear, and dynamic, making it difficult to standardize resilience. As it stands, the management of complex urban systems is affected by uncertainties related to the nature of short- and long-term consequences caused by extreme events.

54 ENVIRONMENTAL SCIENCES↗