Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “production data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Les Houches study on inclusive jet production at NNLO+NNLL

Jet production at the LHC is a powerful probe of QCD, making it ideal for precision tests and determinations of QCD parameters such as parton distribution functions and the strong coupling constant. To make the most of the abundant jet production data collected at the LHC, precise calculations are required. While state-of-the-art calculations reach next-to-next-to-leading order (NNLO) QCD accuracy, a critical assessment of the remaining uncertainties arising from non-perturbative effects and missing higher orders remains crucial for correctly interpreting comparisons between theory and data. Scale variation is nearly always used to determine effects from missing higher orders. In this article, we reassess this method in the context of inclusive jet production by performing NNLO QCD calculations supplemented by small-jet-radius resummation through next-to-next-to-leading-logarithmic accuracy (NNLL). We find that NNLL resummation can have an appreciable impact on the scale uncertainty for inclusive jet cross sections, and, for some scale choices, can lead to sizeable shifts of the central cross section. We conclude that scale variations in fixed-order and resummed calculations can drastically underestimate the impact of higher orders for commonly used jet radius parameters, and that missing higher-order estimates obtained via scale variations should be considered unreliable. Our findings add further evidence to the importance of going beyond scale variations in jet and jet substructure calculations.

Lee, Kyle↗
DOE OSTI2024

Geospatial Data Platform for All

Spatiotemporal data has evolved in scale due to augmented use in cross-domain applications. Simultaneously, there is substantial growth in the availability of Geographic Information Systems (GIS) data provided by the United States Geological Survey (USGS) along with other federal, state, county, or local agencies through open-data portals and public access APIs. However, data availability does not equate with accessibility. Large-scale analyses and applications require robust, performant data management with co-location of data storage and computing. The insufficiency of data management infrastructure compels researchers to adopt ad hoc project- specific GIS data storage solutions (e.g., copying data to High-Performance computer file systems). As an ad hoc storage strategy does not scale, it hampers cross-domain analyses causing difficulty in data reuse and utilizing existing code bases. Furthermore, GIS data is complex and requires expertise to analyze and manipulate due to its intricate data structures and data-specific projection transformations. Despite the challenges, we recognize that derived GIS data products, e.g., satellite or LIDAR-based images, can be used in downstream applications such as AI by domain, but non-GIS experts. To address the data needs and overcome the challenges, we are working towards a GIS Data Platform focused on efficient data storage, data discovery and access, and an API to enable common workflows. We propose a knowledge-graph (KG) approach for data discovery, whereby datasets are semantically linked to higher- level constructs such as projects and research areas. The semantic data links enable researchers to explore datasets in a top-down approach by specifying relevant and meaningful terms (assists in finding hidden data). An advantage is that the nodes and edges in a knowledge graph create built-in semantic documentation. Deeper spatiotemporal connections between data sources can be encoded via Graph Neural Networks (GNN) (Zhang et al., 2021). The KG approach can be extended to integrate the data itself in a Virtual KG (VKG). Our work will derive inspiration from large-scale VKG efforts that have been undertaken or are currently underway as part of the OpenStreetMap project (Ding et al., 2021). For DOE Data Days, we share the proposed geospatial data platform hybrid (cloud/on-prem) architecture, our work-to-date on storing, retrieving, and transforming LiDAR and raster data relevant to two important NREL use-cases, including the Renewable Energy Potential (reV) Model, and present our proposal for a KG based data discovery engine.

data platform↗
DOE OSTI2021

Injection data analysis using material balance time for CO 2 storage capacity estimation in deep closed saline aquifers

Estimating the ultimate storage capacity of deep saline aquifers is important to address the formation potential to store the envisioned large volumes of CO 2 . Injection data (i.e. injection rate, bottomhole pressure, and cumulative injected volume of CO 2 ) are routinely recorded during storage operations. These data contain valuable information on the subsurface (e.g. the reservoir pore volume and the formation storage capacity) that can be extracted. In this paper, we present a two-step graphical technique to infer the pore volume and the ultimate storage capacity of closed saline aquifers by analyzing the available injection data. First, the pore volume is inferred through adapting the concept of the material balance time. Material balance time is an approximate superposition time function developed to interpret production data from oil and gas wells operating at variable pressure/rate conditions during the boundary-dominated flow period. Using material balance techniques, the ultimate storage capacity is then estimated through linear extrapolation of the average pressure trend to the maximum allowable pressure the formation can withstand. The average pressure is not available in practice, but is can be obtained from the injection data. Two approaches are presented in this study to calculate the average pressure; namely the rigorous and the approximate approaches. Unlike the rigorous approach, the approximate approach does not require a prior knowledge of some reservoir properties (e.g. relative permeability, absolute permeability, formation porosity and thickness) to calculate the average pressure. To investigate its potential and reliability in analyzing CO 2 injection data, the proposed technique is applied to four synthetic cases representing different well operating conditions. Results indicate that the approximate approach consistently overestimates the actual (simulated) storage capacity as compared to the rigorous approach. The agreement - between the inferred and the simulated reservoir pore volume, and between the analytical and numerical estimates of storage capacity - validates the potential application of the technique to CO 2 storage in closed saline aquifers. The technique is further substantiated through application to a field data set utilized from a commercial-scale geological storage (CGS) project. Finally, field data interpretation shows that the proposed technique can be utilized to identify the degree of hydraulic continuity and reservoir compartmentalization within a target formation by interpreting the corresponding pressure and rate responses.

02 PETROLEUM↗
DOE OSTI2022

The MeerKAT Galaxy Cluster Legacy Survey I. Survey Overview and Highlights

MeerKAT’s large number (64) of 13.5 m diameter antennas, spanning 8 km with a densely packed 1 km core, create a powerful instrument for wide-area surveys, with high sensitivity over a wide range of angular scales. The MeerKAT Galaxy Cluster Legacy Survey (MGCLS) is a programme of long-track MeerKAT L-band (900–1670 MHz) observations of 115 galaxy clusters, observed for ~6–10 h each in full polarisation. The first legacy product data release (DR1), made available with this paper, includes the MeerKAT visibilities, basic image cubes at ~8" resolution, and enhanced spectral and polarisation image cubes at ~8" and 15" resolutions. Typical sensitivities for the full-resolution MGCLS image products range from ~3–5 μJy beam –1 . The basic cubes are full-field and span 2° × 2°. The enhanced products consist of the inner 1.2° × 1.2° field of view, corrected for the primary beam. The survey is fully sensitive to structures up to ~10' scales, and the wide bandwidth allows spectral and Faraday rotation mapping. Relatively narrow frequency channels (209 kHz) are also used to provide H I mapping in windows of 0 < z < 0.09 and 0.19 < z < 0.48. Here, in this paper, we provide an overview of the survey and the DR1 products, including caveats for usage. We present some initial results from the survey, both for their intrinsic scientific value and to highlight the capabilities for further exploration with these data. These include a primary-beam-corrected compact source catalogue of ~626 000 sources for the full survey and an optical and infrared cross-matched catalogue for compact sources in the primary-beam-corrected areas of Abell 209 and Abell S295. We examine dust unbiased star-formation rates as a function of cluster-centric radius in Abell 209, extending out to 3.5 R 200 . We find no dependence of the star-formation rate on distance from the cluster centre, and we observe a small excess of the radio-to-100 μm flux ratio towards the centre of Abell 209 that may reflect a ram pressure enhancement in the denser environment. We detect diffuse cluster radio emission in 62 of the surveyed systems and present a catalogue of the 99 diffuse cluster emission structures, of which 56 are new. These include mini-halos, halos, relics, and other diffuse structures for which no suitable characterisation currently exists. We highlight some of the radio galaxies that challenge current paradigms, such as trident-shaped structures, jets that remain well collimated far beyond their bending radius, and filamentary features linked to radio galaxies that likely illuminate magnetic flux tubes in the intracluster medium. We also present early results from the H I analysis of four clusters, which show a wide variety of H I mass distributions that reflect both sensitivity and intrinsic cluster effects, and the serendipitous discovery of a group in the foreground of Abell 3365.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Intra-annual variations of regional total column ozone, aerosol optical depth, and water vapor from ground-based, satellite-based and model-based observations

The Microtops II ozonometer has been deployed to continuously measure the total column ozone (TCO), pre-cipitable water content (PWC) and aerosol optical thickness (AOT) at Atigre village (16.74° N, 74.37° E, 604 m above sea level, masl) located on the southeastern slope of Indian western Ghats. The Microtops II ozonometer measurements during the period from September 2017 to June 2018 were analyzed along with the retrieved products of Ozone Monitoring Instrument (OMI) and Moderate Resolution Imaging Spectroradiometer (MODIS) onboard NASA's Terra satellites and also the ERA-interim reanalysis model. We found that the TCO (or PWC) data from the OMI (or MODIS) and the ERA reanalysis model data products are in good agreement. The mea-surements showed strong seasonal variability such that TCO was lowest in the winter season but increased in the summer season, and both PWC and AOT were lowest in the post-monsoon season and increased in the summer season. In continuous ERA-interim reanalysis TCO observations, we found the three types of periodicities in the daily mean TCO as well as PWC (i) The weekly (7 days), (ii) quasi-biweekly (14 to 16 days), (iii) Madden Julian Oscillations (MJO) (30–60 days) oscillations. These oscillations depend on the periodic weather changes in the troposphere. We also observe that the average day to day variability in daily mean TCO observations in the observational period is about 1.4%, 1.1%, 2.62% in the Microtops II ozonometer, ERA-interim reanalysis, and OMI data respectively. We found the positive correlation between daily mean AOT and PWC in all seasons (except monsoon), which is maximum in the winter season, showing the hygroscopic nature of aerosols. The sources of water vapor and aerosol at our location are also studied using back-trajectory analysis.

Nade, Dada R.↗
DOE OSTI2020

waveSZ: A Hardware-Algorithm Co-Design of Efficient Lossy Compression for Scientific Data

Error-bounded lossy compression is critical to the success of extreme-scale scientific research because of ever-increasing volumes of data produced by today's high-performance computing (HPC) applications. Not only can error-controlled lossy compressors significantly reduce the I/O and storage burden but they can retain high data fidelity for post analysis. Existing state-of-the-art lossy compressors, however, generally suffer from relatively low compression and decompression throughput (up to hundreds of megabytes per second on a single CPU core), which considerably restrict the adoption of lossy compression by many HPC applications especially those with a fairly high data production rate. In this paper, we propose a highly efficient lossy compression approach based on field programmable gate arrays (FPGAs) under the state-of-the-art lossy compression model SZ. Our contributions are fourfold. (1) We adopt a wavefront memory layout to alleviate the data dependency during the prediction for higher-dimensional predictors, such as the Lorenzo predictor. (2) We propose a co-design framework named WAVESZ based on the wavefront memory layout and the characteristics of SZ algorithm and carefully implement it by using high-level synthesis. (3) We propose a hardware-algorithm co-optimization method to improve the performance. (4) We evaluate our proposed WAVESZ on three real-world HPC simulation datasets from the Scientific Data Reduction Benchmarks and compare it with other state-of-the-art methods on both CPUs and FPGAs. Experiments show that our WAVESZ can improve SZ's compression throughput by 6.9x similar to 8.7x over the production version running on a state-of-the-art CPU and improve the compression ratio and throughput by 2.1x and 5.8x on average, respectively, respectively, compared with the state-of-the-art FPGA design.

Compression Ratio↗
DOE OSTI2026

Sensitivity Analysis of Drivers Water Shortage in the Los Angeles Region During Drought

The code and detailed step-by-step instructions for generating the model output data, processing results, and analysis and plotting are provided at https://github.com/IMMM-SFA/Ferencz_et_al_2026_ER_Water. The PyArtes model is a python adaptation of the Artes model. PyArtes uses many of the same input data and optimization model architecture as Artes. Documentation for the PyArtes model is provided in the Supplement to the paper. The primary data product are simulated monthly water shortages for indoor and outdoor demand under a large ensemble of drought scenarios (>13,000). The droughts are hypothetical and are not based on historical time series data of supply sources - though historical data did help inform ranges explored for supply parameters. Demands are informed by recent 2017-2021 water supply data. Demands used for the model can be accessed at https://github.com/IMMM-SFA/Ferencz_et_al_2026_ER_Water. Simulations resolve demand for over 90 water providers in the study region. The results report 36 months of water shortage data for each indoor and outdoor demand node. The study also developed a multilayer perceptron (MLP) neural network trained on a subset of the simulated shortage ensemble to emulate worst annual water shortage for a given set of parameter multipliers -- provided the parameter values fall within the ranges sampled in the ensemble. Emulated water shortages for synthetic ensembles are in the MLP-generated shortages folder. The MLP model was used to generate larger ensembles to support Sobol analysis that would have been extremely computationally expensive to simulate. Datasets provided in this repository*: Simulated shortages. These results are used for the analysis for Figures 5, 8, and 9 in the paper, and also to train the MLP emulator. .zip file containing outputs for the 13,312 scenario ensemble. Separate .csv files for indoor and outdoor shortage for each scenario. Rows = demand ids (~100), Columns = months (36) Units = acre-feet/month of shortage (shortage = monthly demand - supply). 1 acft = 1233.48 m^3 .csv files of aggregated shortages derived from the 13,312 ensemble Rows = scenarios (13,312), Columns = demand ids (~100) Units = acre-feet/year (either worst annual shortage or total shortage over the 3-year drought) .csv file of the parameter multipliers scenarios for the ensemble .csv file of the parameter ranges and baseline values the multipliers were applied to MLP-generated shortages. These results are used for Figures 4, 6, and 7 in the paper. mwd higher folder: scenario ensembles, emulated worst year total shortages (acft), and Sobol results Emulated shortages. Rows = scenarios, columns = demand ids, units acft Sobol results. Rows = demand ids, columns Sobol (S1, ST, or 95% confidence interval) value for each parameter mwd lower folder: scenario ensembles, emulated worst year total shortages (acft), and Sobol results same organization as mwd higher MLP performance: performance metrics (R^2, RMSE, BIAS, MAPE) for the testing subset (20% or 2,662 scenarios) and simulated vs emulated worst year shortage (acre-feet/year) for every demand node, MWD wholesale regions, and the entire study region (LAC). Supporting data for figures. Figure plotting scripts in the associated GitHub repo. These files support analysis and visualization. Geospatial Data used for plotting simulated water shortages and Sobol results. Dictionary of full names for demand nodes in the model and estimates of water supply by source type informed by Artes input files and California Urban Water Management Planning data: https://water.ca.gov/Programs/Water-Use-And-Efficiency/Urban-Water-Use-Efficiency/Urban-Water-Management-Plans *Readme files provided for each folder.

drought↗
DOE OSTI2025

A Morphological Model to Separate Resolved–Unresolved Sources in the DESI Legacy Surveys: Application in the LS4 Alert Stream

Separating resolved and unresolved sources in large imaging surveys is a fundamental step to enable downstream science, such as searching for extragalactic transients in wide-field time-domain surveys. Here we present our method to effectively separate point sources from the resolved, extended sources in the Dark Energy Spectroscopic Instrument (DESI) Legacy Surveys (LS). We develop a supervised machine learning model based on the Gradient Boosting algorithm XGBoost. The features input to the model are purely morphological and are derived from the tabulated LS data products. We train the model using ∼2 × 10 5 LS sources in the COSMOS field with HST morphological labels and evaluate the model performance on LS sources with spectroscopic classification from the DESI Data Release 1 (∼2 × 10 7 objects) and the Sloan Digital Sky Survey Data Release 17 (∼3 × 10 6 objects), as well as on ∼2 × 10 8 Gaia stars. A significant fraction of LS sources are not observed in every LS filter, and we therefore build a “Hybrid” model as a linear combination of two XGBoost models, each containing features combining aperture flux measurements from the “blue” (gr) and “red” (iz) filters. The Hybrid model shows a reasonable balance between sensitivity and robustness, and achieves higher accuracy and flexibility compared to the LS morphological typing. With the Hybrid model, we provide classification scores for ∼3 × 10 9 LS sources, making this the largest ever machine learning catalog separating resolved and unresolved sources. The catalog has been incorporated into the real-time pipeline of the La Silla Schmidt Southern Survey (LS4), enabling the identification of extragalactic transients within the LS4 alert stream.

astrostatistics↗
DOE OSTI2021

Development of a Random-Forest Cloud-Regime Classification Model Based on Surface Radiation and Cloud Products

Various methods have been developed to characterize cloud type, otherwise referred to as cloud regime. These include manual sky observations, combining radiative and cloud vertical properties observed from satellite, surface-based remote sensing, and digital processing of sky imagers. While each method has inherent advantages and disadvantages, none of these cloud-typing methods actually includes measurements of surface shortwave or longwave radiative fluxes. Here, a method that relies upon detailed, surface-based radiation and cloud measurements and derived data products to train a random-forest machine-learning cloud classification model is introduced. Measurements from five years of data from the ARM Southern Great Plains site were compiled to train and independently evaluate the model classification performance. A cloud-type accuracy of approximately 80% using the random-forest classifier reveals that the model is well suited to predict climatological cloud properties. Furthermore, an analysis of the cloud-type misclassifications is performed. While physical cloud types may be misreported, the shortwave radiative signatures are similar between misclassified cloud types. From this, we assert that the cloud-regime model has the capacity to successfully differentiate clouds with comparable cloud–radiative interactions. Therefore, we conclude that the model can provide useful cloud-property information for fundamental cloud studies, inform renewable energy studies, and be a tool for numerical model evaluation and parameterization improvement, among many other applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Recovery of Neptunium-236g from Photon and Proton-Irradiated Actinide Targets

Neptunium-236g is a rare radionuclide used as a tracer for neptunium-237 analyses. The availability of 236gNp is limited and the viable production routes are costly, time consuming, and only produce trace quantities of the desired product. For this work, two known production methods were tested to determine product recovery, purity, and viability for use as a tracer. The first method utilizes a photon-irradiated 237Np target to produce 236gNp by the 237Np(?,n)?236Np reaction. The second method utilizes the 238U(d,4n) ?236Np reaction. These production routes were evaluated previously, and the former was considered ineffective without isotope separation and the latter was not well-characterized for the 236mNp/236gNp production ratio. Recent resurgence of electromagnetic isotope separation technology has enabled at least partial recovery of 236gNp from part-per-million abundance feeds produced by the photonuclear reaction. To address the lack of production data for the second method, a deuteron-irradiated depleted uranium target was chemically processed to recover and purify the Np for abundance and ratio analyses. The status and current analytical results for each production method are presented.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2026

APPL Hyperspectral_Imaging_Dataset_for_Heritability_Analysis_in_Populus_trichocarpa

This dataset contains hyperspectral imaging data collected at the Advanced Plant Phenotyping Laboratory (APPL) at Oak Ridge National Laboratory. Natural variants of Populus trichocarpa were imaged using a high-throughput hyperspectral phenotyping pipeline to quantify spectral reflectance traits for downstream quantitative genetics analyses. The dataset includes hyperspectral image files and derived reflectance data products suitable for extracting spectral features across the measured wavelength range (e.g., VNIR and/or SWIR, depending on instrument configuration), along with associated sample metadata (e.g., genotype identifiers, experimental design factors, and imaging run identifiers). These data were generated to support analyses of broad-sense heritability of hyperspectral traits and their relationships with biochemical phenotypes (including lignin traits from Py-MBMS).

APPL↗
DOE OSTI2020

A nonparametric approach to modeling dependence among production parameters for energy cost estimation

Dependence existing among production parameters can significantly affect energy costs. For material removal processes, processing times and material amounts to be cut have positive dependence, and the dependence can affect energy costs by varying a peak electricity load. Existing methods to model the dependence of production parameters are based on parametric approaches that cannot accurately represent the dependence due to the rigid nature of parametric models. To address this issue, this study proposes a method to quantify dependence among manufacturing parameters through the application of the empirical copula to the dependence between the milling processing time and the amount of volume to be cut. The proposed method is illustrated by a case study of a manufacturing facility consisting of milling machines; a total of 27 scenarios are simulated for energy cost estimations. The case study clearly shows that the proposed method can capture the dependence between the milling parameters more accurately than a conventional dependence measure from parametric correlation models. Furthermore, the findings from this study would be useful to estimate energy costs in that the proposed method provides a better fit to real production data than conventional parametric approaches can.

42 ENGINEERING↗
DOE OSTI2025

Advancements and opportunities to improve bottom–up estimates of global wetland methane emissions

Wetlands are the single largest natural source of atmospheric methane (CH 4 ), contributing approximately 30% of total surface CH 4 emissions, and they have been identified as the largest source of uncertainty in the global CH 4 budget based on the most recent Global Carbon Project CH 4 report. High uncertainties in the bottom–up estimates of wetland CH 4 emissions pose significant challenges for accurately understanding their spatiotemporal variations, and for the scientific community to monitor wetland CH 4 emissions from space. In fact, there are large disagreements between bottom–up estimates versus top–down estimates inferred from inversion of atmospheric CH 4 concentrations. To address these critical gaps, we review recent development, validation, and applications of bottom–up estimates of global wetland CH 4 emissions, as well as how they are used in top–down inversions. These bottom–up estimates, using (1) empirical biogeochemical modeling (e.g. WetCHARTs: 125–208 TgCH 4 yr -1 ); (2) process-based biogeochemical modeling (e.g. WETCHIMP: 190 ± 39 TgCH 4 yr -1 ); and (3) data-driven machine learning approach (e.g. UpCH4: 146 ± 43 TgCH 4 yr -1 ). Bottom–up estimates are subject to significant uncertainties (~80 Tg CH 4 yr -1 ), and the ranges of different estimates do not overlap, further amplifying the overall uncertainty when combining multiple data products. These substantial uncertainties highlight gaps in our understanding of wetland CH 4 biogeochemistry and wetland inundation dynamics. Major tropical and arctic wetland complexes are regional hotspots of CH 4 emissions. However, the scarcity of satellite data over the tropics and northern high latitudes offer limited information for top–down inversions to improve bottom–up estimates. Recent advances in surface measurements of CH 4 fluxes (e.g. FLUXNET-CH 4 ) across a wide range of ecosystems including bogs, fens, marshes, and forest swamps provide an unprecedented opportunity to improve existing bottom–up estimates of wetland CH 4 estimates. We suggest that continuous long-term surface measurements at representative wetlands, high fidelity wetland mapping, combined with an appropriate modeling framework, will be needed to significantly improve global estimates of wetland CH 4 emissions. There is also a pressing unmet need for fine-resolution and high-precision satellite CH 4 observations directed at wetlands.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

ABACUSSUMMIT : a massive set of high-accuracy, high-resolution N -body simulations

We present the public data release of the AbacusSummit cosmological N-body simulation suite, produced with the Abacus N-body code on the Summit supercomputer of the Oak Ridge Leadership Computing Facility. Abacus achieves $\mathcal {O}(10^{-5})$ median fractional force error at superlative speeds, calculating 70M particle updates per second per node at early times, and 45M particle updates per second per node at late times. The simulation suite totals roughly 60 trillion particles, the core of which is a set of 139 simulations with particle mass $2\times 10^{9}\, h^{-1}\, \mathrm{M}_\odot$ in box size $2\, h^{-1}\, \mathrm{Gpc}$. The suite spans 97 cosmological models, including Planck 2018, previous flagship simulation cosmologies, and a linear derivative and cosmic emulator grid. A subsuite of 1883 boxes of size $500\, h^{-1}\, \mathrm{Mpc}$ is available for covariance estimation. AbacusSummit data products span 33 epochs from z = 8 to 0.1 and include light cones, full particle snapshots, halo catalogues, and particle subsets sampled consistently across redshift. AbacusSummit is the largest high-accuracy cosmological N-body data set produced to date.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

An Integrated Multiscale Modeling Framework for Unconventional Stimulation and Production (Final Report)

The production of oil and gas from unconventional reservoirs largely depends upon two main features operating at different scales: (1) the establishment of a reservoir scale stimulated fracture network that effectively communicates with the rock volume, enhancing permeability and transport to the wellbore and (2) the coupled multi-phase flow, chemical and mechanical processes affecting the migration of hydrocarbons from the low permeability country rock adjacent to the stimulated fracture network. To date, there has been no simulation framework that allows seamless and integrated prediction of these features across spatial scales extending from the pore structure of the reservoir rock to the volume of the reservoir. In addition, there has been a lack of suitable field measurements to test such models, as stimulation and production data are often proprietary and not freely available to national laboratories and academic institutions. New multi-scale simulation capabilities are needed that are validated against suitable field-based research experiments on hydraulic fracturing and shale production.

02 PETROLEUM↗
DOE OSTI2020

Automated Integration of Continental-Scale Observations in Near-Real Time for Simulation and Analysis of Biosphere–Atmosphere Interactions

The National Ecological Observatory Network (NEON) is a continental-scale observatory with sites across the US collecting standardized ecological observations that will operate for multiple decades. To maximize the utility of NEON data, we envision edge computing systems that gather, calibrate, aggregate, and ingest measurements in an integrated fashion. Edge systems will employ machine learning methods to cross-calibrate, gap-fill and provision data in near-real time to the NEON Data Portal and to High Performance Computing (HPC) systems, running ensembles of Earth system models (ESMs) that assimilate the data. For the first time gridded EC data products and response functions promise to offset pervasive observational biases through evaluating, benchmarking, optimizing parameters, and training new machine learning parameterizations within ESMs all at the same model-grid scale. Leveraging open-source software for EC data analysis, we are already building software infrastructure for integration of near-real time data streams into the International Land Model Benchmarking (ILAMB) package for use by the wider research community. We will present a perspective on the design and integration of end-to-end infrastructure for data acquisition, edge computing, HPC simulation, analysis, and validation, where Artificial Intelligence (AI) approaches are used throughout the distributed workflow to improve accuracy and computational performance.

Durden, David J.↗