mergedflux.c1
This data product combines the ECOR, SEBS, AMC, and STAMP datastreams, where deployed, into a single data product (csv format) following AmeriFlux standards
54 ENVIRONMENTAL SCIENCES↗
SEARCH · Engineering Papers
Results for “data products”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Next-Level Energy Management in Manufacturing: Facility-Level Energy Digital Twin Framework Based on Machine Learning and Automated Data Collection
This research introduces an energy prediction framework at the facility level supported by automated data collection and machine learning models. It investigates whether reducing the prediction time scale allows for applying more complex machine learning techniques and if those techniques improve the prediction accuracy. The primary advantages of this framework lie in its automation of the energy prediction process and its provision of real-time energy data suitable for use in energy dashboards or digital twins. A sitewide dataset was created by combining 15 min energy and daily production data of five shops—assembly, battery, body (electric), body (gas), and paint—from a globally recognized electric vehicle manufacturer. Various machine learning models were evaluated on daily, weekly, and monthly datasets, including, in increasingly complex order: naïve, simple linear regression, net regularized generalized linear regression, principal component regression, k-nearest neighbor, random forest, and Bayesian regularized neural network. Compared to the current state-of-the-art energy consumption prediction for the industrial facility level, this research investigates more complex models and smaller time intervals for higher accuracy. The findings revealed that the more complex monthly models require a minimum of a year and a half of data to operate, while weekly models demand a year of data to achieve improved accuracy. Daily models can operate with only six months of data but exhibit poor performance due to reduced prediction accuracy of production. Key challenges identified include access to reliable, high-quality energy and production data and the initial demand for human labor.
digital twin↗
Fission Product Release Data Summary Covering AGR-1 through AGR-3/4 [Slides]
Presentation on a summary of DOE's AGR TRISO fuel program fission product release measurements. To be given at the annual ART GCR program review hosted by INL.
11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
In-medium changes of nucleon cross sections tested in neutrino-induced reactions
Historically, studied in the context of heavy-ion collisions, the extent to which free nucleon-nucleon cross sections are modified in-medium remains undetermined by these data sets. Therefore, we investigate the impact of N N in-medium modifications on neutrino-nucleus cross section predictions using the GiBUU transport model. We find that including an in-medium lowering of the N N cross section and density dependence on Δ excitation improves agreement with MicroBooNE neutrino-argon scattering data. This is observed for both proton and neutral pion spectra in charged-current muon neutrino and neutral-current single pion production data sets. The impact of collision broadening of the Δ resonance is also investigated. The absence of Δ broadening is slightly favored, but the larger uncertainties on the pion production data prevent definitive conclusions. Published by the American Physical Society 2024
Bogart, B. (ORCID:0000000305588934)↗
Optimising the processing and storage of visibilities using lossy compression
The next-generation radio astronomy instruments are providing a massive increase in sensitivity and coverage, largely through increasing the number of stations in the array and the frequency span sampled. The two primary problems encountered when processing the resultant avalanche of data are the need for abundant storage and the constraints imposed by I/O, as I/O bandwidths drop significantly on cold storage. An example of this is the data deluge expected from the SKA Telescopes of more than 60 PB per day, all to be stored on the buffer filesystem. While compressing the data is an obvious solution, the impacts on the final data products are hard to predict. In this paper, we chose an error-controlled compressor – MGARD – and applied it to simulated SKA-Mid and real pathfinder visibility data, in noise-free and noise-dominated regimes. As the data have an implicit error level in the system temperature, using an error bound in compression provides a natural metric for compression. MGARD ensures the compression incurred errors adhere to the user-prescribed tolerance. To measure the degradation of images reconstructed using the lossy compressed data, we proposed a list of diagnostic measures, exploring the trade-off between these error bounds and the corresponding compression ratios, as well as the impact on science quality derived from the lossy compressed data products through a series of experiments. We studied the global and local impacts on the output images for continuum and spectral line examples. We found relative error bounds of as much as 10%, which provide compression ratios of about 20, have a limited impact on the continuum imaging as the increased noise is less than the image RMS, whereas a 1% error bound (compression ratio of 8) introduces an increase in noise of about an order of magnitude less than the image RMS. For extremely sensitive observations and for very precious data, we would recommend a 0.1% error bound with compression ratios of about 4. These have noise impacts two orders of magnitude less than the image RMS levels. At these levels, the limits are due to instabilities in the deconvolution methods. We compared the results to the alternative compression tool DYSCO, in both the impacts on the images and in the relative flexibility. MGARD provides better compression for similar error bounds and has a host of potentially powerful additional features.
Techniques: interferometric↗
The Early Data Release of the Dark Energy Spectroscopic Instrument
The Dark Energy Spectroscopic Instrument (DESI) completed its 5 month Survey Validation in 2021 May. Spectra of stellar and extragalactic targets from Survey Validation constitute the first major data sample from the DESI survey. This paper describes the public release of those spectra, the catalogs of derived properties, and the intermediate data products. In total, the public release includes good-quality spectral information from 466,447 objects targeted as part of the Milky Way Survey, 428,758 as part of the Bright Galaxy Survey, 227,318 as part of the Luminous Red Galaxy sample, 437,664 as part of the Emission Line Galaxy sample, and 76,079 as part of the Quasar sample. In addition, the release includes spectral information from 137,148 objects that expand the scope beyond the primary samples as part of a series of secondary programs. Here, we describe the spectral data, data quality, data products, Large-Scale Structure science catalogs, access to the data, and references that provide relevant background to using these spectra.
79 ASTRONOMY AND ASTROPHYSICS↗
Strangeness in the proton from $W+$ charm production and SIDIS data
We perform a global QCD analysis of unpolarized parton distribution functions (PDFs) in the proton, including new 𝑊+ charm production data from 𝑝𝑝 collisions at the LHC and semi-inclusive pion and kaon production data in lepton-nucleon deep-inelastic scattering, both of which have been suggested for constraining the strange quark PDF. Compared with a baseline global fit that does not include these datasets, the new analysis reduces the uncertainty on the strange quark distribution over the range 0.01 < 𝑥 < 0.3, and provides a consistent description of processes sensitive to strangeness in the proton. Including the new datasets, the ratio of strange to nonstrange sea quark distributions is $R_s = (s + \bar{s})/(\bar{u} +\bar{d})$ $=$ {$0.72^{+0.52}_{−0.34}, 0.46^{+0.30}_{−0.20}, 0.32^{+0.23}_{−0.15}$} for 𝑥 ={$0.01, 0.04, 0.1$} at 𝑄 2 $=$ 4 GeV 2 . The data place more stringent constraints on the strange asymmetry $(s - \bar{s})$, which is found to be consistent with zero in this range.
Anderson, Trey [College of William and Mary, Willi↗
An ML-based terrestrial data fusion and augmentation framework to enable advanced understanding of the terrestrial carbon and water interactions
Soil moisture is essential to the terrestrial carbon and water cycles and land–atmosphere interactions. There are various types of soil moisture data, and each type has the distinct spatiotemporal strengths and limitations, depending on the diverse applications and retrieval methodologies of different data types (Li et al., in review; The PNNL-82151 FY23 Report). However, the limitations of different soil moisture data in terms of accuracy and spatiotemporal coverage hinder our ability to further understand the soil moisture dynamics across scales. To have a gap free soil moisture data product with a fine spatiotemporal coverage and vertical profiles, we train extreme gradient boosting (XGBoost) models by using (1) in-situ soil moisture measurements from the International Soil Moisture Network (ISMN), (2) soil moisture from the ECMWF reanalysis (ERA) at the 9 km and sub-daily spatiotemporal resolution, (3) the Daymet meteorological fields, and (4) data products that characterize surface conditions, including soil texture, organic content, topography, vegetation type, and rooting depth. We use the trained XGBoost models that have consistent performance across seven soil layers, i.e., 0–5 cm, 5–10 cm, 10–20 cm, 20–40 cm, 40–60 cm, 60–100 cm, and 100–200 cm, and the gridded model predictors to generate a soil moisture data at the 1 km and daily spatiotemporal resolution for the Continental United States (CONUS) from 2001–2020. This dataset can be broadly used for Earth system model benchmark, monitoring extreme weathers, making informed decisions regarding agriculture, water resource management, climate change mitigation, and ecosystem preservation.
58 GEOSCIENCES↗
Community and Passenger Survey Responses for Bastrop, Texas Low-Speed Electric Vehicle Mobility Service Project
This document describes the contents of the following data products: 1. ALL-survey_results_NREL_LiveWire_04_14_2023 (Excel file with two worksheets) 2. eCab_DOE_NREL_LiveWire_04_14_2023_results_all_surveys_except_SP_csv (CSV file) 3. eCab_DOE_NREL_LiveWire_04_14_2023_SP_survey_results_only_csv (CSV file). These data products contain the results of the surveys conducted throughout the DOE-funded Electric First-/Last-Mile On-Demand Shuttle Service for Rural Communities in Central Texas project. The Excel file is the original database of all the survey results (contained in two worksheets). The CSV files are those two worksheets saved as individual CSV files.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Evaluating downscaled products with expected hydroclimatic co-variances
Abstract. There has been widespread adoption of downscaled products amongst practitioners and stakeholders to ascertain risk from climate hazards at the local scale (e.g., ∼ 5 km resolution). Such products must nevertheless be consistent with physical laws to be credible and of value to users. Here we evaluate statistically and dynamically downscaled products by examining local co-evolution of downscaled temperature and precipitation during convective and frontal precipitation events (two mechanisms testable with just temperature and precipitation). We find that two widely used statistical downscaling techniques (Localized Constructed Analogs version 2, LOCA2, and Seasonal Trends and Analysis of Residuals Empirical Statistical Downscaling Model, STAR-ESDM) generally preserve expected co-variances during convective precipitation events over the historical and future projected intervals as compared to European Centre for Medium-Range Weather Forecasts Reanalysis v5 (ERA5) and two observation-based data products (Livneh and nClimGrid-Daily). However, both techniques dampen future intensification of frontal precipitation that is otherwise robustly captured in global climate models (i.e., prior to downscaling) and with process-based dynamical downscaling across five different regional climate models. In the case of LOCA2, this leads to appreciable underestimation of future frontal precipitation event intensity. This study is one of the first to quantify a likely ramification of the stationarity assumption underlying statistical downscaling methods and identify a phenomenon where projections of future change diverge depending on data production method employed. Finally, our work proposes expected co-variances during convective and frontal precipitation as useful evaluation diagnostics that can be universally applied to a wide range of statistically downscaled products.
54 ENVIRONMENTAL SCIENCES↗
Identification and Photometric Classification of Extragalactic Transients in the Vera C. Rubin Observatory’s Data Preview 1
The Vera C. Rubin Observatory will soon survey the southern sky, delivering a depth and sky coverage that is unprecedented in time-domain astronomy. As part of commissioning, Data Preview 1 (DP1) has been released. It comprises a Legacy Survey of Space and Time (LSST) Commissioning Camera observing campaign between 2024 November and December with multiband imaging of seven fields, covering roughly 0.4 deg 2 each, providing a first glimpse into the data products that will become available once the LSST begins. In this work, we search three fields for extragalactic transients. We identify eight new likely supernovae (SNe), and three known ones from a sample of 369,644 difference image analysis objects. Photometric classification using Superphot+ assigns subclasses with >95% confidence to only one SN Ia and one SN II in this sample. Our findings are in agreement with SN detection rate predictions of 15 ± 4 SNe from simulations using simsurvey. The SN detection rate in the data is possibly affected by the lack of suitable templates. Nevertheless, this work demonstrates the quality of the data products delivered in DP1 and indicates that the Rubin Observatory’s LSST is well placed to fulfill its discovery potential in time-domain astronomy.
Freeburn, James [University of North Carolina, Cha↗
NGEE Arctic Integrated Modeling (IM2): Improved subgrid hillslope hydrologic connectivity
This data product represents the integration of new code capability for arctic tundra hillslope hydrologic processes into the Energy Exascale Earth System Model (E3SM), through the E3SM Land Model (ELM) component. This code integration is the result of collaborative effort between the NGEE Arctic project and the E3SM project. The current ELM represents water movement primarily through vertical processes, such as precipitation, canopy interception, evaporation, infiltration, and soil water movement. Lateral water movement—such as surface runoff, subsurface flow, and river transport—plays a significant role in the hydrological cycle, especially in regions with varied topography. While E3SM includes a runoff routing component representing water transport in the river network, the lateral transport of water at the subgrid scale within the land model has previously not been taken into account. With the recent development of topographic units within the ELM subgrid data structure, there is an opportunity to simulate hillslope hydrologic connectivity by introducing water transport along topographic gradients. We expect that more realistic representation of hillslope hydrologic processes will lead to improved predictions of both soil water content and river network flows. Lateral transport of water at and near the surface is represented as a sub-grid process in this new code development. Water is tracked as it moves from higher to lower elevations within a gridcell. This capability uses the nested hierarchical sub-grid scheme within ELM to connect water fluxes from sub-grid elements with higher elevation to those with lower elevation. This data record consists of a single document (pdf format) that describes the theoretical basis for the hillslope hydrology processes added to ELM, and describes the modifications made to the ELM code. The Methods section of this metadata record includes a link to the public E3SM code repository where the exact code modifications as integrated in E3SM can be accessed. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
Thornton, Peter E [ORNL] (ORCID:0000000247595158)↗
A Novel Segmentation Algorithm for the ARM User Facility All-Sky Imagers Using Machine Learning Applications
Cloud cover plays a pivotal role in modulating the Earth's energy budget through the reflection of incoming solar radiation and the trapping of outgoing longwave radiation. Ground-based all-sky imagers offer an objective assessment of cloud cover that can be used to estimate solar irradiance, classify cloud types, track cloud movement, and serve as a benchmark 10 for the evaluation of satellite and reanalysis data products. The Atmospheric Radiation Measurement (ARM) user facility has utilized all-sky imagers for more than 25 years to monitor cloud cover and augment its comprehensive suite of atmospheric measurements. Following the retirement of its Total Sky Imager (TSI), ARM recently deployed the TSI’s successor, the All Sky Imager (ASI-16 camera systems). To provide a smooth transition and continuity to the vast amount of knowledge gathered by the TSI over the years, while addressing typical deployment issues, we developed a novel pixel segmentation algorithm, 15 the ASI Sky Cover (ASISKYCOVER). ASISKYCOVER builds on the different strengths and properties of the TSI processing algorithm while integrating machine learning techniques, ensuring data validity and accuracy across diverse atmospheric conditions. It enhances cloud cover characterization with new features such as artifact detection and uncertainty quantification. ASISKYCOVER also includes cloud cover estimates for near-zenith (narrow field-of-view) and reduces susceptibility to false detections. This study introduces ASISKYCOVER, details its algorithm framework, and demonstrates its capabilities using a 20 year-long dataset from the ARM Southern Great Plains site. Comparisons with co-located TSI data and other ARM measurements, such as zenith-pointing radars and lidars, are presented, underscoring the ASISKYCOVER’s potential to improve cloud cover analyses and data evaluation efforts, as well as to be integrated into higher-level data products that synergize instrument suites to generate new and insightful information
Silber, Israel↗
Comparative Economic Analysis Between Bioenergy and Forage Types of Switchgrass for Sustainable Biofuel Feedstock Production: A Data Envelopment Analysis and Cost–Benefit Analysis Approach
ABSTRACT The capacity to produce switchgrass efficiently and cost‐effectively across diverse environments can be pivotal in achieving the short‐ and medium‐term Sustainable Aviation Fuel targets set by the U.S. Department of Energy. This study evaluated the economic performance of forage‐ and bioenergy‐type switchgrass cultivars and their response to N fertilization under diverse marginal environments across the US Midwest that included Illinois (IL), Iowa (IA), Nebraska (NE), and South Dakota (SD). Data Envelopment Analysis (DEA) was used to evaluate the efficiency of 23 Decision‐Making Units (DMUs)—cultivar types and N fertilization rate combinations—while a cost–benefit analysis calculated their profitability over 5 years. Results showed that two energy‐type cultivars—“Independence” and “Liberty”—were superior economically to the forage cultivars. Independence performed best with the highest profit margin when fertilized at 56 kg N ha −1 , particularly in the US hardiness zone 6a (Urbana, IL). Liberty exhibited the highest profit margins in hardiness zone 5b (Madrid, IA, and Ithaca, NE) at 56 kg N ha −1 and showed exceptional profitability with 28 kg N ha −1 in hardiness zone 6b (Brighton, IL). Switchgrass cultivar “Carthage” showed better efficiency score and profitability results in hardiness zone 4b (South Shore, SD) at 56 kg N ha −1 . The profit trends observed in current study sites may indicate broader patterns across similar US hardiness zones. This study provides valuable insights for decision‐makers to optimize input strategies for biomass production of bioenergy switchgrass to meet renewable energy demands.
Arshad, Muhammad Umer [Department of Crop Sciences↗
Surrogate models for development of unconventional shale reservoirs by an integrated numerical approach of hydraulic fracturing, flow and geomechanics, and machine learning
We develop well-completion surrogate models by taking an integrated workflow of hydraulic fracturing, flow, geomechanics, and machine learning simulation. There are three steps in the proposed workflow. First, history-matching processes are conducted with the field data including pumping and production data for characterization. Second, full-physics simulation is performed with various parameters of the field development (e.g., cluster spacing, clusters per stage, pumping rates and times, amount of proppant, and well spacing) to generate multiple simulation results by changing the parameters of the completion design with well-known hydraulic fracturing, reservoir, geomechanics simulators to calculate fracture geometry, reservoir depressurization, induced stress changes. The workflow is demonstrated over a field in the Southern Midland Basin. Here, we take two completion scenarios: a single well case followed by a multi-well case. Finally, a Long Short-Term Memory (LSTM) machine learning algorithm is employed to create surrogate models that can replicate the full-physics simulation results. Furthermore, results show that the trained models applied in the single well and multi-well cases for a particular geological system can provide good accuracy close to those provided by full-physics simulations. Specifically, the site-specific surrogate models can predict fracture parameters (length, height, and surface area) and cumulative production accurately with computational efficiency, suggesting our proposed workflow can be used as a pragmatic tool for expediting the well completion optimization process.
Geomechanics↗
Data for Production of a δ-Lactam from Glucose through Integrating Biological and Chemical Catalysis
We present a new strategy for the production of a δ-lactam from glucose that integrates biological production of triacetic acid lactone (TAL, 4-hydroxy-6-methyl-2H-2-one) with catalytic transformation of TAL into 6-methylpiperidin-2-one (MPO) through metabolic engineering, isomerization, amination, and catalytic hydrogenation/hydrogenolysis. We developed a sustainable and antibiotic-free fed-batch fermentation using genetically modified Rhodotorula toruloides IFO0880. This process achieved a yield of 2-hydroxy-6-methyl-4H-pyran-4-one (2H4P) at 0.05 g/g of glucose, corresponding to a 9.9 g/L titer. By adjusting the pH of the fermentation broth to 2, 2H4P was quantitatively converted into TAL. The TAL in the fermentation broth was directly converted by aminolysis into 4-hydroxy-6-methylpyridin-2(1H)-one (HMPO), which achieved an 18.5% yield with 94.3% purity. The HMPO yield was lower in the fermentation broth than in a clean feedstock (32.2%), suggesting that the biological impurities are inhibitors in this reaction. Further investigation revealed that lower pH levels and reduced TAL concentrations in the fermentation broth significantly decreased HMPO yields. Subsequently, the precipitated HMPO was filtered and dried and then subjected to the final catalytic conversion in H2O solvent, achieving a MPO yield of 91.8%. This integrated approach demonstrated the direct use of TAL in the filtered aqueous fermentation broth without the need to isolate TAL.
Catalysis↗
Enhancing Discoverability and Management of Atmospheric Data at Scale: Solutions from the ARM Data Center
The Atmospheric Radiation Measurement (ARM) is a multi-laboratory and multi-institutional U.S. Department of Energy (DOE) Office of Science National User Facility. The ARM Data Center (ADC), located at Oak Ridge National Laboratory, collects, archives, and shares vast atmospheric data crucial for climate research. The ADC manages over 7 PB of data from 460 instruments worldwide, processing it into more than 11,000 diverse data products using the Network Common Data Form (NetCDF) for machine-independent accessibility. The primary challenge addressed in this paper is the efficient management and distribution of vast and diverse datasets essential for the climate research community, enhancing accessibility through advanced tools like Data Discovery. The ADC has developed advanced infrastructure and software architecture to handle the continuous influx of heterogeneous data to enhance data discoverability, resulting in increased scientific collaboration. In 2023, users from over 34 countries downloaded and utilized ARM data, resulting in 1,455 publications. The ADC’s efforts have significantly improved the discoverability and usability of atmospheric data, fostering extensive scientific research and collaboration. This paper details the solutions implemented by the ADC team for efficient data discovery and distribution, and it demonstrates ARM’s capability of staging processed data for scientific analysis.
Shah, Chirag [ORNL] (ORCID:0000000203145737)↗
Long-term measurements of ice nucleating particles at Atmospheric Radiation Measurement (ARM) sites worldwide
Ice nucleating particles (INPs) play a critical role in cloud microphysics and precipitation formation, yet long-term, spatially extensive observational datasets remain limited. Here, we present one of the most comprehensive publicly available datasets of immersion-mode INP concentrations using a single analytical method, generated through the U.S. Department of Energy's (DOE) Atmospheric Radiation Measurement (ARM) user facility. INP filter samples have been collected across a broad range of environments – including agricultural plains, Arctic coastlines, high-elevation mountain sites, marine regions, and urban areas – via fixed observatories, mobile facility deployments, and vertically-resolved tethered balloon system operations. We describe the standardized processing and quality assurance pipeline, from filter collection and processing using the Ice Nucleation Spectrometer to final data products archived on the ARM Data Discovery portal. The dataset includes both total INP concentrations and selectively treated samples, allowing for classification of biological, organic, and inorganic INP types. It features a continuous 5-year record of INP measurements from a central U.S. site, with data collection still ongoing. Seasonal and site-specific differences in INP concentrations are illustrated through intercomparisons at −10 and −20 °C, revealing distinct regional sources and atmospheric drivers. We also outline mechanisms for researchers to access existing data, request additional sample analyses, and propose future field campaigns involving ARM INP measurements. This dataset supports a wide range of scientific applications, from observational and mechanistic studies to model development, and provides critical constraints on aerosol-cloud interactions across diverse atmospheric regimes (Creamean et al., 2024, 2020b; https://doi.org/10.5439/1770816).
Creamean, Jessie M. [Colorado State Univ., Fort Co↗