SEARCH · Engineering Papers

Results for “data versions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Measurements and Model Improvement: Insight into NWP Model Error Using Doppler Lidar and Other WFIP2 Measurement Systems

Abstract Doppler-lidar wind-profile measurements at three sites were used to evaluate NWP model errors from two versions of NOAA’s 3-km-grid HRRR model, to see whether updates in the latest version 4 reduced errors when compared against the original version 1. Nested (750-m grid) versions of each were also tested to see how grid spacing affected forecast skill. The measurements were part of the field phase of the Second Wind Forecasting Improvement Project (WFIP2), an 18-month deployment into central Oregon–Washington, a major wind-energy-producing region. This study focuses on errors in simulating marine intrusions, a summertime, 600–800-m-deep, regional sea-breeze flow found to generate large errors. HRRR errors proved to be complex and site dependent. The most prominent error resulted from a premature drop in modeled marine-intrusion wind speeds after local midnight, when lidar-measured winds of greater than 8 m s −1 persisted through the next morning. These large negative errors were offset at low levels by positive errors due to excessive mixing, complicating the interpretation of model “improvement,” such that the updates to the full-scale versions produced mixed results, sometimes enhancing but sometimes degrading model skill. Nesting consistently improved model performance, with version 1’s nest producing the smallest errors overall. HRRR’s ability to represent the stages of sea-breeze forcing was evaluated using radiation budget, surface-energy balance, and near-surface temperature measurements available during WFIP2. The significant site-to-site differences in model error and the complex nature of these errors mean that field-measurement campaigns having dense arrays of profiling sensors are necessary to properly diagnose and characterize model errors, as part of a systematic approach to NWP model improvement. Significance Statement Dramatic increases in NWP model skill will be required over the coming decades. This paper describes the role of major deployments of accurate profiling sensors in achieving that goal and presents an example from the Second Wind Forecast Improvement Program (WFIP2). Wind-profile data from scanning Doppler lidars were used to evaluate two versions of HRRR, the original and an updated version, and nested versions of each. This study focuses on the ability of updated HRRR versions to improve upon predicting a regional sea-breeze flow, which was found to generate large errors by the original HRRR. Updates to the full-scale HRRR versions produced mixed results, but the finer-mesh versions consistently reduced model errors.

Meteorology & Atmospheric Sciences↗

DOE OSTI2025

Groundwater elevation data for monitoring wells within the East and Taylor River basins, Colorado (USA)

This dataset is comprised of temporal variations in groundwater elevation data for the 24 monitoring wells located throughout the East River watershed. Seasonal to annual variations in groundwater elevations are a critical property of mountainous watersheds needed to understand both hydrological and below ground biogeochemical processes. Such data serve as a critical constraint for numerical models describing coupled groundwater-surface water behavior within the watershed. Additionally, the offset between the maximum and minimum groundwater elevations defines the extent of the bedrock weathering zone, with annual excursions in the groundwater hydrographic (i.e., the rising and falling hydrographic limbs) imposing primary controls on bedrock saturation state and redox conditions that govern biogeochemical reactions impacting nitrogen, carbon, and metals cycling. Manufacturer-specific software is used to download pressure data from each transducer, with broadly available spreadsheet software (e.g. Microsoft Excel) used to convert temporal variations in water pressure to elevations in units of meters above mean sea level. As additional monitoring wells are installed within the East River watershed and new groundwater monitoring wells are installed in the Taylor River watershed, temporal groundwater elevation data will be included as a part of this master dataset. Details regarding the metadata associated with each monitoring well location, including well depths, screened intervals, well location coordinates, and bedrock type, are included, as is a standard operating procedure for generating groundwater elevation data from water pressure values recorded by the pressure transducers. This dataset includes: (1) a zip file (East_River_Watershed_Compiled_Groundwater_Elevation_Data_Plots.zip), containing (a) PNG of groundwater hydrographs, (b) a CSV file with groundwater elevation data, and (c) CSV file containing metadata organized by location; (2) an Excel file (East_River_Watershed_Compiled_Groundwater_Elevation_Data_Plots.xlsx) with the groundwater elevation data, groundwater hydrographs, and metadata organized by location; (3) a Word file (Groundwater_elevation_data_protocols.docx) and a PDF file version (Groundwater_elevation_data_protocols.pdf) containing field protocols and methods; (4) a location metadata (locations.csv) file; (5) a file level metadata (flmd.csv); and (6) data dictionary (dd.csv) file.This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Pan-Arctic daily streamflow at 0.5-degree resolution

Data was derived using daily runoff from models participating in the Coupled Model Intercomparison Project, version 6 (CMIP6) that have been routed through the Model for Scale Adaptive River Transport (MOSART) routing model to represent streamflow at individual streamflow gage locations. Data from 750 streamflow gage locations are represented, which are indexed by gage id according to the metadata.csv file. Streamflow gage location sites were based on gage records downloaded from the United States Geological Survey (USGS), National Water Data (HYDAT) Archive from Canada, and the State Hydrological Institute of Russia. Data are available from 11 Earth System Models (ESMs) in total at a daily timestep with a duration of 1920-2099 (1850-2014 for E3SM only). The spatial domain of the modeled data is 0.5 degree resolution. Earth System Models and Units of mean daily streamflow are presented in cubic meters per second (cms). Data files consist of 11 Earth System Model mean daily streamflow output per gage location in .csv format, 1 metadata file in .csv format and 1 Readme file in .docx format (13 files in total). These data were used to benchmark CMIP6 modeled representations of streamflow against gage records.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Updated Filter Leak Frequencies for Use in Risk Assessments

Quantitative risk assessment (QRA) is highly dependent on data, leading to more robust models as new and updated data is acquired. The Hydrogen Plus Other Alternative Fuels Risk Assessment (HyRAM+) QRA capabilities include calculations of individual risk from leaks in a gaseous hydrogen facility due to the potential effects of jet fires and explosions. Leak frequencies are acquired through statistical analysis of published data from a variety of sources and industries. The filter leak frequencies in previous versions of the HyRAM+ software are substantially greater than the leak frequencies of other components, leading to QRA results for gaseous hydrogen in which filters consistently dominate the overall risk. Data that were previously used to derive the filter leak frequencies were reevaluated for applicability and additional data points were added to update the filter leak frequencies. The new frequencies are more comparable to leak frequencies for other components.

08 HYDROGEN↗

DOE OSTI2024

A Methodology for Simulating Supercritical CO2 Heat Transfer Experiments Using Machine Learning Models

To support the growth of supercritical carbon dioxide (sCO2) power cycles in the energy industry, this study seeks to train a machine learning model to mirror experimental data to predict new heat transfer data. To do this experimental data was amassed, one preliminary set comprised of 16 test results, and an expanded version comprised of 38 test results. With the goal of predicting experimental apparatus temperatures and pressures, several iterations of models were tested investigating the impact of model hyper-parameters, data inclusion, and data pre-processing on model performance. A total of 15 variations cumulatively of Gaussian Process Regressors, Gradient Boosting Regressors, and Multi-Layer Perceptrons were trained and validated on the preliminary set, and the best algorithm of each class was re-trained on the expanded set. These were compared based on test/train R^2 , test/train mean absolute error (MAE), and validation MAE, to identify the successfulness of these models. It was shown temperatures could be predicted within just a few degrees, showing the potential of this approach. Future research has been identified with approaches to improve pressure and temperature predictions going forward.

Grabowski, Owen↗

DOE OSTI2022

MetaText: Compositional Generalization in Deep Language Models

Compositional generalization, the ability to infer and reason using novel combinations of previously encountered entities and structures, is a trait of great utility across a variety of deep learning tasks; it implies a certain ability to reason using consistent and therefore interpretable rules, to understand the constituent parts of its input at multiple levels of granularity, to be robust to spurious differences between semantically equivalent inputs, and more. We seek to understand the degree to which existing natural language models achieve or fall short of compositional generalization across a variety of tasks, whether there are distinct types of compositional generalization in practice, and to identify avenues of intervention through which we can improve models’ compositional generalization ability. After exploring these questions using an array of models, tasks, and potential interventions we see that large, pretrained language models have encountered sufficient training data to account for a variety of fine-grained compositional behavior but still struggle to reason at the level of phrases or larger language structures. Non-intrusive, data-based interventions in the form of augmenting individual sequences with compressed versions of themselves or deriving new examples from induced grammars prove insufficient to encourage greater levels of compositional reasoning, indicating that future work might benefit most from focusing on changes to a model’s inductive bias at the architectural or loss level, or by integrating compositionality-boosting data interventions into the large-scale pretraining process itself.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

EOSPAC User's Manual: Version 6.5 Second Edition (Rev. 3)

The EOSPAC utility package is a collection of interface routines, which can be used to access the SESAME data library and perform various data adjustments and interpolations on the SESAME data. The SESAME data library contains both thermodynamic (e.g., equation of state) and transport coefficients (e.g., opacity and conductivity). Note, for simplicity, the term EOS (equation of state) used herein includes both thermodynamic variables and transport coefficients. The EOSPAC utility package is designed to be used by physics codes (henceforth ”host codes”) written in multiple languages and on multiple platforms. The remainder of this manual is organized into several sections. Chapter 2 discusses conventions such as data organization and routine names. Chapter 3 provides a general overview of basic theory and models implemented within EOSPAC. Chapter 4 provides a general overview of how to use the EOSPAC interface library. Chapters 5 to 7 describe the public interfaces of EOSPAC in detail. Chapter 8 provides a brief introduction to some related tools, which may be of use to the user. Chapter 9 provides details related to some selected numerical features of EOSPAC. Chapter 10 gives examples for using the interface routines described in chapters 5 to 7. Chapter 11 provides technical support contact information. Chapter 12 contains a brief set of acknowledgments. Chapter 13 contains a list of referenced documents. Finally, chapter 14 lists the “table types: mnemonic conventions”, “table types: grouped by category, sorted by name”, “table types: eospac version 5 cross reference”, “options: setup phase”, “data information parameters”, “meta-data information parameters”, “options: interpolation phase”, and the “error codes”.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

The brighter-fatter effect in the JWST MIRI Si:As IBC detectors: I. Observations, impact on science, and modeling

Context.The Mid-Infrared Instrument (MIRI) on board theJames WebbSpace Telescope (JWST) uses three Si:As impurity band conduction (IBC) detector arrays. The output voltage level of each MIRI detector pixel is digitally recorded by sampling up the ramp. For uniform or low-contrast illumination, the pixel ramps become nonlinear in a predictable way, but in areas of high contrast, the nonlinearity curve becomes much more complex. The origin of the effect is poorly understood and currently not calibrated out of the data. Aims.We provide observational evidence of the brighter-fatter effect (BFE) in MIRI conventional and high-contrast coronagraphic imaging, low-resolution spectroscopy, and medium-resolution spectroscopy data, and we investigate the physical mechanism that gives rise to the effect on the MIRI detector pixel raw voltage integration ramps. Methods.We used public data from the JWST/MIRI commissioning and Cycle 1 phase. We also developed a numerical electrostatic model of the MIRI detectors using a modified version of the publicPoisson_CCDcode. Results.We find that the physical mechanism behind the BFE manifesting in MIRI data is fundamentally different to that of charge-coupled devices and photodiode arrays such as the Hawaii-XRG near-infrared detectors used by the NIRISS, NIRCam, and NIRSpec instruments on board JWST. Observationally, the BFE makes the JWST MIRI data yield 10–25% larger point sources and spectral line profiles as a function of the relative level of de-biasing of neighboring detector pixels. This broadening impacts the MIRI absolute flux calibration, time-series observations of faint companions, and point spread function modeling and subtraction. We also find that the intra-pixel 2D profile of the shrinking Si:As IBC detector depletion region directly impacts the accuracy of the pixel ramp nonlinearity calibration model.

Astronomy & Astrophysics↗

DOE OSTI2021

The 2021 update of the EPA’s adverse outcome pathway database

The EPA developed the Adverse Outcome Pathway Database (AOP-DB) to better characterize adverse outcomes of toxicological interest that are relevant to human health and the environment. Here we present the most recent version of the EPA Adverse Outcome Pathway Database (AOP-DB), version 2. AOP-DB v.2 introduces several substantial updates, which include automated data pulls from the AOP-Wiki 2.0, the integration of tissue-gene network data, and human AOP-gene data by population, semantic mapping and SPARQL endpoint creation, in addition to the presentation of the first publicly available AOP-DB web user interface. Potential users of the data may investigate specific molecular targets of an AOP, the relation of those gene/protein targets to other AOPs, cross-species, pathway, or disease-AOP relationships, or frequencies of AOP-related functional variants in particular populations, for example. Version updates described herein help inform new testable hypotheses about the etiology and mechanisms underlying adverse outcomes of environmental and toxicological concern.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Scalable Gaussian Processes, GPyTorch Application Benchmarking, and Targeted Adaptive Design (TAD) on ThetaGPU

We aim at showcasing the scalability of Gaussian Process (GP). The naive GP implementation scales cubically with data size, which can be prohibitive, so GP has not heretofore been considered suitable for very large-scale problem settings. We take advantage of GPyTorch, a library for scalable GPs built on top of PyTorch that incorporates GPU acceleration. With GPyTorch, one can achieve nearly linear scaling with structured kernel interpolation (SKI) and constant-time predictive covariances computation with LanczOs Variance Estimates (LOVE) while preserving accuracy. We also take advantage of the computational power of ThetaGPU, a supercomputer of Argonne Leadership Computing Facility (ALCF). In addition, we implement a scalable, GPU-ready version of Targeted Adaptive Design (TAD), a GP-based data-driven algorithm that efficiently searches the control space of an advanced manufacturing experiment for settings capable of producing a required design within a specified tolerance, despite the poorly known mapping from control settings to design. We finally show our benchmarking for GPyTorch and TAD performance on CPU vs. ThetaGPU and discuss the results and implications.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

pvlib iotools—Open-source Python functions for seamless access to solar irradiance data

Access to accurate solar resource data is critical for numerous applications, including estimating the yield of solar energy systems, developing radiation models, and validating irradiance datasets. However, lack of standardization in data formats and access interfaces across providers constitutes a major barrier to entry for new users. pvlib python’s iotools subpackage aims to solve this issue by providing standardized Python functions for reading local files and retrieving data from external providers. All functions follow a uniform pattern and return convenient data outputs, allowing users to seamlessly switch between data providers and explore alternative datasets. The pvlib package is community-developed on GitHub: https://github.com/pvlib/pvlib-python. As of pvlib python version 0.9.5, the iotools subpackage supports 12 different datasets, including ground measurement, reanalysis, and satellite-derived irradiance data. The supported ground measurement networks include the Baseline Surface Radiation Network (BSRN), NREL MIDC, SRML, SOLRAD, SURFRAD, and the US Climate Reference Network (CRN). Additionally, satellite-derived and reanalysis irradiance data from the following sources are supported: PVGIS (SARAH & ERA5), NSRDB PSM3, and CAMS Radiation Service (including McClear clear-sky irradiance).

14 SOLAR ENERGY↗

DOE OSTI2021

INGENIOUS Thermal Conductivity Measurement Source Categorization

Thermal conductivity (TC) data taken for different wells at a specified drill depth. This is an abridged version of the complete SMU heat flow database, downloaded from the SMU node of the NGDS at the beginning of INGENIOUS (approximately April 2021), and filtered to the INGENIOUS study area. This National Geothermal Data System (NGDS) project aggregates geothermal data collected and curated by the SMU Geothermal Laboratory and its partner organizations. All columns in this database are the same as the SMU database, except for 2 additions associated with this project. Repeated columns are for data correlation purposes. Column descriptions and data types are the same as previous iterations of the SMU database. The new values that are the addition are two new columns developed as part of the INGENIOUS project: INGENIOUS TC Value | INGENIOUS notes INGENIOUS notes are individual notes that were written for specific data points during the analysis process. There are not always notes associated with each input value. INGENIOUS TC Value includes 4 values: 1. Assumed Measured These are values that are assumed to be measured thermal conductivity values, either within a specific well or within the same study region. Many of these have either a published reference, a reported standard deviation, or a unique thermal conductivity value. 2. Data release - assumed measured These are values in the SMU database that are from proprietary data that were added to the SMU database and are labeled as data release for their reference. These values were searched for in person at the SMU Geothermal Laboratory as well as virtual examination of data available on the NGDS. For many of these, there are reported thermal conductivity values associated with the heat flow data in the database, but no specific table or reference to measurements in the original data release files. 3. Known measured These are values that have a reported measurement, either as an original file in the SMU data files on the NGDS or a reported table in a publication. In the rare circumstances, Maria Richards or David Blackwell confirmed measurement. Confirmation of measurement would be written in the INGENIOUS notes column. 4. Unmeasured Unmeasured values are those that are known to be unmeasured, either estimated from another report or no information given. In the SMU database, there are wells that have a heat flow but no thermal conductivity. These are categorized as unmeasured. There are also heat flow values that are stated to have estimated or generalized average thermal conductivity values for the region and rock type. Because these are known to be unmeasured, they are categorized as such. 5. Blank Blank values are either A quality or X quality. These quality values are stated in the INGENIOUS notes. These values were not going to change associated with the heat flow analysis, so these were not examined.

15 GEOTHERMAL ENERGY↗

DOE OSTI2025

Identification of tau leptons using a convolutional neural network with domain adaptation

A tau lepton identification algorithm,DeepTau, based on convolutional neural network techniques, has been developed in the CMS experiment to discriminate reconstructed hadronic decays of tau leptons (τ h ) from quark or gluon jets and electrons and muons that are misreconstructed as τ h candidates. The latest version of this algorithm, v2.5, includes domain adaptation by backpropagation, a technique that reduces discrepancies between collision data and simulation in the region with the highest purity of genuine τh candidates. Additionally, a refined training workflow improves classification performance with respect to the previous version of the algorithm, with a reduction of 30–50% in the probability for quark and gluon jets to be misidentified as τ h candidates for given reconstruction and identification efficiencies. This paper presents the novel improvements introduced in theDeepTau algorithm and evaluates its performance in LHC proton-proton collision data at √(s) = 13 and 13.6 TeV collected in 2018 and 2022 with integrated luminosities of 60 and 35 fb -1 , respectively. Techniques to calibrate the performance of the τ h identification algorithm in simulation with respect to its measured performance in real data are presented, together with a subset of results among those measured for use in CMS physics analyses.

Large detector-systems performance↗

DOE OSTI2021

Timely Reporting of Heavy Hitters Using External Memory

Given an input stream S of size N, a Φ-heavy hitter is an item that occurs at least ΦN times in S. The problem of finding heavy-hitters is extensively studied in the database literature. In this work, we study a real-time heavy-hitters variant in which an element must be reported shortly after we see its T = Φ N-th occurrence (and hence it becomes a heavy hitter). We call this the Timely Event Detection (TED) Problem. The TED problem models the needs of many real-world monitoring systems, which demand accurate (i.e., no false negatives) and timely reporting of all events from large, high-speed streams with a low reporting threshold (high sensitivity). Like the classic heavy-hitters problem, solving the TED problem without false-positives requires large space (Ω (N) words). Thus in-RAM heavy-hitters algorithms typically sacrifice accuracy (i.e., allow false positives), sensitivity, or timeliness (i.e., use multiple passes). We show how to adapt heavy-hitters algorithms to external memory to solve the TED problem on large high-speed streams while guaranteeing accuracy, sensitivity, and timeliness. Our data structures are limited only by I/O-bandwidth (not latency) and support a tunable tradeoff between reporting delay and I/O overhead. With a small bounded reporting delay, our algorithms incur only a logarithmic I/O overhead. We implement and validate our data structures empirically using the Firehose streaming benchmark. Multi-threaded versions of our structures can scale to process 11M observations per second before becoming CPU bound. In comparison, a naive adaptation of the standard heavy-hitters algorithm to external memory would be limited by the storage device’s random I/O throughput, i.e., ≈100K observations per second.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Evaluation of the CAM6 Climate Model Using Cloud Observations at McMurdo Station, Antarctica

A comparative analysis between observational data from McMurdo Station, Antarctica and the Community Atmosphere Model version 6 (CAM6) simulation is performed focusing on cloud characteristics and their thermodynamic conditions. Ka-band Zenith Radar (KAZR) and High Spectral Resolution Lidar (HSRL) retrievals are used as the basis of cloud fraction and cloud phase identifications. Radiosondes released at 12-hour increments provide atmospheric profiles for evaluating the simulated thermodynamic conditions. Our findings show that the CAM6 simulation consistently overestimates (underestimates) cloud fraction above (below) 3 km in four seasons of a year. Normalized by total in-cloud samples, ice and mixed phase occurrence frequencies are underestimated and liquid phase frequency is overestimated by the model at cloud fractions above 0.6, while at cloud fractions below 0.6 ice phase frequency is overestimated and liquid-containing phase frequency is underestimated by the model. The cloud fraction biases are closely associated with concurrent biases in relative humidity (RH), i.e., high (low) RH biases above (below) 2 km. Frequencies of correctly simulating ice and liquid-containing phase increase when the absolute biases of RH decrease. Cloud fraction biases also show a positive correlation with RH biases. Water vapor mixing ratio biases are the primary contributor to RH biases, and hence, likely a key factor controlling the cloud biases. Finally, this diagnosis of the evident shortfalls of representations of cloud characteristics in CAM6 simulation at McMurdo Station brings new insight in improving the governing model physics therein.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Carbon Ore Resources Database (CORD)

The Carbon Ore Resources Database (CORD) is a working collection of 399 data files associated with carbon ore resources in the United States. The collection includes spatial/non-spatial, filtered, processed, and secondary data files with original data acquisition efforts focused on domestic coal resources. The current version 1.0 is on NETL ArcGIS Enterprise.

Carbon Ore↗

DOE OSTI2023

Carbon Storage Planning Framework Dashboard

The Carbon Storage Planning Framework dashboard (beta version) provides easy access to explore, query, and evaluate multiple data layers to support and accelerate carbon storage resource and feasibility assessments and planning efforts. The interactive dashboard currently contains a range of authoritative datasets associated with geologic, technical, social, and environmental factors. The data sets can be filtered geographically for an area of interest to update statistics and charts within the dashboard. Terms of Use: NETL is sharing this beta/prototype tool with the request that users will provide feedback to NETL about the function and content of the dashboard, alerting NETL to any bugs or providing suggestions for additional resources to help mature the platform.

CCS,EDX4CCS,carbon storage,dashboard↗

DOE OSTI2020

Cambium Documentation: Version 2020

This is the documentation for the 2020 version of Cambium. Cambium is a tool that assembles structured data sets of simulated hourly cost and operational data for modeled futures of the U.S. electric sector with metrics designed to be useful for long-term decision-making. In this documentation, we define the metrics reported in Cambium databases and document the Cambium-specific methods for calculating those metrics.

24 POWER TRANSMISSION AND DISTRIBUTION↗