Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “IDS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Short-Lived Intermediate in the N2O Generation by P450 NO Reductase Captured by Time-Resolved IR Spectroscopy and XFEL Crystallography

Diffraction images were collected using an MX300-HS CCD detector. For each cryoloop, 2D raster scan with 50 μm step in each direction was performed twice. In the second pass, the raster-scan grid was shifted 25 μm in each direction. In cheetah directory, - {puck_name}/{pin_id}_hits.h5 correspond to the first scan, and - {puck_name}/{pin_id}-2_hits.h5 correspond to the second scan.

BL3↗

XRF-ROI Finder: Machine Learning to Guide Region-of-Interest Scanning for X-ray Fluorescence Microscopy

The ROI-finder software is being developed for use by several Microscopy Group beamlines at Argonne National Laboratory, including 2-ID microprobes and 9-ID-B Bionanoprobe which use multi-scale scanning fluorescence microscopy to acquire elemental maps (multi-modal image data). Microscopy experiments require scan of samples at a coarse resolution followed by ROI identification using feature detection based on domain expertise. Finer resolution scans are then conducted based on identified ROI. The decision-making process based on domain expertise will be difficult to perform for faster data rates and much larger sampling volumes anticipated after APS-U necessitating the need for the ROI-finder software. The ROI- finder detects regions of interest through a continuous learning process, starting with a unsupervised representation learning and improving its recommendations through supervised learning and an interactive tool for user annotation. The scope of ongoing development efforts includes the integration of image registration module to correlate optical and X-ray images, extraction of feature morphology as well as elemental signatures in the image space and incorporation of beamtime streaming data by the scanning probe via EPICS.

CHOWDHURY, M. ARSHAD ZAHANGIR↗

PolyID™ (Polymer Inverse Design) [SWR-21-98]

PolyID™ provides a framework for building, training, and predicting polymer properties using graph neural networks. The codes leverages Neural Fingerprint (nfp) (See DOE Code ID 22185) for building tensorflow-based message-passing neural networks, and Monomers to Polymers (m2p) (See DOE Code ID 44795) for building polymer structures. To understand and use the pipeline, the following examples have been provided: Building polymer structures: examples/example_generate_polymer_structures.ipynb Checking domain of validity: examples/example_determine_domain-of-validity.ipynb Training a graph neural network: examples/example_generate_and_train_models.ipynb Predicting with the trained model: examples/example_predict_with_trained_models.ipynb

Wilson, Nolan↗

rmon (Resource monitor) [SWR-24-128]

The resource monitor application provides monitoring, collection, and visualization of resource utilization in compute nodes. This package contains utilities to monitor system resource utilization (CPU, memory, disk, network). Here are the ways you can use it: -Monitor resource utilization for a compute node for a given set of resource types and process IDs. -Start a process and monitor its resource utilization. -Monitor resource utilization for a compute node asynchronously with the ability to dynamically change the resource types and process IDs being monitored. -Produce JSON reports of aggregated metrics. -Produce interactive HTML plots of the statistics.

Thom, Daniel [National Renewable Energy Laboratory↗

Shell Timeout Scripts

Automatic shell timeout configuration scripts for POSIX shells (bash/zsh) and C shells (csh/tcsh). These scripts automatically set shell timeout values based on User ID (UID) or Group ID (GID) membership (including secondary groups). When a matching user logs in, their shell will automatically terminate after a configured period of inactivity. NOTE: Not all shells implement this feature. Features UID and/or GID-based timeout configuration Additive and subtractive list management Validation of timeout values (positive integers only) Can set timeout to readonly (bash/zsh).

Riehecky, Pat [Fermilab]↗

SMC 2021 : Analyzing Resource Utilization and User Behavior on Titan Supercomputer

Resource utilization statistics of submitted jobs on a supercomputer can help us understand how users from various scientific domains use HPC platforms and better design a job scheduler. We explore to generate insight regarding workload distribution and usage pattern domains from job scheduler trace, GPU failure information, and project-specific information collected from Titan supercomputer. Furthermore, we want to know how the scheduler performance varies over time and how the users' scheduling behavior changes following a system failure. These observations have the potential to provide valuable insight, which is helpful to prepare for system failures. These practices will help us develop and apply novel machine learning algorithms in understanding system behavior, requirement, and better scheduling of HPC systems. There are two datasets, RUR and GPU. RUR: This dataset is the job scheduler traces collected from the Titan supercomputerfrom 01/01/2015 to 07/31/2019 (2015.csv - 2019.csv). These were collected usingResource Utilization Report (RUR), a Cray-developed resource-usage data collectionand reporting system. It contains the usage information of its critical resources (CPU,Memory, GPU, and I/O) of each running job on Titan during that period [2]. ProjectAreas: Every job is associated with a project ID. TheProjectAreas.csvdatasetprovides a mapping of the project ID to its domain science. GPU: There have been some hardware-related issues in the GPUs in Titan that caused some GPUs to fail, sometimes irrecoverably during some job runs. This dataset provides information regarding these failures during the execution of the submitted jobs. GPUs on Titan are uniquely identified by a serial number (SN), and they are installed in a location. A GPU can be installed in a location, then removed from that location following a failure, and then re-installed in a different location after fixing the problem. If the failure can't be recovered, the GPU might be removed entirely from Titan. There are two prominent types of failures that resulted in the removal of GPUs from Titan: Double Bit Error (DBE) and Out of the Bus (OTB). The dataset (gc_full.csv) has the following fields: 1. SN : Serial number of a GPU 2. location : The location where it is installed 3. insert : The time when it was inserted into that location 4. remove : The time when it was removed from that location 5. duration : Amount of time the GPU spent in this location 6. out : If the device was taken out entirely w/o a re-installment into a new location. 7. event : If the GPU was taken out entirely, the reason for its removal. To learn more about this dataset, please refer to the git repositoryhttps://github.com/olcf/TitanGPULifeand the related publication [1]. References [1] George Ostrouchov, Don Maxwell, Rizwan A Ashraf, Christian Engelmann, MallikarjunShankar, and James H Rogers. Gpu lifetimes on titan supercomputer: Survival analysisand reliability. InSC20: International Conference for High Performance Computing,Networking, Storage and Analysis, pages 1-14. IEEE, 2020. [2] Feiyi Wang, Sarp Oral, Satyabrata Sen, and Neena Imam. Learning from five-yearresource-utilization data of titan system. In2019 IEEE International Conference onCluster Computing (CLUSTER), pages 1-6. IEEE, 2019.

42 ENGINEERING↗

SMC 2021 Data Challenge: Analyzing Resource Utilization and User Behavior on Titan Supercomputer

Resource utilization statistics of submitted jobs on a supercomputer can help us understand how users from various scientific domains use HPC platforms and better design a job scheduler. We explore to generate insight regarding workload distribution and usage pattern domains from job scheduler trace, GPU failure information, and project-specific information collected from Titan supercomputer. Furthermore, we want to know how the scheduler performance varies over time and how the users' scheduling behavior changes following a system failure. These observations have the potential to provide valuable insight, which is helpful to prepare for system failures. These practices will help us develop and apply novel machine learning algorithms in understanding system behavior, requirement, and better scheduling of HPC systems. There are two datasets, RUR and GPU: RUR dataset is the job scheduler traces collected from the Titan supercomputer from 01/01/2015 to 07/31/2019 (2015.csv - 2019.csv). These were collected using resource Utilization Report (RUR), a Cray-developed resource-usage data collection and reporting system. It contains the usage information of its critical resources (CPU, Memory, GPU, and I/O) of each running job on Titan during that period (https://ieeexplore.ieee.org/abstract/document/8891001). It includes ProjectAreas as additional information, every job is associated with a project ID. TheProjectAreas.csv dataset provides a mapping of the project ID to its domain science. GPU dataset has information regarding GPU failure on Titan. There have been some hardware-related issues in the GPUs in Titan that caused some GPUs to fail, sometimes irrecoverably during some job runs. This dataset provides information regarding these failures during the execution of the submitted jobs. GPUs on Titan are uniquely identified by a serial number (SN), and they are installed in a location. A GPU can be installed in a location, then removed from that location following a failure, and then re-installed in a different location after fixing the problem. If the failure can't be recovered, the GPU might be removed entirely from Titan. There are two prominent types of failures that resulted in the removal of GPUs from Titan: Double Bit Error (DBE) and Out of the Bus (OTB). The dataset (gc_full.csv) has seven attributes, we provided a short description of these attributes in the ReadMe file. To learn more about this dataset, please refer to the git repository https://github.com/olcf/TitanGPULife and the related publication (https://ieeexplore.ieee.org/abstract/document/9355319).

42 ENGINEERING↗

Supplementary Material for ORNL_AISD-Ex

This dataset provides supplementary material for the previously published dataset ORNL_AISD-Ex (1), which is available at the following website: https://www.osti.gov/biblio/1907919 The dates comprises one compressed folder called ornl_aisd_ex.zip. The compressed folder ornl_aisd_ex.zip contains 1,000 CSV files, each of them titled ornl_aisd_ex_ID.csv, where ID is a number that ranges between 1 and 1,000. The information contained in ornl_aisd_ex_ID.csv corresponds to the information of the molecules compresses inside the ornl_aisd_ex_ID.tar.gz of the dataset ORNL_AISD-Ex. Each row in each .CSV file is associated with a molecule, and the columns contain the following information: 1) molecules ID 2) SMILES string representation 3) DFTB-PE (eV): formation energy 4) first 50 electronic excitation modes 5) oscillators strengths of the first 50 electronic excitation modes The compression of this information into CSV files will allow a more agile extraction and management of information to the users that do not have access to large scale HPC platforms. REFERENCES (1) Lupo Pasini, Massimiliano, Mehta, Kshitij, Yoo, Pilsun, and Irle, Stephan. ORNL_AISD-Ex: Quantum chemical prediction of UV/Vis absorption spectra for over 10 million organic molecules. United States: N. p., 2023. Web. doi:10.13139/OLCF/1907919.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Model America - data and models of every U.S. building

The 5-year goal of the 'Model America' concept was to generate a model of every building in the United States. This data repository delivers on that goal. Oak Ridge National Laboratory (ORNL) has developed the Automatic Building Energy Modeling (AutoBEM) software suite to process multiple types of data, extract building-specific descriptors, generate building energy models, and simulate them on High Performance Computing (HPC) resources. For more information, see AutoBEM-related publications (bit.ly/AutoBEM). There were 125,714,640 buildings detected in the United States and this dataset contains 122,930,327 (97.8%) buildings which resulted in a successful simulation. Future, annual updates have been proposed that may include additional buildings, data improvements, or other algorithmic enhancements. This dataset of 122.9 million buildings includes: Models (state_county.zip) - OpenStudio (v3.1.0) and EnergyPlus (v9.4) building energy models. Please note that the download requires the free Globus Connect Personal (https://www.globus.org/globus-connect-personal); Each model has approximately 3,000 building input descriptors that can be extracted. Please see the EnergyPlus(v9.4) 2,784-page Input/Output Reference Guide (https://energyplus.net/sites/all/modules/custom/nrel_custom/pdfs/pdfs_v9.4.0/InputOutputReference.pdf) for everything that can be retrieved or simulated from these models. These models were derived from the following metadata, which is not included in this dataset: 1. ID - unique building ID 2. County - county name 3. State - state name 4. CZ - ASHRAE Climate Zone designation 5. Clim_Zone - text label of climate zone 6. est_year - estimated year of construction 7. est_commercial - estimated building type (0=residential, 1=commercial) 8. Centroid - building center location in latitude/longitude (from Footprint2D) 9. Footprint2D - building polygon of 2D footprint (lat1/lon1_lat2/lon2_...) 10. Height - building height (meters) 11. Area2D - footprint area (ft2) 12. BuildingType - DOE prototype building designation (IECC=residential) as implemented by OpenStudio-standards 13. WWR_surfaces - percent of each facade (pair of points from Footprint2D) covered by fenestration/windows (average 14.5% for residential, 40% for commercial buildings) 14. NumFloors - number of floors (above-grade) 15. Area - estimate of total conditioned floor area (ft2) 16. Standard - building vintage. These models are made free and openly available in hopes of stimulating any simulation-informed use case. Data is provided as-is with no warranties, express or implied, regarding fitness for a particular purpose. We wish to thank our sponsors which include Oak Ridge National Laboratory (ORNL) Laboratory Directed Research and Development (LDRD), U.S. Dept. of Energy's (DOE) Building Technologies Office (BTO), Office of Electricity (OE), Biological and Environmental Research (BER), and National Nuclear Security Administration (NNSA). This research used resources of the Argonne Leadership Computing Facility, which is a DOE Office of Science User Facility supported under Contract DE-AC02-06CH11357. Please cite as: New, Joshua R., Adams, Mark, Bass, Brett, Berres, Anne, and Clinton, Nicholas (2021). 'Model America - data and models of every U.S. building. [Data set].' Constellation, doi.ccs.ornl.gov/ui/doi/339, April 14, 2021

24 POWER TRANSMISSION AND DISTRIBUTION↗

Extreme background rejection techniques for the ELROI satellite license plate

The extremely low-resource optical identifier (ELROI) is a concept for an autonomous, low-power optical “license plate” that can be attached to anything that goes into space. ELROI uses short, omnidirectional flashes of laser light to encode a unique ID number that can be read by a small ground telescope using a photon-counting sensor and innovative extreme background-rejection techniques. ELROI is smaller and lighter than a typical radio beacon, low-power enough to run on its own small solar cell, and can safely operate for the entire orbital lifetime of a satellite or debris object. The concept has been validated in ground tests, and orbital prototypes are scheduled for launch in 2018 and beyond. In this paper, we focus on the details of the encoding scheme and data analysis that allow a milliwatt optical signal to be read from orbit. We describe the techniques of extreme background-rejection needed to achieve this, including spectral filtering and temporal filtering using a period- and phase-recovery algorithm, and discuss the requirements for an error-correcting code to encode the ID number. Worked examples with both simulated and experimental (long-range ground test) data illustrate the methods used. Finally, we present these techniques to describe a new optical communication concept, and to encourage others to consider observing and analyzing our upcoming test flights.

42 ENGINEERING↗

Hyperspectral image reconstruction for x-ray fluorescence tomography

A penalized maximum-likelihood estimation is proposed to perform hyperspectral (spatio-spectral) image reconstruction for X-ray fluorescence tomography. The approach minimizes a Poisson-based negative log-likelihood of the observed photon counts, and uses a penalty term that has the effect of encouraging local continuity of model parameter estimates in both spatial and spectral dimensions simultaneously. The performance of the reconstruction method is demonstrated with experimental data acquired from a seed of arabidopsis thaliana collected at the 13-ID-E microprobe beamline at the Advanced Photon Source. The resulting element distribution estimates with the proposed approach show significantly better reconstruction quality than the conventional analytical inversion approaches, and allows for a high data compression factor which can reduce data acquisition times remarkably. In particular, this technique provides the capability to tomographically reconstruct full energy dispersive spectra without compromising reconstruction artifacts that impact the interpretation of results.

Fluorescence microscopy↗

Gap Assessment (FY 13 Update)

To help guide its future data collection efforts, The DOE GTO funded a data gap analysis in FY2012 to identify high potential hydrothermal areas where critical data are needed. This analysis was updated in FY2013 and the resulting datasets are represented by this metadata. The original process was published in FY 2012 and is available here: https://pangea.stanford.edu/ERE/db/GeoConf/papers/SGW/2013/Esposito.pdf Though there are many types of data that can be used for hydrothermal exploration, five types of exploration data were targeted for this analysis. These data types were selected for their regional reconnaissance potential, and include many of the primary exploration techniques currently used by the geothermal industry. The data types include: 1. well data 2. geologic maps 3. fault maps 4. geochemistry data 5. geophysical data To determine data coverage, metadata for exploration data (including data type, data status, and coverage information) were collected and catalogued from nodes on the National Geothermal Data System (NGDS). It is the intention of this analysis that the data be updated from this source in a semi-automated fashion as new datasets are added to the NGDS nodes. In addition to this upload, an online tool was developed to allow all geothermal data providers to access this assessment and to directly add metadata themselves and view the results of the analysis via maps of data coverage in Geothermal Prospector (http://maps.nrel.gov/gt_prospector). A grid of the contiguous U.S. was created with 88,000 10-km by 10-km grid cells, and each cell was populated with the status of data availability corresponding to the five data types. Using these five data coverage maps and the USGS Resource Potential Map, sites were identified for future data collection efforts. These sites signify both that the USGS has indicated high favorability of occurrence of geothermal resources and that data gaps exist. The uploaded data are contained in two data files for each data category. The first file contains the grid and is in the SHP file format (shape file.) Each populated grid cell represents a 10k area within which data is known to exist. The second file is a CSV (comma separated value) file that contains all of the individual layers that intersected with the grid. This CSV can be joined with the map to retrieve a list of datasets that are available at any given site. The attributes in the CSV include: 1. grid_id : The id of the grid cell that the data intersects with 2. title: This represents the name of the WFS service that intersected with this grid cell 3. abstract: This represents the description of the WFS service that intersected with this grid cell 4. gap_type: This represents the category of data availability that these data fall within. As the current processing is pulling data from NGDS, this category universally represents data that are available in the NGDS and are ready for acquisition for analytic purposes. 5. proprietary_type: Whether the data are considered proprietary 6. service_type: The type of service 7. base_url: The service URL

15 GEOTHERMAL ENERGY↗

DTS Raw Data Guelph, Ontario Canada

Unprocessed active distributed temperature sensing (DTS) data from 3 boreholes in the Guelph, ON Canada region. Data from borehole 1 was collected during a fluid injection while data from boreholes 2 and 3 were collected under natural gradient conditions in a lined borehole. The column labels/headers (in the first row) define the time since start of measurement in seconds and the row labels/headers (in the first column) are the object IDs that are defined in the metadata. Each object ID is a sampling location whose exact location is defined in the metadata file. Data in each cell are temperature in Celsius at time and sampling location as defined above.

15 GEOTHERMAL ENERGY↗

Rare Earth Element and Trace Element Data Associated with Hydrothermal Spring Reservoir Rock, Idaho

These data represent rock samples collected in Idaho that correspond with naturally occurring hydrothermal samples that were collected and analyzed by INL (Idaho Falls, ID). Representative samples of type rocks were selected to best represent the various regions of Idaho in which naturally occurring hydrothermal waters occur. This includes the Snake River Plain (SRP), Basin and Range type structures east of the SRP, and large scale/deep seated orogenic uplift of the Sawtooth Mountains, ID. Analysis includes ICP-OES and ICP-MS methods for Major, Trace, and REE concentrations.

15 GEOTHERMAL ENERGY↗

EGS Collab Experiment 1: Core Logs

Core logs from the EGS Collab project Experiment 1 for the stimulation (Injection) well (E1-I), the Production well (E1-P), and monitoring wells (E1-OT, E1-OB, E1-PST, E1-PSB, E1-PDT, and E1-PDB) on the 4850 Level of SURF (the Sanford Underground Research Facility), single PDF file, 5-ft run intervals. In the monitoring well IDs, "O" indicates that the well is orthogonal to the anticipated fracture plane, "P" indicates that the well is parallel to the anticipated fracture plane, "S" indicates a shallow well, "D" indicates a deep well, "T" refers to top, and "B" refers to bottom. Logs include: experiment number; borehole ID; depth interval; run number; final packed core box number; scribe line (yes/no; red-on-right convention); logging dates; logger initials; as well as sketches of core foliation, folding, and fracturing with additional details and notes on other features of interest.

15 GEOTHERMAL ENERGY↗

EGS Collab Experiment 2: Core Logs

Core logs and photos from the EGS Collab project Experiment 2 for the Top Vertical well (TV4100) and the Top Horizontal well (TV 4100) on the 4100 Level of SURF (the Sanford Underground Research Facility). The core logs are stored in a single PDF file with 5-ft run intervals. In the monitoring well IDs, "O" indicates that the well is orthogonal to the anticipated fracture plane, "T" refers to top, and "H" refers to horizontal. A core log CT scan for TV4100 and a layout image of the 4100 wells are included as well. Logs include: experiment number; borehole ID; depth interval; run number; final packed core box number; scribe line (yes/no; red-on-right convention); logging dates; logger initials; as well as sketches of core foliation, folding, and fracturing with additional details and notes on other features of interest. Shift reports include: date, location, personnel, summary of site activity, and field notes.

15 GEOTHERMAL ENERGY↗

Groundwater table elevation and temperature from 2015 to 2024 at the Lower Montane site in the East River Watershed, Colorado.

This groundwater level elevation and temperature data package is aimed at improving the predictive understanding of hydro-biogeochemical processes at the lower montane site in the East River Watershed, Colorado. The dataset is obtained using pressure transducers placed in shallow wells in the floodplain. This dataset contains data from wells with Location ID's ER-DOW (alias DO1West), ER-DOE (alias DO2East), ER-MBA1 (alias M1Bend1), ER-MBA2 (alias M1Bend2), ER-UPW (alias UP1West), ER-UPM (alias UP2), ER-UPE (alias UP3East). Another dataset contains the data from wells with Location ID's ER-CPA1 to ER-CPA6. Each file contains the water level elevation and the water temperature. Water level elevation has been obtained using the barometric pressure from the pressure transducer (Hobos sensor) in the well, barometric pressure from a sensor in air located at the same site (lower montane), depth from top-of-casing (TOC) to sensor measurement point, and TOC elevation. Data have been checked with a few measurements of water table depths. A real-time kinematic (RTK) global positioning system (GPS) has been used to survey the TOC (data in file Well_Location.csv). The water level elevation is given in UTM13N Geoid2012AB. While depth to water level is not present in the data files, it can be easily calculated with the TOC and distance to ground provided in the GPS coordinate file. The dataset quality is discussed in Collection/Analysis section of the methods. Time-series of measurements were initially added to the archive for the period 2015 to 2019, and later updated with time-series until 2024 (end of data collection). The dataset contains 8 *.csv data files, and 3 *.csv metadata files. Feel free to contact the author with any questions or collaboration interests. The publication year was updated from "2020" to "2025" to reflect the revised version of this dataset.

54 ENVIRONMENTAL SCIENCES↗

Aligned FTICR-MS, Respiration, and Biochemical Transformation Data from Columbia River Sediment Incubations Associated with: “Carbon Limitation Leads to Thermodynamic Regulation of Aerobic Metabolism”

Columbia River hyporheic zone sediments from the Hanford Site 300 Area in eastern Washington were incubated in a full factorial design with different organic matter (OM) amendments. The aim of the experiment was to test the influence of OM thermodynamics on aerobic respiration across different organic carbon pools and concentrations. This dataset is comprised of (1) a csv with high resolution characterization of dissolved organic matter via 12 Tesla Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) analyzed through the Environmental Molecular Sciences Laboratory (EMSL; https://www.pnnl.gov/environmental-molecular-sciences-laboratory), (2) a csv with sample IDs, replicates, amendments, dissolved oxygen (DO) measurements, and sampling time points, (3) a csv with sample IDs, replicates, respiration rates, FTICR summary metrics, and relative abundance of chemical classes; and (4) a csv with the number of chemical transformations in each sample replicate (microcosm). The data are associated with the publication “Carbon Limitation Leads to Thermodynamic Regulation of Aerobic Metabolism” published in ES&T Letters (Garayburu-Caruso et al., 2020). Please use the data package’s DOI to cite the data package. We ask that you acknowledge the U.S. Department of Energy (DOE) Biological and Environmental Research (BER) Subsurface Biogeochemical Research (SBR) program when using the data. All data are free to be used for any purpose, such as for manuscripts, presentations, and grant proposals. There is no obligation to include data package authors as co-authors.

54 ENVIRONMENTAL SCIENCES↗