Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “csv”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

NEWTS EPA Gasification Dataset and Case Studies

Data from the US EPA Gasification Database containing gasification effluent data from selected U.S. coal power plants. Original data from: Nguyen, Dan-Tam, Eastern Research Group. Sep 29, 2015. Analytical Database for the Steam Electric Rulemaking - DCN SE05359. https://www.regulations.gov/document/EPA-HQ-OW-2009-0819-5640 Files include: Original data tab, processed data and charge balance information in "NEWTS_EPA_Gasification_Effluent_Dataset_all_tabs.xlsx" Individual .csv files for data in format for input into aqueous chemistry modeling software (OLI Systems and Geochemist's Workbench) Data input templates for modeling streams in OLI Systems and Geochemist's Workbench Case studies for selected solved streams modeled in OLI Systems and Geochemist's Workbench

gasification↗

U.S. Freight Transload Facilities Dataset

The U.S. Freight Transload Facilities Dataset provides location information (latitude, longitude, zip, city, county, state)for more than 9,000 facilities across 50 U.S. States where freight may be transferred between waterways, railways, and roadways. The dataset lists the known modes and available direction(s) for freight transfers at each facility as of 2024. The U.S. Freight Transload Facilities dataset was built by mining and fusing several public sources, such as the USACE Master Docks Plus, the USDOT National Transportation Atlas Database (NTAD), files from the Intermodal Association of North America (IANA), and the industry publication Bulk Transloader. The dataset constitutes a key piece of a multimodal freight transportation network and routing algorithm developed by USACE-ERDC. The dataset is shared as a .csv file. The dataset is published for research purposes and should not be considered exhaustive or authoritative.

Peterson, Steven [ORNL] (ORCID:0000000287672998)↗

easyaccess: Enhanced SQL command line interpreter for astronomical surveys

easyaccess is an enhanced command line interpreter and Python package created to facilitate access to astronomical catalogs stored in SQL Databases. It provides a custom interface with custom commands and was specifically designed to access data from the Dark Energy Survey Oracle database, including autocompletion of tables, columns, users and commands, simple ways to upload and download tables using csv, fits and HDF5 formats, iterators, search and description of tables among others. It can easily be extended to another surveys or SQL databases. The package was completely written in Python and support customized addition of commands and functionalities. Visit https://github.com/mgckind/easyaccess to view installation instructions, tutorials, and the Python source code for easyaccess.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

rmap: An R package to plot and compare tabular data on customizable maps across scenarios and time

`rmap` is an R package that allows users to easily plot tabular data (CSV or R data frames) on maps without any Geographic Information Systems (GIS) knowledge. Maps produced by `rmap` are `ggplot` objects and thus capitalize on the flexibility and advancements of the `ggplot2` package and all elements of each map are thus fully customizable. Additionally `rmap` automatically detects and produces comparison maps if the data has multiple scenarios or time periods as well as animations for time series data. Advanced users can load their own shapefiles if desired. `rmap` comes with a range of pre-built color palettes but users can also provide any `R` color palette or create their own as needed. Four different legend types are available to highlight different kinds of data distributions. The input spatial data can be both gridded or polygon data. `rmap` is desgined in particular for comparing spatial data across scenarios and time periods and comes preloaded with standard country, state, and basin maps as well as custom maps compatible with the Global Change Analysis Model (GCAM) spatial boundaries. `rmap` has a growing number of users and its products have been used in multiple multisector dynamics publications as well as a required dependency in other R packages such as `rfasst` and `metis`. `rmap's` automatic processing of tabular data using pre-built map selection, difference map calculations, faceting, and animations offers unique functionality which makes it a powerful and yet simple tool for users looking to explore multi-sector, multi-scenario data across space and time.

58 GEOSCIENCES↗

FAIRmaterials: Ontology Tools with Data FAIRification in Development

The bilingual FAIRmaterials package simplifies the creation and visualization of materials and data science ontologies. FAIRmaterials, available in the Python and R languages, addresses the complexities associated with traditional ontology editors based on manual user input such as Protege with an intuitive workflow and easy-to-use templates, making it accessible to users both experienced and inexperienced with ontologies. The FAIRmaterials package is its ability to programatically convert simple and structured CSV inputs into rich, well-defined ontologies. This capability is designed to support the findability, accessibility, interoperability, and reusability (FAIR) of research data and serve as a tool in the process of data FAIRification. Its additional features, such as automated ontology merging, static visualizations, and comprehensive documentation for outputs extend its utility, making it a valuable tool for any researcher engaged in knowledge management.

Bradley, Alexander Harding [Case Western Reserve U↗

FAIRLinked: Data FAIRification Tools for Materials Data Science

FAIRLinked is a software package created to support the FAIRification of materials science data, ensuring proper alignment with FAIR principles: Findable, Accessible, Interoperable, and Reusable. It is built to be compatible with MDS-Onto, an ontology designed to capture the semantics of various types of materials data, enabling integration and sharing across different research workflows. The package is subdivided into three subpackages: InterfaceMDS, RDFTableConversion, and QBWorkflow. The first subpackage, InterfaceMDS allows users to search for terms using either string search or various filters, explore different domains and subdomains, and add terms to MDS-Onto. RDFTableConversion is used for serialization and deserialization of data from CSV into JSONLDs and vice versa in a way that captures the semantics of the data using MDS-Onto. Lastly, QBWorkflow is a serialization and deserialization workflow that incorporates RDF Data Cube vocabulary, useful for working with multidimensional datasets. By offering these packages, FAIRLinked lowers the barrier of creating FAIR, machine-actionable data for researchers in the materials science community.

FAIR↗

User's Guide to Pre-Processing Data in Universal Translator 2 for the Energy Charting and Metrics Tool (ECAM)

This document is a user's guide for the Energy Charting and Metrics Tool to facilitate the examination of energy information from buildings, reducing the time spent analyzing trend and utility meter data. This user guide was generated to help pre-process data with the intention of utilizing the Energy Charting and Metrics (ECAM) tool to improve building operational efficiency. There are numerous occasions when the metered data that is received from the building automation system (BAS) isn't in the right format acceptable for ECAM. This includes, but isn't limited to, cases such as inconsistent time-stamps for the trends (e.g., each trend has its own time-stamp), data with holes (e.g., some time-stamps have data and others are missing data), each point in the BAS is trended and exported into an individual .csv or .txt file, the time-stamp is unrecognizable by ECAM, etc. After reading through this user guide, the user should be able to pre-process all data files and be ready to use this data in ECAM to improve their building operational efficiency.

99 GENERAL AND MISCELLANEOUS↗

Lightweight performance data collectors 2.0 with Eiger support.

We report on the use and design of a portable, extensible performance data collection tool motivated by modeling needs of the high performance computing systems co-design com- munity. The lightweight performance data collectors with Eiger support is intended to be a tailorable tool, not a shrink-wrapped library product, as pro ling needs vary widely. A single code markup scheme is reported which, based on compilation ags, can send perfor- mance data from parallel applications to CSV les, to an Eiger mysql database, or (in a non-database environment) to at les for later merging and loading on a host with mysql available. The tool supports C, C++, and Fortran applications.

Allan, Benjamin A.↗

Database Performance Monitoring for the Photovoltaic Systems

The Database Performance Monitoring (DPM) software (copyright in processes) is being developed at Sandia National Laboratories to perform quality control analysis on time series data. The software loads time indexed databases (currently csv format), performs a series of quality control tests defined by the user, and creates reports which include summary statistics, tables, and graphics. DPM can be setup to run on an automated schedule defined by the user. For example, the software can be run once per day to analyze data collected on the previous day. HTML formatted reports can be sent via email or hosted on a website. To compare performance of several databases, summary statistics and graphics can be gathered in a dashboard view which links to detailed reporting information for each database. The software can be customized for specific applications.

97 MATHEMATICS AND COMPUTING↗

JSATS Detector Field Manual

The Juvenile Salmon Acoustic Telemetry System (JSATS) Detector is a software and hardware system that captures JSATS Acoustic Micro Transmitter (AMT) signals. The system uses hydrophones to capture acoustic signals in the water. This analog signal is then amplified and processed by the Analog to Digital Converter (ADC) and Digital Signal Processor (DSP) board in the computer. This board digitizes and processes the acoustic signal to determine if a possible JSATS tag is present. With this detection, the data will be saved to the computer for further analysis. This document details the features and functionality of the JSATS Detector software. The document covers how to install the software, setup and run the detector software. The document will also go over the raw binary waveform file format and CSV files containing RMS values

47 OTHER INSTRUMENTATION↗

SchemaOnRead Manual

SchemaOnRead provides tools for implementing schema-on-read including a single function call (e.g., schemaOnRead("filename")) that reads text (TXT), comma separated value (CSV), raster image (BMP, PNG, GIF, TIFF, and JPG), R data (RDS), HDF5, NetCDF, spreadsheet (XLS, XLSX, ODS, and DIF), Weka Attribute-Relation File Format (ARFF), Epi Info (REC), Pajek network (PAJ), R network (NET), Hypertext Markup Language (HTML), SPSS (SAV), Systat (SYS), and Stata (DTA) files. It also recursively reads folders (e.g., schemaOnRead("folder")), returning a nested list of the contained elements.

97 MATHEMATICS AND COMPUTING↗

MOVES Activity Updates Using Fleet DNA Data: Interim Report

The U.S. Environmental Protection Agency's Motor Vehicle Emissions Simulator (MOVES) is a publicly available tool used by researchers and policy makers to help understand motor vehicle emission sources at national, county, and project levels. However, estimates of heavy-duty activity (MOVES2014), have been identified as areas needing improvement. The start activities in MOVES2014 are calculated using a limited data set, prompting the concern that inventory values are not representative. In addition, MOVES2014 is believed to underestimate heavy-duty activity that is not captured in the current drive cycles used to represent on-network activity. For example, MOVES2014 does not account for work-day idling activity that takes place on off-network roads, such as at a distribution center while the truck is queuing or during loading and unloading. Under the guidance and expertise of the EPA, the National Renewable Energy Laboratory has leveraged its extensive Fleet DNA database of heavy-duty vehicles to reinforce the data set behind the next-generation MOVES model and enhance idle activity and start fractions using six heavy-duty vehicle classes. The data available in Fleet DNA from 420 conventional, diesel powered vehicles provided over 120,000 hours of operation. Start fraction, soak fraction, and idle fraction by hour of the day were derived for each source type, state, and vocation, and results were provided in the form of .CSV files representing MOVES table inputs. This midterm report details these results providing graphical analysis and context for the start, soak, and idle distributions.

33 ADVANCED PROPULSION SYSTEMS↗

Design and implementation of a data analysis pipeline for paper spray ionization mass spectrometry of UO 2 Cl 2

Ambient mass spectrometry is an emerging characterization method for nuclear materials analysis. SRNL has recently acquired a new JEOL AccuTOF™-DART® LP 4G with a Filter Spray™ front end sample injection system, to develop new methods for ambient mass spectrometry of uranium analytes. Preliminary measurements of uranium-containing samples have demonstrated a need to rapidly evaluate large datasets generated with tailored data analysis scripts. To address this gap a data analysis pipeline written in R within the R Studio environment has been developed. The pipeline comprises a series of processing steps where the data are ingested, analyte peaks of interest are extracted, subsequent ratio and normalization calculations are performed, and results are presented in a series of graphical plots. In detail, the data files containing up to several hundred chronological spectra of a single sample in netCDF format were first extracted into RStudio. Then, initial 3D plots of the data were created in respect to the time, intensity, and mass to charge domains. These graphics serve as an initial easily visualized survey of instrument data. Next, a .csv format file containing the names, masses, and abundances of isotopes of interest were ingested into RStudio and were used to automatically collect intensity values at the mass value. Uranium isotope ratios were plotted against gadolinium isotope ratios (gadolinium was used as an internal standard) and assessed for ion beam stability and intensity. The spectra were filtered by applying a threshold intensity for the 158GdO+ mass channel. A Monte Carlo experiment was performed by creating a theoretical distribution of the data in order to determine the ratio of the uranium isotopes. The results show that the developed data analysis pipeline successfully filters high quality data from overall poor quality runs. Our results also support the idea that paper spray ionization mass spectrometry can be used for both detection and quantification of trace amounts of uranium compounds.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Continuous Water Quality Sensing for FGD Wastewater

The coal fired plant power industry requires new solutions for on-line monitoring of flue gas desulfurization (FGD) wastewaters for regulated trace metals to reduce recurring operating and off-site laboratory analysis costs and provide a high level of confidence of compliance with state and federal discharge guidelines. The University of Alabama at Birmingham (UAB) developed an integrated water sensor package for continuous water quality monitoring of flue gas desulfurization (FGD) wastewaters for concentration measurements of Selenium (Se). UAB utilized a diverse team of University Professors/Staff Members/Student(s) (Engineering and Innovative Technology Development Group), a University Affiliated Research Institution from the local area (Southern Research), and a cost sharing Industry Partner (Metrohm). The team developed and validated a proprietary wet chemistry batch process for water sample preparation; and implemented this process as a fully automated on-line monitor prototype system. This prototype system’s performance was evaluated in both the laboratory and during in-field deployment to a coal fired power plant. In both environments it was found that the prototype system was unable to recreate the batch process’s success at preparing FGD water samples for total Se measurements with a commercial-off-the-shelf (COTS) cyclic anodic stripping voltammetry (CSV) system. Through this experience, UAB has provided insight into a number of specific areas where improvements can be made with respect to the COTS systems used in this project to yield a more complete and competitive industry solution for on-line monitoring of total Se in industrial wastewater.

20 FOSSIL-FUELED POWER PLANTS↗

Continuous Water Quality Sensing for FGD Wastewater

The coal fired plant power industry requires new solutions for on-line monitoring of flue gas desulfurization (FGD) wastewaters for regulated trace metals to reduce recurring operating and off-site laboratory analysis costs and provide a high level of confidence of compliance with state and federal discharge guidelines. The University of Alabama at Birmingham (UAB) developed an integrated water sensor package for continuous water quality monitoring of flue gas desulfurization (FGD) wastewaters for concentration measurements of Selenium (Se). UAB utilized a diverse team of University Professors/Staff Members/Student(s) (Engineering and Innovative Technology Development Group), a University Affiliated Research Institution from the local area (Southern Research), and a cost sharing Industry Partner (Metrohm). The team developed and validated a proprietary wet chemistry batch process for water sample preparation; and implemented this process as a fully automated on-line monitor prototype system. This prototype system’s performance was evaluated in both the laboratory and during in-field deployment to a coal fired power plant. In both environments it was found that the prototype system was unable to recreate the batch process’s success at preparing FGD water samples for total Se measurements with a commercial-off-the-shelf (COTS) cyclic anodic stripping voltammetry (CSV) system. Through this experience, UAB has provided insight into a number of specific areas where improvements can be made with respect to the COTS systems used in this project to yield a more complete and competitive industry solution for on-line monitoring of total Se in industrial wastewater.

01 COAL, LIGNITE, AND PEAT↗

Ultra High Performance Liquid Chromatography with Quadrupole Time-of-Flight Mass Spectrometry and Fisher Ratio Analysis for Discovery-Based Analysis

The ability to discover minute differences between samples or sample classes for ultrahigh performance liquid chromatography coupled to quadrupole time-of-flight mass spectrometry (UHPLC-QTOF) can be a challenging endeavor especially when these differences are not known a priori. Indeed a typical UHPLC-QTOF analysis time of ~15 minutes can generate over 4 gigabytes of information for a single sample. Implementation of chemometrics such as Fisher ratio (F-ratio) analysis will allow the analyst to quickly and precise probe the chemical differences between different samples or sample classes. F-ratio analysis can be used to find sample or sample class distinguishing compounds reducing the 5 gigabytes of information into a simple, yet informative hit list. Moreover through combinatorial rearrangement, it is possible to determine a F-ratio threshold to separate the real and non-real hits. The F-ratio software presented herein is a semi-automated algorithm that processes the raw, exported .csv files from the SCIEX 500R QTOF in as little as 30 seconds. While further research is needed to modify and perfect the software to deal with high resolution mass spectra precise to 0.0001 Daltons, the current software, precise to 0.1 Da, is able to find significant chemical differences despite some of them being at extremely low concentrations nearing the limit of detection.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Heavy-Duty Vehicle Activity Updates for MOVES Using NREL Fleet DNA and CE-CERT Data

The U.S. Environmental Protection Agency's (EPA's) Motor Vehicle Emission Simulator (MOVES) is a publicly available tool used by researchers and policymakers to help understand motor vehicle emission sources at a national, county, and project level. Estimates of heavy-duty activity in the most recent version of the model at the time this work was conducted, MOVES2014, was identified as an area in need of improvement. The start activity in MOVES2014 is based on a limited and dated data set. In addition, MOVES2014 relies on drive cycles that represent on-network activity but do not account for idling activity that occurs on off-network roads, such as at a distribution center, while the truck is queuing or during loading and unloading. As a result, MOVES2014 may currently underestimate the number of starts and idle and soak time for heavy-duty trucks in real-world operation. The National Renewable Energy Laboratory (NREL) has previously leveraged its expansive Fleet DNA database of heavy-duty vehicles to idle and start activity for six of the nine heavy-duty vehicle source types of classes in the MOVES model. The data available in Fleet DNA from 416 conventional, diesel-powered vehicles provided activity estimates from more than 120,000 hours of operation throughout 14,682 vehicle days between October 2006 and January 2016. NREL calculated start fraction, starts per day, soak fraction, and idle fraction by hour of the day for each vehicle type, state, and vocation, and provided results in .CSV files that can be translated to MOVES table inputs. The idle and start activity from this initial analysis of Fleet DNA data was used to develop default idle and start data for heavy-duty vehicles in MOVES3. Satisfied with the results from the Fleet DNA data used for MOVES3, the EPA asked NREL to extend this start/soak/idle analysis using additional data from a larger number of vehicles for a potential future update to the MOVES model. Such a data set was achieved from a project led by the University of California at Riverside, College of Engineering, Center for Environmental Research & Technology (CE-CERT) and funded by California Air Resources Board. Specifically, this data set consists of 90 heavy-duty vehicles operated mainly in California, which can be separated into five of the nine heavy-duty vehicle classes in the MOVES model. In addition, the heavy-duty activity database collected by CE-CERT provided activity estimates from more than 44,000 hours of operation throughout 4,724 vehicle days between November 2014 and September 2016. This report details the analysis of the heavy-duty activity database collected from the University of California at Riverside by providing graphical analysis and context for the start, soak, and idle distributions. The comparison of the related results from both the Fleet DNA and CE-CERT data sets are documented as well.

33 ADVANCED PROPULSION SYSTEMS↗

Oscilloscope Data Push Program

Data acquisition (DAQ) is a complex and costly process. Creating DAQ systems for analyzing a system requires expensive electronics and a dedicated team of engineers for support, posing a challenge for users who readily need data. This project is a proof of concept to create a temporary or one-off DAQ system using equipment commonly available to every team. We aim to automate the data acquisition process from the Rohde \& Schwarz RTO 1044 oscilloscope, convert the acquired binary data into floating point values, and store the results in a CSV file format. By developing a Python program to handle these tasks, we seek to reduce the manual effort involved in data collection, significantly increasing efficiency.

Osei-Tutu, Jason↗