Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “csv”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Grid Service Values of Generic Marginal Building Flexibility in Modeled 2030 U.S. Power Systems

The datasets include the capacity, energy, and ancillary service values of a marginal kilowatt-hour (kWh) of generic, daily, shiftable building flexibility as a presumed market entrant in the 2030 U.S. power systems. The results should be interpreted along with the caveats listed in "Valuation of Building Flexibility: Grid Service Value for Initial Market Entrants in Projected 2030 United States Power Systems", which also documents the methods used for the study. The factors examined in the study include: grid scenario, region, original usage hour in the day (local time), and building flexibility parameters - efficiency, dissipation, and shifting window include max pre-shift and max post-shift. Filenames in the datasets: The filenames contain information on the grid scenario, and the building flexibility efficiency and dissipation. For example: MidCase_2030_efficiency1.25_dissipation0.05_value.csv contains all results under Mid RE 2020, efficiency = 1.25, and dissipation = 0.05. * MidCase = Mid RE Each .csv file contains: region: The location of the building flexibility, aligned with U.S. Energy Information Administration (EIA) National Energy Modeling System (NEMS) Electricity Market Module regions. max_pre_shift: Part of building flexibility shifting window parameter, indicates the max number of hours the building flexibility can shift earlier. max_post_shift: Part of building flexibility shifting window parameter, indicates the max number of hours the building flexibility can shift later. local_datetime: Original datetime of 1kWh of building energy consumption. local_orig_h: Original usage hour (1-24) of building energy consumption, ignores daylight saving. local_shift_to: The datetime to when building energy consumption shifts, if shifting happens. If no shifting occurs, this cell is left blank. energy: Net energy value of energy shifting. capacity: Net capacity value of energy shifting. shifting_value: Net energy plus capacity value of energy shifting. spin: Spin reserve value at the original datetime of consumption. flex: Flexible reserve value at the original datetime of consumption. reg: Regulation reserve value at the original datetime of consumption. total_profit: Assuming the building flexibility is capable of providing energy, capacity, and ancillary services, total profit is the maximum value of energy shifting value, spin reserve value, flexible reserve value, and regulation reserve value - one of the four choices at any given hour - because we do not allow its value to be double-counted.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Screening Tool for Equitable Adoption and Deployment of Solar (STEADy Solar)

The Screening Tool for Equitable Adoption and DeploYment of Solar (STEADy Solar) is a database and mapping tool designed to promoting clean energy investments for low-income communities across the United States. The tool indicates locations that may be eligible for the Investment Tax Credit bonus adders defined in the 2022 Inflation Reduction Act (IRA) and combines this information with demographics, social vulnerability, solar technical potential, solar economics (modeled net present value), and building counts by use-type. It can be used by states, municipalities, community-based organizations, developers, and researchers to identify sites where solar projects may be economical and where federal incentives may be available to support equitable adoption of solar. Specific values include: Areas eligible for the Energy Communities Tax Credit Bonus Program (including brownfield site counts) Areas eligible for the Low Income Communities Bonus Credit Program (including Tribal Lands, and covered affordable housing project counts) Areas categorized as disadvantaged by Justice40 Commercial and Residential Solar economics characterized by the Net Present Value and Simple Payback Period Total Population, Race, and Ethnicity Median Household Income, Poverty rate, Household Tenure Social Vulnerability Count of buildings, developable rooftop solar capacity (in kWdc) and estimated annual generation potential (in kWh) on four building types: Government General Services, Government Emergency Response, Grade Schools, and Colleges/Universities. The linked report describes the STEADy dataset metadata and presents high level insights from the data. The downloadable and formatted excel dataset makes it easy for users to gain insights for their locations. Supporting .csv and shapefiles provide users with the full data to run their own analyses on equitable solar siting.

14 SOLAR ENERGY↗

NLR HPC Facility Power Usage Effectiveness (PUE) Data

Timeseries of Energy Systems Integration Facility (ESIF) Data Center Power Usage Effectiveness (PUE) Data provided in Parquet and compressed CSV formats Power Metrics Timeseries Fields: ts: Timestamp cooling_kw: Cooling (kilowatts) - Captures the power used by fans and pipe trace heaters associated with outdoor cooling equipment. The dedicated tower filter pump power is also captured as cooling load. energy_reuse: Energy Reuse Effectiveness hvac_kw: Heating, ventilation, and air conditioning (kilowatts) - Captures fan walls, fan coils that support the data center electrical rooms, and the make-up air unit. it_power_kw: IT equipment (kilowatts) - Captures power used by the IT equipment on the data center floor. plug_and_light_kw: Lights and utility plugs (kilowatts) - Captures power associated with the data center and dedicated mechanical room. The crank-case heater for the emergency standby generator is also captured as light and plug load. pue: Power Usage Effectiveness pump_kw: Pumps (kilowatts) - Captures power from pumps that move water in the data center Energy Recover Water loop and the Tower Water loops, and also captures power used by the boost pumps that circulate water through the fan walls. Note: The tower filter pump runs constantly to filter water from the data center cooling tower system, so 2.67 kilowatts are attributed to this pump and that is not reflected in this data field. day: Day of month Outside Weather Station Timeseries Fields: ts: Timestamp outside_air_humidity: Outside air humidity - Relative humidity percent outside_air_temp: Outside air temperature - Degrees Fahrenheit day: Day of month More detail: High-Performance Computing Data Center Power Usage Effectiveness

97 MATHEMATICS AND COMPUTING↗

NLR HPC Eagle GPU Node Metrics

Ganglia node metrics and iLO (Integrated Lights Out) power data captured from six representative Eagle GPU nodes The Eagle HPC operated at NLR from 2019 through 2024. Eagle was a 2,000-node, 8-petaflop system. This dataset is a representative sample of metrics for 6 of the GPU nodes. Each GPU node contained 2 CPUs and 2 GPUs. Data provided in compressed CSV format. Ganglia and iLO Power Time Series Fields ts: Timestamp dv: Device / Node - Rack and Unit - r103u17 == r(ack)103u(nit)17 mt: Metric (only present for Ganglia) vl: Value - Value in watts for iLO power (instantaneous value at sampling time) or specified Ganglia metric below Ganglia Metrics Metric name -- Metric description -- Unit cpu_aidle -- Percent of time since boot idle CPU -- Percent cpu_idle -- Percent CPU idle -- Percent cpu_nice -- Percent CPU nice -- Percent cpu_speed -- Speed in MHz of CPU -- MHz cpu_user -- Percent CPU user -- Percent cpu_wio -- The percentage of CPU Wait I/O -- Percent gpu0_bar1_memory -- Used GPU bar1 memory -- MB gpu0_decoder_util -- GPU decoder utilization -- Percent gpu0_ecc_db_error -- Total ECC error counts for the GPU -- Number gpu0_encoder_util -- GPU encoder utilization -- Percent gpu0_fan -- Fan speed -- RPM gpu0_fb_memory -- Used GPU framebuffer memory -- MB gpu0_graphics_clock_report -- Current clock speeds for the device -- MHz gpu0_mem_total -- Memory total -- MB gpu0_mem_util -- Memory utilization -- Percent gpu0_power_usage_report -- Power usage report -- Watts gpu0_temp -- GPU 1 temperature -- Celsius gpu1_bar1_memory -- Used GPU bar1 memory -- MB gpu1_decoder_util -- GPU decoder utilization -- Percent gpu1_ecc_db_error -- Total ECC error counts for the GPU -- Number gpu1_encoder_util -- GPU encoder utilization -- Percent gpu1_fan -- Fan speed -- RPM gpu1_fb_memory -- Used GPU framebuffer memory -- MB gpu1_graphics_clock_report -- Current clock speeds for the GPU -- MHz gpu1_mem_total -- Memory total -- MB gpu1_mem_util -- Memory utilization -- MB gpu1_power_usage_report -- Power usage report -- Watts gpu1_temp -- GPU 1 temperature -- Celsius ipmi_cpu1_temp -- CPU 1 temperature -- Celsius ipmi_cpu2_temp -- CPU 2 temperature -- Celsius ipmi_inlet_ambient_temp -- Temperature measured at intake -- Celsius ipmi_vr_p1_temp -- CPU 1 voltage regulator temperature -- Celsius ipmi_vr_p2_temp -- CPU 2 voltage regulator temperature -- Celsius mem_buffers -- Amount of buffered memory -- Bytes mem_cached -- Amount of cached memory -- Bytes mem_free -- Amount of available memory -- Bytes mem_shared -- Amount of shared memory -- Bytes mem_total -- Amount of available memory -- Bytes

97 MATHEMATICS AND COMPUTING↗

Outdoor Deployment Data for a Four-Terminal GaAs//Si Tandem Solar Mini-Module

This dataset contains the complete outdoor measurement and analysis data for a mechanically stacked, four-terminal (4T) gallium arsenide (GaAs)//silicon (Si) tandem solar mini-module deployed from October 2019 to January 2021 at the Solar Radiation Research Laboratory (SRRL) in Golden, Colorado, USA. The data support a performance modeling and degradation analysis framework for tandem photovoltaic devices, as described in the accompanying publication. The dataset includes: (1) current–voltage (J–V) characteristics of each sub-cell measured approximately every five minutes, with extracted performance parameters; (2) spectral irradiance from an EKO MS-710 WISER spectroradiometer, along with derived spectral mismatch ratios (SMR) and average photon energy (APE); (3) one-minute resolution meteorological data from the co-located SRRL weather station and GPS-derived precipitable water vapor (PWV); (4) pre-deployment laboratory characterization (external quantum efficiency, J–V curves, standard test conditions parameters); (5) outdoor-extracted temperature and PWV correction coefficients; and (6) PVcircuit equivalent-circuit simulation outputs used for model validation. Degradation rates of −4.1 ± 0.2 %/year (GaAs) and −2.5 ± 0.9 %/year (Si) were determined using a filtering and normalization methodology adapted for fixed-tilt tandem modules. All data are provided in open, portable formats (Apache Parquet, CSV, JSON) to enable full reproducibility of the published analysis.

14 SOLAR ENERGY↗

NGDS Data Archiver

This is a Node.js command line utility for scraping XML metadata from CSW and WFS, downloading linkage data from CSW and WFS, pinging hosts and returning status codes, pinging data linkages and returning status codes, writing ping status to CSV files, and uploading data to Amazon S3.

Source record↗

Sequence Polishing Library (SPL) v10.0

The Sequence Polishing Library (SPL) is a suite of software tools in order to automate "Design for Synthesis and Assembly" workflows. Specifically: The SPL "Converter" tool converts files among the following sequence data exchange formats: CSV, FASTA, GenBank, and Synthetic Biology Open Language (SBOL); The SPL "Juggler" tool optimizes the codon usages of DNA coding sequences according to an optimization strategy, a user-specific codon usage table and genetic code. In addition, the SPL "Juggler" can translate amino acid sequences into DNA sequences.:The SPL "Polisher" verifies NA sequences against DNA synthesis constraints, such as GC content, repeating k-mers, and restriction sites. In case of violations, the "Polisher" reports the violations in a comprehensive manner. The "Polisher" tool can also modify the violating regions according to an optimization strategy, a user-specific codon usage table and genetic code;The SPL "Partitioner" decomposes large DNA sequences into smaller building blocks with partial overlaps that enable an efficient assembly. The "Partitioner" enables the user to configure the characteristics of the overlaps, which are mostly determined by the utilized assembly protocol, such as length, GC content, or melting temperature.

Oberortner, Ernst↗

j5 v2.8.4

j5 automates and optimizes the design of the molecular biological process of cloning/constructing DNA. j5 enables users to benefit from (combinatorial) multi-part scar-less SLIC, Gibson, CPEC, Golden Gate assembly, or variants thereof, for which automation software does not currently exist, without the intense labor currently associated with the process. j5 inputs a list of the DNA sequences to be assembled, along with a Genbank, FASTA, jbei-seq, or SBOL v1.1 format sequence file for each DNA source. Given the list of DNA sequences to be assembled, j5 first determines the cost-minimizing assembly strategy for each part (direct synthesis, PCR/SOE, or oligo-embedding), designs DNA oligos with Primer3, adds flanking homology sequences (SLIC, Gibson, and CPEC; optimized with Primer3 for CPEC) or optimized overhang sequences (Golden Gate) to the oligos and direct synthesis pieces, and utilizes BLAST to check against oligo mis-priming and assembly piece incompatibility events. After identifying DNA oligos that are already contained within a local collection for reuse, the program estimates the total cost of direct synthesis and new oligos to be ordered. In the instance that j5 identifies putative assembly piece incompatibilities (multiple pieces with high flanking sequence homology), the program suggests hierarchical subassemblies where possible. The program outputs a comma-separated value (CSV) file, viewable via Excel or other spreadsheet software, that contains assembly design information (such as the PCR/SOE reactions to perform, their anticipated sizes and sequences, etc.) as well as a properly annotated genbank file containing the sequence resulting from the assembly, and appends the local oligo library with the oligos to be ordered j5 condenses multiple independent assembly projects into 96-well format for high-throughput liquid-handling robotics platforms, and generates configuration files for the PR-PR biology-friendly robot programming language. j5 thus provides a new way to design DNA assembly procedures much more productively and efficiently, not only in terms of time, but also in terms of cost. To a large extent, however, j5 does not allow people to do something that could not be done before by hand given enough time and effort. An exception to this is that, since the very act of using j5 to design the DNA assembly process standardizes the experimental details and workflow, j5 enables a single person to concurrently perform the independent DNA construction tasks of an entire group of researchers. Currently, this is not readily possible, since separate researchers employ disparate design strategies and workflows, and furthermore, their designs and workflows are very infrequently fully captured in an electronic format which is conducive to automation.

Hillson, Nathan↗

TOUGH3 v1.0

TOUGH3 V1.0 capabilities to simulate multi-dimensional, multi-phase, multi-component, non-isothermal flow and transport in fractured porous media, with applications geosciences and reservoir engineering and other application areas. TOUGH3 V1.0 supports a number of different combinations of fluids and components (updated equation-of-state (EOS) modules from previous versions of TOUGH, including EOS1, EOS2, EOS3, EOS4, EOS5, EOS7, EOS7R, EOS7C, EOS7CA, EOS8, EOS9, EWASG, TMVOC, ECO2N, and ECO2M). This upgrade includes (a) expanded list of updated equation-of-state (EOS) modules, (b) new hysteresis models, (c) new implementation of parallel and solver functionalities, (d) new linear solver options based on PETSc libraries, (e) new automatic build system that automatically downloads and builds third-party libraries and TOUGH3, (f) new printout in CSV format, (g) dynamic memory allocation, (h) various user features, and (i) bug fixes.

PAU, GEORGE↗

SynTrack: DNA Assembly Workflow Management (SynTrack) v2.0.1

SynTrack is a dynamic, workflow-driven data management system that tracks the DNA build process: Management of the hierarchical relationships of the DNA fragments; Monitoring of process tasks for the assembly of multiple DNA fragments into final constructs; Creations of vendor order forms with selectable building blocks. Organizing plate layouts barcodes for vendor/pcr/fusion/chewback/bioassay/glycerol/master plate maps (default/condensed); Creating or updating Pre-Assembly/Assembly process workflows with selected building blocks; Generating Echo pooling instructions based on plate maps; Tracking of building block orders, received and final assembled for delivering; Bulk updating of colony or PCR amplification information, fusion PCR and chewback results; Updating with QA/QC outcome with .csv & .xlsx template files; Re-work assembly workflow enabled before and after sequencing validation; and Tracking of plate/well data changes and status updates and reporting of master plate status with QC outcomes.

MENG, XIANWEI↗

PLEXOS Input Data Generator

The PLEXOS Input Data Generator (PIDG) is a tool that enables PLEXOS users to better version their data, automate data processing, collaborate in developing inputs, and transfer data between different production cost modeling and other power systems analysis software. PIDG can process data that is in a generalized format from multiple input sources, including CSV files, PostgreSQL databases, and PSS/E .raw files and write it to an Excel file that can be imported into PLEXOS with only limited manual intervention.

Source record↗

MultiDimChemImaging v1.30

The purpose of this software is to correlate and visualize multidimensional chemical images where the different modalities were collected with different resolution and/or offset. List of features: - change dimension of data stored in XYZ (XYcoordinate, value) or Comma Separated Values (CSV) formats via bipolar or bicubic interpolation - determine and apply offset between different modalities - create a multimodal image file from multiple single modalities in Tab Separate Values (TSV) or TissueViewTM (industry standard for chemical image visualization) formats - visualize and save (whole or partial) composite chemical images made of multiple (up to 3 at once) modalities Specific application: correlated multidimensional chemical imaging by AFM-based nano-thermal (nano-TA) analysis coupled to spectroscopy and mass spectrometry for spatially resolved surface analysis. In case of a phase separated polymer film, the modalities were: 1. topography image 203. IR images collected at two different wavelengths 4-5. mass spectral chemical images of two different m/z values.

Kertesz, Vilmos↗

Automating the Analysis of GHGRP Data Using Python, to Perform Temporal Analysis on Natural Gas Supply Chain Parameters - LCAXIX

This work was presented at the American Center for Life Cycle Assessment 2019 Conference (LCAXIX) in Tucson, AZ on September 24, 2019. Subpart W of the Environmental Protection Agency’s (EPA) Greenhouse Gas Reporting Program (GHGRP) consists of facility level greenhouse gas data for petroleum and natural gas systems that emit 25,000 metric tons or more of GHGs per year. Envirofacts is a tool that provides all publicly available data reported to GHGRP and it can be used to customize and download the data. This is one of the most granular datasets available that can be used to perform a detailed cradle-to-gate Life Cycle Analysis (LCA) of the United States natural gas supply chain. However, as robust as this data is, it is not available in a format that can be analyzed easily, and it is especially difficult to perform a temporal analysis on it. NETL's python script downloads all the .csv files for the desired reporting years from the subpart W of GHGRP.

Rai, Srijana↗

Aerial Measuring System - Analysis of the Releasable Data Set

This is a collection of spectral data files obtained from AMS flights over areas in and around Las Vegas and the Nevada National Security Site. These are being made available for anyone to analyze and compare results with those in the accompanying report. The data files are attached to the PDF as Excel CSV format files.

99 GENERAL AND MISCELLANEOUS↗

Oscilloscope Data Push Program

This paper details the development of a Python program designed to automate the data acquisition and conversion for an oscilloscope for the purposes of a one-off/temporary data acquisition system for users that readily need data, and do not have the option of obtaining a Data Acquisition (DAQ) solution. Creating DAQ systems for analyzing a system requires expensive electronics and a dedicated team of engineers for support. Traditionally, manual data collection and processing are time consuming and prone to error. By automating these processes, the cost, efficiency and accuracy of data handling are improved upon. This project involves the creation of a program that interacts with the oscilloscope. During this interaction, there are various functions being performed such as the acquisition of waveform data via floating points, generating plots with the acquired wave points, and storing of floating points in a CSV file format for future reference and plotting purposes. While the initial aim of the project included continuous logging to a cloud database, this was deferred due to time constraints. The results portrayed an almost-instant rate of data collection with a buffer time, showcasing the potential for further integration and real-time data processing.

Osei-Tutu, Jason↗

Zapiary: Creating Visibility in IOT Networks

Zigbee and Z-Wave are the main networking protocols used by low-power Internet of Things (IOT) devices. These protocols use low frequencies. Mesh architecture, and unique address formats that make them not compatible with traditional network traffic tools like IX-Discovery Tools. Zapiary is a software that takes CSV files with Zigbee and Z-Wave traffic and generates Structured Threat Information eXpression (STIX) JSON bundles illustrating the communication within IOT networks. The bundles can then be viewed within Structured Threat Intelligence Graph (STIG) or used with AI/ML models to provide deeper visibility into nodes that make up the network and the ability to trend the mesh network over time.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Designing a User Interface for Real-Time Magnetometer Data Acquisition

The Matter-wave Atomic Gradiometer Interferometric Sensor (MAGIS-100) is a next-generation quantum sensor designed to search for ultralight dark matter and explore new frontiers in quantum mechanics. Due to the experiment’s sensitivity to magnetic interference, a magnetometer trolley system was developed to scan magnetic fields along a vacuum tube. Interacting with the system required command-line inputs, creating usability challenges. To improve accessibility and streamline data acquisition, I developed a graphical user interface (GUI) using Python and the customtkinter library. The GUI supports real-time data display, state/mode switching, command execution, and CSV file management. I collaborated with another intern to integrate data visualization features into the GUI, allowing users to generate 3D plots of post-acquisition magnetic field data. In the future, I aim to fix the real-time plotting feature as it results in an unresponsive GUI.

Mendez, Milagros [DuPage Coll.]↗

ADCP Upsample

This R script takes reads the csv file of stream-wise velocity data and generates a new time series of with comparable but distinct noise using the Langevin method and library. It simulates a time series measured at 1/10 the sampling rate by calculating a moving average of 10, though other sampling rates can be calculated by adjusting the moving average window. A stationary signal is calculated by taking the difference of the original signal and the moving average, then normalizing by the standard deviation of the moving average. The stationary signal is used to calculate drift and diffusion coefficients. Those coefficients are used to generate a new stationary signal. The new stationary signal is un-normalized and added to the moving average (or new equivalent signal) to create a new up-sampled velocity time-series.

Green, Nathan↗