WattAMeter [SWR-25-101]
WattAMeter is a Python package for monitoring and recording power consumption over time, enabling users to collect time series data on CPU, GPU, and RAM power usage. It also estimates energy consumption and CO₂ emissions.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
WattAMeter is a Python package for monitoring and recording power consumption over time, enabling users to collect time series data on CPU, GPU, and RAM power usage. It also estimates energy consumption and CO₂ emissions.
Due to their captive and local operations, industrial locomotives present a unique potential to reduce energy consumption and associated costs through application of advanced locomotive technologies. However, until now, there has been no data source for the number, size (hp), usage, and energy consumption of these locomotives, which limits the ability to design and implement a research, development, and deployment strategy. This research addresses this gap by developing the first national inventory of locomotives in industrial use and provides a tool to explore the energy and emissions associated with this transportation segment.
Personal micromobility devices like bicycles, e-bikes, and scooters are low- or zero-energy alternatives to single-occupancy vehicles. However, a lack of data has led to a dearth of data-driven research on personally owned e-bike usage. We present longitudinal findings from the CanBikeCO program, focused on e-bike adoption and use across demographics, trip characteristics, and geographies in the state of Colorado. CanBikeCO recorded travel survey data from low-income individuals provided with personal e-bikes by the Colorado Energy Office in six communities across Colorado from July 2021 to December 2022. The data were collected using a custom instance of the National Renewable Energy Laboratory OpenPATH platform, which combines passive data collection with semantic information such as trip mode and purpose labels. To our knowledge, there are no prior travel survey data on personally owned e-bikes with this range and scope. Insights from this unique dataset include: (i) work trips were 17% more likely than average trips to be taken on an e-bike, (ii) e-bikes were most often reported to replace cars (34% of e-bike trips) and other personal micromobility devices (22%), and (iii) participants favored walking for trips less than 1 mile, e-bikes for trips of 1-3 miles, and e-bikes, cars, or shared rides for trips of 3-20 miles. The data used to generate these results have been made available in the Transportation Secure Data Center. We find e-bike use is appealing across age groups and may be related to characteristics of land use, urban form, occupation, income, and car ownership. We conclude for this population that the energy demand added by e-bike use (induced demand and replacing non-motorized modes) is outweighed by the reduction in energy demand from replacement of single-occupancy vehicle trips with e-bike trips. Our findings suggest considerable potential for energy savings from personal e-bike ownership.
Many distributed systems, file transfer mechanisms, and message passing systems offer reliability mechanisms such as acknowledgements, retries, and durability. While these tools may be “good enough” for their typical use cases, they may not offer sufficient coverage for the wide range of faults that impact data transfers and communication. A gap in the reliability measures may lead to some small amount of data loss. Some high-consequence systems cannot tolerate the loss or corruption of even a single record. We present seven principles that will counter a wide range of faults and protect against data loss and corruption. These principles bring together lessons learned from a wide range of technologies and can inform appropriate system design and application usage. These principles will help readers reason on how prevent data loss in a multi-hop pipeline and how to properly use tools that may have a deficiency in reliability.
BuildingSync® is a building data exchange schema to better enable integration between software tools and building data workflows. The schema's original use case was focused on commercial building energy audits; however, several additional use cases have been realized including building energy modeling and more high-level generic building data exchange. Version 2.7.0 adds new elements for file attachment feature and FederalBuilding, and generalizes usage of Optional Elements (e.g. EquipmentCondition, EquipmentID) to all assets/systems. BuildingSync helps streamline the data exchange process, improving the value of the data, minimizing duplication of effort for subsequent building data collection efforts (including audits), and facilitating the achievement of greater energy efficiency. This in done in part by standardizing on (a) reporting audits in an electronic format, (b) tracking proposed, implemented, and discarded energy conservation measures, and (c) storing building characteristics (at multiple levels) for audits, benchmarking, and building energy analysis. BuildingSync has several documents and tools available to help users understand how to best leverage BuildingSync. The list below are only a subset of the resources available. If new resources are discovered, then feel free to create a new pull request with the additions. Generic BuildingSync information is available on the DOE website and the project website. BuildingSync Examples - These examples are kept up to date and show a wide range of implementations. Any new update to BuildingSync is required to pass validation on these example files. BuildingSync Use Case Validator allows for users to determine if their instance complies with a specific use case for BuildingSync by checking if the required elements are implemented in an uploaded instance. An API is also provided for automated integration into other tools. Also, the website contains an easy way to view the entirety of the schema and how elements relate to the Building Exchange Data Exchange Specification. The Validator is open sourced here Use Case TestSuite provides a Python package for easier generation of BuildingSync use cases. BuildingSync use cases depend on the generation of schematron documents, which is time-consuming and difficult to implement well. The TestSuite allows users to define a use case using a more palatable CSV template, which it then turns into a Schematron document. The source code is available here. BuildingSync to OpenStudio/EnergyPlus. The translator is open sourced here. This project will translate a Level 1 (and partial Level 2) ASHRAE Energy Audit to a fully defined OpenStudio and EnergyPlus model. This project is in early Beta testing and any feedback is welcome!
Overview -------------------------- This repository contains datasets from the manuscript **"Enhanced Generalizability to Deep-Learning Quantification of 3D Microstructural Characteristics through Microstructurally Aware Augmentation of Scarce Data"** (*William F. Kent, Rochan Bajpai, Rachel C. Kurchin, William K. Epting, Harry W. Abernathy, Paul A. Salvador. Submitted 2026*). The methods are also described in the dissertation **Data Intensive Analysis of Solid Oxide Cell Microstructures** (*Doctoral dissertation, Carnegie Mellon University, 2025*). The datasets here are trained convolutional neural network (CNN) models for predicting key microstructural properties of solid oxide cell (SOC) electrodes from low-res, 2-channel 3D images, as well as some helpful code. The parameters for input images are provided in the paper. Sample data is provided in the file `Combined_anode_aug_dual_1k_examples` - that particular data was used to train `anode_all_aug.pth` and will work most accurately with that model. Please familiarize yourself with all caveats on accuracy and applicability, as detailed in the associated paper. Usage -------------------------- The basic usage is as follows, assuming `model_fn` is the path to the .pth file, and `X` is 2-channel input image(s) of the proper dimensions (either one image of shape `[2,12,24,24]`, or a batch of N input images of shape `[N,2,12,24,24]`): from CNN_inferencer import load_model_for_inference model = load_model_for_inference(model_fn) y_predicted = model(X) The model object automatically handles input scaling and output de-scaling based on the way the models were trained - in other words, pass in a 2-channel micro-CT image, and it will output microstructural property values in real units. ## Other model object attributes Note that model has useful attributes other than its forward pass model(X). * `model.output_descaler` - returns the output descaler object. Model does the de-scaling when generating inferences, but you may want to re-use this de-scaler on other values to e.g. compare predictions to ground truth from already-scaled training data. * `model.prop_names` - Gives the property names of the predicted y values, in order. Only exists if there's an output scaler as part of the model object, which there will be in the models provided here. ## Usage with sample data Here is a short script to use with the included sample data. from CNN_inferencer import display_predictions, load_model_for_inference, calculate_mape, parity_plot import h5py import numpy as np model_fn = 'anode_all_aug.pth' data_fn = 'Combined_anode_aug_dual_1k_examples.h5' N_samples = 200 figure_outdir = '.' model = load_model_for_inference(model_fn) with h5py.File(data_fn,'r') as f: XX = f['X'] #These are the 2-channel 3D images yy = f['y'] #These are the ground-truth microstructural properties, but they have been scaled for training - need to de-scale below N = XX.shape[0] #How many images total in the input data file #Run inferences on N_samples random samples from XX. #Run in a batch, much more efficient than one at a time. ii = np.random.choice(N,N_samples,replace=False) ii.sort() y_pred = model(XX[ii]) #Get the original/true (but normalized/scaled) values from the training dataset... #Because they were normalized, they are not in real units yet. So let's also de-scale them using model.output_scaler. y_true = model.output_scaler.transform(yy[ii]) #Let's display actual values for just 5 random ones for i in np.random.choice(N_samples,5,replace=False): display_predictions(y_true[i], y_pred[i], model.prop_names) #Make parity plots for each property (ground truth vs predicted values) #Also label each plot with the mean abs. percent error (MAPE) of the predicted values for i,key in enumerate(model.prop_names): mape = calculate_mape(y_true[:,i], y_pred[:,i]) parity_plot(y_true[:,i], y_pred[:,i], figure_outdir, key, extra_title=f' ({mape:.2f}% MAPE)')
SUMMARY The U.S. Department of Energy (DOE) Advanced Reactor Technologies (ART) Graphite Research and Development (GRD) Program is conducting a series of six experiments to quantify the effects of irradiation on nuclear-grade graphite. This report documents the qualification of irradiation monitoring data for the fifth experiment, High Dose Graphite-1 (HDG-1). Qualified monitoring data are required by the ART program to support the design and licensing of the first high-temperature reactor (HTR) nuclear plant. Data are classified as Qualified if they meet the usage requirements described in the experiment planning and quality assurance (QA) documents, Failed if they do not meet those requirements and provide no usable information, or Trend if they do not fully meet all requirements but still provide useful information subject to an assessment of how any deficiencies may affect a particular use of the data. HDG-1 irradiation began with Advanced Test Reactor (ATR) Cycle 168B on August 24, 2020, and concluded after Cycle 173C on January 27, 2025. The HDG-1 capsule was removed from the reactor core twice—during core internal change (CIC) Cycle 170A and powered axial locator mechanism (PALM) Cycle 172A—to prevent overheating of the graphite specimens during high-power PALM cycles. The capsule was therefore irradiated during a total of seven normal ATR cycles: 168B, 169A, 171A, 171B, 173A, 173B, and 173C. Irradiation monitoring data evaluated in this report include thermocouple (TC) temperature, gas flow rate, gas moisture, gas pressure, specimen load, and graphite stack displacement. Temperature. A total of 14,508,065 TC temperature records were captured. Of these, 13,901,785 (95.8%) are Qualified and 606,280 (4.2%) are Failed. The principal source of failed temperature data was the instrument failure of TC-9 (Zone 2) on June 24, 2024, and TC-10 (Zone 1) on July 5, 2024, near the end of Cycle 173A, which resulted in 595,554 Failed readings. An additional 379 missing values and 10,347 slightly negative values from TC-13 during ATR outages are also Failed. Neither TC-9 nor TC-10 was used as a temperature-control TC, and their failures did not compromise capsule condition monitoring. Correlation analysis of all 13 TCs found no evidence of virtual junction formation. Control chart analysis revealed clear downward drift of approximately 80°C for TC-6 (Zone 3) relative to other stable TCs, and possible downward drift of approximately 60°C for TC-13 relative to the Zone 5 control TC (TC-1), though TC-13 remained consistent with the Zone 2 control TC (TC-12). Gas flow. A total of 20,088,090 gas flow rate records were captured. Of these, 19,941,463 (99.3%) are Qualified and 146,627 (0.7%) are Failed due to missing values. All argon, helium, and total gas flow data were within expected ranges throughout the irradiation. Gas moisture. A total of 1,116,005 outlet gas moisture values were captured. Of these, 1,101,421 (98.7%) are Qualified and 14,584 (1.3%) are Failed, comprising 14,556 out-of-range values and 28 missing values. The out-of-range moisture values exceeded 22,000 ppmv for approximately 1 week at the beginning of Cycle 173A, when accumulated moisture evaporated after the capsule was retrieved from water storage during PALM Cycle 172A and reinserted into the east flux trap. Moisture levels returned to below 25 ppmv for the remaining three cycles, and the transient high-moisture event did not affect the integrity of specimen irradiation. Gas pressure. A total of 7,812,035 gas pressure values were captured. Of these, 6,642,048 (85.0%) are Qualified and 1,169,987 (15.0%) outlet pressure values are Failed, comprising 718,537 zero outlet pressure values due to sensor failure from Cycle 168B through Cycle 171B, 54,550 missing values, and 396,900 too-low outlet pressure values, ranging from 1.1 to 1.6 psia after sensor replacement during Cycle 173A. Load. A total of 6,696,030 load values were captured. Of these, 6,694,580 (99.98%) are Qualified and 1,450 (0.02%) are Failed due to missing values. Applied loads to the six specimen stacks were stable throughout the irradiation. Stack displacement. A total of 6,696,030 displacement values were captured. Of these, 5,713,297 (85.32%) are Qualified and 3,781 (0.06%) are Failed due to missing values. Stack displacement increased consistently throughout the irradiation, reaching approximately 3.08 in. for Channels 5 and 6 by the end of irradiation. 978,952 (14.62%) substantially elevated displacements observed for Channel 6 beginning in Cycle 171A and for Channel 5 beginning in Cycle 173A are assigned Trend status. Raising pressure. A total of 1,115,999 raising pressure values were captured. Of these, 1,115,430 (99.95%) are Qualified and 569 (0.05%) are Failed due to missing values. Ram pressure. A total of 6,696,030 ram pressure values were captured. Of these, 6,692,249 (99.95%) are Qualified and 3,484 (0.05%) are Failed due to missing values. Stack raising was perf
NREL's computational sciences center hosts the largest high performance computing (HPC) capabilities dedicated to energy research while functioning as a living laboratory for energy-efficient computing. NREL's HPC capabilities support the research needs of the Department of Energy's Office of Energy Efficiency and Renewable Energy (EERE). In ten years of operation, HPC use in EERE-sponsored research has grown by a factor of 30, including work in electricity generation, energy efficiency, transportation, and energy system modeling. This paper analyzes this research portfolio, providing examples of individual use cases. The paper documents NREL's history of operating one of the world's most energy-efficient data centers while examining pathways to reduce economic and environmental impact beyond reduction of Power Usage Efficiency (PUE). This paper concludes by examining the unique opportunities created for accelerating improvements in data center efficiency created by combining an HPC system dedicated to energy research and a research program in energy-efficient computing.
The widespread use of pesticides, such as atrazine and malathion, in agricultural systems raises significant concerns regarding the contamination of groundwater, which serves as a critical resource for drinking water. This study applies machine learning techniques to predict the concentrations of atrazine and malathion in groundwater across Georgia, USA, using 2019 data. A Random Forest classifier was employed to integrate various environmental and demographic factors, including pesticide application rates, precipitation, lithology, and population density, to predict pesticide contamination in groundwater. The models demonstrated high training accuracies of 100% and moderate average testing accuracy of 55% for atrazine and 60% for malathion across five iterations. The low test accuracy of the model, ranging from 50% to 75%, is likely due to overfitting, which can be attributed to the small dataset size and the complex nature of pesticide-contamination patterns, making it challenging for the model to generalize to unseen data. Feature importance analysis revealed that average pesticide usage emerged as the most influential factor for atrazine, while aquifer lithology and precipitation played crucial roles in both models. These results provide valuable insights into the dynamics of pesticide contamination, highlighting areas at greater risk of contamination. The findings underscore the importance of integrating environmental, geological, and agricultural variables for more effective groundwater management and sustainable agricultural practices, contributing to the protection of water resources and public health.
As we transition to a more sustainable energy system, the extraction and processing of critical minerals becomes increasingly important. However, these industries often raise concerns about environmental and social impacts, particularly in disadvantaged communities. To address these concerns, our research focuses on regionalizing environmental life cycle data to connect it with communities affected by mineral extraction. A framework was developed for collecting life cycle background data that supports the Justice40 Toolset, a market-based approach to evaluating net benefits and costs of critical mineral material recovery pathways. A goal was to alleviate public skepticism around mineral extraction processes, including secondary and unconventional feedstocks, by highlighting both environmental and social impacts. To achieve this, computational analysis and geospatial data science techniques were employed, such as within-scale and across-scale methods and proxy dataset usage. By doing so, we were able to develop a framework for identifying and disaggregating data down to regions small enough to support Justice40 goals. Our approach not only provides valuable tools fo insight into the environmental implications of mineral extraction but also helps policymakers evaluate the social impacts on local communities. This research contributes to a more just and equitable transition to a sustainable energy system, ensuring that marginalized voices are heard in decision-making process.
Predictive mathematical modeling is an essential part of systems biology and is interconnected with information management. Systems biology information is often stored in specialized formats to facilitate data storage and analysis. These formats are not designed for easy human readability and thus require specialized software to visualize and interpret results. Therefore, comprehending modeling and underlying networks and pathways is contingent on mastering systems biology tools, which is particularly challenging for users with no or little background in data science or system biology. To address this challenge, we investigated the usage of public Artificial Intelligence (AI) tools in exploring systems biology resources in mathematical modeling. We tested public AI’s understanding of mathematics in models, related systems biology data, and the complexity of model structures. Our approach can enhance the accessibility of systems biology for non-system biologists and help them understand systems biology without a deep learning curve.
Power time series captured from all Eagle nodes using iLO (Integrated Lights Out) The Eagle HPC operated at NLR from 2019 through 2024. Eagle was a 2,000-node, 8-petaflop system. This dataset is a comprehensive time series of instantaneous snapshots of power usage at 1 minute intervals from all nodes at the node level. Data provided in compressed Hive dataset/Parquet format. iLO Power Time Series Fields ts: Timestamp dv: Device / Node - Rack and Unit - r103u17 == r(ack)103u(nit)17 vl: Value - Value in watts (instantaneous value at sampling time) day month year
GRETL is a C++ library for evaluation, re-evaluation and algorithmic differentiation of functional operations on an arbitrary computational graph with limited memory usage. Similar to popular machine learning frameworks in Python, like PyTorch and JAX, it tracks and stores both operations and output data as functions are evaluated. Once this composition of functions is built up, the entire chain of operations can be back propagated to compute sensitivities of the final result with respect to any number of inputs. In contrast to most machine learning applications, memory usage becomes the bottleneck for back propagation in many physics applications, especially for time-dependent PDEs. Dynamic check pointing becomes essential. An important distinguishing feature of GRETL is its ability to limit the maximum memory usage by automatically dynamic checkpointing the data output for each graph operation (see Wang, Moin, Iaccarino, 2009). During backpropagation, parts of the graph that are no longer in memory are automatically re-evaluated from upstream checkpointed states as needed for derivative sensitivity calculations (or more precisely, for vector-Jacobian products). GRETL is particularly beneficial for applications, such as coupled multi-physics, where deriving adjoint-based sensitivities and managing checkpoint memory across modules becomes onerous. Cases which can be readily handled by the GRETL library include: different time-integration algorithms per physics (e.g., coupled predictor-corrector algorithms, IMEX, etc.), sub-cycling, asynchronous integrators, state dependent timestep sizes, iterative solvers and coupling algorithms, controller algorithms, and more.
Pooled ridesharing offers on-demand, one-way, cost-effective transportation for passengers traveling in similar directions via a shared vehicle ride with others they do not know. Despite its potential benefits, the adoption of pooled rideshare remains low in the United States. This exploratory study aims to evaluate potential service improvements and features that may increase users’ willingness to adopt the service. The study analyzed transportation behaviors, rideshare preferences, and willingness to adopt pooled rideshare services among 8296 U.S. participants in 2025, building on findings from a 2021 nationwide survey of 5385 U.S. participants. The study incorporated 77 actionable items developed from the results of the 2021 survey to assess whether addressing specific user-generated topics such as safety, reliability, convenience, and privacy can improve pooled rideshare use. A side-by-side comparison of the 2021 and 2025 data revealed shifts in transportation behavior, with personal rideshare usage increasing from 22% to 28%, public transportation from 21% to 27%, and pooled rideshare from 6% to 8%, while personal vehicle (79%) use remained dominant. Participants rated features such as driver verification (94%), vehicle information (93%), peak time reliability (93%), and saving time and money (92–93%) as most important for improving rideshare services. A pre-to-post analysis of willingness to use pooled rideshare utilizing the actionable items as per respondents’ preferences showed improvement: “definitely will” increased from 15.9% to 20.1% and “probably will” rose from 35.6% to 47.7%. These results suggest that well-targeted service improvements may meaningfully enhance pooled rideshare acceptance. This study offers practical guidance for Transportation Network Companies (TNCs) and policymakers aiming to improve pooled rideshare as well as potential future research opportunities.
The primary objective of the 2005 Washoe County Travel Characteristics Study was to document travel behavior data characteristics of regional households in Washoe County, Nevada, in order to update the regional transportation model. The household travel survey, which was conducted from October through November, was one of several surveys conducted in the fall of 2005 for the Regional Transportation Commission (RTC) of Washoe County, with the other surveys focusing on documenting transit usage, visitor travel behavior, and external travel through the region. The data collected were drawn from 1,174 households within the RTC planning area and contain information about 2,679 household members, 2,138 vehicles, and 11,077 unlinked trips. The household travel survey entailed the collection of activity and travel information for all household members regardless of age during a specific 24-hour period. The survey relied on the willingness of regional households to 1) provide demographic information about their household, its members, and its vehicles and 2) have all household members record all travel and activity for a specific 24-hour period, including address information for all locations visited, trip purpose, mode, and travel times.
As cities continue to grow globally, characterizing the built environment is essential to understanding human populations, projecting energy usage, monitoring urban heat island impacts, preventing environmental degradation, and planning for urban development. Buildings are a key component of the built environment and there is currently a lack of data on building height at the global level. Current methodologies for developing building height models that utilize remote sensing are limited in scale due to the high cost of data acquisition. Other approaches that leverage 2D features are restricted based on the volume of ancillary data necessary to infer height. Here, we find, through a series of experiments covering 74.55 million buildings from the United States, France, and Germany, it is possible, with 95% accuracy, to infer building height within 3 m of the true height using footprint morphology data. Our results show that leveraging individual building footprints can lead to accurate building height predictions while not requiring ancillary data, thus making this method applicable wherever building footprints are available. The finding that it is possible to infer building height from footprint data alone provides researchers a new method to leverage in relation to various applications.
Battery lifetime prediction at early cycles is crucial for researchers and manufacturers to examine product quality and promote technology development. Machine learning has been widely utilized to construct data-driven solutions for high-accuracy predictions. However, the internal mechanisms of batteries are sensitive to many factors, such as charging/discharging protocols, manufacturing/storage conditions, and usage patterns. These factors will induce state transitions, thereby decreasing the prediction accuracy of data-driven approaches. Transfer learning is a promising technique that overcomes this difficulty and achieves accurate predictions by jointly utilizing information from various sources. Hence, we develop two transfer learning methods, Bayesian Model Fusion and Weighted Orthogonal Matching Pursuit, to strategically combine prior knowledge with limited information from the target dataset to achieve superior prediction performance. From our results, our transfer learning methods reduce root-mean-squared error by 41% through adapting to the target domain. Furthermore, the transfer learning strategies identify the variations of impactful features across different sets of batteries and therefore disentangle the battery degradation mechanisms and the root cause of state transitions from the perspective of data mining. These findings suggest that the transfer learning strategies proposed in our work are capable of acquiring knowledge across multiple data sources for solving specialized issues.
CMS is transitioning to use ROOT’s new RNTuple data storage format for the files CMS will write in the HL-LHC era. Based on initial tests, CMS expects faster I/O and smaller files compared to the present TTree storage format. This contribution will show a comprehensive performance comparison between RNTuple and TTree I/O using CMS AOD and MiniAOD data formats as test cases for both simulation and collision data corresponding to similar data taking conditions of LHC Run 3. Quantities such as the resulting file size, the memory usage of the I/O components, and the rate of events being read from a file or written to a file will be measured. CMS’ data processing relies heavily on reading files over the local or wide area networks. The file read patterns are important because the latencies have been seen to influence the total production job times. Therefore a study on the file read patterns will be conducted by recording traces of the offset, size, and timestamp of each read request for both RNTuple and TTree. The behavior of network reads will be mimicked by reading local files where artificial latency will be added to the read requests. The effect of different latency values on the job times will be studied.