webspinner
Python utilities for working with data source types used by NREL's dsgrid (Demand-Side Grid Model) project (i.e. AWS, PostgreSQL, and .parquet). https://www.nrel.gov/analysis/dsgrid.html
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Python utilities for working with data source types used by NREL's dsgrid (Demand-Side Grid Model) project (i.e. AWS, PostgreSQL, and .parquet). https://www.nrel.gov/analysis/dsgrid.html
Dynamical Components Analysis is a Python implementation of the method described in "Unsupervised discovery of temporal structure in noisy data with dynamical components analysis". It implements the method as well as related data analysis functions.
Dynamical Components Analysis is a Python implementation of the method described in "Unsupervised discovery of temporal structure in noisy data with dynamical components analysis". It implements the method as well as related data analysis functions.
WeightedAFL (WAFL) is an improvement to open source fuzzer, American Fuzzy Lop (AFL). Fuzzers modify input to target programs in order to produce crashes and other unintended output in those target programs. WAFL integrates directly with AFL to determine offsets within a buffer that will improve performance metrics. WAFL uses various machine learning techniques to learn these offsets. WAFL also provides a novel software engineering solution to integrate with AFL and allows contributors to quickly write and test algorithms in python. SAND2020-12546 O Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.
A library for multi-threaded computation of persistence diagrams. The algorithm for computing persistence diagrams in a lock-free manner was published in the 'Towards Lock-free Persistent Homology' (D. Morozov, A. Nigmetov, Brief Announcement: SPAA 2020); it scales better than the only other shared-memory parallel implementation of persistent homology computation PHAT. Library includes python bindings to compute persistence diagrams and their vectorizations for lower-star filtrations on grid data. It is intended to be used by scientists working on Topological Data Analysis and its applications in different areas.
NRWAL (NLR (National Laboratory of the Rockies) formerly known as NREL (National Renewable Energy Laboratory) Wind Analysis Library: A library of offshore wind cost equations (plus new energy technologies like marine hydro!) Easy equation manipulation without editing source code Full continental-scale integration with the NREL Renewable Energy Potential Model (reV) https://nrel.github.io/reV/ Ready-to-use configs for basic users Dynamic python tools for intuitive equation handling One seriously badass sea unicorn To get started with NRWAL, check out the NRWAL Config documentation or the NRWAL example notebook. You can also launch the notebook in an interactive jupyter shell right in your browser without any downloads or software using binder. Ready to build a model with NRWAL but don't want to contribute to the library? No problem! Check out the example getting started project here. Here is the important stuff: The NRWAL Equation Library. Default NRWAL Configs
KRoad is a 2-dimensional, lightweight, vehicle driver simulator that uses 3-dimensional vehicle driving model considerations, i.e. state-of-the-art friction models, and enables the driver to make control decisions with less computation time and programmer effort required than is with full-fidelity 3d simulators. KRoad is fully compatible with OpenAI gym, and contains a factored gym framework for composing gyms from various components (process, reward function, observation function, termination conditions, etc.). KRoad is additionally compatible with the RLlib distributed reinforcement learning environment, running under the Ray distributed python framework.
Deep learning tools for enhancing the spatial resolution of wind data. The software is developed in Python using the TensorFlow deep learning package. Models for diversity super-resolution is provided. Included in the package are pretrained models with example code/data to perform the super-resolution as well as tools of training models for different enhancement- or data-types. The super-resolution is an inherently ill-conditioned problem, with multiple high-resolution fields plausibly mapping to the same coarse field. Considitional GANs provide a framework for generating a distribution of high-resolution realizations from a given low-resolution input. Stochastic estimation is used to inform the network of the expected degree and location of sub-grid diversity. The package includes a pretrained network to generate distributions of 10x-enhanced fields of wind data.
The Functional Mock-up Interface - Machine Learning Center is a tool to interface the Python-Tensorflow library with building simulation models, to develop and train machine learning-based controls. In particular, this framework allows the use of reinforcement learning through the standardized Functional Mock-up Interface, an open industry standard for co-simulation. First application was the development of a controller for dynamic façade and heating ventilation and air conditioning (HVAC) systems.
The Automated Testing System (ATS) is an open-source, Python-based tool for automating the running of tests of an application across a broad range of high performance computers.
The Future Automotive Systems Technology Simulator (FASTSim™) provides a simple way to compare powertrains and estimate the impact of technology improvements on light-, medium-, and heavy-duty vehicle efficiency, performance, cost, and battery life. This extremely fast simulation tool features a streamlined user interface and can rapidly perform a variety of tasks using basic computing resources: • less than 0.1 second to simulate second-by-second standard duty cycles • less than 10 seconds to estimate vehicle efficiency, fuel economy, acceleration, battery life, and cost • less than 5 minutes to perform powertrain comparisons of efficiency and cost. FASTSim models a variety of vehicle powertrains and fuel converter types: • Conventional vehicles - spark ignition, Atkinson, diesel, and hybrid diesel • Electric-drive vehicles - hybrid, plug-in hybrid, and all-electric • Hydrogen fuel cell vehicles. The default model includes a variety of vehicles and duty cycles and an option for adding additional vehicles and custom cycles: • Packaged with more than 20 vehicles • User interface enables addition of more vehicles • Includes standard U.S. drive cycles as well as European and Japanese cycles. FASTSim is available for download in Microsoft Excel and Python formats here: https://www.nrel.gov/transportation/fastsim.html
Hybrid Power Plants (HPPs) have the potential to increase the value of renewable energy systems and decrease their costs through shared development (e.g., permitting) and infrastructure (e.g., collection system). Prior work has identified potential cost savings and technical and economic performance improvements for solar plus storage plants. However, additional research is needed to understand cost drivers that are specific to hybrid wind plants. Here we analyze the potential for shared infrastructure cost savings at one type of hybrid plant: wind plus solar photovoltaic (PV). To perform this analysis, we developed a new open-source, Python-based cost modeling tool: the Hybrid Balance-of-System (BOS) Systems Engineering model (HybridBOSSE). HybridBOSSE is an extension of NREL's LandBOSSE tool.
Multi-modal Free-moving Data Fusion (MFDF) is a python package that implements low and high-level functionality for performing qualitative and quantitative gamma-ray imaging analyses. Such analyses enable the use of gamma-ray spectrometers and/or imagers to estimate the distribution and quantity of radiological materials in an environment. Free-moving 3D imaging requires additional information about the 3D trajectory and orientation of the system, however all of these methods can be applied to 2D static gamma-ray imaging as well. The package includes methods (MLEM and MAP) for distributed source reconstruction, methods (PSL) for point source reconstruction, the ability to ingest and utilize quantitative detector response functions (for absolute analyses), and the ability to perform 3D estimation of dose-rates from quantitative reconstructions.
This repository contains data ingestion, feature extraction, and analysis code used in NREL Technical report "Clustering Analysis of Commercial Vehicles Using Automatically Extracted Features from Time Series Data." The code is written in Python. The ETL and feature extraction code must be run in a Spark context. The analysis code can be run without Spark, provided you have pre-computed features in a CSV file. Analysis code related to the NREL Technical Report NREL/TP-2C00-74212. Includes PySpark functions to perform trip segmentation and feature extraction over big time series data in Apache Spark. Includes "domain specific" features such as Aerodynamic Speed (ft/s), Characteristic Acceleration (ft/s2), Percent Below 55 (%), Percent Zero (%), Stops Per Mile, Average Speed (mph), Maximum Speed (mph), and Speed Standard Deviation (mph). Includes Pyspark UDF to compute "domain agnostic" features using the TSFresh library. This software record also includes the analysis notebooks and code to generate the results in the previously mentioned technical report.
The Sudoku Online Testing Framework provides a configurable basis for testing user interactions to solve visualization-related problems with sudoku puzzles and games. It consists of a server, a client, and test code. The python server implements sudoku puzzle logic and board selection functions. The JavaScript client implements a graphical user interface (GUI) front-end to display the puzzles and facilitate interactions with users. Within the GUI, logical rules may be selected. Cells may be selected to “pivot” on to make a board for each possible value in the cell. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-6409 O
pyMSDtorch is a python implementation of the MSDNet developed by Sethian and Pelt [1] for image analyses, using the pytorch framework. The availability these networks in mainstream ML packages makes it easier to attach standard expansions and other approaches to make it more flexible and user friendly.
The radkit software suite (python) consists of three primary libraries: stark, trajan, and curie. The trajan library provides the tools to analyze and manipulate data from lidar and inertial measurement unit (IMU) devices as well as trajectories from algorithms such as simultaneous localization and mapping (SLAM). These components allow reading and writing standard data formats, performing rigid affine transformations, discretizing three-dimensional space, and visualizing data products. The curie library comprises a standard set of object-oriented tools for radiation data and analysis in the following modules: (1) listmode and binmode data classes with methods for manipulation, plotting, slicing and file IO; (2) radiological/nuclear source detection/identification analysis results; (3) source encounters of correlated analyses and (4) energy-dependent angular detector response functions. The stark package provides low-level tools that are leveraged by both curie and trajan. The tools are flexible for offline analysis as well as performant for real-time integrations. The radkit libraries have associated Robot Operating System packages for use in real-time and robotic systems.
Procedure for reverse engineering binary files and storing the result in a graph database structure for later analysis. This is achieved through the use of Python, angr, and OrientDB Community Edition.