Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “metadata”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

National Geothermal Database

THE NGDS IS A USER-FRIENDLY, WEB-BASED APPLICATION TO SUPPORT FINDING, VISUALIZING, MAPPING, AND ACQUISITION OF DATA BY END-USERS. THIS APPLICATION ALLOWS USERS TO DISCOVER AND ACCESS RESOURCES MADE AVAILABLE ACROSS ALL NGDS NODES, AND TO SEARCH FOR DATA ACROSS THE SYSTEM BASED ON TOPIC, LOCATION, AND OR OTHER CRITERIA. STANDARDIZED METADATA DESCRIBING EACH DATASET PROVIDES THE USER WITH THE INFORMATION NECESSARY TO DETERMINE THE UTILITY OF THAT DATASET FOR THEIR PURPOSES. GEOGRAPHIC DATASETS CAN BE VISUALIZED THROUGH A MAP INTERFACE THAT ALLOWS USERS TO INSPECT THE DETAILS OF INDIVIDUAL DATA POINTS (E.G. WELLS, TEMPERATURE MEASUREMENTS, ETC.) FROM PROPERLY FORMATTED DATASETS. IN ADDITION TO VISUALIZATION WITHIN THE APPLICATION, THE INTERFACE PROVIDES THE INFORMATION NECESSARY FOR USERS TO ACCESS THE DATA FROM OTHER APPLICATIONS.

Source record↗
DOE OSTI2018

jansson_snijders_collaborative_cross

This is supplemental material for a scientific paper. This project 'bernstein-2017-founders-species', explores community succession using a lake biofilm as a model. The code here was used to process and analyze environmental metadata and genetic sequencing data. Statistical tests and data visualization are included. This code makes use of commodity software that is freely available and commonly used in this field. No new methods or techniques are introduced in this code.

Brislawn, Colin↗
DOE OSTI2018

Mage

The Mage suite of tools provide access to DMS files and metadata.

Monroe, Matthew↗
DOE OSTI2018

Cinema Toolkit

Cinema is a workflow and toolkit for capturing, storing and exploring extreme scale scientific data. It is a highly interactive image-based approach to data analysis and exploration that promotes investigation of large scientific datasets, and is easily integrated into existing workflows through extensions to widely used open source tools. In short, many different images of the dataset are captured and stored in a database, along with metadata describing the images. This provides a method of exploration that is unlike other current methods. This novel approach supports interactive exploration of a wide range of results, while still significantly reducing data movement and storage. The Cinema toolkit includes database specifications and software such as database writers, database viewers, algorithms and other support software that enable a wide variety of applications to write, operate on, and view Cinema databases.

ECP↗
DOE OSTI2015

MarFS, Version 1

There is a sea (mar is Spanish for sea) of data out there that needs to be handled efficiently. Object Stores are filling the hole of managing large amounts of data efficiently. However, in many cases, and our HPC case in particular, we need a traditional file (POSIX) interface to this data as HPC I/O models have not moved to object interfaces, such as Amazon S3, CDMI, etc.Eventually Object Store providers may deliver file interfaces to their object stores, but at this point those interfaces are not ready to do the job that we need done. MarFS will glue together two existing scalable components: a file system's scalable metadata component that provides the file interface; and existing scalable object stores (from one or more providers). There will be utilities to do work that is not critical to be done in real-time so that MarFS can manage the space used by objects and allocated to individual users.

ECP↗
DOE OSTI2019

GNU Radio Sandia Utilities v. 1.6

This software adds a data handling module to the GNU Radio (GR) software defined radio (SDR) framework as well as some general-purpose function blocks (filters, metadata control, etc). This software is useful for processing bursty RF transmissions with GR, and serves as a base for applying SDR signal processing techniques to a whole burst of data at a time, as opposed to streaming data which GR.

Gilbert, Jacob↗
DOE OSTI2019

ldlms_plugins_llnl

ldlms_plugins_llnl contains LLNL-developed plugins for LDMS (Lightweight Distributed Metric Service), which is software for low overhead monitoring, transport and storage of cluster metric data. These plugins add to LDMS the capability to monitor Lustre file system clients, metadata servers, and object storage servers.

Morrone, ChristopherJ↗
DOE OSTI2019

Splash v1.0

A database, web API and portal will be developed that stores data from synchotron experiments. The data stored will be: - metadata about the experiment (who ran it, when it was conducted, what proposal and ESAF were covered) - references to raw data (e.g. images taken at the beamline) - references to derived data Beamline users and Beamline staff will have private access to view experiment data and assign web-friendly visualizations to it. They will also be use the portal to download some of the data taken at the beamline. They we will be able to create and approve experiment pages that can be viewed publicly. The software created for this project will include replication and fail over technologies to maintain a high level of uptime. Software developed in this project will be: - database schema - web middleware to create a web API - web-based user interface code

McReynolds, Dylan↗
DOE OSTI2017

UnifyFS: A Distributed Burst Buffer File System - 0.1.0

UnifyFS is a user-level burst buffer file system under active development. UnifyFS supports scalable and efficient aggregation of I/O bandwidth from burst buffers while having the same life cycle as a batch-submitted job. While UnifyFS is designed for N-N write/read, UnifyFS compliments its functionality with the support for N-1 write/read. It efficiently accelerates scientific I/O based on scalable metadata indexing, co-located I/O delegation, and server-side read clustering and pipelining.

ECP↗
DOE OSTI2020

DEPRECATED Hasty [SWR-20-80]

DEPRECATED This repository was archived by the owner on Nov 18, 2022. It is now read-only. The software is a web app to create semantic metadata models, namely, Haystack and Brick. The purpose of Hasty is to assist in the auditing of building mechanical systems and controls. The software is designed to capture mechanical system topology and important information regarding real world controls implementations. The tool is intended to output Brick / Haystack / ASHRAE 223 compliant models.

Mosiman, Cory↗
DOE OSTI2020

Splash-ML v0.1

The Splash database and portal, also under development (https://lbl.wellspringsoftware.net/kms/invention/detail/3980/), ingests experimental data and references to datasets from a variety of sources, primarily lightsource beamlines. After deployment, it will contain a great deal of metadata and references to data from which many insights can be extracted.

McReynolds, Dylan↗
DOE OSTI2020

XRFtomo

Based on [1], XRFtomo brings together a variety of image processing tools used for preparing, processing and reconstructing 3D renditions of samples imaged using a synchrotron-based x-ray fluorescence (XRF) microprobe or nanoprobe at the Advanced Photon Source (APS). This software bridges the gap between data acquisition and visualization by providing tools to adjust for misalignment in the imaging process and tools for running reconstructions[2], all with the use of a GUI or command line. XRFtomo accepts .h5 files processed through MAPS[3] and it outputs reconstructed cross-sections, projections, sinograms, metadata, and a configuration file with last-used parameters for rapid processing the next time the program is launched. These images serve as inputs for other 3D visualization software for generating volumetric renderings and animations.

Marin, Fabrico↗
DOE OSTI2020

sandialabs/xyz

Tools for extracting and viewing information from zip archives. Simply extracts and displays zip file metadata in a format convenient for analysts.SAND2020-0168 M

Smutz, Charles↗
DOE OSTI2020

Panel-Segmentation [SWR-21-18]

Panel-Segmentation contains the scripts for automated metadata extraction of solar PV installations, using satellite imagery coupled with computer vision techniques. In this package, the user can perform the following actions: *Automatically generate a satellite image using a set of lat-long coordinates, and a Google Maps API key. Users would need to set up a Google Cloud account and get a Maps Static API key. Please refer to Setting Up Google Maps Static API Key section for this process. *Perform image segmentation on the satellite image, to locate the solar array(s) in the image on a pixel-by-pixel basis, using an image segmentation model (panel_detection_model.pth). Get classification of the installation (rooftop, ground mounted fixed-tilt or tracking, carport, etc). *Perform azimuth estimation on each solar array cluster in the masked image. *Detect solar panels and get its latitude, longitude, and address within a geographic bounding box through the SOL-Searcher Pipeline. *Detect and calculate hurricane damage on solar installations given pre-hurricane and post-hurricane satellite imagery through the Hurricane Detection Pipeline. *Detect and calculate hail damage on solar installations given satellite imagery through the Hail Detection pipeline. *Convert NOAA MESH (Maximum Estimated Size of Hail) grib2 files into kml or geojson files. *Estimate tilt and azimuth of a solar array by processing USGS LiDAR data for the array’s location.

Edun, Ayobami↗
DOE OSTI2020

Laika BOSS (Binary Object Scanning System)

Laika BOSS (Binary Object Scanning System), often written as "Laikaboss", is an object scanner and intrusion detection system that strives to be scalable, flexible, and verbose. Its goal is to take arbitrary file input and extract all relevant subfiles and metadata for use in helping analysts determine the function and maliciousness of a file at a glance. This is an extension to the original code developed by Lockheed Martin.

Walkup, Gregory↗
DOE OSTI2018

AESD (Advanced Energy System Design) Records API [SWRs-17-50, 17-51, 17-52]

The Records API (application program interface) for Advanced Energy System Design (AESD) enables software that serves multidimensional record-oriented data to interoperate with software than uses such data. In the context of the Records API, multidimensional data records are simply tuples of real numbers, integers, and character strings, where each data value is tagged by a variable name, according to a pre-defined schema, and each record is assigned a unique integer identifier. Conceptually, these records are isomorphic to rows in a relational database, JSON objects, or key-value maps. Records servers might supply static datasets, sensor measurements that periodically update as new telemetry become available, or the results of simulations as the simulations generate new output. Records client software might display or analyze the data, but in the case of simulations the client request the creation of new ensembles for specified input parameters. It is also possible to chain records clients and servers together so that a client consuming data from a server might transform that data and serve it to additional clients. This minimalist API avoids imposing burdensome metadata, structural, or implementation requirements on developers by relying on open-source technologies that are readily available for common programming languages. In particular, the API has been designed to place the least possible burden on services that provide data. This document defines the message format for the Records API, a transport mechanism for communicating the data, and the semantics for interpreting it. The message format is specified as Google Protocol Buffers and the transport mechanism uses WebSockets. We discuss three major use cases for serving and consuming records data: (i) static data, (ii) dynamically augmented data, (iii) on-demand simulations, (iv) with filters, and (v) with bookmarks. Separate implementations of the API exist in C++, Haskell, JavaScript, Python, and R.

Bush, Brian↗
DOE OSTI2021

battery-data-toolkit

This software package contains utilities for ingesting battery cycling data from various equipment and converting it to a common file format including metadata. Further development of the package will include utilities for further processing the data for a variety of machine learning tasks.

PAULSON, NOAHHARRIS↗
DOE OSTI2021

Highly Extensible X-ray Diffraction Toolkit

This code has been previous released as open source under LLNL-CODE-529294. The HEXRD program comprises a library of X-ray diffraction analysis tools and a stand-alone GUI application. While there are many software packages that provide similar capabilities, HEXRD was designed to provide an extremely flexible and extensible basis for describing a broad array of X-ray diffraction instruments; this includes both mono- and poly-chromatic modalities as well as poly- and single-crystal samples. The high-level objects include Material: an abstraction for defining crystalline materials, including unit cell parameters and anisotropic elastic moduli Imageseries: an interface for series of diffraction images containing one or more frames, including provisions for metadata. Instrument: an abstraction of an X-ray diffraction instrument including support for the definition of multiple detector elements as well as powder, Laue, and mono-chromatic single/multi-grain diffraction analysis modalities (including attendant calibration routines). The hexrdgui package is a standalone PySide2/Qt5 GUI built on top of hexrd. The 0.8.1 release includes various bug fixes as well as some new functionality in the GUI, including: o Enhancements to the import tools for LLNL diffraction instruemtns (PXRDIP and TARDIS) o The ability to save 1-d LeBail fits of integrated diffraction spectra.

Barton, NathanR.↗