SEARCH · Engineering Papers

Results for “Metadata”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

All sources NASA NTRS DOE OSTI

DOE OSTI2017

UnifyFS: A Distributed Burst Buffer File System - 0.1.0

UnifyFS is a user-level burst buffer file system under active development. UnifyFS supports scalable and efficient aggregation of I/O bandwidth from burst buffers while having the same life cycle as a batch-submitted job. While UnifyFS is designed for N-N write/read, UnifyFS compliments its functionality with the support for N-1 write/read. It efficiently accelerates scientific I/O based on scalable metadata indexing, co-located I/O delegation, and server-side read clustering and pipelining.

ECP↗

DOE OSTI2020

DEPRECATED Hasty [SWR-20-80]

DEPRECATED This repository was archived by the owner on Nov 18, 2022. It is now read-only. The software is a web app to create semantic metadata models, namely, Haystack and Brick. The purpose of Hasty is to assist in the auditing of building mechanical systems and controls. The software is designed to capture mechanical system topology and important information regarding real world controls implementations. The tool is intended to output Brick / Haystack / ASHRAE 223 compliant models.

Mosiman, Cory↗

DOE OSTI2020

Splash-ML v0.1

The Splash database and portal, also under development (https://lbl.wellspringsoftware.net/kms/invention/detail/3980/), ingests experimental data and references to datasets from a variety of sources, primarily lightsource beamlines. After deployment, it will contain a great deal of metadata and references to data from which many insights can be extracted.

McReynolds, Dylan↗

DOE OSTI2020

XRFtomo

Based on [1], XRFtomo brings together a variety of image processing tools used for preparing, processing and reconstructing 3D renditions of samples imaged using a synchrotron-based x-ray fluorescence (XRF) microprobe or nanoprobe at the Advanced Photon Source (APS). This software bridges the gap between data acquisition and visualization by providing tools to adjust for misalignment in the imaging process and tools for running reconstructions[2], all with the use of a GUI or command line. XRFtomo accepts .h5 files processed through MAPS[3] and it outputs reconstructed cross-sections, projections, sinograms, metadata, and a configuration file with last-used parameters for rapid processing the next time the program is launched. These images serve as inputs for other 3D visualization software for generating volumetric renderings and animations.

Marin, Fabrico↗

DOE OSTI2020

sandialabs/xyz

Tools for extracting and viewing information from zip archives. Simply extracts and displays zip file metadata in a format convenient for analysts.SAND2020-0168 M

Smutz, Charles↗

DOE OSTI2020

Panel-Segmentation [SWR-21-18]

Panel-Segmentation contains the scripts for automated metadata extraction of solar PV installations, using satellite imagery coupled with computer vision techniques. In this package, the user can perform the following actions: *Automatically generate a satellite image using a set of lat-long coordinates, and a Google Maps API key. Users would need to set up a Google Cloud account and get a Maps Static API key. Please refer to Setting Up Google Maps Static API Key section for this process. *Perform image segmentation on the satellite image, to locate the solar array(s) in the image on a pixel-by-pixel basis, using an image segmentation model (panel_detection_model.pth). Get classification of the installation (rooftop, ground mounted fixed-tilt or tracking, carport, etc). *Perform azimuth estimation on each solar array cluster in the masked image. *Detect solar panels and get its latitude, longitude, and address within a geographic bounding box through the SOL-Searcher Pipeline. *Detect and calculate hurricane damage on solar installations given pre-hurricane and post-hurricane satellite imagery through the Hurricane Detection Pipeline. *Detect and calculate hail damage on solar installations given satellite imagery through the Hail Detection pipeline. *Convert NOAA MESH (Maximum Estimated Size of Hail) grib2 files into kml or geojson files. *Estimate tilt and azimuth of a solar array by processing USGS LiDAR data for the array’s location.

Edun, Ayobami↗

DOE OSTI2020

Laika BOSS (Binary Object Scanning System)

Laika BOSS (Binary Object Scanning System), often written as "Laikaboss", is an object scanner and intrusion detection system that strives to be scalable, flexible, and verbose. Its goal is to take arbitrary file input and extract all relevant subfiles and metadata for use in helping analysts determine the function and maliciousness of a file at a glance. This is an extension to the original code developed by Lockheed Martin.

Walkup, Gregory↗

DOE OSTI2018

AESD (Advanced Energy System Design) Records API [SWRs-17-50, 17-51, 17-52]

The Records API (application program interface) for Advanced Energy System Design (AESD) enables software that serves multidimensional record-oriented data to interoperate with software than uses such data. In the context of the Records API, multidimensional data records are simply tuples of real numbers, integers, and character strings, where each data value is tagged by a variable name, according to a pre-defined schema, and each record is assigned a unique integer identifier. Conceptually, these records are isomorphic to rows in a relational database, JSON objects, or key-value maps. Records servers might supply static datasets, sensor measurements that periodically update as new telemetry become available, or the results of simulations as the simulations generate new output. Records client software might display or analyze the data, but in the case of simulations the client request the creation of new ensembles for specified input parameters. It is also possible to chain records clients and servers together so that a client consuming data from a server might transform that data and serve it to additional clients. This minimalist API avoids imposing burdensome metadata, structural, or implementation requirements on developers by relying on open-source technologies that are readily available for common programming languages. In particular, the API has been designed to place the least possible burden on services that provide data. This document defines the message format for the Records API, a transport mechanism for communicating the data, and the semantics for interpreting it. The message format is specified as Google Protocol Buffers and the transport mechanism uses WebSockets. We discuss three major use cases for serving and consuming records data: (i) static data, (ii) dynamically augmented data, (iii) on-demand simulations, (iv) with filters, and (v) with bookmarks. Separate implementations of the API exist in C++, Haskell, JavaScript, Python, and R.

Bush, Brian↗

DOE OSTI2012

MyEMSL

MyEMSL provides the following features: user-assisted upload of data from scientific instruments to an archive, tracking data though the upload process, providing metadata for recovery of uploaded data, providing users with access to the data. These features are supplied by a mixture of open source software and internally developed software. MyESML also provides a notification system that allows the system to communicate with users and other parts of the MyEMSL system. This allows the system to support automated workflows and user interaction. Reprocessing of already ingested data is also supported.

Glass, Kevin↗

DOE OSTI2021

battery-data-toolkit

This software package contains utilities for ingesting battery cycling data from various equipment and converting it to a common file format including metadata. Further development of the package will include utilities for further processing the data for a variety of machine learning tasks.

PAULSON, NOAHHARRIS↗

DOE OSTI2021

Highly Extensible X-ray Diffraction Toolkit

This code has been previous released as open source under LLNL-CODE-529294. The HEXRD program comprises a library of X-ray diffraction analysis tools and a stand-alone GUI application. While there are many software packages that provide similar capabilities, HEXRD was designed to provide an extremely flexible and extensible basis for describing a broad array of X-ray diffraction instruments; this includes both mono- and poly-chromatic modalities as well as poly- and single-crystal samples. The high-level objects include Material: an abstraction for defining crystalline materials, including unit cell parameters and anisotropic elastic moduli Imageseries: an interface for series of diffraction images containing one or more frames, including provisions for metadata. Instrument: an abstraction of an X-ray diffraction instrument including support for the definition of multiple detector elements as well as powder, Laue, and mono-chromatic single/multi-grain diffraction analysis modalities (including attendant calibration routines). The hexrdgui package is a standalone PySide2/Qt5 GUI built on top of hexrd. The 0.8.1 release includes various bug fixes as well as some new functionality in the GUI, including: o Enhancements to the import tools for LLNL diffraction instruemtns (PXRDIP and TARDIS) o The ability to save 1-d LeBail fits of integrated diffraction spectra.

Barton, NathanR.↗

DOE OSTI2022

VizBrick

Brick (https://brickschema.org/) is a unified metadata schema to address the problem of building data standardization. Creating Brick models for building datasets means that the contents of the datasets are semantically described using the standard terms defined in the Brick ontology, and it will enable the benefits of data standardization, without having to recollect or reorganize the data. The challenge is that building brick models for building datasets leads to repeated manual trial and error processes, which can be time-consuming. VizBrick is a tool with a graphic/Web-based user interface that can assist users to create Brick models visually and interactively without having to understand the Resource Description Framework (RDF) syntax. VizBrick contains a web server that renders VizBrick web interface pages for browsers. The web server utilizes software components that (1) provide Brick ontology entity mapping to data column suggestions to users so that they can efficiently create their model; (2) provide keyword/Metadata-based search capability for easy find of relevant brick concepts and relations to their data columns

Lee, Sangkeun [Oak Ridge National Lab. (ORNL), Oak↗

DOE OSTI2016

Cyber-Physical Security Assessment (CyPSA) Toolset

CyPSA seeks to organize and gain insight into the diverse sets of data that a critical infrastructure provider must manage. Specifically CyPSA inventories, manages, and analyzes assets and relations among those assets. A variety of interfaces are provided. CyPSA inventories assets (both cyber and physical). This may include the cataloging of assets through a common interface. Data sources used to generate a catalogue of assets include PowerWorld, NPView, NMap Scans, and device configurations. Depending upon the role of the person using the tool the types of assets accessed as well as the data sources through which asset information is accessed may vary. CyPSA allows practitioners to catalogue relations among assets and these may either be manually or programmatically generated. For example, some common relations among assets include the following: Topological Network Data: Which devices and assets are connected and how? Data sources for this kind of information include NMap scans, NPView topologies (via Firewall rule analysis). Security Metrics Outputs: The output of various security metrics such as overall exposure. Configure Assets:CyPSA may eventually include the ability to configure assets including relays and switches. For example, a system administrator would be able to configure and alter the state of a relay via the CyPSA interface. Annotate Assets: CyPSA also allows practitioners to manually and programmatically annotate assets. Sources of information with which to annotate assets include provenance metadata regarding the data source from which the asset was loaded, vulnerability information from vulnerability databases, configuration information, and the output of an analysis in general.

Garcia, Luis↗

DOE OSTI2023

Data Science Infrastructure SOFTWARE

LANL science workflows generate complex data sets and ensembles of data requiring significant compute and storage resources. The Data Science Infrastructure (DSI) project focuses on data-driven approaches to make data more readily available to LANL projects. DSI workflows leverage metadata stored in data-agnostic databases, supported by an abstraction layer API to simplify searching and accessing data across simulation runs, experimental runs, filesystems and environments. The abstraction layer API allows the user to query a range of data types: raw output, processed data, configuration data, machine learning models, performance data, etc. In addition to the abstraction backend API, the DSI project is developing client-driven query APIs and UIs to support specific user workflows.

Turton, Terece↗

DOE OSTI2023

Earthdata Pub

Earthdata Pub is a toolset that provides forms and workflows so that a data producer can request archival of their NASA-funded data, NASA can determine which (if any) DAAC is appropriate to that data, and the selected DAAC can work with the data producer to get the data and metadata necessary for publication.

Broughton, Kimberly↗

DOE OSTI2024

MAPSTER

MAPSTER Observer is a light-weight software package that can be installed on field deployed computers which automatically manages data and creates metadata packages designed to organize large datasets, making them easy to retrieve and share.

Larson, MatthewD↗

DOE OSTI2024

Ingest

Ingest is an application that allows project owners to solicit data from users and require them to fill out metadata along with those uploads. It is an application developed in Elixir/Phoenix and is a web based platform.

Darrington, JohnW.↗

DOE OSTI2023

CEDS Differential Privacy (CEDSDP) v0.1

A Python package that provides differentially private queries optimized for energy systems' data. It may be used to publish queries such as clustering, averaging, metadata inference, etc. that are useful for a variety of grid-related analytics, including cyberattack detection.

Peisert, Sean↗