WFIP3 Lidar / Processed Data
This dataset contains standardized, processed data from the Leosphere WindCube V2.1 deployed at Nantucket, MA for WFIP-3. The lidar was tall tower validated in May 2023.
17 WIND ENERGY↗
SEARCH · Engineering Papers
Results for “Data processing and standardization”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Lidar / Processed Data
This dataset contains processed, standardized data from the UND scanning Doppler lidar at WFIP3's BARG site, consisting of range- and time-resolved measurements of radial velocity, attenuated backscatter, intensity, and spectral width. We note that the beam azimuth angles are NOT referenced to true north.
17 WIND ENERGY↗
CACO Site - ANL Scanning Doppler Lidar / Processed Data
This dataset contains processed, standardized data from the ANL scanning Doppler lidar, consisting of range- and time-resolved measurements of radial velocity, attenuated backscatter, intensity, and spectral width. We note that the beam azimuth angles are NOT referenced to true north.
17 WIND ENERGY↗
Lidar / Processed Data
This dataset contains processed, standardized data from the UND scanning Doppler lidar at WFIP3's BARG site, consisting of range- and time-resolved measurements of radial velocity, attenuated backscatter, intensity, and spectral width. We note that the beam azimuth angles are NOT referenced to true north.
17 WIND ENERGY↗
The Marine and Hydrokinetic ToolKit for Data Quality Control and Analysis: Preprint
The ability to handle data is critical at all stages of marine energy (ME) development. The marine hydrokinetic toolkit (MHKiT) is an open-source marine energy software, which includes modules for ingesting, applying quality control, processing, visualizing, and managing data. MHKiT-Python and MHKiT-MATLAB provide robust and verified functions that are needed by the ME community to standardize data processing. Calculations and visualizations adhere to International Electrotechnical Commission (IEC) technical specifications and other guidelines. A resource assessment of NDBC buoy 46050 near PACWAVE is performed using MHKiT and discusses comparisons to the resource assessment provided performed by Dunkel et al.
marine energy↗
The Marine and Hydrokinetic Toolkit (Mhkit) for Data Quality Control and Analysis
The ability to handle data is critical at all stages of marine energy (ME) development. The marine hydrokinetic toolkit (MHKiT) is an open-source marine energy software, which includes modules for ingesting, applying quality control, processing, visualizing, and managing data. MHKiT-Python and MHKiT-MATLAB provide robust and verified functions that are needed by the ME community to standardize data processing. Calculations and visualizations adhere to International Electrotechnical Commission (IEC) technical specifications and other guidelines. A resource assessment of NDBC buoy 46050 near PACWAVE is performed using MHKiT and discusses comparisons to the resource assessment provided performed by Dunkel et al.
marine energy↗
Automating Detection and Diagnosis of Faults, Failures, and Underperformance in PV Plants
The project developed hybrid physics-based and machine-learning methods for near-real-time detection of balance-of-system faults (e.g., string, combiner, and tracker outages) in utility-scale Photovoltaic plants, achieving over 50% true positive rates with under 10% false positives and significantly reducing engineering setup time. In the extended phase, the scope expanded to plant-level underperformance analysis and industry benchmarking through the SUPER.epri.com platform. SUPER standardizes data processing and performance metrics across more than 9 GWac and 120+ plants, enabling robust comparisons and insights into loss rates, inverter downtime, and capacity degradation.
14 SOLAR ENERGY↗
Tanana River Test Site Model Verification Using the Marine and Hydrokinetic Toolkit (MHKiT)
The marine energy (ME) industry historically lacked a standardized data processing toolkit for common tasks such as data ingestion, quality control, and visualization. The marine and hydrokinetic toolkit (MHKiT) solved this issue by providing a public software deployment (open-source and free) toolkit for the ME industry to store and maintain commonly used functionality for wave, tidal, and river energy. This paper demonstrates an initial model verification study in MHKiT. Using Delft3D, a numerical model of the Tanana River Test Site (TRTS) at Nenana, Alaska was created. Field data from the site was collected using an Acoustic Doppler Current Profiler (ADCP) at the proposed Current Energy Converter (CEC) locations. MHKiT is used to process model simulations from Delft3D and compare them to the transect data from the ADCP measurements at TRTS. The ability to use a single tool to process simulation and field data demonstrates the ease at which the ME industry can obtain results and collaborate across specialties, reducing errors and increasing efficiency.
13 HYDRO ENERGY↗
PDBx/mmCIF Ecosystem: Foundational Semantic Tools for Structural Biology
PDBx/mmCIF, Protein Data Bank Exchange (PDBx) macromolecular Crystallographic Information Framework (mmCIF), has become the data standard for structural biology. With its early roots in the domain of small-molecule crystallography, PDBx/mmCIF provides an extensible data representation that is used for deposition, archiving, remediation, and public dissemination of experimentally determined three-dimensional (3D) structures of biological macromolecules by the Worldwide Protein Data Bank (wwPDB, wwpdb.org). Extensions of PDBx/mmCIF are similarly used for computed structure models by ModelArchive (modelarchive.org), integrative/hybrid structures by PDB-Dev (pdb-dev.wwpdb.org), small angle scattering data by Small Angle Scattering Biological Data Bank SASBDB (sasbdb.org), and for models computed generated with the AlphaFold 2.0 deep learning software suite (alphafold.ebi.ac.uk). Community-driven development of PDBx/mmCIF spans three decades, involving contributions from researchers, software and methods developers in structural sciences, data repository providers, scientific publishers, and professional societies. Having a semantically rich and extensible data framework for representing a wide range of structural biology experimental and computational results, combined with expertly curated 3D biostructure data sets in public repositories, accelerates the pace of scientific discovery. Herein, we describe the architecture of the PDBx/mmCIF data standard, tools used to maintain representations of the data standard, governance, and processes by which data content standards are extended, plus community tools/software libraries available for processing and checking the integrity of PDBx/mmCIF data. Use cases exemplify how the members of the Worldwide Protein Data Bank have used PDBx/mmCIF as the foundation for its pipeline for delivering Findable, Accessible, Interoperable, and Reusable (FAIR) data to many millions of users worldwide.
59 BASIC BIOLOGICAL SCIENCES↗
Lidar Wind Cube / Processed Data
This dataset contains processed and standardized data from DOE Buoy 140 deployed during WFIP3.
17 WIND ENERGY↗
Empowering Scientific Discovery Through Computing at the Advanced Photon Source
This paper explores the challenges and solutions for managing and processing the vast amount of data generated by the Advanced Photon Source (APS), a synchrotron light source facility producing ultra-bright x-rays for diverse scientific domains. With 68 experimental beamlines covering materials research, biology, and more, the APS serves a wide user base across academia, government, and industry. The ongoing upgrade of the APS storage ring and installation of new instruments will amplify data generation and processing demands. This paper discusses the approach to address these demands through automated data processing using standardized workflows that produce faster scientific insights. The APS Data Management System coordinates various data related tasks to manage storage, data transfer, metadata cataloging, data processing, and interfaces with tools provided by Globus. Through integration with the Argonne Leadership Computing Facility (ALCF), APS users can efficiently access high-performance computing resources. Standardized workflows have led to reduced computational burdens on scientists and greater accessibility of high performance computing resources. We demonstrate how standardization and collaboration enable scientists to rapidly convert raw data into meaningful scientific results, establishing a streamlined path from data collection to analysis and ultimately to publication.
Parraga, Hannah↗
Supply Chain Risk Management: Data Structuring
Supply chain risk management (SCRM) is an area of research that addresses both logistics concepts to maximize efficiency, reliability, and revenue as well as risk features, such as potential weak points, break points, and vulnerabilities within the supply chain. SCRM is used to find risks introduced at each node in a supply chain and how these risks can impact a company’s products, individuals, customers, and reputation. SCRM is a relatively new field, so standardized processes including data structuring are not fully documented. This paper explains the importance of a standard data structuring methodology and how it can enhance current SCRM efforts. Data ingest, structuring, and analysis are predominantly managed by humans. Automating some of the less complex steps can positively impact SCRM by allowing human analysts to focus on more strategic analyses. Types of data to be collected and structured are collected via publicly available information related to hardware, software, and corporate entities. After the data has been collected, the information is formatted in a specific manner, conforming to a schema, to allow for more effective and efficient ingest for further analysis. This paper outlines data structures used by Pacific Northwest National Laboratory for SCRM research and analysis purposes. These structures have been used for hundreds of analyses and have been successful in developing a common baseline. Data structuring is one of the first steps in data standardization, which will further mature and enhance the SCRM research area.
supply chain risk management, data structuring, re↗
Data Life Cycle: Livewire Data Platform
This document outlines the data life cycle process and standards for data stored on the Livewire Data Platform.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Data Curation for Machine Learning Applied to Geothermal Power Plant Operational Data for GOOML: Geothermal Operational Optimization with Machine Learning: Preprint
Geothermal Operational Optimization with Machine Learning (GOOML) is a transferable and extensible component-based geothermal asset modeling framework that considers complex steamfield relationships and identifies optimization prospects using a data-driven approach to physics-guided, data-centric machine learning. This framework has been used to develop digital twins that provide steamfield operators with operational environments to analyze and understand historical and forecasted power production, explore new steamfield configuration possibilities, and seek optimal asset management in real world applications. To create, test, and apply the GOOML framework, diverse time-series datasets spanning multiple years were sourced from various geothermal power plant components within several complex real-world geothermal operations. These operations are based in the United States and New Zealand and include a variety of technologies, end-uses and configurations, collectively covering nearly all relevant operating conditions for modern geothermal fields. Datasets were acquired from multiple sources to ensure that machine learning experiments generalized properly to various operating conditions. It was found that the data varied in quality, format, and completeness. To ensure consistency between the various datasets, a standardized data curation process was developed to reliably streamline data preparation. This paper will discuss best practices as learned from the GOOML data curation process which takes the following steps: 1) acquisition of large quantities of data from power plant operators, 2) digestion of data to gain an initial understanding of what is included, 3) data transformation, which includes converting the data into a standardized machine-readable format so that they can be visualized, quality checked, and cleaned, 4) quality assurance and quality control, involving identification of significant data gaps and apparent anomalies through mapping of data features to real world componentry via the GOOML historical model, followed by discussion with modelers and power plant operators to identify additional data needs and to resolve issues, 5) use in machine learning algorithms, and 6) repetition of steps one through five until all data needs are met and data are deemed suitable for producing trustworthy modeling results which may be disseminated, ideally along with the curated dataset. This iterative process is focused on improving the quality of the data rather than tuning machine learning model parameters and supports a shift towards data-centric AI as a means to improving real-world applicability of geothermal machine learning projects.
access↗
Classification of events from α -induced reactions in the MUSIC detector via statistical and ML methods
The Multi-Sampling Ionization Chamber (MUSIC) detector is typically used to measure nuclear reaction cross sections relevant for nuclear astrophysics, fusion studies, and other applications. From the MUSIC data produced in one experiment scientists carefully extract an order of 10 3 events of interest from about 10 9 total events, where each event can be represented by an 18-dimensional vector. However, the standard data classification process is based on expert driven, manually intensive data analysis techniques that require several months to identify patterns and classify the relevant events from the collected data. Here, to address this issue, we present a method for the classification of events originating from specific α-induced reactions by combining statistical and machine learning methods that require significantly less input from the domain scientist, relative to the standard technique. Here, we applied the new method to two experimental data sets and compared our results with those obtained using traditional methods. With few exceptions, the number of events classified by our method agrees within ±20% with the results obtained using traditional methods. With the present method, which is the first of its kind for the MUSIC data, we have established the foundation for the automated extraction of physical events of interest from experiments using the MUSIC detector.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Ontologizing health systems data at scale: making translational discovery a reality
Common data models solve many challenges of standardizing electronic health record (EHR) data but are unable to semantically integrate all of the resources needed for deep phenotyping. Open Biological and Biomedical Ontology (OBO) Foundry ontologies provide computable representations of biological knowledge and enable the integration of heterogeneous data. However, mapping EHR data to OBO ontologies requires significant manual curation and domain expertise. We introduce OMOP2OBO, an algorithm for mapping Observational Medical Outcomes Partnership (OMOP) vocabularies to OBO ontologies. Using OMOP2OBO, we produced mappings for 92,367 conditions, 8611 drug ingredients, and 10,673 measurement results, which covered 68–99% of concepts used in clinical practice when examined across 24 hospitals. When used to phenotype rare disease patients, the mappings helped systematically identify undiagnosed patients who might benefit from genetic testing. By aligning OMOP vocabularies to OBO ontologies our algorithm presents new opportunities to advance EHR-based deep phenotyping.
96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
Gold Standard for macromolecular crystallography diffraction data
Explore the source record for details and available documents.
99 GENERAL AND MISCELLANEOUS↗
The Marine and Hydrokinetic ToolKit (MHKiT) for Data Quality Control and Analysis [Slides]
The ability to collect, ingest, condition, reduce, quality control, process, visualize, and store data in a standardized way is critical at all stages of Marine Energy (ME) research and technology/project development. MHKiT is an open-source, standardized suite of ME data processing functions that provides the ability to ingest, condition, reduce, quality control, process, visualize and store ME data. MHKiT is developed in both Python and Matlab.
16 TIDAL AND WAVE POWER↗