Results for “open data format” — Page 21

DOE OSTI2026

Smokescreen: A Python package for data vector blinding and encryption in cosmological analyses

Smokescreen is an open-source Python library for data-vector concealment (blinding) in cosmological analyses. Data-vector blinding works by applying cosmology-dependent shifts to the observed data vector, moving it away from the true cosmological signal without affecting its statistical properties, so that analysts cannot infer the true result until the analysis is frozen and the blinding is lifted. The package computes these shifts using Firecrown likelihoods applied to data vectors stored in the SACC format, ensuring that the theoretical model used for blinding is identical to that used for inference whilst remaining agnostic to the specific observable being blinded. To prevent accidental unblinding, the original SACC file, containing the true cosmology, is encrypted. Although developed for the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), Smokescreen is applicable to any experiment using Firecrown likelihoods and the SACC data format.

Loureiro, Arthur [Stockholm U., OKC; Imperial Coll↗

DOE OSTI2023

Closed Loop Geothermal Working Group: GeoCLUSTER App, Subsurface Simulation Results, and Publications

To better understand the heat production, electricity generation performance, and economic viability of closed-loop geothermal systems in hot-dry rock, the Closed-Loop Geothermal Working Group -- a consortium of several national labs and academic institutions has tabulated time-dependent numerical solutions and levelized cost results of two popular closed-loop heat exchanger designs (u-tube and co-axial). The heat exchanger designs were evaluated for two working fluids (water and supercritical CO2) while varying seven continuous independent parameters of interest (mass flow rate, vertical depth, horizontal extent, borehole diameter, formation gradient, formation conductivity, and injection temperature). The corresponding numerical solutions (approximately 1.2 million per heat exchanger design) are stored as multi-dimensional HDF5 datasets and can be queried at off-grid points using multi-dimensional linear interpolation. A Python script was developed to query this database and estimate time-dependent electricity generation using an organic Rankine cycle (for water) or direct turbine expansion cycle (for CO2) and perform a cost assessment. This document aims to give an overview of the HDF5 database file and highlights how to read, visualize, and query quantities of interest (e.g., levelized cost of electricity, levelized cost of heat) using the accompanying Python scripts. Details regarding the capital, operation, and maintenance and levelized cost calculation using the techno-economic analysis script are provided. This data submission will contain results from the Closed Loop Geothermal Working Group study that are within the public domain, including publications, simulation results, databases, and computer codes. GeoCLUSTER is a Python-based web application created using Dash, an open-source framework built on top of Flask that streamlines the building of data dashboards. GeoCLUSTER provides users with a collection of interactive methods for streamlining the exploration and visualization of an HDF5 dataset. The GeoCluster app and database are contained in the compressed file geocluster_vx.zip, where the "x" refers to the version number. For example, geocluster_v1.zip is Version 1 of the app. This zip file also contains installation instructions. **To use the GeoCLUSTER app in the cloud, click the link to "GeoCLUSTER on AWS" in the Resources section below. To use the GeoCLUSTER app locally, download the geocluster_vx.zip to your computer and uncompress this file. When uncompressed this file comprises two directories and the geocluster_installation.pdf file. The geo-data app contains the HDF5 database in condensed format, and the GeoCLUSTER directory contains the GeoCLUSTER app in the subdirectory dash_app, as app.py. The geocluster_installation.pdf file provides instructions on installing Python, the needed Python modules, and then executing the app.

15 GEOTHERMAL ENERGY↗

NASA NTRS1992

Proton aurora and substorm intensifications

Ground based measurements from the CANOPUS array of meridian scanning photometers and precipitating ion and electron data from the DMSP F9 satellite show that the electron arc which brightens to initiate substorms intensifications is formed within a region of intense proton precipitation that is well equatorward (about 4-6 deg) of the nightside open-closed field line boundary. The precipitating protons are from a population that is energized via Earthward convection from the magnetotail into the dipolar region of the magnetosphere and may play an important role in the formation of the electron arcs leading to substorm intensifications on dipolelike field lines.

Samson, J. C.↗

NASA NTRSDate not supplied

RadLab: A Comprehensive Database and Graphical and Programming Interfaces for Biologically Relevant Space Radiation Data

RadLab, a new component of the NASA Open Science Data Repository (OSDR), is a platform built upon a database of radiation data relevant to space biology. RadLab provides visual and programmatic interfaces for interrogation of its database, as well as a submission process for inclusion of data from investigators. The RadLab application programming interface (API) implements a request syntax enabling users to retrieve data filtered by various combinations of parameters (detector type, location, direction, timespan, etc), which are delivered in machine-readable text formats, ready to be ingested by downstream analysis pipelines; while the graphical user interface (GUI) provides easy means to iteratively modify query parameters and incorporates a number of standard analyses and visualizations (time series plots, geospatial visualizations, detector comparison). Investigators from many countries, including US, Russia, Japan, Canada, the Czech Republic, Germany, Hungary, and Italy, have committed to provide data from their instruments located on the ISS; RadLab will also include data from other spacecraft in LEO (e.g., the Space Shuttle, the Mir space station), BLEO (e. g. BioSentinel, Mars Orbiter, among others), and on other celestial bodies (e. g. Chang’e 4, Curiosity). The first release of RadLab has been made available to the public. Once fully operational, RadLab will provide a comprehensive and ever-growing compendium of space radiation data, facilitating straightforward access to multiple types of readings and enabling space biology researchers to perform intercomparisons of detectors and to determine the radiation environment of research missions, both via programmatic retrieval of these data and via the graphical analysis toolkit; as well as a user-friendly submission portal for ingesting data from space agencies and research institutions. Radiation scientists will be able to use RadLab to gain a deeper understanding of the space radiation environment for future human space exploration. The RadLab Working Group has been formed to foster close collaborations among data contributors and users, to identify data sources, to put in place standards for data normalization, to guide the development of features of the analysis toolkit, to establish the use of RadLab in space radiation biology research, and eventually to provide a forum for discussing relevant research issues that can take advantage of RadLab's capabilities.

radiation↗

DOE OSTI2024

Seance de formation de l'USAID en Haiti n3: Expansion des capacites [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-88837 for the English translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

Dataset of Generative AI Workload Power Profiles

This dataset provides a collection of high-resolution (5/10 Hz or every 0.2/0.1 seconds) power consumption profiles for generative artificial intelligence (GenAI) workloads executed on NLR's High Performance Computing (HPC) platform Kestrel. The dataset also includes examples of representative whole-facility power profiles generated using a bottom-up, event-driven, data center energy model . This dataset is designed to support research in energy modeling, infrastructure planning, energy system integration, and sustainability analysis for AI-driven computing systems. The dataset captures time-resolved electrical power measurements across a diverse set of configurations, including variations in job type (inference vs. training), workload (LLM vs. image generation), datasets, and number of compute nodes. Power traces are provided in a standardized format and include both raw/instantaneous and aggregated files. Each profile is accompanied by metadata describing workload parameters, enabling reproducibility and cross-study comparison. The dataset is intended for use in applications such as data center infrastructure planning, energy modeling, demand response and grid impact studies, and development and validation of system-level simulation tools. By making these workload-specific power profiles publicly available, this dataset aims to address the current lack of open, empirical energy data for generative AI systems and to facilitate transparent, reproducible research on the energy and environmental impacts of large-scale AI deployment. If you use this dataset, please cite the associated publication: Vercellino et al., “Measurement of Generative AI Workload Power Profiles for Whole-Facility Data Center Infrastructure Planning,” arXiv:2604.07345 (2026).

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1993

Proton aurora and substorm intensifications

Ground based measurements from the CANOPUS array of meridian scanning photometers and precipitating ion and electron data from the DMSP F9 satellite show that the electron arc which brightens to initiate substorm intensifications is formed within a region of intense proton precipitation that is well equatorward (approximately four to six degrees) of the nightside open-closed field line boundary. The precipitating protons are from a population that is energized via earthward convection from the magnetotail into the dipolar region of the magnetosphere and may play an important role in the formation of the electron arcs leading to substorm intensifications on dipole-like field lines.

Samson, J. C.↗

DOE OSTI2024

Session de formation de l'USAID en Haiti n1: Orientation de l'outil Engage [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications at from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-88835 for the English translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Session de formation de l'USAID en Haiti n2: Introduction a l'outil Engage [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-88836 for the English translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

An Adaptive-Mesh-Refinement Based Computational Tool for Simulating Catalysis at Mesoscale

In this work, we present a computational tool for mesoscale applications using open-source exascale- computing compatible adaptive-mesh-refinement (AMR) library, AMReX [2]. AMReX is software library that enables development of application solvers with block-structured Cartesian AMR. Our tool has capabilities to include realistic geometry representation, chemical species transport, reactions and thermodynamics that are critical for capturing mesoscale physics. A significant achievement is the ability of our solver to automatically import electron microscopy data in the form of a stereolithography (STL) or pixelated file format (mrc, tiff) without undergoing the tedious task of unstructured mesh generation. This feature allows for rapid simulation of catalyst particles with complex morphologies using an immersed-boundary formulation. The use of AMR allows for higher resolutions at catalyst surface interfaces, which in turn provides an accurate description of surface reactions and transport. Our solver uses a hybrid distributed and shared memory parallelism (OpenMP/GPU-based) with which strong scaling up to 10,000 processors for realistic catalyst particle simulations have been demonstrated.

BIOMASS FUELS,MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Elucidating the formation mechanisms of zeolites using data-driven modelling and in-situ characterization

Zeolites are the main solid catalysts used by the chemical industry. The use of zeolites in separations and as shape selective catalysts requires control of the width and connectivity of their pores. 235 distinct zeolite frameworks have been synthesized to date, of over 2 million that have been proposed. Recent work indicates that the limitation is in large part kinetic: new synthetic pathways are required to access new zeolites. Organic cations are used to direct the synthesis towards specific zeolites. However, the molecular mechanisms by which cations direct the nucleation towards specific zeolites is not known. Elucidating these mechanisms is key to realize new zeolites for catalysis and separations, and is the focus of this project. This project developed and implemented a synergistic, data-driven computational and experimental approach to resolve the molecular pathways of nucleation, growth, and polymorph selection of zeolites and the role of organic cations in directing their formation. The project developed computationally efficient and accurate models for the study of the nucleation and growth of pure silica zeolites in molecular simulations, using machine learning with data from experiments. Simulations with these models were integrated with scanning tunneling electron microscopy, computer vision, and deep learning to unveil the molecular pathways of formation of a zeolite. Of particular interest in this project was to elucidate the role of amorphous precursors in the nucleation of the zeolite. Previous experiments indicate that zeolites are born within non-crystalline aggregates in which the silicates and organic cations have local and medium range order similar to that of the zeolite. The organic cations that direct the formation of zeolites and those that direct the formation of ordered mesoporous silicas are similar. We hypothesized that the frustrated attraction that for large organic cations leads to the formation of stable mesophases that direct the synthesis of mesoporous silicas, could promote the formation of metastable mesophases that can assist in the nucleation and polymorph selection of zeolites. The simulations resolved how structure directing agents build crystalline order and showed that mesoscopic pre-ordering occurs is not required to facilitate the nucleation of zeolites, because the synthesis occurs at high driving forces, where the barriers for nucleation are negligible. This project unveiled that polymorph selection in zeolite synthesis occurs after nucleation, opening a distinct area of control through the kinetics of growth and not through nucleation barriers.

36 MATERIALS SCIENCE↗

NASA NTRS2017

Hierarchical Data Formats (HDF) Update

In this presentation, we will talk about the latest releases of HDF4 and HDF5 software and tools, new features available in HDF5, and roadmap for the HDF software. We will also solicit feedback from the users of HDF data and HDF application developers on new features and new tools. The talk will cover: Difference between 1.8 and 1.10 releases and how and when to move to the latest release Features of the recent HDF5 1.8.19, 1.10.1 and HDF 4.2.13 Overview of HDF View 3.0 and other enhancements to tools Supported compilers and systems Open discussion of new requirements and wish list of the HDF features Compression library for interoperability with h5py and Pandas and better floating-point data compression.

HDFView↗

DOE OSTI2022

Perceived Costs and Benefits of ICON Science and Foundational Documents associated with “Integrated, Coordinated, Open, and Networked (ICON) Science to Advance the Geosciences: Introduction and Synthesis of a Special Collection of Commentary Articles"

This data package is associated with the publication "Integrated, Coordinated, Open, and Networked (ICON) Science to Advance the Geosciences: Introduction and Synthesis of a Special Collection of Commentary Articles" in Earth and Space Science (Goldman et al. 2022; https://doi.org/10.1029/2021EA002099). The manuscript is an introductory article for a special collection of commentary articles across 19 geoscience disciplines that explore the challenges and opportunities associated with the use of ICON science principles. These principles focus on research intentionally designed to be Integrated, Coordinated, Open, and Networked (ICON) with the goal of maximizing mutual benefit (among stakeholders) and cross-system transferability of science outcomes. This data package contains data, figures, and R scripts associated with the cost/benefit analysis presented in the manuscript. The writing teams involved in the special collection placed each letter of ICON on a plot with perceived cost on one axis and perceived benefit on the other to summarize their perceptions of pursuing each principle of ICON science. These data were subsequently quantified and analyzed. Files are saved as .csv, .R, and .pdf. This data package also contains (1) the public foundational and instructional documents that enabled the crowdsourced creation of the special collection; (2) file-level metadata (flmd) that lists each file in the data package with a description; (3) data dictionary (dd) that defines column headers that appear in csv files. Files are saved as .pdf and .csv.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Seance de formation n4: Modelisation de la resilience et du secteur de l'electricite - Partie I [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-88838 for the English translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Seance de formation n4: Modelisation de la resilience et du secteur de l'electricite - Partie II [Slides]

Welcome to Engage! Engage is a capacity expansion modeling tool supported by the National Renewable Energy Laboratory and based on the Calliope open-source capacity expansion model developed by the ETH Zurich University, maintained at the TU Delft University. Engage is an accessible (free, open-access, web-hosted) and flexible web-based energy system planning application for rapid multiple-energy-form energy system scenario exploration. Its cloud-based, collaborator-sharable data model, intuitive interface and visualization capabilities facilitate collaboration and communication among teams, with experts, and among diverse stakeholder groups exploring energy system implications from district to national-scale models. This training series was developed under USAID to empower Haitian stakeholders to explore modeling scenarios in Engage to develop a Haiti Energy Master Plan. This training series includes a general overview of how Engage works along with tailored exercises that target Haiti's specific energy needs, such as modeling the capacity expansion of the bulk power system, fuel scarcity challenges, the development of microgrids, and the economic viability of transmission strategies. See NREL/PR-7A40-89389 for the English translation of this document.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Data-driven studies of magnetic two-dimensional materials

We use a data-driven approach to study the magnetic and thermodynamic properties of van der Waals (vdW) layered materials. We investigate monolayers of the form A 2 B 2 X 6 , based on the known material Cr 2 Ge 2 Te 6 , using density functional theory (DFT) calculations and machine learning methods to determine their magnetic properties, such as magnetic order and magnetic moment. We also examine formation energies and use them as a proxy for chemical stability. We show that machine learning tools, combined with DFT calculations, can provide a computationally efficient means to predict properties of such two-dimensional (2D) magnetic materials. Our data analytics approach provides insights into the microscopic origins of magnetic ordering in these systems. For instance, we find that the X site strongly affects the magnetic coupling between neighboring A sites, which drives the magnetic ordering. Our approach opens new ways for rapid discovery of chemically stable vdW materials that exhibit magnetic behavior.

42 ENGINEERING↗

NASA NTRS1990

Primary and diagenetic controls of isotopic compositions of iron-formation carbonates

Results are presented on parallel analyses of carbonate and chert microbands in segments from the early Proterozoic Dales Gorge Member of the Brockman Iron Formation (western Australia), including data on isotopic, chemical, and mineralogic variations in microbanded carbonates, cherts, and coexisting minerals in four core segments from Paraburdoo and one from Wittenoom. It is shown that patterns of variation observed in isotopic abundance and mineral composition can be consistently explained in terms of diagenetic replacement of fine-grained primary precipitates by secondary ones, rather than by mineral-dependent fractionations, metamorphism, or the influence of large volumes of water in an open system.

Kaufman, Alan J.↗

DOE OSTI2024

ATLAS-MAP: An Automated Test Station for Gated Electronic Transport Measurements

The diversification of electronic materials in devices provides a strong incentive for methods to rapidly correlate device performance with fabrication decisions. In this work, we present a low-cost automated test station for gated electronic transport measurements of field-effect transistors. Utilizing open-source PyMeasure libraries for transparent instrument control, the “ATLAS-MAP” system serves as a customizable interface between sourcemeters and samples under test and is programmed to conduct transfer curve and van der Pauw methods with static and sweeping gate voltages. Zinc oxide transistors of variable thickness (5, 10, and 20 nm) and channel size (50 μm to 3 mm, of equal length and width) were fabricated to validate the design. Standardization of testing procedures and raw data formatting enabled automated data analysis. A detailed list of parts and code files for the system are provided.

36 MATERIALS SCIENCE↗