Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Open data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

DOE Repository Metadata Profile (DRMP): A Metadata Framework for Advancing Interoperability and AI Readiness Across Scientific Repositories

The Department of Energy (DOE) funds a diverse and distributed ecosystem of repositories that steward scientific data, publications, and software across its research programs, user facilities, and national laboratories. While significant progress has been made in standardizing dataset-level metadata, the metadata describing repositories themselves (their identity, governance, access interfaces, policies, and technical capabilities) remains inconsistent and fragmented across DOE-funded systems. This variability limits discoverability, interoperability, automated validation, and AI-driven analysis, all of which are increasingly essential for modern scientific workflows. To address this gap, the DOE Data Curation Working Group (DCWG) developed the DOE Repository Metadata Profile (DRMP). The DRMP is a practical, community-driven framework that defines how repositories can describe themselves in a consistent, machine-actionable, and scalable manner. The DRMP is not a new metadata schema. Instead, it is a mapping profile and structured element set capturing the essential characteristics of DOE repositories. It harmonizes repository-level metadata across six widely adopted community schemas: RE3Data; DCAT-US v3; Schema.org; Dublin Core; DataCite 4.6; and PREMIS 3.0. This harmonization eliminates reinvention and enables interoperability within DOE and across the broader scientific ecosystem. A core objective of the DRMP is to reduce burden on repositories by allowing them to reuse their existing metadata through a Rosetta-style crosswalk rather than redesigning local implementations. The profile introduces a three-level conformance model that supports incremental adoption: • Level 1 – Minimum Viable Record (MVR): foundational identification elements required for workflows, project registration, and basic repository presence. • Level 2 – Interoperable: structured metadata enabling alignment with national and international discovery systems. • Level 3 – AI-Ready: enhanced provenance, policy transparency, fixity, semantic context, and capabilities that support automated reasoning, model training governance, and machine-assisted curation. To support implementation, the DRMP includes JSON Schema definitions, OpenAPI patterns, and MCP templates that allow repositories to publish machine-readable metadata directly within existing platforms. These resources are modular and lightweight, enabling adoption without major architectural change. Adopting the DRMP enables repositories to: • Enhance discoverability and interoperability by aligning identifiers, classifications, and descriptive elements across widely used schema standards. • Support federated discovery and cross-registration across DOE systems, Data.gov, and international catalogs. • Enable AI agents and workflow orchestration systems to interpret repository-level metadata within the American Science Cloud (AmSC) through Model Context Protocol (MCP)-based context publication. • Demonstrate alignment with DOE’s open science, stewardship, and FAIR data priorities. This guidance represents a community-driven step forward. Through voluntary adoption and continued feedback, the DRMP advances a cohesive, machine-actionable description of DOE repositories that supports FAIR data practices, preparing the infrastructure for AI-enabled research, and strengthening the discoverability and reuse of DOE’s scientific outputs.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2019

Lipid Mini-On: mining and ontology tool for enrichment analysis of lipidomic data

Abstract Summary Here we introduce Lipid Mini-On, an open-source tool that performs lipid enrichment analyses and visualizations of lipidomics data. Lipid Mini-On uses a text-mining process to bin individual lipid names into multiple lipid ontology groups based on the classification (e.g. LipidMaps) and other characteristics, such as chain length. Lipid Mini-On provides users with the capability to conduct enrichment analysis of the lipid ontology terms using a Shiny app with options of five statistical approaches. Lipid classes can be added to customize the user’s database and remain updated as new lipid classes are discovered. Visualization of results is available for all classification options (e.g. lipid subclass and individual fatty acid chains). Results are also visualized through an editable network of relationships between the individual lipids and their associated lipid ontology terms. The utility of the tool is demonstrated using biological (e.g. human lung endothelial cells) and environmental (e.g. peat soil) samples. Availability and implementation Rodin (R package: https://github.com/PNNL-Comp-Mass-Spec/Rodin), Lipid Mini-On Shiny app (https://github.com/PNNL-Comp-Mass-Spec/LipidMiniOn) and Lipid Mini-On online tool (https://omicstools.pnnl.gov/shiny/lipid-mini-on/). Supplementary information Supplementary data are available at Bioinformatics online.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

GRACC: GRid ACcounting Collector

The OSG has long maintained a central accounting system called Gratia. It uses small probes on each computing and storage resource in order to collect resource usage. The probes report to a central collector which stores the usage in a database. The database is then queried to generate reports. As the OSG aged, the size of the database grew very large. It became too large for the database technology to efficiently query to generate detailed reports. The design of a replacement requires data storage that could be queried efficiently to generate multi-year reports. Additionally, it requires flexibilityto add new attributes to the collected data.In this paper we will describe updates to the GRACC architecture in the last 18 months. GRACC uses modern web technologies that were designed for large data storage, query, and visualization. That includes the open source database Elasticsearch, message broker software RabbitMQ, and Grafana and Kibana as data visualization platforms. It uses multiple agents that perform operations on the data to transform it for easier querying and summarization.

Weitzel, Derek↗
DOE OSTI2019

Density Calculations of Actinide Solutions using the Pitzer Method

This report summarizes an exhaustive literature search for density data of actinide solutions in support of the Nuclear Criticality Safety Program (NCSP). This work comprises an extension of work originally begun in 2003 that implemented an advanced density calculation scheme in the SCALE material input processor. This method demonstrated improved criticality calculations for aqueous systems of UO 2 (NO 3 ) 2 and Pu(NO 3 ) 4 in excess acid over a considerable range of concentrations and temperatures. It also provided for UO 2 F 2 in acid at room temperature, although with higher uncertainty. The current study was intended to search all available sources for additional data on uranium and plutonium solutions, including the open literature, reports with limited distribution, and unpublished sources such as laboratory notebooks. Data for some of the systems has been regressed to obtain model parameters for the Pitzer formalism of modeling electrolyte solutions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Vulnerabilities in Artificial Intelligence and Machine Learning Applications and Data

Artificial intelligence (AI) applications driven by machine learning (ML) are transformational technologies within the international nuclear security regime. Advancements realized by AI—faster and improved data insights, more efficient and automated processes, reductions in human error—enable nuclear security applications such as behavior analysis for insider threat mitigation, source tracking of stolen nuclear material, and facial recognition software for physical protection. In addition to the advantages, however, there are also inherent vulnerabilities and threats associated with its use and risk mitigations must be built into any AI/ML-enabled systems. This work provides a background on AI and ML and different data types used in the field, including open-source intelligence information (OSINT) that is discoverable by AI tools and application data that are used by AI tools for decision-making and automation. Current and potential AI applications and vulnerabilities related to their use within the nuclear security regime are also discussed.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2024

Database schema design: Energy Flexibility Environmental Tradeoffs Tool

The Energy Flexibility-Environment Tradeoff Toolset is designed using Streamlit framework, with Python as the programming language. Data storage is facilitated through the use of SQLite. Streamlit is an open-source Python framework for machine learning and data science teams, and SQLite is the most used database engine.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2016

An Adaptable Seismic Data Format

We present ASDF, the Adaptable Seismic Data Format, a modern and practical data format for all branches of seismology and beyond. The growing volume of freely available data coupled with ever expanding computational power opens avenues to tackle larger and more complex problems. Current bottlenecks include inefficient resource usage and insufficient data organization. Properly scaling a problem requires the resolution of both these challenges, and existing data formats are no longer up to the task. ASDF stores any number of synthetic, processed or unaltered waveforms in a single file. A key improvement compared to existing formats is the inclusion of comprehensive meta information, such as event or station information, in the same file. Additionally, it is also usable for any non-waveform data, for example, cross-correlations, adjoint sources or receiver functions. Last but not least, full provenance information can be stored alongside each item of data, thereby enhancing reproducibility and accountability. Any data set in our proposed format is self-describing and can be readily exchanged with others, facilitating collaboration. The utilization of the HDF5 container format grants efficient and parallel I/O operations, integrated compression algorithms and check sums to guard against data corruption. To not reinvent the wheel and to build upon past developments, we use existing standards like QuakeML, StationXML, W3C PROV and HDF5 wherever feasible. Usability and tool support are crucial for any new format to gain acceptance. We developed mature C/Fortran and Python based APIs coupling ASDF to the widely used SPECFEM3D_GLOBE and ObsPy toolkits.

58 GEOSCIENCES↗
DOE OSTI2023

Soil architecture and subsurface stratigraphic heterogeneities across land-lake interfaces along Lake Erie.

Uploaded raw datasets from electrical resistivity tomography (ERT), ground penetrating radar (GPR), electromagnetic induction (EMI) and insitu sensors were acquired across land-lake interfaces along Lake Erie. These datasets were useful to delineate the soil architecture and subsurface stratigraphic heterogeneities. We combined multiple geophysical methods with lithostratigraphic logs from borehole cores and data from soil and borehole sensors to investigate spatial heterogeneities across land-lake interfaces. The apparent electrical conductivity (Eca) maps matched closely with the soil maps from public database and also detected additional soil units that were missing in the traditional soil maps. This implies that electromagnetic induction (EMI) could be relied upon for non invasive characterization of soils in sampling restricted sites where only non-invasive measurements are feasible. Results from electrical resistivity tomography (ERT) and Ground penetrating radar (GPR) are consistent with the surficial geology of the study area, and revealed that the vertical variabilities at the sites are mainly driven by stratigraphy.The ERT data (.stg) were acquired from three different sites portage river (PTR), crane creek (CRC) and old woman creek (OWC). The ".stg" files can be opened with ERT inversion software such as EarthImager, ResIpy or Res2DInv. The GPR data (.GPZ) were also acquired from the three sites, and the ".GPZ" data files can be opened with EKKO_project 5 software from Sensors & Software Inc., or with any other standard GPR software. The EM data (.csv) were acquired from the three sites while the soil sensor data (.csv) here were acquired only from crane creek site. The ".csv) files can be opened with MS Excel or any other spread sheet software.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

Using KBase to Assemble and Annotate Prokaryotic Genomes

The DOE Systems Biology Knowledgebase is an open–access bioinformatics software and data platform for analyzing plants, microbes, and their communities. KBase enables scientists to create, execute, collaborate on, and share reproducible analyses of their biological data in the context of public data and private collaborator data. For microbiologists researching prokaryotes, KBase offers analysis tools for performing quality control and assessment of Next–Generation Sequencing reads, de novo assembly, genome annotation, and tools for analyzing structural and functional features of genomes. As a result, this unit demonstrates an example workflow for taking a comparative and iterative approach to assembly and annotation of prokaryotic genomes using KBase that can be used by microbiologists seeking to perform isolate analysis in a rapid and reproducible fashion.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Machine-Learning Accelerated Studies of Materials with High Performance and Edge Computing

In the studies of materials, experimental measurements often serve as the reference to verify physics theory and modeling; while theory and modeling provide a fundamental understanding of the physics and principles behind. However, the interactions and cross validation between them have long been a challenge even to-date. Not only that inferring a physics model from experimental data is itself a difficult inverse problem, another major challenge is the orders-of-magnitude longer wall-clock time required to carry out high-fidelity computer modeling to match the timescale of experiments. We envisage that by combining high performance computing, data science, and edge computing technology, the current predicament can be alleviated, and a new paradigm of data-driven physics research will open up. For example, we can accelerate computer simulations by first performing the large-scale modeling on high performance computers and train a machine-learned surrogate model. This computationally inexpensive surrogate model can then be transferred to the computing units residing closely to the experimental facilities to perform high-fidelity simulations at a much higher throughout. The model will also be more amenable to analyzing and validating experimental observations in comparable time scales at a much lower computational cost. Further integration of these accelerated computer simulations with an outer machine learning loop can also inform and direct future experiments, while making the inverse problem of physics model inference more tractable. We will demonstrate a proof-of-concept by using a quantum Monte Carlo application, Dynamical Cluster Approximation (DCA++), to machine-learn a surrogate model and accelerate the study of quantum correlated materials.

Li, Ying Wai↗
DOE OSTI2018

Enhancement of CO 2 Uptake and Selectivity in a Metal–Organic Framework by the Incorporation of Thiophene Functionality

The complex [Zn 2 (tdc) 2 dabco] (H 2 tdc = thiophene-2,5-dicarboxylic acid; dabco = 1,4-diazabicyclooctane) shows a remarkable increase in carbon dioxide (CO 2 ) uptake and CO 2 /dinitrogen (N 2 ) selectivity compared to the nonthiophene analogue [Zn 2 (bdc) 2 dabco] (H 2 bdc = benzene-1,4-dicarboxylic acid; terephthalic acid). CO 2 adsorption at 1 bar for [Zn 2 (tdc) 2 dabco] is 67.4 cm 3 ·g -1 (13.2 wt %) at 298 K and 153 cm 3 ·g -1 (30.0 wt %) at 273 K. For [Zn 2 (bdc) 2 dabco], the equivalent values are 46 cm 3 ·g -1 (9.0 wt %) and 122 cm 3 ·g -1 (23.9 wt %), respectively. The isosteric heat of adsorption for CO 2 in [Zn 2 (tdc) 2 dabco] at zero coverage is low (23.65 kJ·mol -1 ), ensuring facile regeneration of the porous material. Enhancement by the thiophene group on the separation of CO 2 /N 2 gas mixtures has been confirmed by both ideal adsorbate solution theory calculations and dynamic breakthrough experiments. The preferred binding sites of adsorbed CO 2 in [Zn 2 (tdc) 2 dabco] have been unambiguously determined by in situ single-crystal diffraction studies on CO 2 -loaded [Zn 2 (tdc) 2 dabco], coupled with quantum-chemical calculations. These studies unveil the role of the thiophene moieties in the specific CO 2 binding via an induced dipole interaction between CO 2 and the sulfur center, confirming that an enhanced CO 2 capacity in [Zn 2 (tdc) 2 dabco] is achieved without the presence of open metal sites. The experimental data and theoretical insight suggest a viable strategy for improvement of the adsorption properties of already known materials through the incorporation of sulfur-based heterocycles within their porous structures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Online Bayesian State Estimation for Real-Time Monitoring of Growth Kinetics in Thin Film Synthesis

Rapid validation of newly predicted materials through autonomous synthesis requires real-time adaptive control methods that exploit physics knowledge, a capability that is lacking in most systems. Here, in this study, we demonstrate an approach to enable real-time control of thin film synthesis by combining in situ optical diagnostics with a Bayesian state estimation method. We developed a physical model for film growth and applied the direct filter (DF) method for real-time estimation of nucleation and growth rates during pulsed laser deposition (PLD). We validated the approach using simulated and experimental reflectivity data for WSe 2 growth and ultimately deployed the algorithm on an autonomous PLD system during the growth of 1T'-MoTe 2 . The DF robustly estimates growth parameters in real time at early stages of growth, down to 15% monolayer area coverage. This fusion of in situ diagnostics, data assimilation, and physical modeling opens new opportunities in adaptive control of synthesis trajectories toward desired material states.

36 MATERIALS SCIENCE↗
DOE OSTI2014

Sodium bromide electron-extraction layers for polymer bulk-heterojunction solar cells

Inexpensive and non-toxic sodium bromide (NaBr) was introduced into polymer solar cells (PSCs) as the cathode buffer layer (CBL) and the electron extraction characteristics of the NaBr CBL were investigated in detail. The PSCs based on NaBr CBL with different thicknesses (i.e., 0 nm, 0.5 nm, 1 nm, and 1.5 nm) were prepared and studied. The optimal thickness of NaBr was 1 nm according to the photovoltaic data of PSCs. The open-circuit voltage (V{sub oc}), short-circuit current density (J{sub sc}), fill factor (FF), and power conversion efficiency (PCE) of the PSC with 1 nm NaBr were evaluated to be 0.58 V, 7.36 mA/cm{sup 2}, 0.63, and 2.70%, respectively, which were comparable to those of the reference device with the commonly used LiF. The optimized photovoltaic performance of PSC with 1 nm NaBr was ascribed to the improved electron transport and extraction capability of 1 nm NaBr in PSCs. In addition, the NaBr CBL could prevent the diffusion of oxygen and water vapor into the active layer and prolong the lifetime of the devices to some extent. Therefore, NaBr layer could be considered as a promising non-toxic CBL for PSCs in future.

36 MATERIALS SCIENCE↗
DOE OSTI2014

Characterization of CZTSSe photovoltaic device with an atomic layer-deposited passivation layer

We describe a CZTSSe (Cu{sub 2}ZnSn(S{sub 1−x},Se{sub x}){sub 4}) photovoltaic (PV) device with an ALD (atomic layer deposition) coated buffer dielectric layer for CZTSSe surface passivation. An ALD buffer layer, such as TiO{sub 2}, can be applied in order to reduce the interface recombination and improve the device's open-circuit voltage. Detailed characterization data including current-voltage, admittance spectroscopy, and capacitance profiling are presented in order to compare the performance of PV devices with and without the ALD layer.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

Reconstruction of effective potential from statistical analysis of dynamic trajectories

The broad incorporation of microscopic methods is yielding a wealth of information on the atomic and mesoscale dynamics of individual atoms, molecules, and particles on surfaces and in open volumes. Analysis of such data necessitates statistical frameworks to convert observed dynamic behaviors to effective properties of materials. Here, we develop a method for the stochastic reconstruction of effective local potentials solely from observed structural data collected from molecular dynamics simulations (i.e., data analogous to those obtained via atomically resolved microscopies). Using the silicon vacancy defect in graphene as a model, we apply the statistical framework presented herein to reconstruct the free energy landscape from the calculated atomic displacements. Evidence of consistency between the reconstructed local potential and the trajectory data from which it was produced is presented, along with a quantitative assessment of the uncertainty in the inferred parameters.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2023

Deep learning symmetries and their Lie groups, algebras, and subalgebras from first principles

Abstract We design a deep-learning algorithm for the discovery and identification of the continuous group of symmetries present in a labeled dataset. We use fully connected neural networks to model the symmetry transformations and the corresponding generators. The constructed loss functions ensure that the applied transformations are symmetries and the corresponding set of generators forms a closed (sub)algebra. Our procedure is validated with several examples illustrating different types of conserved quantities preserved by symmetry. In the process of deriving the full set of symmetries, we analyze the complete subgroup structure of the rotation groups SO (2), SO (3), and SO (4), and of the Lorentz group S O ( 1 , 3 ) . Other examples include squeeze mapping, piecewise discontinuous labels, and SO (10), demonstrating that our method is completely general, with many possible applications in physics and data science. Our study also opens the door for using a machine learning approach in the mathematical study of Lie groups and their properties.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Fast event-based electron counting for small-molecule structure determination by MicroED

Electron counting helped realize the resolution revolution in single-particle cryoEM and is now accelerating the determination of MicroED structures. Its advantages are best demonstrated by new direct electron detectors capable of fast (kilohertz) event-based electron counting (EBEC). This strategy minimizes the inaccuracies introduced by coincidence loss (CL) and promises rapid determination of accurate structures. We used the Direct Electron Apollo camera to leverage EBEC technology for MicroED data collection. Given its ability to count single electrons, the Apollo collects high-quality MicroED data from organic small-molecule crystals illuminated with incident electron beam flux densities as low as 0.01–0.045 e − /Å 2 /s. Under even the lowest flux density (0.01 e − /Å 2 /s) condition, fast EBEC data produced ab initio structures of a salen ligand (268 Da) and biotin (244 Da). Each structure was determined from a 100° wedge of data collected from a single crystal in as few as 50 s, with a delivered fluence of only ∼0.5 e − /Å 2 . Fast EBEC data collected with a fluence of 2.25 or 3.33 e − /Å 2 also facilitated a 1.5 Å structure of thiostrepton (1665 Da). While refinement of these structures appeared unaffected by CL, a CL adjustment applied to EBEC data further improved the distribution of intensities measured from the salen ligand and biotin crystals. However, CL adjustment only marginally improved the refinement of their corresponding structures, signaling the already high counting accuracy of detectors with counting rates in the kilohertz range. Overall, by delivering low-dose structure-worthy data, fast EBEC collection strategies open new possibilities for high-throughput MicroED.

EBEC↗
DOE OSTI2023

Driving Next-Generation Workflows from the Data Plane

We observe the emergence of a new generation of scientific workflows that process data produced at a sustained rate by scientific instruments and large scale numerical simulations. This data is consumed by multiple analysis, visualization, or Machine Learning components not only to enable inference and justify the scientific program, but also to monitor and steer the evolution of these experiments. In such workflows, moving intermediate data efficiently is key to performance, more than efficiently scheduling computational tasks. However, most traditional workflow management systems focus on optimizing task scheduling and then deal with data management, assuming a “move little, compute for long” model, which makes them unfit to the efficient management of this new generation of workflows. Therefore, we advocate for a new way to manage scientific workflows. We propose to consider an efficiently and independently managed data plane that can store and stream data. Workflows compute components, in the application plane can then interact with the data plane, abstracted from complexities of data management. Then, the role of a workflow management system would become that of a control plane that allows users to connect services together to execute the workflow and manages connections between the application and data planes. In this position paper, we characterize several next-generation workflow motifs and describe how their interaction with the data plane is a challenge to traditional workflow management systems. Then, we express a set of requirements that a workflow management system should meet to efficiently manage next-generation workflows at different scales. Based on these requirements, we expose our vision of driving next-generation workflows from the data plane and list remaining open challenges.

Suter, Fred↗