Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Databases”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Database-Agnostic Log Analysis and Monitoring Framework

Prior to my internship, I was informed that a previous intern had built a tool to analyse MongoDB logs and look for invalid access attempts, which served as a great reference point for my project. I was initially tasked with expanding on her prototype and filling in the gaps such as integrating it with the main monitoring tool the lab uses. Eventually, the scope grew, expanding to support other databases and a growing collection of tools. I organized the framework around an observer pattern, meaning one point in the program sending updates to the rest of the framework. Every time a log was read and parsed, it was sent to be processed by the tools, using the type of event as a means to determine which tools should get a chance to act on the log. This decouples the tools from the log reader, making future updates and additions much easier. The framework processes MongoDB logs at ~135,000 entries per second and PostgreSQL logs at ~170,500 entries per second, accurately detecting anomalies such as slow queries and connections from unknown addresses. This framework serves to fill gaps in database monitoring tools currently implemented at the lab, such as tracking failed authentication for PostgreSQL and MongoDB which had very minimal or none before this framework. National labs such as Fermilab hold sensitive data and valuable computing resources, making them attractive targets. Monitoring intrusion attempts on databases is made much easier by this comprehensive monitoring suite.

Clark, Dylan [Unlisted, US, IL; Fermilab]↗
DOE OSTI2023

Optimized thermodynamic properties of REE aqueous species (REE 3+ and REEOH 2+ ) and experimental database for modeling the solubility of REE phosphate minerals (monazite, xenotime, and rhabdophane) from 25 to 300 °C

Rare earth elements (REE) are critical elements found in monazite, xenotime, and hydrated REE phosphates which typically form in hydrothermal mineral deposits. Accurate predictions of the solubility of these REE phosphates and the speciation of REE in aqueous fluids are both key to understanding the controls on the transport, fractionation, and deposition of REE in natural systems. Previous monazite and xenotime solubility experiments indicate the presence of large discrepancies between experimentally derived solubility constants versus calculated solubilities by combining different data sources for the thermodynamic properties of minerals and aqueous species at hydrothermal conditions. In this study, these discrepancies were resolved by using the program GEMSFITS to optimize the standard partial molal Gibbs energy of formation (Δ f G° 298 ) of REE aqueous species (REE 3+ and REE hydroxyl complexes) at 298.15 K and 1 bar while keeping the thermodynamic properties fixed for the REE phosphates. A comprehensive experimental database was compiled using solubility data available between 25 and 300 °C. The latter permits conducting thermodynamic parameter optimization of Δ f G° 298 for REE aqueous species. Optimal matching of the rhabdophane solubility data between 25 and 100 °C requires modifying the Δ f G° 298 values of REE 3+ by 1–6 kJ/mol, whereas matching of the monazite solubility data between 100 and 300 °C requires modifying the Δ f G° 298 values of both REE 3+ and REEOH 2+ by ~15–31 kJ/mol and ~2–10 kJ/mol, respectively. For xenotime, adjustments of Δ f G° 298 values by 1–26 kJ/mol are only necessary for the REE 3+ species. The optimizations indicate that the solubility of monazite in acidic solutions is controlled by the light (L)REE 3+ species at <150 °C and the LREEOH 2+ species at >150 °C, whereas the solubility of xenotime is controlled by the heavy (H)REE 3+ species between 25 and 300 °C. Based on the optimization results, we conclude that the revised Helgeson-Kirkham-Flowers equation of state does not reliably predict the thermodynamic properties of REE 3+ , REEOH 2+ , and likely other REE hydroxyl species at hydrothermal conditions. We therefore provide an experimental database (ThermoExp_REE) as a basic framework for future updates, extensions with other ligands, and optimizations as new experimental REE data become available. As a result, the optimized thermodynamic properties of aqueous species and minerals are available open access to accurately predict the solubility of REE phosphates in fluid-rock systems.

58 GEOSCIENCES↗
DOE OSTI2022

Information-Theoretic Exploration of Multivariate Time-Varying Image Databases

Modern scientific simulations produce very large datasets, making interactive exploration of such data computationally prohibitive. An increasingly common data reduction technique is to store visualizations and other data extracts in a database. The Cinema project is one such approach, storing visualizations in an image database for post hoc exploration and interactive image-based analysis. This work focuses on developing efficient algorithms that can quantify various types of multivariate dependencies existing within multi-variable datasets. It applies specific mutual information measures for the quantification of salient regions from multivariate image data. Here, using such information measures, the opacity of the images is modulated so that the salient regions are automatically highlighted and the domain scientists can interactively explore the most relevant regions for scientific discovery.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Scaling Semantic Graph Databases in Size and Performance

In this paper we present SGEM, a full software system for accelerating large-scale semantic graph databases on commodity clusters. Unlike current approaches, SGEM addresses semantic graph databases by only employing graph methods at all the levels of the stack. On one hand, this allows exploiting the space efficiency of graph data structures and the inherent parallelism of graph algorithms. These features adapt well to the increasing system memory and core counts of modern commodity clusters. On the other hand, however, these systems are optimized for regular computation and batched data transfers, while graph methods usually are irregular and generate fine-grained data accesses with poor spatial and temporal locality. Our framework comprises a SPARQL to data parallel C compiler, a library of parallel graph methods and a custom, multithreaded runtime system. We introduce our stack, motivate its advantages with respect to other solutions and show how we solved the challenges posed by irregular behaviors. We present the result of our software stack on the Berlin SPARQL benchmarks with datasets up to 10 billion triples (a triple corresponds to a graph edge), demonstrating scaling in dataset size and in performance as more nodes are added to the cluster.

Aggregation↗
DOE OSTI2024

Generation of macro- and microplastic databases by high-throughput FTIR analysis with microplate readers

Abstract FTIR spectral identification is today’s gold standard analytical procedure for plastic pollution material characterization. High-throughput FTIR techniques have been advanced for small microplastics (10–500 µm) but less so for large microplastics (500–5 mm) and macroplastics (> 5 mm). These larger plastics are typically analyzed using ATR, which is highly manual and can sometimes destroy particles of interest. Furthermore, spectral libraries are often inadequate due to the limited variety of reference materials and spectral collection modes, resulting from expensive spectral data collection. We advance a new high-throughput technique to remedy these problems using FTIR microplate readers for measuring large particles (> 500 µm). We created a new reference database of over 6000 spectra for transmission, ATR, and reflection spectral collection modes with over 600 plastic, organic, and mineral reference materials relevant to plastic pollution research. We also streamline future analysis in microplate readers by creating a new particle holder for transmission measurements using off-the-shelf parts and fabricating a nonplastic 96-well microplate for storing particles. We determined that particles should be presented to microplate readers as thin as possible due to thick particles causing poor-quality spectra and identifications. We validated the new database using Open Specy and demonstrated that additional transmission and reflection spectra reference data were needed in spectral libraries. Graphical abstract

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Applications of CALPHAD modeling and databases in advanced lightweight metallic materials

Here this paper presents an overview on the application of CALPHAD (CALculation of Phase Diagrams) methodology in the design and development of advanced lightweight metallic materials including magnesium, aluminum, titanium, aluminum-based metal matrix composites, and high entropy alloys. In this work, CALPHAD methodology has been established and summarized from the construction of databases describing thermodynamics, atomic mobility, kinetics, thermo-physical properties (such as viscosity) to the application of computational design of lightweight materials. The examples in this paper have demonstrated the effectiveness and capability of CALPHAD methodology in accelerating the design of advanced lightweight materials by optimizing the compositions and various heat-treatment conditions, modifying the evolution of microstructures during processing, and finally predicting the mechanical properties (e.g., yield strength and hardness) of the lightweight components. Although the examples are given in lightweight alloys for structural applications, the fundamental methodology and modeling principles are applicable to all materials and engineering applications. Thus, the future of the advanced material design will be strongly based on development of CALPHAD methodology such as the construction of reliable databases coupled with CALPHAD-based models for various applications.

36 MATERIALS SCIENCE↗
DOE OSTI2015

Distributed database kriging for adaptive sampling (D²KAS)

We present an adaptive sampling method supplemented by a distributed database and a prediction method for multiscale simulations using the Heterogeneous Multiscale Method. A finite-volume scheme integrates the macro-scale conservation laws for elastodynamics, which are closed by momentum and energy fluxes evaluated at the micro-scale. In the original approach, molecular dynamics (MD) simulations are launched for every macro-scale volume element. Our adaptive sampling scheme replaces a large fraction of costly micro-scale MD simulations with fast table lookup and prediction. The cloud database Redis provides the plain table lookup, and with locality aware hashing we gather input data for our prediction scheme. For the latter we use kriging, which estimates an unknown value and its uncertainty (error) at a specific location in parameter space by using weighted averages of the neighboring points. We find that our adaptive scheme significantly improves simulation performance by a factor of 2.5 to 25, while retaining high accuracy for various choices of the algorithm parameters.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Remote visual analysis of large turbulence databases at multiple scales

The remote analysis and visualization of raw large turbulence datasets is challenging. Current accurate direct numerical simulations (DNS) of turbulent flows generate datasets with billions of points per time-step and several thousand time-steps per simulation. Until recently, the analysis and visualization of such datasets was restricted to scientists with access to large supercomputers. The public Johns Hopkins Turbulence database simplifies access to multi-terabyte turbulence datasets and facilitates the computation of statistics and extraction of features through the use of commodity hardware. In this paper, we present a framework designed around wavelet-based compression for high-speed visualization of large datasets and methods supporting multi-resolution analysis of turbulence. By integrating common technologies, this framework enables remote access to tools available on supercomputers and over 230 terabytes of DNS data over the Web. Finally, the database toolset is expanded by providing access to exploratory data analysis tools, such as wavelet decomposition capabilities and coherent feature extraction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

A database for storing the results of material radiopurity measurements

Searches for rare nuclear processes, such as neutrinoless double beta-decay and the interactions of WIMP dark matter, are motivating experiments with ever-decreasing levels of radioactive backgrounds. These background reductions are achieved using various techniques, but amongst the most important is minimizing radioactive contamination in the materials from which the experiment is constructed. To this end there have been decades of advances in material sourcing, manufacture and certification, during which researchers have accumulated many thousands of measurements of material radiopurity. Some of these assays are described in publications, others are in databases, but many are still communicated informally. Until this work, there has been no standard format for encoding assay results and no effective, central location for storing them. The aim of this paper is to address these long-standing problems by creating a concise and flexible material assay data format and powerful software application to manipulate it. Finally, a public installation of this software, available at http://www.radiopurity.org, is the largest database of assay results ever compiled and is intended as a long-term repository for the community's data.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2023

The Intermetallic Reactivity Database: Compiling Chemical Pressure and Electronic Metrics toward Materials Design and Discovery

Here, the advent of high-throughput Density Functional Theory (DFT) calculations has supported the creation of large databases containing the quantitative output necessary for constructing theoretical phase diagrams and predicting physical properties. In this Article, we present a complementary resource, the Intermetallic Reactivity Database (IRD), focused on the chemical bonding features of solid-state structures and indicators of potential structural transformations. Each IRD entry augments common features, such as band structures and density of states (DOS) distributions, with chemically motivated information including DFT-Chemical Pressure (CP) schemes and visualizable representations of the atomic charges. Together, these data types enable the rationalization and prediction of potential structural phenomena encountered in intermetallic chemistry, as we illustrate with four examples: the origins of the Y 2 Ni 2 Mg structure in terms of CP features of its parent structures, the anticipation of intergrowth phases from the net atomic CPs collected in Al-containing binary phases, the correlation between trends in the CP schemes of CaCu 5 -type phases and experimentally observed structural variations, and finally, the development of theoretical methodology with the testing of a streamlined method generating DFT-CP schemes. Altogether, these examples highlight how the IRD supports the creation of models of structural chemistry that extend beyond the bounds of its entries.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Virtual Excited State Reference for the Discovery of Electronic Materials Database: An Open-Access Resource for Ground and Excited State Properties of Organic Molecules

This letter announces the Virtual Excited State Reference for the Discovery of Electronic Materials Database (VERDE materials DB), the first database to include downloadable excited-state structures (S 0 , S 1 , T 1 ) and photophysical properties. Furthermore, VERDE materials DB is searchable, open-access via www.verdedb.org , and focused on light-responsive π-conjugated organic molecules with applications in green chemistry, organic solar cells, and organic redox flow batteries. It includes results of our active and past virtual screening studies; to date, more than 13 000 density functional theory (DFT) calculations have been performed on 1 500 molecules to obtain frontier molecular orbitals and photophysical properties, including excitation energies, dipole moments, and redox potentials. To improve community access, we have made VERDE materials DB available via an integration with the Materials Data Facility. We are leveraging VERDE materials DB to train machine learning algorithms to identify new materials and structure–property relationships between molecular ground- and excited-states. We present a case-study involving photoaffinity labels, including predictions of new diazirine-based photoaffinity labels anticipated to have high photostabilities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2019

FDA-ARGOS is a database with public quality-controlled reference genomes for diagnostic use and regulatory science

FDA proactively invests in tools to support innovation of emerging technologies, such as infectious disease next generation sequencing (ID-NGS). Here, we introduce FDA-ARGOS quality-controlled reference genomes as a public database for diagnostic purposes and demonstrate its utility on the example of two use cases. We provide quality control metrics for the FDA-ARGOS genomic database resource and outline the need for genome quality gap filling in the public domain. In the first use case, we show more accurate microbial identification of Enterococcus avium from metagenomic samples with FDA-ARGOS reference genomes compared to non-curated GenBank genomes. In the second use case, we demonstrate the utility of FDA-ARGOS reference genomes for Ebola virus target sequence comparison as part of a composite validation strategy for ID-NGS diagnostic tests. The use of FDA-ARGOS as an in silico target sequence comparator tool combined with representative clinical testing could reduce the burden for completing ID-NGS clinical trials

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Plant Metabolic Network 15: A resource of genome-wide metabolism databases for 126 plants and algae

To understand and engineer plant metabolism, we need a comprehensive and accurate annotation of all metabolic information across plant species. As a step towards this goal, we, in this study, generated genome-scale metabolic pathway databases of 126 algal and plant genomes, ranging from model organisms to crops to medicinal plants (https://plantcyc.org). Of these, 104 have not been reported before. We systematically evaluated the quality of the databases, which revealed that our semi-automated validation pipeline dramatically improves the quality. We then compared the metabolic content across the 126 organisms using multiple correspondence analysis and found that Brassicaceae, Poaceae, and Chlorophyta appeared as metabolically distinct groups. To demonstrate the utility of this resource, we used recently published sorghum transcriptomics data to discover previously unreported trends of metabolism underlying drought tolerance. We also used single-cell transcriptomics data from the Arabidopsis root to infer cell type-specific metabolic pathways. This work shows the quality and quantity of our resource and demonstrates its wide-ranging utility in integrating metabolism with other areas of plant biology.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Compilation of a Solar Mirror Materials Database and an Analysis of Natural and Accelerated Mirror Exposure and Degradation

The National Renewable Energy Laboratory (NREL) has been conducting exposure experiments on solar reflectors for over four decades. Thousands of mirror samples from over one hundred suppliers have been exposed to and monitored in a range of relevant environments. These test conditions include outdoor test settings and several controlled laboratory environments. These samples have been rigorously individually characterized using a series of reflectance measurements, visual inspections, and in some cases, in-depth composition analysis to identify degradation modes, reflectance losses, and other mirror properties integral to understanding the solar reflector's life cycle. Here, this paper compiles the decades of measurement data into a concise statistical analysis. It includes exposure and degradation data for numerous reflector types, including secondary-surface reflector permutations of polymer and glass superstrates with silver and aluminum reflectors as well as front-surface reflectors. The results herein are intended to analyze environmental stressors and degradation trends among various historical and state-of-the-art solar reflectors. It may be used to support solar reflector design, effective testing methodology, and inform manufacturing decisions moving forward. Presented are the results of the compiled database and an initial analysis for degradation rate modeling using full-spectrum and wavelength-dependent approaches. The database is a growing resource hosted on a live, publicly accessible website. In conjunction with the analysis presented here, it provides a valuable resource to the solar reflector manufacturing and testing industry.

14 SOLAR ENERGY↗
DOE OSTI2025

An open-access simulated earthquake ground-motion database for an M7 Hayward Fault earthquake in the San Francisco Bay Region

Comprehensive understanding of earthquake ground motions, particularly in the near-fault region of large-magnitude events, is limited by gaps in strong-motion data. This challenge is prominent in areas with high seismic hazard but infrequent large earthquakes where data is sparse and difficult to interpret. These data limitations lead to uncertainties in the development of site-specific ground motions, which are crucial for engineering risk assessments. To address these challenges, physics-based regional-scale ground-motion simulations have been developed. With the emergence of exaflop-scale computing ecosystems, it is now possible to simulate regional earthquake processes at unprecedented fidelity and generate the large number of fault rupture realizations necessary to characterize both intra- and inter-event ground-motion variability. This article introduces a new database of simulated earthquake ground motions, created for applications in earthquake engineering, earthquake planning, and emergency response. The inaugural version of the database features simulated ground motions for a magnitude 7 Hayward Fault earthquake in the San Francisco Bay Region (SFBR), using the EarthQuake SIMulation (EQSIM) simulation framework and the Graves–Pitarka kinematic rupture model. The aim is to provide high-fidelity, spatially dense, three-component motions generated on the Department of Energy’s (DOE) newest generation of graphics processing unit (GPU)-accelerated supercomputers. These motions are being made openly available to the engineering, scientific, and disaster planning communities. In addition, this work develops protocols for the efficient dissemination of these large data sets and emphasizes community engagement to build confidence in their application. This article discusses the methodology behind the data, underlying software verification and validation, scalable data management, and a user interface for data access. The goal is to facilitate widespread use and elicit expert feedback to maximize the utility and exploitation of simulated motions. While the initial focus is on the San Francisco Region, simulations for additional regions will be added as the DOE program progresses.

Simulated ground-motion database↗
DOE OSTI2015

A Toolkit for ARB to Integrate Custom Databases and Externally Built Phylogenies

Researchers are perpetually amassing biological sequence data. The computational approaches employed by ecologists for organizing this data (e.g. alignment, phylogeny, etc.) typically scale nonlinearly in execution time with the size of the dataset. This often serves as a bottleneck for processing experimental data since many molecular studies are characterized by massive datasets. To keep up with experimental data demands, ecologists are forced to choose between continually upgrading expensive in-house computer hardware or outsourcing the most demanding computations to the cloud. Outsourcing is attractive since it is the least expensive option, but does not necessarily allow direct user interaction with the data for exploratory analysis. Desktop analytical tools such as ARB are indispensable for this purpose, but they do not necessarily offer a convenient solution for the coordination and integration of datasets between local and outsourced destinations. Therefore, researchers are currently left with an undesirable tradeoff between computational throughput and analytical capability. To mitigate this tradeoff we introduce a software package to leverage the utility of the interactive exploratory tools offered by ARB with the computational throughput of cloud-based resources. Our pipeline serves as middleware between the desktop and the cloud allowing researchers to form local custom databases containing sequences and metadata from multiple resources and a method for linking data outsourced for computation back to the local database. Furthermore, a tutorial implementation of the toolkit is provided in the supporting information, S1 Tutorial.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2015

SOLTHERM Thermodynamic Database for Geochemical Modeling

This data submission is a link to a thermodynamic database maintained by the University of Oregon. The data at this link are not 'data results' from sampling. The data at this link comprise a thermodynamic database for aqueous species, minerals, and gases, including data for stoichiometry, equilibrium constants log K(T,P), aqueous activity coefficients, fugacity coefficients, and water enthalpy. These data are derived from SOLTHERM as a reference for the user, showing balanced reactions and equilibrium constants log K(T,P) along the liquid-vapor saturation curve only, up to 350 degrees C, for aqueous species and minerals including REE, and gases. These data include REE aqueous species and minerals. These data are used by programs SOLVEQ-XPT, CHIM-XPT, and GEOCAL-XPT.

15 GEOTHERMAL ENERGY↗
DOE OSTI2017

Tropospheric Ozone Assessment Report: Database and Metrics Data of Global Surface Ozone Observations

In support of the first Tropospheric Ozone Assessment Report (TOAR) a relational database of global surface ozone observations has been developed and populated with hourly measurement data and enhanced metadata. A comprehensive suite of ozone data products including standard statistics, health and vegetation impact metrics, and trend information, are made available through a common data portal and a web interface. These data form the basis of the TOAR analyses focusing on human health, vegetation, and climate relevant ozone issues, which are part of this special feature. Cooperation among many data centers and individual researchers worldwide made it possible to build the world's largest collection of in-situ hourly surface ozone data covering the period from 1970 to 2015. By combining the data from almost 10,000 measurement sites around the world with global metadata information, new analyses of surface ozone have become possible, such as the first globally consistent characterisations of measurement sites as either urban or rural/remote. Exploitation of these global metadata allows for new insights into the global distribution, and seasonal and long-term changes of tropospheric ozone and they enable TOAR to perform the first, globally consistent analysis of present-day ozone concentrations and recent ozone changes with relevance to health, agriculture, and climate. Considerable effort was made to harmonize and synthesize data formats and metadata information from various networks and individual data submissions. Extensive quality control was applied to identify questionable and erroneous data, including changes in apparent instrument offsets or calibrations. Such data were excluded from TOAR data products. Limitations of a posteriori data quality assurance are discussed. As a result of the work presented here, global coverage of surface ozone data for scientific analysis has been significantly extended. Yet, large gaps remain in the surface observation network both in terms of regions without monitoring, and in terms of regions that have monitoring programs but no public access to the data archive. Therefore future improvements to the database will require not only improved data harmonization, but also expanded data sharing and increased monitoring in data-sparse regions.

54 ENVIRONMENTAL SCIENCES↗