Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed databases”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Towards Lightweight Data Integration Using Multi-Workflow Provenance and Data Observability

Modern large-scale scientific discovery requires multidisciplinary collaboration across diverse computing facilities, including High Performance Computing (HPC) machines and the Edge-to-Cloud continuum. Integrated data analysis plays a crucial role in scientific discovery, especially in the current AI era, by enabling Responsible AI development, FAIR, Reproducibility, and User Steering. However, the heterogeneous nature of science poses challenges such as dealing with multiple supporting tools, cross-facility environments, and efficient HPC execution. Building on data observability, adapter system design, and provenance, we propose MIDA: an approach for lightweight runtime Multi-workflow Integrated Data Analysis. MIDA defines data observability strategies and adaptability methods for various parallel systems and machine learning tools. With observability, it intercepts the dataflows in the background without requiring instrumentation while integrating domain, provenance, and telemetry data at runtime into a unified database ready for user steering queries. We conduct experiments showing end-to-end multi-workflow analysis integrating data from Dask and MLFlow in a real distributed deep learning use case for materials science that runs on multiple environments with up to 276 GPUs in parallel. We show near-zero overhead running up to 100,000 tasks on 1,680 CPU cores on the Summit supercomputer.

Santos Souza, Renan↗
DOE OSTI2020

Fabrication of yttrium hydride for high-temperature moderator application

We report given the superior thermal stability and highly attainable hydrogen density, yttrium hydride is an excellent high-temperature moderator material in advanced thermal neutron spectrum reactors that require small core volumes. Large-scale, crack-free, bulk yttrium hydride is in high demand; however, fabrication of yttrium hydride is challenging and has not been demonstrated for nearly half century. The associated challenges are discussed herein. In response to these challenges, a hydriding system was designed and constructed at Oak Ridge National Laboratory and was used to successfully fabricate crack-free yttrium hydride in complex geometries at large scales. This was accomplished by precisely controlling the hydrogen’s partial pressure and the retort temperature, which was informed by the well-established thermodynamic properties of the binary H–Y system. Hydrogen content in as-fabricated hydride was determined by weight change, an approach which was considered reliable based on the use of ultra–high-purity yttrium, the absence of oxide phases up to levels detectable using x-ray diffraction (XRD), and the significant weight gain. Hydrogen distribution along one yttrium hydride rod was evaluated with XRD analysis on materials extracted from different locations on the rod. The results indicated a relatively homogeneous hydrogen distribution along the hydride rod, with <3% uncertainty in the fraction of the δ-phase hydride. In addition, significant efforts are being dedicated to establish a complete database summarizing the thermomechanical and physical properties of as-fabricated yttrium hydride and the irradiation response to facilitate its deployment as a high-temperature moderator in advanced nuclear reactors.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Next-generation geospatial-temporal information technologies for disaster management

Traditional geographic information systems (GIS) have been disrupted by the emergence of Big Data in the form of geo-coded raster, vector, and time-series Internet-of-Things data. This article discusses the application of new scalable technologies that go far beyond relational databases and file-based storage on spinning disk or tape to incorporate both storage and processing data in the same platform. The roles of the Apache Hadoop Distributed File Systems and NoSQL key-value stores such as the Apache Hbase are discussed, along with indexing schemes that optimally support geospatial-temporal use. Here, we highlight how this new approach can rapidly search multiple GIS data layers to obtain insights in the context of early warning, impact evaluation, response, and recovery to earthquake and wildfire disasters.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Tidal Disruption Event Galaxy Binner

This software simulates astronomical survey detections of tidal disruptions of stars by super-massive black holes. It begins with the synthetic galaxy catalogue described in van Velzen 2008 (https://arxiv.org/abs/1707.03458). The stellar disruption rate in each galaxy is estimated based on Stone & Metzger 2016 (https://arxiv.org/abs/1410.7772). Based on these rates, and the present-day stellar mass function in the galaxy, disruptions are randomly sampled, and the properties of the resulting flares are sampled based on empirical distributions. The code also accounts for obscuration by dust in the host galaxy. Finally, the survey selection effects are applied. The detectable simulated flares are stored in a database, allowing histograms of their properties to be created.

Roth, NathanielJ.↗
DOE OSTI2021

Gaps in global wildlife trade monitoring leave amphibians vulnerable

As the biodiversity crisis continues, we must redouble efforts to understand and curb pressures pushing species closer to extinction. One major driver is the unsustainable trade of wildlife. Trade in internationally regulated species gains the most research attention, but this only accounts for a minority of traded species and we risk failing to appreciate the scale and impacts of unregulated legal trade. Despite being legal, trade puts pressure on wild species via direct collection, introduced pathogens, and invasive species. Smaller species-rich vertebrates, such as reptiles, fish, and amphibians, may be particularly vulnerable to trading because of gaps in regulations, small distributions, and demand of novel species. Here, we combine data from five sources: online web searches in six languages, Convention on International Trade in Endangered Species (CITES) trade database, Law Enforcement Management Information System (LEMIS) trade inventory, IUCN assessments, and a recent literature review, to characterise the global trade in amphibians, and also map use by purpose including meat, pets, medicinal, and for research. We show that 1215 species are being traded (17% of amphibian species), almost three times previous recorded numbers, 345 are threatened, and 100 Data Deficient or unassessed. Traded species origin hotspots include South America, China, and Central Africa; sources indicate 42% of amphibians are taken from the wild. Newly described species can be rapidly traded (mean time lag of 6.5 years), including threatened and unassessed species. The scale and limited regulation of the amphibian trade, paired with the triptych of connected pressures (collection, pathogens, invasive species), warrants a re-examination of the wildlife trade status quo, application of the precautionary principle in regard to wildlife trade, and a renewed push to achieve global biodiversity goals.

Hughes, Alice C.↗
DOE OSTI2025

User Manual for the Thermal Hydraulic Code SE2RCT

SE2-ANL is a modified version of SUPERENERGY-2 which interfaces the power distribution in the ANL maintained physics codes for the user. SE2RCT is a special version of SE2-ANL developed for specific use on models of the Experimental Breeder Reactor-II (EBR-II). SE2RCT fulfills a specific role in the calculated results as part of the Fuels Irradiation and Physics Database (FIPD) and is built to connect with the Physics and Analysis DataBase (PADB) for metallic fuel research and development in advanced sodium-cooled fast reactors (SFRs) created for EBR-II. SE2RCT is primarily a thermal analysis code that interfaces with the RCT based pin power details instead of the built-in pin power dehomogenization strategy in SE2-ANL. Beyond the thermal hydraulic calculation, the SE2RCT code provides detailed axial distributions of the RCT calculated results. SE2RCT also calculates the the axial distribution of pin wise DPA for the cladding materials which is part of the FIPD calculated results. This report serves as the user manual for SE2RCT and thus eliminates the QA gap of missing documentation on the SE2RCT software. All of the features and limitations of SE2RCT are documented in this report. The input and output specifications of SE2RCT are discussed in detail, and some unique features of SE2RCT, e.g. accurate pin power and temperature results for problems with non-uniform composition within an assembly, are also demonstrated and tested.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Bias Characterization, Vertical Interpolation, and Horizontal Interpolation for Distributed Wind Siting Using Mesoscale Wind Resource Estimates

Much like their counterparts in utility-scale wind energy, developers of industrial, small-scale and distributed wind turbine deployments need to understand and accurately characterize the wind resource to properly assess the power generation and financial ramifications during siting and planning. National Renewable Energy Laboratory’s WIND (Wind Integration National Dataset) Toolkit (WTK) provides a best-in-class wind resource dataset generated using the Weather Research and Forecasting (WRF) model. This dataset includes parameters such as the wind speed, wind direction, and temperature at various heights, plus atmospheric stability near the surface. This data is available at 2-km spatial resolution and five-minute temporal resolution across 7 years, from 2007 to 2013 through a publicly accessible API interface. The Tools Assessing Performance (TAP) project seeks to extend this dataset to allow long term resource estimates and leverage it to better equip distributed wind equipment manufacturers, owner-operators, and installation professionals with better tools for practical siting applications. In this report, we present the results from our investigation within the TAP project focused on characterization of bias in WTK-based wind speed estimates and evaluation of vertical and horizontal interpolation techniques. We discuss the tradeoffs between different techniques and their combinations, as well as describe the lower bounds we determine for the studied validation errors. While the specific estimates we present are specific to WTK and the validation dataset we have chosen for this investigation (NREL's Wind Resource Meteorological Database), the overall analysis and the studied techniques are general enough to be applied to a broader set of wind datasets, both simulation-based and observational.

17 WIND ENERGY↗
DOE OSTI2025

Estimating energy consumption and GHG emissions in the U.S. food supply chain for net-zero

This work provides a database of the U.S. food system’s energy consumption and GHG emissions at the national and state levels by food supply chain (FSC) stage, fuel type, and food commodity. We estimate that the U.S. FSC consumed a total 4660 TBTU (4900 PJ) of site energy, 7130 TBTU (7500 PJ) of primary energy, and generated 970 MMT of GHG emissions in 2016. Among all the stages, on-farm production is the largest energy consumer (31% primary energy) and GHG emissions contributor (70%), largely due to raising animals. Optimizing distribution can reduce the stage’s energy consumption and GHG emissions and increase products’ shelf-life. Reducing food loss and waste is another good option, as it decreases the amount of food necessary to grow, thus impacting the overall FSC. The database can help stakeholders identify stage- and region-specific strategies and measures to curtail the environmental footprint of the U.S. food system.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Proposed Application for an Entity Component System in an Energy Services Interface

An Entity Component System is a data-oriented architecture originally developed to streamline video game performance. Despite being quite new, Entity Component Systems are relatively well established within the video game industry due to the cutting edge nature of research into performance, especially around graphics. However, Entity Component Systems have not been widely examined or adopted outside of that industry. We propose adopting an Entity Component Systems framework to serve the needs of an Energy Service Interfaces. We examine the needs of an Energy Service Interface, give an overview of open-source Entity Component Systems (ECSs) libraries, examine some preliminary performance results for ECSs, and explore the traditional approach to fulfilling the needs of an Energy Service Interface (ESI) with database architectures.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Compaction of crushed salt for safe containment – overview of the KOMPASS project

Abstract. In Germany, rock salt formations are possible host rock candidates for a repository for heat-emitting radioactive waste. The safety concept of a repository in salt bases on a multibarrier system consisting mainly of the geological barrier salt and geotechnical seals ensuring safe containment. Crushed salt will be used for backfilling of cavities and sealing measures in drifts and shafts due to its favourable properties and its easy availability (mined-off material). The creep of the rock salt leads to crushed salt compaction with time. Thereby, the crushed salts' porosity is reduced from the initial porosity of 30 %–40 % to a value comparable to the porosity of undisturbed rock salt (≤1 %). In such low porosity ranges, technical impermeability is assumed. The compaction behaviour of crushed salt is rather complex and involves several coupled THM processes (Kröhn et al., 2017; Hansen et al., 2014). It is influenced by internal properties like humidity and grain size distribution, as well as boundary conditions such as temperature, compaction rate or stress state. However, the current process understanding has some important gaps referring to the material behaviour, experimental database and numerical modelling. It needs to be extended and validated, especially in the low porosity range. The objective of the KOMPASS project was development of methods and strategies for the reduction of deficits in the prediction of crushed salt compaction leading to an improvement of the prognosis quality. Key results are as follows (KOMPASS Phase 1, 2020): selection of an easily available and permanently producible synthetic crushed salt mixture, acting as a reference material for generic investigations; development and proof of different techniques for producing pre-compacted samples for further investigations; establishment of a tool of microstructure investigation methods to demonstrate the comparability of grain structures of pre-compacted samples with in-situ compacted material for future investigations; execution of various laboratory experiments using pre-compacted samples, e.g. long-term creep tests which deliver reliable information about time- and stress-dependent compaction behaviour; development of a complex experimental investigation strategy to derive necessary model parameters considering individual functional dependencies. Its technical feasibility was successfully verified; benchmarking with various existing numerical models using datasets from three different triaxial long-term tests. The result was not entirely satisfactory; however, the number of influencing factors is small and further validation work has to be done. Overall, the KOMPASS project has made significant progress in the approaches to solving the outstanding question, building the basis for further investigations.

Friedenberg, Larissa↗
DOE OSTI2023

The Intermetallic Reactivity Database: Compiling Chemical Pressure and Electronic Metrics toward Materials Design and Discovery

Here, the advent of high-throughput Density Functional Theory (DFT) calculations has supported the creation of large databases containing the quantitative output necessary for constructing theoretical phase diagrams and predicting physical properties. In this Article, we present a complementary resource, the Intermetallic Reactivity Database (IRD), focused on the chemical bonding features of solid-state structures and indicators of potential structural transformations. Each IRD entry augments common features, such as band structures and density of states (DOS) distributions, with chemically motivated information including DFT-Chemical Pressure (CP) schemes and visualizable representations of the atomic charges. Together, these data types enable the rationalization and prediction of potential structural phenomena encountered in intermetallic chemistry, as we illustrate with four examples: the origins of the Y 2 Ni 2 Mg structure in terms of CP features of its parent structures, the anticipation of intergrowth phases from the net atomic CPs collected in Al-containing binary phases, the correlation between trends in the CP schemes of CaCu 5 -type phases and experimentally observed structural variations, and finally, the development of theoretical methodology with the testing of a streamlined method generating DFT-CP schemes. Altogether, these examples highlight how the IRD supports the creation of models of structural chemistry that extend beyond the bounds of its entries.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Geophysical methods reveal the soil architecture and subsurface stratigraphic heterogeneities across land-lake interfaces along Lake Erie

Abstract Purpose The land-lake interface is a unique zone where terrestrial and aquatic ecosystems meet, forming part of the Earth’s most geochemically and biologically active zones. The unique characteristics of this interface are yet to be properly understood due to the inherently high spatiotemporal variability of subsurface properties, which are difficult to capture with the traditional soil sampling methods. Geophysical methods offer non-invasive techniques to capture variabilities in soil properties at a high resolution across various spatiotemporal scales. Methods We combined electromagnetic induction (EMI), electrical resistivity tomography (ERT), and ground penetrating radar (GPR) with data from soil cores and in situ sensors to investigate hydrostratigraphic heterogeneities across land-lake interfaces along the western basin of Lake Erie. Results EMI revealed high spatial heterogeneities in ECa distribution across the land-lake interfaces, with higher values in the wetland and transition zones compared to the upland zone. Soil ECa maps matched soil maps from a public database with the hydric soil units delineated as high conductivity zones (ECa > 40 mS/m). ERT and GPR showed vertical variation in soil properties with clear stratigraphic boundaries, and correlation of ERT profiles with lithologs from piezometers revealed the stratigraphic units of silt–clay and till sequence down to 3.5 m depth which are consistent with the surficial geology of the study area. Conclusions These results validate the use of multiple geophysical methods for extrapolating soil properties and mapping stratigraphic structures at land-lake interfaces, thereby providing the missing information required to improve the earth system model (ESM) of coastal interfaces.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Catalyzing deep decarbonization with federated battery diagnosis and prognosis for better data management in energy storage systems

Industrial data analytics methods play a central role in improving energy storage performance and efficiency, impacting the future of electrified transportation and renewable electricity generation. However, significant challenges hinder the large-scale deployment of batteries. Conventional methods rely on centralized collection and processing of fleet-level data, leading to database size issues and privacy concerns due to potential data breaches. To enable scalable deployment of battery management systems, this article proposes a federated battery diagnosis and prognosis model, which distributes the processing of battery standard current-voltage-time-usage data in a privacy-preserving manner. Instead of transferring the raw data, this approach communicates only the locally processed parameters, thus reducing communication load and preserving data confidentiality. The federated model offers a paradigm shift in battery health management through privacy-preserving distributed methods for battery data processing and lifetime prediction, ensuring the reliable and sustainable deployment of lithium-ion batteries in a rapidly evolving world.

asset health management↗
DOE OSTI2024

Results from a synthetic model of the ITER XRCS-Core diagnostic based on high-fidelity x-ray ray tracing

A high-fidelity synthetic diagnostic has been developed for the ITER core x-ray crystal spectrometer diagnostic based on x-ray ray tracing. This synthetic diagnostic has been used to model expected performance of the diagnostic, to aid in diagnostic design, and to develop engineering tolerances. The synthetic model is based on x-ray ray tracing using the recently developed xicsrt ray tracing code and includes a fully three-dimensional representation of the diagnostic based on the computer aided design. The modeled components are: plasma geometry and emission profiles, highly oriented pyrolytic graphite pre-reflectors, spherically bent crystals, and pixelated x-ray detectors. Plasma emission profiles have been calculated for Xe 44+ , Xe 47+ , and Xe 51+ , based on an ITER operational scenario available through the Integrated Modelling & Analysis Suite database, and modeled within the ray tracing code as a volumetric x-ray source; the shape of the plasma source is determined by equilibrium geometry and an appropriate wavelength distribution to match the expected ion temperature profile. All individual components of the x-ray optical system have been modeled with high-fidelity producing a synthetic detector image that is expected to closely match what will be seen in the final as-built system. Particular care is taken to maintain preservation of photon statistics throughout the ray tracing allowing for quantitative estimates of diagnostic performance.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Causal CCF Parameter Estimations 2020

This report documents the quantitative results of the causal common-cause failure (CCF) parameter estimations for the failure cause groups “component,” “design,” “environment,” “human,” and “other,” based on CCF data through 2020 in the U.S. Nuclear Regulatory Commission (NRC) CCF database: https://rads.inl.gov/Pages/CCF.aspx. This report utilizes the same data period (2006–2020) and CCF templates as INL/EXT-21-62940, Revision 1, CCF Parameter Estimations, 2020 Update. The 2015 causal CCF prior distributions for the specific failure cause groups (instead of the 2015 generic CCF prior distributions) were used in this report to estimate the associated causal CCF parameters. All the 2015 causal CCF prior distributions and generic CCF prior distributions were developed in INL/EXT-21-43723, Developing Generic Prior Distributions for Common Cause Failure Alpha Factors and Causal Alpha Factors, using CCF data from 1997 to 2015. These quantitative results were developed to support the causal alpha factor model and should be used as appropriate in probabilistic risk assessment (PRA) studies such as the NRC Significance Determination Process for commercial nuclear power plants in the United States.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

A method and tool to determine the colorimetric and photobiological properties of light transmitted through glass and other optical materials

Here we describe a framework and provides a computational tool to characterize the color quality and biological potential of light that is transmitted through glass and other optical materials. The IES TM-30 framework and Excel computation tool were adapted to evaluate color quality, with measures from CIE S 026, UL 24480, and the WELL Building Standard v2 added to evaluate biological potential. The user selects a pre-transmittance spectral power distribution (SPD), such as for a CIE D-Series Illuminant, Planckian radiation, electric lamp, or measurement of daylight at a building site. The tool allows a user to populate a database with spectral data for glazing or other optical materials, comprising spectral transmission and the spectral reflectance of both sides. The user creates a unit with one, two, or three panes of glazing or other optical materials, and the tool calculates the composite spectral transmittance accounting for reflections between materials. The tool computes the transmitted SPD, then determines colorimetric and photobiological outputs using the transmitted SPD as the test source. Glass, window, and skylight manufacturers can employ the tool to optimize glazing spectral transmission to achieve intentional colorimetric and photobiological performance with transmitted light. Electric lighting manufacturers, designers, and researchers can use the tool to evaluate the impact of glazing units and other optical materials on the color quality and biological potential of transmitted light.

36 MATERIALS SCIENCE↗
DOE OSTI2021

A data-driven global soil heterotrophic respiration dataset and the drivers of its inter-annual variability

Soil heterotrophic respiration (SHR), one of the primary carbon fluxes from terrestrial ecosystems to the atmosphere, is important for carbon-climate feedbacks because of its sensitivity to available litter and soil carbon, climatic conditions, and nutrient availability. However, until recently limited SHR data were available, and most published global SHR estimates have either a short time span, coarse spatial resolution, or reply on overly-simple model formulations. To better understand and quantify the global distribution of SHR and its sensitivity to climate variability, we produced a new global SHR dataset using Random Forest algorithms, up-scaling 455 point data from the Global Soil Respiration Database (SRDB 4.0) with gridded fields of climatic, edaphic and productivity as explanatory variables. We estimated a global total SHR of 46.8 Pg C yr-1 over 1985-2013 (95% confidence interval: 38.6-56.3 Pg C yr-1), with a significant increasing trend of 0.03 Pg C yr-2 during this period. We found that the choice of soil moisture datasets contributes more to the difference among these data-driven SHR members rather than that of productivity, temperature and precipitation data sources. We also analyzed the influence of climatic variables on the inter-annual variability (IAV) of our SHR product. Water availability was the dominant driver of IAV at global scales, although the inferred sensitivity depends on the choice of the soil moisture gridded dataset. At the ecosystem scale, temperature strongly controls the IAV of SHR in tropical forests, while water availability dominates in extra-tropical forest and semi-arid regions. Our machine-learning gridded SHR dataset and outputs from process-based land surface models (TRENDYv6) show agreement for a strong association between water variability and SHR IAV at the global scale, but the two approaches lead to different temporal trend globally and different controlling variables for IAV at the ecosystem scale. Our study provides evidence for the pervasive and important role of water availability in driving SHR, indicating both a direct effect limiting decomposition rates and an indirect effect through the amount of fresh organic matter made available to SHR from productivity. In consideration of potential limitations and uncertainties remaining in our data-driven SHR datasets, we call for a more scientifically designed observation network for SHR, more observation data compilation, and increased use of deep learning methods making maximum use of observation data in hand. This will benefit process-based models, and improve our understanding of SHR response to future anomalous environmental conditions.

Yao, Yitong↗