Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

The SDSS-Gaia View of the Color–Magnitude Relation for Blue Horizontal-branch Stars

We present an updated sample of blue horizontal-branch (BHB) stars selected from the photometric and spectroscopic data from Sloan Digital Sky Survey and its associated project Sloan Extension for Galactic Understanding and Exploration (SEGUE). With these data, we selected candidates for A-type stars in the color–color space and then a mixture modeling technique was implemented in order to distinguish between BHB and main-sequence/blue-straggler stars based on their surface gravity values (log g) estimated by the SEGUE Stellar Parameter Pipeline. Our robust approach allows us to attribute individual probabilities of each star truly being in the BHB stage. Hence, our method is advantageous in comparison to previous SEGUE BHB selections that adopted simple log g cuts. We also revisit the color–magnitude relation for these stars and propose two calibrations, based on updated distances for Galactic globular clusters, to estimate absolute magnitudes with (g – r) 0 and (u – r) 0 colors.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Streamflow measurements from four sites on the Tuolumne River in Yosemite National Park from Water Years 2002 to 2021

Regions with remote and complex terrain experience spatially varying streamflow patterns, but are often poorly sampled due to difficult access. This data package includes streamflow measurements collected using low-visibility and low-impact installations at four sites on the Tuolumne River in Yosemite National Park, for water years 2002 to 2021. The resulting data set offers a unique opportunity to explore hydrologic processes in complex terrain.This data package contains half-hourly recordings of unvented pressure, vented pressure, and water temperature are measured and used to estimate discharge and stage height. Discharge flags provide insight into data anomalies. This dataset is formatted in accordance with ESS-Dive's Hydrologic Monitoring and File Level Metadata Formats. It contains the following files:1) Folder containing four csv files of time series streamflow measurements (unvented pressure, vented pressure, estimated discharge, water temperature, stage height, and discharge flag) from four locations on the Tuolumne River2) Data dictionary (dd.csv) containing units, definitions, human readable column names, and data type for all column headers throughout the dataset3) File-level metadata (FLMD.csv) containing metadata for files contained in the dataset4) Installation methods (InstallationMethods.csv) containing metadata on sensor installation

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

The Data Foundry: Secure Collaboration for the Geothermal Industry: Preprint

The Data Foundry provides secure, cloud-based storage and universal access to digital information, enabling the greater geothermal industry to collaborate seamlessly with the Department of Energy (DOE), national labs, universities, and private organizations. Originally developed to support the EGS Collab project, the Data Foundry has been expanded to support FORGE, EDGE, and other DOE-funded projects, some collaborative, some private, by providing each project with a secure space and the ability to fine-tune individual access controls. In response to user feedback, it now also features improved integration with DOE’s Geothermal Data Repository (GDR), to provide a clear and convenient pathway from collaboration to publication, and to register collaborative data projects with well-known data registries like Data.gov and the National Geothermal Data System (NGDS). This paper will explore how recent concerns raised by data-centric, proprietary projects have informed development on the Data Foundry and highlight improvements designed to streamline workflows, improve access control, and promote the timely dissemination of information to the geothermal industry.

Data Foundry↗
DOE OSTI2023

NEWTS Database Dashboard

The NEWTS (National Energy Water Treatment and Speciation) database dashboard displays sites across the nation where energy-related wastewater stream samples and composition data have been collected. Using the dashboard, community leaders and the public will be able to quickly explore and obtain sample data from locations displayed on a map where various government agencies collect and analyze water samples from energy-related wastewater streams.

Aqueous Chemistry↗
DOE OSTI2020

Dimensionality Reduction of SDSS Spectra with Variational Autoencoders

High-resolution galaxy spectra contain much information about galactic physics, but the high dimensionality of these spectra makes it difficult to fully utilize the information they contain. We apply variational autoencoders (VAEs), a nonlinear dimensionality reduction technique, to a sample of spectra from the Sloan Digital Sky Survey (SDSS). In contrast to principal component analysis (PCA), a widely used technique, VAEs can capture nonlinear relationships between latent parameters and the data. We find that a VAE can reconstruct the SDSS spectra well with only six latent parameters, outperforming PCA with the same number of components. Different galaxy classes are naturally separated in this latent space, without class labels having been given to the VAE. The VAE latent space is interpretable because the VAE can be used to make synthetic spectra at any point in latent space. For example, making synthetic spectra along tracks in latent space yields sequences of realistic spectra that interpolate between two different types of galaxies. Using the latent space to find outliers may yield interesting spectra: in our small sample, we immediately find unusual data artifacts and stars misclassified as galaxies. In this exploratory work, we show that VAEs create compact, interpretable latent spaces that capture nonlinear features of the data. While a VAE takes substantial time to train (≈1 day for 48,000 spectra), once trained, VAEs can enable the fast exploration of large astronomical data sets.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Templates for developing and versioning data standards and reporting formats using GitHub

This data package contains three templates that can be used for creating README files and Issue Templates, written in the markdown language, that support community-led data reporting formats. We created these templates based on the results of a systematic review (see related references) that explored how groups developing data standard documentation use the Version Control platform GitHub, to collaborate on supporting documents. Based on our review of 32 GitHub repositories, we make recommendations for the content of README Files (e.g., provide a user license, indicate how users can contribute) and so 'README_template.md' includes headings for each section. The two issue templates we include ('issue_template_for_all_other_changes.md' and 'issue_template_for_documentation_change.md') can be used in a GitHub repository to help structure user-submitted issues, or can be modified to suit the needs of data standard developers. We used these templates when establishing ESS-DIVE's community space on GitHub (https://github.com/ess-dive-community) that includes documentation for community-led data reporting formats. We also include file-level metadata 'flmd.csv' that describes the contents of each file within this data package. Lastly, the temporal range that we indicate in our metadata is the time range during which we searched for data standards documented on GitHub.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

The DECADE cosmic shear project I: A new weak lensing shape catalog of 107 million galaxies

We present the Dark Energy Camera All Data Everywhere (DECADE) weak lensing dataset: a catalog of 107 million galaxies observed by the Dark Energy Camera (DECam) in the northern Galactic cap. This catalog was assembled from public DECam data including survey and standard observing programs. These data were consistently processed with the Dark Energy Survey Data Management pipeline as part of the DECADE campaign and serve as the basis of the DECam Local Volume Exploration survey (DELVE) Early Data Release 3 (EDR3). We apply the Metacalibration measurement algorithm to generate and calibrate galaxy shapes. After cuts, the resulting cosmology-ready galaxy shape catalog covers a region of $5,\!412 \,\,{\rm deg}^2$ with an effective number density of $4.59\,\, {\rm arcmin}^{-2}$. The coadd images used to derive this data have a median limiting magnitude of $r = 23.6$, $i = 23.2$, and $z = 22.6$, estimated at ${\rm S/N} = 10$ in a 2 arcsecond aperture. We present a suite of detailed studies to characterize the catalog, measure any residual systematic biases, and verify that the catalog is suitable for cosmology analyses. In parallel, we build an image simulation pipeline to characterize the remaining multiplicative shear bias in this catalog, which we measure to be $m = (-2.454 \pm 0.124) \times10^{-2}$ for the full sample. Despite the significantly inhomogeneous nature of the data set, due to it being an amalgamation of various observing programs, we find the resulting catalog has sufficient quality to yield competitive cosmological constraints.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Computationally efficient CFD prediction of bubbly flow using physics-guided deep learning

To realize efficient computational fluid dynamics (CFD) prediction of two-phase flow, a multi-scale framework was proposed in this paper by applying a physics-guided data-driven approach. Instrumental to this framework, Feature Similarity Measurement (FSM) technique was developed for error estimation in two-phase flow simulation using coarse-mesh CFD, to achieve a comparable accuracy as fine-mesh simulations with fast-running feature. In this work, by defining physics-guided parameters and variable gradients as physical features, FSM has the capability to capture the underlying local patterns in the coarse-mesh CFD simulation. Massive low-fidelity data and respective high-fidelity data are used to explore the underlying information relevant to the main simulation errors and the effects of phenomenological scaling. By learning from previous simulation data, a surrogate model using deep feedforward neural network (DFNN) can be developed and trained to estimate the simulation error of coarse-mesh CFD. In a demonstration case of two-phase bubbly flow, the DFNN model well captured and corrected the unphysical “peaks” in the velocity and void fraction profiles near the wall in the coarse-mesh configuration, even for extrapolative predictions. The research documented supports the feasibility of the physics-guided deep learning methods for coarse mesh CFD simulations which has a potential for the efficient industrial design.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

DEMONSTRATION OF A DATA-DRIVEN PHYSICS-BASED APPROACH FOR COMPUTATIONALLY EFFICIENT CFD PREDICTION OF TWO-PHASE BUBBLY FLOW

To realize efficient computational fluid dynamics (CFD) prediction of two-phase flow, a multi-scale physics-guided data-driven approach, Feature Similarity Measurement (FSM) technique was developed for error estimation in two-phase flow simulation using coarse-mesh CFD, to achieve a comparable accuracy as fine-mesh simulations with fast-running feature. By defining physics-guided parameters and variable gradients as physical features, FSM has the capability to capture the underlying local patterns in the coarse-mesh CFD simulation. Massive low-fidelity data and respective high-fidelity data are used to explore the underlying information relevant to the main simulation errors and the effects of phenomenological scaling. By learning from previous simulation data, a surrogate model using deep feedforward neural network (DFNN) can be developed and trained to estimate the simulation error of coarse-mesh CFD. In a demonstration case of two-phase bubbly flow, the DFNN model well captured and corrected the unphysical “peaks” in the velocity and void fraction profiles near the wall in the coarse-mesh configuration, even for extrapolative predictions. The research documented supports the feasibility of the physics-guided deep learning methods for coarse mesh CFD simulations which has a potential for the efficient industrial design.

42 ENGINEERING↗
DOE OSTI2022

Exploring two-dimensional van der Waals heavy-fermion material: Data mining theoretical approach

Abstract The discovery of two-dimensional (2D) van der Waals (vdW) materials often provides interesting playgrounds to explore novel phenomena. One of the missing components in 2D vdW materials is the intrinsic heavy-fermion systems, which can provide an additional degree of freedom to study quantum critical point (QCP), unconventional superconductivity, and emergent phenomena in vdW heterostructures. Here, we investigate 2D vdW heavy-fermion candidates through the database of experimentally known compounds based on dynamical mean-field theory calculation combined with density functional theory (DFT+DMFT). We have found that the Kondo resonance state of CeSiI does not change upon exfoliation and can be easily controlled by strain and surface doping. Our result indicates that CeSiI is an ideal 2D vdW heavy-fermion material and the quantum critical point can be identified by external perturbations.

36 MATERIALS SCIENCE↗
DOE OSTI2023

An Analysis of Published DAS Studies for Application to SPE Phase III

Distributed Acoustic Sensing (DAS) is an emerging technology capable of recording the acoustic wavefield at unprecedented spatial resolution. However, this new tool requires significant refinements before it becomes operational for explosion monitoring objectives. Recent studies have shown significant development of array processing with DAS data. In this report we explore three such array processing methods including DAS strain-rate data versus geophone measured ground motion, beamforming for event parameters, and machine learning based denoising. Prior to applying these algorithms to the Source Physics Experiment Phase II and Phase III data, we validate these methods through replication analysis.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

SEAFORML (Smart Exploration and Analysis For Optimal and Robust Machine Learning)

The poster discusses data analysis of the WAVgraph database and applied machine learning methods for it. The database is a long-term project that seeks to be a comprehensive repository of information on cyber threats and is updated regularly. It was previously unanalyzed and unexplored. The goal was to learn more about it and its contents in order to have a better understanding and enable better use. The data analysis and discovery enabled further exploration through natural language processing, similarity, and clustering methods. The poster shows some of the insights from the analysis and explains the methods used for the machine learning applications.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Exploring Autoencoder-based Error-bounded Compression for Scientific Data

Error-bounded lossy compression is becoming an indispensable technique for the success of today's scientific projects with vast volumes of data produced during the simulations or instrument data acquisitions. Not only can it significantly reduce data size, but it also can control the compression errors based on user-specified error bounds. Autoencoder (AE) models have been widely used in image compression, but few AE-based compression approaches support error-bounding features, which are highly required by scientific applications. To address this issue, we explore using convolutional autoencoders to improve error-bounded lossy compression for scientific data, with the following three key contributions. (1) We provide an in-depth investigation of the characteristics of various autoencoder models and develop an error-bounded autoencoder-based framework in terms of the SZ model. (2) We optimize the compression quality for main stages in our designed AE-based error-bounded compression framework, fine-tuning the block sizes and latent sizes and also optimizing the compression efficiency of latent vectors. (3) We evaluate our proposed solution using five real-world scientific datasets and comparing them with six other related works. Experiments show that our solution exhibits a very competitive compression quality from among all the compressors in our tests. In absolute terms, it can obtain a much better compression quality (100%similar to 800% improvement in compression ratio with the same data distortion) compared with SZ2.1 and ZFP in cases with a high compression ratio.

Liu, Jinyang↗
DOE OSTI2024

Cloud Fusion of Big Data and Multi-Physics Models using Machine Learning for Discovery, Exploration, and Development of Hidden Geothermal Resources

The primary goals of this project are identifying hidden geothermal resources in the USA and designing profitable enhanced geothermal systems (EGS). Many non-obvious processes and parameters could characterize geothermal resources and could control the ultimate energy potential of geothermal fields. Diverse datasets (e.g., geology, geochemistry, geophysics, satellite, airborne geophysics) are available to help characterize geothermal resources, but this data is sparse and multi-scale. This has hindered attempts to leverage the datasets for geothermal exploration and profitable EGS design. Recent advancements in machine learning (ML) give promise to overcome these issues. Modern ML methods and tools can (1) analyze large datasets, (2) assimilate model ensembles that include a multitude of inputs and outputs, (3) process sparse datasets, (4) perform transfer learning between sites with different data quality, (5) extract hidden geothermal signatures from field and simulation data, (6) label geothermal resources and processes, (7) identify high-value data acquisition targets, and (8) guide geothermal exploration and production by selecting optimal exploration, production, and drilling strategies. In this work, we implement ML-based geothermal exploration and an enhanced geothermal systems (EGS) design tool to achieve the above goals. Our exploration tool is GeoThermalCloud (GTC) EGS design tool is GeoDT-ML. GTC (github.com/SmartTensors/GeoThermalCloud.jl) utilizes a LANL unsupervised ML platform called SmartTensors (https://tensors.lanl.gov/) to automate data analyses and interpretations by extracting hidden signatures to identify geothermal prospects. It enables the identification of critical measurements needed to identify geothermal resource signatures. GeoDT-ML (github.com/SmartTensors/GeoThermalCloud.jl/tree/master/) adds coupling to GeoDT (https://github.com/GeoDesignTool/GeoDT.git) for stochastic EGS design optimization and performance prediction. GeoDT-ML leverages recent advances in deep learning and high-performance computing. Contributors to this effort include LANL, PNNL, Google, Stanford, and Julia Computing.

15 GEOTHERMAL ENERGY↗
DOE OSTI2021

Parameterization of arctic hydrometeor physics using new precipitation measurement technologies: Final Report

Predictions of precipitation are highly sensitive to the accuracy of parameterized growth and sedimentation processes, especially in remote regions such as the Arctic where observations are scarce. The goal of this study was to combine measurements of meteorological conditions and retrievals from passive and active remote sensors to provide refined parameterizations of precipitation properties and processes with a particular focus on the Arctic. To accomplish the project goals, new instrumentation was used from the Oliktok Point Mobile Facility and the Utqiagvik (Barrow) North Slope of Alaska ARM site focusing in particular on Multi-Angle Snowflake Camera (MASC) data. The MASC is the first device able to automatically photograph precipitation particles in free-fall from multiple angles while simultaneously measuring their fall speed. The MASC installed at the ARM Oliktok Point and Utqiagvik facilities was used to examine the nature of Arctic precipitation, taking particular advantage of the unique suite of precipitation, meteorological, and remote sensing instrumentation that is available at the high latitude sites. Combined with radiometer data we were able to explore the relationship between precipitation particle characteristics and the clouds where the snow is created. Ground-based wind measurements provided detailed data on turbulence. Further theoretical work explored the physical mechanisms controlling precipitation size distributions, the physics determining hydrometeor fallspeed, and the existence of general solutions to the Navier-Stokes equations for falling particles. Outreach work introduced hydrometeor classification to classrooms across the United States.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Evaluation of hydrograph separation techniques with uncertain end-member composition

Hydrograph separation is one of many approaches used to analyse shifts in source water contributions to stream flow resulting from climate change in remote watersheds. Understanding these shifts is vital, as shifts in source water contributions to a stream can shape water management decisions. Because remote watersheds are often inaccessible and have poorly characterized contributing water sources, or end-members, it is critical to understand the implications of using different hydrograph separation techniques in these data-limited environments. To explore the uncertainty associated with different techniques, results from two hydrograph separation techniques, mass balance and principle component analysis, were compared using 3 years of aqueous geochemical data from the East River watershed located in the Elk Mountains of Central Colorado. Solute concentrations of the end-members were characterized by both a limited set of direct chemical measurements of different sources and detailed seasonal instream chemistry to examine the influences of uncertain end-member compositions in a data-limited environment. Annual volumetric end-member contributions to stream flow had relatively good agreement across separation techniques. Large variations in time were observed in the hydrograph separations, depending on the end-member type, and estimated flow contributions varied between the selected solutes. End-member concentrations characterized by stream chemistry showed several limitations including a reduced number of distinguishable end-members and differences in timing of flow contributions. Here the results highlight the benefits of using multiple hydrograph separation techniques by providing a ‘weight-of-evidence’ approach to environments with limited end-member concentration data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A Cast of Thousands: How the IDEAS Productivity Project Has Advanced Software Productivity and Sustainability

Computational and data-enabled science and engineering are revolutionizing advances throughout science and society, at all scales of computing. For example, teams in the U.S. Department of Energy’s Exascale Computing Project have been tackling new frontiers in modeling, simulation, and analysis by exploiting unprecedented exascale computing capabilities—building an advanced software ecosystem that supports next-generation applications and addresses disruptive changes in computer architectures. However, concerns are growing about the productivity of the developers of scientific software. Members of the Interoperable Design of Extreme-scale Application Software project serve as catalysts to address these challenges through fostering software communities, incubating and curating methodologies and resources, and disseminating knowledge to advance developer productivity and software sustainability. This article discusses how these synergistic activities are advancing scientific discovery—mitigating technical risks by building a firmer foundation for reproducible, sustainable science at all scales of computing, from laptops to clusters to exascale and beyond.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Physics-Informed Recurrent Neural Networks to Predict Reactor Operations of the AGN-201 Nuclear Reactor

4 page paper submitted to ANS Student conference. Summary of paper similar to the following abstract: The ability to predict how a reactor will operate, understand when anomalous conditions arise, and ensure a reactor is being operated as expected is crucial for deploying new nuclear facilities. Digital twins serve as a unique solution to recognizing reactor behavior; however, they require data to be useful. For next-generation reactors, this data may not currently be available. To explore how synthetic physics-informed reactor data can be used to predict reactor operations, a recurrent neural network was implemented for the Idaho State University AGN-201 digital twin. The goal of this work is to determine how synthetic data can be used to train a recurrent neural network model for predicting the reactor power of the AGN-201. The recurrent neural network was validated using both synthetic and real operational data. We envision this approach will help bridge the gap between the virtual and physical sides of a digital twin, where reactor physics models based on as-built data can be corrected for actual operating parameters to ensure the virtual model mirrors reality.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗