Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “scientific data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Efficient graph representation framework for chemical molecule similarity tasks

Graph data has emerged in numerous scientific domains and machine learning techniques have been widely used for analysis and learning of diverse data for prediction and decision. Machine learning techniques can readily address complex problems by leveraging their structural information. But graphs cannot be directly used for existing machine learning algorithms unless encoded as vectors. The problem of efficient representation of graphs is a substantial challenge in graph machine learning. In this paper, we propose a novel two-stage framework for the representation of chemical molecule graphs based on the strengths of Graph Isomorphism Networks (GINs) and Siamese autoencoders. In the first stage, the GIN model is constructed and trained using the structural information of chemical molecule graphs. Node attributes, edge attributes, and edge indices are used as input data, while graph attributes are used as labels. The GIN model effectively captures the structural characteristics of graphs and can accurately predict graph attributes, i.e., molecular properties. It also generates Graph Embeddings, represented as vectors that encode the structural information of graphs. In the second stage, Graph Embedding vectors are further optimized for downstream similarity tasks while preserving the graph structural information. The Siamese autoencoder is constructed and trained, which reduces the dimensionality of the Graph Embedding vectors, while maximizing the preservation of structural information in the original high-dimensional vectors. The resulting low-dimensional Graph Embeddings can be effectively utilized for tasks such as approximate nearest neighbor search. The experimental results demonstrate the effectiveness of our proposed framework in accurately predicting graph similarity.

Ma, Jiaji↗

Analysis of Needlet Internal Linear Combination performance on B -mode data from sub-orbital experiments

The observation of primordial B modes in cosmic microwave background (CMB) polarisation data represents the main scientific goal of most of the future CMB experiments. This signal is predicted to be much lower than polarised Galactic emission (foregrounds) in any region of the sky, pointing to the need for effective component separation methods. Aims. Among all the techniques, the blind Needlet Internal Linear Combination (NILC) is of great relevance given our current limited knowledge of the B-mode foregrounds. In this work, we explore the possibility of employing NILC for the analysis of B modes reconstructed from partial-sky data, specifically addressing the complications that such an application yields such as E–B leakage, needlet filtering, and beam convolution. We consider two complementary simulated datasets of future experiments: the balloon-borne Short Wavelength Instrument for the Polarisation Explorer (SWIPE) of the Large Scale Polarisation Explorer, which targets the observation of both reionisation and recombination peaks of the primordial CMB B-mode angular power spectrum, and the ground-based Small Aperture Telescope of Simons Observatory, which, instead, is designed to observe only the recombination bump at ℓ ~ 80. We assessed the performance of the following two alternative techniques to correct for the CMB E–B leakage: the recycling technique and the Zhao-Baskaran method. We find that both techniques reduce the E–B leakage residuals at a negligible level given the sensitivity of the considered experiments, except for the recycling method in the SWIPE footprint at ℓ < 20. Thus, we implemented two extensions of the pipeline, the iterative B decomposition and the diffusive inpainting, which enabled us to recover the input CMB B-mode power for ℓ ≥ 5. For the considered experiments, we demonstrate that needlet filtering and beam convolution do not affect the CMB B-mode reconstruction. Finally, with an appropriate masking strategy, we find that NILC foregrounds subtraction allows one to achieve sensitivities on the tensor-to-scalar ratio in agreement with the targets of the considered CMB experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

Elastic Bayesian Model Calibration

Functional data are ubiquitous in scientific modeling. For instance, quantities of interest are modeled as functions of time, space, energy, density, etc. Uncertainty quantification methods for computer models with functional response have resulted in tools for emulation, sensitivity analysis, and calibration that are widely used. However, many of these tools do not perform well when the computer model’s parameters control both the amplitude variation of the functional output and its alignment (or phase variation). This paper introduces a framework for Bayesian model calibration when the model responses are misaligned functional data. The approach generates two types of data out of the misaligned functional responses: (1) aligned functions so that the amplitude variation is isolated and (2) warping functions that isolate the phase variation. These two types of data are created for the computer simulation data (both of which may be emulated) and the experimental data. The calibration approach uses both types so that it seeks to match both the amplitude and phase of the experimental data. The framework is careful to respect constraints that arise, especially when modeling phase variation, and is framed in a way that it can be done with readily available calibration software. In conclusion, we demonstrate the techniques on two simulated data examples and on two dynamic material science problems: a strength model calibration using flyer plate experiments and an equation of state model calibration using experiments performed on the Sandia National Laboratories’ Z-machine.

97 MATHEMATICS AND COMPUTING↗

Network of Modified Portable Optical Particle Spectrometers Instrument Handbook

The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s portable optical particle spectrometer (POPS) network (Figure 1) provides an aerosol size distribution spectrum from 150 nm to 5 μm in 16 logarithmically spaced bins. The data emanating from this network of up to four matching POPS in weatherproof enclosures comprises one-minute averages of the aerosol size and number spectrum and the co-located temperature and relative humidity. The total particle concentration and sample flow rate are also provided. The sample stream is not dried before its measurement. Two size spectra are provided: the default size distribution corresponds to the calibration using polystyrene latex spheres (PSL), while the second size distribution corresponds to the calibration using size-selected dry ammonium sulfate aerosol. The principal scientific application of the data provided by the ARM POPS is to determine the aerosol size distribution across a region in three disparate locations – the size distribution is broadly relevant to studies of pollution and of conditions in the boundary layer. A high particle concentration can be an indicator of unhealthy levels of pollution; the dispersion of particles in the atmosphere is a predictor of long-range visibility; and particles serve as collectors of condensing gases including water vapor, and thus are a factor in the formation and properties of fogs and clouds, and in the initiation of precipitation.

54 ENVIRONMENTAL SCIENCES↗

PlasmoData.jl — A Julia framework for modeling and analyzing complex data as graphs

Datasets encountered in scientific and engineering applications appear in complex formats (e.g., images, multivariate time series, molecules, video, text strings, networks). Graph theory provides a unifying framework to model such datasets and enables the use of powerful tools that can help analyze, visualize, and extract value from data. In this work, we present PlasmoData.jl, an open-source, Julia framework that uses concepts of graph theory to facilitate the modeling and analysis of complex datasets. The core of our framework is a general data modeling abstraction, which we call a DataGraph. We show how the abstraction and software implementation can be used to represent diverse data objects as graphs and to enable the use of tools from topology, graph theory, and machine learning (e.g., graph neural networks) to conduct a variety of tasks. We illustrate the versatility of the framework by using real datasets: (i) an image classification problem using topological data analysis to extract features from the graph model to train machine learning models; (ii) a disease outbreak problem where we model multivariate time series as graphs to detect abnormal events; and (iii) a technology pathway analysis problem where we highlight how we can use graphs to navigate connectivity. Further, our discussion also highlights how PlasmoData.jl leverages native Julia capabilities to enable compact syntax, scalable computations, and interfaces with diverse packages. Overall, we show that the DataGraph abstraction and PlasmoData.jl Julia package are able to model data within graphs and enable useful analysis.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

SDSS-IV MaNGA: Modeling the Spectral Line-spread Function to Subpercent Accuracy

The Sloan Digital Sky Survey IV Mapping Nearby Galaxies at APO (MaNGA) program has been operating from 2014 to 2020, and has now observed a sample of 9269 galaxies in the low redshift universe (z ∼ 0.05) with integral-field spectroscopy. With rest-optical (λλ0.36–1.0 μm) spectral resolution R ∼ 2000 the instrumental spectral line-spread function (LSF) typically has 1σ width of about 70 km s{sup −1}, which poses a challenge for the study of the typically 20–30 km s{sup −1} velocity dispersion of the ionized gas in present-day disk galaxies. In this contribution, we present a major revision of the MaNGA data pipeline architecture, focusing particularly on a variety of factors impacting the effective LSF (e.g., under-sampling, spectral rectification, and data cube construction). Through comparison with external assessments of the MaNGA data provided by substantially higher-resolution R ∼ 10,000 instruments, we demonstrate that the revised MPL-10 pipeline measures the instrumental LSF sufficiently accurately (≤0.6% systematic, 2% random around the wavelength of Hα) that it enables reliable measurements of astrophysical velocity dispersions σ {sub Hα} ∼ 20 km s{sup −1} for spaxels with emission lines detected at signal-to-noise ratio > 50. Velocity dispersions derived from [O II], Hβ, [O III], [N II], and [S II] are consistent with those derived from Hα to within about 2% at σ {sub Hα} > 30 km s{sup −1}. Although the impact of these changes to the estimated LSF will be minimal at velocity dispersions greater than about 100 km s{sup −1}, scientific results from previous data releases that are based on dispersions far below the instrumental resolution should be reevaluated.

47 OTHER INSTRUMENTATION↗

ThunderSecure: deploying real-time intrusion detection for 100G research networks by leveraging stream-based features and one-class classification network

Nowadays, data generated by large-scale scientific experiments are on the scale of petabytes per month. These data are transferred through dedicated high-bandwidth networks (40/100G) across distributed sites for processing, storage, and analysis. Like general purpose networks, research networks experience intrusions. However, monitoring anomalies in such high-speed network traffics is challenging given current cyber-infrastructure. Moreover, traditional network intrusion detection systems (NIDS) are signature based. However, anomaly patterns are difficult to define and that rulesets are often not updated frequently enough to reflect the changes of attack behaviors. We present ThunderSecure, a high-throughput, unsupervised learning-based intrusions detection system for 100G research networks. ThunderSecure implements an efficient packet processing and detection pipeline using multi-cores and GPUs. It extracts statistical and temporal features from real-time network data streams and feeds them to a one-class anomaly detection network. A baseline of normal distribution will be created based on the training observation. Testing traffic deviated from the learned profile will be marked as anomalies. We trained ThunderSecure on hundreds of billions of science data packets mirrored from two 100G network connections at Fermi National Accelerator Laboratory. The detection performance was evaluated on traffic captured from the same research network days and weeks after the training with different types of attack flows injected. Results show that ThunderSecure can recognize science data traffic captured long after the training and made nearly certain detection on the segment of the streams where anomalous flows were injected.

100G research network↗

Real-time Intrusion Detection for High-bandwidth Research Networks using Unsupervised Deep Learning

Nowadays, data generated by large-scale scientific experiments are on the scale of petabytes per month. These data are transferred through dedicated high-bandwidth networks across distributed collaboration sites for processing, storage, and analysis. Like general purpose networks, research networks experience attacks. However, monitoring traffic in such high-bandwidth network environments is challenging with conventional deep packet inspection (DPI)- based network intrusion detection systems (NIDS). Recently, machine learning (ML) algorithms have shown potential in detecting anomalous patterns with better generalizability and faster speed. Compared to the general purpose networks, traffic movement in research network is less volatile and more likely to benefit from the ML-based anomaly analysis. We present ThunderSecure, an efficient AI-powered system for detecting anomalies in 100G research networks. ThunderSecure implements a high-throughput packet processing infrastructure using multi-cores and GPUs. It takes time-series statistics from a variety of network measurements and uses 2D Convolutional Neural Network (CNN) to explore both spatial and temporal dependencies in network data stream. Patterns of science data traffic are learned with a one-class neural network, which blends an Adversarial Autoencoder (AAE) with Gaussian mixture density estimation. Testing traffic flows exhibiting significant deviations from the learned baseline of normality are marked as anomalies. We trained ThunderSecure on hundreds of billions of science data packets recorded from a 100G research network at Fermi National Accelerator Laboratory. The detection performance was evaluated on traffic captured from the same research network days and weeks after the training with different types of attack flows injected. To the best of our knowledge, this is the first ML work in the area of network anomaly detection that has been validated on such extreme scale datasets. Results show that ThunderSecure can recognize science data traffic that are captured long after the training and make nearly certain detection on those with anomalous flows injected, even in the case when the anomaly-to-normal mixing ratio is 0.1%.

Gong, Qian↗

EPCAPE Radar b1 Data Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy (DOE)’s Atmospheric Radiation Measurement (ARM) user facility recently deployed its First ARM Mobile Facility (AMF1) to La Jolla, California as part of the Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE) campaign. Some of the goals behind EPCAPE were to characterize the diurnal and seasonal cycles of stratocumulus clouds and to investigate the cloud-aerosol-radiation interactions and feedbacks in the area. The deployment of the AMF1 for a full year from 15 February 2023 to 14 February 2024 aided in addressing these scientific questions. While AMF1 collected data year-round, enhanced measurements were taken during two intensive operational periods (IOPs). The first IOP occurred from April to June and focused on the chemistry of low clouds (EPCAPE_Chem), while the second IOP occurred from July to September and was focused on the radiation of high clouds (EPCAPE_Radiation). Several cloud radars were deployed with AMF1 to collect valuable data on cloud properties that will help users address key science objectives. As in past ARM campaigns, a1-level radar data is extensively analyzed and calibration techniques are performed to generate b1-level data (Matthews et al. 2023, Feng et al. 2024). Radar data at the b1-level are of the highest quality and thus can be used to examine scientific questions. The status of the a1-level data and the a1-to-b1 process for the EPCAPE radars is subsequently detailed in this document.

54 ENVIRONMENTAL SCIENCES↗

SigTime: Learning and Visually Explaining Time Series Signatures

Understanding and distinguishing temporal patterns in time series data is essential for scientific discovery and decision-making. For example, in biomedical research, uncovering meaningful patterns in physiological signals can improve diagnosis, risk assessment, and patient outcomes. However, existing methods for time series pattern discovery face major challenges, including high computational complexity, limited interpretability, and difficulty in capturing meaningful temporal structures. Here, to address these gaps, we introduce a novel learning framework that jointly trains two Transformer models using complementary time series representations: shapelet-based representations to capture localized temporal structures and traditional feature engineering to encode statistical properties. The learned shapelets serve as interpretable signatures that differentiate time series across classification labels. Additionally, we develop a visual analytics system—SigTime—with coordinated views to facilitate exploration of time series signatures from multiple perspectives, aiding in useful insights generation. We quantitatively evaluate our learning framework on eight publicly available datasets and one proprietary clinical dataset. Additionally, we demonstrate the effectiveness of our system through two usage scenarios along with the domain experts: one involving public ECG data and the other focused on preterm labor analysis.

97 MATHEMATICS AND COMPUTING↗

FY 2025 Multidimensional Data Correlation Platform: Unified Software Architecture for Advanced Materials and Manufacturing Technologies Data Management and Processing

The Advanced Materials and Manufacturing Technologies (AMMT) program continues to advance a data-driven approach to demonstrate the utility of additive manufacturing for fabricating components for nuclear applications. A key scientific goal is to leverage data to better understand manufacturing outcomes and thereby improve the performance, reliability, and lifespan of nuclear components. Ultimately, this effort supports the development of standards for certification and qualification of additively manufactured components, enabling broader industry adoption. In support of this objective, the AMMT program is building and deploying a data management platform to record, index, analyze, and make available the manufacturing data generated across the AMMT program. In FY 2023, the team conceptualized the architecture of the platform and, in FY 2024, deployed the first functional version at the Oak Ridge National Laboratory (ORNL) Manufacturing Demonstration Facility (MDF). In FY 2025, the platform was officially opened to all AMMT members. To enable this expansion, core modifications and enhancements were developed, including improvements to the user interface and workflows for data entry and retrieval. Most notably, robust security and access control mechanisms were implemented to protect data and manage information sharing. This effort featured a logging system, protected views, and controlled access mechanisms. This report documents these enhancements and the transition of the platform into program-wide use.

36 MATERIALS SCIENCE↗

WHOLESCALE - Water & Hole Observations Leverage Effective Stress Calculations And Lessen Expenses (Final Technical Report 2020 - 2024)

The WHOLESCALE acronym stands for Water & Hole Observations Leverage Effective Stress Calculations and Lessen Expenses. The goal of the WHOLESCALE project is to simulate the spatial distribution and temporal evolution of stress in the geothermal system at San Emidio in Nevada, United States. To reach this goal, the WHOLESCALE team has developed a methodology to incorporate and interpret data from four methods of measurement into a multi-physics model that couples thermal, hydrological, and mechanical (T H-M) processes. The WHOLESCALE team has applied this methodology at the San Emidio geothermal field, located ~100 km north of Reno, Nevada in the northwestern Basin and Range province. The WHOLESCALE team includes 30 individuals working at two universities, two national laboratories, and one industry partner. Two master-degree students and five post-doctoral researchers have gained professional experience and earned partial financial support via the WHOLESCALE project. The WHOLESCALE team has taken advantage of the perturbations created by changes in pumping operations during planned shutdowns in 2016, 2021, and 2022 to infer temporal changes in the state of stress in the geothermal system at San Emidio, Nevada, U.S. The WHOLESCALE results support the working hypothesis that increasing pore-fluid pressure reduces the effective normal stress acting across fault zones. During normal operations, pumping in deep production wells decreases fluid pressures and thus increases the effective normal stresses on faults, reducing microseismicity. During planned shutdowns, the cessation of production increases pore-fluid pressure and reduces effective normal stress. The WHOLESCALE products generated during the 4-year period between 2020 and 2024 include: three articles published in the open-access, peer-reviewed scientific literature, two master’s theses, 20 presentations or papers at scientific conferences, and 17 data sets available on public repositories. The WHOLESCALE project has been completed in two phases that included three performance periods separated by two Go/No-go Stage Gate Reviews. Tasks were classified by data type (i.e., Geologic Structure, Borehole, Geodesy, Hydrology, Seismology, and Modeling). The first phase of the project started July 31, 2020 and included ongoing project coordination (Task 1), a project kickoff (Task 2), analysis of existing data (Task 3), development of the initial stress model & deployment design (Task 4), and Go/No-go Decision Point #1 (Task 5). Phase II began with implementing the 2022 deployment (Task 6), followed by Go/No-go Decision Point #2 (Task 7) The remainder of Phase II consisted of analyzing data collected during deployment (Task 8), calibration of the stress model on all observations (Task 9), and the Final Review (August 23, 2024) & Reporting (Task 10).

15 GEOTHERMAL ENERGY↗

Soil organic carbon is not just for soil scientists: measurement recommendations for diverse practitioners

Soil organic carbon (SOC) regulates terrestrial ecosystem functioning, provides diverse energy sources for soil microorganisms, governs soil structure, and regulates the availability of organically bound nutrients. Investigators in increasingly diverse disciplines recognize how quantifying SOC attributes can provide insight about ecological states and processes. Today, multiple research networks collect and provide SOC data, and robust, new technologies are available for managing, sharing, and analyzing large data sets. Here, we advocate that the scientific community capitalize on these developments to augment SOC data sets via standardized protocols. We describe why such efforts are important and the breadth of disciplines for which it will be helpful, and outline a tiered approach for standardized sampling of SOC and ancillary variables that ranges from simple to more complex. We target scientists ranging from those with little to no background in soil science to those with more soil-related expertise, and offer examples of the ways in which the resulting data can be organized, shared, and discoverable.

54 ENVIRONMENTAL SCIENCES↗

Community-Driven Methods for Open and Reproducible Software Tools for Analyzing Datasets from Atom Probe Microscopy

Atom probe tomography, and related methods, probe the three-dimensional architecture of a material. The software tools that microscopists use, and how these tools are connected into workflows, makes a substantial contribution to the accuracy and precision of such a material characterization experiment. Typically, we adapt methods from other communities like mathematics, data science, computational geometry, artificial intelligence, or scientific computing. We also realize that improving on research data management is a challenge when it comes to align with the FAIR data stewardship principles. Faced with this global challenge, we are convinced that collaborating is useful. Here, we report the results and challenges with an inter-laboratory call for developing test cases for several types of atom probe software tools. The results support why defining detailed recipes of software workflows and sharing these recipes is necessary and rewarding: Open source tools and (meta)data exchange can help to make our day-to-day data processing tasks become more efficient, the training of new users and knowledge transfer become easier, and assist us with automated quantification of uncertainties to gain access to substantiated results.

36 MATERIALS SCIENCE↗

Bayesian model-data comparison incorporating theoretical uncertainties

Accurate comparisons between theoretical models and experimental data are critical for scientific progress. However, inferred physical model parameters can vary significantly with the chosen physics model, highlighting the importance of properly accounting for theoretical uncertainties. In this Letter, we present a Bayesian framework that explicitly quantifies these uncertainties by statistically modeling theory errors, guided by qualitative knowledge of a theory’s varying reliability across the input domain. We demonstrate the effectiveness of this approach using two systems: a simple ball drop experiment and multi-stage heavy-ion simulations. In both cases incorporating model discrepancy leads to improved parameter estimates, with systematic improvements observed as additional experimental observables are integrated.

Bayesian methods↗

Volcanology, Geochemistry, and Petrology Perspectives on Integrated, Coordinated, Open, Networked (ICON) Science

This article is composed of a commentary about the state of Integrated, Coordinated, Open, and Networked (ICON) principles in Volcanology, Geochemistry, and Petrology (VGP), and discussion on the opportunities and challenges of adopting them. VGP encompasses a broad field that addresses volcanic, magmatic, hydrothermal, geomicrobial systems; process investigations that span the physical, geochemical and biological realms, including planetary geology; and one that is extensively supported by state-of-the-art research facilities. We suggest that an open, inclusive, collaborative and evolving model of an international coordinated network is critical to answering the most pressing challenges in VGP. In this commentary piece, we begin to discuss the elements of, challenges to, and path forward in developing such a model. For this team, ICON means collaboration, equitable access to data for the entire scientific community, and forging of partnerships that potentially contribute to more innovative ways of coordinating and sharing research. It also means bringing more equity to science, by implementing effective measures which consider access to funding, analytical equipment, resources, and mentors. More importantly, ICON to us means having important conversations around what we value in the advancement of science, perhaps exploring outside the idea of meritocracy and evaluating what individual traits can contribute to science outside what has traditionally been considered the norm.

58 GEOSCIENCES↗

Quantum annealing algorithms for Boolean tensor networks

Abstract Quantum annealers manufactured by D-Wave Systems, Inc., are computational devices capable of finding high-quality heuristic solutions of NP-hard problems. In this contribution, we explore the potential and effectiveness of such quantum annealers for computing Boolean tensor networks. Tensors offer a natural way to model high-dimensional data commonplace in many scientific fields, and representing a binary tensor as a Boolean tensor network is the task of expressing a tensor containing categorical (i.e., $$\{0, 1\}$$ { 0 , 1 } ) values as a product of low dimensional binary tensors. A Boolean tensor network is computed by Boolean tensor decomposition, and it is usually not exact. The aim of such decomposition is to minimize the given distance measure between the high-dimensional input tensor and the product of lower-dimensional (usually three-dimensional) tensors and matrices representing the tensor network. In this paper, we introduce and analyze three general algorithms for Boolean tensor networks: Tucker, Tensor Train, and Hierarchical Tucker networks. The computation of a Boolean tensor network is reduced to a sequence of Boolean matrix factorizations, which we show can be expressed as a quadratic unconstrained binary optimization problem suitable for solving on a quantum annealer. By using a novel method we introduce called parallel quantum annealing, we demonstrate that Boolean tensor’s with up to millions of elements can be decomposed efficiently using a DWave 2000Q quantum annealer.

97 MATHEMATICS AND COMPUTING↗

Bayesian experimental design and parameter estimation for ultrafast spin dynamics

Abstract Advanced experimental measurements are crucial for driving theoretical developments and unveiling novel phenomena in condensed matter and materials physics, which often suffer from the scarcity of large-scale facility resources, such as x-ray or neutron scattering centers. To address these limitations, we introduce a methodology that leverages the Bayesian optimal experimental design paradigm to efficiently uncover key quantum spin fluctuation parameters from x-ray photon fluctuation spectroscopy (XPFS) data. Our method is compatible with existing theoretical simulation pipelines and can also be used in combination with fast machine learning surrogate models in the event that real-time simulations are unfeasible. Our numerical benchmarks demonstrate the superior performance in predicting model parameters and in delivering more informative measurements within limited experimental time. Our method can be adapted to many different types of experiments beyond XPFS and spin fluctuation studies, facilitating more efficient data collection and accelerating scientific discoveries.

97 MATHEMATICS AND COMPUTING↗