Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Reformulation of the No-Free-Lunch Theorem for Entangled Datasets

The No-Free-Lunch (NFL) theorem is a celebrated result in learning theory that limits one’s ability to learn a function with a training data set. With the recent rise of quantum machine learning, it is natural to ask whether there is a quantum analog of the NFL theorem, which would restrict a quantum computer’s ability to learn a unitary process with quantum training data. However, in the quantum setting, the training data can possess entanglement, a strong correlation with no classical analog. In this work, we show that entangled data sets lead to an apparent violation of the (classical) NFL theorem. This motivates a reformulation that accounts for the degree of entanglement in the training set. As our main result, we prove a quantum NFL theorem whereby the fundamental limit on the learnability of a unitary is reduced by entanglement. We employ Rigetti's quantum computer to test both the classical and quantum NFL theorems. In conclusion, our work establishes that entanglement is a commodity in quantum machine learning.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Search for a Sub-eV Sterile Neutrino Using Daya Bay’s Full Dataset

This Letter presents results of a search for the mixing of a sub-eV sterile neutrino with three active neutrinos based on the full data sample of the Daya Bay Reactor Neutrino Experiment, collected during 3158 days of detector operation, which contains 5.55 × 106 reactor $\overline{v}$ e candidates identified as inverse beta-decay interactions followed by neutron capture on gadolinium. The analysis benefits from a doubling of the statistics of our previous result and from improvements of several important systematic uncertainties. No significant oscillation due to mixing of a sub-eV sterile neutrino with active neutrinos was found. Exclusion limits are set by both Feldman-Cousins and CLs methods. Light sterile neutrino mixing with sin 2⁡ 2⁢θ 14 ≳ 0.01 can be excluded at 95% confidence level in the region of 0.01 eV 2 ≲ |Δ⁢$m$$^{2}_{41}$| ≲ 0.1 eV 2 . This result represents the world-leading constraints in the region of 2 × 10 –4 eV 2 ≲ |Δ⁢$m$$^{2}_{41}$| ≲ 0.2 eV 2 .

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2018

Interactive visualization of multi-data-set Rietveld analyses using Cinema:Debye-Scherrer [nteractive Visualization of Multi-Dataset Rietveld Analyses using Cinema:Debye-Scherrer]

A tool named Cinema:Debye-Scherrer to visualize the results of a series of Rietveld analyses is presented. The multi-axis visualization of the high-dimensional data sets resulting from powder diffraction analyses allows identification of analysis problems, prediction of suitable starting values, identification of gaps in the experimental parameter space and acceleration of scientific insight from the experimental data. The tool is demonstrated with analysis results from 59 U–Nb alloy samples with different compositions, annealing times and annealing temperatures as well as with a high-temperature study of the crystal structure of CsPbBr 3 . A script to extract parameters from a series of Rietveld analyses employing the widely used GSAS Rietveld software is also described. Finally, both software tools are available for download.

36 MATERIALS SCIENCE↗
DOE OSTI2017

Parallel Multivariate Spatio-Temporal Clustering of Large Ecological Datasets on Hybrid Supercomputers

A proliferation of data from vast networks of remote sensing platforms (satellites, unmanned aircraft systems (UAS), airborne etc.), observational facilities (meteorological, eddy covariance etc.), state-of-the-art sensors, and simulation models offer unprecedented opportunities for scientific discovery. Unsupervised classification is a widely applied data mining approach to derive insights from such data. However, classification of very large data sets is a complex computational problem that requires efficient numerical algorithms and implementations on high performance computing (HPC) platforms. Additionally, increasing power, space, cooling and efficiency requirements has led to the deployment of hybrid supercomputing platforms with complex architectures and memory hierarchies like the Titan system at Oak Ridge National Laboratory. The advent of such accelerated computing architectures offers new challenges and opportunities for big data analytics in general and specifically, large scale cluster analysis in our case. Although there is an existing body of work on parallel cluster analysis, those approaches do not fully meet the needs imposed by the nature and size of our large data sets. Moreover, they had scaling limitations and were mostly limited to traditional distributed memory computing platforms. We present a parallel Multivariate Spatio-Temporal Clustering (MSTC) technique based on k-means cluster analysis that can target hybrid supercomputers like Titan. We developed a hybrid MPI, CUDA and OpenACC implementation that can utilize both CPU and GPU resources on computational nodes. We describe performance results on Titan that demonstrate the scalability and efficacy of our approach in processing large ecological data sets.

Sreepathi, Sarat↗
DOE OSTI2023

Spatiotemporally Adaptive Compression for Scientific Dataset with Feature Preservation – A Case Study on Simulation Data with Extreme Climate Events Analysis

Scientific discoveries are increasingly constrained by limited storage space and I/O capacities. For time-series simulations and experiments, their data often need to be decimated over timesteps to accommodate storage and I/O limitations. In this paper, we propose a technique that addresses storage costs while improving post-analysis accuracy through spatiotemporal adaptive, error-controlled lossy compression. We investigate the trade-off between data precision and temporal output rates, revealing that reducing data precision and increasing timestep frequency lead to more accurate analysis outcomes. Additionally, we integrate spatiotemporal feature detection with data compression and demonstrate that performing adaptive error-bounded compression in higher dimensional space enables greater compression ratios, leveraging the error propagation theory of a transformation-based compressor. To evaluate our approach, we conduct experiments using the well-known E3SM climate simulation code and apply our method to compress variables used for cyclone tracking. Our results show a significant reduction in storage size while enhancing the quality of cyclone tracking analysis, both quantitatively and qualitatively, in comparison to the prevalent timestep decimation approach. Compared to three state-of-the-art lossy compressors lacking feature preservation capabilities, our adaptive compression framework improves perfectly matched cases in TC tracking by 26.4-51.3% at medium compression ratios and by 77.3-571.1% at large compression ratios, with a merely 5–11% computational overhead.

Gong, Qian↗
DOE OSTI2018

Reduced solar-induced chlorophyll fluorescence from GOME-2 during Amazon drought caused by dataset artifacts

In a recent study, Yang et al. reported a decrease in solar-induced chlorophyll fluorescence (SIF) during 2015/2016 El Niño event albeit the increase in enhanced vegetation index (EVI). They interpreted the reduced SIF as a signal of reduced ecosystem photosynthesis. However, we argue that the reduced SIF during 2015/2016 is caused by a decreasing trend of SIF due to sensor degradation and the satellite overpass time is critical for drought impact assessment.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Testing for changes in biomass dynamics in large‐scale forest datasets

Abstract Tropical forest responses to climate and atmospheric change are critical to the future of the global carbon budget. Recent studies have reported increases in estimated above‐ground biomass (EAGB) stocks, productivity, and mortality in old‐growth tropical forests. These increases could reflect a shift in forest functioning due to global change and/or long‐lasting recovery from past disturbance. We introduce a novel approach to disentangle the relative contributions of these mechanisms by decomposing changes in whole‐plot biomass fluxes into contributions from changes in the distribution of gap‐successional stages and changes in fluxes for a given stage. Using 30 years of forest dynamic data at Barro Colorado Island, Panama, we investigated temporal variation in EAGB fluxes as a function of initial EAGB (EAGB i ) in 10 × 10 m quadrats. Productivity and mortality fluxes both increased strongly with initial quadrat EAGB. The distribution of EAGB (and thus EAGB i ) across quadrats hardly varied over 30 years (and seven censuses). EAGB fluxes as a function of EAGB i varied largely and significantly among census intervals, with notably higher productivity in 1985–1990 associated with recovery from the 1982–1983 El Niño event. Variation in whole‐plot fluxes among census intervals was explained overwhelmingly by variation in fluxes as a function of EAGB i , with essentially no contribution from changes in EAGB i distributions. The high observed temporal variation in productivity and mortality suggests that this forest is very sensitive to climate variability. There was no consistent long‐term trend in productivity, mortality, or biomass in this forest over 30 years, although the temporal variability in productivity and mortality was so strong that it could well mask a substantial trend. Accurate prediction of future tropical forest carbon budgets will require accounting for disturbance‐recovery dynamics and understanding temporal variability in productivity and mortality.

Rutishauser, Ervan↗
DOE OSTI2018

Russulaceae: a new genomic dataset to study ecosystem function and evolutionary diversification of ectomycorrhizal fungi with their tree associates

The family Russulaceae is considered an iconic lineage of mostly mushroom-forming basidiomycetes due to their importance as edible mushrooms in many parts of the world, and their ubiquity as ectomycorrhizal symbionts in both temperate and tropical forested biomes. Although much research has been focused on this group, a comprehensive or cohesive synthesis by which to understand the functional diversity of the group has yet to develop. Interest in ectomycorrhizal fungi, of which Russulaceae is a key lineage, is prodigious due to the important roles they play as plant root mutualists in ecosystem functioning, global carbon sequestration, and a potential role in technology development toward environmental sustainability. As one of the most species-diverse ectomycorrhizal lineages, the Russulaceae has recently been the focus of a dense sampling and genome sequencing initiative with the Joint Genome Institute aimed at untangling their functional roles and testing whether functional niche specialization exists for independent lineages of ectomycorrhizal fungi. In this paper, we present a review of important studies on this group to contextualize what we know about its members' evolutionary history and ecosystem functions, as well as to generate hypotheses establishing the Russulaceae as a valuable experimental system.

54 ENVIRONMENTAL SCIENCES↗