Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Improved algorithm for processing grating-based phase contrast interferometry image sets

Grating-based X-ray and neutron interferometry tomography using phase-stepping methods generates large data sets. An improved algorithm is presented for solving for the parameters to calculate transmissions, differential phase contrast, and dark-field images. The method takes advantage of the vectorization inherent in high-level languages such as Mathematica and MATLAB and can solve a 16 × 1k × 1k data set in less than a second. In addition, the algorithm can function with partial data sets. This is demonstrated with processing of a 16-step grating data set with partial use of the original data chosen without any restriction. Also, we have calculated the reduced chi-square for the fit and notice the effect of grating support structural elements upon the differential phase contrast image and have explored expanded basis set representations to mitigate the impact.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Disentangling multidimensional spatio-temporal data into their common and aberrant responses

With the advent of high-throughput measurement techniques, scientists and engineers are starting to grapple with massive data sets and encountering challenges with how to organize, process and extract information into meaningful structures. Multidimensional spatio-temporal biological data sets such as time series gene expression with various perturbations over different cell lines, or neural spike trains across many experimental trials, have the potential to acquire insight about the dynamic behavior of the system. For this potential to be realized, we need a suitable representation to understand the data. A general question is how to organize the observed data into meaningful structures and how to find an appropriate similarity measure. A natural way of viewing these complex high dimensional data sets is to examine and analyze the large-scale features and then to focus on the interesting details. Since the wide range of experiments and unknown complexity of the underlying system contribute to the heterogeneity of biological data, we develop a new method by proposing an extension of Robust Principal Component Analysis (RPCA), which models common variations across multiple experiments as the lowrank component and anomalies across these experiments as the sparse component. We show that the proposed method is able to find distinct subtypes and classify data sets in a robust way without any prior knowledge by separating these common responses and abnormal responses. Thus, the proposed method provides us a new representation of these data sets which has the potential to help users acquire new insight from data.

59 BASIC BIOLOGICAL SCIENCES↗

Independent confirmation of global land warming without the use of station temperatures

Confidence in estimates of anthropogenic climate change is limited by known issues with air temperature observations from land stations. Station siting, instrument changes, changing observing practices, urban effects, land cover, land use variations, and statistical processing have all been hypothesized as affecting the trends presented by the Intergovernmental Panel on Climate Change and others. Any artifacts in the observed decadal and centennial variations associated with these issues could have important consequences for scientific understanding and climate policy. We use a completely different approach to investigate global land warming over the 20th century. We have ignored all air temperature observations and instead inferred them from observations of barometric pressure, sea surface temperature, and sea-ice concentration using a physically based data assimilation system called the 20th Century Reanalysis. This independent data set reproduces both annual variations and centennial trends in the temperature data sets, demonstrating the robustness of previous conclusions regarding global warming.

54 ENVIRONMENTAL SCIENCES↗

rapidMCR

rapidMCR is a user friendly software package that includes automatic preprocessing, analysis, and viewing of hyperspectral image data sets. Currently, this software package specifically preprocesses and analyzes hyperspectral fluorescence image data sets that have been created on Sandia hyperspectral imaging microscopes; however, this software can be modified to include spectroscopic image data sets from other (non-Sandia developed) instruments as well. This software relies on using prior information about the spectroscopic image data sets by conducting a rigorous characterization of the instrument. By characterizing the instrument for noise and artifacts, we can implement our algorithms to account for the effects specific to a particular instrument. This allows us to automate the data preprocessing while improving the analysis results.

Source record↗

TRANSIT TIMING OBSERVATIONS FROM KEPLER. V. TRANSIT TIMING VARIATION CANDIDATES IN THE FIRST SIXTEEN MONTHS FROM POLYNOMIAL MODELS

Transit timing variations provide a powerful tool for confirming and characterizing transiting planets, as well as detecting non-transiting planets. We report the results of an updated transit timing variation (TTV) analysis for 1481 planet candidates based on transit times measured during the first sixteen months of Kepler observations. We present 39 strong TTV candidates based on long-term trends (2.8% of suitable data sets). We present another 136 weaker TTV candidates (9.8% of suitable data sets) based on the excess scatter of TTV measurements about a linear ephemeris. We anticipate that several of these planet candidates could be confirmed and perhaps characterized with more detailed TTV analyses using publicly available Kepler observations. For many others, Kepler has observed a long-term TTV trend, but an extended Kepler mission will be required to characterize the system via TTVs. We find that the occurrence rate of planet candidates that show TTVs is significantly increased ({approx}68%) for planet candidates transiting stars with multiple transiting planet candidates when compared to planet candidates transiting stars with a single transiting planet candidate.

79 ASTRONOMY AND ASTROPHYSICS↗

SPRUCE Ground Observations of Phenology in Experimental Plots, 2020

This data set consists of one comma separated (*.csv) file containing phenological transition dates, as derived from direct observations of vegetative and reproductive phenology recorded by a human observer, from the SPRUCE experiment during 2020, the fifth full year of whole-ecosystem warming (Hanson et al. 2017). Both spring and autumn phenological events are included. Since April 2016, human observers have been directly tracking the phenology of both woody and herbaceous species on a weekly schedule within the SPRUCE experimental chambers, these data are reported in annual ground observations data sets (see Related Data Sets). The observed date reported here is the first survey date in 2020 on which an event/phenophase was definitively observed. This data set also contains a companion file in HTML (*.html) format containing figures showing the relationship between the day of year and temperature treatment for different phenological phases by species for 2020. User note: Ground observations of phenology from 2016-2021 are available. SPRUCE Ground Observations of Phenology in Experimental Plots 2021, https://doi.org/10.25581/spruce.099/1874936 for the most recent data as well as links to all other ground phenology datasets.

54 ENVIRONMENTAL SCIENCES↗

Understanding boundary effects in quantum state tomography – One qubit case

For classical and quantum estimation with finite data sets, the estimation error can deviate significantly from its asymptotic (large data set) behavior. In quantum state tomography, a major reason for this is the existence of a boundary in the parameter space imposed by constraints, such as the positive semidefiniteness of density matrices. Intuitively, we should be able to reduce the estimation error by using our knowledge of these constraints. This intuition is correct for maximumlikelihood estimators, but the size of the reduction has not been evaluated quantitatively. In this proceeding, we evaluate the improvement in one qubit state tomography by using mathematical tools in classical statistical estimation theory. In particular, we show that the effect of the reduction decreases exponentially with respect to the number of data sets when the true state is mixed, and it remains at arbitrarily large data set when the true state is pure.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DeepMerge – II. Building robust deep learning algorithms for merging galaxy identification across domains

In astronomy, neural networks are often trained on simulation data with the prospect of being used on telescope observations. Unfortunately, training a model on simulation data and then applying it to instrument data leads to a substantial and potentially even detrimental decrease in model accuracy on the new target dataset. Simulated and instrument data represent different data domains, and for an algorithm to work in both, domain-invariant learning is necessary. Here we employ domain adaptation techniques— Maximum Mean Discrepancy (MMD) as an additional transfer loss and Domain Adversarial Neural Networks (DANNs)— and demonstrate their viability to extract domain-invariant features within the astronomical context of classifying merging and non-merging galaxies. Additionally, we explore the use of Fisher loss and entropy minimization to enforce better in-domain class discriminability. We show that the addition of each domain adaptation technique improves the performance of a classifier when compared to conventional deep learning algorithms. We demonstrate this on two examples: between two Illustris-1 simulated datasets of distant merging galaxies, and between Illustris-1 simulated data of nearby merging galaxies and observed data from the Sloan Digital Sky Survey. The use of domain adaptation techniques in our experiments leads to an increase of target domain classification accuracy of up to ~20%. With further development, these techniques will allow astronomers to successfully implement neural network models trained on simulation data to efficiently detect and study astrophysical objects in current and future large-scale astronomical surveys.

galaxies: interactions↗

SPRUCE Ground Observations of Phenology in Experimental Plots, 2021

This data set consists of one comma separated (*.csv) file containing phenological transition dates, as derived from direct observations of vegetative and reproductive phenology recorded by a human observer, from the SPRUCE experiment during 2021, the sixth full year of whole-ecosystem warming (Hanson et al. 2017). Both spring and autumn phenological events are included. Since April 2016, human observers have been directly tracking the phenology of both woody and herbaceous species on a weekly schedule within the SPRUCE experimental chambers, these data are reported in annual ground observations data sets (see Related Data Sets). The observed date reported here is the first survey date in 2021 on which an event/phenophase was definitively observed. This data set also contains a companion file in HTML (*.html) format containing figures showing the relationship between the day of year and temperature treatment for different phenological phases by species for 2021. User note: Ground observations of phenology from 2016-2020 are available. See the user guide for links to all other ground phenology datasets.

54 ENVIRONMENTAL SCIENCES↗

SPRUCE Ground Observations of Phenology in Experimental Plots, 2022

This data set consists of one comma separated (*.csv) file containing phenological transition dates, as derived from direct observations of vegetative and reproductive phenology recorded by a human observer, from the SPRUCE experiment during 2022 (2022-03-28 to 2021-11-17), the seventh full year of whole-ecosystem warming (Hanson et al. 2017). Both spring and autumn phenological events are included. Since April 2016, human observers have been directly tracking the phenology of both woody and herbaceous species on a weekly schedule within the SPRUCE experimental chambers, these data are reported in annual ground observations data sets (see Related Data Sets). The observed date reported here is the first survey date in 2022 on which an event/phenophase was definitively observed. This data set also contains a companion file in HTML (*.html) containing figures showing the relationship between the day of year and temperature treatment for different phenological phases by species for 2022.

SPRUCE experiment, plant phenological phases, Spru↗

SPRUCE Ground Observations of Phenology in Experimental Plots, 2023

This data set consists of one comma separated (*.csv) file containing phenological transition dates, as derived from direct observations of vegetative and reproductive phenology recorded by a human observer, from the SPRUCE experiment during 2023 (2023-03-30 to 2023-11-29), the eighth full year of whole-ecosystem warming (Hanson et al. 2017). Both spring and autumn phenological events are included. Since April 2016, human observers have been directly tracking the phenology of both woody and herbaceous species on a weekly schedule within the SPRUCE experimental chambers, these data are reported in annual ground observations data sets (see Related Data Sets). The observed date reported here is the first survey date in 2023 on which an event/phenophase was definitively observed. This data set also contains a companion file in HTML (*.html) containing figures showing the relationship between the day of year and temperature treatment for different phenological phases by species for 2023.

Marcell Experimental Forest↗

SPRUCE Ground Observations of Phenology in Experimental Plots, 2024

This data set consists of one comma separated (*.csv) file containing phenological transition dates, as derived from direct observations of vegetative and reproductive phenology recorded by a human observer, from the SPRUCE experiment during 2024 (2025-03-06 to 2025-11-21), the ninth full year of whole-ecosystem warming (Hanson et al. 2017). Both spring and autumn phenological events are included. Since April 2016, human observers have been directly tracking the phenology of both woody and herbaceous species on a weekly schedule within the SPRUCE experimental chambers, these data are reported in annual ground observations data sets (see Related Data Sets). The observed date reported here is the first survey date in 2024 on which an event/phenophase was definitively observed. This data set also contains a companion file in HTML (*.html) containing figures showing the relationship between the day of year and temperature treatment for different phenological phases by species for 2024.

54 ENVIRONMENTAL SCIENCES↗

The Need for Precise and Well-documented Experimental Data on Prompt Fission Neutron Spectra from Neutron-induced Fission of {sup 239}Pu

The spectrum of neutrons emitted promptly after {sup 239}Pu(n,f)—a so-called prompt fission neutron spectrum (PFNS)—is a quantity of high interest, for instance, for reactor physics and global security. However, there are only few experimental data sets available that are suitable for evaluations. In addition, some of those data sets differ by more than their 1-σ uncertainty boundaries. We present the results of MCNP studies indicating that these differences are partly caused by underestimated multiple scattering contributions, over-corrected background, and inconsistent deconvolution methods. A detailed uncertainty quantification for suitable experimental data was undertaken including these effects, and test-evaluations were performed with the improved uncertainty information. The test-evaluations illustrate that the inadequately estimated effects and detailed uncertainty quantification have an impact on the evaluated PFNS and associated uncertainties as well as the neutron multiplicity of selected critical assemblies. A summary of data and documentation needs to improve the quality of the experimental database is provided based on the results of simulations and test-evaluations. Given the possibly substantial distortion of the PFNS by multiple scattering and background effects, special care should be taken to reduce these effects in future measurements, e.g., by measuring the {sup 239}Pu PFNS as a ratio to either the {sup 235}U or {sup 252}Cf PFNS.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

MADmap: A Massively Parallel Maximum-Likelihood Cosmic Microwave Background Map-Maker

MADmap is a software application used to produce maximum-likelihood images of the sky from time-ordered data which include correlated noise, such as those gathered by Cosmic Microwave Background (CMB) experiments. It works efficiently on platforms ranging from small workstations to the most massively parallel supercomputers. Map-making is a critical step in the analysis of all CMB data sets, and the maximum-likelihood approach is the most accurate and widely applicable algorithm; however, it is a computationally challenging task. This challenge will only increase with the next generation of ground-based, balloon-borne and satellite CMB polarization experiments. The faintness of the B-mode signal that these experiments seek to measure requires them to gather enormous data sets. MADmap is already being run on up to O(1011) time samples, O(108) pixels and O(104) cores, with ongoing work to scale to the next generation of data sets and supercomputers. We describe MADmap's algorithm based around a preconditioned conjugate gradient solver, fast Fourier transforms and sparse matrix operations. We highlight MADmap's ability to address problems typically encountered in the analysis of realistic CMB data sets and describe its application to simulations of the Planck and EBEX experiments. The massively parallel and distributed implementation is detailed and scaling complexities are given for the resources required. MADmap is capable of analysing the largest data sets now being collected on computing resources currently available, and we argue that, given Moore's Law, MADmap will be capable of reducing the most massive projected data sets.

79 ASTRONOMY AND ASTROPHYSICS↗

Consistent satellite XCO 2 retrievals from SCIAMACHY and GOSAT using the BESD algorithm

Consistent and accurate long-term data sets of global atmospheric concentrations of carbon dioxide (CO 2 ) are required for carbon cycle and climate related research. However, global data sets based on satellite observations may suffer from inconsistencies originating from the use of products derived from different satellites as needed to cover a long enough time period. One reason for inconsistencies can be the use of different retrieval algorithms. We address this potential issue by applying the same algorithm, the Bremen Optimal Estimation DOAS (BESD) algorithm, to different satellite instruments, SCIAMACHY on-board ENVISAT (March 2002–April 2012) and TANSO-FTS on-board GOSAT (launched in January 2009), to retrieve XCO 2 , the column-averaged dry-air mole fraction of CO 2 . BESD has been initially developed for SCIAMACHY XCO 2 retrievals. Here, we present the first detailed assessment of the new GOSAT BESD XCO 2 product. GOSAT BESD XCO 2 is a product generated and delivered to the MACC project for assimilation into ECMWF's Integrated Forecasting System (IFS). We describe the modifications of the BESD algorithm needed in order to retrieve XCO 2 from GOSAT and present detailed comparisons with ground-based observations of XCO 2 from the Total Carbon Column Observing Network (TCCON). We discuss detailed comparison results between all three XCO 2 data sets (SCIAMACHY, GOSAT and TCCON). The comparison results demonstrate the good consistency between the SCIAMACHY and the GOSAT XCO 2 . For example, we found a mean difference for daily averages of −0.60 ± 1.56 ppm (mean difference ± standard deviation) for GOSAT-SCIAMACHY (linear correlation coefficient r = 0.82), −0.34 ± 1.37 ppm ( r = 0.86) for GOSAT-TCCON and 0.10 ± 1.79 ppm ( r = 0.75) for SCIAMACHY-TCCON. The remaining differences between GOSAT and SCIAMACHY are likely due to non-perfect collocation (±2 h, 10° × 10° around TCCON sites), i.e., the observed air masses are not exactly identical, but likely also due to a still non-perfect BESD retrieval algorithm, which will be continuously improved in the future. Our overarching goal is to generate a satellite-derived XCO 2 data set appropriate for climate and carbon cycle research covering the longest possible time period. We therefore also plan to extend the existing SCIAMACHY and GOSAT data set discussed here by using also data from other missions (e.g., OCO-2, GOSAT-2, CarbonSat) in the future.

54 ENVIRONMENTAL SCIENCES↗

Nonpareil 3: Fast Estimation of Metagenomic Coverage and Sequence Diversity

Estimations of microbial community diversity based on metagenomic data sets are affected, often to an unknown degree, by biases derived from insufficient coverage and reference database-dependent estimations of diversity. For instance, the completeness of reference databases cannot be generally estimated since it depends on the extant diversity sampled to date, which, with the exception of a few habitats such as the human gut, remains severely undersampled. Further, estimation of the degree of coverage of a microbial community by a metagenomic data set is prohibitively time-consuming for large data sets, and coverage values may not be directly comparable between data sets obtained with different sequencing technologies. Here, we extend Nonpareil, a database-independent tool for the estimation of coverage in metagenomic data sets, to a high-performance computing implementation that scales up to hundreds of cores and includes, in addition, a k -mer-based estimation as sensitive as the original alignment-based version but about three hundred times as fast. Further, we propose a metric of sequence diversity ( N d ) derived directly from Nonpareil curves that correlates well with alpha diversity assessed by traditional metrics. We use this metric in different experiments demonstrating the correlation with the Shannon index estimated on 16S rRNA gene profiles and show that N d additionally reveals seasonal patterns in marine samples that are not captured by the Shannon index and more precise rankings of the magnitude of diversity of microbial communities in different habitats. Therefore, the new version of Nonpareil, called Nonpareil 3, advances the toolbox for metagenomic analyses of microbiomes.

59 BASIC BIOLOGICAL SCIENCES↗

Selection of a phylogenetically informative region of the norovirus genome for outbreak linkage

The recognition of a common source norovirus outbreak is supported by finding identical norovirus sequences in patients. Norovirus sequencing has been established in many (national) public health laboratories and academic centers, but often partial and different genome sequences are used. Therefore, agreement on a target sequence of sufficient diversity to resolve links between outbreaks is crucial. Although harmonization of laboratory methods is one of the keystone activities of networks that have the aim to identify common source norovirus outbreaks, this has proven difficult to accomplish, particularly in the international context. Here, we aimed at providing a method enabling identification of the genomic region informative of a common source norovirus outbreak by bio-informatic tools. The data set of 502 unique full length capsid gene sequences available from the public domain, combined with epidemiological data including linkage information was used to build over 3,000 maximum likelihood (ML) trees for different sequence lengths and regions. All ML trees were evaluated for robustness and specificity of clustering of known linked norovirus outbreaks against the background diversity of strains. Great differences were seen in the robustness of commonly used PCR targets for cluster detection. The capsid gene region spanning nucleotides 900–1,400 was identified as the region optimally substituting for the full length capsid region. Reliability of this approach depends on the quality of the background data set, and we recommend periodic reassessment of this growing data set. The approach may be applicable to multiple sequence-based data sets of other pathogens.

59 BASIC BIOLOGICAL SCIENCES↗

Cambium 2022 Scenario Descriptions and Documentation

The National Renewable Energy Laboratory’s (NREL’s) Cambium data sets are annually released sets of simulated hourly emission, cost, and operational data for a range of modeled futures of the U.S. electric sector with metrics designed to be useful for long-term decision making. The 2022 Cambium data set is the third annual release. The data sets are a companion product to NREL’s Standard Scenarios, which are likewise released annually and are a set of projections of how the U.S. electric sector could evolve across a suite of different potential futures, but covering more scenarios with less temporal granularity. In this documentation, we describe Cambium 2022’s scenarios (Section 3), define the metrics (Section 5), and document the Cambium-specific methods for calculating those metrics (Section 6).

29 ENERGY PLANNING, POLICY, AND ECONOMY↗