Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

The NANOGrav nine-year data set: Astrometric measurements of 37 millisecond pulsars

Using the nine-year radio-pulsar timing data set from the North American Nanohertz Observatory for Gravitational Waves (NANOGrav), collected at Arecibo Observatory and the Green Bank Telescope, we have measured the positions, proper motions, and parallaxes for 37 millisecond pulsars. We report twelve significant parallax measurements and distance measurements, and eighteen lower limits on distance. We compare these measurements to distances predicted by the NE2001 interstellar electron density model and find them to be in general agreement. We use measured orbital-decay rates and spin-down rates to confirm two of the parallax distances and to place distance upper limits on other sources; these distance limits agree with the parallax distances with one exception, PSR J1024–0719, which we discuss at length. Using the proper motions of the 37 NANOGrav pulsars in combination with other published measurements, we calculate the velocity dispersion of the millisecond pulsar population in Galactocentric coordinates. We find the radial, azimuthal, and perpendicular dispersions to be 46, 40, and 24 km s{sup −1}, respectively, in a model that allows for high-velocity outliers; or 81, 58, and 62 km s{sup −1} for the full population. These velocity dispersions are far smaller than those of the canonical pulsar population, and are similar to older Galactic disk populations. This suggests that millisecond pulsar velocities are largely attributable to their being an old population rather than being artifacts of their birth and evolution as neutron star binary systems. The components of these velocity dispersions follow similar proportions to other Galactic populations, suggesting that our results are not biased by selection effects.

79 ASTRONOMY AND ASTROPHYSICS↗

A Meteorology and Snow Data Set From Adjacent Forested and Meadow Sites at Crested Butte, CO, USA

We present meteorology and snow observation data collected at sites in the southwestern Colorado Rocky Mountains (USA) over three consecutive water years with different amounts of snow water equivalent (SWE) accumulation: A year with above average SWE (2019), a year with average SWE (2020), and a year with below average SWE (2021). This data set is distinguished by its emphasis on paired open-forest sites in a continental snow climate. Approximately once a month during February–May, we collected data from 15 to 20 snow pits and took 8 to 19 snow depth transects. Our sampling sites were in open and adjacent forested areas at 3,100 m and in a lower elevation aspen (3,035 m) and higher elevation conifer stand (3,395 m). In total, we recorded 270 individual snow pit density and temperature profiles and over 4,000 snow depth measurements. These data are complimented by continuous meteorological measurements from two weather stations: One in the open and one in the adjacent forest. Meteorology data—including incoming shortwave and longwave radiation, outgoing shortwave radiation, relative humidity, wind speed, snow depth, and air and infrared surface temperature—were quality controlled and the forcing data were gap-filled. These data are available to download from Bonner, Smyth, et al. at three levels of processing, including a level with downscaled, adjusted precipitation based on data assimilation using observed snow depth and a process-based snow model. We demonstrate the utility of these data with a modeling experiment that explores open-forest differences and identifies opportunities for improvements in model representation.

54 ENVIRONMENTAL SCIENCES↗

Public Data Set: Erratum: "Multi-point, high-speed passive ion velocity distribution diagnostic on the Pegasus Toroidal Experiment" [Rev. Sci. Instrum. 83, 10D516 (2012)]

This data set contains openly-documented, machine readable digital research data corresponding to figures published in M.G. Burke et al., 'Erratum: "Multi-point, high-speed passive ion velocity distribution diagnostic on the Pegasus Toroidal Experiment" [Rev. Sci. Instrum. 83, 10D516 (2012)],' Rev. Sci. Instrum. 87, 079902 (2016).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Testing the consistency of Gamma Ray Burst data-set and Supernovae Union2

In this paper, we test the consistency of Gamma Ray Bursts (GRBs) Data-set and Supernovae Union2 (SNU2) via the so-called multi-dimensional consistency test under the assumption that ΛCDM model is a potentially correct cosmological model. We find that the probes are inconsistent with 1.456σ and 85.47% in terms of probability. With this observation, it is concluded that GRBs can be combined with SNU2 to constrain cosmological models.

79 ASTRONOMY AND ASTROPHYSICS↗

Comparison of typical year and multiyear building simulations using a 55-year actual weather data set from China

Weather has significant impacts on the thermal environment and energy use in buildings. Thus, accurate weather data are crucial for building performance evaluations. Traditionally, typical year data inputs are used to represent long-term weather data. However, there is no guarantee that a single year represents the changing climate well. In this study, the long-term representation of a typical year was assessed by comparing it to a 55-year actual weather data set. To investigate the weather impact on building energy use, 559 simulation runs of a prototype office building were performed for 10 large cities covering all climate zones in China. The analysis results demonstrated that the weather data varied significantly from year to year. Hence, a typical year cannot reflect the variation range of weather fluctuations. Typical year simulations overestimated or underestimated the energy use and peak load in many cases. With the increase in computational power of personal computers, it is feasible and essential to adopt multiyear simulations for full assessments of long-term building performance, as this will improve decision-making by allowing for the full consideration of variations in building energy use.

54 ENVIRONMENTAL SCIENCES↗

Analyzing large data sets from XGC1 magnetic fusion simulations using apache spark

Apache Spark is explored as a tool for analyzing large data sets from the magnetic fusion simulation code XGCI. Implementation details of Apache Spark on the NERSC Edison supercomputer are discussed, including binary file reading, and parameter setup. Here, an unsupervised machine learning algorithm, k-means clustering, is applied to XGCI particle distribution function data, showing that highly turbulent spatial regions do not have common coherent structures, but rather broad, ring-like structures in velocity space.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Sublinear Algorithms for Massive Data Sets

This is the final SAND report for the Early-Career LDRD (# 158477) “Sublinear Algorithms for Massive Data Sets”. We provide a list of the various publications and achievements in the project. 3

97 MATHEMATICS AND COMPUTING↗

Public Data Set: Erratum: “Initial Characterization of Electron Temperature and Density Profiles in PEGASUS Spherical Tokamak Discharges Driven Solely by Local Helicity Injection” [Phys. Plasmas 28, 102504 (2021)]

This public data set contains openly-documented, machine readable digital research data corresponding to figures published in G.M. Bodner et al., ‘Erratum: “Initial Characterization of Electron Temperature and Density Profiles in PEGASUS Spherical Tokamak Discharges Driven Solely by Local Helicity Injection” [Phys. Plasmas 28, 102504 (2021)],’ Physics of Plasmas 31, 129904 (2024).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

High-Resolution Southeast Asia Wind Resource Data Set

Well informed decision-making is a key part of integrating variable renewable energy into the global energy marketplace. USAID and NREL, through the Advanced Energy Partnership for Asia, are expanding access to critical resource data by providing free, high-fidelity time-series wind resource data for Southeast Asia through the RE Data Explorer platform. This brief highlights the development of the Southeast Asia wind resource data set and discusses the impacts of this data.

Advanced Energy Partnership for Asia↗

Considerations for Observational Research Using Large Data Sets in Radiation Oncology

The radiation oncology community has witnessed growing interest in observational research conducted using large-scale data sources such as registries and claims-based data sets. With the growing emphasis on observational analyses in health care, the radiation oncology community must possess a sophisticated understanding of the methodological considerations of such studies in order to evaluate evidence appropriately to guide practice and policy. Because observational research has unique features that distinguish it from clinical trials and other forms of traditional radiation oncology research, the International Journal of Radiation Oncology, Biology, Physics assembled a panel of experts in health services research to provide a concise and well-referenced review, intended to be informative for the lay reader, as well as for scholars who wish to embark on such research without prior experience. This review begins by discussing the types of research questions relevant to radiation oncology that large-scale databases may help illuminate. It then describes major potential data sources for such endeavors, including information regarding access and insights regarding the strengths and limitations of each. Finally, it provides guidance regarding the analytical challenges that observational studies must confront, along with discussion of the techniques that have been developed to help minimize the impact of certain common analytical issues in observational analysis. Features characterizing a well-designed observational study include clearly defined research questions, careful selection of an appropriate data source, consultation with investigators with relevant methodological expertise, inclusion of sensitivity analyses, caution not to overinterpret small but significant differences, and recognition of limitations when trying to evaluate causality. This review concludes that carefully designed and executed studies using observational data that possess these qualities hold substantial promise for advancing our understanding of many unanswered questions of importance to the field of radiation oncology.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Challenges and Vision for Standardization of Biopolymer Data Sets for Machine Learning

Machine learning (ML) is transforming materials research, yet potential for biopolymer discovery remains constrained by fragmented data and nonstandardized reporting. Biopolymers differ significantly from synthetic polymers, requiring specialized approaches to represent their biosynthetic origins, hierarchical structures, and application-specific metrics. In this Perspective, we identify three core challenges limiting biopolymer representation: information encoding, data quality, and data sharing. We describe the most pressing issues and propose commensurate approaches to address each key challenge. Recommendations include the design and adoption of biopolymer-specific fingerprinting and representation frameworks, development of hybrid human-large language model (LLM) data extraction strategies, and expanding Findable, Accessible, Interoperable, Reusable (FAIR)-compliant repositories. We propose a robust foundation to define interoperable, high-quality data sets that capture the full context of biopolymer materials. Standardized metadata, shared ontologies, and community-driven infrastructure would enable scalable, reproducible workflows and accelerate the ML-driven development of biopolymers.

36 MATERIALS SCIENCE↗

Scalable subsurface inverse modeling of huge data sets with an application to tracer concentration breakthrough data from magnetic resonance imaging

When characterizing subsurface properties is crucial for reliable and cost-effective groundwater supply management and contaminant remediation. With recent advances in sensor technology, large volumes of hydro-geophysical and geochemical data can be obtained to achieve high-resolution images of subsurface properties. However, characterization with such a large amount of information requires prohibitive computational costs associated with “big data” processing and numerous large-scale numerical simulations. To tackle such difficulties, the Principal Component Geostatistical Approach (PCGA) has been proposed as a “Jacobian-free” inversion method that requires much smaller forward simulation runs for each iteration than the number of unknown parameters and measurements needed in the traditional inversion methods. PCGA can be conveniently linked to any multi-physics simulation software with independent parallel executions. In our paper, we extend PCGA to handle a large number of measurements (e.g. 106 or more) by constructing a fast preconditioner whose computational cost scales linearly with the data size. For illustration, we characterize the heterogeneous hydraulic conductivity (K) distribution in a laboratory-scale 3-D sand box using about 6 million transient tracer concentration measurements obtained using magnetic resonance imaging. Since each individual observation has little information on the K distribution, the data was compressed by the zero-th temporal moment of breakthrough curves, which is equivalent to the mean travel time under the experimental setting. Moreover, only about 2,000 forward simulations in total were required to obtain the best estimate with corresponding estimation uncertainty, and the estimated K field captured key patterns of the original packing design, showing the efficiency and effectiveness of the proposed method. This article is protected by copyright. All rights reserved.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets

Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics implementation and numerical approximations across different simulation suites, models trained on data from one cosmological simulation show a drop in performance when tested on another. Similarly, models trained on any of the simulations would also likely experience a drop in performance when applied to observational data. Training on data from two different suites of the CAMELS hydrodynamic cosmological simulations, we examine the generalization capabilities of Domain Adaptive Graph Neural Networks (DA-GNNs). By utilizing GNNs, we capitalize on their capacity to capture structured scale-free cosmological information from galaxy distributions. Moreover, by including unsupervised domain adaptation via Maximum Mean Discrepancy (MMD), we enable our models to extract domain-invariant features. We demonstrate that DA-GNN achieves higher accuracy and robustness on cross-dataset tasks. Using data visualizations, we show the effects of domain adaptation on proper latent space data alignment. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.

79 ASTRONOMY AND ASTROPHYSICS↗

Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets

Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics implementation and numerical approximations across different simulation suites, models trained on data from one cosmological simulation show a drop in performance when tested on another. Similarly, models trained on any of the simulations would also likely experience a drop in performance when applied to observational data. Training on data from two different suites of the CAMELS hydrodynamic cosmological simulations, we examine the generalization capabilities of Domain Adaptive Graph Neural Networks (DA-GNNs). By utilizing GNNs, we capitalize on their capacity to capture structured scale-free cosmological information from galaxy distributions. Moreover, by including unsupervised domain adaptation via Maximum Mean Discrepancy (MMD), we enable our models to extract domain-invariant features. We demonstrate that DA-GNN achieves higher accuracy and robustness on cross-dataset tasks (up to $28\%$ better relative error and up to almost an order of magnitude better $\chi^2$). Using data visualizations, we show the effects of domain adaptation on proper latent space data alignment. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.

79 ASTRONOMY AND ASTROPHYSICS↗

Renormalization group computation of likelihood functions for cosmological data sets

I show how a renormalization group (RG) method can be used to incrementally integrate the information in cosmological large-scale structure data sets (including CMB, galaxy redshift surveys, etc.). I show numerical tests for Gaussian fields, where the method allows arbitrarily close to exact computation of the likelihood function in order N time, even for problems with no symmetry, compared to N 3 for brute force linear algebra (where N is the number of data points - to be fair, methods already exist to solve the Gaussian problem in at worst N log N time, and this method will not necessarily be faster in practice). The method requires no sampling or other Monte Carlo (random) element. Nonlinearity/non-Gaussianity can be accounted for to the extent that terms generated by integrating out small scale modes can be projected onto a sufficient basis, e.g., at least in the sufficiently perturbative regime. The formulas to evaluate are straightforward and require no understanding of quantum field theory, but this paper may also serve as a pedagogical introduction to Wilsonian RG for astronomers.

79 ASTRONOMY AND ASTROPHYSICS↗

Parallel membership queries on very large scientific data sets using bitmap indexes

© 2019 John Wiley & Sons, Ltd. Many scientific applications produce very large amounts of data as advances in hardware fuel computing and experimental facilities. Managing and analyzing massive quantities of scientific data is challenging as data are often stored in specific formatted files, such as HDF5 and NetCDF, which do not offer appropriate search capabilities. In this research, we investigated a special class of search capability, called membership query, to identify whether queried elements of a set are members of an attribute. Attributes that naturally have classification values appear frequently in scientific domains such as category and object type as well as in daily life such as zip code and occupation. Because classification attribute values are discrete and require random data access, performing a membership query on a large scientific data set creates challenges. We applied bitmap indexing and parallelization to membership queries to overcome these challenges. Bitmap indexing provides high performance not only for low cardinality attributes but also for high cardinality attributes, such as floating-point variables, electric charge, or momentum in a particle physics data set, due to compression algorithms such as Word-Aligned Hybrid. We conducted experiments, in a highly parallelized environment, on data obtained from a particle accelerator model and a synthetic data set.

Yildiz, Beytullah↗

Technologies for node-degree based clustering of data sets

Technologies for node-degree based clustering include a computing device to construct a graph that includes multiple vertices corresponding to the data points of a data set. The computing device inserts an edge between each pair of vertices that has a corresponding similarity metric that meets a predetermined threshold similarity metric. The computing device determines a node degree for each vertex in the graph and initializes a cutoff node degree as the lowest node degree of the vertices. The computing device selects a test subset of the graph that includes vertices having a node degree less than or equal to the cutoff node degree. The computing device determines whether the test subset covers the graph and if not increases the cutoff node degree. If the test subset covers the graph, the data points corresponding to the vertices of the test subset are the representative cluster. Other embodiments are described and claimed.

Sitik, Ahmet Can↗