Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

FRAM Isotopic Analysis of High-Resolution CZT Data [Slides]

Abstract: H3D Inc. introduced a new type of CZT detectors with resolution several times better than that of a typical CZT; The current FRAM v.6.1 can analyze uranium spectra with minimal modification of the parameter sets and get acceptable results; The exceptionally large high-energy tail of the peaks makes it difficult to achieve good uranium results and impossible to successfully analyze plutonium spectra; The FRAM code needed to be modified to better fit the high-energy tail of the peaks to analyze plutonium data and to get better uranium analysis results.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Model-free estimation of completeness, uncertainties, and outliers in atomistic machine learning using information theory

Abstract An accurate description of information is relevant for a range of problems in atomistic machine learning (ML), such as crafting training sets, performing uncertainty quantification (UQ), or extracting physical insights from large datasets. However, atomistic ML often relies on unsupervised learning or model predictions to analyze information contents from simulation or training data. Here, we introduce a theoretical framework that provides a rigorous, model-free tool to quantify information contents in atomistic simulations. We demonstrate that the information entropy of a distribution of atom-centered environments explains known heuristics in ML potential developments, from training set sizes to dataset optimality. Using this tool, we propose a model-free UQ method that reliably predicts epistemic uncertainty and detects out-of-distribution samples, including rare events in systems such as nucleation. This method provides a general tool for data-driven atomistic modeling and combines efforts in ML, simulations, and physical explainability.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Measurement of the Neutron Magnetic Form Factor at Large Momentum Transfer Using the Super-Bigbite Apparatus in Jefferson Lab Hall-A

The nucleon elastic electromagnetic form factors help us study the electromagnetic structure of the nucleon, benchmark theoretical models, and improve our understanding of non-perturbative quantum chromodynamics and confinement. The Nobel Prize-winning electron-nucleon scattering experiments by Robert Hofstadter and collaborators in the 1950s at Stanford High Energy Physics Lab were the first nucleon form factor measurements performed using leptonic probes. The Super Bigbite Spectrometer (SBS) program at Hall-A of Jefferson Lab represents the latest efforts to measure nucleon form factors. This ambitious program aims to significantly extend the current data set in terms of square momentum transfer (Q2) with high precision. The advent of novel detector technologies, like Gas Electron Multipliers (GEM), which provide excellent position resolution (< 100 ?m) while withstanding high background particle rates (several hundred MHz/cm2) over a large active area, has paved the way for open-geometry, moderate solid angle spectrometers, which are central to all form factor experiments in the SBS program. The first experimental run group in SBS ran successfully between September 2021 and February 2022, collecting data for the measurement of the magnetic form factor of the neutron Gn M at five squared momentum-transfer values: 3.0, 4.5, 7.5, 9.8, and 13.5 (GeV /c)2. This extends the existing high-precision data for Gn M by about a factor of four. The ratio technique was used, which involved the simultaneous measurement of exclusive quasielastic scattering of D(e,e?n)p and D(e,e?p)n from a deuterium target. Pre-preliminary results for D(e,e?n)p and D(e,e?p)n quasi-elastic ratio, and the neutron magnetic form factor Gn M , for Q2 points 3.0, 9.8, and 13.5 (GeV /c)2 are presented.

Mudiyanselage, Anuruddha Rathnayake↗
DOE OSTI2022

Feasibility of Adding Twitter Data to Aid Drought Depiction: Case Study in Colorado

The use of social media, such as Twitter, has changed the information landscape for citizens’ participation in crisis response and recovery activities. Given that drought progression is slow and also spatially extensive, an interesting set of questions arise, such as how the usage of Twitter by a large population may change during the development of a major drought alongside how the changing usage facilitates drought detection. For this reason, contemporary analysis of how social media data, in conjunction with meteorological records, was conducted towards improvement in the detection of drought and its progression. The research utilized machine learning techniques applied over satellite-derived drought conditions in Colorado. Three different machine learning techniques were examined: the generalized linear model, support vector machines and deep learning, each applied to test the integration of Twitter data with meteorological records as a predictor of drought development. It is found that the integration of data resources is viable given that the Twitter-based model outperformed the control run which did not include social media input. Eight of the ten models tested showed quantifiable improvements in the performance over the control run model, suggesting that the Twitter-based model was superior in predicting drought severity. Future work lies in expanding this method to depict drought in the western U.S.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A semiparametric latent factor model for large scale temporal data with heteroscedasticity

Large scale temporal data have flourished in a vast array of applications, and their sophisticated structures, especially the heteroscedasticity among subjects with inter- and intra-temporal dependence, have fueled a great demand for new statistical models. In this paper, with covariate information, we consider a flexible model for large scale temporal data with subject-specific heteroscedasticity. Formally, the model employs latent semiparametric factors to simultaneously account for the subject-specific heteroscedasticity and the contemporaneous and/or serial correlations. The subject-specific heteroscedasticity is modeled as the product of the unobserved factor process and subject’s covariate effect, which is further characterized via additive models. For estimation, we propose a two-step procedure. First, the latent factor process and nonparametric loading are recovered through projection-based methods, and following, we estimate the regression components by approaches motivated from the generalized least squares. By scrupulously examining the non-asymptotic rates for recovering the factor process and its loading, we show the consistency and efficiency of estimated regression coefficients in the absence of prior knowledge of latent factor process and subject’s covariate effect. Here, the statistical guarantees remain valid even for finite time points that makes our method particularly appealing when the subjects significantly outnumber the observation time points. Using comprehensive simulations, we demonstrate the finite sample performance of our method, which corroborates the theoretical findings. Finally, we apply our method to a data set of air quality and energy consumption collected at 129 monitoring sites in the United States in 2015.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Phase Diagrams of Alloys and Their Hydrides via On-Lattice Graph Neural Networks and Limited Training Data

Efficient prediction of sampling-intensive thermodynamic properties is needed to evaluate material performance and permit high-throughput materials modeling for a diverse array of technology applications. To alleviate the prohibitive computational expense of high-throughput configurational sampling with density functional theory (DFT), surrogate modeling strategies like cluster expansion are many orders of magnitude more efficient but can be difficult to construct in systems with high compositional complexity. We therefore employ minimal-complexity graph neural network models that accurately predict and can even extrapolate to out-of-train distribution formation energies of DFT-relaxed structures from an ideal (unrelaxed) crystallographic representation. This enables the large-scale sampling necessary for various thermodynamic property predictions that may otherwise be intractable and can be achieved with small training data sets. Two exemplars, optimizing the thermodynamic stability of low-density high-entropy alloys and modulating the plateau pressure of hydrogen in metal alloys, demonstrate the power of this approach, which can be extended to a variety of materials discovery and modeling problems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Sedimentation and Nonlinear Trapping in Texas Reservoirs Identified Using Remote Sensing and Bathymetric Survey Records

Decreasing reservoir storage capacity due to sedimentation poses great challenges to aging U.S. reservoirs, as it reduces the efficacy and reliability of their socio‐economic services. However, systematic assessments of reservoir sedimentation rates and associated issues remain limited because of sparse and infrequent bathymetry survey data. In this study, we use remote sensing‐driven estimates of sediment concentrations to identify regions experiencing rapid reservoir capacity loss, as observed in repeated bathymetry surveys. Our analysis focuses on Texas, where one of the most reliable state‐level reservoir capacity loss data sets is available through a unique long‐term monitoring program by the Texas Water Development Board. We find that reservoirs with large storage capacities and high sedimentation rate are concentrated in Northeast Texas. We also show that reduced forest, increased barren land, and erosive soil properties are co‐varying with high reservoir sedimentation rates. Temporal changes in the longitudinal gradient of the remotely sensed sediment flux highlight the nonlinear nature of sediment trapping processes, and can be used to estimate the reservoir storage capacity loss over time. In combination with standard bathymetry surveys, our approach shows potential for more cost‐effective and frequent assessment of reservoir storage loss.

Lee, Jiyong [ORNL] (ORCID:0000000198957406)↗
DOE OSTI2022

J-PLUS: Support vector machine applied to STAR-GALAXY-QSO classification

Context. In modern astronomy, machine learning has proved to be efficient and effective in mining big data from the newest telescopes. Aims. In this study, we construct a supervised machine-learning algorithm to classify the objects in the Javalambre Photometric Local Universe Survey first data release (J-PLUS DR1). Methods. The sample set is featured with 12-waveband photometry and labeled with spectrum-based catalogs, including Sloan Digital Sky Survey spectroscopic data, the Large Sky Area Multi-Object Fiber Spectroscopic Telescope, and VERONCAT – the Veron Catalog of Quasars & AGN. The performance of the classifier is presented with the applications of blind test validations based on RAdial Velocity Extension, the Kepler Input Catalog, the Two Micron All Sky Survey Redshift Survey, and the UV-bright Quasar Survey. A new algorithm was applied to constrain the potential extrapolation that could decrease the performance of the machine-learning classifier. Results. The accuracies of the classifier are 96.5% in the blind test and 97.0% in training cross-validation. The F1-scores for each class are presented to show the balance between the precision and the recall of the classifier. We also discuss different methods to constrain the potential extrapolation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Characterization of sub-picosecond laser-produced fast electrons by modeling angularly resolved bremsstrahlung measurements with 3D hybrid particle-in-cell code

Hard x-rays produced by intense laser-produced fast electrons interacting with solids are a vital source for producing radiographs of high-density objects and implosion cores for inertial confinement fusion. Accurate calculation of hard x-ray sources requires a three-dimensional (3D) simulation geometry that fully models the electron transport dynamics, including electron recirculation and the generation of absolute photon yields. To date, 3D simulations of laser-produced bremsstrahlung photons over tens of picoseconds and code benchmarking have not been performed definitively. In this study, we characterize sub-picosecond laser-produced fast electrons by modeling angularly resolved bremsstrahlung measurements for refluxing and non-refluxing targets using the 3D hybrid particle-in-cell (PIC), Large Scale Plasma code. Bremsstrahlung radiation and escaped electron data were obtained by focusing a 50-TW Leopard laser (15 J, 0.35 ps, 2 × 10 19 W/cm 2 ) on a 100-μm-thick Cu foil and a Cu with a large plastic backing (Cu–CH target). Data for both the Cu and Cu–CH targets were reproduced for simulations with a given set of electron parameters. Comparison of the simulations revealed that the hard x-ray emission from the Cu target was significantly longer in duration than that from the Cu–CH target. Here, the benchmarked hybrid PIC code could prove to be a powerful tool in the design and optimization of time- and angular-dependent bremsstrahlung sources for flash x-ray and gamma-ray radiography.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

The infrared imaging video bolometer at Wendelstein 7-X

The radiated power distribution is a crucial aspect of heat transport, heat load mitigation, and plasma exhaust performance. An imaging video bolometer camera has been installed to measure the plasma radiated power in the divertor region of the Wendelstein 7-X (W7-X) stellarator. This diagnostic offers a wide-angle (40° × 68°) sampling of the plasma volume in both the poloidal and toroidal directions. The field-of-view is covered with a large number (> 500) of bolometer channels, providing imaging capability. The diagnostic design is introduced here together with its data analysis procedure. A set of laboratory experiments is performed to assess the thermal properties of the gold absorber foil and their spatial uniformity. Following installation, a heat source originating from the inertially cooled front of the diagnostic is identified and filtered out. The discharge data indicate a satisfactory signal-to-noise ratio as well as spatiotemporal resolution. These represent the first toroidally resolved images of the line-integrated radiated power in the W7-X island divertor. The diagnostic was then upgraded with a thinner platinum absorber and adjusted mirrors. Early data from the most recent experimental campaign employing the upgraded design show a considerable improvement in the diagnostic performance with more bolometer channels (> 1400), extended coverage, and increased spatial resolution.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Progress on Machine Learning for the SNS High Voltage Converter Modulators

The High-Voltage Converter Modulators (HVCM) used to power the klystrons in the Spallation Neutron Source (SNS) linac were selected as one area to explore machine learning due to reliability issues in the past and the availability of large sets of archived waveforms. Progress in the past two years has resulted in generating a significant amount of simulated and measured data for training neural network models such as recurrent neural networks, convolutional neural networks, and variational autoencoders. Applications in anomaly detection, fault classification, and prognostics of capacitor degradation were pursued in collaboration with the Jefferson Laboratory, and early promising results were achieved. This paper will discuss the progress to date and present results from these efforts.

Pappas, Chris↗
DOE OSTI2021

The persistence of large scale structures. Part I. Primordial non-Gaussianity

Abstract We develop an analysis pipeline for characterizing the topology of large scale structure and extracting cosmological constraints based on persistent homology . Persistent homology is a technique from topological data analysis that quantifies the multiscale topology of a data set, in our context unifying the contributions of clusters, filament loops, and cosmic voids to cosmological constraints. We describe how this method captures the imprint of primordial local non-Gaussianity on the late-time distribution of dark matter halos, using a set of N-body simulations as a proxy for real data analysis. For our best single statistic, running the pipeline on several cubic volumes of size 40 (Gpc/h) 3 , we detect f NL loc =10 at 97.5% confidence on ~ 85% of the volumes. Additionally wetest our ability to resolve degeneracies betweenthe topological signature of f NL loc and variation of σ 8 and argue that correctly identifying nonzero f NL loc in this case is possible via an optimal template method. Our method relies on information living at $\mathcal{O}$(10) Mpc/h, a complementary scale with respect to commonly used methods such as the scale-dependent bias in the halo/galaxy power spectrum. Therefore, while still requiring a large volume, our method does not require sampling long-wavelength modes to constrain primordial non-Gaussianity. Moreover, our statistics are interpretable: we are able to reproduce previous results in certain limits and we make new predictions for unexplored observables, such as filament loops formed by dark matter halos in a simulation box.

Astronomy & Astrophysics↗
DOE OSTI2020

Camera settings and biome influence the accuracy of citizen science approaches to camera trap image classification

Scientists are increasingly using volunteer efforts of citizen scientists to classify images captured by motion-activated trail cameras. The rising popularity of citizen science reflects its potential to engage the public in conservation science and accelerate processing of the large volume of images generated by trail cameras. While image classification accuracy by citizen scientists can vary across species, the influence of other factors on accuracy is poorly understood. Inaccuracy diminishes the value of citizen science derived data and prompts the need for specific best-practice protocols to decrease error. We compare the accuracy between three programs that use crowdsourced citizen scientists to process images online: Snapshot Serengeti, Wildwatch Kenya, and AmazonCam Tambopata. We hypothesized that habitat type and camera settings would influence accuracy. To evaluate these factors, each photograph was circulated to multiple volunteers. All volunteer classifications were aggregated to a single best answer for each photograph using a plurality algorithm. Subsequently, a subset of these images underwent expert review and were compared to the citizen scientist results. Classification errors were categorized by the nature of the error (e.g., false species or false empty), and reason for the false classification (e.g., misidentification). Our results show that Snapshot Serengeti had the highest accuracy (97.9%), followed by AmazonCam Tambopata (93.5%), then Wildwatch Kenya (83.4%). Error type was influenced by habitat, with false empty images more prevalent in open-grassy habitat (27%) compared to woodlands (10%). For medium to large animal surveys across all habitat types, our results suggest that to significantly improve accuracy in crowdsourced projects, researchers should use a trail camera set up protocol with a burst of three consecutive photographs, a short field of view, and determine camera sensitivity settings based on in situ testing. Accuracy level comparisons such as this study can improve reliability of future citizen science projects, and subsequently encourage the increased use of such data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Ultimate Precision on Sin^2 Theta_23 With the Numi Experiments

There were two major goals to this proposal: the study of the discrepancy between data and MC in the NuMI Medium Energy neutrino beam and the incorporation of the MINOS and NOVA neutrino oscillation datasets. The first topic was approached via development of a simulation of the NuMI beam monitoring instrumentation suite. Initially, the Horn-Off current data sets were used to measure a set of hadron production parameters which improved the data/MC agreement in a way which was independent of the focusing parameters. The peak position discrepancy was only explained by a large (10kA) reduction in the horn current. A full simulation of the muon monitors was developed to attempt to make an independent measurement of the horn current by means of differential data taken by those monitors. While only at the 5kA level, the result corroborated the former findings. The second goal has not yet been completed but progress has focused on understanding how to modify the MINOS MC to take into account the MEC contribution which is missing from the underlying NEUGEN MC. A number of improvements to the MINOS reconstruction have been necessary. The framework to run the fits on the combined data has been completed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Conquering Data Chaos: Research Data Management with Kubernetes

Managing massive volumes of data and effectively making it accessible to researchers poses significant challenges and is a barrier to scientific discovery. In many cases, critical data is locked up in unwieldy file formats or one-off databases and is too large to effectively process on a single machine. This talk explores the role of Kubernetes, an open-source container orchestration platform, in addressing research data management challenges. I will discuss how we are using a set of publicly available open-source and home-grown tools in the National Renewable Energy Lab (NREL) Data, Analysis, and Visualization (DAV) group to help researchers overcome data-related bottlenecks. The talk will begin by providing an overview of the data challenges faced in research data management, including data storage, processing, and analysis. I will highlight Kubernetes' ability to handle large-scale data by leveraging containerization and distributed computing, including distributed storage. Kubernetes allows researchers to encapsulate data processing infrastructure and workflows into portable containers, enabling reproducibility and ease of deployment. Kubernetes can then schedule and manage the resource allocation of these containers to enable efficient utilization of limited computing resources, leading to more efficient data processing and analysis. I will discuss some limitations of traditional, siloed approaches to dealing with data and emphasize the need for solutions which foster collaboration. I will highlight how we are using Kubernetes at NREL to facilitate data sharing and cooperation among research teams. Kubernetes' flexible architecture enables the deployment of shared computing environments, such as Apache Superset, where researchers can seamlessly access and analyze shared datasets. Providing the ability to have one research team easily consume data generated by another, utilizing Kubernetes' as a central data platform, is one of the major wins we've encountered by adopting the platform. Finally, I will showcase real-world use cases from NREL where we have used Kubernetes to solve some persistent data challenges involving large volumes of sensor and monitoring data. I will discuss the challenges we encountered when creating our cluster and making it available as a production-ready resource. I will also discuss the specific suite of tools, including Postgres and Apache Druid for columnar and timeseries data, and Redpanda Kafka for streaming data we have deployed in our infrastructure, and the process that went into the selection of these tools.

collaborative environment↗
DOE OSTI2021

Errors introduced in fission neutron spectrum measurements using a single reference

Measurements of physical quantities are often made relative to a reference quantity, simplifying the interpretation of the measurement and its uncertainties. However, if applied without careful considerations, this technique can carry with it a significant and complex systematic error that is usually ignored. For example, measurements of continuous neutron spectra relative to a reference spectrum yield a result that does not properly include the important effects of neutron scattering in the experimental environment. These effects act to distort the measured spectrum shape and create notable errors in spectrum-integrated quantities. While this effect is one of a series of known potential sources of systematic error including, but not limited to target impurities, angular distributions, incident beam flux, and others, the error introduced from differences in environmental scattering effects between the reference and desired spectra are frequently overlooked. In this work, we demonstrate the origin of this error using simulated data corresponding to measurements of the neutron-induced prompt fission neutron spectra of 233 U, 235 U, 238 U, and 239 Pu as well as the spontaneous fission neutron spectrum of 252 Cf. Errors in the spectrum shape can be as high as 10%–15% depending on the combination of incident and outgoing neutron energy. The spectrum integral and average spectrum energy also contain errors that change with incident neutron energy and can be as high as ~2%. Although this study is based on simulated data, we also show a method for proving that this error exists in an experimental data set and we show a correction that can be applied to results of this type to obtain a more accurate result, thereby largely removing systematic errors from environmental scattering effects. The potential for these kinds of errors should be considered in measurements producing continuous neutron spectra.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Distributed Augmentation, Hypersweeps, and Branch Decomposition of Contour Trees for Scientific Exploration

Contour trees describe the topology of level sets in scalar fields and are widely used in topological data analysis and visualization. A main challenge of utilizing contour trees for large-scale scientific data is their computation at scale using highperformance computing. To address this challenge, recent work has introduced distributed hierarchical contour trees for distributed computation and storage of contour trees. However, effective use of these distributed structures in analysis and visualization requires subsequent computation of geometric properties and branch decomposition to support contour extraction and exploration. In this work, we introduce distributed algorithms for augmentation, hypersweeps, and branch decomposition that enable parallel computation of geometric properties, and support the use of distributed contour trees as query structures for scientific exploration. Finally, we evaluate the parallel performance of these algorithms and apply them to identify and extract important contours for scientific visualization.

97 MATHEMATICS AND COMPUTING↗