Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Fitting a deep generative hadronization model

Hadronization is a critical step in the simulation of high-energy particle and nuclear physics experiments. As there is no first principles understanding of this process, physically-inspired hadronization models have a large number of parameters that are fit to data. Deep generative models are a natural replacement for classical techniques, since they are more flexible and may be able to improve the overall precision. Proof of principle studies have shown how to use neural networks to emulate specific hadronization when trained using the inputs and outputs of classical methods. However, these approaches will not work with data, where we do not have a matching between observed hadrons and partons. In this paper, we develop a protocol for fitting a deep generative hadronization model in a realistic setting, where we only have access to a set of hadrons in data. Our approach uses a variation of a Generative Adversarial Network with a permutation invariant discriminator. We find that this setup is able to match the hadronization model in Herwig with multiple sets of parameters. This work represents a significant step forward in a longer term program to develop, train, and integrate machine learning-based hadronization models into parton shower Monte Carlo programs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Residuals-based distributionally robust optimization with covariate information

We consider data-driven approaches that integrate a machine learning prediction model within distributionally robust optimization (DRO) given limited joint observations of uncertain parameters and covariates. Our framework is flexible in the sense that it can accommodate a variety of regression setups and DRO ambiguity sets. We investigate asymptotic and finite sample properties of solutions obtained using Wasserstein, sample robust optimization, and phi-divergence-based ambiguity sets within our DRO formulations, and explore cross-validation approaches for sizing these ambiguity sets. Through numerical experiments, we validate our theoretical results, study the effectiveness of our approaches for sizing ambiguity sets, and illustrate the benefits of our DRO formulations in the limited data regime even when the prediction model is misspecified.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Fouling modeling and prediction approach for heat exchangers using deep learning

In this article, we develop a generalized and scalable statistical model for accurate prediction of fouling resistance using commonly measured parameters of industrial heat exchangers. This prediction model is based on deep learning where a scalable algorithmic architecture learns non-linear functional relationships between a set of target and predictor variables from large number of training samples. Here, the efficacy of this modeling approach is demonstrated for predicting fouling in an analytically modeled cross-flow heat exchanger, designed for waste heat recovery from flue-gas using room temperature water. The performance results of the trained models demonstrate that the mean absolute prediction errors are under 10 –4 KW –1 for flue-gas side, water side and overall fouling resistances. The coefficients of determination (R 2 ), which characterize the goodness of fit between the predictions and observed data, are over 99%. Even under varying levels of measurement noise in the inputs, we demonstrate that predictions over an ensemble of multiple neural networks achieves better accuracy and robustness to noise. We find that the proposed deep-learning fouling prediction framework learns to follow heat exchanger flow and heat transfer physics, which we confirm using locally interpretable model agnostic explanations around randomly selected operating points. Overall, we provide a robust algorithmic framework for fouling prediction that can be generalized and scaled to various types of industrial heat exchangers.

42 ENGINEERING↗
DOE OSTI2023

On the Scaling and Growth Limit of Fluvial Dunes

Abstract Bedforms emerge in a variety of shapes and sizes when a granular erodible surface is subject to a strong enough shear flow, as observed in topographic data from submarine canyons, rivers, deserts, and planetary bodies. The two salient features of bedforms are the ability to collectively transport particles, and to generate form drag thus increasing flow resistance. These two mechanisms are in competition and contribute to force bedforms of increasing size migrating more slowly. In a dedicated large‐scale open channel flow facility, hierarchies of fluvial bedforms were generated and measured in equilibrium conditions. The corresponding scale‐dependent migration velocity and mass flux contributions were quantified in the wave number and frequency domains. Experimental results are paired with a validated set of theoretical models to demonstrate that ripples or dunes reach an equilibrium state when drag partitioning ensures high enough frictional drag to sustain the bedload transport of sediment, and low enough form drag to enable the migration of the largest bedform size. This mechanism is inferred to constrain the growth of bedforms when sediment supply is not the limiting factor.

58 GEOSCIENCES↗
DOE OSTI2024

A Data-Driven Framework for Power System Event Type Identification via Safe Semi-Supervised Techniques

Herein this paper investigates the use of phasor measurement unit (PMU) data with deep learning techniques to construct real-time event identification models for transmission networks. Increasing penetration of distributed energy resources represents a great opportunity to achieve decarbonization, as well as challenges in systematic situational awareness. When high-resolution PMU data and sufficient manually recorded event labels are available, the power event identification problem is defined as a statistical classification problem that can be solved by numerous cutting-edge classifiers. However, in real grids, collecting tremendous high-quality event labels is quite expensive. Utilities frequently have a large number of event records without in-depth details (i.e., unlabeled events). To bridge this gap, we propose a novel semi-supervised learning-based method to improve the performance of event classifiers trained with a limited number of labeled events by exploiting the information from massive unlabeled events. In other words, compared to existing data-driven methods, our method requires only a small portion of labeled data to achieve a similar level of accuracy. Meanwhile, this work discusses and addresses the performance degradation caused by class distribution mismatch between the training set and the real applications. Based on the proposed safe learning mechanism, our model does not directly use all unlabeled events during model training, but selectively uses them through a comprehensive evaluation procedure. Numerical studies on a sizable PMU dataset have been used to validate the performance of the proposed method.

42 ENGINEERING↗
DOE OSTI2025

Simulation-Based Inference for Neutrino Interaction Model Parameter Tuning

High-energy physics experiments studying neutrinos rely heavily on simulations of their interactions with atomic nuclei. Limitations in the theoretical understanding of these interactions typically necessitate ad hoc tuning of simulation model parameters to data. Traditional tuning methods for neutrino experiments have largely relied on simple algorithms for numerical optimization. While adequate for the modest goals of initial efforts, the complexity of future neutrino tuning campaigns is expected to increase substantially, and new approaches will be needed to make progress. In this paper, we examine the application of simulation-based inference (SBI) to the neutrino interaction model tuning for the first time. Using a previous tuning study performed by the MicroBooNE experiment as a test case, we find that our SBI algorithm can correctly infer the tuned parameter values when confronted with a mock data set generated according to the MicroBooNE procedure. This initial proof-of-principle illustrates a promising new technique for next-generation simulation tuning campaigns for the neutrino experimental community.

Tame-Narvaez, Karla Maria [Fermilab]↗
DOE OSTI2020

A Visual Analytics Framework for Reviewing Streaming Performance Data

Understanding and tuning the performance of extreme-scale parallel computing systems demands a streaming approach due to the computational cost of applying offline algorithms to vast amounts of performance log data. Analyzing large streaming data is challenging because the rate of receiving data and limited time to comprehend data make it difficult for the analysts to sufficiently examine the data without missing important changes or patterns. To support streaming data analysis, we introduce a visual analytic framework comprising of three modules: data management, analysis, and interactive visualization. The data management module collects various computing and communication performance metrics from the monitored system using streaming data processing techniques and feeds the data to the other two modules. The analysis module automatically identifies important changes and patterns at the required latency. In particular, we introduce a set of online and progressive analysis methods for not only controlling the computational costs but also helping analysts better follow the critical aspects of the analysis results. Finally, the interactive visualization module provides the analysts with a coherent view of the changes and patterns in the continuously captured performance data. Through a multi-faceted case study on performance analysis of parallel discrete-event simulation, we demonstrate the effectiveness of our framework for identifying bottlenecks and locating outliers.

Human-centered computing↗
DOE OSTI2022

Benchmarking intra-nuclear cascade models for neutrino scattering with relativistic optical potentials

The description of final-state interactions (FSI) in the large phase space probed in neutrino experiments poses a great challenge. In neutrino experiments, which operate under semi-inclusive conditions, cascade models are commonly used for this task, while under exclusive conditions FSI can be treated with relativistic optical potentials (ROP). We formulate conditions under which the ROP approach and cascade model can be directly compared. We feed the NEUT cascade with events from a relativistic distorted-wave impulse approximation calculation that uses the real part of an optical potential. Cuts on the missing energy of the resulting events are applied to define a set of events that can be directly compared to RDWIA calculations with the full optical potential. The NEUT cascade and ROP agree for proton kinetic energies $T_p > 150$ MeV for carbon, oxygen and calcium nuclei when a realistic nuclear density is used to introduce events in the cascade. For $T_p < 100$ MeV the ROP and NEUT cross sections differ in shape and differences in magnitude are larger than 50 %. Single transverse variables allow to distinguish different approaches to FSI, but due to a large non-QE contribution the comparison to T2K data does not give an unambiguous view of FSI. We discuss electron scattering and argue that with a cut in missing energy FSI can be studied with minimal confounding factors in e.g. $e4\nu$. The agreement of the ROP and NEUT for T2K conditions lends confidence to these models as a tool in oscillation analyses for sufficiently large nucleon kinetic energies. These results urge for caution when a cascade model is applied for small nucleon energies. The assessment of model assumptions relevant to this region are strongly encouraged. This paper provides novel constraints on cascade models from proton-nucleus scattering that can be easily applied to other neutrino event generators.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Impact of Varying Dark Energy on Future Large-Scale Structure Studies

The cosmos withholds multiple mysteries such as dark forms of matter and energy that are yet beyond human comprehension. In the standard cosmological model, $\Lambda$CDM, the cosmological constant $\Lambda$ is thought to be responsible for the late accelerated expansion of the Universe. However, recent results from the Dark Energy Spectroscopic Instrument (DESI) suggest the possibility of evolving dark energy, which warrants further exploration. Future surveys such as the Rubin Observatory Legacy Survey of Space and Time (LSST) will map the large-scale structure (LSS) with unprecedented precision, giving us valuable statistical information about the cosmos. The goal of this research is to investigate the potential impact of an evolving dark energy scenario on cosmological parameters constrained by LSS probes, as will be mapped by the LSST. For this, we examine the power spectra of lens galaxies, source galaxies, and cross-power spectra between lens galaxies and source galaxies. The combination of these statistics is commonly referred to as '3 $\times$ 2 points'. For this investigation, we created a set of simulations resembling LSST data and used them to perform cosmological parameter inference in two scenarios: one in which the simulated data is based on the fiducial model and another on evolving dark energy. We then examined the degeneracy between the cosmological parameters and checked for potential shifts in the parametric space when the data contains dynamical dark energy but the modeling assumes $\Lambda$CDM. Our findings indicate that mismodeling the dark energy equation of state can significantly impact parameter inference, particularly affecting the total matter density, $\Omega_m$, and the growth of structures, as represented by the $S_8$ parameter. These results highlight the importance of further exploring extensions of the $\Lambda$CDM model in future LSS studies.

Yaman Acharya, A.↗
DOE OSTI2025

Simulation-based inference for neutrino interaction model parameter tuning

High-energy physics experiments studying neutrinos rely heavily on simulations of their interactions with atomic nuclei. Limitations in the theoretical understanding of these interactions typically necessitate ad hoc tuning of simulation model parameters to data. Traditional tuning methods for neutrino experiments have largely relied on simple algorithms for numerical optimization. While adequate for the modest goals of initial efforts, the complexity of future neutrino tuning campaigns is expected to increase substantially, and new approaches will be needed to make progress. In this paper, we examine the application of simulation-based inference (SBI) to the neutrino interaction model tuning for the first time. Using a previous tuning study performed by the MicroBooNE experiment as a test case, we find that our SBI algorithm can correctly infer the tuned parameter values when confronted with a mock data set generated according to the MicroBooNE procedure. This initial proof-of-principle illustrates a promising new technique for next-generation simulation tuning campaigns for the neutrino experimental community.

Tame-Narvaez, Karla [Fermilab] (ORCID:000000022249↗
DOE OSTI2025

Data Centers and Digital Assurance Introduction to Supply Chain and Cybersecurity for Data Centers, Session 1

The first session of the TADA (Technical Assistance for Digital Assurance) Data Centers Cohort Workshop, held on October 30, 2025, introduced foundational concepts of Digital Assurance in the context of data center and grid integration. Sponsored by the U.S. Department of Energy, the workshop brought together utilities, data center operators, developers, and vendors to address cybersecurity and supply chain vulnerabilities. The session emphasized the growing criticality of data centers within the electric grid and the need for secure, real-time, bidirectional communication. Participants explored the principles of Digital Assurance, including cybersecurity, cyber-informed engineering (CIE), and lifecycle security, and applied a threat-vulnerability-consequence framework to identify and mitigate risks at the data center–grid interface. Discussions covered a range of threats such as spoofed dispatch signals and insider threats, architectural vulnerabilities like SCADA interfaces and insecure protocols, and potential consequences including cascading grid failures. The session also raised strategic questions about business value, vendor assurance, and defining cyber boundaries and responsibilities. This foundational workshop set the stage for deeper technical analysis and the development of actionable frameworks in subsequent sessions. Session 1 of 3.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

ContourNet: Salient Local Contour Identification for Blob Detection in Fusion Plasma Simulation Data

We present ContourNet, a deep learning approach to identify salient local isocontours as blobs in large-scale 5D gyrokinetic tokamak simulation data. Blobs-regions of high turbulence that run along the edge wall down toward the diverter and can damage the tokamak-are non-well-defined features but have been empirically localized by isocontours in 2D normalized fluctuating density fields. The key of our study is to train ContourNet to follow the empirical rules to detect blobs over the time-varying simulation data. The architecture of ContourNet is a convolutional neural segmentation network: the inputs are the density field and a rasterized isocontour; the output is a set of isocontour encircling blobs. At the training stage, we feed the network with manually identified isocontours and propagated labels. At the inference stage, we extract isocontours from the segmented blob regions. Results show that our approach can achieve both high accuracy and performance, which enables scientists to understand the blob dynamics influencing the confinement of the plasma.

Blob detection↗
DOE OSTI2022

Large-scale paleo water-table rise in a deep desert aquifer recorded by dissolved noble gases

Illuminating past hydrological and climatological conditions in arid regions may provide insights into future trends in groundwater availability. The main objective of this study is to explore paleorecharge processes in the deep regional Nubian Sandstone Aquifer (NSA), which stretches below the hyperarid deserts of the Sinai Peninsula (Egypt) and the Negev (Israel), using dissolved noble gas data. Extremely high amounts of dissolved excess air (Ne concentrations up to 4 × solubility equilibrium) were observed in the ancient ( 81 Kr-depleted) groundwater that was recharged during past pluvial epochs in the basin. Here, the observed unique excess air signal and the clear spatiotemporal structure of the noble gas compositions in the aquifer are hypothesized to reflect two major characteristics of the groundwater system: (a) large-scale, long-term rises in the water table that facilitate the entrapment and dissolution of air bubbles under increased hydrostatic pressure, and (b) the geological settings in the southern recharge area in Sinai, including an almost horizontal position of the layers and intercalation of low-permeability rock formations within the aquifer, which inefficiently reject air bubbles from groundwater, thereby allowing for substantial entrapment of bubbles that dissolve as the water table rises. Enhanced dissolution of entrapped air was also observed in other paleo-groundwater-containing regional sandstone aquifers across North Africa, which, together with the recent findings from the NSA, suggest that largescale water table fluctuations have likely extensively occurred during past pluvial periods over these (and possibly other) arid regions. A preliminary assessment of noble gas recharge temperatures (NGTs) indicates an apparent decoupling of surface and water table temperatures in the case of deep aquifers with a thick (hundreds of m) unsaturated zone. This observed decoupling calls for a re-evaluation of previously obtained NGT records and a need for future work to consider the modification of NGTs due to soil air fractionation and geothermal heating of the underlying deep unsaturated zones.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Multi-scale integration of satellite remote sensing improves characterization of dry-season green-up in an Amazon tropical evergreen forest

In tropical forests, leaf phenology-particularly the pronounced dry-season green-up-strongly regulates biogeochemical cycles of carbon and water fluxes. However, uncertainties remain in the understanding of tropical forest leaf phenology at different spatial scales. Phenocams accurately characterize leaf phenology at the crown and ecosystem scales but are limited to a few sites and time spans of a few years. Time-series satellite observations might fill this gap, but the commonly used satellites (e.g. MODIS, Landsat and Sentinel-2) have resolutions too coarse to characterize single crowns. To resolve this observational challenge, we used the PlanetScope constellation with a 3m resolution and near daily nadir-view coverage. We first developed a rigorous method to cross-calibrate PlanetScope surface reflectance using daily BRDF-adjusted MODIS as the reference. We then used linear spectral unmixing of calibrated PlanetScope to obtain dry-season change in the fractional cover of green vegetation (GV) and non-photosynthetic vegetation (NPV) at the PlanetScope pixel level. We used the Central Amazon Tapajos National Forest k67 site, as all necessary data (from field to phenocam and satellite observations) was available. For this proof of concept, we chose a set of 22 dates of PlanetScope measurements in 2018 and 16 in 2019, all from the six drier months of the year to provide the highest possible cloud-free temporal resolution. Our results show that MODIS-calibrated dry-season PlanetScope data (1) accurately assessed seasonal changes in ecosystem-scale and crown-scale spectral reflectance; (2) detected an increase in ecosystem-scale GV fraction (and a decrease in NPV fraction) from June to November of both years, consistent with local phenocam observations with R 2 around 0.8; and (3) monitored large seasonal trend variability in crown-scale NPV fraction. Finally, our results highlight the potential of integrating multi-scale satellite observations to extend fine-scale leaf phenology monitoring beyond the spatial limits of phenocams.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Machine learning of high dimensional data on a noisy quantum processor

Abstract Quantum kernel methods show promise for accelerating data analysis by efficiently learning relationships between input data points that have been encoded into an exponentially large Hilbert space. While this technique has been used successfully in small-scale experiments on synthetic datasets, the practical challenges of scaling to large circuits on noisy hardware have not been thoroughly addressed. Here, we present our findings from experimentally implementing a quantum kernel classifier on real high-dimensional data taken from the domain of cosmology using Google’s universal quantum processor, Sycamore. We construct a circuit ansatz that preserves kernel magnitudes that typically otherwise vanish due to an exponentially growing Hilbert space, and implement error mitigation specific to the task of computing quantum kernels on near-term hardware. Our experiment utilizes 17 qubits to classify uncompressed 67 dimensional data resulting in classification accuracy on a test set that is comparable to noiseless simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Measurement of the Higgs boson width and evidence of its off-shell contributions to ZZ production

Since the discovery of the Higgs boson in 2012, detailed studies of its properties have been ongoing. Besides its mass, its width - related to its lifetime - is an important parameter. One way to determine this quantity is by measuring its off-shell production, where the Higgs boson mass is far away from its nominal value, and relating it to its on-shell production, where the mass is close to the nominal value. Here, we report evidence for such off-shell contributions to the production cross section of two Z bosons with data from the CMS experiment at the CERN Large Hadron Collider. We constrain the total rate of the off-shell Higgs boson contribution beyond the Z boson pair production threshold, relative to its standard model expectation, to the interval [0.0061, 2.0] at 95% confidence level. The scenario with no off-shell contribution is excluded at a p-value of 0.0003 (3.6 standard deviations). We measure the width of the Higgs boson as $\Gamma_{\mathrm{H}}$ = 3.2 $_{-1.7}^{+2.4}$ MeV, in agreement with the standard model expectation of 4.1 MeV. In addition, we set constraints on anomalous Higgs boson couplings to W and Z boson pairs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Close-up view of the interplay between lattice distortions and charge density waves: Case study on rare-earth nickel carbides

Using variable temperature total x-ray scattering and large-scale structure modeling, we study the temperature and composition evolution of lattice distortions and charge density waves (CDWs) in the archetypal strongly correlated system RENi⁢ C 2 (RE=Dy, Tb, Gd, and Sm). Joint analysis of reciprocal and real space data reveals the presence of strong lattice distortions that, depending on the RE species and temperature, appear periodic or remain local, forming a complex CDW phase diagram. Apparently, the CDWs in RENi⁢ C 2 materials arise from a common to the system lattice instability involving diverse distortion modes that persist when magnetic order also sets in at very low temperature. In conclusion, the results support the notion that intrinsic lattice distortions are important to the emergence of exotic electronic phases in strongly correlated systems and call for their further investigation using the advanced approach adopted here.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Summary of Savannah River Site FY23 Salt Waste Qualification Data

The Savannah River National Laboratory (SRNL) analyzed samples from Savannah River Site (SRS) Waste Tanks 41H and 21H to support qualification of Salt Waste Processing Facility (SWPF) Waste Batches 8 and 9 for processing (the FY23 Salt Batch Qualification samples). These Tanks (i.e. 41H and 21H) are blend tanks for feed to SWPF. None of the samples displayed any unusual or unexpected characteristics such as large amounts of solids, floating solids, or unusual color. Characterization of these samples confirmed similar chemical composition and characteristics to previous salt waste batches. The results for Batches 8 and 9 were provided by SRNL to Savannah River Mission Completion (SRMC), the Liquid Waste Operations subcontractor at SRS, as External Sample Results (Laboratory Information Management System (LIMS)) Reports. Additionally, a separate technical memo was issued by SRNL to report re-test data for Batch 8 for Cs-137 for filtered samples only which were run at the request of SWPF. For Batch 9, a set of samples was also analyzed in parallel by the SWPF-Analytical Laboratory (SWPF-AL). The SWPF-AL data is included herein for comparison with the SRNL data where applicable. The analytical results (both rapid, typically 4 weeks, and long term, typically 8 weeks) for Batches 8 and 9 are now summarized and discussed in this technical report.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗