Experiences developing large-scale synthetic U.S.-style distribution test systems
Not Available
Palmintier, Bryan (ORCID:0000000214520715)↗
SEARCH · Engineering Papers
Results for “large data sets”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Observed and Projected Changes of Large‐Scale Environments Conducive to Spring MCS Initiation Over the US Great Plains
Abstract Mesoscale convective systems (MCSs) are frequent over the US Great Plains during spring. The link between large‐scale environments and spring MCS initiation were well established. Here, historical and future changes of spring large‐scale environments favorable for MCS initiation are investigated using an MCS tracking data set, ERA5 reanalysis, and 20 Coupled Model Intercomparison Project Phase 6 (CMIP6) models. The frequency of Great Plains low‐level jet (GPLLJ)‐related MCS environments is found to have increased by ∼41% from 1979 to 2019, consistent with the enhanced GPLLJ and more frequent MCSs. Comparing CMIP6 AMIP and historical experiments, we find that the observed GPLLJ strengthening and more frequent MCS environments are mainly due to the decadal sea‐surface temperature variations rather than external forcings. Under a high emission scenario, the frequency of GPLLJ‐related environments favorable for MCS initiation will increase by ∼65% during 2015–2100, along with a stronger GPLLJ, suggesting more frequent MCSs over the US Great Plains in a warming world.
54 ENVIRONMENTAL SCIENCES↗
Compressing deep neural networks on FPGAs to binary and ternary precision with hls4ml
We present the implementation of binary and ternary neural networks in the hls4ml library, designed to automatically convert deep neural network models to digital circuits with FPGA firmware. Starting from benchmark models trained with floating point precision, we investigate different strategies to reduce the network's resource consumption by reducing the numerical precision of the network parameters to binary or ternary. We discuss the trade-off between model accuracy and resource consumption. In addition, we show how to balance between latency and accuracy by retaining full precision on a selected subset of network components. As an example, we consider two multiclass classification tasks: handwritten digit recognition with the MNIST data set and jet identification with simulated proton-proton collisions at the CERN Large Hadron Collider. The binary and ternary implementation has similar performance to the higher precision implementation while using drastically fewer FPGA resources.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Importance of kernel bandwidth in quantum machine learning
Quantum kernel methods are considered a promising avenue for applying quantum computers to machine learning problems. Identifying hyperparameters controlling the inductive bias of quantum machine learning models is expected to be crucial given the central role hyperparameters play in determining the performance of classical machine learning methods. In this work we introduce the hyperparameter controlling the bandwidth of a quantum kernel and show that it controls the expressivity of the resulting model. We use extensive numerical experiments with multiple quantum kernels and classical data sets to show consistent change in the model behavior from underfitting (bandwidth too large) to overfitting (bandwidth too small), with optimal generalization in between. We draw a connection between the bandwidth of classical and quantum kernels and show analogous behavior in both cases. Furthermore, we show that optimizing the bandwidth can help mitigate the exponential decay of kernel values with qubit count, which is the cause behind recent observations that the performance of quantum kernel methods decreases with qubit count. Here, we reproduce these negative results and show that if the kernel bandwidth is optimized, the performance instead improves with growing qubit count and becomes competitive with the best classical methods.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Co-flow injection for serial crystallography at X-ray free-electron lasers
Serial femtosecond crystallography (SFX) is a powerful technique that exploits X-ray free-electron lasers to determine the structure of macromolecules at room temperature. Despite the impressive exposition of structural details with this novel crystallographic approach, the methods currently available to introduce crystals into the path of the X-ray beam sometimes exhibit serious drawbacks. Samples requiring liquid injection of crystal slurries consume large quantities of crystals (at times up to a gram of protein per data set), may not be compatible with vacuum configurations on beamlines or provide a high background due to additional sheathing liquids present during the injection. Proposed and characterized here is the use of an immiscible inert oil phase to supplement the flow of sample in a hybrid microfluidic 3D-printed co-flow device. Co-flow generation is reported with sample and oil phases flowing in parallel, resulting in stable injection conditions for two different resin materials experimentally. A numerical model is presented that adequately predicts these flow-rate conditions. The co-flow generating devices reduce crystal clogging effects, have the potential to conserve protein crystal samples up to 95% and will allow degradation-free light-induced time-resolved SFX.
3D printing↗
A Reconfigurable Planar Capacitor Sensor for Thru the Jacket Dielectric Constant Measurement of Cable Insulation
Planar capacitor sensors have been proposed to measure the aging-related dielectric constant variation of the jacket or insulation materials of cables. Although capacitor sensors have been used to monitor the aging of cable insulation by removing the jacket, through the jacket measurement of cable insulation dielectric constant variation is difficult because once the sensor is placed on the jacket it would either measure the aging of the jacket or that of the jacket and insulation together. A reconfigurable sensor along with innovative cable-specific models could be used to determine the jacket and insulation aging using the same sensor. For the proposed novel reconfigurable sensor, the electric field penetration depth is changed by activating and deactivating PIN diode switches. In one instance, the sensor measures the dielectric constant variation of the jacket, while in the next, it measures the dielectric constant variation of both the jacket and the insulation. Here, by leveraging previously developed capacitance estimation models from large-scale finite element simulations for a specific cable, these two sets of measurement data are used to evaluate the aging-related dielectric constant variation of the insulation. Experimental data from aged cable specimens are presented to demonstrate the operation of the sensor.
47 OTHER INSTRUMENTATION↗
A scalable, open-source implementation of a large-scale mechanistic model for single cell proliferation and death signaling
Mechanistic models of how single cells respond to different perturbations can help integrate disparate big data sets or predict response to varied drug combinations. However, the construction and simulation of such models have proved challenging. Here, we developed a python-based model creation and simulation pipeline that converts a few structured text files into an SBML standard and is high-performance- and cloud-computing ready. We applied this pipeline to our large-scale, mechanistic pan-cancer signaling model (named SPARCED) and demonstrate it by adding an IFNγ pathway submodel. We then investigated whether a putative crosstalk mechanism could be consistent with experimental observations from the LINCS MCF10A Data Cube that IFNγ acts as an anti-proliferative factor. The analyses suggested this observation can be explained by IFNγ-induced SOCS1 sequestering activated EGF receptors. This work forms a foundational recipe for increased mechanistic model-based data integration on a single-cell level, an important building block for clinically-predictive mechanistic models.
60 APPLIED LIFE SCIENCES↗
Attribution of the role of climate change in the forest fires in Sweden 2018
In this study, we analyse the role of climate change in the forestfires that raged through large parts of Sweden in the summer of 2018 from ameteorological perspective. This is done by studying the Canadian FireWeather Index (FWI) based on sub-daily data, both in reanalysis data sets(ERA-Interim, ERA5, the Japanese 55 year Reanalysis, JRA-55, and Modern-Era Retrospective analysis for Research and Applications version 2, MERRA-2) and three large-ensemble climatemodels (EC-Earth, weather@home, W@H, and Community Earth System Model, CESM) simulations. The FWI, based on reanalysis, correlates well with the observed burnt area in summer (r=0.6 to 0.8). We find that the maximum FWI in July 2018 had return times of ~24 years (90 % CI, confidence interval, > 10 years) for southern and northern Sweden. Furthermore, we find a negative trend of the FWI for southern Sweden over the 1979 to 2017 time period in the reanalyses, yielding a non-significant reduced probability of such an event. However, the short observational record, large uncertainty between the reanalysis products and large natural variability of the FWI give a large confidence interval around this number that easily includes no change, so we cannot draw robust conclusions from reanalysis data. The three large-ensembles with climate models point to a roughly 1.1 (0.9 to 1.4) times increased probability (non-significant) for such events in the current climate relative to preindustrial climate. For a future climate (2 °C warming), we find a roughly 2 (1.5 to 3) times increased probability for such events relative to the preindustrial climate. The increased fire weather risk is mainly attributed to the increase intemperature. The other main factor, i.e. precipitation during summer months, isprojected to increase for northern Sweden and decrease for southern Sweden. We, however, do not find a clear change in prolonged dry periods in summer months that could explain the increased fire weather risk in the climate models. In summary, we find a (non-significant) reduced probability of such eventsbased on reanalyses, a small (non-significant) increased probability due to global warming up to now and a more robust (significant) increase in the risk for such events in the future based on the climate models.
54 ENVIRONMENTAL SCIENCES↗
Evaluating Large‐Storm Dominance in High‐Resolution GCMs and Observations Across the Western Contiguous United States
Abstract Extreme precipitation events are projected to increase in frequency across much of the land‐surface as the global climate warms, but such projections have typically relied on coarse‐resolution (100–250 km) general circulation models (GCMs). The ensemble of HighResMIP GCMs presents an opportunity to evaluate how a more finely resolved atmosphere and land‐surface might enhance the fidelity of the simulated contribution of large‐magnitude storms to total precipitation, particularly across topographically complex terrain. Here, the simulation of large‐storm dominance, that is, the number of wettest days to reach half of the total annual precipitation, is quantified across the western United States (WUS) using four GCMs within the HighResMIP ensemble and their coarse resolution counterparts. Historical GCM simulations (1950–2014) are evaluated against a baseline generated from station‐observed daily precipitation (4,803 GHCN‐D stations) and from three gridded, observationally based precipitation data sets that are coarsened to match the resolution of the GCMs. All coarse‐resolution simulations produce less large‐storm dominance than in observations across the WUS. For two of the four GCMs, bias in the median large‐storm dominance is reduced in the HighResMIP simulation, decreasing by as much as 62% in the intermountain west region. However, the other GCMs show little change or even an increase (+28%) in bias of median large‐storm dominance across multiple sub‐regions. The spread in differences with resolution amongst GCMs suggests that, in addition to resolution, model structure and parameterization of precipitation generating processes also contribute to bias in simulated large‐storm dominance.
Environmental Sciences & Ecology↗
A filter-dependent granular temperature model from large-scale CFD-DEM data
The computational study of strongly-coupled, gas–solid flows at scales relevant to most environmental and engineering applications requires the use of ‘coarse-grained’ methodologies such as the two-fluid model, particle-in-cell approach or the multiphase Reynolds Averaged Navier–Stokes equations. While these strategies enable computations at desirable length- and time-scales, they rely heavily on models to capture important flow physics that occur at scales smaller than the mesh. To date, the models that do exist are based on a limited set of flow conditions, such as very dilute particle phase. To this end, we leverage a large-scale repository of CFD-DEM data to develop filter-size dependent models for the mean variance in particle volume fraction, a quantity commonly used to assess the degree of clustering, and the granular temperature, a key quantity for accurately predicting gas–solid flows. In conclusion, because of its filter-size dependence, the granular temperature model can be directly translated to coarse-grained approaches and tied directly to grid size.
AMReX↗
Mitigating Catastrophic Forgetting in Deep Learning in a Streaming Setting Using Historical Summary
Recent advancements in scientific equipment and the adaptation of electronics and the Internet of Things (IoT) in our everyday lives resulted in large and complex data production at a high rate. Making meaningful and timely knowledge discovery at a modest cost from this big data is difficult for computing power and storage limitations. Training deep learning models incrementally in a streaming setting can help us with overcoming these limitations. However, in a well-known phenomenon named catastrophic forgetting, incrementally trained models increasingly perform poorly on the past data. To mitigate catastrophic forgetting in training in a streaming setting, we propose constructing a historical summary over time and use the summary with newly arrived data during incremental training. We propose various data summarization techniques such as random sampling, micro clustering, coreset computation, and Auto Encoders to counteract catastrophic forgetting. We built a pipeline for incremental training with a historical summary for training deep learning models for streaming data. We demonstrate the effectiveness of historical summary in mitigating catastrophic forgetting using three case studies involving three different deep learning applications: an Artificial Neural Network (ANN) for classification task on MNIST dataset, a language model (RNN-LM) on the WikiText2 dataset, and a Convolutional Neural Network (CNN), ResNet50 to classify the ImageNet dataset. Through the training of the models, we observe that catastrophic forgetting is evident in ANN and CNN but not in an RNN. For the first task, our method recovers up to 47.9% lost accuracy due to catastrophic forgetting. For the third task, the historical summary recovers classification accuracy by up to 25%. For the second task, though there is not proof of catastrophic forgetting, the training performance (PPL) improves by up to 26% with historical summary.
Dash, Sajal↗
Measurement of the production cross section of prompt $ {\Xi}_{\mathrm{c}}^0 $ baryons at midrapidity in pp collisions at $ \sqrt{s} $ = 5.02 TeV
The transverse momentum (p T ) differential cross section of the charm-strange baryon $ {\Xi}_{\mathrm{c}}^0 $ is measured at midrapidity (|y| < 0.5) via its semileptonic decay into e + Ξ - ν e in pp collisions at $\sqrt{s}$ = 5.02 TeV with the ALICE detector at the LHC. The ratio of the p T -differential $ {\Xi}_{\mathrm{c}}^0 $-baryon and D 0 -meson production cross sections is also reported. The measurements are compared with simulations with different tunes of the PYTHIA 8 event generator, with predictions from a statistical hadronisation model (SHM) with a largely augmented set of charm-baryon states beyond the current lists of the Particle Data Group, and with models including hadronisation via quark coalescence. The p T -integrated cross section of prompt $ {\Xi}_{\mathrm{c}}^0 $-baryon production at midrapidity is also reported, which is used to calculate the baryon-to-meson ratio $ {\Xi}_{\mathrm{c}}^0 $/D 0 = 0.20 ± 0.04 (stat.)$^{+0.08}_{-0.07}$ (syst.). These results provide an additional indication of a modification of the charm fragmentation from e + e - and e - p collisions to pp collisions.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Interactions Between the Amazonian Rainforest and Cumuli Clouds: A Large‐Eddy Simulation, High‐Resolution ECMWF, and Observational Intercomparison Study
Abstract The explicit coupling at meter and second scales of vegetation's responses to the atmospheric‐boundary layer dynamics drives a dynamic heterogeneity that influences canopy‐top fluxes and cloud formation. Focusing on a representative day during the Amazonian dry season, we investigate the diurnal cycle of energy, moisture and carbon dioxide at the canopy top, and the transition from clear to cloudy conditions. To this end, we compare results from a large‐eddy simulation technique, a high‐resolution global weather model, and a complete observational data set collected during the GoAmazon14/15 campaign. The overall model‐observation comparisons of radiation and canopy‐top fluxes, turbulence, and cloud dynamics are very satisfactory, with all the modeled variables lying within the standard deviation of the monthly aggregated observations. Our analysis indicates that the timing of the change in the daylight carbon exchange, from a sink to a source, remains uncertain and is probably related to the stomata closure caused by the increase in vapor pressure deficit during the afternoon. We demonstrate quantitatively that heat and moisture transport from the subcloud layer into the cloud layer are misrepresented by the global model, yielding low values of specific humidity and thermal instability above the cloud base. Finally, the numerical simulations and observational data are adequate settings for benchmarking more comprehensive studies of plant responses, microphysics, and radiation.
Vilà‐Guerau de Arellano, J.↗
Deep Learning Advances Arctic River Water Temperature Predictions
The accelerated warming in the Arctic poses serious risks to freshwater ecosystems by altering streamflow and river thermal regimes. However, limited research on Arctic River water temperatures exists due to data scarcity and the absence of robust methodologies, which often focus on large, major river basins. To address this, we leveraged the newly released, extensive AKTEMP data set and advanced machine learning techniques to develop a Long Short-Term Memory (LSTM) model. By incorporating ERA5-Land reanalysis data and integrating physical understanding into data-driven processes, our model advanced river water temperature predictions in ungauged, snow- and permafrost-affected basins in Alaska. Our model outperformed existing approaches in high-latitude regions, achieving a median Nash-Sutcliffe Efficiency of 0.95 and root mean squared error of 1.0°C. The LSTM model learned air temperature, soil temperature, solar radiation, and thermal radiation—factors associated with energy balance—were the most important drivers of river temperature dynamics. Soil moisture and snow water equivalent were highlighted as critical factors representing key processes such as thawing, melting, and groundwater contributions. Glaciers and permafrost were also identified as important covariates, particularly in seasonal river water temperature predictions. Our LSTM model successfully captured the complex relationships between hydrometeorological factors and river water temperatures across varying timescales and hydrological conditions. This scalable and transferable approach can be potentially applied across the Arctic, offering valuable insights for future conservation and management efforts.
54 ENVIRONMENTAL SCIENCES↗
Transfer learning for analysis of collective and non-collective Thomson scattering spectra
Thomson scattering (TS) diagnostics provide reliable, minimally perturbative measurements of fundamental plasma parameters, such as electron density (n e ) and electron temperature (T e ). Deep neural networks can provide accurate estimates of n e and T e when conventional fitting algorithms may fail, such as when TS spectra are dominated by noise, or when fast analysis is required for real-time operation. Although deep neural networks typically require large training sets, transfer learning can improve model performance on a target task with limited data by leveraging pre-trained models from related source tasks, where select hidden layers are further trained using target data. We present five architecturally diverse deep neural networks, pre-trained on synthetic TS data and adapted for experimentally measured TS data, to evaluate the efficacy of transfer learning in estimating n e and T e in both the collective and non-collective scattering regimes. We evaluate errors in n e and T e estimates as a function of training set size for models trained with and without transfer learning, and we observe decreases in model error from transfer learning when the training set contains ≲ 200 experimentally measured spectra.
Artificial neural networks↗
Nearest neighbour distributions: New statistical measures for cosmological clustering
ABSTRACT The use of summary statistics beyond the two-point correlation function to analyse the non-Gaussian clustering on small scales, and thereby, increasing the sensitivity to the underlying cosmological parameters, is an active field of research in cosmology. In this paper, we explore a set of new summary statistics – the k-Nearest Neighbour Cumulative Distribution Functions (kNN-CDF). This is the empirical cumulative distribution function of distances from a set of volume-filling, Poisson distributed random points to the k-nearest data points, and is sensitive to all connected N-point correlations in the data. The kNN-CDF can be used to measure counts in cell, void probability distributions, and higher N-point correlation functions, all using the same formalism exploiting fast searches with spatial tree data structures. We demonstrate how it can be computed efficiently from various data sets – both discrete points, and the generalization for continuous fields. We use data from a large suite of N-body simulations to explore the sensitivity of this new statistic to various cosmological parameters, compared to the two-point correlation function, while using the same range of scales. We demonstrate that the use of kNN-CDF improves the constraints on the cosmological parameters by more than a factor of 2 when applied to the clustering of dark matter in the range of scales between 10 and $40\, h^{-1}\, {\rm Mpc}$. We also show that relative improvement is even greater when applied on the same scales to the clustering of haloes in the simulations at a fixed number density, both in real space, as well as in redshift space. Since the kNN-CDF are sensitive to all higher order connected correlation functions in the data, the gains over traditional two-point analyses are expected to grow as progressively smaller scales are included in the analysis of cosmological data, provided the higher order correlation functions are sensitive to cosmology on the scales of interest.
79 ASTRONOMY AND ASTROPHYSICS↗
Big Data Analytic for Cascading Failure Analysis
With the challenges of increased grid dynamics and more variability of power generation from renewable energy sources, rapidly increasing complexity in the grid model, and abundant data from measurements and simulations, the requirements for computational analysis have also increased dramatically. Power system operators and engineers need to analyze more scenarios, extract meaningful information from a larger set of data, and respond more quickly when faced with these new challenges for large-scale applications, such as contingency analysis. This paper proposes a novel big data analysis approach for power system cascading analysis, prevention, and remediation. The developed techniques will be capable of cascading analysis, better assessment of the system’s vulnerability level, as well as proposing potential remediation. Case studies using IEEE 118-bus system and a 500-bus system, with a comparison against a commercial tool, validate the advantages of the developed big data approach: accurate prediction, and more importantly, faster and effective correction actions.The developed techniques could be further used for other power system applications.
big data, cascading analysis, corrective action, m↗
Manifold Learning: What, How, and Why
Manifold learning (ML), also known as nonlinear dimension reduction, is a set of methods to find the low-dimensional structure of data. Dimension reduction for large, high-dimensional data is not merely a way to reduce the data; the new representations and descriptors obtained by ML reveal the geometric shape of high-dimensional point clouds and allow one to visualize, denoise, and interpret them. This review presents the underlying principles of ML, its representative methods, and their statistical foundations, all from a practicing statistician's perspective. It describes the trade-offs and what theory tells us about the parameter and algorithmic choices we make in order to obtain reliable conclusions.
Mathematics↗