Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large scale analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Database-wide hazard modelling of the onset of DIII-D tearing modes with field features

The rate of onset (hazard) of tearing modes is modelled probabilistically using statistical learning algorithms. Axisymmetric energy-density equilibrium fields are taken as raw high-dimensional input features which are reduced with principal component analysis. Signal processing of non-axisymmetric magnetics fluctuation array data provides the target information from which to learn. Model selection, visualization and calibration assessment procedures are detailed. Here, the analysis is deployed at large scale across the DIII-D tokamak database. Standard model selection criteria suggest that the energy-density post-processed feature is a better choice for modelling the onset rate compared to the non-processed equilibrium reconstruction solution. Two example applications of the learned rate function are demonstrated: (i) proximity-to-onset discharge monitoring and (ii) database analysis showing an (expected) observational global trend that the general hazard increases as a plasma performance metric increases. An important connection between the hazard function and its use as a conditional probability generator is reviewed in the Appendix.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Enhancing the EVI-X National Framework to Address Emerging Questions on Charging Infrastructure Deployment

As large national investments in EV charging continue to be made, this project seeks to improve the state-of-the-art in EV infrastructure analysis. New and improved quantitative analysis capabilities will position VTO to support EERE Leadership, assist the DOT/DOE Joint Office through timely analysis, and provide a strategy for the deployment of the national charging network. This project supports on-going development of NREL's EVI-X Suite of charging infrastructure analysis tools, including tools supporting large-scale network planning, local site design decisions, and comprehensive financial analysis. EVI-X development complements and leverages other VTO-funded efforts to ensure inputs to EVI-X and output produced by EVI-X are consistent with and well-integrated into the VTO portfolio (e.g., EV adoption scenarios from TEMPO, charging infrastructure design provided to EVs@Scale, etc.).

ADVANCED PROPULSION SYSTEMS,ENERGY PLANNING, POLIC↗

De-Risking Large-Scale PV Systems Through Data Analytics

Large-scale photovoltaic system performance analysis is being conducted within the US Department of Energy's-sponsored PV Fleet Performance Data Initiative. This collaboration with commercial PV system owners collects and evaluates PV field performance data, and provides reports on aggregated results. Drawing on over 2200 sites across the US and over 24,000 separate PV inverters we have collected in excess of 8.3 gigawatts (GW) of performance data, representing 6-7% of the entire US installed PV capacity. A mixture of utility-scale and large commercial systems are represented, averaging 4.1 megawatts (MW) in size and 5 years in age. Initial results show average system degradation rates at -0.75% / year, which is slightly higher than historically reported module-level values of -0.5%/year. We also found that the availability of systems averaged 97.7%, which is lower than the typical 99% uptime assumed by many project economic forecasts. Given these results, we compared monthly performance with expected production values, based on satellite weather data and a simple PVWatts performance model. We found that systems were performing within 10% of monthly expectation over 90% of the time, with a fleet average vs expected monthly value of 0.994. We also evaluated the impact of extreme weather events on system performance, and found a range of short-term and longer-term performance effects ranging from grid outage, system downtime, module damage and accelerated long-term degradation rate.

analysis↗

The parallelism motifs of genomic data analysis

Genomic datasets are growing dramatically as the cost of sequencing continues to decline and small sequencing devices become available. Enormous community databases store and share these data with the research community, but some of these genomic data analysis problems require large-scale computational platforms to meet both the memory and computational requirements. These applications differ from scientific simulations that dominate the workload on high-end parallel systems today and place different requirements on programming support, software libraries and parallel architectural design. For example, they involve irregular communication patterns such as asynchronous updates to shared data structures. We consider several problems in high-performance genomics analysis, including alignment, profiling, clustering and assembly for both single genomes and metagenomes. We identify some of the common computational patterns or ‘motifs’ that help inform parallelization strategies and compare our motifs to some of the established lists, arguing that at least two key patterns, sorting and hashing, are missing. This article is part of a discussion meeting issue ‘Numerical algorithms for high-performance computational science’.

59 BASIC BIOLOGICAL SCIENCES↗

A Gigaparsec-scale Hydrodynamic Volume Reconstructed with Deep Learning

The next generation of spectroscopic surveys will map the large-scale structure of the Universe at high redshifts (2 ≤ z ≤ 5) using millions of quasar spectra, enabling major advances in constraining both the standard cosmological model and its extensions. Robust cosmological analyses of these data sets require numerical simulations that both cover gigaparsec volumes and resolve features on ∼10 kpc scales and smaller. However, running such large-volume, high-resolution hydrodynamic simulations is computationally prohibitive. We present a generative deep learning model that enhances a low-resolution, gigaparsec-scale (960 h −1 Mpc) hydrodynamic simulation using a smaller (80 h −1 Mpc) high-resolution input hydrodynamic simulation as training data. The resulting enhanced simulation reproduces the line-of-sight power spectrum to within ∼10% and the three-dimensional power spectrum at the ∼20% level at intermediate to small scales (k ≲ 2 h Mpc −1 ). Our method shows strong promise for producing realistic simulations for cosmological analyses with current surveys such as the Dark Energy Spectroscopic Instrument and upcoming next-generation experiments, but further improvements are needed to accurately recover the large-scale modes. We publicly release the enhanced hydrodynamic simulation, along with a halo catalog from a companion N-body dark matter simulation to support the calibration of data analysis pipelines for these large-scale surveys.

Convolutional neural networks↗

Recent Tropical Cyclone Outer Size Increases in the Western North Atlantic

The outer size of a tropical cyclone (TC) plays a pivotal role in its impact through a modulation of wind duration, rainfall extent and storm surge. While global and basin scale trends in TC size have been examined previously, whether there have been regional changes over time remains unclear. Here, using a suite of observations and reanalyses, we detect an increasing TC outer size over the western North Atlantic during 1979–2022. Over the western subtropical North Atlantic where the largest changes are found, the area-averaged increase in the radius of 17 ms -1 winds is about 7.5% over this period. Analysis of the large-scale environment reveals that the air-sea thermodynamic state has become more favorable for storm intensification, and thereby expansion, over that region. Further, numerical model simulations link changes in the environment with those in storm size, and suggest a combination of natural variability and external forcing in driving them.

Balaguru, Karthik [Pacific Northwest National Labo↗

Precision Plant Biomass Characterization in Agriculture: Harnessing Machine Learning and Hyperspectral Imaging [Slides]

Efficient Biomass Separation Object detection of anatomical parts (Cob, Stalk, Husk) in IR images enables precise separation, improving preprocessing (e.g., drying, grinding) for biofuel production. Detailed Biomass Characterization with Hyperspectral Data Hyperspectral imaging captures spectral signatures of biomass, allowing for the identification of specific traits like moisture content, lignin levels, and nutrient composition, leading to optimized treatments for each biomass part. Enhanced Feedstock Quality By leveraging hyperspectral data, feedstock can be processed based on its chemical composition, improving conversion efficiency and biofuel yield. Automation for Large-Scale Operations Automated object detection and hyperspectral data analysis reduce manual labor, ensuring accurate sorting and faster processing, making large-scale biofuel production more efficient. Maximized Biomass Utilization Accurate identification of biomass properties minimizes waste and ensures that each part is processed according to its highest biofuel potential.

09 BIOMASS FUELS↗

Fast correlation function calculator: A high-performance pair-counting toolkit

A novel high-performance exact pair-counting toolkit called fast correlation function calculator (FCFC) is presented. With the rapid growth of modern cosmological datasets, the evaluation of correlation functions with observational and simulation catalogues has become a challenge. High-efficiency pair-counting codes are thus in great demand. We introduce different data structures and algorithms that can be used for pair-counting problems, and perform comprehensive benchmarks to identify the most efficient algorithms for real-world cosmological applications. We then describe the three levels of parallelisms used by FCFC, SIMD, OpenMP, and MPI, and run extensive tests to investigate the scalabilities. Finally, we compare the efficiency of FCFC with alternative pair-counting codes. The data structures and histogram update algorithms implemented in FCFC are shown to outperform alternative methods. FCFC does not benefit greatly from SIMD because the bottleneck of our histogram update algorithm is mainly cache latency. Nevertheless, the efficiency of FCFC scales well with the numbers of OpenMP threads and MPI processes, even though speedups may be degraded with over a few thousand threads in total. FCFC is found to be faster than most (if not all) other public pair-counting codes for modern cosmological pair-counting applications.

79 ASTRONOMY AND ASTROPHYSICS↗

A Stability Analysis Tool for Bulk Power Systems Using Black-Box Models of Inverter-Based Resources

This paper presents a small-signal stability analysis tool for large-scale power systems with high penetration of inverter-based resources (IBRs). Firstly, a network transfer function matrix (NTFM), which represents the information of the system topology, transmission lines, loads, IBRs locations, etc., is derived to model the entire power system network. Secondly, small-signal perturbation method is applied to obtain the sequence impedance/admittance models of the block-box IBRs considering the frequency cross-coupling effects. With the obtained NTFM as well as IBR models, a multi-input, multi-output (MIMO) feedback system is constructed, and the generalized Nyquist criterion (GNC)-based stability method is employed to analyze the stability of the entire power system. Furthermore, based on the developed stability analysis method, sensitivity analysis is conducted on an unstable case to identify which parameter has a high impact on the system stability. As a result, different test cases based on a modified IEEE 14- bus system as well as a reduced 240-bus WECC system are studied to verify the proposed stability analysis tool.

42 ENGINEERING↗

A Stability Analysis Tool for Bulk Power Systems Using Black-Box Models of Inverter-based Resources

This paper presents a small-signal stability analysis tool for large-scale power systems with high penetration of inverter-based resources (IBRs). Firstly, a network transfer function matrix (NTFM), which represents the information of the system topology, transmission lines, loads, IBRs locations, etc., is derived to model the entire power system network. Secondly, small-signal perturbation method is applied to obtain the sequence impedance/admittance responses of IBRs considering the frequency cross-coupling effects. With the obtained NTFM as well as IBRs' models, a multi-input, multi-output (MIMO) feedback system is constructed, and the generalized Nyquist criterion (GNC)-based stability method is employed to analyze the stability of the entire power system. Different testing cases based on a modified IEEE-14 bus system are leveraged to verify the proposed stability analysis tool.

Sun, Dongsen↗

Scaling pair count to next galaxy surveys

ABSTRACT Counting pairs of galaxies or stars according to their distance is at the core of real-space correlation analyses performed in astrophysics and cosmology. Upcoming galaxy surveys (LSST, Euclid) will measure properties of billions of galaxies challenging our ability to perform such counting in a minute-scale time relevant for the usage of simulations. The problem is only limited by efficient access to the data, hence belongs to the big data category. We use the popular Apache Spark framework to address it and design an efficient high-throughput algorithm to deal with hundreds of millions to billions of input data. To optimize it, we revisit the question of non-hierarchical sphere pixelization based on cube symmetries and develop a new one dubbed the ‘Similar Radius Sphere Pixelization’ (SARSPix) with very close to square pixels. It provides the most adapted indexing over the sphere for all distance-related computations. Using LSST-like fast simulations, we compute autocorrelation functions on tomographic bins containing between a hundred million to one billion data points. In each case, we achieve the construction of a standard pair-distance histogram in about 2 min, using a simple algorithm that is shown to scale, over a moderate number of nodes (16–64). This illustrates the potential of this new techniques in the field of astronomy where data access is becoming the main bottleneck. They can be easily adapted to other use-cases as nearest-neighbours search, catalogue cross-match or cluster finding. The software is publicly available from https://github.com/astrolabsoftware/SparkCorr.

79 ASTRONOMY AND ASTROPHYSICS↗

THERMAL ANALYSIS AND DESIGN OF SELF-HEATING MOLDS USING LARGE-SCALE ADDITIVE MANUFACTURING FOR OUT-OF-AUTOCLAVE APPLICATIONS

Autoclave processing is a commonly used state-of-the-art fiber-reinforced composite manufacturing technology, albeit high capital cost, long cycle times and high energy consumption. Alternatively, out-of-autoclave processing reduces the initial and operating costs while producing composite structures with similar quality as that of autoclave parts. Additive Manufacturing (AM) the scaled-up molds for out-of-autoclave process using carbon fiber (CF) reinforced composite offers design flexibility, enhanced mechanical, and thermal properties in addition to reduction in weight and cost. However, heating of these molds using an oven is still expensive and necessitates an energy-efficient heating process. In this study, resistive heating through heating elements embedded within fiber reinforced composite molds is used as an efficient heating mechanism. The goal is to design wire embeddings and determine the optimal heat flux density to achieve a target uniform temperature of 1000C across the mold surface. To this end, numerical analyses were performed to evaluate the temperature distribution across the composite mold surface for a given wire placement and mold configuration. Constant thermal properties of the 20 wt.% short CF reinforced acrylonitrile butadiene styrene (ABS) were used in the thermal analysis. Time taken to reach the steady state temperature was also estimated. Design guidelines for wire embeddings were included to enable efficient manufacturing of fiber-reinforced composites through out-of-autoclave molds.

Pokkalla, Deepak↗

NeuDiff Agent: a governed AI workflow for single-crystal neutron crystallography

Large-scale facilities increasingly face analysis and reporting latency as a limiting step in scientific throughput, particularly for structural studies that require iterative reduction, integration, refinement and validation. To improve the time to result and analysis efficiency, NeuDiff Agent is introduced as a governed, tool-using AI workflow for TOPAZ at the Spallation Neutron Source. NeuDiff Agent takes instrument data through reduction, integration, refinement and validation to a validated crystal structure and a publication-ready CIF. NeuDiff Agent coordinates established crystallographic tools under explicit governance by restricting actions to allowlisted tools, enforcing fail-closed verification gates at key workflow boundaries, and capturing complete provenance for inspection, auditing and controlled replay. The present benchmark is limited to structural crystallography for periodic structures; magnetic structure analysis and incommensurate or superspace refinement are outside the scope of the current workflow. Performance is assessed using a fixed prompt protocol and repeated end-to-end runs with two large language model backends, with user and machine time partitioned and intervention burden and recovery behaviors quantified under gating. In a reference-case benchmark, NeuDiff Agent reduces wall time from 435 min (manual) to 86.5 ± 4.7 to 94.4 ± 3.5 min (4.6–5.0× faster) while producing a validated CIF with no checkCIF level A or B alerts. These results establish a practical route to deploy agentic AI in facility crystallography while preserving traceability and publication-facing validation requirements.

Xiao, Zhongcan [ORNL] (ORCID:0000000220761961)↗

A composite likelihood approach for inference under photometric redshift uncertainty

ABSTRACT Obtaining accurately calibrated redshift distributions of photometric samples is one of the great challenges in photometric surveys like LSST, Euclid, HSC, KiDS, and DES. We present an inference methodology that combines the redshift information from the galaxy photometry with constraints from two-point functions, utilizing cross-correlations with spatially overlapping spectroscopic samples, and illustrate the approach on CosmoDC2 simulations. Our likelihood framework is designed to integrate directly into a typical large-scale structure and weak lensing analysis based on two-point functions. We discuss efficient and accurate inference techniques that allow us to scale the method to the large samples of galaxies to be expected in LSST. We consider statistical challenges like the parametrization of redshift systematics, discuss and evaluate techniques to regularize the sample redshift distributions, and investigate techniques that can help to detect and calibrate sources of systematic error using posterior predictive checks. We evaluate and forecast photometric redshift performance using data from the CosmoDC2 simulations, within which we mimic a DESI-like spectroscopic calibration sample for cross-correlations. Using a combination of spatial cross-correlations and photometry, we show that we can provide calibration of the mean of the sample redshift distribution to an accuracy of at least 0.002(1 + z), consistent with the LSST-Y1 science requirements for weak lensing and large-scale structure probes.

(cosmology:) large-scale structure of Universe↗

Toward a Seamless Integration of Computing, Experimental, and Observational Science Facilities: A Blueprint to Accelerate Discovery

The Department of Energy, Office of Science operates world-leading facilities for experimental, observational, and computational science. DOE supercomputing facilities will reach performance at the scale of ExaFLOPs in the coming years, enabling new vistas of scale and precision for large scale simulations and data analysis. Experimental scientific facilities are undergoing similar upgrades that will lead to higher data rates and correspondingly larger computational demands, and will increase the need for near-real-time processing and resilient support for more complex workflows. A transformation of science is underway, with workloads at supercomputing facilities increasingly driven by this explosion of data from instruments and experimental facilities, as well as the accelerating use of Artificial Intelligence (AI) as a tool for scientific discovery. A seamless integration of computing, networking, instruments, and experimental facilities is required to support these emerging workloads and open up a new frontier of U.S. leadership in scientific discovery. We propose to accomplish this by providing frictionless access to the ASCR supercomputing facilities. We describe our vision of combining the power of ASCR supercomputers and networking infrastructure into an integrated scalable fabric, available to end user scientists via interfaces that aim to automate and simplify access to high performance computing systems. This will enable unprecedented computational science capabilities for experimental and observational facilities, and will create new opportunities to combine large simulations and modeling with experimental facility data analysis. This blueprint for creating an integrated network of computational and experimental facilities will provide an enriched discovery environment and open doors for new scientific communities to access the DOE’s world-leading computing and networking capabilities.

97 MATHEMATICS AND COMPUTING↗

Structural Impact of Grid-Forming Inverters on Power System Coherency

This paper addresses the following fundamental research question: how does the integration of grid-forming inverters (GFMs) replacing conventional synchronous generators (SGs) impact the slow coherent eigen-structure and the low frequency oscillatory behavior of future power systems? Due to time-scale separated dynamics, generator states inside a coherent area synchronize over a fast time-scale due to stronger coupling, while the areas themselves synchronize over a slower time scale. Our mathematical analysis shows that due to the large-scale integration of GFMs, the weighted Laplacian structure of the frequency dynamics is preserved, however, the entries of the Laplacian may be significantly modified based on the location and penetration levels of the GFMs. This can impact and potentially significantly alter the coherency structure of the system. We have validated our findings with numerical results using the IEEE 68-bus test system.

Mukherjee, Sayak [BATTELLE (PACIFIC NW LAB)]↗

Direct cosmological inference from three-dimensional correlations of the Lyman α forest

ABSTRACT When performing cosmological inference, standard analyses of the Lyman α (Ly α) three-dimensional correlation functions only consider the information carried by the distinct peak produced by baryon acoustic oscillations (BAO). In this work, we address whether this compression is sufficient to capture all the relevant cosmological information carried by these functions. We do this by performing a direct fit to the full shape, including all physical scales without compression, of synthetic Ly α autocorrelation functions and cross-correlations with quasars at effective redshift zeff = 2.3, assuming a DESI-like survey, and providing a comparison to the classic method applied to the same data set. Our approach leads to a $3.5{{\ \rm per\ cent}}$ constraint on the matter density ΩM, which is about three to four times better than what BAO alone can probe. The growth term fσ8(zeff) is constrained to the $10{{\ \rm per\ cent}}$ level, and the spectral index ns to $\sim 3-4{{\ \rm per\ cent}}$. We demonstrate that the extra information resulting from our ‘direct fit’ approach, except for the ns constraint, can be traced back to the Alcock–Paczynski effect and redshift space distortion information.

79 ASTRONOMY AND ASTROPHYSICS↗

Geometry versus growth: Internal consistency of the flat ΛCDM model with KiDS-1000

Here, we carry out a multi-probe self-consistency test of the flat Lambda Cold Dark Matter (ΛCDM) model with the aim of exploring potential causes of the reported tensions between high- and low-redshift cosmological observations. We divide the model into two theory regimes determined by the smooth background (geometry) and the evolution of matter density fluctuations (growth), each governed by an independent set of ΛCDM cosmological parameters. This extended model is constrained by a combination of weak gravitational lensing measurements from the Kilo-Degree Survey, galaxy clustering signatures extracted from Sloan Digital Sky Survey campaigns and the Six-Degree Field Galaxy Survey, and the angular baryon acoustic scale and the primordial scalar fluctuation power spectrum measured in Planck cosmic microwave background (CMB) data. For both the weak lensing data set individually and the combined probes, we find strong consistency between the geometry and growth parameters, as well as with the posterior of standard ΛCDM analysis. In the non-split analysis, for which one single set of parameters was used, tension in the amplitude of matter density fluctuations as measured by the parameter S 8 persists at around 3σ, with a 1.5% constraint of S 8 = 0.776$_{–0.008}^{+0.016}$ for the combined probes. We also observe a less significant preference (at least 2σ) for higher values of the Hubble constant, H 0 = 70.5$_{–1.5}^{+0.7}$ km s –1 Mpc –1 , as well as for lower values of the total matter density parameter Ω m = 0.289$_{–0.005}^{+0.007}$ compared to the full Planck analysis. Including the subset of the CMB information in the probe combination enhances these differences rather than alleviate them, which we link to the discrepancy between low and high multipoles in Planck data. Our geometry versus growth analysis does not yet yield clear signs regarding whether the origin of the discrepancies lies in ΛCDM structure growth or expansion history but holds promise as an insightful test for forthcoming, more powerful data.

79 ASTRONOMY AND ASTROPHYSICS↗