Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large scale analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Valuation of Hydrogen Technology on the Electric Grid Using Production Cost Modeling: Cooperative Research and Development Final Report, CRADA Number CRD-18-00736

This research project will estimate the value to the United States electric grid of deploying hydrogen technology (such as electrolyzers and hydrogen-fueled generation) under projected conditions of high renewable penetration. The analysis will advance the state of the art in systems-level cost-benefit analysis of hydrogen technology for the electric grid by incorporating production cost modeling results in the analysis. Large-scale grid simulation tools will be used to evaluate total system production cost and grid operation when hydrogen technology is deployed for applications such as energy storage and demand response. Scenarios will include one or more future grid mixes in the Western Interconnect (WI) with a high proportion of intermittent renewables. Electric Power Research Institute (EPRI) will work with four utility companies to refine scenarios. Results of the analysis will include comparing the net cost of hydrogen to other technologies for long duration storage, and of power-to-gas (P2G) scenarios including merchant hydrogen sale and hydrogen-fueled generation.

08 HYDROGEN↗
DOE OSTI2023

Transcriptomic Analysis Reveals Novel Regulators of the Scots Pine Stilbene Pathway

Stilbenes accumulate in Scots pine heartwood where they have important roles in protecting wood from decaying fungi. They are also part of active defense responses, and their production is induced by different (a)biotic stressors. The specific transcriptional regulators as well as the enzyme responsible for activating the stilbene precursor cinnamate in the pathway are still unknown. UV-C radiation was the first discovered artificial stress activator of the pathway. Here, we describe a large-scale transcriptomic analysis of pine needles in response to UV-C and treatment with translational inhibitors, both activating the transcription of stilbene pathway genes. We used the data to identify putative candidates for the missing CoA ligase and for pathway regulators. We further showed that the pathway is transcriptionally activated by phosphatase inhibitor, ethylene and jasmonate treatments, as in grapevine, and that the stilbene synthase promoter retains its inducibility in some of the tested conditions in Arabidopsis, a species that normally does not synthesize stilbenes. Shared features between gymnosperm and angiosperm regulation and partially retained inducibility in Arabidopsis suggest that pathway regulation occurs not only via ancient stress-response pathway(s) but also via species-specific regulators. Understanding which genes control the biosynthesis of stilbenes in Scots pine aids breeding of more resistant trees.

4-Coumarate-CoA ligase↗
DOE OSTI2024

Harmonic analysis of discrete tracers of large-scale structure

It is commonplace in cosmology to analyze fields projected onto the celestial sphere, and in particular density fields that are defined by a set of points e.g. galaxies. When performing an harmonic-space analysis of such data (e.g. an angular power spectrum) using a pixelized map one has to deal with aliasing of small-scale power and pixel window functions. We compare and contrast the approaches to this problem taken in the cosmic microwave background and large-scale structure communities, and advocate for a direct approach that avoids pixelization. We describe a method for performing a pseudo-spectrum analysis of a galaxy data set and show that it can be implemented efficiently using well-known algorithms for special functions that are suited to acceleration by graphics processing units (GPUs). The method returns the same spectra as the more traditional map-based approach if in the latter the number of pixels is taken to be sufficiently large and the mask is well sampled. The method is readily generalizable to cross-spectra and higher-order functions. It also provides a convenient route for distributing the information in a galaxy catalog directly in harmonic space, as a complement to releasing the configuration-space positions and weights, and a route to spectral apodization. Finally, we make public a code enabling the application of our method to existing and upcoming datasets.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Block segmentation in feature space for realtime object detection in high granularity images

Computer vision has applications in object detection, image recognition and classification, and object tracking. One of the challenges of computer vision is the presence of useful information at multiple distance scales. Filtering techniques may sacrifice details at small scales in order to prioritize the analysis of large-scale features of the image. We present a strategy for coarse-graining multidimensional data while maintaining fine-grained detail for subsequent analysis. The algorithm is based on fixed-size block segmentation in the feature space. We apply this strategy to solve the long-standing challenge of detecting particle trajectories at the Large Hadron Collider in real time.

Computer vision↗
DOE OSTI2023

Dynamically Downscaled Hourly Future Weather Data with 12-km Resolution Covering Most of North America

This is an hourly future weather dataset for energy modeling applications. The dataset is primarily based on the output of a regional climate model (RCM), i.e., the Weather Research and Forecasting (WRF) model version 3.3.1. The WRF simulations are driven by the output of a general circulation model (GCM), i.e., the Community Climate System Model version 4 (CCSM4). This dataset is in the EPW format, which can be read or translated by more than 25 building energy modeling programs (e.g., EnergyPlus, ESP-r, and IESVE), energy system modeling programs (e.g., System Advisor Model (SAM)), indoor air quality analysis programs (e.g., CONTAM), and hygrothermal analysis programs (e.g., WUFI). It contains 13 weather variables, which are the Dry-Bulb Temperature, Dew Point Temperature, Relative Humidity, Atmospheric Pressure, Horizontal Infrared Radiation Intensity from Sky, Global Horizontal Irradiation, Direct Normal Irradiation, Diffuse Horizontal Irradiation, Wind Speed, Wind Direction, Sky Cover, Albedo, and Liquid Precipitation Depth. The weather data is created for two emissions scenarios: RCP4.5 and RCP8.5 and spans two 10-year time slices in the future: 2045 - 2054 and 2085 - 2094. It offers a spatial resolution of 12 km by 12 km with extensive coverage across most of North America. Due to the enormous size of the entire dataset, in the first stage of its distribution, we provide 20 years of future weather data for the centroid of each Public Use Microdata Area (PUMA), excluding Hawaii. PUMAs are non-overlapping, statistical geographic areas that partition each state or equivalent entity into geographic areas containing no fewer than 100,000 people each. The 2,378 PUMAs as a whole cover the entirety of the U.S. The weather data can be utilized alongside the large-scale energy analysis tools, ResStock and ComStock, developed by National Renewable Energy Laboratory, whose smallest resolution is at the PUMA scale. The data for RCP4.5 is still being processed and will be published soon.

Array↗
DOE OSTI2025

AI-powered topic modeling: comparing LDA and BERTopic in analyzing opioid-related cardiovascular risks in women

Topic modeling is a crucial technique in natural language processing (NLP), enabling the extraction of latent themes from large text corpora. Traditional topic modeling, such as Latent Dirichlet Allocation (LDA), faces limitations in capturing the semantic relationships in the text document although it has been widely applied in text mining. BERTopic, created in 2022, leveraged advances in deep learning and can capture the contextual relationships between words. In this work, we integrated Artificial Intelligence (AI) modules to LDA and BERTopic and provided a comprehensive comparison on the analysis of prescription opioid-related cardiovascular risks in women. Opioid use can increase the risk of cardiovascular problems in women such as arrhythmia, hypotension etc. 1,837 abstracts were retrieved and downloaded from PubMed as of April 2024 using three Medical Subject Headings (MeSH) words: “opioid,” “cardiovascular,” and “women.” Machine Learning of Language Toolkit (MALLET) was employed for the implementation of LDA. BioBERT was used for document embedding in BERTopic. Eighteen was selected as the optimal topic number for MALLET and 23 for BERTopic. ChatGPT-4-Turbo was integrated to interpret and compare the results. The short descriptions created by ChatGPT for each topic from LDA and BERTopic were highly correlated, and the performance accuracies of LDA and BERTopic were similar as determined by expert manual reviews of the abstracts grouped by their predominant topics. The results of the t-SNE (t-distributed Stochastic Neighbor Embedding) plots showed that the clusters created from BERTopic were more compact and well-separated, representing improved coherence and distinctiveness between the topics. Our findings indicated that AI algorithms could augment both traditional and contemporary topic modeling techniques. In addition, BERTopic has the connection port for ChatGPT-4-Turbo or other large language models in its algorithm for automatic interpretation, while with LDA interpretation must be manually, and needs special procedures for data pre-processing and stop words exclusion. Therefore, while LDA remains valuable for large-scale text analysis with resource constraints, AI-assisted BERTopic offers significant advantages in providing the enhanced interpretability and the improved semantic coherence for extracting valuable insights from textual data.

Research & Experimental Medicine↗
DOE OSTI2025

Automated Image Segmentation and Processing Pipeline Applied to X–Ray Computed Tomography Studies of Pitting Corrosion in Aluminum Wires

Understanding pitting corrosion is critical, yet its kinetics and morphology remain challenging to study from X-ray computed tomography (XCT) due to manual segmentation barriers. To address this, an automated pipeline leveraging deep learning for efficient large-scale XCT analysis is developed, revealing new corrosion insights. The pipeline enables pit segmentation, 3D reconstruction, statistical characterization, and a topological transformation for visualization. Here, the pipeline is applied to 87 648 XCT images capturing commercial purity aluminum (1100 Al) wire exposed to sodium chloride (NaCl) salt particles over a period of 122 h. The pipeline achieves complete feature extraction and statistical quantification across the entire XCT dataset, leveraging distributed computing environment for high efficiency. Global growth kinetics such as high-level stepwise sigmoidal volume loss patterns and granular individual pit developments are both captured for 36 detected pits. By combining automation, computer vision, and extensive XCT datasets, this research accelerates precise corrosion assessment to enable materials science discoveries at scale.

36 MATERIALS SCIENCE↗
DOE OSTI2025

In-Situ Synchrotron X-Ray Diffraction of Ultrasonic Microstructural Refinement During Solidification in a Commercial Al–Si–Mg Alloy

This study reports the first use of in-situ synchrotron X-ray diffraction (SXRD) to study the effects of ultrasonic melt processing (USMP) on phase and grain size evolution during solidification in a commercial Al–Si–Mg casting alloy. USMP is a technique that, when applied to aluminum as it solidifies, can be used to refine the local microstructure of large-scale castings. Analysis of the in-situ SXRD data to estimate the average grain size of primary α-Al grains during USMP demonstrates that USMP slows the growth rate of α-Al grains and reduces grain size by 36 pct. Furthermore, there is also evidence that USMP causes the primary α-Al grains to move relative to the X-ray beam; such motion increases the probability of primary α-Al grains colliding and fragmenting. This movement becomes constrained at the onset of the Al–Si binary eutectic, suggesting that USMP ceases to effectively refine the microstructure once the Al–Si binary eutectic begins to form. Complementary laboratory-scale X-ray diffraction (XRD) data were used to correlate the lattice parameters of the α-Al and Si (D-A4) phases with temperature to estimate cooling rate during solidification. Thus, this study can guide the design of novel castings with spatially distributed fine-grained regions produced using local ultrasonic processing.

Aluminum Alloys↗
DOE OSTI2024

Large-scale simulation-based parametric analysis of an optimal precooling strategy for demand flexibility in a commercial office building

Achieving success with grid-interactive efficient buildings (GEBs) is closely tied to the utilization of flexible loads. A valuable strategy involves the implementation of precooling techniques before high-demand events, such as peak hours, by adjusting zone air temperature setpoints. This leads to a reduction in thermal loads and peak electricity demand during these times, as the building’s thermal mass stores and subsequently releases thermal energy. However, the effectiveness of the pre-cooling optimization is highly contingent on specific conditions such as building thermal properties, weather conditions, utility rate structure, HVAC equipment sizing, etc. Therefore, investigating the impacts of these condition-specific factors is crucial, especially when considering precooling strategies that utilize thermal mass in commercial buildings. In this paper, we first devised a novel heuristic control approach that incorporates parameterized optimal precooling thermostat schedules to enhance demand flexibility in a commercial office building. Subsequently, we conducted a thorough performance evaluation of this control strategy. Here, the optimal thermostat schedule was parameterized using three optimization variables: the precooling start time, the precooling end time, and the precooling temperature setpoint. Utilizing the DOE medium-sized office building as the virtual testbed, we showed that the parameterized schedule effectively approximates model predictive control and requires drastically reduced computational overhead. In addition, we investigated the impact of different influencing factors on the optimal precooling strategy. These factors include building thermal mass, outdoor air conditions, and energy price profiles. Using high-performance computing, we simulated a total of 225 scenarios, consisting of three levels of thermal mass, five typical outdoor air temperature profiles, and fifteen time-of-use price plans. The results demonstrate that optimal thermostat scheduling could save substantial energy cost in medium-sized office buildings with heavy thermal mass but with some energy penalty. Although the potential for cost savings is lower in buildings with low and medium thermal mass, the energy penalty remains consistent in all three thermal mass scenarios. The study also highlights the need to account for zone diversity and recognize that a one-size-fits-all-zone setpoint schedule may not be suitable for all zones and can lead to unnecessary energy wastage. Furthermore, the results highlight that while outdoor air conditions play a role in cost and energy performance, the cooling load exerts a more immediate and substantial influence on cost savings in precooling strategies. Although cost savings are comparable under certain conditions with the same cooling load, observed deviations in energy penalty indicate potential disparities in the efficiency of the HVAC system during the load-shifting process. In addition, the duration of peak pricing and the ratio between peak and off-peak times exhibit clear correlations with cost savings and energy consumption, aligning with intuitive expectations. These findings offer valuable insights for optimizing precooling strategies in office buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

QUBO formulations for training machine learning models

Abstract Training machine learning models on classical computers is usually a time and compute intensive process. With Moore’s law nearing its inevitable end and an ever-increasing demand for large-scale data analysis using machine learning, we must leverage non-conventional computing paradigms like quantum computing to train machine learning models efficiently. Adiabatic quantum computers can approximately solve NP-hard problems, such as the quadratic unconstrained binary optimization (QUBO), faster than classical computers. Since many machine learning problems are also NP-hard, we believe adiabatic quantum computers might be instrumental in training machine learning models efficiently in the post Moore’s law era. In order to solve problems on adiabatic quantum computers, they must be formulated as QUBO problems, which is very challenging. In this paper, we formulate the training problems of three machine learning models—linear regression, support vector machine (SVM) and balanced k-means clustering—as QUBO problems, making them conducive to be trained on adiabatic quantum computers. We also analyze the computational complexities of our formulations and compare them to corresponding state-of-the-art classical approaches. We show that the time and space complexities of our formulations are better (in case of SVM and balanced k-means clustering) or equivalent (in case of linear regression) to their classical counterparts.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Temperature outweighs light and flow as the predominant driver of dissolved oxygen in US rivers

The concentration of dissolved oxygen (DO), an important measure of water quality and river metabolism, varies tremendously in time and space. Riverine DO is commonly perceived as regulated by interacting and competing drivers (light, temperature and flow) that define rivers’ climate. Its continental-scale drivers, however, have remained elusive, partly due to the scarcity and spatio-temporal inconsistency of water quality data. Here we show, via a deep learning model (long short-term memory) trained using data from 580 rivers, that temperature predominantly drives daily DO dynamics in the contiguous United States. Light comes a close second, whereas flow imparts minimal influence. This work showcases the promise of using deep learning models for data filling that enables large-scale systematic analysis of patterns and drivers. Results show fairly accurate prediction of DO by temperature alone, and declining DO in warming rivers, which has important implications for water security and ecosystem health in the future climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

DESI mock challenge: Halo and galaxy catalogues with the bias assignment method

We present a novel approach to the construction of mock galaxy catalogues for large-scale structure analysis based on the distribution of dark matter halos obtained with effective bias models at the field level. We aim to produce mock galaxy catalogues capable of generating accurate covariance matrices for a number of cosmological probes that are expected to be measured in current and forthcoming galaxy redshift surveys (e.g. two- and three-point statistics). The construction of the catalogues shown in this paper is part of a mock-comparison project within the Dark Energy Spectroscopic Instrument (DESI) collaboration. We use the bias assignment method ( BAM ) to model the statistics of halo distribution through a learning algorithm using a few detailed N-body simulations, and approximated gravity solvers based on Lagrangian perturbation theory. We introduce cosmic-web-dependent corrections to modelling redshift-space distortions at the N-body level – both in the halo and galaxy distributions –, as well as a multi-scale approach for accurate assignment of halo properties. Using specific models of halo occupation distributions to populate halos, we generate galaxy mocks with the expected number density and central-satellite fraction of emission-line galaxies, which are a key target of the DESI experiment. BAM generates mock catalogues with per cent accuracy in a number of summary statistics, such as the abundance, the two- and three-point statistics of halo distributions, both in real and redshift space. In particular, the mock galaxy catalogues display ~3%-10% accuracy in the multipoles of the power spectrum up to scales of k ~ 0.4 h -1 Mpc. We show that covariance matrices of two- and three-point statistics obtained with BAM display a similar structure to the reference simulation. BAM offers an efficient way to produce mock halo catalogues with accurate two- and three-point statistics and is able to generate a variety of multi-tracer catalogues with precise covariance matrices of several cosmological probes. We discuss future developments of the algorithm towards mock production in DESI and other galaxy-redshift surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Angular clustering properties of the DESI QSO target selection using DR9 Legacy Imaging Surveys

ABSTRACT The quasar target selection for the upcoming survey of the Dark Energy Spectroscopic Instrument (DESI) will be fixed for the next 5 yr. The aim of this work is to validate the quasar selection by studying the impact of imaging systematics as well as stellar and galactic contaminants, and to develop a procedure to mitigate them. Density fluctuations of quasar targets are found to be related to photometric properties such as seeing and depth of the Data Release 9 of the DESI Legacy Imaging Surveys. To model this complex relation, we explore machine learning algorithms (random forest and multilayer perceptron) as an alternative to the standard linear regression. Splitting the footprint of the Legacy Imaging Surveys into three regions according to photometric properties, we perform an independent analysis in each region, validating our method using extended Baryon Oscillation Spectroscopic Survey (eBOSS) EZ-mocks. The mitigation procedure is tested by comparing the angular correlation of the corrected target selection on each photometric region to the angular correlation function obtained using quasars from the Sloan Digital Sky Survey (SDSS) Data Release 16. With our procedure, we recover a similar level of correlation between DESI quasar targets and SDSS quasars in two-thirds of the total footprint and we show that the excess of correlation in the remaining area is due to a stellar contamination that should be removed with DESI spectroscopic data. We derive the Limber parameters in our three imaging regions and compare them to previous measurements from SDSS and the 2dF QSO Redshift Survey.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Emergence of Intermediate Range Order in Jammed Packings

We perform a structural analysis of large scale jammed packings of monodisperse, frictionless and frictional spheres to elucidate structural signatures of the static structure factor in the low-to-intermediate wave number region. We employ discrete element method simulations containing up to 8×10^{7} particles, in which the particle friction coefficient(s), including sliding, rolling, and twisting interactions, are varied. At intermediate wave number values, corresponding to length scales that lie between that of the nearest neighbor primary peak and the system size, we find the emergence of a prepeak-a signature of intermediate range order-that grows with increasing friction. We correlate the emergence of this peak to real space fluctuations in the local particle coordination number, which exhibits a grainy fluctuating field throughout the packing process that is retained in the final, mechanically stable state. While the formation of the prepeak shows varying degrees of robustness to packing protocol changes, our results suggest that preparation history may be used to construct packings with variable large length scale structural properties.

Monti, Joseph M↗
DOE OSTI2023

Consideration of Nonideal Detonation Regimes Influenced by Wave Modes in a Water-Cooled Rotating Detonation Engine Using OH* Chemiluminescence

Although inherently unstable, existing research in rotating detonation combustion supports its application in notionally steady processes resulting in greater availability compared to conventional, constant pressure combustion. Further improvements rely on a more in-depth understanding of system losses and identifying conditions which optimize device performance. Within this study, the presence and proportion of ideal and nonideal combustion regimes are compared across a variety of process conditions and wave modes. Here, large-scale data analysis seeks to summarize proportional heat release associated with commensal, parasitic, and detonative combustion averaged across individual traces of OH* chemiluminescent data acquired at the detonation plane. Means of regime partitioning based on the anatomy of the time-resolved OH* signal are proposed to ensure consistent analysis throughout the current and future studies concerning combustion regimes. Of particular interest is the possible influence of wave on the nonideal combustion in relative proportion to the desired detonation. Results showed improved percent detonation with increasing significance for the following trends: decreasing equivalence ratio, increasing wave count, decreasing wave velocity, and increasing detonation time. Increased wave number, brought on by decreased equivalence ratios and wave velocities, is thought to decrease fill region surface area, and therefore, decrease nonideal contact burning. Additional analysis is performed to consider possible trend variation due to the presence of stable galloping waves, which were found to have minimal influence on relative percent detonation values. The outcome of this study suggests operational states, which correspond to increased wave quantities for increased proportions of reactants consumed by the targeted detonative combustion regime.

42 ENGINEERING↗
DOE OSTI2022

Streaming Statistics

In the context of a larger effort for in situ data analytics, there is a need to calculate basic statistics metrics (e.g., count, mean, median) online as new data points become available. Originally, the code for such online, or in other words streaming, statistics was part of the TALASS (Topological Analysis of Large- Scale Simulations) library. We isolated the relevant code and created a standalone library from it called Streaming Statistics. We also added an ability to serialize and deserialize the statistics objects so that the library can be used in distributed, task-based processing. To use the Streaming Statistics library, the user chooses a statistic, constructs an object for it, and then "adds" values to it, which means the statistic is augmented.

Shudler, Sergei↗
DOE OSTI2024

PIPES (Pipeline for Integrated Projects in Energy Systems) [SWR-24-89]

The Pipeline for Integrated Projects in Energy Systems (PIPES) is a comprehensive project, data, and workflow management tool designed for integrated modeling teams. PIPES facilitates the management of data requirements, tasks, and progress tracking, serving as a higher-level integration layer that works across various data and modeling software. This tool integrates models, data, and tools to perform large-scale, integrated analysis work at scale. PIPES is designed to streamline integrated modeling projects, enhance collaboration, and ensure the quality and efficiency of data management and workflow processes. https://github.com/nrel-pipes/pipes-api https://github.com/nrel-pipes/pipes-web https://github.com/nrel-pipes/nrel-pipes

Gu, Jianli↗
DOE OSTI2020

Seismology in the Cloud: A New Streaming Workflow

Data-intensive research in seismology is experiencing a recent boom, driven in part by large volumes of available data and advances in the growing field of data science. However, there are significant barriers to processing large data volumes, such as long retrieval times from data repositories, complex data management, and limited computational resources. New tools and platforms have reduced the barriers to entry for scientific cluster computing, including the maturation of the commercial cloud as an accessible instrument for research. Here, we build a customized research cluster in the cloud to test a new workflow for large-scale seismic analysis, in which data are processed as a stream (retrieved on-the-fly and acted upon without storing), with data from the Incorporated Research Institutions for Seismology Data Management Center. We use this workflow to deploy a spectral peak detection algorithm over 5.6 TB of compressed continuous seismic data from 2074 stations of the USArray Transportable Array EarthScope network. Using a 50-node cluster in the cloud, we completed the noise survey in 80 hr, with an average data throughput of 1.7 GB per minute. By varying cluster sizes, we find the scaling of our analysis to be sublinear, due to a combination of algorithmic limitations and data center response times. The cloud-based streaming workflow represents an order-of-magnitude increase in acquisition and processing speed compared to a traditional download-store-process workflow, and offers the additional benefits of employing a flexible, accessible, and widely used computing architecture. It is limited, however, due to its reliance on Internet transfer speeds and data center service capacity, and may not work well for repeated analyses or those for which even higher data throughputs are needed. These research applications will require a new class of cloud-native approaches in which both data and analysis are in the cloud.

58 GEOSCIENCES↗