Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

In Situ XAFS, XRD, and DFT Characterization of the Sulfur Adsorption Sites on Cu and Ce Exchanged Y Zeolites

Adsorptive desulfurization with Cu and Ce ion-exchanged Y zeolite (CuCeY) has proven to be an effective method for the removal of sulfur compounds from hydrocarbon fuels. In this study, Cu and Ce exchanged Y materials including CuY, CeY, and CuCeY were prepared and examined to investigate the mechanism behind the superior sulfur adsorption and selectivity of CuCeY. In situ conditions were used to study the materials as prepared for optimal desulfurization. X-ray diffraction (XRD) confirmed the absence of large well-ordered crystalline phases from metallic or oxide Cu and Ce after the reduction of the samples. The oxidation states and local environments of Cu and Ce were determined using X-ray adsorption fine structure (XAFS) analysis and correlated to theoretical findings obtained from density functional theory (DFT) calculations. XAFS data indicate the successful reduction of Cu species to Cu + and Cu o , and Ce to Ce 3+ . Analysis of XAFS spectra located Cu and Ce within the Y zeolite framework with Cu cations in the six-member ring sites and as small metallic Cu clusters. Ce cations were found to occupy both six-member ring and hexagonal prism sites. Furthermore, these results reveal the structure of CuCeY as prepared for desulfurization and provide insight into its superior sulfur adsorption performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Augmented Human Analysis (AHA)

Radio frequency (RF) signal monitoring generally emphasizes intentionally generated signals, such as WiFi, Bluetooth, or cellular transmissions. However, electronic devices also produce unintended radiated emissions (UREs), which could also be useful in RF spectrum analysis. In either case, deriving intelligence from RF signals is typically a human-intensive process requiring significant domain knowledge. In the Augmented Human Analysis (AHA) project, we investigate the utility of dimensionally aligned signal projection (DASP) and machine learning (ML) algorithms for accelerating RF analysis workflows. We find that while DASP algorithms can indeed highlight signal characteristics relevant for classification tasks, the choice of algorithmic hyperparameters greatly affects performance. To address this challenge, we evaluate the quality of DASP outputs using the silhouette score, which measures how well data points cluster; high silhouette scores indicate good clustering, and thus good hyperparameter values. This approach is critical for machine learning pipelines as the DASP parameters cannot be directly optimized during model training. By identifying good DASP parameters, and thus good DASP outputs, as a preprocessing step, we can decrease the amount of effort required for downstream ML model training. We demonstrate our workflow using a dataset of UREs from common household devices, showing that even without the aid of ML, proper selection of DASP parameters enables clustering by device type.

42 ENGINEERING↗
DOE OSTI2021

Hubble Frontier Field Clusters and Their Parallel Fields: Photometric and Photometric Redshift Catalogs

We present a multiband analysis of the six Hubble Frontier Field clusters and their parallel fields, producing catalogs with measurements of source photometry and photometric redshifts. We release these catalogs to the public along with maps of intracluster light and models for the brightest galaxies in each field. This rich data set covers a wavelength range from 0.2 to 8 μm, utilizing data from the Hubble Space Telescope, Keck Observatories, Very Large Telescope array, and Spitzer Space Telescope. We validate our products by injecting into our fields and recovering a population of synthetic objects with similar characteristics to those in real extragalactic surveys. The photometric catalogs contain a total of over 32,000 entries, with 50% completeness at a threshold of mag AB ~ 29.1 for unblended sources and magAB ~ 29 for blended ones, in the IR-weighted detection band. Photometric redshifts were obtained by means of template fitting and have an average outlier fraction of 10.3% and scatter σ = 0.067 when compared to spectroscopic estimates. The software we devised, after being tested in the present work, will be applied to new data sets from ongoing and future surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

DESI z ≳ 5 Quasar Survey. I. A First Sample of 400 New Quasars at z ~ 4.7–6.6

We report the first results of a high-redshift (z ≳ 5) quasar survey using the Dark Energy Spectroscopic Instrument (DESI). As a DESI secondary target program, this survey is designed to carry out a systematic search and investigation of quasars at 4.8 < z < 6.8. The target selection is based on the DESI Legacy Imaging Surveys (the Legacy Surveys) DR9 photometry, combined with the Pan-STARRS1 data and J-band photometry from public surveys. A first quasar sample has been constructed from the DESI Survey Validation 3 (SV3) and first-year observations until 2022 May. This sample includes more than 400 new quasars at redshift 4.7 ≤ z < 6.6, down to 21.5 magnitude (AB) in the z band, discovered from 35% of the entire target sample. Remarkably, there are 220 new quasars identified at z ≥ 5, more than one-third of existing quasars previously published at this redshift. The observations so far result in an average success rate of 23% at z > 4.7. The current spectral data set has already allowed analysis of interesting individual objects (e.g., quasars with damped Lyα absorbers and broad absorption line features), and statistical analysis will follow the survey's completion. A set of science projects will be carried out leveraging this program, including quasar luminosity function, quasar clustering, intergalactic medium, quasar spectral properties, intervening absorbers, and properties of early supermassive black holes. Additionally, a sample of 38 new quasars at z ~ 3.8–5.7 discovered from a pilot survey in the DESI SV1 is also published in this paper.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Kilometer-Scale Hydrologic Exchange Flows in a Gravel Bed River Corridor and Their Implications to Solute Migration

In this work, a well-characterized field site along a major river corridor was used to investigate the dynamic pathways and impacts of subsurface hydrogeologic structures on kilometer-scale hydrologic exchange flows between river water and groundwater. A aqueous uranium (U aq ) plume exists at the site that discharges to the Columbia River. We performed temporally intensive monitoring of specific conductance (SpC) and U aq concentrations within the plume at increasing distances from the river shoreline and at locations both within and outside a presumed subsurface pathway of lateral hydrologic exchange. Specific conductance and U aq were utilized as in-situ tracers of hydrologic exchange and associated groundwater-surface water mixing. Monitoring data was collected for an approximate two year period during which seasonal river elevations varied by more than 2 m causing distinct events of river water intrusion and retreat from the near-shore aquifer, and large temporal variations in well-water analyte concentrations. Statistical clustering analysis was applied to identify well groupings exhibiting common time series behaviors. PFLOTRAN was implemented within a modeling domain of 3.3 x 1.9 km with dynamic flow boundary conditions and accurate subsurface topography for the basal aquitard underlying the aquifer. In-silico calculations of river water tracer behavior were performed to assess predominant flow directions and velocities influenced by river stage variations and variable aquitard topography, and their collective influences on SpC and U aq concentrations. We demonstrate complicated multidirectional flow behaviors at the kilometer scale resulting from hydrologic exchange and subsurface structure that influence plume dynamics and determine the overall system behavior.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Reconstruction with velocities

ABSTRACT Reconstruction is becoming a crucial procedure of galaxy clustering analysis for future spectroscopic redshift surveys to obtain subper cent level measurement of the baryon acoustic oscillation scale. Most reconstruction algorithms rely on an estimation of the displacement field from the observed galaxy distribution. However, the displacement reconstruction degrades near the survey boundary due to incomplete data and the boundary effects extend to ${\sim}100\, \mathrm{Mpc}/h$ within the interior of the survey volume. We study the possibility of using radial velocities measured from the cosmic microwave background observation through the kinematic Sunyaev–Zeldovich effect to improve performance near the boundary. We find that the boundary effect can be reduced to ${\sim}30-40\, \mathrm{Mpc}/h$ with the velocity information from Simons Observatory. This is especially helpful for dense low redshift surveys where the volume is relatively small and a large fraction of total volume is affected by the boundary.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

FY 2026 Midyear Report: Seismic Monitoring of Underground Vibration Sources Using Distributed Acoustic Sensing and Seismometers

Safeguards-relevant temporal changes in underground facilities can be observed using geophysical monitoring techniques. Seismic waves, in particular, provide valuable insights into subsurface activities and can serve as an important tool for detecting anomalous events that may indicate containment breaches at geological repositories. This midyear report summarizes ongoing efforts to automatically and rapidly detect and locate anomalous vibration signals that could be indicative of potential containment breaches. Previous work during FY25 focused on compiling continuous seismic datasets from two underground sites and developing a database of continuous waveforms and ground-truth event data derived from multiple sensing modalities. Building on this foundation, we are adapting anomaly detection and geolocation algorithms to explore methods for monitoring underground activities using two relatively low-maintenance sensing technologies: a dense surface geophone array deployed at the Pleasant Gap mine in Pennsylvania, and a three-dimensional fiber-optic cable array for distributed acoustic sensing (DAS) installed in the subsurface at the Sanford Underground Research Facility (SURF) in South Dakota. This report summarizes work conducted during the first two quarters of FY26, during which we refined a dynamic power spectral density (PSD)-based detector, applied it independently to each geophone station, and then combined the per‑station detections with density-based spatial clustering of applications with noise (DBSCAN) to cluster events and produce spatial maps over a nine‑day interval. In addition, we outline plans for a field trial at the Waste Isolation Pilot Plant (WIPP) in New Mexico to compare traditional seismic monitoring approaches with DAS techniques and to evaluate the benefits of combined data analysis. Activities during the past two quarters have included the preparation and submission of a Field Test Plan to WIPP for approval, as well as submission to headquarters for review and feedback.

58 GEOSCIENCES↗
DOE OSTI2024

Machine Learning-Driven Reliability Estimation of PV Inverters Considering Alert-Ambient Variability

Weather-induced spatio-temporal degradation limits outdoor PV inverter lifetime and reliability, necessitating advanced data analysis. This study employs a top-down, data-driven approach utilizing multiple machine learning (ML) algorithms to estimate inverter reliability in a 1.4 MW PV power plant, considering factors such as irradiance, humidity, temperature, time of day, and weather conditions. An extensive alert dataset from 17 identical inverters, including alert types, propagation, and frequency, reveals significant correlations with environmental factors and inverter output power, enabling the construction of a performance reliability model. Dual-stage supervised-ML models are evaluated for accuracy, with the ‘classification-regression’ model by an artificial neural network (ANN) tested on the averaged “Alert-Ambient” dataset, which is outperformed by ‘clustering-regression’ models using random forest (RF) and K-Nearest Neighbors (KNN) on individual inverter datasets. K-means clustering applies principal component analysis to reduce dimensions, achieving improved accuracy beyond the 80% achieved by ANN on the averaged dataset. Second-stage regression estimates inverter reliability with a mean square error of 0.0195 on the averaged dataset and as low as 0.002 on individual inverter datasets using RF. Furthermore, these findings highlight the method's suitability for estimating PV inverter output reliability under ambient conditions, essential for digital twin development and related applications.

14 SOLAR ENERGY↗
DOE OSTI2020

Forecasting cosmological constraints from the weak lensing magnification of type Ia supernovae measured by the Nancy Grace Roman Space Telescope

We report that the weak lensing magnification of type Ia supernovae (SNe Ia) is sensitive to the clustering of matter and provides an independent cosmological probe complementary to SN Ia distance measurements. The Nancy Grace Roman Space Telescope is uniquely sensitive to this measurement as it can discover high redshift SNe Ia and measure them with high precision. We present a methodology for reconstructing the probability distribution of the weak lensing magnification μ of SNe Ia, p(μ), from observational data, and using it to constrain cosmological parameters. We find that the reconstructed p(μ) can be fitted accurately by a stretched Gaussian distribution and used to measure the variance of μ, ξ μ , which can be compared to theoretical predictions in a likelihood analysis. Applying our methodology to a set of realistically simulated SNe Ia expected from the Roman Space Telescope, we find that using the weak lensing magnification of the SNe Ia constrains a combination of matter density Ω m and matter clustering amplitude σ 8 . SN Ia distances alone lead to a better than 1% measurement of Ωm. The combination of SN Ia weak lensing magnification and distance measurements result in a ~10 % measurement on σ 8 . The SNe Ia from Roman will be powerful in constraining the cosmological model.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Exploring HOD-dependent systematics for the DESI 2024 Full-Shape galaxy clustering analysis

We analyze the robustness of the DESI 2024 cosmological inference from the full shape of the galaxy power spectrum to uncertainties in the Halo Occupation Distribution (HOD) model of the galaxy-halo connection and the choice of priors on nuisance parameters. We assess variations in the recovered cosmological parameters across a range of mocks populated with different HOD models and find that shifts are often greater than 20% of the expected statistical uncertainties from the DESI data. We encapsulate the effect of such shifts in terms of a systematic covariance term, C HOD , and an additional diagonal contribution quantifying the impact of our choice of nuisance parameter priors on the ability of the effective field theory (EFT) model to correctly recover the cosmological parameters of the simulations. These two covariance contributions are designed to be added to the usual covariance term, C stat , describing the statistical uncertainty in the power spectrum measurement, in order to fairly represent these sources of systematic uncertainty. This novel approach should be more general and robust to the choice of model or additional external datasets used in cosmological fits than the alternative approach of adding systematic uncertainties to the recovered marginalised parameter posteriors. We compare the approaches within the context of a fixed ΛCDM model and demonstrate that our method gives conservative estimates of the systematic uncertainty that nevertheless have little impact on the final posteriors obtained from DESI data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Unsupervised learning-enabled pulsed infrared thermographic microscopy of subsurface defects in stainless steel

Metallic structures produced with laser powder bed fusion (LPBF) additive manufacturing method (AM) frequently contain microscopic porosity defects, with typical approximate size distribution from one to 100 microns. Presence of such defects could lead to premature failure of the structure. In principle, structural integrity assessment of LPBF metals can be accomplished with nondestructive evaluation (NDE). Pulsed infrared thermography (PIT) is a non-contact, one-sided NDE method that allows for imaging of internal defects in arbitrary size and shape metallic structures using heat transfer. PIT imaging is performed using compact instrumentation consisting of a flash lamp for deposition of a heat pulse, and a fast frame infrared (IR) camera for measuring surface temperature transients. However, limitations of imaging resolution with PIT include blurring due to heat diffusion, sensitivity limit of the IR camera. We demonstrate enhancement of PIT imaging capability with unsupervised learning (UL), which enables PIT microscopy of subsurface defects in high strength corrosion resistant stainless steel 316 alloy. PIT images were processed with UL spatial–temporal separation-based clustering segmentation (STSCS) algorithm, refined by morphology image processing methods to enhance visibility of defects. The STSCS algorithm starts with wavelet decomposition to spatially de-noise thermograms, followed by UL principal component analysis (PCA), fine-tuning optimization, and neural learning-based independent component analysis (ICA) algorithms to temporally compress de-noised thermograms. The compressed thermograms were further processed with UL-based graph thresholding K-means clustering algorithm for defects segmentation. The STSCS algorithm also includes online learning feature for efficient re-training of the model with new data. For this study, metallic specimens with calibrated microscopic flat bottom hole defects, with diameters in the range from 203 to 76 µm, were produced using electro discharge machining (EDM) drilling. While the raw thermograms do not show any material defects, using STSCS algorithm to process PIT images reveals defects as small as 101 µm in diameter. To the best of our knowledge, this is the smallest reported size of a sub-surface defect in a metal imaged with PIT, which demonstrates the PIT capability of detecting defects in the size range relevant to quality control requirements of LPBF-printed high-strength metals.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Evaluating HPC Scheduling Strategies for Urgent Workloads

Scientific computing centers increasingly face workloads with diverse urgency requirements, driven by applications that demand rapid or even immediate execution. Appropriately configured scheduling policies can significantly improve both user satisfaction and overall cluster utilization. In this work, we present a systematic analysis of scheduler configurations under scenarios where a fraction of jobs have urgent computing needs. We evaluate multiple job scheduling simulators, develop a lightweight job-submission emulation framework, and create tools to analyze and visualize the resulting scheduling data. Our study identifies key trade-offs between responsiveness, fairness, and efficiency, and offers a set of practical scheduling configurations (particularly for Slurm) that can be tailored to HPC environments supporting mixed-urgency workloads.

Maheshwari, Ketan [ORNL] (ORCID:000000033800662X)↗
DOE OSTI2020

Trajectory prediction via a feature vector approach

Described herein are various technologies pertaining to extracting one or more features from trajectory data recorded during motion of a body, and further, generating a n-dimensional feature vector based upon the one or more extracted features. The n-dimensional feature vector enables expedited analysis of the trajectory data from which the feature vector was generated. For example, rather than having to analyze a trajectory curve comprising a large number of time-position data points, the n-dimensional feature vector can be compared with one or more search parameters to facilitate clustering of the trajectory data associated with the n-dimensional feature vector with other trajectory data which also satisfies the search request. The trajectory data can be plotted on a screen in combination with the n-dimensional feature vector, and other pertinent information. The trajectory data, etc., can be displayed using heat maps or other graphical representation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

DefectTrack: a deep learning-based multi-object tracking algorithm for quantitative defect analysis of in-situ TEM videos in real-time

Abstract In-situ irradiation transmission electron microscopy (TEM) offers unique insights into the millisecond-timescale post-cascade process, such as the lifetime and thermal stability of defect clusters, vital to the mechanistic understanding of irradiation damage in nuclear materials. Converting in-situ irradiation TEM video data into meaningful information on defect cluster dynamic properties (e.g., lifetime) has become the major technical bottleneck. Here, we present a solution called the DefectTrack , the first dedicated deep learning-based one-shot multi-object tracking (MOT) model capable of tracking cascade-induced defect clusters in in-situ TEM videos in real-time. DefectTrack has achieved a Multi-Object Tracking Accuracy (MOTA) of 66.43% and a Mostly Tracked (MT) of 67.81% on the test set, which are comparable to state-of-the-art MOT algorithms. We discuss the MOT framework, model selection, training, and evaluation strategies for in-situ TEM applications. Further, we compare the DefectTrack with four human experts in quantifying defect cluster lifetime distributions using statistical tests and discuss the relationship between the material science domain metrics and MOT metrics. Our statistical evaluations on the defect lifetime distribution suggest that the DefectTrack outperforms human experts in accuracy and speed.

42 ENGINEERING↗
DOE OSTI2020

Multivariate Analysis of Sensor Data NSARD Poster

Poster for the cancelled NSARD meeting. The Federal Program Manager, Angie Waterworth, plans to send posters out to all planned attendees, even though the poster will NO LONGER BE PRESENTED.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Beyond Energy Efficiency: A clustering approach to embed demand flexibility into building energy benchmarking

The intermittency of carbon-free renewables and the demand changes associated with the widespread push for electrifying the transportation and building sectors provides an opportunity for buildings to go beyond energy efficiency and push towards providing demand flexibility to the electricity grid. The duality of energy efficiency and demand flexibility is necessary for success in a sustainable and reliable energy transition. Current building energy benchmarking models are limited in their ability to integrate concepts of demand flexibility and/or utilize granular smart meter data. Thus, current benchmarking methods are focused annual energy usage and fail to incorporate how the time of use of energy consumption impacts emissions in a quickly changing energy grid. Without a more comprehensive view of energy usage and associated real-time emissions, current benchmarking methods are unlikely to realize the full decarbonization potential of buildings. New emerging data streams provide an opportunity to develop a new generation of benchmarking energy models that embed dimensions of energy efficiency, grid interactivity, and demand flexibility into their analysis. In this paper, we propose a four-step method for embedding grid interactivity and demand flexibility into building benchmarking models that utilizes emerging building and time-series electricity data streams. We first engineer features to produce a mix-type dataset that encompasses many attributes of grid-interactive and efficient buildings, and then we apply K-medoids using Gower's Distance to produce peer-group clusters. We apply the method to a case study of 306 primary and secondary schools in southern California, USA. The results show that the method effectively clusters buildings by attributes of demand flexibility and energy efficiency. The clustering results reveal patterns in inefficient building operations and demand inflexibility at the building peer group level. In conclusion, the interpretation of clusters can serve as an integrated energy efficiency and demand flexibility benchmarking model and inform performance-specific policy targeting for buildings that go beyond traditional efficiency measures.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Lowest-energy broad 𝛼-cluster resonances in 19 F

There is strong astrophysical interest in the structure of 19 F states near the α-decay threshold, as their properties are important for understanding the development of α clustering in the 20 Ne region. The emergence of clustered states, and more generally of states that couple strongly to reaction channels near their decay thresholds, is also a topic of current interest in theoretical nuclear physics. In this work, we determine the parameters of broad low-spin states in 19 F near the α-decay threshold and present a theoretical study of these states. The analysis is restricted to ℓ = 0 and 1 resonances in the α + 15 N system close to the α threshold in 19 F. Excitation functions for 15 N(α,α) elastic scattering were measured using the Thick Target Inverse Kinematics (TTIK) method, and these new data, together with older high–energy-resolution measurements, were analyzed within the R-matrix framework. The nuclear structure of 19 F was calculated using configuration-interaction methods with a recently developed effective interaction Hamiltonian. As a result, we identify a sequence of α-cluster resonances in 19 F and map the distribution of clustering strength, which is relevant for astrophysical reaction modeling and for the theoretical understanding of many-body dynamics and the emergence of clustering in loosely bound or unstable nuclei. Furthermore, the work advances theoretical insight into the origins of clustering and highlights open questions for future theoretical and experimental studies.

19F↗
DOE OSTI2022

A novel cosmic filament catalogue from SDSS data

Here, in this work, we present a new catalogue of cosmic filaments obtained from the latest Sloan Digital Sky Survey (SDSS) public data. In order to detect filaments, we implement a version of the Subspace-Constrained Mean-Shift algorithm that is boosted by machine learning techniques. This allows us to detect cosmic filaments as one-dimensional maxima in the galaxy density distribution. Our filament catalogue uses the cosmological sample of SDSS, including Data Release 16, and therefore inherits its sky footprint (aside from small border effects) and redshift coverage. In particular, this means that, taking advantage of the quasar sample, our filament reconstruction covers redshifts up to z = 2.2, making it one of the deepest filament reconstructions to our knowledge. We follow a tomographic approach and slice the galaxy data in 269 shells at different redshift. The reconstruction algorithm is applied to 2D spherical maps. The catalogue provides the position and uncertainty of each detection for each redshift slice. The quality of our detections, which we assess with several metrics, show improvement with respect to previous public catalogues obtained with similar methods. We also detect a highly significant correlation between our filament catalogue and galaxy cluster catalogues built from microwave observations of the Planck Satellite and the Atacama Cosmology Telescope.

79 ASTRONOMY AND ASTROPHYSICS↗