Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52
All sourcesNASA NTRSDOE OSTI
NASA NTRS1973

A comparison of land-use determinations using data from ERTS-1 and high altitude aircraft

A manual interpretation of ERTS-1 MSS system corrected imagery has been performed on a study area within the Houston Area Test Site to classify land use using the Level 1 categories proposed by the Department of the Interior. The two types of imagery used included: (1) black and white transparencies of each band enlarged to a scale of approximately 1:250,000 and (2) color transparencies composited from the computer compatible tapes using the film recorder on a multispectral data analysis station. The results of this interpretation have been compared with the 1970 land use inventory of HATS which was compiled using color ektachrome imagery from high altitude aircraft (scale 1:120,000). Urban data from the same scene was also analyzed using a computer-aided (clustering) technique. The resulting clusters, representing areas of similar content, were compared with existing land use patterns in Houston. A technique was developed to correlate the spectral clusters to specific urban features on aircraft imagery by the location of specific, high contrast objects in particular resolution elements. It was concluded that ERTS-1 data could be used to develop Level 1 and many Level 2 land use categories for regional inventories and perhaps to some degree on a local level.

Lundelius, M. A.↗
NASA NTRS1983

The center for astrophysics redshift survey

Major advances in the art of redshift measurements have improved the obtainable accuracy to better than 30 km/s. It is now posible to obtain a redshift for almost any galaxy brighter than 15th magnitude on a 60-inch telescope in 60 minutes or less. These advances were utilized in an observation program initiated in the spring of 1978. This program represents a survey of radial velocities for all 2400 galaxies brighter than 14.5 at high galactic latitude in the northern hemisphere. The obtained data set has been employed as a basis for a derivation of a good measure of the local mean mass density. In addition, information was obtained concerning the overdensity and the dynamics of the local supercluster, and an analysis was conducted of the dynamics of groups and clusters of galaxies within the sample volume.

Davis, M.↗
NASA NTRS2017

Creating Aerosol Types Form CHemistry (CATCH): a New Algorithm to Extend the Link Between Remote Sensing and Models

Current remote sensing methods can identify aerosol types within an atmospheric column, presenting an opportunity to incrementally bridge the gap between remote sensing and models. Here a new algorithm was designed for Creating Aerosol Types from CHemistry (CATCH). CATCH-derived aerosol types—dusty mix, maritime, urban, smoke, and fresh smoke—are based on first-generation airborne High Spectral Resolution Lidar (HSRL-1) retrievals during the Ship-Aircraft Bio-Optical Research (SABOR) campaign, July/August 2014. CATCH is designed to derive aerosol types from model output of chemical composition. CATCH-derived aerosol types are determined by multivariate clustering of model-calculated variables that have been trained using retrievals of aerosol types from HSRL-1. CATCH-derived aerosol types (with the exception of smoke) compare well with HSRL-1 retrievals during SABOR with an average difference in aerosol optical depth (AOD) <0.03. Data analysis shows that episodic free tropospheric transport of smoke is underpredicted by the Goddard Earth Observing System- with Chemistry (GEOS-Chem) model. Spatial distributions of CATCH-derived aerosol types for the North American model domain during July/August 2014 show that aerosol type-specific AOD values occurred over representative locations: urban over areas with large population, maritime over oceans, smoke, and fresh smoke over typical biomass burning regions. This study demonstrates that model-generated information on aerosol chemical composition can be translated into aerosol types analogous to those retrieved from remote sensing methods. In the future, spaceborne HSRL-1 and CATCH can be used to gain insight into chemical composition of aerosol types, reducing uncertainties in estimates of aerosol radiative forcing.

K W Dawson↗
NASA NTRSDate not supplied

Springtime SEA Air Is Consistently Both Smoky and Humid, but This Relationship (and Its Radiative Effects) Varies Spatially and Seasonally

The atmosphere over the southeast Atlantic Ocean (SEA) sees a consistent springtime biomass burning (BB) smoke from widespread agricultural fires on the African continent. This smoke layer is initially lofted high in a continental mixed layer (~5-6km) and is then transported westward in the free troposphere, where it overlies and ultimately mixes into the SEA stratocumulus-topped oceanic boundary layer. Coincident with this smoke is an elevated humidity signal which is present from the time a given airmass is over the continental source region. ORACLES (ObseRvations of Aerosols above CLouds and their intEractionS) was a NASA Earth Venture Suborbital mission with the goal of measuring aerosol, cloud, and atmospheric properties over this region during three deployments in September 2016, August 2017, and October 2018. A previous study discussed the spatial characteristics of the water vapor-BB plume observations in the September 2016 flight data and their degree of agreement with several atmospheric reanalyses and models. In the present work, we first discuss atmospheric chemistry, structure, and aerosol results from all three ORACLES deployments to place these results in a broader seasonal context. Despite the differing locations and season of each deployment, we show that there continues to be good agreement between the airborne ORACLES dataset and large-scale reanalyses, specifically the ECMWF ERA5 and CAMS reanalyses. Other reanalyses (specifically NASA's MERRA-2) preserved the observed correlation between meteorology and biomass burning conditions, but, as was seen for 2016, was frequently displaced spatially relative to the observations. The CAMS reanalysis performs better with water vapor than with CO. Results comparing CAMS column AOD to the field measurements show slight overestimates, consistent with previous analysis, but the good relationship observed between AOD and inlet-based aerosol extinction demonstrates this metric's utility to broader studies. The good ERA5/CAMS/ORACLES agreement allows us to next examine the multi-year seasonal patterns and trends beyond the three ORACLES deployment periods. Looking at seven years of reanalysis data for the BB season, we find distinct variations between each month/deployment in terms of vertical smoke distribution and correlation to atmospheric specific humidity, due to changing conditions through the BB season. Using k-means clustering of these climatological reanalysis, we identify six canonical atmospheric profile types of varying total atmospheric humidity and vertical structure and describe their changing incidence spatially and throughout the season, and six analogous profile types for carbon monoxide, allowing us to characterize the atmospheric structure of both vapor and BB over time throughout the SEA region. This classification will allow for a more complete analysis of the broader radiative and dynamical effects of humid aerosols overlying stratocumulus clouds.

Kristina Marie Myers Pistone↗
DOE OSTI2024

Machine Learning-Driven Reliability Estimation of PV Inverters Considering Alert-Ambient Variability

Weather-induced spatio-temporal degradation limits outdoor PV inverter lifetime and reliability, necessitating advanced data analysis. This study employs a top-down, data-driven approach utilizing multiple machine learning (ML) algorithms to estimate inverter reliability in a 1.4 MW PV power plant, considering factors such as irradiance, humidity, temperature, time of day, and weather conditions. An extensive alert dataset from 17 identical inverters, including alert types, propagation, and frequency, reveals significant correlations with environmental factors and inverter output power, enabling the construction of a performance reliability model. Dual-stage supervised-ML models are evaluated for accuracy, with the ‘classification-regression’ model by an artificial neural network (ANN) tested on the averaged “Alert-Ambient” dataset, which is outperformed by ‘clustering-regression’ models using random forest (RF) and K-Nearest Neighbors (KNN) on individual inverter datasets. K-means clustering applies principal component analysis to reduce dimensions, achieving improved accuracy beyond the 80% achieved by ANN on the averaged dataset. Second-stage regression estimates inverter reliability with a mean square error of 0.0195 on the averaged dataset and as low as 0.002 on individual inverter datasets using RF. Furthermore, these findings highlight the method's suitability for estimating PV inverter output reliability under ambient conditions, essential for digital twin development and related applications.

14 SOLAR ENERGY↗
DOE OSTI2020

Forecasting cosmological constraints from the weak lensing magnification of type Ia supernovae measured by the Nancy Grace Roman Space Telescope

We report that the weak lensing magnification of type Ia supernovae (SNe Ia) is sensitive to the clustering of matter and provides an independent cosmological probe complementary to SN Ia distance measurements. The Nancy Grace Roman Space Telescope is uniquely sensitive to this measurement as it can discover high redshift SNe Ia and measure them with high precision. We present a methodology for reconstructing the probability distribution of the weak lensing magnification μ of SNe Ia, p(μ), from observational data, and using it to constrain cosmological parameters. We find that the reconstructed p(μ) can be fitted accurately by a stretched Gaussian distribution and used to measure the variance of μ, ξ μ , which can be compared to theoretical predictions in a likelihood analysis. Applying our methodology to a set of realistically simulated SNe Ia expected from the Roman Space Telescope, we find that using the weak lensing magnification of the SNe Ia constrains a combination of matter density Ω m and matter clustering amplitude σ 8 . SN Ia distances alone lead to a better than 1% measurement of Ωm. The combination of SN Ia weak lensing magnification and distance measurements result in a ~10 % measurement on σ 8 . The SNe Ia from Roman will be powerful in constraining the cosmological model.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS1973

Analysis of Mossbauer Fe-57 absorption in an F.C.C. Fe-Co-V alloy

Mossbauer Fe-57 absorption spectra of superparamagnetic F.C.C. Fe sub .34 Co sub .52 V sub 14 (Vicalloy II) have been analyzed using a cluster model and magnetic resonance relaxation theory. The number and magnetic moment of the clusters were determined from magnetization data. A least squares fit to the spectrum at 4.2 K gives sub Hhyp = 175. kG, substantially greater than the value 55 kG inferred just from the observed broadening of the single line spectrum. From this broadening an estimate of 40 kG is obtained for the width of the distribution in Hhyp at 4.2 K arising from compositional fluctuations sub and small cluster effects.

Bambakidis, G.↗
DOE OSTI2025

Exploring HOD-dependent systematics for the DESI 2024 Full-Shape galaxy clustering analysis

We analyze the robustness of the DESI 2024 cosmological inference from the full shape of the galaxy power spectrum to uncertainties in the Halo Occupation Distribution (HOD) model of the galaxy-halo connection and the choice of priors on nuisance parameters. We assess variations in the recovered cosmological parameters across a range of mocks populated with different HOD models and find that shifts are often greater than 20% of the expected statistical uncertainties from the DESI data. We encapsulate the effect of such shifts in terms of a systematic covariance term, C HOD , and an additional diagonal contribution quantifying the impact of our choice of nuisance parameter priors on the ability of the effective field theory (EFT) model to correctly recover the cosmological parameters of the simulations. These two covariance contributions are designed to be added to the usual covariance term, C stat , describing the statistical uncertainty in the power spectrum measurement, in order to fairly represent these sources of systematic uncertainty. This novel approach should be more general and robust to the choice of model or additional external datasets used in cosmological fits than the alternative approach of adding systematic uncertainties to the recovered marginalised parameter posteriors. We compare the approaches within the context of a fixed ΛCDM model and demonstrate that our method gives conservative estimates of the systematic uncertainty that nevertheless have little impact on the final posteriors obtained from DESI data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Unsupervised learning-enabled pulsed infrared thermographic microscopy of subsurface defects in stainless steel

Metallic structures produced with laser powder bed fusion (LPBF) additive manufacturing method (AM) frequently contain microscopic porosity defects, with typical approximate size distribution from one to 100 microns. Presence of such defects could lead to premature failure of the structure. In principle, structural integrity assessment of LPBF metals can be accomplished with nondestructive evaluation (NDE). Pulsed infrared thermography (PIT) is a non-contact, one-sided NDE method that allows for imaging of internal defects in arbitrary size and shape metallic structures using heat transfer. PIT imaging is performed using compact instrumentation consisting of a flash lamp for deposition of a heat pulse, and a fast frame infrared (IR) camera for measuring surface temperature transients. However, limitations of imaging resolution with PIT include blurring due to heat diffusion, sensitivity limit of the IR camera. We demonstrate enhancement of PIT imaging capability with unsupervised learning (UL), which enables PIT microscopy of subsurface defects in high strength corrosion resistant stainless steel 316 alloy. PIT images were processed with UL spatial–temporal separation-based clustering segmentation (STSCS) algorithm, refined by morphology image processing methods to enhance visibility of defects. The STSCS algorithm starts with wavelet decomposition to spatially de-noise thermograms, followed by UL principal component analysis (PCA), fine-tuning optimization, and neural learning-based independent component analysis (ICA) algorithms to temporally compress de-noised thermograms. The compressed thermograms were further processed with UL-based graph thresholding K-means clustering algorithm for defects segmentation. The STSCS algorithm also includes online learning feature for efficient re-training of the model with new data. For this study, metallic specimens with calibrated microscopic flat bottom hole defects, with diameters in the range from 203 to 76 µm, were produced using electro discharge machining (EDM) drilling. While the raw thermograms do not show any material defects, using STSCS algorithm to process PIT images reveals defects as small as 101 µm in diameter. To the best of our knowledge, this is the smallest reported size of a sub-surface defect in a metal imaged with PIT, which demonstrates the PIT capability of detecting defects in the size range relevant to quality control requirements of LPBF-printed high-strength metals.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Evaluating HPC Scheduling Strategies for Urgent Workloads

Scientific computing centers increasingly face workloads with diverse urgency requirements, driven by applications that demand rapid or even immediate execution. Appropriately configured scheduling policies can significantly improve both user satisfaction and overall cluster utilization. In this work, we present a systematic analysis of scheduler configurations under scenarios where a fraction of jobs have urgent computing needs. We evaluate multiple job scheduling simulators, develop a lightweight job-submission emulation framework, and create tools to analyze and visualize the resulting scheduling data. Our study identifies key trade-offs between responsiveness, fairness, and efficiency, and offers a set of practical scheduling configurations (particularly for Slurm) that can be tailored to HPC environments supporting mixed-urgency workloads.

Maheshwari, Ketan [ORNL] (ORCID:000000033800662X)↗
NASA NTRS1991

Pilot personality and crew coordination - Implications for training and selection

It is contended that past failures to find linkages between performance and personality were due to a combination of premature performance evaluation, inadequate statistical modeling, and/or the reliance on data gathered in contrived as opposed to realistic situations. The goal of the research presented is to isolate subgroups of pilots along performance-related personality dimensions and to document limits on the impact of crew coordination training between the groups. Three different profiles were identified through cluster analysis of personality scales that replicated across samples and predicted attitude change following training in crew coordination.

Chidester, Thomas R.↗
DOE OSTI2020

Trajectory prediction via a feature vector approach

Described herein are various technologies pertaining to extracting one or more features from trajectory data recorded during motion of a body, and further, generating a n-dimensional feature vector based upon the one or more extracted features. The n-dimensional feature vector enables expedited analysis of the trajectory data from which the feature vector was generated. For example, rather than having to analyze a trajectory curve comprising a large number of time-position data points, the n-dimensional feature vector can be compared with one or more search parameters to facilitate clustering of the trajectory data associated with the n-dimensional feature vector with other trajectory data which also satisfies the search request. The trajectory data can be plotted on a screen in combination with the n-dimensional feature vector, and other pertinent information. The trajectory data, etc., can be displayed using heat maps or other graphical representation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

DefectTrack: a deep learning-based multi-object tracking algorithm for quantitative defect analysis of in-situ TEM videos in real-time

Abstract In-situ irradiation transmission electron microscopy (TEM) offers unique insights into the millisecond-timescale post-cascade process, such as the lifetime and thermal stability of defect clusters, vital to the mechanistic understanding of irradiation damage in nuclear materials. Converting in-situ irradiation TEM video data into meaningful information on defect cluster dynamic properties (e.g., lifetime) has become the major technical bottleneck. Here, we present a solution called the DefectTrack , the first dedicated deep learning-based one-shot multi-object tracking (MOT) model capable of tracking cascade-induced defect clusters in in-situ TEM videos in real-time. DefectTrack has achieved a Multi-Object Tracking Accuracy (MOTA) of 66.43% and a Mostly Tracked (MT) of 67.81% on the test set, which are comparable to state-of-the-art MOT algorithms. We discuss the MOT framework, model selection, training, and evaluation strategies for in-situ TEM applications. Further, we compare the DefectTrack with four human experts in quantifying defect cluster lifetime distributions using statistical tests and discuss the relationship between the material science domain metrics and MOT metrics. Our statistical evaluations on the defect lifetime distribution suggest that the DefectTrack outperforms human experts in accuracy and speed.

42 ENGINEERING↗
NASA NTRS1994

Structural analysis of airborne flux estimates over a region

Aircraft-based observations of turbulence fields of velocity, moisture, and temperature are used to study coherent turbulent structures that dominate turbulent transfer of moisture and heat above three different eco-systems. Flux traces are defragmented, to reconstruct the presumed full size (along the sampled transect) of these structures, and flux traces are simplified by elimination of those that contribute negligibly to the flux estimate. Structures are analyzed in terms of size, spatial distribution, and contribution to the flux, in the four 'quadrant' modes of eddy-covariance transfer (excess up/down and deficit up/down). The effect of nonlinear detrending of moisture and temperature data on this 'structural analysis,' over surfaces with heterogeneous surface wetness, is also examined. Results over grassland, wetland, and moist and dry agricultural land, show that nonlinear detrending may provide a more physically realistic description of structures. Significant differences are observed between structure size and associated relative flux contribution, between moist and dry areas, with smaller structures playing a more important role over the moist areas. Structure size generally increases with height, as spatial reorganization from smaller structures into larger ones takes place. This coincides with a gradual loss of surface 'signature' (position and clustering of plumes above localized source areas). The data are expected to provide a basis for an eventual statistical description of boundary-layer transfer events , and help to interpret the link between boundary-layer transfer and hydrological surface conditions.

Caramori, Paulo↗
DOE OSTI2020

Multivariate Analysis of Sensor Data NSARD Poster

Poster for the cancelled NSARD meeting. The Federal Program Manager, Angie Waterworth, plans to send posters out to all planned attendees, even though the poster will NO LONGER BE PRESENTED.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Beyond Energy Efficiency: A clustering approach to embed demand flexibility into building energy benchmarking

The intermittency of carbon-free renewables and the demand changes associated with the widespread push for electrifying the transportation and building sectors provides an opportunity for buildings to go beyond energy efficiency and push towards providing demand flexibility to the electricity grid. The duality of energy efficiency and demand flexibility is necessary for success in a sustainable and reliable energy transition. Current building energy benchmarking models are limited in their ability to integrate concepts of demand flexibility and/or utilize granular smart meter data. Thus, current benchmarking methods are focused annual energy usage and fail to incorporate how the time of use of energy consumption impacts emissions in a quickly changing energy grid. Without a more comprehensive view of energy usage and associated real-time emissions, current benchmarking methods are unlikely to realize the full decarbonization potential of buildings. New emerging data streams provide an opportunity to develop a new generation of benchmarking energy models that embed dimensions of energy efficiency, grid interactivity, and demand flexibility into their analysis. In this paper, we propose a four-step method for embedding grid interactivity and demand flexibility into building benchmarking models that utilizes emerging building and time-series electricity data streams. We first engineer features to produce a mix-type dataset that encompasses many attributes of grid-interactive and efficient buildings, and then we apply K-medoids using Gower's Distance to produce peer-group clusters. We apply the method to a case study of 306 primary and secondary schools in southern California, USA. The results show that the method effectively clusters buildings by attributes of demand flexibility and energy efficiency. The clustering results reveal patterns in inefficient building operations and demand inflexibility at the building peer group level. In conclusion, the interpretation of clusters can serve as an integrated energy efficiency and demand flexibility benchmarking model and inform performance-specific policy targeting for buildings that go beyond traditional efficiency measures.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2003

Patterns of global gene expression in rat skeletal muscle during unloading and low-intensity ambulatory activity

Physical inactivity and unloading lead to diverse skeletal muscle alterations. Our goal was to identify the genes in skeletal muscle whose expression is most sensitive to periods of unloading/reduced physical activity and that may be involved in triggering initial responses before phenotypic changes are evident. The ability of short periods of physical activity/loading as an effective countermeasure against changes in gene expression mediated by inactivity was also tested. Affymetrix microarrays were used to compare mRNA levels in the soleus muscle under three experimental treatments (n = 20-29 rats each): 12-h hindlimb unloading (HU), 12-h HU followed by 4 h of intermittent low-intensity ambulatory and postural activity (4-h reloading), and control (with ambulatory and postural activity). Using a combination of criteria, we identified a small set of genes (approximately 1% of 8,738 genes on the array or 4% of significant expressed genes) with the most reproducible and largest responses to altered activity. Analysis revealed a coordinated regulation of transcription for a large number of key signaling proteins and transcription factors involved in protein synthesis/degradation and energy metabolism. Most (21 of 25) of the gene expression changes that were downregulated during HU returned at least to control levels during the reloading. In surprising contrast, 27 of 38 of the genes upregulated during HU remained significantly above control, but most showed trends toward reversal. This introduces a new concept that, in general, genes that are upregulated during unloading/inactivity will be more resistant to periodic reloading than those genes that are downregulated. This study reveals genes that are the most sensitive to loading/activity in rat skeletal muscle and indicates new targets that may initiate muscle alterations during inactivity.

NASA Discipline Musculoskeletal↗
NASA NTRS2004

From the Cluster Temperature Function to the Mass Function at Low Z

This XMM project consisted of three observations of the nearby, hot galaxy cluster Triangulum Australis, one of the cluster center and two offsets. The goal was to measure the radial gas temperature profile out to large radii and derive the total gravitating mass within the radius of average mass overdensity 500. The central pointing also provides data for a detailed two-dimensional gas temperature map of this interesting cluster. We have analyzed all three observations. The derivation of the temperature map using the central pointing is complete, and the paper is soon to be submitted. During the course of this study and of the analysis of archival XMM cluster observations, it became apparent that the commonly used XMM background flare screening techniques are often not accurate enough for studies of the cluster outer regions. The information on the cluster's total masses is contained at large off-center distances, and it is precisely the temperatures for those low-brightness regions that are most affected by the detector background anomalies. In particular, our two offset observations of the Triangulum have been contaminated by the background flares ("bad cosmic weather") to a degree where they could not be used for accurate spectral analysis. This forced us to expand the scope of our project. We needed to devise a more accurate method of screening and modeling the background flares, and to evaluate the uncertainty of the XMM background modeling. To do this, we have analyzed a large number of archival EPIC blank-field and closed-cover observations. As a result, we have derived stricter background screening criteria. It also turned out that mild flares affecting EPIC-pn can be modeled with an adequate accuracy. Such modeling has been used to derive our Triangulum temperature map. The results of our XMM background analysis, including the modeling recipes, are presented in a paper which is in final preparation and will be submitted soon. It will be useful not only for our future analysis but for other XMM cluster observations as well.

Mushotzky, Richard↗