Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Real-time X-ray phase-contrast imaging using SPINNet—a speckle-based phase-contrast imaging neural network

X-ray phase-contrast imaging has become indispensable for visualizing samples with low absorption contrast. In this regard, speckle-based techniques have shown significant advantages in spatial resolution, phase sensitivity, and implementation flexibility compared with traditional methods. However, the computational cost associated with data inversion has hindered their wider adoption. By exploiting the power of deep learning, we developed a speckle-based phase-contrast imaging neural network (SPINNet) that significantly improves the imaging quality and boosts the phase retrieval speed by at least 2 orders of magnitude compared to existing methods. To achieve this performance, we combined SPINNet with a coded-mask-based technique, an enhanced version of the speckle-based method. Using this scheme, we demonstrate the simultaneous reconstruction of absorption and phase images on the order of 100 ms, where a traditional correlation-based analysis would take several minutes even with a cluster. In addition to significant improvement in speed, our experimental results show that the imaging and phase retrieval quality of SPINNet outperform existing single-shot speckle-based methods. Furthermore, we successfully demonstrate SPINNet application in x-ray optics metrology and 3D x-ray phase-contrast tomography. Our result shows that SPINNet could enable many applications requiring high-resolution and fast data acquisition and processing, such as in situ and in operando 2D and 3D phase-contrast imaging and real-time at-wavelength metrology and wavefront sensing.

36 MATERIALS SCIENCE↗
DOE OSTI2020

A new phenomenological model to describe root-soil interactions based on percolation theory

In his paper on net primary productivity of terrestrial communities predicted from climatological data, Rosenzweig (1968) argued that variability in productivity is well accounted for by (evapo)-transpiration, and that water from transpiration is, on global scales, the most variable component in the photosynthesis reaction. The goal of this paper is to investigate whether variability in plant growth on local scales and within species is primarily related to transpiration under several scenarios including different terrain curvature, slope aspect, soil characteristics, and climate ranges. Here, we test the hypothesis that this relationship exists because root growth into the surface soil layers (0–2 m) tends to follow paths with minima in resistance, which in turn maximizes water flow and nutrient delivery rates that regulate growth. The set of all connected paths with individual pore-to-pore flow resistances less than a critical, percolating, value forms a cluster with mass fractal dimensionality, d f . We propose that roots follow paths through the 2D percolation cluster, defining the set of all optimal flow paths, making the 2D value of d f from percolation relevant to root fractal dimensionality. The tortuosity of such optimal paths as defined in percolation theory should then relate root length to root radial extent, linking the parameters of root tortuosity and plant productivity. Our analysis of large data sets across species implies that root radial extent and tree height are both proportional to cumulative transpiration until trees approached maximum height, and their growth rates are proportional to the transpiration rate, not to the moisture content. Local variations in tree height as functions of the variables investigated appear generally consistent with deduced variations in transpiration. Here this correlation is investigated more closely in the context of studies addressing individual tree species.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2014

Acoustic Data Processing and Transient Signal Analysis for the Hybrid Wing Body 14- by 22-Foot Subsonic Wind Tunnel Test

An advanced vehicle concept, the HWB N2A-EXTE aircraft design, was tested in NASA Langley's 14- by 22-Foot Subsonic Wind Tunnel to study its acoustic characteristics for var- ious propulsion system installation and airframe con gurations. A signi cant upgrade to existing data processing systems was implemented, with a focus on portability and a re- duction in turnaround time. These requirements were met by updating codes originally written for a cluster environment and transferring them to a local workstation while en- abling GPU computing. Post-test, additional processing of the time series was required to remove transient hydrodynamic gusts from some of the microphone time series. A novel automated procedure was developed to analyze and reject contaminated blocks of data, under the assumption that the desired acoustic signal of interest was a band-limited sta- tionary random process, and of lower variance than the hydrodynamic contamination. The procedure is shown to successfully identify and remove contaminated blocks of data and retain the desired acoustic signal. Additional corrections to the data, mainly background subtraction, shear layer refraction calculations, atmospheric attenuation and microphone directivity corrections, were all necessary for initial analysis and noise assessments. These were implemented for the post-processing of spectral data, and are shown to behave as expected.

Bahr, Christopher J.↗
NASA NTRS1999

Dependence of Cumulus Anvil Radiative Properties on Environmental Conditions in the Tropical West Pacific

Areally extensive, optically thick anvil clouds associated with mesoscale convective clusters dominate the shortwave cloud forcing in the tropics and provide longwave forcing comparable to that of thin cirrus. Changes in the cover and optical thickness of tropical anvils as climate warms can regulate the sign of cloud feedback. As a prelude to the study of MMCR data from the ARM TWP sites, we analyze ISCCP-derived radiative characteristics of anvils observed in the tropical west Pacific during the TOGA-COARE IOP. Anvils with radius greater than 100 km were identified and tracked from inception to decay using the Machado-Rossow algorithm. Corresponding environmental conditions just prior to the start of the convectove event were diagnosed using the Lin-Johnson objective analysis product. Small clusters (100-200 km radius) are observed to have a broad range of optical thicknesses (10-50), while intermediate optical thickness clusters are observed to range in size from 100 km to almost 1000 km. Large-size clusters appear to be favored by strong pre-storm large scale upward motion throughout the troposphere, moist low-to-midlevel relative humidities, environments with slightly higher CAPE than those for smaller clusters, and strong front-to-rear flow. Optically thick anvils are favored in situations of strong low-level moisture convergence and strong upper-level shear.

Ye, B.↗
DOE OSTI2024

Early dark energy constraints with late-time expansion marginalization

Abstract Early dark energy (EDE) is an extension to the ΛCDM model that includes an additional energy density contribution near recombination. The model was proposed to reduce the tension between the measurements of the Hubble constantH 0 from the cosmic microwave background (CMB) and from the local cosmic distance ladder. Some analyses in the recent literature have shown intriguing hints for EDE. However, this model increases the tension in the derived clustering of galaxies (as measured by the so-calledS 8 parameter) between CMB and large scale structure (LSS) measurements. This new tension limits the contribution of EDE during recombination, and thus its effect on the Hubble tension. In this work, we investigate whether the inclusion of a general, smooth late-time dark energy modification can increase back the EDE contribution when LSS data is included in the analysis. In order to generalize the late expansion with respect to the ΛCDM model, we substitute the cosmological constant by a late dark energy fluid model with a piecewise constant equation of state w(z) in redshift bins. We show that, when analysing this generalized model with combinations of CMB, LSS and type Ia supernovae data from several experiments no significant changes onS 8 and EDE parameter constraints is found. The contribution to the EDE fraction constraint with late-time expansion marginalization isf EDE = 0.067 +0.019 -0.027 using 3 redshift bins, with similar results for 5 and 10 redshift bins. This work shows that in order to solve simultaneously the Hubble andS 8 tensions, one needs a mechanism for increasing the clustering of matter at late times different from a simple change in the background evolution of late dark energy.

Astronomy & Astrophysics↗
DOE OSTI2021

Subaru Hyper Suprime-Cam revisits the large-scale environmental dependence on galaxy morphology over 360 deg2 at z = 0.3–0.6

This study investigates the role of large-scale environments on the fraction of spiral galaxies at z = 0.3–0.6 sliced to three redshift bins of Δz = 0.1. Here, we sample 276220 massive galaxies in a limited stellar mass of 5 × 1010 solar mass (~M*) over 360 deg2, as obtained from the Second Public Data Release of the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP). By combining projected two-dimensional density information (Shimakawa et al. 2021, MNRAS, 503, 3896) and the CAMIRA cluster catalog (Oguri et al. 2018, PASJ, 70, S20), we investigate the spiral fraction across large-scale overdensities and in the vicinity of red sequence clusters. We adopt transfer learning to reduce the cost of labeling spiral galaxies significantly and then perform stacking analysis across the entire field to overcome the limitations of sample size. Here we employ a morphological classification catalog by the Galaxy Zoo Hubble (Willett et al., 2017, MNRAS, 464, 4176) to train the deep learning model. Based on 74103 sources classified as spirals, we find moderate morphology–density relations on a 10 comoving Mpc scale, thanks to the wide-field coverage of HSC-SSP. Clear deficits of spiral galaxies have also been confirmed, in and around 1136 red sequence clusters. Furthermore, we verify whether there is a large-scale environmental dependence on rest-frame u - r colors of spiral galaxies; such a tendency was not observed in our sample.

Astronomy & Astrophysics↗
NASA NTRS2017

Classification of Meteorological Influences Surrounding Extreme Precipitation Events in the United States using the MERRA-2 Reanalysis

Extreme precipitation events can have a large impact on society through flooding that can result in property destruction, crop losses, economic losses, the spread of water-borne diseases, and fatalities. Observations indicate there has been a statistically significant increase in extreme precipitation events over the past 15 years in the Northeastern United States and other localized regions of the country have become crippled with record flooding events, for example, the flooding that occurred in the Southeast United States associated with Hurricane Matthew in October 2016. Extreme precipitation events in the United States can be caused by various meteorological influences such as extratropical cyclones, tropical cyclones, mesoscale convective complexes, general air mass thunderstorms, upslope flow, fronts, and the North American Monsoon. Reanalyses, such as the Modern Era Retrospective Analysis for Research and Applications, version 2 (MERRA-2), have become a pivotal tool to study the meteorology surrounding extreme precipitation events. Using days classified as an extreme precipitation events based on a combination of observational gauge and radar data, two techniques for the classification of these events are used to gather additional information that can be used to determine how events have changed over time using atmospheric data from MERRA-2. The first is self organizing maps, which is an artificial neural network that uses unsupervised learning to cluster like patterns and the second is an automated detection technique that searches for characteristics in the atmosphere that define a meteorological phenomena. For example, the automated detection for tropical cycles searches for a defined area of suppressed sea level pressure, alongside thickness anomalies aloft, indicating the presence of a warm core. These techniques are employed for extreme precipitation events in preselected regions that were chosen based an analysis of the climatology of precipitation.

Monsoon↗
NASA NTRS2004

More Far-Side Deep Moonquake Nests Discovered

As reported last year, we started to reanalyze the seismic data acquired from 1969 to 1977 with a network of stations established on the Moon during the Apollo mission. The reason for the reanalysis was because recent advances in computer technology make it possible to employ much more sophisticated analysis techniques than was possible previously. The primary objective of the reanalysis was to search for deep moonquakes on the far side of the Moon and, if found, to use them to infer the structure of the Moon's deep interior, including a possible central core. The first step was to identify any new deep moonquakes that escaped our earlier search by applying a combination of waveform cross-correlation and single-link cluster analysis, and then to see if any of them are from previously unknown nests of deep moonquakes. We positively identified 7245 deep moonquakes, more than a five-fold increase from the previous 1360. We also found at least 88 previously unknown deep-moonquake nests. The question was whether any of these newly discovered nets were on the far side of the Moon, and we now report that our analysis of the data indicates that some of them are indeed on the far side.

Nakamura, Y.↗
DOE OSTI2020

Automated identification of deformation twin systems in Mg WE43 from SEM DIC

In this study, the application of machine learning and computer vision approaches to microscale deformation data for the automated identification of deformation twinning systems, and their associated twin area, is introduced. Deformation data was obtained during in-situ SEM compression testing of a WE43 Mg alloy using digital image correlation (DIC) modified for use with electron microscopy. A 5.7 mm × 3.4 mm area of interest was analyzed, generating ~100 million data points of deformation. Experimental twin trace directions were determined by applying k-means clustering, morphological thinning, and Hough transforms to the deformation data. The identification of deformation twinning was achieved by consideration of the twin trace direction, its strain value, and its evolution. The deformation map was divided into areas corresponding to individual active twin systems, enabling the analysis of microstructure dependence of deformation behavior and twinning activity. The performance of the proposed twinning identification approach was evaluated by accuracy, precision, and sensitivity metrics. The effect of the tuning parameters used in the algorithm on the performance is also discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2020

How good are polarizable and flexible models for water: Insights from a many-body perspective

We present a systematic analysis of state-of-the-art polarizable and flexible water models from a many-body perspective, with a specific focus on their ability to represent the Born–Oppenheimer potential energy surface of water from the gas to the liquid phase. Using coupled cluster data in the completed basis set limit as a reference, we examine the accuracy of the polarizable models in reproducing individual many-body contributions to interaction energies and harmonic frequencies of water clusters and compare their performance with that of MB-pol, an explicit many-body model that has been shown to correctly predict the properties of water across the entire phase diagram. Based on these comparisons, we use MB-pol as a reference to analyze the ability of the polarizable models to reproduce the energy landscape of liquid water under ambient conditions. We find that, while correctly reproducing the energetics of minimum-energy structures, the polarizable models examined in this study suffer from inadequate representations of many-body effects for distorted configurations. To investigate the role played by geometry-dependent representations of 1-body charge distributions in reproducing coupled cluster data for both interaction and many-body energies, we introduce a simplified version of MB-pol that adopts fixed atomic charges and demonstrate that the new model retains the same accuracy as the original MB-pol model. Based on the analyses presented in this study, we believe that future developments of both polarizable and explicit many-body models should continue in parallel and would benefit from synergistic efforts aimed at integrating the best aspects of the two theoretical/computational frameworks.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Distinguishing time clustering of astrophysical bursts

Many astrophysical bursts can recur, and their time series structure or pattern could be closely tied to the emission and system physics. While analysis of periodic events is well established, some sources, e.g., some fast radio bursts and soft gamma-ray emitters, are suspected of more subtle and less explored periodic windowed behavior: the bursts themselves are not periodic, but the activity only occurs during periodic windows. Here, we focus on distinguishing periodic windowed behavior from merely clustered events through time clustering analysis, using techniques analogous to spatial clustering, demonstrating methods for identifying and characterizing the behavior. An important aspect is accounting for the “curious incident of the dog in the night time”—lack of bursts carries information. As a worked example, we analyze six years of data from the soft gamma repeater SGR 1935 + 2154 , deriving a window period of 231 days and 55% duty cycle.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Pair distribution function analysis of discrete nanomaterials in PDFgui

Pair distribution functions (PDFs) are a leading tool for atomic structure analysis of nanomaterials. However, the most widely used programs for refining atomic structure against PDF data are based on extended crystallographic models, which cannot be applied to discrete, whole nanoparticles. Furthermore, this work describes a straightforward approach to simulate and refine atomistic models of discrete clusters and nanoparticles employing widely used PDF modelling programs such as PDFgui that utilize extended crystallographic models. In this approach, the whole particle to be modelled is contained within an expanded, and otherwise empty, unit cell that is sufficiently large to avoid correlations between atoms in neighbouring unit cells over the r range analyzed. The PDF of the particle is simulated as a composite using two conventional `phases': one that calculates the atom–atom correlations and one that approximates the local number density. This approach is first validated for large nanoparticles that are well modelled by a conventional shape factor model, and then applied to simulate the PDF of discrete particles and low-dimensional materials (graphene and MXene) and to model the experimental PDF data for single-layer FeS nanosheets. A comparison of this approach with the DiffPy-CMI program, which calculates the PDF of discrete species, shows that the composite modelling approach is equally or more accurate. Example input files for implementing this approach within PDFgui and TOPAS, and recommendations for selecting model parameters for reliable application of this refinement strategy, are provided.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Detecting Living-off-the-land Attacks Using K-means And Graph Convolutional Networks

The code ingests Zeek logs derived from network packet captures and goes through data preprocessing before it gets passed into a K-Means model that labels each device as either a client or server. Graph Convolutional Network (GCN) model is used to obtain the embeddings to represent the features in lower dimension. Last, K-means cluster analysis is used to cluster the embeddings for each class.

Quach, Anna [Idaho National Laboratory (INL), Idah↗
NASA NTRS1983

Image processing in remote sensing data analysis - The state of the art

Image analysis techniques applicable to remote sensing data and covering image models, feature detection, segmentation and classification, texture analysis, and matching are studied. Model types for characterizing images examined include random-field, mosaic, and facet models. Edge and corner detection as well as global extraction of linear features are discussed. Pixel clustering and classification are covered in addition to the regional approach to segmentation. Autocorrelation, second-order gray level probability density, and the use of primitive element statistics are discussed in relation to texture analysis. Finally, reducing the cost of (sub)imaging matching methods (e.g., pixelwise comparison of gray levels and normalized cross-correlation between two images) as well as improving match sharpness is considered.

Rosenfeld, A.↗
NASA NTRS1991

Fusion of monocular cues to detect man-made structures in aerial imagery

The extraction of buildings from aerial imagery is a complex problem for automated computer vision. It requires locating regions in a scene that possess properties distinguishing them as man-made objects as opposed to naturally occurring terrain features. It is reasonable to assume that no single detection method can correctly delineate or verify buildings in every scene. A cooperative-methods paradigm is useful in approaching the building extraction problem. Using this paradigm, each extraction technique provides information which can be added or assimilated into an overall interpretation of the scene. Thus, the main objective is to explore the development of computer vision system that integrates the results of various scene analysis techniques into an accurate and robust interpretation of the underlying three dimensional scene. The problem of building hypothesis fusion in aerial imagery is discussed. Building extraction techniques are briefly surveyed, including four building extraction, verification, and clustering systems. A method for fusing the symbolic data generated by these systems is described, and applied to monocular image and stereo image data sets. Evaluation methods for the fusion results are described, and the fusion results are analyzed using these methods.

Shufelt, Jefferey↗
NASA NTRS1993

Automatic definition of spectral units in the equatorial regions of Mars

ISM was the first instrument that acquired spectra of small areas (25x25 sq km) on a planetary surface. The data set consists mainly in images made up of about 3000 such pixels, each one corresponding to a near-infrared spectrum (0.76 to 3.15 microns in 128 spectral channels) with high signal-to-noise ratio. These data were used to define spectral units and to constrain the mineralogy of surface materials in the equatorial regions of the planet. Future spaceborne imaging spectrometers (e.g. OMEGA on board the Mars-94 Russian spacecraft) are expected to provide several hundred times as much data as ISM, so there's a strong need for fast and reliable processing methods. The present work is an attempt to define spectral units in the region of Syrtis Major-Isidis Planitia by means of G-mode analysis. The method allows to cluster the spectra according to their similarities; different levels of classification can be achieved by tuning a threshold of confidence.

Erard, Stephane↗
NASA NTRS2006

Hera - The HEASARC's New Data Analysis Service

Hera is the new computer service provided by the HEASARC at the NASA Goddard Space Flight Center that enables qualified student and professional astronomical researchers to immediately begin analyzing scientific data from high-energy astrophysics missions. All the necessary resources needed to do the data analysis are freely provided by Hera, including: * the latest version of the hundreds of scientific analysis programs in the HEASARC's HEASOFT package, as well as most of the programs in the Chandra CIAO package and the XMM-Newton SAS package. * high speed access to the terabytes of data in the HEASARC's high energy astrophysics Browse data archive. * a cluster of fast Linw workstations to run the software * ample local disk space to temporarily store the data and results. Some of the many features and different modes of using Hera are illustrated in this poster presentation.

Pence, William↗
DOE OSTI2021

PandAna: A Python Analysis Framework for Scalable High Performance Computing in High Energy Physics

Modern experiments in high energy physics analyze millions of events recorded in particle detectors to select the events of interest and make measurements of physics parameters. These data can often be stored as tabular data in files with detector information and reconstructed quantities. Current techniques for event selection in these files lack the scalability needed for high performance computing environments. We describe our work to develop a high energy physics analysis framework suitable for high performance computing. This new framework utilizes modern tools for reading files and implicit data parallelism. Framework users analyze tabular data using standard, easy-to-use data analysis techniques in Python while the framework handles the file manipulations and parallelism without the user needing advanced experience in parallel programming. In future versions, we hope to provide a framework that can be utilized on a personal computer or a high performance computing cluster with little change to the user code.

Groh, Micah↗