Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sparse sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Linking Associations of Rare Low-Abundance Species to Their Environments by Association Networks

Studies of microbial communities by targeted sequencing of rRNA genes lead to recovering numerous rare low-abundance taxa with unknown biological roles. We propose to study associations of such rare organisms with their environments by a computational framework based on transformation of the data into qualitative variables. Namely, we analyze the sparse table of putative species or OTUs (operational taxonomic units) and samples generated in such studies, also known as an OTU table, by collecting statistics on co-occurrences of the species and on shared species richness across samples. Based on the statistics we built two association networks, of the rare putative species and of the samples respectively, using a known computational technique, Association networks (Anets) developed for analysis of qualitative data. Clusters of samples and clusters of OTUs are then integrated and combined with metadata of the study to produce a map of associated putative species in their environments. We tested and validated the framework on two types of microbiomes, of human body sites and that of the Populus tree root systems. We show that in both studies the associations of OTUs can separate samples according to environmental or physiological characteristics of the studied systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

GPU-Accelerated Analytic Simulation of Sparse Ionization Signal Formation in Pixelated Projection Detector

This paper presents a GPU-accelerated simulation package, TRED, for next-generation neutrino detectors with pixelated charge readout, leveraging community-driven software ecosystems to ensure adaptability and extensibility. We introduce two generic contributions: (i) an effective-charge representation based on Gaussian quadrature rules, in which the linear- interpolation factors for the field response inside each voxel are absorbed into the effective charge, and (ii) a sparse, block- binned tensor representation that enables efficient FFT-based computation of induced signals on readout electrodes for sparsely activated detector volumes. The former captures structure inside a voxel without dense sampling, while the latter achieves low memory usage and scalable runtime, as demonstrated in bench- mark studies. The underlying data representation is applicable to large-scale detectors and to other computational problems involving sparse activity.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2010

Micrometeoroid and Lunar Secondary Ejecta Flux Measurements: Comparison of Three Acoustic Systems

This report examines the inherent capability of three large-area acoustic sensor systems and their applicability for micrometeoroids (MM) and lunar secondary ejecta (SE) detection and characterization for future lunar exploration activities. Discussion is limited to instruments that can be fabricated and deployed with low resource requirements. Previously deployed impact detection probes typically have instrumented capture areas less than 0.2 square meters. Since the particle flux decreases rapidly with increased particle size, such small-area sensors rarely encounter particles in the size range above 50 microns, and even their sampling the population above 10 microns is typically limited. Characterizing the sparse dust population in the size range above 50 microns requires a very large-area capture instrument. However it is also important that such an instrument simultaneously measures the population of the smaller particles, so as to provide a complete instantaneous snapshot of the population. For lunar or planetary surface studies, the system constraints are significant. The instrument must be as large as possible to sample the population of the largest MM. This is needed to reliably assess the particle impact risks and to develop cost-effective shielding designs for habitats, astronauts, and critical instrument. The instrument should also have very high sensitivity to measure the flux of small and slow SE particles. is the SE environment is currently poorly characterized, and possess a contamination risk to machinery and personnel involved in exploration. Deployment also requires that the instrument add very little additional mass to the spacecraft. Three acoustic systems are being explored for this application.

Corsaro, R. D.↗
DOE OSTI2025

Intelligent Sampling of Extreme-Scale Turbulence Datasets for Accurate and Efficient Spatiotemporal Model Training

With the end of Moore’s law and Dennard scaling, efficient training increasingly requires rethinking data volume. Can we train better models with significantly less data via intelligent subsampling? To explore this, we develop SICKLE, a sparse intelligent curation framework for efficient learning, featuring a novel maximum entropy (MaxEnt) sampling approach, scalable training, and energy benchmarking. We compare MaxEnt with random and phase-space sampling on large direct numerical simulation (DNS) datasets of turbulence. Evaluating SICKLE at scale on Frontier, we show that subsampling as a preprocessing step can, in many cases, improve model accuracy and substantially lower energy consumption, with observed reductions of up to 38×.

Brewer, Wes [ORNL] (ORCID:0000000236393956)↗
DOE OSTI2017

Compressive Classification for TEM-EELS

Acquiring atomic-resolution images of beam sensitive materials or under dynamic conditions (e.g. operando STEM) is very difficult and requires precise dose fractioning to minimize the dose delivered to the sample and acquire the data more rapidly than dynamics present. Typical methods of low-dose STEM imaging include adjusting the beam current, dwell-time, and probe Scanning transmission electron microscopy (STEM) is used routinely to obtain atomic-resolution images of a small selection of radiation tolerant materials under stable conditions.size. All three of these determine the dose over a spatial area in STEM. Recently, compressive sensing [1] has been applied to electron microscopy. The computational imaging method of inpainting [2] has been proposed as a method to reduce dose and increase acquisition speed for STEM. Inpainting is a technique to recover missing pixels in an image. By skipping pixels (randomly) during acquisition, a fourth dose-control mechanism is realized [3]. A few implementations of randomly-subsampled STEM exist (e.g., [4]). To make the concepts of compressive sensing accessible to the microscopy community we begin with an example using atomic resolution images of a GaAs crystal (see Figure 1). Because the crystal is periodic it has a sparse representation in reciprocal space. In fact, a sparse representation is a key component of compressive sensing. If an image is sub-sampled randomly we find that the Fourier transform remains sparse, but becomes increasing noisy as less and less data is acquired. Yet, by finding the peaks in the reciprocal image and removing the noise it is possible to recover atomic resolution images with only 1% of the pixels. Figure 1 shows the reconstruction process for GaAs sub-sampled at 50%, 10%, 5%, and 1%. Periodic images form a special class for which the optimal sampling approach (according to CS theory) is a random selection of pixels. For non-periodic images, such as those arising in in-situ STEM, methods such as dictionary learning are necessary [2,5]. The data can be compressed in time for TEM [5] or pixels can be skipped randomly for STEM. There are several issues that arise in developing a random scan for STEM [4] and a coded aperture for TEM. The remainder of the talk will address these issues. References: [1] E Candes and M Wakin. Signal Processing Magazine, IEEE. 2(25) (2008), pp. 21. [2] A Stevens, Pu Y, Sun Y, et al. Artificial Intelligence & Statistics (AISTATS), 2017. [3] A Stevens, H Yang, L Carin et al. Microscopy 63(1), (2014), pp. 41. [4] L Kovarik, A Stevens, A Liyu et al. Appl. Phys. Lett. 109, 164102 (2016). [5] A Stevens, L Kovarik, P Abellan et al. Adv. Structural and Chemical Imaging 1(10), (2015), pp. 1. [6] Supported by the Chemical Imaging, Signature Discovery, and Analytics in Motion Initiatives at PNNL. PNNL is operated by Battelle Memorial Inst. for the US DOE; contract DE-AC05-76RL01830.

Hao, Weituo↗
DOE OSTI2022

Automated Crystal Orientation Mapping in py4DSTEM using Sparse Correlation Matching

Crystalline materials used in technological applications are often complex assemblies composed of multiple phases and differently oriented grains. Robust identification of the phases and orientation relationships from these samples is crucial, but the information extracted from the diffraction condition probed by an electron beam is often incomplete. We have developed an automated crystal orientation mapping (ACOM) procedure which uses a converged electron probe to collect diffraction patterns from multiple locations across a complex sample. We provide an algorithm to determine the orientation of each diffraction pattern based on a fast sparse correlation method. We demonstrate the speed and accuracy of our method by indexing diffraction patterns generated using both kinematical and dynamical simulations. We have also measured orientation maps from an experimental dataset consisting of a complex polycrystalline twisted helical AuAgPd nanowire. From these maps we identify twin planes between adjacent grains, which may be responsible for the twisted helical structure. All of our methods are made freely available as open source code, including tutorials which can be easily adapted to perform ACOM measurements on diffraction pattern datasets.

36 MATERIALS SCIENCE↗
DOE OSTI2012

Pseudo spectral Chebyshev representation of few-group cross sections on sparse grids

This paper presents a pseudo spectral method for representing few-group homogenised cross sections, based on hierarchical polynomial interpolation. The interpolation is performed on a multi-dimensional sparse grid built from Chebyshev nodes. The representation is assembled directly from the samples using basis functions that are constructed as tensor products of the classical one-dimensional Lagrangian interpolation functions. The advantage of this representation is that it combines the accuracy of Chebyshev interpolation with the efficiency of sparse grid methods. As an initial test, this interpolation method was used to construct a representation for the two-group macroscopic cross sections of a VVER pin cell. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2016

SU-G-IeP3-07: High-Resolution, High-Sensitivity Imaging and Quantification of Intratumoral Distributions of Gold Nanoparticles Using a Benchtop L-Shell XRF Imaging System

Purpose: To demonstrate the ability to perform high-resolution imaging and quantification of sparse distributions of gold nanoparticles (GNPs) within ex vivo tumor samples using a highly-sensitive benchtop L-shell x-ray fluorescence (XRF) imaging system. Methods: An optimized L-shell XRF imaging system was assembled using a tungsten-target x-ray source (operated at 62 kVp and 45 mA). The x-rays were filtered (copper: 0.08 mm & aluminum: 0.04 mm) and collimated (lead: 5 cm thickness, 3 cm aperture diameter) into a cone-beam in order to irradiate small samples or objects. A collimated (stainless steel: 4 cm thickness, 2 mm aperture diameter) silicon drift detector, capable of 2D translation, was placed at 90° with respect to the beam to acquire XRF/scatter spectra from regions of interest. Spectral processing involved extracting XRF signal from background, followed by attenuation correction using a Compton scatter-based normalization algorithm. Calibration phantoms with water/GNPs (0 and 0.00001–10 mg/cm{sup 3}) were used to determine the detection limit of the system at a 10-second acquisition time. The system was then used to map the distribution of GNPs within a 12×11×2 mm{sup 3} slice excised from the center of a GNP-loaded ex vivo murine tumor sample; a total of 110 voxels (2.65×10{sup −3} cm{sup 3}) were imaged with 1.3-mm spatial resolution. Results: The detection limit of the current cone-beam benchtop L-shell XRF system was 0.003 mg/cm{sup 3} (3 ppm). Intratumoral GNP concentrations ranging from 0.003 mg/cm{sup 3} (3 ppm) to a maximum of 0.055 mg/cm{sup 3} (55 ppm) and average of 0.0093 mg/cm{sup 3} (9.3 ppm) were imaged successfully within the ex vivo tumor slice. Conclusion: The developed cone-beam benchtop L-shell XRF imaging system can immediately be used for imaging of ex vivo tumor samples containing low concentrations of GNPs. With minor finetuning/optimization, the system can be directly adapted for performing routine preclinical in vivo imaging tasks. Supported by NIH/NCI grant R01CA155446 This investigation was supported by NIH/NCI grant R01CA155446.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Vadose Zone Flow and Transport Parameters Data Package for the Hanford Site Composite Analysis and Cumulative Impact Evaluation

This report provides a description of the basis for the development and implementation of a conceptual model for vadose zone flow and transport for the composite analysis (CA) groundwater pathway analysis and the cumulative impact evaluation (CIE). The parameterization for a numerical model is intimately linked to the conceptual model framework. The report describes the basis for the selection of hydraulic and transport parameters for the hydrostratigraphic units (HSUs) identified in the 200 East and 200 West Areas. Whenever data are sparse or unavailable, surrogate hydraulic properties are chosen based on samples collected within the 200 Areas and nearby locations that are representative of sediments characteristic of the HSUs identified elsewhere.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2016

MAPPING THE GAS TURBULENCE IN THE COMA CLUSTER: PREDICTIONS FOR ASTRO-H

Astro-H will be able for the first time to map gas velocities and detect turbulence in galaxy clusters. One of the best targets for turbulence studies is the Coma cluster, due to its proximity, absence of a cool core, and lack of a central active galactic nucleus. To determine what constraints Astro-H will be able to place on the Coma velocity field, we construct simulated maps of the projected gas velocity and compute the second-order structure function, an analog of the velocity power spectrum. We vary the injection scale, dissipation scale, slope, and normalization of the turbulent power spectrum, and apply measurement errors and finite sampling to the velocity field. We find that even with sparse coverage of the cluster, Astro-H will be able to measure the Mach number and the injection scale of the turbulent power spectrum—the quantities determining the energy flux down the turbulent cascade and the diffusion rate for everything that is advected by the gas (metals, cosmic rays, etc.). Astro-H will not be sensitive to the dissipation scale or the slope of the power spectrum in its inertial range, unless they are outside physically motivated intervals. We give the expected confidence intervals for the injection scale and the normalization of the power spectrum for a number of possible pointing configurations, combining the structure function and velocity dispersion data. Importantly, we also determine that measurement errors on the line shift will bias the velocity structure function upward, and show how to correct this bias.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2002

Determining Greenland Ice Sheet Accumulation Rates from Radar Remote Sensing

An important component of NASA's Program for Arctic Regional Climate Assessment (PARCA) is a mass balance investigation of the Greenland Ice Sheet. The mass balance is calculated by taking the difference between the areally Integrated snow accumulation and the net ice discharge of the ice sheet. Uncertainties in this calculation Include the snow accumulation rate, which has traditionally been determined by interpolating data from ice core samples taken from isolated spots across the ice sheet. The sparse data associated with ice cores juxtaposed against the high spatial and temporal resolution provided by remote sensing , has motivated scientists to investigate relationships between accumulation rate and microwave observations as an option for obtaining spatially contiguous estimates. The objective of this PARCA continuation proposal was to complete an estimate of surface accumulation rate on the Greenland Ice Sheet derived from C-band radar backscatter data compiled in the ERS-1 SAR mosaic of data acquired during, September-November, 1992. An empirical equation, based on elevation and latitude, is used to determine the mean annual temperature. We examine the influence of accumulation rate, and mean annual temperature on C-band radar backscatter using a forward model, which incorporates snow metamorphosis and radar backscatter components. Our model is run over a range of accumulation and temperature conditions. Based on the model results, we generate a look-up table, which uniquely maps the measured radar backscatter, and mean annual temperature to accumulation rate. Our results compare favorably with in situ accumulation rate measurements falling within our study area.

Jezek, Kenneth C.↗
NASA NTRS2000

Climate and infectious disease: use of remote sensing for detection of Vibrio cholerae by indirect measurement

It has long been known that cholera outbreaks can be initiated when Vibrio cholerae, the bacterium that causes cholera, is present in drinking water in sufficient numbers to constitute an infective dose, if ingested by humans. Outbreaks associated with drinking or bathing in unpurified river or brackish water may directly or indirectly depend on such conditions as water temperature, nutrient concentration, and plankton production that may be favorable for growth and reproduction of the bacterium. Although these environmental parameters have routinely been measured by using water samples collected aboard research ships, the available data sets are sparse and infrequent. Furthermore, shipboard data acquisition is both expensive and time-consuming. Interpolation to regional scales can also be problematic. Although the bacterium, V. cholerae, cannot be sensed directly, remotely sensed data can be used to infer its presence. In the study reported here, satellite data were used to monitor the timing and spread of cholera. Public domain remote sensing data for the Bay of Bengal were compared directly with cholera case data collected in Bangladesh from 1992-1995. The remote sensing data included sea surface temperature and sea surface height. It was discovered that sea surface temperature shows an annual cycle similar to the cholera case data. Sea surface height may be an indicator of incursion of plankton-laden water inland, e.g., tidal rivers, because it was also found to be correlated with cholera outbreaks. The extensive studies accomplished during the past 25 years, confirming the hypothesis that V. cholerae is autochthonous to the aquatic environment and is a commensal of zooplankton, i.e., copepods, when combined with the findings of the satellite data analyses, provide strong evidence that cholera epidemics are climate-linked.

Cholera/epidemiology↗
NASA NTRS2005

A Global Map of Mars' Crustal Magnetic Field Based on Electron Reflectometry

One of the great surprises of the Mars Global Surveyor mission was the discovery of intensely magnetized crust. Magnetic sources on Mars are at least ten times stronger than their terrestrial counterparts, probably requiring large volumes of coherently magnetized material, very strong remanence, or both. Although much of the attention so far has been placed on the strong crustal fields in the southern highlands, magnetic sources do exist in the younger low-lying plains. The strength and morphology of these sources could yield clues to the thermal and magnetic history of the northern plains. Low altitude (approx. 100 km) Magnetometer (MAG) data obtained during aerobraking have the greatest spatial resolution and sensitivity for identifying crustal magnetic sources from orbit, but those data are sparse and therefore limit the ability to discern morphology. Fully sampled MAG data obtained in the 400-km altitude mapping orbit have been differenced with respect to latitude (Br/Lat) to minimize the influence of induced fields from the solar wind interaction and thus enhance the sensitivity to weak crustal sources. Here we describe independent results from the Electron Reflectometer (ER), which remotely measures the magnetic field intensity at approx. 170 km altitude, and is roughly seven times more sensitive to crustal magnetic sources than measurements of Br from the mapping orbit.

Mitchell, D. L.↗
NASA NTRS2016

Mapping the Gas Turbulence in the Coma Cluster: Predictions for Astro-H

Astro-H will be able for the first time to map gas velocities and detect turbulence in galaxy clusters. One of the best targets for turbulence studies is the Coma cluster, due to its proximity, absence of a cool core, and lack of a central active galactic nucleus. To determine what constraints Astro-H will be able to place on the Coma velocity field, we construct simulated maps of the projected gas velocity and compute the second-order structure function, an analog of the velocity power spectrum. We vary the injection scale, dissipation scale, slope, and normalization of the turbulent power spectrum, and apply measurement errors and finite sampling to the velocity field. We find that even with sparse coverage of the cluster, Astro-H will be able to measure the Mach number and the injection scale of the turbulent power spectrum-the quantities determining the energy flux down the turbulent cascade and the diffusion rate for everything that is advected by the gas (metals, cosmic rays, etc.). Astro-H will not be sensitive to the dissipation scale or the slope of the power spectrum in its inertial range, unless they are outside physically motivated intervals. We give the expected confidence intervals for the injection scale and the normalization of the power spectrum for a number of possible pointing configurations, combining the structure function and velocity dispersion data. Importantly, we also determine that measurement errors on the line shift will bias the velocity structure function upward, and show how to correct this bias.

clusters: intracluster medium↗
DOE OSTI2019

Optimized sub-sampling in an electron microscope

Disclosed are methods for optimized sub-sampling in an electron microscope. With regard at least to utilization of electron dose budgets, of time for acquisition of measurements, and of computing/processing capabilities, very high efficiencies can be achieved by informing and/or adapting subsequent sub-sampling measurements according to one or more earlier-acquired sparse datasets and/or according to analyzes thereof.

Stevens, Andrew J.↗
DOE OSTI2017

Sparse Representations to Replace TOFD Images in Non-destructive Testing of Materials

This paper describes a proposed method for the selection of relevant samples of ultrasonic signals during automatic material inspection. Instead of the well-known time of flight diffraction (TOFD) images, data are stored as a sparse matrix in which the elements only indicate whether a defect has been detected. This technique avoids storage of useless signals received during probe displacement in cases of low and high signal-to-noise ratios that correspond to coarse-grained and fine-grained materials, respectively. The approach is based on comparing the positions of maximum amplitudes, which are randomly located when signals only consist of noise but are in the same signal range when a defect is detected. The matrix elements are then applied as inputs to a self organizing map by neural networks to produce a normalized sparse matrix as the output, with a constant number of elements. This approach will be beneficial to enable the use of selected data in intelligent systems requiring a fixed number of inputs to characterize defects.

42 ENGINEERING↗
DOE OSTI2014

Reconstruction Techniques for Sparse Multistatic Linear Array Microwave Imaging

Sequentially-switched linear arrays are an enabling technology for a number of near-field microwave imaging applications. Electronically sequencing along the array axis followed by mechanical scanning along an orthogonal axis allows dense sampling of a two-dimensional aperture in near real-time. In this paper, a sparse multi-static array technique will be described along with associated Fourier-Transform-based and back-projection-based image reconstruction algorithms. Simulated and measured imaging results are presented that show the effectiveness of the sparse array technique along with the merits and weaknesses of each image reconstruction approach.

concealed-weapon detection↗
DOE OSTI2019

A Novel Sparse Compositional Technique Reveals Microbial Perturbations

ABSTRACT The central aims of many host or environmental microbiome studies are to elucidate factors associated with microbial community compositions and to relate microbial features to outcomes. However, these aims are often complicated by difficulties stemming from high-dimensionality, non-normality, sparsity, and the compositional nature of microbiome data sets. A key tool in microbiome analysis is beta diversity, defined by the distances between microbial samples. Many different distance metrics have been proposed, all with varying discriminatory power on data with differing characteristics. Here, we propose a compositional beta diversity metric rooted in a centered log-ratio transformation and matrix completion called robust Aitchison PCA. We demonstrate the benefits of compositional transformations upstream of beta diversity calculations through simulations. Additionally, we demonstrate improved effect size, classification accuracy, and robustness to sequencing depth over the current methods on several decreased sample subsets of real microbiome data sets. Finally, we highlight the ability of this new beta diversity metric to retain the feature loadings linked to sample ordinations revealing salient intercommunity niche feature importance. IMPORTANCE By accounting for the sparse compositional nature of microbiome data sets, robust Aitchison PCA can yield high discriminatory power and salient feature ranking between microbial niches. The software to perform this analysis is available under an open-source license and can be obtained at https://github.com/biocore/DEICODE ; additionally, a QIIME 2 plugin is provided to perform this analysis at https://library.qiime2.org/plugins/q2-deicode .

59 BASIC BIOLOGICAL SCIENCES↗