Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “large data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Multi-fidelity modeling to predict the rheological properties of fiber suspensions

Unveiling the rheological properties of fiber suspensions is of paramount interest to many industrial applications like biofuel production. The 3D numerical simulations of the suspension of fibers are often computationally expensive and time-consuming. Machine learning methods such as neural networks can simplify the prediction of rheological behavior; however, they require a relatively large training data set. Multi -fidelity models, which combine high-fidelity data from numerical simulations and less expensive lower fidelity data from resources such as simplified physical equations, can lead to optimized predictions. Here, we focus on a neural network with two levels of fidelity, i.e., high and low fidelity networks. To produce high-fidelity data, we perform direct numerical simulations to model the fibers as one-dimensional inextensible slender bodies that obey the Euler- Bernoulli beam equation. The Navier-Stokes equations govern the suspended fluid, and an immersed boundary method is used to couple the fluid and solid motion. The low-fidelity data is produced by using constitutive equations. Noticeable improvements have been observed in the accuracy of predicting the rheological behavior when a multi-fidelity network is used compared to the single-fidelity network.

Boodaghidizaji, Miad↗

Scientific Discovery with Physics-Informed System Identification (Abbreviated Report)

My fellowship research focused on making physics-based simulations faster and more useful through machine learning. Many problems in science and engineering are governed by partial differential equations, but high-fidelity simulations are often too expensive to run repeatedly. I worked on improving Latent Space Dynamics Identification (LaSDI), a reduced-order modeling framework that compresses large simulation data sets into a smaller representation and then learns how that representation evolves over time. The motivation was to develop reduced models that remain accurate for more challenging systems, especially when predictions must remain reliable over long time intervals or when the underlying dynamics are more complicated than standard methods can easily handle. I also contributed to related work on Quandary, a high-performance software effort for simulation and control of open quantum systems, before focusing primarily on Latent Space Dynamics Identification methods. The main outcomes of the fellowship were two new algorithms (both of which were published), Rollout-LaSDI and Higher-Order LaSDI, together with supporting work on multi-stage Latent Space Dynamics Identification. Rollout-LaSDI improved long-term prediction by training the model to stay accurate over extended time horizons, and Higher-Order LaSDI broadened the method so it could model systems with higher-order time dynamics. My contributions to multistage Latent Space Dynamics Identification also helped show that its later training stages could be simplified without losing effectiveness, and that this behavior held across different model architectures and training strategies. Taken together, these advances improved the accuracy, flexibility, and practical value of reduced-order modeling tools for computational science.

97 MATHEMATICS AND COMPUTING↗

SBND Detector Status and First Results

The Short-Baseline Near Detector (SBND) is one of three liquid argon time projection chamber (LArTPC) neutrino detectors positioned along the axis of the Booster Neutrino Beam (BNB) at Fermilab, and serves as the near detector in the Short-Baseline Neutrino (SBN) Program. The detector just completed its second year of running, collecting over 6.5e20 POT, equivalent to an unprecedented sample of over 5 million neutrino interactions. Initial data has demonstrated superb performance of the detector’s subsystems, enabling precise tracking and calorimetric reconstruction of events. With this large statistical data set, SBND is performing multi-dimensional cross section measurements of inclusive and exclusive topologies and precise searches for beyond the Standard Model (BSM) processes. As the near detector in the SBN Program, it will enable the full potential of the joint sterile neutrino measurements program by precisely characterizing the unoscillated neutrino beam, constraining BNB flux and neutrino-argon cross-section systematic uncertainties. In this talk, the current status of the experiment, first results from SBND’s neutrino interaction program, as well as status and prospects for BSM and oscillation searches are discussed.

Paton, Josephine [Fermilab] (ORCID:000000032651489↗

Rasterization with Data-Parallel Primitives

Parallel rasterization can suffer from race conditions during fragment generation, which is traditionally addressed by using specialized hardware accessible via vendor graphics APIs. Unfortunately, graphics APIs are increasingly problematic on high-performance computers, either because they are not provided or because of concerns about dependencies with in situ visualization. In response, we present a hardware-agnostic rasterization algorithm that handles race conditions using only data-parallel primitives (DPPs), enabling efficient rendering on HPC systems without graphics API dependencies and aligning with recent efforts to deliver visualization software with DPPs. Our evaluation consists of three phases: (1) evaluating portability across different CPU and GPU architectures, (2) evaluating competitiveness with a community standard, and (3) evaluating performance across varying workloads and available parallelism. The supporting experiments run on both AMD and NVIDIA GPUs, considering data sets as large as 460 million triangles and 160 million pixels. While performance generally falls short of graphics API baselines, it achieves interactive frame rates on most workloads. As a result, we conclude our approach is a viable solution for rasterization on high-performance computers since our approach is portably performant across different architectures without the need for specialized vendor support.

Buckley, Makani [University of Oregon] (ORCID:0009↗

Deposition, Diagenesis, and Sequence Stratigraphy of the Pennsylvanian Morrowan and Atokan Intervals at Farnsworth Unit

Farnsworth Field Unit (FWU), a mature oilfield currently undergoing CO2-enhanced oil recovery (EOR) in the northeastern Texas panhandle, is the study area for an extensive project undertaken by the Southwest Regional Partnership on Carbon Sequestration (SWP). SWP is characterizing the field and monitoring and modeling injection and fluid flow processes with the intent of verifying storage of CO2 in a timeframe of 100–1000 years. Collection of a large set of data including logs, core, and 3D geophysical data has allowed us to build a detailed reservoir model that is well-grounded in observations from the field. This paper presents a geological description of the rocks comprising the reservoir that is a target for both oil production and CO2 storage, as well as the overlying units that make up the primary and secondary seals. Core descriptions and petrographic analyses were used to determine depositional setting, general lithofacies, and a diagenetic sequence for reservoir and caprock at FWU. The reservoir is in the Pennsylvanian-aged Morrow B sandstone, an incised valley fluvial deposit that is encased within marine shales. The Morrow B exhibits several lithofacies with distinct appearance as well as petrophysical characteristics. The lithofacies are typical of incised valley fluvial sequences and vary from a relatively coarse conglomerate base to an upper fine sandstone that grades into the overlying marine-dominated shales and mudstone/limestone cyclical sequences of the Thirteen Finger limestone. Observations ranging from field scale (seismic surveys, well logs) to microscopic (mercury porosimetry, petrographic microscopy, microprobe and isotope data) provide a rich set of data on which we have built our geological and reservoir models.

04 OIL SHALES AND TAR SANDS↗

Analyzing Mass Spectrometry Imaging Data of 13C-Labeled Phospholipids in Camelina sativa and Thlaspi arvense (Pennycress) Embryos

The combination of 13C-isotopic labeling and mass spectrometry imaging (MSI) offers an approach to analyze metabolic flux in situ. However, combining isotopic labeling and MSI presents technical challenges ranging from sample preparation, label incorporation, data collection, and analysis. Isotopic labeling and MSI individually create large, complex data sets, and this is compounded when both methods are combined. Therefore, analyzing isotopically labeled MSI data requires streamlined procedures to support biologically meaningful interpretations. Using currently available software and techniques, here we describe a workflow to analyze 13C-labeled isotopologues of the membrane lipid and storage oil lipid intermediate―phosphatidylcholine (PC). Our results with embryos of the oilseed crops, Camelina sativa and Thlaspi arvense (pennycress), demonstrated greater 13C-isotopic labeling in the cotyledons of developing embryos compared with the embryonic axis. Greater isotopic enrichment in PC molecular species with more saturated and longer chain fatty acids suggest different flux patterns related to fatty acid desaturation and elongation pathways. The ability to evaluate MSI data of isotopically labeled plant embryos will facilitate the potential to investigate spatial aspects of metabolic flux in situ.

metabolomics↗

Dimensionality Reduction of SDSS Spectra with Variational Autoencoders

High-resolution galaxy spectra contain much information about galactic physics, but the high dimensionality of these spectra makes it difficult to fully utilize the information they contain. We apply variational autoencoders (VAEs), a nonlinear dimensionality reduction technique, to a sample of spectra from the Sloan Digital Sky Survey (SDSS). In contrast to principal component analysis (PCA), a widely used technique, VAEs can capture nonlinear relationships between latent parameters and the data. We find that a VAE can reconstruct the SDSS spectra well with only six latent parameters, outperforming PCA with the same number of components. Different galaxy classes are naturally separated in this latent space, without class labels having been given to the VAE. The VAE latent space is interpretable because the VAE can be used to make synthetic spectra at any point in latent space. For example, making synthetic spectra along tracks in latent space yields sequences of realistic spectra that interpolate between two different types of galaxies. Using the latent space to find outliers may yield interesting spectra: in our small sample, we immediately find unusual data artifacts and stars misclassified as galaxies. In this exploratory work, we show that VAEs create compact, interpretable latent spaces that capture nonlinear features of the data. While a VAE takes substantial time to train (≈1 day for 48,000 spectra), once trained, VAEs can enable the fast exploration of large astronomical data sets.

79 ASTRONOMY AND ASTROPHYSICS↗

Comparison of some classification techniques

The so-called table look-up classification procedure and a modification of it are discussed. These and several other classification techniques are evaluated and simulation results comparing some of the techniques are displayed. Indications are that the table look-up technique is quite useful in classifying large sets of data, such as in remote sensing data analysis.

Odell, P. L.↗

An automated approach to the design of decision tree classifiers

The classification of large dimensional data sets arising from the merging of remote sensing data with more traditional forms of ancillary data is considered. Decision tree classification, a popular approach to the problem, is characterized by the property that samples are subjected to a sequence of decision rules before they are assigned to a unique class. An automated technique for effective decision tree design which relies only on apriori statistics is presented. This procedure utilizes a set of two dimensional canonical transforms and Bayes table look-up decision rules. An optimal design at each node is derived based on the associated decision table. A procedure for computing the global probability of correct classfication is also provided. An example is given in which class statistics obtained from an actual LANDSAT scene are used as input to the program. The resulting decision tree design has an associated probability of correct classification of .76 compared to the theoretically optimum .79 probability of correct classification associated with a full dimensional Bayes classifier. Recommendations for future research are included.

Argentiero, P.↗

Image processing applied to gravity and topography data covering the continental United States

The applicability of fairly standard image processing techniques to processing and analyzing large geologic data sets in addressed. Image filtering techniques were used to interpolate between gravity station locations to produce a regularly spaced data array that preserves detail in areas with good coverage, and that produces a continuous tone image rather than a contour map. Standard image processing techniques were used to digitally register and overlay topographic and gravity data, and the data were displayed in ways that emphasize subtle but pervasive structural features. The potential of the methods is illustrated through a discussion of linear structures that appear in the processed data between the midcontinent gravity high and the Appalachians.

Arvidson, R. E.↗

Deconvolution of spectra for intimate mixtures

Visible to near infrared reflectance spectra of macroscopic mixtures have been shown to be linear combinations of the reflections of the pure mineral components in the mixture. However, for microscopic mixtures the mixing systematics are in general nonlinear. The systematics may be linearized by conversion of reflectance to single scattering albedo (w), where the equations which relate reflectance to w depend on the method of data collection. Several proposed mixing models may be used to estimate mineral abundances from the reflectance spectra of intimate mixtures. These models are summarized and a revised model is presented. A noniterative (linear) least squares approach was used for curve fitting and the data, measured as bi-directional reflectance with incidence and emergence angles of 30 and 0 deg were converted to w by a simplified version of Hapke's equation for bi-directional reflectance. This model was tested with two mixture series composed of 45 to 75 micron particles: an anorthite-enstatite series and an olivine-magnetite series. The data indicate that the simplified Hapke's equation may be used to convolve reflectance spectra into mineral abundances if appropriate endmembers are known or derived from other techniques. For surfaces that contain a significant component of very low albedo material, a somewhat modified version of this technique will need to be developed. Since the abundances are calculated using a noniterative approach, the application of this method is especially efficient for large spectral data sets, such as those produced by mapping spectrometers.

Mustard, John F.↗

An interactive, discipline-independent data visualization system

The data visualization techniques used by National Space Science Data Center Graphics System are discussed. The system includes a self-describing data abstraction for the storage and manipulation of multidimensional data for discipline-independent scientific applications. The system's data format and graphics display are described. Consideration is given to techniques developed for the rapid display and manipulation of large, complex data sets and for manipulating algorithms with portable implementations which can operate on any data object or geometry. The processes of operating the system are given and examples are presented from applying the system to various types of data, including TOMS data, data from the International Satellite Cloud Climatology Project, and IRAS data.

Treinish, Lloyd A.↗

The spectral relationships between NEA and the meteorites: An overview using principal components analysis

One of the primary reservoirs for meteorites is probably the planet-crossing Aten, Apollo, and Amor asteroids. Comparing the spectral characteristics of these two populations with each other and with the spectra of the main belt asteroids would provide insight into the dynamical processes that deliver meteorites to Earth. One method for obtaining an overview of general relationships in a large spectral data set is the statistical technique of principal components analysis. This technique quantifies general spectral similarities and reprojects the data in a plot of major axes of variation where distance is a measure of relative similarity. A major caveat should be kept in mind, however, spectra are sensitive to particle size and viewing geometry effects, and near Earth asteroids (NEA's) are probably significantly different from main belt asteroids in both these factors. The analysis was restricted to the spectral range of ECAS filters and included 116 meteorite spectra from the Gaffey (1976) survey and 417 asteroids from the Zellner et. al. (1985) survey of which 13 are planet-crossers. Although thirteen asteroids are not much of a sample on which to base conclusions, a few inferences can be drawn from this exercise. First, the NEA spectral characteristics are, on average, more consistent with the spectra of meteorites than are the main belt asteroids. Second, the S-type NEA's tend to be spectrally more similar to the ordinary chondrite meteorites than the main belt S-types. This suggests that the planet-crossing S-types do not represent the spectral range of the main belt S-type population and that the planet-crossing S-types are on average more like the ordinary chondrites than the main belt S-types. Third, the only direct asteroidal ordinary chondrite analog, the Q-type asteroid, 1862 Apollo, plots well within the field of the ordinary chondrite meteorites and represents the most common meteorite fall type. Finally, it is interesting that the planet-crossing asteroids occupy similar PCA space with the general trend of the meteorites while most of the main belt objects are offset from the meteorites in statistical space.

Britt, D. T.↗

Latest developments in the display of large-scale ionospheric and thermospheric data sets

Over the past decade, data base sizes have continually increased and will continue to do so in the future. This problem of size is further compounded because the trend in present-day studies is to use data from many different locations and different instruments and then compare it with data from global scale physical models. The latter produce data bases of comparable if not even larger size. Much of the data can be viewed as 'image' time sequences and is most readily viewed on color display terminals. These data sets reside in national or owner-generated data bases linked together by computer networks. As the size increases, just moving this data around, taking 'quick-looks' at the data, or even storing it locally become severe problems compromising the scientific return from the data. Is the present-day technology with these analysis techniques being used in the best way? What are the prospects for reducing the storage and transmission size of the data sets? Examples of such problems and potential solutions are described in this paper.

Sojka, J. J.↗

Intercomparison between microwave and infrared observations of precipitable water

The possible utility of observations by the TIROS-N Vertical Sounder system as a data base for a global climatology of atmospheric precipitable water is assessed. A comparison is described between the atmospheric precipitable water content (PWC) derived from IR observations by the High-Resolution Infrared Radiation Sounder (HIRS/2) of the TOVS system using the eigenvector regression technique and derived from microwave observations by the Special Sensor Microwave/Imager (SSM/I). It is suggested that the difference between the two data sets can largely be attributed to the eigenvector method used to retrieve PWC from the HIRS/2 observations. It is shown that in the regions of subsidence associated with the air motion around the subtropical zone of high pressure, the HIRS/2 tends to overestimate the PWC.

Tjemkes, Stephen A.↗

Electronic Catalog Of Extragalactic Objects

NASA/IPAC Extragalactic Database (NED) is publicly accessible computerized catalog of published information about extragalactic observations. Developed to accommodate increasingly large sets of data from surveys, exponentially growing literature, and trend among astronomers to take multispectral approach to astrophysical problems. Accessible to researchers and librarians.

Helou, George↗

A Southern Hemisphere radar meteor orbit survey

A meteor radar system has been operated on a routine basis near Christchurch, New Zealand, to determine the orbits of Earth-impacting interplanetary dust and meteoroids. The system sensitivity is +13 visual magnitude, corresponding to approximately 100 micron sized meteoroids. With an orbital precision of 2 degrees in angular elements and 10 percent in orbital energy (1/a), the operation yields an average of 1500 orbits daily with a total to date in excess of 10(exp 5). The use of pc's and automated data reduction permit the large orbital data sets we collect to be routinely reduced. Some illustrative examples are presented of the signal formats/processing and the results of data reduction, giving the individual orbital elements and hence the overall distributions. Current studies include the distribution of dust in the inner solar system; the influx of meteoroids associated with near-Earth asteroids; and the orbital structure existing in comet-produced streams.

Baggaley, W. Jack↗

Automating sky object classification in astronomical survey images

We describe the application of machine classification techniques to the development of an automated tool for the reduction of a large scientific data set. The 2nd Palomer Observatory Sky Survey is nearly completed. This survey provides comprehensive coverage of the northern celestial hemisphere in the form of photographic plates. The plates are being transformed into digitized images whose quality will probably not be surpassed in the next ten to twenty years. The images are expected to contain on the order of 10(exp 7) galaxies and 10(exp 8) stars. Astronomers wish to determine which of these sky objects belong to various classes of galaxies and stars. The size of this data set precludes manual analysis. Our approach is to develop a software system which integrates the functions of independently developed techniques for image processing and data classification. Digitized sky images are passed through image processing routines to identify sky objects and to extract a set of features for each object. These routines are used to help select a useful set of attributes for classifying sky objects. Then GID3* and O-BTree, two inductive learning techniques, learn classification decision trees from examples. These classifiers will be used to process the rest of the data. This paper gives an overview of the machine learning techniques used, describes the details of our specific application, and reports the initial encouraging results. The results indicate that our approach is well-suited to the problem. The primary benefits of the approach are increased data reduction throughput and consistency of classification. The classification rules which are the product of the inductive learning techniques will form an object, examinable basis for classifying sky objects. A final, not to be underestimated benefit is that astronomers will be freed from the tedium of an intensely visual task to pursue more challenging analysis and interpretation problems based on automatically cataloged data.

Fayyad, Usama M.↗