Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “random access”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
NASA NTRS1979

Processing of on-board recorded data for quick analysis of aircraft performance

A system of independent computer programs for the processing of digitized pulse code modulated (PCM) and frequency modulated (FM) data is described. Information is stored in a set of random files and accessed to produce both statistical and graphical output. The software system is designed primarily to present these reports within a twenty-four hour period for quick analysis of the helicopter's performance.

Michaud, N. H.↗
NASA NTRS1992

JPL activities on development of acousto-optic tunable filter imaging spectrometer

Recent activities of JPL in the development of a new type of imaging spectrometers for earth observation and planetary exploration are reported. This instrument uses the acousto-optic tunable filter (AOTF) as high resolution and fast programmable bandpass filter. AOTF operates in the principle of acousto-optic interaction in an anisotropic medium. This filter can be tuned in sequential, random, and multiwavelength access modes, providing observational flexibility. The diffraction process in the filter generates two diffracted monochromatic beams with polarization orthogonal to each other, creating a unique capability to measure both polarimetric and spectral properties of the incoming light simultaneously with a single instrument. The device gives wide wavelength operations with reasonably large throughput. In addition, it is in a compact solid-state structure without moving parts, providing system reliability. These attractive features give promising opportunities to develop a new generation of airborne/spaceborne and ground, real-time, imaging spectrometer systems for remote sensing applications.

Cheng, Li-Jen↗
DOE OSTI2012

ISABELA for effective in situ compression of scientific data: ISABELA FOR EFFECTIVE IN-SITU REDUCTION OF SPATIO-TEMPORAL DATA

Exploding dataset sizes from extreme-scale scientific simulations necessitates efficient data management and reduction schemes to mitigate I/O costs. With the discrepancy between I/O bandwidth and computational power, scientists are forced to capture data infrequently, thereby making data collection an inherently lossy process. Although data compression can be an effective solution, the random nature of real-valued scientific datasets renders lossless compression routines ineffective. These techniques also impose significant overhead during decompression, making them unsuitable for data analysis and visualization, which require repeated data access. To address this problem, we propose an effective method for In situ Sort-And-B-spline Error-bounded Lossy Abatement (ISABELA) of scientific data that is widely regarded as effectively incompressible. With ISABELA, we apply a pre-conditioner to seemingly random and noisy data along spatial resolution to achieve an accurate fitting model that guarantees a ≥0.99 correlation with the original data. We further take advantage of temporal patterns in scientific data to compress data b ≈ 85%, while introducing only a negligible overhead on simulations in terms of runtime. ISABELA significantly outperforms existing lossy compression methods, such as wavelet compression, in terms of data reduction and accuracy. We extend upon our previous paper by additionally building a communication-free, scalable parallel storage framework on top of ISABELA-compressed data that is ideally suited for extreme-scale analytical processing. The basis for our storage framework is an inherently local decompression method (it need not decode the entire data), which allows for random access decompression and low-overhead task division that can be exploited over heterogeneous architectures. Furthermore, analytical operations such as correlation and query processing run quickly and accurately over data in the compressed space. Copyright © 2012 John Wiley & Sons, Ltd.

Computer Science↗
DOE OSTI2020

Soybean ( Glycine max ) Haplotype Map (GmHapMap): a universal resource for soybean translational and functional genomics

Here, we describe a worldwide haplotype map for soybean (GmHapMap) constructed using whole-genome sequence data for 1007 Glycine max accessions and yielding 14.9 million variants as well as 4.3 M tag single-nucleotide polymorphisms (SNPs). When sampling random subsets of these accessions, the number of variants and tag SNPs plateaued beyond approximately 800 and 600 accessions, respectively. This suggests extensive coverage of diversity within the cultivated soybean. GmHapMap variants were imputed onto 21 618 previously genotyped accessions with up to 96% success for common alleles. A local association analysis was performed with the imputed data using markers located in a 1-Mb region known to contribute to seed oil content and enabled us to identify a candidate causal SNP residing in the NPC1 gene. We determined gene-centric haplotypes (407 867 GCHs) for the 55 589 genes and showed that such haplotypes can help to identify alleles that differ in the resulting phenotype. Finally, we predicted 18 031 putative loss-of-function (LOF) mutations in 10 662 genes and illustrated how such a resource can be used to explore gene function. The GmHapMap provides a unique worldwide resource for applied soybean genomics and breeding.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Discovering the desirable alleles contributing to the lignocellulosic biomass traits in saccharum germplasm collections for energy cane improvement

Phenotyping Methods: The accessions (which includes 21 taxa and 1,177 accessions) in the World Collection of Sugarcane and Related Grasses (WCSRG) was evaluated for the following traits: arenchyma, internode length and diameter, pubescence, pith, Brix, stalk number and fiber. A core of 300 accessions that included each species in the World Collection was selected by using the Maximization Strategy in MStrat software. Results: The core had a higher diversity rating than random selections of 300 accessions. The Shannon–Weaver Diversity Index scores of the core and whole collection were similar indicating that the majority of the diversity was captured by the core collection. The ranges and medians between the core and WCSRG were similar; only two of the trait medians were not significant at P = 0.05 using the non-parametric Wilcoxon method and the coincidence rate (CR % = 96.2) was high (>80) indicating that extreme values were retained. Thus, the phenotypic diversity of these traits in the WCSRG was well represented by the core collection. Associations Methods: Genotypic and phenotypic data were collected for 1002 accessions of the WCSRG including 209 SSR markers. Association analysis was performed using both General Linear (GLM) and Maximum Likelihood (MLM) models. Different core collections with 300 accessions each were selected based on genotypic, phenotypic and combined data based on the Maximization Strategy in MStrat software. Results: A major portion of the genotyping involving SNPs is being conducted by Dr. Jianping Wang of the University of Florida under the DOE award DE-FG 02-11ER 65214 and the genotypic and phenotypic associations will be reported separately next year. In the current, study forty one and seventeen markers were found to be associated with traits using the GLM and MLM methods respectively including associations with arenchyma, internode length and diameter, pubescence, pith, and Sugar Cane Yellow Leaf Virus. The data indicates that each of the cores and the World Collection are similar to each other genotypically and phenotypically, but the core that was selected using only genotypic data was significantly different phenotypically. This indicates that there is not enough association between the genotypic and phenotypic diversity as to select using only genotypic diversity and get the full phenotypic diversity. Core Collection: Creation and Phenotyping Methods: To evaluate this germplasm for breeding purposes, a representative diversity panel selected from the WCSRG of approximately 300 accessions was planted at Canal Point, FL in three replications. These accessions were measured for stalk height and stalk number multiple times throughout the growing season and Brix and fresh biomass during harvest in 2013 and, stalk height, stalk number, stalk diameter, internode length, Brix and fresh and dry biomass was determined in the ratoon crop harvest in 2014. Results: In correlations of multiple measurements, there were higher correlations for early measurements of stalk number and stalk height with harvest traits like Brix and fresh weight. Hybrids had higher fresh mass and Brix while Saccharum spontaneum had higher stalk number and dry mass. The heritability of hybrid mass traits was lower in the ratoon crop. According to the principal component analysis, the diversity panel was divided into two groups. One group had accessions with high stalk number and high dry biomass like S. spontaneum and the other groups contained accessions with higher Brix and fresh biomass like S. officinarum. Mass traits correlated with each other as expected but hybrids had lower correlations between fresh and dry mass. Stalk number and the mass traits correlated with each other except in S. spontaneum and hybrids in the first ratoon. There were 110 accessions not significantly different in Brix from the commercial sugarcane checks including 10 S. spontaneum accessions. There were 27 dry and 6 fresh mass accessions significantly higher than the commercial sugarcane checks. Core Collection: Fiber analysis Methods: A biomass sample was taken from each accession then shredded and dried. Fiber analysis was then performed on each sample. The acetyl groups, acid insoluble lignin, acid soluble lignin, arabinan, glucan, holocellulose, total lignin, structural ash, and xylan were quantified on a % fiber basis and nonstructural ash on a % total basis. Results: There were significant, but not large differences between species for holocellulose, lignin, acetyl, acid soluble lignin, nonstructural ash, and glucan. For each trait, S. spontaneum had significantly more holocellulose, glucan, lignin, and nonstructural ash and less acetyl and acid soluble lignin than the other species. In all populations, glucan and was positively correlated with holocellulose were positively correlated and glucan and and holocellulose were negatively correlated with lignin. In hybrids, internode length correlated positively with holocellulose and nonstructural ash and negatively with lignin. The heritability estimates for each of the fiber component traits is low indicating that environment is an important factor in fiber composition. Principal component analysis indicated that a large amount of diversity exists within each of the species.

09 BIOMASS FUELS↗
DOE OSTI2024

Codiscovering graphical structure and functional relationships within data: A Gaussian Process framework for connecting the dots

Most problems within and beyond the scientific domain can be framed into one of the following three levels of complexity of function approximation. Type 1: Approximate an unknown function given input/output data. Type 2: Consider a collection of variables and functions, some of which are unknown, indexed by the nodes and hyperedges of a hypergraph (a generalized graph where edges can connect more than two vertices). Given partial observations of the variables of the hypergraph (satisfying the functional dependencies imposed by its structure), approximate all the unobserved variables and unknown functions. Type 3: Expanding on Type 2, if the hypergraph structure itself is unknown, use partial observations of the variables of the hypergraph to discover its structure and approximate its unknown functions. These hypergraphs offer a natural platform for organizing, communicating, and processing computational knowledge. While most scientific problems can be framed as the data-driven discovery of unknown functions in a computational hypergraph whose structure is known (Type 2), many require the data-driven discovery of the structure (connectivity) of the hypergraph itself (Type 3). We introduce an interpretable Gaussian Process (GP) framework for such (Type 3) problems that does not require randomization of the data, access to or control over its sampling, or sparsity of the unknown functions in a known or learned basis. Its polynomial complexity, which contrasts sharply with the super-exponential complexity of causal inference methods, is enabled by the nonlinear ANOVA capabilities of GPs used as a sensing mechanism.

Science & Technology - Other Topics↗
DOE OSTI2024

MDLoader: A Hybrid Model-Driven Data Loader for Distributed Graph Neural Network Training

Scalable data management is essential for processing large scientific dataset on HPC platforms for distributed deep learning. In-memory distributed storage is preferred for its speed, enabling rapid, random, and frequent data access required by stochastic optimizers. Processes use one-sided or collective communication to fetch remote data, with optimal performance depending on (i) dataset characteristics, (ii) training scale, and (iii) interconnection network. Empirical analysis shows collective communication excels with larger mini-batch sizes and/or fewer processes, whereas one-sided communication outperforms at larger scales. We propose MDLoader, a hybrid in-memory data loader for distributed graph neural network training. MDLoader features a model-driven performance estimator that dynamically selects between one-sided and collective communication at the beginning of training using Tree of Parzen Estimators (TPE). Evaluations on NERSC Perlmutter and OLCF Summit show MDLoader outperforms single-backend loaders by up to 2.83 × and predicts the suitable communication method with 96.3% (Perlmutter) and 94.3% (Summit) success rate.

Bae, Jonghyun↗
DOE OSTI2014

Fixed-rate compressed floating-point arrays

ZFP is a library for lossy compression of single- and double-precision floating-point data. One of the unique features of ZFP is its support for fixed-rate compression, which enables random read and write access at the granularity of small blocks of values. Using a C++ interface, this allows declaring compressed arrays (1D, 2D, and 3D arrays are supported) that through operator overloading can be treated just like conventional, uncompressed arrays, but which allow the user to specify the exact number of bits to allocate to the array. ZFP also has variable-rate fixed-precision and fixed-accuracy modes, which allow the user to specify a tolerance on the relative or absolute error.

ECP↗
NASA NTRS1985

A study of topologies and protocols for fiber optic local area network

The emergence of new applications requiring high data traffic necessitates the development of high speed local area networks. Optical fiber is selected as the transmission medium due to its inherent advantages over other possible media and the dual optical bus architecture is shown to be the most suitable topology. Asynchronous access protocols, including token, random, hybrid random/token, and virtual token schemes, are developed and analyzed. Exact expressions for insertion delay and utilization at light and heavy load are derived, and intermediate load behavior is investigated by simulation. A new tokenless adaptive scheme whose control depends only on the detection of activity on the channel is shown to outperform round-robin schemes under uneven loads and multipacket traffic and to perform optimally at light load. An approximate solution to the queueing delay for an oscillating polling scheme under chaining is obtained and results are compared with simulation. Solutions to the problem of building systems with a large number of stations are presented, including maximization of the number of optical couplers, and the use of passive star/bus topologies, bridges and gateways.

Yeh, C.↗
NASA NTRS1994

An incremental database access method for autonomous interoperable databases

We investigated a number of design and performance issues of interoperable database management systems (DBMS's). The major results of our investigation were obtained in the areas of client-server database architectures for heterogeneous DBMS's, incremental computation models, buffer management techniques, and query optimization. We finished a prototype of an advanced client-server workstation-based DBMS which allows access to multiple heterogeneous commercial DBMS's. Experiments and simulations were then run to compare its performance with the standard client-server architectures. The focus of this research was on adaptive optimization methods of heterogeneous database systems. Adaptive buffer management accounts for the random and object-oriented access methods for which no known characterization of the access patterns exists. Adaptive query optimization means that value distributions and selectives, which play the most significant role in query plan evaluation, are continuously refined to reflect the actual values as opposed to static ones that are computed off-line. Query feedback is a concept that was first introduced to the literature by our group. We employed query feedback for both adaptive buffer management and for computing value distributions and selectivities. For adaptive buffer management, we use the page faults of prior executions to achieve more 'informed' management decisions. For the estimation of the distributions of the selectivities, we use curve-fitting techniques, such as least squares and splines, for regressing on these values.

Roussopoulos, Nicholas↗
NASA NTRS1989

On the stability of robotic systems with random communication rates

Control problems of sampled data systems which are subject to random sample rate variations and delays are studied. Due to the rapid growth of the use of computers more and more systems are controlled digitally. Complex systems such as space telerobotic systems require the integration of a number of subsystems at different hierarchical levels. While many subsystems may run on a single processor, some subsystems require their own processor or processors. The subsystems are integrated into functioning systems through communications. Communications between processes sharing a single processor are also subject to random delays due to memory management and interrupt latency. Communications between processors involve random delays due to network access and to data collisions. Furthermore, all control processes involve delays due to casual factors in measuring devices and to signal processing. Traditionally, sampling rates are chosen to meet the worst case communication delay. Such a strategy is wasteful as the processors are then idle a great proportion of the time; sample rates are not as high as possible resulting in poor performance or in the over specification of control processors; there is the possibility of missing data no matter how low the sample rate is picked. Asymptotical stability with probability one for randomly sampled multi-dimensional linear systems is studied. A sufficient condition for the stability is obtained. This condition is so simple that it can be applied to practical systems. A design procedure is also shown.

Kobayashi, H.↗
DOE OSTI2025

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Automated Construction of a Photocatalysis Dataset for Water-Splitting Applications

We present an automatically generated dataset of 15,755 records that were extracted from 47,357 papers. These records contain water-splitting activity in the presence of certain photocatalysts, along with additional information about the chemical reaction conditions under which this activity was recorded. These conditions include any co-catalysts and additives that were present during water splitting, the length of time for which the photocatalytic experiment was conducted, and the type of light source used, including its wavelength. Despite the text extraction of such a wide range of chemical reaction attributes, the dataset afforded good precision (71.2%) and recall (36.3%). These figures-of-merit were calculated based on a random sample of open-access papers from the corpus. Mining such a complex set of attributes required the development of novel techniques in knowledge extraction and interdependency resolution, leveraging inter- and intra-sentence relations, which are also described in this paper. We present a new version (version 2.2) of the chemistry-aware text-mining toolkit ChemDataExtractor, in which these new techniques are included.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Placebo-resistant gut bacteria: Akkermansia muciniphila spp. and Familial Mediterranean fever disease

Introduction: Despite numerous investigations into the impact of drugs/probiotics on the gut microbiota composition in Familial Mediterranean Fever (FMF) patients, the question as to whether there exists a significant bacterial diversity(ies) independent of the placebo effect that can be reliably considered in clinical and nutritional trials remains unresolved. Methods: This study represents the in augural analysis of the placebo’s influence on the gut microbiota of both healthy individuals and FMF afflicted men, utilizing previously collected data from PhyloChip™ DNA microarray experiments. A total of 15 healthy and 15 FMF male volunteers, aged 18 to 50, participated in this partially randomized placebo trial, which is accessible through the GEO Series accession number GSE111835. Results and Discussion: Key findings from current investigations include i. the anticipated divergence in gut bacteria resistance to placebo between healthy and FMF individuals, ii. the minor impact of placebo on gut bacterial diversities in healthy individuals, with Enterobacteriaceae diversities identified as placebo-resistant among “healthy” gut bacteria, and iii. the comprehensive influence of placebo on all bacterial phyla in the gut microbiome of FMF patients, extending to nearly all bacterial genera, except for the resilience of gut Akkermansia muciniphila spp. to placebo in FMF patients. This study underscores the susceptibility of Faecalibacterium, Blautia, and Clostridium genera to placebo. Consequently, this investigation holds significance for the proper design of placebo-controlled trials and establishes a foundation for further exploration of the gut-brain axis. Furthermore, it contributes valuable insights to discussions regarding proposals for probiotic therapies, particularly focusing on Faecalibacterium spp., Blautia spp., and Clostridium spp.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1997

Cellular effects of individual high-linear energy transfer particles and implications for tissue response at low doses

The energy deposition patterns produced by the radiation environment in space can be quite different from those in conventional radiation environments. Furthermore, conventional radiation biological experiments, using randomly distributed particle tracks, cannot access some variables which may be important in determining the health effects of irradiation. Controlled microbeam irradiation provides the means to investigate the effects and unique energy deposition patterns and cell environment for a variety of end points.

Non-NASA Center↗
DOE OSTI2013

Arbitrarily small amounts of correlation for arbitrarily varying quantum channels

As our main result show that in order to achieve the randomness assisted message and entanglement transmission capacities of a finite arbitrarily varying quantum channel it is not necessary that sender and receiver share (asymptotically perfect) common randomness. Rather, it is sufficient that they each have access to an unlimited amount of uses of one part of a correlated bipartite source. This access might be restricted to an arbitrary small (nonzero) fraction per channel use, without changing the main result. We investigate the notion of common randomness. It turns out that this is a very costly resource – generically, it cannot be obtained just by local processing of a bipartite source. This result underlines the importance of our main result. Also, the asymptotic equivalence of the maximal- and average error criterion for classical message transmission over finite arbitrarily varying quantum channels is proven. At last, we prove a simplified symmetrizability condition for finite arbitrarily varying quantum channels.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS2012

Using Random Forest Models to Predict Organizational Violence

We present a methodology to access the proclivity of an organization to commit violence against nongovernment personnel. We fitted a Random Forest model using the Minority at Risk Organizational Behavior (MAROS) dataset. The MAROS data is longitudinal; so, individual observations are not independent. We propose a modification to the standard Random Forest methodology to account for the violation of the independence assumption. We present the results of the model fit, an example of predicting violence for an organization; and finally, we present a summary of the forest in a "meta-tree,"

Levine, Burton↗