Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “very large databases”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Information-Theoretic Exploration of Multivariate Time-Varying Image Databases

Modern scientific simulations produce very large datasets, making interactive exploration of such data computationally prohibitive. An increasingly common data reduction technique is to store visualizations and other data extracts in a database. The Cinema project is one such approach, storing visualizations in an image database for post hoc exploration and interactive image-based analysis. This work focuses on developing efficient algorithms that can quantify various types of multivariate dependencies existing within multi-variable datasets. It applies specific mutual information measures for the quantification of salient regions from multivariate image data. Here, using such information measures, the opacity of the images is modulated so that the salient regions are automatically highlighted and the domain scientists can interactively explore the most relevant regions for scientific discovery.

97 MATHEMATICS AND COMPUTING↗

Specification, Design, and Analysis of Advanced HUMS Architectures

During the two-year project period, we have worked on several aspects of domain-specific architectures for HUMS. In particular, we looked at using scenario-based approach for the design and designed a language for describing such architectures. The language is now being used in all aspects of our HUMS design. In particular, we have made contributions in the following areas. 1) We have employed scenarios in the development of HUMS in three main areas. They are: (a) To improve reusability by using scenarios as a library indexing tool and as a domain analysis tool; (b) To improve maintainability by recording design rationales from two perspectives - problem domain and solution domain; (c) To evaluate the software architecture. 2) We have defined a new architectural language called HADL or HUMS Architectural Definition Language. It is a customized version of xArch/xADL. It is based on XML and, hence, is easily portable from domain to domain, application to application, and machine to machine. Specifications written in HADL can be easily read and parsed using the currently available XML parsers. Thus, there is no need to develop a plethora of software to support HADL. 3) We have developed an automated design process that involves two main techniques: (a) Selection of solutions from a large space of designs; (b) Synthesis of designs. However, the automation process is not an absolute Artificial Intelligence (AI) approach though it uses a knowledge-based system that epitomizes a specific HUMS domain. The process uses a database of solutions as an aid to solve the problems rather than creating a new design in the literal sense. Since searching is adopted as the main technique, the challenges involved are: (a) To minimize the effort in searching the database where a very large number of possibilities exist; (b) To develop representations that could conveniently allow us to depict design knowledge evolved over many years; (c) To capture the required information that aid the automation process.

Mukkamala, Ravi↗

MIBiG 3.0: a community-driven effort to annotate experimentally validated biosynthetic gene clusters

Abstract With an ever-increasing amount of (meta)genomic data being deposited in sequence databases, (meta)genome mining for natural product biosynthetic pathways occupies a critical role in the discovery of novel pharmaceutical drugs, crop protection agents and biomaterials. The genes that encode these pathways are often organised into biosynthetic gene clusters (BGCs). In 2015, we defined the Minimum Information about a Biosynthetic Gene cluster (MIBiG): a standardised data format that describes the minimally required information to uniquely characterise a BGC. We simultaneously constructed an accompanying online database of BGCs, which has since been widely used by the community as a reference dataset for BGCs and was expanded to 2021 entries in 2019 (MIBiG 2.0). Here, we describe MIBiG 3.0, a database update comprising large-scale validation and re-annotation of existing entries and 661 new entries. Particular attention was paid to the annotation of compound structures and biological activities, as well as protein domain selectivities. Together, these new features keep the database up-to-date, and will provide new opportunities for the scientific community to use its freely available data, e.g. for the training of new machine learning models to predict sequence-structure-function relationships for diverse natural products. MIBiG 3.0 is accessible online at https://mibig.secondarymetabolites.org/.

59 BASIC BIOLOGICAL SCIENCES↗

Implementation of a Very Large Atmospheric Correction Lookup Table for ASTER Using a Relational Database Management System

The Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER)is designed to provide a high resolution map of the Earth in both visible, near-infrared, and thermal spectral regions of the electromagnetic spectrum. The ASTER Science Team has developed several standard data product algorithms, but the most complex aod computing-intensive of these is the estimation of surface radiance and reflectance values, which is done by modeling and correcting for the effects of the atmosphere. The algorithm for atmospheric correction in the visible bands sensed by ASTER calls for use of a very large Atmospheric Correction Look Up Table (ACLUT).

ASTER↗

Observations of loops and prominences

We review recent observations by the Yohkoh-SXT (Soft X-ray Telescope) in collaboration with other spacecraft and ground-based observatories of coronal loops and prominences. These new results point to problems that SoHO will be able to address. With a unique combination of rapid-cadence digital imaging (greater than or equal to 32 s full-disk and greater than or equal to 2 s partial-frame images), high spatial resolution (greater than or equal to 2.5 arcsec pixels), high sensitivity (EM less than or equal to 10(exp 42) cm(exp -3)), a low-scatter mirror, and large dynamic range, SXT can observe a vast range of targets on the Sun. Over the first 21 months of Yohkoh operations SXT has taken over one million images of the corona and so is building up an invaluable long-term database on the large-scale corona and loop geometry. The most striking thing about the SXT images is the range of loop sizes and shapes. The active regions are a bright tangle of magnetic field lines, surrounded by a network of large-scale quiet-Sun loops stretching over distances in excess of 105 km. The cross-section of most loops seems to be constant. Loops displaying significant Gamma's are the exception, not the rule, implying the presence of widespread currents in the corona. All magnetic structures show changes. Time scales range from seconds to months. The question of how these structures are formed, become filled with hot plasma, and are maintained is still open. While we see the propagation of brightenings along the length of active-region loops and in X-ray jets with velocities of several hundred km/s, much higher velocities are seen in the quiet Sun. In XBP flares, for example, velocities of over 1000 km/s are common. Active-region loops seem to be in constant motion, moving slowly outward, carrying plasma with them. During flares, loops often produce localized brightenings at the base and later at the apex of the loop. Quiescent filaments and prominences have been observed regularly. Their coronal manifestation seems to be an extended arcade of loops overlying the filament. Reliable alignment of the ground-based data with the X-ray images make it possible to make a detailed intercomparison of the hot and cold plasma structures over extended periods. Hence we are able to follow the long-term evolution of these structures and see how they become destabilized and erupt.

Strong, Keith T.↗

International contributions to IAEA-NEA heat transfer databases for supercritical fluids

An IAEA Coordinated Research Project on 'Heat Transfer Behaviour and Thermohydraulics Code Testing for SCWRs' is being conducted to facilitate collaboration and interaction among participants from 15 organizations. While the project covers several key technology areas relevant to the development of SCWR concepts, it focuses mainly on the heat transfer aspect, which has been identified as the most challenging. Through the collaborating effort, large heat-transfer databases have been compiled for supercritical water and surrogate fluids in tubes, annuli, and bundle subassemblies of various orientations over a wide range of flow conditions. Assessments of several supercritical heat-transfer correlations were performed using the complied databases. The assessment results are presented. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Theory-based scaling laws of near and far scrape-off layer widths in single-null L-mode discharges

Abstract Theory-based scaling laws of the near and far scrape-off layer (SOL) widths are analytically derived for L-mode diverted tokamak discharges by using a two-fluid model. The near SOL pressure and density decay lengths are obtained by leveraging a balance among the power source, perpendicular turbulent transport across the separatrix, and parallel losses at the vessel wall, while the far SOL pressure and density decay lengths are derived by using a model of intermittent transport mediated by filaments. The analytical estimates of the pressure decay length in the near SOL is then compared to the results of three-dimensional, flux-driven, global, two-fluid turbulence simulations of L-mode diverted tokamak plasmas, and validated against experimental measurements taken from an experimental multi-machine database of divertor heat flux profiles, showing in both cases a very good agreement. Analogously, the theoretical scaling law for the pressure decay length in the far SOL is compared to simulation results and to experimental measurements in TCV L-mode discharges, pointing out the need of a large multi-machine database for the far SOL decay lengths.

Physics↗

Supervised extraction of near-complete genomes from metagenomic samples: A new service in PATRIC

Large amounts of metagenomically-derived data are submitted to PATRIC for analysis. In the future, we expect even more jobs submitted to PATRIC will use metagenomic data. One in-demand use case is the extraction of near-complete draft genomes from assembled contigs of metagenomic origin. The PATRIC metagenome binning service utilizes the PATRIC database to furnish a large, diverse set of reference genomes. We provide a new service for supervised extraction and annotation of high-quality, near-complete genomes from metagenomically-derived contigs. Reference genomes are assigned to putative draft genome bins based on the presence of single-copy universal marker roles in the sample, and contigs are sorted into these bins by their similarity to reference genomes in PATRIC. Each set of binned contigs represents a draft genome that will be annotated by RASTtk in PATRIC. A structured-language binning report is provided containing quality measurements and taxonomic information about the contig bins. The PATRIC metagenome binning service emphasizes extraction of high-quality genomes for downstream analysis using other PATRIC tools and services. Due to its supervised nature, the binning service is not appropriate for mining novel or extremely low-coverage genomes from metagenomic samples.

59 BASIC BIOLOGICAL SCIENCES↗

High Performance Semantic Factoring of Giga-Scale Semantic Graph Databases

As semantic graph database technology grows to address components ranging from extant large triple stores to SPARQL endpoints over SQL-structured relational databases, it will become increasingly important to be able to bring high performance computational resources to bear on their analysis, interpretation, and visualization, especially with respect to their innate semantic structure. Our research group built a novel high performance hybrid system comprising computational capability for semantic graph database processing utilizing the large multithreaded architecture of the Cray XMT platform, conventional clusters, and large data stores. In this paper we describe that architecture, and present the results of our deploying that for the analysis of the Billion Triple dataset with respect to its semantic factors.

Semantic graph databases, high performance computi↗

The radial phase variation of reversed-shear and toroidicity-induced Alfvén eigenmodes in DIII-D

The eigenfunction of an instability contains information about energy flow in the wave. Here, the amplitude and phase of electron cyclotron emission radiometer data from hundreds of DIII-D reversed shear Alfvén eigenmodes (RSAE) and toroidicity-induced Alfvén eigenmodes (TAE) are analyzed along the outboard horizontal midplane. The radial phase profile can be flat, linearly rising or falling, convex or concave; in other words, a wide variety of shapes is observed. For a particular mode, often the radial phase profile remains approximately constant as the mode evolves in time but sometimes it changes rapidly. Many TAEs and some RSAEs have phase profiles that are rather flat where the mode amplitude is largest but rise steadily by ~2π at large major radius. Rapid phase changes are observed when the frequencies of an RSAE and TAE overlap and the modes couple. The phase profile depends weakly on the fast-ion gradient that would appear in the absence of wave-induced transport. Linear and quadratic fits to the phase profiles, together with many plasma parameters, are assembled into RSAE and TAE databases. In both cases, large variability is observed. For RSAEs, the strongest phase dependencies are on electron temperature T e , RSAE mode frequency, and the density of carbon impurities. For TAEs, the strongest dependencies are on beam power and major radius of the mode. In general, the average RSAE radial phase profile is essentially flat but the TAE profile has non-zero slope and curvature.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The IBM PC at NASA Ames

Like many large companies, Ames relies very much on its computing power to get work done. And, like many other large companies, finding the IBM PC a reliable tool, Ames uses it for many of the same types of functions as other companies. Presentation and clarification needs demand much of graphics packages. Programming and text editing needs require simpler, more-powerful packages. The storage space needed by NASA's scientists and users for the monumental amounts of data that Ames needs to keep demand the best database packages that are large and easy to use. Availability to the Micom Switching Network combines the powers of the IBM PC with the capabilities of other computers and mainframes and allows users to communicate electronically. These four primary capabilities of the PC are vital to the needs of NASA's users and help to continue and support the vast amounts of work done by the NASA employees.

Peredo, James P.↗

High performance semantic factoring of giga-scale semantic graph databases.

As semantic graph database technology grows to address components ranging from extant large triple stores to SPARQL endpoints over SQL-structured relational databases, it will become increasingly important to be able to bring high performance computational resources to bear on their analysis, interpretation, and visualization, especially with respect to their innate semantic structure. Our research group built a novel high performance hybrid system comprising computational capability for semantic graph database processing utilizing the large multithreaded architecture of the Cray XMT platform, conventional clusters, and large data stores. In this paper we describe that architecture, and present the results of our deploying that for the analysis of the Billion Triple dataset with respect to its semantic factors, including basic properties, connected components, namespace interaction, and typed paths.

99 GENERAL AND MISCELLANEOUS↗

High Performance Descriptive Semantic Analysis of Semantic Graph Databases

As semantic graph database technology grows to address components ranging from extant large triple stores to SPARQL endpoints over SQL-structured relational databases, it will become increasingly important to be able to understand their inherent semantic structure, whether codified in explicit ontologies or not. Our group is researching novel methods for what we call descriptive semantic analysis of RDF triplestores, to serve purposes of analysis, interpretation, visualization, and optimization. But data size and computational complexity makes it increasingly necessary to bring high performance computational resources to bear on this task. Our research group built a novel high performance hybrid system comprising computational capability for semantic graph database processing utilizing the large multi-threaded architecture of the Cray XMT platform, conventional servers, and large data stores. In this paper we describe that architecture and our methods, and present the results of our analyses of basic properties, connected components, namespace interaction, and typed paths such for the Billion Triple Challenge 2010 dataset.

99 GENERAL AND MISCELLANEOUS↗

A priori and a posteriori investigations for developing large eddy simulations of multi-species turbulent mixing under high-pressure conditions

A Direct Numerical Simulation (DNS) database was created representing mixing of species under high-pressure conditions. The configuration considered is that of a temporally evolving mixing layer. The database was examined and analyzed for the purpose of modeling some of the unclosed terms that appear in the Large Eddy Simulation (LES) equations. Several metrics are used to understand the LES modeling requirements. First, a statistical analysis of the DNS-database large-scale flow structures was performed to provide a metric for probing the accuracy of the proposed LES models as the flow fields obtained from accurate LESs should contain structures of morphology statistically similar to those observed in the filtered-and-coarsened DNS (FC-DNS) fields. To characterize the morphology of the large-scales structures, the Minkowski functionals of the iso-surfaces were evaluated for two different fields: the second-invariant of the rate of deformation tensor and the irreversible entropy production rate. To remove the presence of the small flow scales, both of these fields were computed using the FC-DNS solutions. It was found that the large-scale structures of the irreversible entropy production rate exhibit higher morphological complexity than those of the second invariant of the rate of deformation tensor, indicating that the burden of modeling will be on recovering the thermodynamic fields. Second, to evaluate the physical effects which must be modeled at the subfilter scale, an a priori analysis was conducted. This a priori analysis, conducted in the coarse-grid LES regime, revealed that standard closures for the filtered pressure, the filtered heat flux, and the filtered species mass fluxes, in which a filtered function of a variable is equal to the function of the filtered variable, may no longer be valid for the high-pressure flows considered in this study. The terms requiring modeling are the filtered pressure, the filtered heat flux, the filtered pressure work, and the filtered species mass fluxes. Improved models were developed based on a scale-similarity approach and were found to perform considerably better than the classical ones. These improved models were also assessed in an a posteriori study. Different combinations of the standard models and the improved ones were tested. At the relatively small Reynolds numbers achievable in DNS and at the relatively small filter widths used here, the standard models for the filtered pressure, the filtered heat flux, and the filtered species fluxes were found to yield accurate results for the morphology of the large-scale structures present in the flow. Analysis of the temporal evolution of several volume-averaged quantities representative of the mixing layer growth, and of the cross-stream variation of homogeneous-plane averages and second-order correlations, as well as of visualizations, indicated that the models performed equivalently for the conditions of the simulations. The expectation is that at the much larger Reynolds numbers and much larger filter widths used in practical applications, the improved models will have much more accurate performance than the standard one.

42 ENGINEERING↗

Case Study Analyses of the SUCCESS DC-8 Scanning Lidar Database

Under project SUCCESS (Subsonic Aircraft Contrail and Cloud Effects Special Study) funded by the Atmospheric Effects of Aviation Program, SRI International (SRI) developed an angular scanning backscatter lidar for operation on the NASA DC-8 research aircraft and deployed the scanning lidar during the SUCCESS field campaign. The primary purpose of the lidar was to generate real-time video displays of clouds and contrails above, ahead of, and below the DC-8 as a means to help position the aircraft for optimum cloud and contrail sampling by onboard in situ sensors, and to help extend the geometrical domain of the in situ sampling records. A large, relatively complex lidar database was collected and several data examples were processed to illustrate the value of the lidar data for interpreting the other data records collected during SUCCESS. These data examples were used to develop a journal publication for the special SUCCESS Geophysical Research Letters issue. The data examples justified data analyses of a larger part of the DC-8 lidar database and is the objective of the current study. Efficient processing of the SUCCESS DC-8 scanning lidar database required substantial effort to enhance hardware and software components of the data system that was used for the initial analyses. MATLAB instructions are used to generate altitude and distance color-coded lidar displays corrected for effects introduced by aircraft pitch and forward movement during an angular scan time interval. Onboard in situ sensor atmospheric measurements are propagated to distances ahead of the DC-8 using recorded aircraft velocity so that they can be plotted on the lidar displays for comparison with lidar remotely observed aerosol distributions. Resulting lidar and in situ sensor polar scan displays over extended sampling intervals are integrated into a time series movie format for 36 case studies. Contrails and clouds were detected to ranges of 15 km by the forward-viewing angular scanning lidar and were progressively mapped as the aircraft approached and penetrated them. Near aircraft lidar observations were much better correlated with in situ sensor observations than lidar observations at greater distances ahead of the aircraft. The major cause of this difference was thought to be the about 2 deg. offset of the lidar viewing direction from the flight direction. Contrail spatial distributions were not of the quality obtainable from ground-based lidar observations. This results because contrails tend to become horizontally stratified, vertical distance between angular lidar observations increases with increased distance from the aircraft, and erratic aircraft motions during an angular scan. The most useful lidar observations were made with lidar viewing directions of vertically upward or vertically downward. These provided real-time information on aircraft altitudes to achieve optimum in situ cloud and contrail sampling. At sampling altitudes, the forward viewing angular scanning observations were useful for fine-tuning the aircraft altitude for cloud and contrail penetration. Best information on cloud and contrail properties were obtained from vertically directed lidar observations as the aircraft performed a series of upward and downward penetrations of contrails. This operational mode was especially well suited for lidar and radiometric evaluation of cloud and contrail optical and radiative properties. The vertical viewing lidar detected ice crystals thought to be precipitating from an aircraft contrail and their scavenging by a cirrus cloud layer. The lidar display indicates that the crystals are effective for increasing cirrus cloud density. Vertical angular scanning observations can evaluate the sharp decrease in lidar backscatter for small off-vertical viewing directions that result from horizontally aligned ice crystals and perhaps can provide additional information on crystal shapes. The about 2 deg. offset of the lidar viewing direction from the flight direction is thought to have greatly degraded the forward-viewing angular scanning observations and this mode of operation was not fully evaluated. However, the reasoning for this capability remains valid and the angular scan presentations collected during this program justifies modification of the lidar pod for true forward direction lidar viewing during future cloud and contrail studies.

Uthe, Edward E.↗

SCOPe: classification of large macromolecular structures in the structural classification of proteins—extended database

The SCOPe (Structural Classification of Proteins—extended, https://scop.berkeley.edu) database hierarchically classifies domains from the majority of proteins of known structure according to their structural and evolutionary relationships. SCOPe also incorporates and updates the ASTRAL compendium, which provides multiple databases and tools to aid in the analysis of the sequences and structures of proteins classified in SCOPe. Protein structures are classified using a combination of manual curation and highly precise automated methods. In the current release of SCOPe, 2.07, we have focused our manual curation efforts on larger protein structures, including the spliceosome, proteasome and RNA polymerase I, as well as many other Pfam families that had not previously been classified. Domains from these large protein complexes are distinctive in several ways: novel non-globular folds are more common, and domains from previously observed protein families often have N- or C-terminal extensions that were disordered or not present in previous structures. The current monthly release update, SCOPe 2.07–2018-10–18, classifies 90 992 PDB entries (about two thirds of PDB entries).

Biochemistry & Molecular Biology↗

Case Study Analyses of the Success DC-8 Scanning Lidar Database

Under project SUCCESS (Subsonic Aircraft Contrail and Cloud Effects Special Study) funded by the Atmospheric Effects of Aviation Program, SRI International (SRI) developed an angular scanning back'scatter lidar for operation on the NASA DC-8 research aircraft and deployed the scanning lidar during the SUCCESS field campaign. The primary purpose of the lidar was to generate real-time video displays of clouds and contrails above, ahead of, and below the DC-8 as a means to help position the aircraft for optimum cloud and contrail sampling by onboard in situ sensors, and to help extend the geometrical domain of the in situ sampling records. A large, relatively complex lidar database was collected and several data examples were processed to illustrate the value of the lidar data for interpreting the other data records collected during SUCCESS. These data examples were used to develop a journal publication for the special SUCCESS Geophysical Research Letters issue (reprint presented as Appendix A). The data examples justified data analyses of a larger part of the DC-8 lidar database and is the objective of the current study.

Uthe, Edward E.↗

Comparison of the Frontier Distributed Database Caching System to NoSQL Databases

One of the main attractions of non-relational NoSQL databases is their ability to scale to large numbers of readers, including readers spread over a wide area. The Frontier distributed database caching system, used in production by the Large Hadron Collider CMS and ATLAS detector projects for Conditions data, is based on traditional SQL databases but also adds high scalability and the ability to be distributed over a wide-area for an important subset of applications. This paper compares the major characteristics of the two different approaches and identifies the criteria for choosing which approach to prefer over the other. It also compares in some detail the NoSQL databases used by CMS and ATLAS: MongoDB, CouchDB, HBase, and Cassandra.

Dykstra, Dave↗