Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “correlation mining”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2012

A Visual Analytics Approach for Correlation, Classification, and Regression Analysis

New approaches that combine the strengths of humans and machines are necessary to equip analysts with the proper tools for exploring today's increasing complex, multivariate data sets. In this paper, a novel visual data mining framework, called the Multidimensional Data eXplorer (MDX), is described that addresses the challenges of today's data by combining automated statistical analytics with a highly interactive parallel coordinates based canvas. In addition to several intuitive interaction capabilities, this framework offers a rich set of graphical statistical indicators, interactive regression analysis, visual correlation mining, automated axis arrangements and filtering, and data classification techniques. The current work provides a detailed description of the system as well as a discussion of key design aspects and critical feedback from domain experts.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2013

A Visual Analytics Approach for Correlation, Classification, and Regression Analysis

New approaches that combine the strengths of humans and machines are necessary to equip analysts with the proper tools for exploring today s increasing complex, multivariate data sets. In this paper, a visual data mining framework, called the Multidimensional Data eXplorer (MDX), is described that addresses the challenges of today s data by combining automated statistical analytics with a highly interactive parallel coordinates based canvas. In addition to several intuitive interaction capabilities, this framework offers a rich set of graphical statistical indicators, interactive regression analysis, visual correlation mining, automated axis arrangements and filtering, and data classification techniques. This chapter provides a detailed description of the system as well as a discussion of key design aspects and critical feedback from domain experts.

Steed, Chad A↗
DOE OSTI2018

A Big Data Analytics Framework for HPC Log Data: Three Case Studies Using the Titan Supercomputer Log

Reliability, availability and serviceability (RAS) logs of high performance computing (HPC) resources, when closely investigated in spatial and temporal dimensions, can provide invaluable information regarding system status, performance, and resource utilization. These data are often generated from multiple logging systems and sensors that cover many components of the system. The analysis of these data for finding persistent temporal and spatial insights faces two main difficulties: the volume of RAS logs makes manual inspection difficult and the unstructured nature and unique properties of log data produced by each subsystem adds another dimension of difficulty in identifying implicit correlation among recorded events. To address these issues, we recently developed a multi-user Big Data analytics framework for HPC log data at Oak Ridge National Laboratory (ORNL). This paper introduces three in-progress data analytics projects that leverage this framework to assess system status, mine event patterns, and study correlations between user applications and system events. We describe the motivation of each project and detail their workflows using three years of log data collected from ORNL's Titan supercomputer.

Park, Byung↗
DOE OSTI2018

Variation in microbial community structure correlates with heavy-metal contamination in soils decades after mining ceased

Microorganisms play vital roles in Earth's biogeochemical cycles. Identifying disturbances in microbial communities due to anthropogenic contamination can provide insights into the health of ecosystems. Picher, Oklahoma, was the site of large-scale mining operations for Pb, Zn, and other heavy metals until the mid-1950s, operating within the Tri-State Mining District (TSMD) of Missouri, Kansas and Oklahoma. Although mining ceased decades ago, high concentrations of heavy metals (>1000 ppm) remain in area soil and water systems. Previously, we mapped metal concentrations on samples collected from mine tailings in Picher and along cardinal-direction transects within an 8.05-km radius of the town. To elucidate changes in microbial community structure due to regional metal contamination, 16S rRNA gene sequences and qPCR calculations of total Bacteria and Archaea were analyzed against these metal concentrations. Bacteria were negatively and significantly correlated with Pb, Cd, Zn, and Mg; however, Archaea was only significantly and positively correlated with pH. Illumina sequencing of 16S rRNA genes showed significant differences in microbial communities of chat and west transect samples. Comparison of soil chemistry with community structure indicated that Al, Pb, Cd, and Zn significantly impacted community composition and distribution of individual OTUs. Mapping the distribution of heavy-metal contamination and microbial communities in these soils represents the first step in understanding effects of long-term, heavy-metal contamination at a basic trophic level.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

An Investigation on the Pollen-Induced Soiling Losses in Utility-Scale PV Plants

Soiling, the accumulation of dust and other contaminants on the surface of photovoltaic (PV) modules, is a common factor that can negatively impact the performance of PV systems. In this study, the authors aim to analyze the impact of pollen on soiling losses in PV systems located in North Carolina, USA, particularly during the spring season. The performance data of two utility-scale PV plants was collected and analyzed using the two soiling extraction methods. Environmental data, including croplands and vegetation was also collected and analyzed to identify correlations with soiling losses. The results of the study may help improve understanding of necessary operation and maintenance activities for PV plants and provide new insights into the phenomenon of pollen deposition on PV systems.

correlation↗
NASA NTRS1973

Application of ERTS-A imagery to fracture related mine safety hazards in the coal mining industry

The author has identified the following significant results. The most important result to date is the demonstration of the special value of repetitive ERTS-1 multiband coverage for detecting previously unknown fracture lineaments despite the presence of a deep glacial overburden. The Illinois Basin is largely covered with glacial drift and few rock outcrops are present. A contribution to the geological understanding of Illinois and Indiana has been made. Analysis of ERTS-1 imagery has provided useful information to the State of Indiana concerning the surface mined lands. The contrast between healthy vegetation and bare ground as imaged by Band 7 is sharp and substantial detail can be obtained concerning the extent of disturbed lands, associated water bodies, large haul roads, and extent of mined lands revegetation. Preliminary results of analysis suggest a reasonable correlation between image-detected fractures and mine roof fall accidents for a few areas investigated. ERTS-1 applications to surface mining operations appear probable, but further investigations are required. The likelihood of applying ERTS-1 derived fracture data to improve coal mine safety in the entire Illinois Basin is suggested from studies conducted in Indiana.

Wier, C. E.↗
NASA NTRS1972

Study of the application of ERTS-A imagery to fracture-related mine safety hazards in the coal mining industry

The author has identified the following significant results. Various data compilation and analysis activities in support of ERTS-1 imagery interpretation are in progress or are completed. These include the compilation of mine accident data, areas of mine roof instability and the analysis of high altitude color infrared photography and low altitude color and color infrared photography which was acquired by NASA in support of the project. The photography reveals that many fracture lineaments are detectable through a varied thickness of glacial till. These data will be compiled on a series of 1:250,000 scale base maps and evaluated for a correlation between fracture zones and mine accidents and rooffalls. Due to high occurrence of cloud cover in the project area and to the delay in imagery shipments, little progress has been made in the analysis of ERTS-1 imagery.

Wier, C. E.↗
NASA NTRS2016

Holodeck Testbed Project

The main objective of the Holodeck Testbed is to create a cost effective, realistic, and highly immersive environment that can be used to train astronauts, carry out engineering analysis, develop procedures, and support various operations tasks. Currently, the Holodeck testbed allows to step into a simulated ISS (International Space Station) and interact with objects; as well as, perform Extra Vehicular Activities (EVA) on the surface of the Moon or Mars. The Holodeck Testbed is using the products being developed in the Hybrid Reality Lab (HRL). The HRL is combining technologies related to merging physical models with photo-realistic visuals to create a realistic and highly immersive environment. The lab also investigates technologies and concepts that are needed to allow it to be integrated with other testbeds; such as, the gravity offload capability provided by the Active Response Gravity Offload System (ARGOS). My main two duties were to develop and animate models for use in the HRL environments and work on a new way to interface with computers using Brain Computer Interface (BCI) technology. On my first task, I was able to create precise computer virtual tool models (accurate down to the thousandths or hundredths of an inch). To make these tools even more realistic, I produced animations for these tools so they would have the same mechanical features as the tools in real life. The computer models were also used to create 3D printed replicas that will be outfitted with tracking sensors. The sensor will allow the 3D printed models to align precisely with the computer models in the physical world and provide people with haptic/tactile feedback while wearing a VR (Virtual Reality) headset and interacting with the tools. Getting close to the end of my internship the lab bought a professional grade 3D Scanner. With this, I was able to replicate more intricate tools at a much more time-effective rate. The second task was to investigate the use of BCI to control objects inside the hybrid reality ISS environment. This task looked at using an Electroencephalogram (EEG) headset to collect brain state data that could be mapped to commands that a computer could execute. On this Task, I had a setback with the hardware, which stopped working and was returned to the vendor for repair. However, I was still able to collect some data, was able to process it, and started to create correlation algorithms between the electrical patterns in the brain and the commands we wanted the computer to carry out. I also carried out a test to investigate the comfort of the headset if it is worn for a long time. The knowledge gained will benefit me in my future career. I learned how to use various modeling and programming tools that included Blender, Maya, Substance Painter, Artec Studio, Github, and Unreal Engine 4. I learned how to use a professional grade 3D scanner and 3D printer. On the BCI Project I learned about data mining and how to create correlation algorithms. I also supported various demos including a live demo of the hybrid reality lab capabilities at ComicPalooza. This internship has given me a good look into engineering at NASA. I developed a more thorough understanding of engineering and my overall confidence has grown. I have also realized that any problem can be fixed, if you try hard enough, and as an engineer it is your job to not only fix problems but to embrace coming up with solutions to those problems.

Arias, Adriel↗
NASA NTRS2007

Data Mining Methods Applied to Flight Operations Quality Assurance Data: A Comparison to Standard Statistical Methods

In a previous study, multiple regression techniques were applied to Flight Operations Quality Assurance-derived data to develop parsimonious model(s) for fuel consumption on the Boeing 757 airplane. The present study examined several data mining algorithms, including neural networks, on the fuel consumption problem and compared them to the multiple regression results obtained earlier. Using regression methods, parsimonious models were obtained that explained approximately 85% of the variation in fuel flow. In general data mining methods were more effective in predicting fuel consumption. Classification and Regression Tree methods reported correlation coefficients of .91 to .92, and General Linear Models and Multilayer Perceptron neural networks reported correlation coefficients of about .99. These data mining models show great promise for use in further examining large FOQA databases for operational and safety improvements.

Stolzer, Alan J.↗
DOE OSTI2018

Analysis of seismicity at observed at station BCE using subspace detectors

A dynamic correlation processor (DCP) was used to process 90 days of 3-component seismic data recorded by station BCE. Two methods of detector creation were compared. The first attempted to span the signal space with a small number of subspace detectors having minimal projections on one another, and the second used a much larger number of detectors with substantial inter-template projections. After two passes over the data the results were compared, and the second approach was found to have produced more than 3 times the number of detections. For events in common, the average correlation statistic for the second approach was 0.77 compared to a statistic of 0.65 for the first approach. Also, analysis of the detection statistics as a function of SNR showed a strong functional relationship between SNR and correlation statistic for the second approach not found in the first approach. I interpret this to mean that the intra-group variability of signals produced by the second method is due primarily to noise rather than variations in source or path. These results show that (in an environment with large numbers of repeaters) if precise classification is a goal, it is better to operate a DCP with many correlators with substantial inter-template projections and that fully span the signal space. The performance of the DCP was also measured using a small set of “ground truth” picks for BCE from the Chip Brogan catalog. The catalog spanned less than three days out of the 90 days of the experiment and is also incomplete, but the comparison identified 12 signals missed by the DCP because of low SNR. Combining detections by the DCP and picks from the Brogan catalog, identifies 76 unique signals. Of these, the DCP detected 64 (84%) and the Catalog contained between 48/76 (63%) and 48/62 (77%). Analysis of time-of-day and day-of-week statistics was not useful in identifying the signal sources. However, magnitude recurrence statistics were consistent with mining induced seismicity (a preponderance of small sources). Failure of the temporal discriminants may indicate that the events being detected are not coupled in the same way to the mining activity, e.g. secondary failures. Correlation data from explosions at the Nevada test site (NTS) were used to bound the separation of events within groups. Nearly all the NTS correlations with the same passband and time bandwidth product as the detections and having a correlation statistic >= 0.8 are from sources separated by less than 1 km. Even at correlation values of 0.6 nearly all the source separations are less than about 3 km. Because the DCP detectors were formed to span the signal space at a correlation value of 0.9 and because the intra-group variability is most likely due to noise and not source variability, it is likely that the sources associated with each detector are separated by one km or less, and almost certain that the majority are separated by no more than 3 km.

47 OTHER INSTRUMENTATION↗
NASA NTRS1974

Level, peculiarities and effects of coal mine noise on pit workers

There exists a correlation between noise intensity and spectrum and degree of hearing impairment in the different professional categories in the pit. Most affected are dross miners and drillers. In these, the first degree of hypoacusia sets in within the first five years of exposure. Deafness begins at a frequency of 4,000 Hz, but often enough (20%) at 2,000 Hz as well, progressively evolving through the classical stages if exposure to noise continues. In the coal bearing basins investigated, the noise level is, on the whole, 31.2%, but the conventional zone is not involved by more than 6.3%. Technological and medical measures are proposed for the purpose of avoiding these troubles in the future.

Darlea, I. G.↗
DOE OSTI2012

Arsenic Speciation in Blue Mussels (Mytilus edulis) Along a Highly Contaminated Arsenic Gradient

Arsenic is naturally present in marine ecosystems, and these can become contaminated from mining activities, which may be of toxicological concern to organisms that bioaccumulate the metalloid into their tissues. The toxic properties of arsenic are dependent on the chemical form in which it is found (e.g., toxic inorganic arsenicals vs nontoxic arsenobetaine), and two analytical techniques, high performance liquid chromatography coupled with inductively coupled plasma mass spectrometry (HPLC-ICP-MS) and X-ray absorption spectroscopy (XAS), were used in the present study to examine the arsenic species distribution in blue mussels (Mytilus edulis) obtained from an area where there is a strong arsenic concentration gradient as a consequence of mining impacted sediments. A strong positive correlation was observed between the concentration of inorganic arsenic species (arsenic compounds with no As-C bonds) and total arsenic concentrations present in M. edulis tissues (R{sup 2} = 0.983), which could result in significant toxicological consequences to the mussels and higher trophic consumers. However, concentrations of organoarsenicals, dominated by arsenobetaine, remained relatively constant regardless of the increasing As concentration in M. edulis tissue (R{sup 2} = 0.307). XANES bulk analysis and XAS two-dimensional mapping of wet M. edulis tissue revealed the presence of predominantly arsenic-sulfur compounds. The XAS mapping revealed that the As(III)-S and/or As(III) compounds were concentrated in the digestive gland. However, arsenobetaine was found in small and similar concentrations in the digestive gland as well as the surrounding tissue suggesting arsenobetaine may being used in all of the mussel's cells in a physiological function such as an intracellular osmolyte.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Discovery of Protein–lncRNA Interactions by Integrating Large-Scale CLIP-Seq and RNA-Seq Datasets

Long non-coding RNAs (lncRNAs) are emerging as important regulatory molecules in developmental, physiological, and pathological processes. However, the precise mechanism and functions of most of lncRNAs remain largely unknown. Recent advances in high-throughput sequencing of immunoprecipitated RNAs after cross-linking (CLIP-Seq) provide powerful ways to identify biologically relevant protein–lncRNA interactions. In this study, by analyzing millions of RNA-binding protein (RBP) binding sites from 117 CLIP-Seq datasets generated by 50 independent studies, we identified 22,735 RBP–lncRNA regulatory relationships. We found that one single lncRNA will generally be bound and regulated by one or multiple RBPs, the combination of which may coordinately regulate gene expression. We also revealed the expression correlation of these interaction networks by mining expression profiles of over 6000 normal and tumor samples from 14 cancer types. Our combined analysis of CLIP-Seq data and genome-wide association studies data discovered hundreds of disease-related single nucleotide polymorphisms resided in the RBP binding sites of lncRNAs. Finally, we developed interactive web implementations to provide visualization, analysis, and downloading of the aforementioned large-scale datasets. Our study represented an important step in identification and analysis of RBP–lncRNA interactions and showed that these interactions may play crucial roles in cancer and genetic diseases.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1973

Iron-absorption band analysis for the discrimination of iron-rich zones

The author has identified the following significant results. Study has concentrated on the two primary aspects of the project, structural analysis through evaluation of lineaments and circular features and spectral analyses through digital computer-processing techniques. Several previously unrecognized lineaments are mapped which may be the surface manifestations of major fault or fracture zones. Two of these, the Walker Lane and the Midas Trench lineament system, transect the predominantly NNE-NNW-trending moutain ranges for more than 500 km. Correlation of major lineaments with productive mining districts implies a genetic relationship, the 50 circular or elliptical features delineated suggest a related role for Tertiary volcanism. Color-ratio composites have been used to identify limonitic zones and to discriminate mafic and felsic rock by combing diazo color transparencies of three different ratios. EROS Data Center scene identification number for color composite in this report is ER 1 CC 500. Refinement of enhancement procedures for the ratio images is progressing. Fieldwork in coordination with both spectral and structural analyses is underway.

Rowan, L. C.↗
NASA NTRS1973

Fracture mapping and strip mine inventory in the Midwest by using ERTS-1 imagery

Analysis of the ERTS-1 imagery and high-altitude infrared photography indicates that useful fracture data can be obtained in Indiana and Illinois despite a glacial till cover. ERTS MSS bands 5 and 7 have proven most useful for fracture mapping in coal-bearing rocks in this region. Preliminary results suggest a reasonable correlation between image-detected fractures and mine roof-fall accidents. Information related to surface mined land, such as disturbed area, water bodies, and kind of reclamation, has been derived from the analysis of ERTS imagery.

Wier, C. W.↗