Engineering Papers⌕ Search

Engineering topics

Farber, Robert M

Publications and source records attributed to Farber, Robert M.

Thought Leaders during Crises in Massive Social Networks

The vast amount of social media data that can be gathered from the internet coupled with workflows that utilize both commodity systems and massively parallel supercomputers, such as the Cray XMT, open new vistas for research to support health, defense, and national security. Computer technology now enables the analysis of graph structures containing more than 4 billion vertices joined by 34 billion edges along with metrics and massively parallel algorithms that exhibit near-linear scalability according to number of processors. The challenge lies in making this massive data and analysis comprehensible to an analyst and end-users that require actionable knowledge to carry out their duties. Simply stated, we have developed language and content agnostic techniques to reduce large graphs built from vast media corpora into forms people can understand. Specifically, our tools and metrics act as a survey tool to identify thought leaders' -- those members that lead or reflect the thoughts and opinions of an online community, independent of the source language.

97 MATHEMATICS AND COMPUTING↗

Massive Social Network Analysis: Mining Twitter for Social Good

Social networks produce an enormous quantity of data. Facebook consists of over 400 million active users sharing over 5 billion pieces of information each month. Analyzing this vast quantity of unstructured data presents challenges for software and hardware. We present GraphCT, a Graph Characterization Tooklit for massive graphs representing social network data. On a 128-processor Cray XMT, GraphCT estimates the betweenness centrality of an artificially generated (R-MAT) 537 million vertex, 8.6 billion edge graph in 55 minutes. We use GraphCT to analyze public data from Twitter, a microblogging network. Twitter's message connections appear primarily tree-structured as a news dissemination system. Within the public data, however, are clusters of conversations. Using GraphCT, we can rank actors within these conversations and help analysts focus attention on a much smaller data subset.

99 GENERAL AND MISCELLANEOUS↗

Social Media and Social Reality - Theory, Evidence and Validation

Social Media provide an exciting and novel view into social phenomena. The vast amounts of data that can be gathered from the Internet coupled with massively parallel supercomputers such as the Cray XMT open new vistas for research. Conclusions drawn from such analysis must recognize that social media are distinct from the underlying social reality. Rigorous validation is essential. This paper briefly presents results obtained from computational analysis of social media - utilizing both blog and twitter data. Validation of these results is discussed in the context of a framework of established methodologies from the social sciences. Finally, an outline for a set of supporting studies is proposed.

99 GENERAL AND MISCELLANEOUS↗

Massively Parallel Near-Linear Scalability Algorithms with Application to Unstructured Video Analysis

This paper describes the use of high performance, massively parallel unstructured data analysis techniques to computationally extract human faces from streaming video data. The use of parallel high-throughput algorithms is essential to maximize the rate at which frames can be analyzed so large volumes of data can be evaluated to answer the question “Have we seen this person’s face before?” This paper will highlight the method used to achieve near-linear scalability according to number of processing cores for principle component analysis (PCA) on the Texas Advanced Computing Center (TACC) Ranger supercomputer. A global summation across processing core operation, accomplished via MPI_Reduce on Ranger, causes a slight deviation from linear scaling behavior. This mapping has been utilized in the past to enable a host of data centric analytic techniques such as neural networks, multi-dimensional scaling (MDS), signal processing and other methods to address, with massively parallel computers, problems of scientific interest in Physics, Mathematics, Biology and Chemistry.

99 GENERAL AND MISCELLANEOUS↗

Storage in Transition

The one-two technology punch of these increasingly affordable technologies (solid-state memory and RAM) can greatly increase the usability of important applications such as databases. Why specifically mention databases? Well, databases are everywhere. They are highly useful and most scientists use them regularly either directly or indirectly. Expect other seek limited applications – such as HPC file-system meta-data servers – to benefit from these technologies as well.

97 MATHEMATICS AND COMPUTING↗