Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Twitter”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Mining Twitter Data to Augment NASA GPM Validation

The Twitter data stream is an important new source of real-time and historical global information for potentially augmenting the validation program of NASA's Global Precipitation Measurement (GPM) mission. There have been other similar uses of Twitter, though mostly related to natural hazards monitoring and management. The validation of satellite precipitation estimates is challenging, because many regions lack data or access to data, especially outside of the U.S. and in remote and developing areas. The time-varying set of "precipitation" tweets can be thought of as an organic network of rain gauges, potentially providing a widespread view of precipitation occurrence. Twitter provides a large source of crowd for crowdsourcing. During a 24-hour period in the middle of the snow storm this past March in the U.S. Northeast, we collected more than 13,000 relevant precipitation tweets with exact geolocation. The overall objective of our project is to determine the extent to which processed tweets can provide additional information that improves the validation of GPM data. Though our current effort focuses on tweets and precipitation, our approach is general and applicable to other social media and other geophysical measurements. Specifically, we have developed an operational infrastructure for processing tweets, in a format suitable for analysis with GPM data; engaged with potential participants, both passive and active, to "enrich" the Twitter stream; and inter-compared "precipitation" tweet data, ground station data, and GPM retrievals. In this presentation, we detail the technical capabilities of our tweet processing infrastructure, including data abstraction, feature extraction, search engine, context-awareness, real-time processing, and high volume (big) data processing; various means for "enriching" the Twitter stream; and results of inter-comparisons. Our project should bring a new kind of visibility to Twitter and engender a new kind of appreciation of the value of Twitter by the science research communities.

validatio

Citizen Science Twitter Data Management for Earth Science Applications

Social media data can provide useful real-time and historical information relating to the natural world, but managing this data poses challenges. Scientists at GES DISC are exploring the potential of Twitter data to augment precipitation data from the Global Precipitation Measurement (GPM) mission. However, the format of Twitter data is unconventional in the context of NASA data centers, resulting in frustration for scientists who need to work with the data. This study investigated procedures and standards needed to properly manage Twitter data to make them compatible with these data centers. After comparing databases, the study found that the MongoDB database was best suited for the storage of raw Twitter data due to its flexibility, ability to be accessed by multiple users, and querying functionality. The study used the Python package Zarr to transform processed Twitter data into a gridded format similar to that of satellite data. Each Tweet was mapped onto a time-space grid; each grid location contained information about Tweet attributes and precipitation. The study developed a pipeline for downloading, storing, and gridding Twitter data and transformed Twitter data into an understandable format for users of NASA satellite data.

Li, Rachel

Enriching the Twitter Stream Increasing Data Mining Yield and Quality Using Machine Learning

Social media data streams are important sources of real-time and historical global information for science applications. At the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), we are exploring the Twitter data stream for its potential in augmenting the validation program of NASA Earth science missions, specifically the Global Precipitation Measurement (GPM) mission. We have implemented a tweet processing infrastructure that outputs classified precipitation tweets. Inputs are "passive" tweets, along with a smaller number of tweets from "active" participants, i.e., those knowingly contributing to our effort. The "active" tweets, presumably of higher quality, enrich the Twitter stream. "Active" sources include data scraped from other social media (e.g., public Facebook posts) and data from existing crowdsourcing programs (e.g., mPING reports). In addition, there is likely relevant precipitation information in images and documents that are the end points of links often included in tweets. Information derived from these "active" sources could then be tweeted into the Twitter stream, thus enriching its quality. The objective of our current work is to mine these tweet­ linked images and documents, using neural networks, to increase the information content and quality related to precipitation. For images, we classified them as either precipitation-related or not. For training and validation, we used images obtained via the Google custom search API. We created two models: (1) by training a simple Convolutional Neural Network and (2) by using transfer learning principles to adapt a pre-trained object recognition model. For documents, both those linked to tweets and the tweet contents, we trained Hierarchical Attention Networks to determine precipitation occurrence, type, and intensity. For training and validation, we used a keyword-filtered tweet data set labelled with ground truth data from Dark Sky (an API to retrieve weather-related labels) and the National Severe Storms Laboratory's Multi­ Radar/Multi-Sensor (MRMS) system. Our results demonstrated the efficacy of our machine learning approaches for enriching the Twitter stream, to derive information potentially useful for validation of earth science satellite data.

Albayrak, Arif

Developing a Machine-Learning-Based Processing Framework for Twitter and Other Crowdsourced Data

Crowdsourced data streams such as Twitter and other social media are important sources of real-time and historical global information for Earth science applications. At the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), we have been exploring the Twitter data stream for its potential in augmenting the validation program of NASA's Global Precipitation Measurement (GPM) mission. To realize this potential, we need to increase the information density and enhance the quality of filtered precipitation tweets. We have implemented various components of a machine learning (ML)-based processing infrastructure for crowdsourced data that outputs, in this instance, useful and usable information derived from precipitation tweets. We have test enriched the Twitter stream with higher quality active tweets from those knowingly contributing to our effort and from existing crowdsourced programs (e.g., mPING, CoCoRaHS). We have experimented with various algorithms for processing tweets, including Naà ve Bayes, Convolutional Neural Network (CNN), Hierarchical Attention Network (HAN), and semi-supervised learning (with tri-training). Our current work focuses on (1) automated review of Earth science-related publications to determine relationships between discipline research needs and ML algorithms; (2) investigating Sequential Generative Adversarial Network (SeqGAN) for processing precipitation tweets for anomaly detection; and (3) managing crowdsourced data in a way that is compatible with existing NASA satellite data archives and using the data for ML applications. Key results include (1) network visualization of NLP-processed publications in various Earth science disciplines; (2) difference between GPM-linked, generated tweets and collected actual tweets that is small for GPM-determined light to moderate rain cases and high for GPM-determined heavy rain cases; and (3) identification of MongoDB for storing raw tweets and Zarr format for gridded tweets (compatible with GPM data). Our results have taken us a step closer to an operational ML-based tweet processing infrastructure and have already demonstrated that tweet-derived precipitation information is potentially useful for validation of Earth science satellite data.

Teng, William

AI-based Cyber Event OSINT via Twitter Data

Open-Source Intelligence (OSINT) is largely regarded as a necessary component for cybersecurity intelligence gathering to secure network systems. With the advancement of artificial intelligence (AI) and increasing usage of social media, like Twitter, we have a unique opportunity to obtain and aggregate information from social media. In this study, we propose an AI-based scheme capable of automatically pulling information from Twitter, filtering out security-irrelevant tweets, performing natural language analysis to correlate the tweets about each cybersecurity event (e.g., a malware campaign), and validating the information. This scheme has many applications, such as providing a means for security operators to gain insight into ongoing events and helping them prioritize vulnerabilities to deal with. To give examples of the possible uses, we present three case studies demonstrating the event discovery and investigation processes.

Dale, Dakota

Open Source Intelligence for Cybersecurity Events via Twitter Data

Open-Source Intelligence (OSINT) is largely regarded as a necessary component for cybersecurity intelligence gathering to secure network systems. With the advancement of artificial intelligence (AI) and increasing usage of social media, like Twitter, we have a unique opportunity to obtain and aggregate information from social media. In this study, we propose an AI-based scheme capable of automatically pulling information from Twitter, filtering out security-irrelevant tweets, performing natural language analysis to correlate the tweets about each cybersecurity event (e.g., a malware campaign), and validating the information. This scheme has many applications, such as providing a means for security operators to gain insight into ongoing events and helping them prioritize vulnerabilities to deal with. To give examples of the possible uses, we present three case studies demonstrating the event discovery and investigation processes. We also examine the potential of OSINT for identifying the network protocols associated with specific events, which can aid in the mitigation procedures by informing operators if the vulnerability is exploitable given their system’s network configurations.

Dale, Dakota

Framework for Processing Citizens Science Data for Applications to NASA Earth Science Missions

Citizen science (or crowdsourcing) has drawn much high-level recent and ongoing interest and support. It is poised to be applied, beyond the by-now fairly familiar use of, e.g., Twitter for natural hazards monitoring, to science research, such as augmenting the validation of NASA earth science mission data. This interest and support is seen in the 2014 National Plan for Civil Earth Observations, the 2015 White House forum on citizen science and crowdsourcing, the ongoing Senate Bill 2013 (Crowdsourcing and Citizen Science Act of 2015), the recent (August 2016) Open Geospatial Consortium (OGC) call for public participation in its newly-established Citizen Science Domain Working Group, and NASA's initiation of a new Citizen Science for Earth Systems Program (along with its first citizen science-focused solicitation for proposals). Over the past several years, we have been exploring the feasibility of extracting from the Twitter data stream useful information for application to NASA precipitation research, with both "passive" and "active" participation by the twitterers. The Twitter database, which recently passed its tenth anniversary, is potentially a rich source of real-time and historical global information for science applications. The time-varying set of "precipitation" tweets can be thought of as an organic network of rain gauges, potentially providing a widespread view of precipitation occurrence. The validation of satellite precipitation estimates is challenging, because many regions lack data or access to data, especially outside of the U.S. and in remote and developing areas. Mining the Twitter stream could augment these validation programs and, potentially, help tune existing algorithms. Our ongoing work, though exploratory, has resulted in key components for processing and managing tweets, including the capabilities to filter the Twitter stream in real time, to extract location information, to filter for exact phrases, and to plot tweet distributions. The key step is to process the "precipitation" tweets to be compatible with satellite-retrieved precipitation data. These key components for processing and managing "precipitation" tweets (and additional ones to be developed) are not limited to precipitation, nor are they limited to the Twitter social medium. Indeed, to maximize the value of our work for NASA earth science programs, these components should be generalized and be part of an overall framework for processing citizen science data for science research. In this paper, we outline such a framework.

earth science satellite data

21st Century Connections: Making Sense of Social Media Tools

Twitter? Blog? Facebook? In an environment of complex project teams and demanding timelines, you may wonder whether any of these new-fangled social media tools that are in the news will help you and your team do a better job delivering project results. What in the world is Facebook and why would I ever want to use it? What does a blog have to do with a NASA project? Aside from my teenager, who cares about Twitter? This introduction to social media is a great way to get your feet wet with some of these new terms and tools. For example, we'll talk about what the difference is between a blog and Facebook. We'll look at some examples of NASA projects that benefit from using blogs, Facebook or Twitter. Most importantly, we'll spend some time talking about how a small or medium-sized project might evaluate whether to use one, many or none of these new ideas. Although there are many commercial tools available and in use across the agency, this talk emphasizes NASA-sponsored tools that are freely available within the Agency.

Fujiech, Maura C.

Sun-Earth Day: Reaching the Education Audience by Informal Means

For ten years the Sun-Earth Day program has promoted Heliophysics education to ever larger audiences through events centered on attractive annual themes. What originally started out as a one day event quickly evolved into a series of programs and events that occur throughout the year culminating with a celebration on or near the Spring Equinox. The events are often formal broadcasts or webcasts seeking to convey the science behind the latest solar-terrestrial mission discoveries. This has been quite successful, but it is clear that the younger generation increasingly depends on social networking approaches and informal news transmission for learning what is happening in the world around them. For 2010, the Sun-Earth Day team put emphasis on using informal approaches to bring the theme to the audience. The main event, a webcast from the NASA booth at the National Science Teachers Association (NSTA) annual meeting by the NASA EDGE group, took a lighthearted and offbeat approach to interviewing scientists and educators about Heliophysics news. NASA EDGE programs are unscripted and unpredictable, and that represents a different approach to getting the message across. The webcast was supplemented by a number of social networking avenues. The Sun-Earth Day program explored a wide range of social media applications including Facebook, Twitter, NING, podcasting, iPhone apps, etc. Each of these offers unique and effective methods to promote Heliophysics content and mission related highlights. The facebook site was quite popular and message posting there told the Sun-Earth Day story piece by piece. The same could be said of twittering and the tweetup held at the NSTA site. Has all of this been effective? Results are still being gathered, but anecdotal responses from the world seem very positive. What other methods might be used in the future to bring the science to a personal hands-on, interactive experience? Outcomes: Participants will: (1) Be introduced to the Sun-Earth Day program and its evolution through a decade of programs; (2) Hear about the methods used to communicate and educate through the years and how well they have worked; and (3) Be acquainted with the latest usage of social networking and informal education approaches and how well they have worked

Thieman, J.

Stennis Space Center Salinity Drifter Project. A Collaborative Project with Hancock High School, Kiln, MS

Presentation topics include: importance of salinity of coastal waters, habitat switching algorithm, habitat switching module, salinity estimates from Landsat for Sabine Calcasieu Basin, percent of time inundated in 2006, salinity data, prototyping the system, system as packaged for field tests, salinity probe and casing, opening for water flow, cellular antenna used to transmit data, preparing to launch, system is launched in the Pearl River at Stennis Space Center, data are transmitted to Twitter by cell phone modem every 15 minutes, Google spreadsheet I used to import the data from the Twitter feed and to compute salinity (from conductivity) and display charts of salinity and temperature, results are uploaded to NASA's Applied Science and Technology Project Office Webpage.

Kalcic, Maria

When the Sky Falls: Performing Initial Assessments of Bright Atmospheric Events

The 2013 Chelyabinsk super bolide was the first "significant" impact event to occur in the age of social media and 24 hour news. Scientists, used to taking many days or weeks to analyze fireball events, were hard pressed to meet the immediate demands (within hours) for answers from the media, general public, and government officials. Fulfilling these requests forced many researchers to exploit information available from various Internet sources - videos were downloaded from sites like Youtube, geolocated via Google Street View, and quickly analyzed with improvised software; Twitter and Facebook were scoured for eyewitness accounts of the fireball and reports of meteorites. These data, combined with infrasound analyses, enabled a fairly accurate description of the Chelyabinsk event to be formed within a few hours; in particular, any relationship to 2012 DA14 (which passed near Earth later that same day) was eliminated. Results of these analyses were quickly disseminated to members of the NEO community for press conferences and media interviews. Despite a few minor glitches, the rapid initial assessment of Chelyabinsk was a triumph, permitting the timely conveyance of accurate information to the public and the incorporation of social media into fireball analyses. Beginning in 2008, the NASA Meteoroid Environments Office, working in cooperation with Western's Meteor Physics Group, developed processes and software that permit quick characterization - mass, trajectory, and orbital properties - of fireball events. These tools include automated monitoring of Twitter to establish the time of events (the first tweet is usually no more than a few seconds after the fireball), mining of Youtube and all sky camera web archives to locate videos suitable for analyses, use of Google Earth and Street View to geolocate the video locations, and software to determine the fireball trajectory and object orbital parameters, including generation of animations suitable for popular media and presentations. This presentation will give a short description of the characterization procedure and show applications of the tools, which have become vital to answering the question of "What was that bright light in the sky?" in the post-Chelyabinsk, 24/7 news world.

Cooke, William J.

Generating Euler Diagrams Through Combinatorial Optimization

Abstract Can a given set system be drawn as an Euler diagram? We present the first method that correctly decides this question for arbitrary set systems if the Euler diagram is required to represent each set with a single connected region. If the answer is yes, our method constructs an Euler diagram. If the answer is no, our method yields an Euler diagram for a simplified version of the set system, where a minimum number of set elements have been removed. Further, we integrate known wellformedness criteria for Euler diagrams as additional optimization objectives into our method. Our focus lies on the computation of a planar graph that is embedded in the plane to serve as the dual graph of the Euler diagram. Since even a basic version of this problem is known to be NP‐hard, we choose an approach based on integer linear programming (ILP), which allows us to compute optimal solutions with existing mathematical solvers. For this, we draw upon previous research on computing planar supports of hypergraphs and adapt existing ILP building blocks for contiguity‐constrained spatial unit allocation and the maximum planar subgraph problem. To generate Euler diagrams for large set systems, for which the proposed simplification through element removal becomes indispensable, we also present an efficient heuristic. We report on experiments with data from MovieDB and Twitter. Over all examples, including 850 non‐trivial instances, our exact optimization method failed only for one set system to find a solution without removing a set element. However, with the removal of only a few set elements, the Euler diagrams can be substantially improved with respect to our wellformedness criteria.

Computer Science

There's Enough Space for Everyone

Only a few fortunate people have the opportunity to go into space and experience the wonders of our universe first-hand. But thanks to social media and virtual worlds, many unique opportunities exist for us to learn, explore and experience what s out there from wherever we are. NASA and Marshall Space Flight Center (MSFC) are making this even easier to do. From blogs to Twitter messages, from Facebook pages to Flickr Photo sites, NASA is leveraging social media to share never-before-seen footage and inside information on spaceflight, scientific discoveries and other space activities. Over the last year, Marshall has reached more than half-a-million viewers through its high-profile, real-time blogs. Through its Watching a Launch blog, visitors were invited to take the "virtual" rides of their lives as they received a first-hand account of seeing a powerful shuttle launch - up close and personal. Through the Shuttle Ferry Flight blog, they got to experience the Shuttle Atlantis journey home to Kennedy Space Center as it rode "piggyback" on a modified Boeing 747 airplane. This year, Marshall s Flickr photo galleries have been visited over 700,000 times, Ares rocket videos have been viewed on iTunes, YouTube, TeacherTube and NASA Web sites more than 1.2 million times, and Marshall s Facebook Page has over 2,800 "friends" who regularly follow NASA. Social media tools have been a powerful way to reach and inspire the public, but NASA has also used these tools effectively to promote education and outreach. From events such as the Great Moonbuggy Race to the Student Launch Initiative, Marshall has used social networks to interest, excite and engage students. This presentation shares some of NASA s experiences on what has worked . . . and what hasn't . . . and seeks to spread the message that through social media "there's enough space for everyone."

Schumacher, Daniel M.

Use of Web 2.0 Technologies for Public Outreach on a Simulated Mars Mission

Recent advances in social media and internet communications have revolutionized the ways people interact and disseminate information. Astronauts are already taking advantage of these tools by blogging and tweeting from space, and almost all NASA missions now have presences on the major social networking sites. One priotity for future human explorers on Mars will be communicating their experiences to the people back on Earth. During July 2009, a 6-member crew of volunteers carried out a simulated Mars mission at the Flashline Mars Arctic Research Station (FMARS). The Mars Society built the mock Mars habitat in 2000-01 to help develop key knowledge and inspire the public for human Mars exploration. It is located on Devon island about 1600 km from the North Pole within the Arctic Circle. The structure is situated on the rim of Haughton Crater in an environment geologically and biologically analogous to Mars. Living in a habitat, conducting EVAs wearing spacesuits, and observing communication delays with "Earth,"the crew endured restrictions similar to those that will be faced by future human Mars explorers. Throughout the expedition, crewmembers posted daily blog entries, reports, photos, videos, and updates to their website and social media outlets Twitter, Facebook, YouTube, and Picasa Web Albums. During the sixteen EVAs of thier field science research campaign, FMARS crewmembers collected GPS track information and took geotagged photos using GPS-enabled cameras. They combined their traverse GPS tracks with photo location information into KML/KMZ files that website visitors can view in Google Earth.

Ferrone, Kristine

Securing Social Media

This slide presentation reviews some issues regarding the use of social media (e.g., Facebook, and Twitter) and security

Jones, Kevin D.

Sun-Earth Day - Teaching Heliophysics Through Education Technology

Sun-Earth Day (SED) is an Education and Outreach program supported by the U.S, National Aeronautics and Space Administration (NASA). The intent of the program is to teach students and the general public about Heliophysics (the science of the study of the Sun, how it varies, and how solar dynamics affect the rest of the solar system, especially the Earth). The program was begun ten years ago. Each year since that time a particular day has been designated as "Sun-Earth Day ,,. Usually the day of the spring equinox (March 20 or 21) is Sun-Earth Day, but other days have been used as well. Each year a theme is chosen relating to Heliophysics and events reflecting that theme are planned not only for Sun-Earth Day, but for the entire year. From the very beginning educational technology was emphasized in the events in order to effectively reach wide audiences with the SED message. The main approach has been to have a "webcast" related to each year's theme, often from a location that supports the theme as well. For example, a webcast took place from the Mayan pyramids at Chichen Itza, Mexico to highlight the theme of "Ancient Observatories, Timeless Knowledge". Webcasts were not the only technology employed, however. Many of the themes centered on the dynamic nature of the Sun and the effects that solar storms can have on interplanetary space and in our day-to-day life on Earth. Activities for tracking when solar storms happen and how they affect the Earth were developed and brought together in an educational package called Space Weather Action Centers. This project is explained in more detail in another presentation in this session being given by Norma Teresinha Oliveira Reis. Recent Sun-Earth Days have utilized "social networking" technologies to reach widespread groups on the internet. Podcasts, Vodcasts, Facebook, Twitter, and Second Life are the types of network technologies being employed now. The NASA Distance learning Network is another method for bringing Sun-Earth Day events and training to widespread educators and classrooms in order to magnify the reach of Sun-Earth Day. Examples of the technologies will be shown along with an assessment of their effectiveness.

Thieman, J.

Sharing the Adventure with the Public - The Value of Excitement: Summary of a Workshop

The premise of the workshop was that NASA and its associated science and exploration communities have not been as effective as they could be in communicating with the public about what NASA does or how its activities contribute to resolving critical problems on Earth. Although not explicitly stated, an underlying assumption seemed to be that if the public had a better understanding, it would be more supportive of NASA, which in turn could generate more political support for the organization. In the case of global climate change, the broader issue is how to convince the public of the magnitude of the problem and the need for solutions. The role of new social media tools like Facebook and Twitter in interacting with the public was an integral part of the discussion.

Source record

Aquarius iPhone Application

The Office of the CIO at JPL has developed an iPhone application for the Aquarius/SAC-D mission. The application includes specific information about the science and purpose of the Aquarius satellite and also features daily mission news updates pulled from sources at Goddard Space Flight Center as well as Twitter. The application includes a media and data tab section. The media section displays images from the observatory, viewing construction up to the launch and also includes various videos and recorded diaries from the Aquarius Project Manager. The data tab highlights many of the factors that affect the Earth s ocean and the water cycle. The application leverages the iPhone s accelerometer to move the Aquarius Satellite over the Earth, revealing these factors. Lastly, this application features a countdown timer to the satellite s launch, which is currently counting the days since launch. This application was highly successful in promoting the Aquarius Mission and educating the public about how ocean salinity is paramount to understanding the Earth.

Estes, Joseph C., Jr.