About Sentiment Sweep

Introduction

What is Sentiment Sweep?

Sentiment Sweep aims to captcha the mood of the internet, either overall or towards a specific topic. It does this by analysing real-time Twitter data, and calculating how positive or negative each Tweet it.

Ten dynamic data visualisations are then used to illustrate the results, and find trends between sentiment and other factors such as time of day, location, topic, country, people etc

What can it be used for?

SS has many uses, from analysing how successful a marketing campaign was in various locations and times, and comparing it to your competitors, to predicting how stock prices will change based on what people are saying about that company. It can also be used to predict which political party will be next in power before the polls are in, based on popularity of each. It can show which train lines are currently delayed or overcrowded, or which the football team has the most support at that time, to name just a few uses.

Is it free?

Yes.

Technical Overview

How does it work?

Well, in short Tweets are streamed live from Twitter, and as each one comes in an algorithm calculates the sentiment based on which words are in the Tweet and how they are positioned. A function is then triggered that formats that Tweet and adds it to which ever data visualisations are currently being viewed. If you search for a custom search term, then that will fetch fresh data from Twitter relative to what you searched and the synonyms. If it's for a location based visualisation that the Google Places API is used in conjunction to get the latitude and longitude of where the Tweet was from. Data from the last 60 minutes is cashed, so that everything loads fast.

All the data visualisations use the same backend, but have different adapter code to format the data into the right format for each chart, most of which is done server-side for efficiency. Everything's written in a very modular way, for maximum code reusability.

Modular code, what's that?

Well most the components of sentiment sweep are quite generic, so could be used for other things in other programs. For this reason eight node modules have been written, documented and tested then published free under the MIT license on NPM. They are in separate repositories, but you can find links to them in the readme.md

So what's it written in?

The backend is mainly Node.js written in CoffeeScript, and using MongoDB for data caching. The data visualisations are mainly developed using D3.js and most of them are rendered isomophically so that real-time changes are efficient, again these are written in CoffeeScript. The Express framework is used for routing, and page layouts are written in Jade, with styles written in LESS.

Nice, so can I see the code?

Yes, because it's 100% open sauce! Everything is published on GitHub under the MIT license, so you can view and copy whatever you want :) Check it out here

How will I know what's what in the code?

There is a lot of code, but it's all fully documented both in-code documentation, unit tests, and written documentation.You can read the written documentation here

Stability

How do you know this works?

It's unit tested.

What if I find a bug?

If you find something that doesn't work as you'd expect, then you can raise it as an issue here.

The live data has stopped working, why?

Probably the API limits have been reached, try again tomorrow. This will be sorted later on when we can qualify for a larger quota.

What if I think this could be better?

I'm always open to suggestions, there are contact details at the bottom of the page. Or create a pull request on GitHub and implement your modifications for review.

Legal

So I can copy the code, right?

Yeah, because it's open-source. But you can't duplicate this project and pass it of as your own work.

Is it guaranteed to work?

Nope, no guarantees, use at your own risk.

Is it okay to be using people's Tweets like this?

Sentiment Sweep follows the rules outlined in the Twitter API T&C's. Only public Tweets are displayed, and the users location is blurred by 100m, to hide their exact address. No Tweets are cashed for more than 24 hours (usually it's less than an hour)

Where's your cookie policy?

Sentiment Sweep doesn't use any cookies, so doesn't need a cookie policy

License

MIT License

Copyright (c) Alicia Sykes

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sub-license, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included install copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANT ABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NON INFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Author

Who wrote this thing?

Me, Alicia Sykes.

Why did you make it?

Thought it would be cool

Did it take long to develop?

Yes, ages - but I like coding :)

How can I contact you?

Visit my website, there's a contact form: http://aliciasykes.com

Are you available for hire?

No, I get a lot of emails asking this. I am not looking for work at this time!