Big Data, Big Analytics

I had the honor to be interviewed for Michael Minelli, Michele Chambers and Ambiga Dhiraj's book "Big Data, Big Analytics: Emerging Business Intelligence and Analytic Trends for Today's Businesses" (also on amazon).

Here is an excerpt (pp. 31-34):


Empowering Marketing with Social Intelligence

We also spoke with Niv Singer, Chief Technology Officer at Tracx, a social media intelligence software provider. Niv had quite a bit to say about the big data challenges faced in the social media realm and how it's impacting the way business is done today - and in the future.

Read more →

Tumblr Firehose

Give me some of that, please.

Tumblr Firehose

We hear quite a bit about BIG DATA and REAL-TIME stuff. But I'm never sure exactly how BIG the data is or how REAL the time is. Seems like these are often just cool words that the cool kids like to throw around. The Tumblr engineering staff is too busy to worry about being cool, but we do have BIG data and we are making it available in REAL time — starting today. We're happy to announce that the Tumblr fire hose is open, thanks to our partnership with GNIP.

As Tumblr has grown (more than 50 million blogs and more than 20 billion posts), so has interest in the underlying data. Our API has been a great way to pull small slices of it, but now enterprise customers can get a complete real-time feed of all public data.

Handling all of this has been a significant, but worthwhile engineering effort; it will give insight into the BIG and REAL creative community that powers Tumblr and produces a lot of fascinating data.

In a future post, we'll talk about the underlying technical bits that make all this magic happen (hint: Kafka, Finagle). For now, go take a drink from the fire hose.

SXSW Heatmap

A heatmap visualization of some of the data we collected and analyzed at Tracx to create The Ultimate SXSW Infographic:

Tracx customers have access to an interactive map showing clusters of public, location-tagged user-generated content (tweets, check-ins, etc.) that are relevant to their campaigns, with the ability to drill down to the individual post level.