The document discusses a platform called Brisk, which integrates Hadoop, Hive, and Cassandra to manage data for an ad network targeting user segmentation and real-time analytics. It includes technical details about the data model, setup instructions, and PHP code examples for implementing user tracking via a pixel-based system. The document emphasizes ease of use, mixed-mode querying, and the absence of a single point of failure in the architecture.

1. LondonOur sponsors:Acunu

2. But first, a short back story…

3. 910111256781234

4. 21222324GC HELL!1718192013141516

5. 333435362930313225262728

6. 333435362930313225262728

7. Please volunteer if you would like to give a talk, Internet fame awaits

8. My experience with Cassandra in production is positive

9. Analytics is more difficult than it could be

10. Welcome Brisk! Brisk combines Hadoop, Hive and Cassandra in a “distribution”

11. In a nutshellCassandraFS as HDFS compatible layer; no namenode, no SPOF

12. Can split cluster for OLAP and OLTP workloads, scaling up either as requiredDemonstrating brisk…Building an Ad Network!

13. Demonstrating brisk…Building anAd Network!

14. The plan: Simple data model – segment users into buckets

15. System to put users in buckets via a pixel

16. Real-time queries

17. AnalyticsWe Have Your KidneysThe ad-network for the paranoid generation Cookie based identification

18. API provides:

19. Add user to a bucket (including ability to define expiry time)

20. Get buckets a user belongs toSetup Briskhttp://www.datastax.com/docs/0.8/brisk/install_brisk_ami Step-by-step guide with pictures!

21. Ubuntu 10.10 image with RAID 0 ephemeral disks

22. Jairam has been bug-fixing some minor issues

23. Data modelCF = users[userUUID] [segmentID] = 1CF = segments[segmentID] [userUUID] = 1

24. Data modelcreate keyspacewhyk... with placement_strategy = 'org.apache.cassandra.locator.SimpleStrategy' ... and strategy_options = [{replication_factor:1}];create column family users ... with comparator = 'AsciiType'... and rows_cached = 5000;create column family segments... with comparator = 'AsciiType'... and rows_cached = 5000;

25. Data modelcreate keyspacewhyk... with placement_strategy = 'org.apache.cassandra.locator.SimpleStrategy' ... and strategy_options = [{replication_factor:1}];create column family users ... with comparator = 'AsciiType'... and rows_cached = 5000;create column family segments... with comparator = 'AsciiType'... and rows_cached = 5000;

26. Our pixelhttp://wehaveyourkidneys.com/add.php? segment=<alphaNumericCode> &expire=<numberOfSeconds> We’ll use Cassandra’s expiring columns feature PHP code – uses phpcassa$pool = new ConnectionPool('whyk', array('localhost'));$users = new ColumnFamily($pool, 'users');$segments = new ColumnFamily($pool, 'segments');$users->insert($userUuid,array($segment => 1),NULL, // default TS$expires );$segments->insert($segment,array($userUuid => 1),NULL, // default TS$expires );

27. Real-time accesshttp://wehaveyourkidneys.com/show.php$pool = new ConnectionPool('whyk', array('localhost'));$users = new ColumnFamily($pool, 'users');// @todo this only gets first 100!$segments = $users->get($userUuid);header('Content-Type: application/json');echo json_encode(array_keys($segments));

28. AnalyticsHow many users in each segment?Launch HIVE (very easy!)root@brisk-01:~# brisk hive

29. CREATE EXTERNAL TABLE whyk.users (userUuid string, segmentId string, value string)STORED BY 'org.apache.hadoop.hive.cassandra.CassandraStorageHandler’WITH SERDEPROPERTIES ("cassandra.columns.mapping" = ":key,:column,:value" );select segmentId, count(1) as totalfrom whyk.usersgroup by segmentIdorder by total desc;

30. Summaryhttp://www.flickr.com/photos/sovietuk/2956044892/sizes/o/in/photostream/