Genn.ai (源内)Attached realtime marketing platform1
http://genn.ai/Who am I?Takeshi NAKANOSenior Researcher / Architect.Co-authered Getting started with Solr in Japanese....
http://genn.ai/3Company Name Recruit Holdings Co., LtdFounded March 31, 1960 (incorporated: August 26, 1963)※governance ch...
http://genn.ai/4RecruitHoldingsHeadquartersFunctionGlobal BusinessBusiness R&DRecruit Career Co., LtdRecruit Jobs Co., Ltd...
http://genn.ai/What is our challenge?Clients can get the information about their customerschecking their items on our web...
http://genn.ai/Agenda What is genn.ai? Overview How to gather clicks 0) Injecting our javascripts6 Genn.ai core detai...
http://genn.ai/Overview of using Genn.ai7CustomerACustomerBCustomerCRealtime AnalysisPlatformGenn.aiじゃらんWeb SitesClient(Ho...
http://genn.ai/Demo videos!•They are based on a hotel reservation site likeExpedia.com.•An animation and a screencapture w...
http://genn.ai/Overview of using Genn.ai9CustomerACustomerBCustomerCRealtime AnalysisPlatformGenn.aiじゃらんWeb SitesClient(Ho...
http://genn.ai/Overview of using Genn.ai10CustomerACustomerBCustomerCじゃらんWeb SitesRealtime AnalysisPlatformGenn.aiClient(H...
http://genn.ai/How to gain access to Genn.ai11CustomerACustomerBCustomerCApp(ex.Tomcat)ApacheGenn.ai will be able to be a...
http://genn.ai/How to gain access to Genn.aiA custom apache module for embeding ourcode on returning html sources from Ap...
http://genn.ai/How to gain access to Genn.ai13The embedded values and js on a html.
http://genn.ai/Structure14
http://genn.ai/Steps for getting resultsThere are 3 steps! (after getting clicks)151 2 3Pouring clicksinto KafkaRecording...
Backend for Genn.aihttp://genn.ai/Structure (Pouring into Kafka)16StormTopology(Filter)Kafkakakan.puTomcatiPad(APP)MongoDB...
Backend for Genn.aihttp://genn.ai/Structure (Recording as behaviors)17StormTopology(Filter)Kafkakakan.puTomcatiPad(APP)Mon...
Backend for Genn.aiVisualizer for Genn.aihttp://genn.ai/Structure (Visualizing customers)18StormTopology(Filter)Kafkakakan...
http://genn.ai/How is Genn.ai composed?Genn.ai Frontend! : Gathering clicks.Genn.ai Backend! : Recording behaviors.Genn...
http://genn.ai/Details of recording behaviors.20
Backend for Genn.aihttp://genn.ai/Structure (Recording behaviors)21StormTopology(Filter)Kafkakakan.puTomcatiPad(APP)MongoD...
http://genn.ai/Calculated valuesRecording behaviorsUseful values for each sites Ex.)Hotel reservation site,22{"_id": 15...
http://genn.ai/Calculated valuesRecording behaviorsUseful values for each sites Ex.)Hotel reservation site, Where is t...
http://genn.ai/Calculated valuesRecording behaviorsUseful values for each sites Ex.)Hotel reservation site, Where is t...
http://genn.ai/Calculated valuesRecording behaviorsUseful values for each sites Ex.)Hotel reservation site, Where is t...
http://genn.ai/Functions for recording behaviorsTime shift functionTime sensitive counter (old item will be expired and ...
http://genn.ai/Functions for recording behaviorsTime shift functionTime sensitive counter (old item will be expired and ...
http://genn.ai/Time Shift function?We make 3 min time window and now start.( no clicks here )28tNow
http://genn.ai/Time Shift function?In our 3 min time window, 1.5 min are captured.2 clicks have been recorded.291.5 minsN...
http://genn.ai/Time Shift function?There are 3 clicks in the past.The length of the capturing window becomesmax.303 mins...
http://genn.ai/Time Shift function?There are 4 clicks in the past.Ignore the first 2 clicks31▲Click▲ClickNowTime window▲C...
http://genn.ai/Time Shift function?There are 4 clicks in the past.Ignore the first 3 clicks32▲Click▲ClickNowTime window▲C...
http://genn.ai/Functions for recording behaviorsTime shift functionTime sensitive counter (old item will be expired and ...
http://genn.ai/Functions for recording behaviorsTime shift functionTime sensitive counter (old item will be expired and ...
http://genn.ai/Counting the frequencyThis function is under the effect of the Timeshift function.35{"_id": 154,"largeAreaC...
http://genn.ai/Counting the frequencyThis function is under the effect of the Timeshift function.You have booked 1 stay i...
http://genn.ai/Details of visualization.37
Backend for Genn.aihttp://genn.ai/Visualizing the customers38StormTopology(Filter)Kafkakakan.puTomcatiPad(APP)MongoDBGenn....
Backend for Genn.aihttp://genn.ai/Visualizing the customers39StormTopology(Filter)Kafkakakan.puTomcatiPad(APP)MongoDBGenn....
http://genn.ai/Kafka consumerKakan.puThe program for relaying clicks from Kafka to theother systems.The enriching funct...
Backend for Genn.aihttp://genn.ai/Visualizing the customers41StormTopology(Filter)Kafkakakan.puTomcatiPad(APP)MongoDBGenn....
http://genn.ai/Visualizing toolZoomdataA product containing a set of server app and ipadapp for visualizing event data.4...
http://genn.ai/ZoomdataZoomdata has the functions like..WebAPI for streaming data.Own event processor for vizualizing.4...
http://genn.ai/Feature plan.44
http://genn.ai/Genn.ai EvolutionAdding functions on Genn.ai core.Genn.ai should have filtering / aggrigation functionsfor...
http://genn.ai/Future planGenn.ai wants friends! We are looking for co-challenging partners for tuningand improving Genn...
http://genn.ai/Thanks!47
48
Upcoming SlideShare
Loading in...5
×

Genn.ai introduction for Buzzwords

295
-1

Published on

We are making a realtime marketing system for general marketplace type web sites with Kafka + Strom.
http://genn.ai/

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
295
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
2
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Genn.ai introduction for Buzzwords

  1. 1. Genn.ai (源内)Attached realtime marketing platform1
  2. 2. http://genn.ai/Who am I?Takeshi NAKANOSenior Researcher / Architect.Co-authered Getting started with Solr in Japanese.Co-authered Hadoop Hacks in Japanese.2Writing Getting started with Kafka in Japanese.
  3. 3. http://genn.ai/3Company Name Recruit Holdings Co., LtdFounded March 31, 1960 (incorporated: August 26, 1963)※governance changed from Recruit Co., Ltd since October 1st, 2012Headquarters Tokyo, JapanNumber of Group Employees 22,368(as of the end of March,2012)Number of Group Companies 102(Consolidated Subsidiaries/as of the end of June,2012)Capital 3,002.64 million yen(since March 1st, 1995)Consolidated Sales 806,661 million yen(from April 1st 2011 to March 31st 2012)Consolidated OrdinaryIncome117,617 million yen( from April 1st 2011 to March 31st 2012)
  4. 4. http://genn.ai/4RecruitHoldingsHeadquartersFunctionGlobal BusinessBusiness R&DRecruit Career Co., LtdRecruit Jobs Co., LtdRecruit Sumai Company LtdRecruit Marketing Partners Co., LtdRecruit Lifestyle Co., LtdRecruit Administration Co., LtdRecruit Technologies Co., LtdRecruit Communications Co., LtdOperating Companies DomainRecruit Staffing Co., LtdSTAFF SERVICE HOLDINGS CO., LTD
  5. 5. http://genn.ai/What is our challenge?Clients can get the information about their customerschecking their items on our web sites.Providing a printed report monthly.    ▽Send them more detailed report in real time.In real time fashion, the value of the information will bedramatically increased!5
  6. 6. http://genn.ai/Agenda What is genn.ai? Overview How to gather clicks 0) Injecting our javascripts6 Genn.ai core details Structure 1) Setting up filters 2) Filtering customers 3) Visualizing them Future Dealing with historical streams Genn.ai wants friends.
  7. 7. http://genn.ai/Overview of using Genn.ai7CustomerACustomerBCustomerCRealtime AnalysisPlatformGenn.aiじゃらんWeb SitesClient(Hotels)MarketerAnalyst
  8. 8. http://genn.ai/Demo videos!•They are based on a hotel reservation site likeExpedia.com.•An animation and a screencapture what themarketting staff see using Genn.ai.At this moment ..•What prefectures are all my users searching for? (0:26)•Comparing the number of searches in today s andyesterday s regarding places. (2:50)8
  9. 9. http://genn.ai/Overview of using Genn.ai9CustomerACustomerBCustomerCRealtime AnalysisPlatformGenn.aiじゃらんWeb SitesClient(Hotels)MarketerAnalyst
  10. 10. http://genn.ai/Overview of using Genn.ai10CustomerACustomerBCustomerCじゃらんWeb SitesRealtime AnalysisPlatformGenn.aiClient(Hotels)MarketerAnalyst
  11. 11. http://genn.ai/How to gain access to Genn.ai11CustomerACustomerBCustomerCApp(ex.Tomcat)ApacheGenn.ai will be able to be attached!
  12. 12. http://genn.ai/How to gain access to Genn.aiA custom apache module for embeding ourcode on returning html sources from App.12CustomerBApacheGenn.ai will be able to be attached!modGenn.aiApp(ex.Tomcat)
  13. 13. http://genn.ai/How to gain access to Genn.ai13The embedded values and js on a html.
  14. 14. http://genn.ai/Structure14
  15. 15. http://genn.ai/Steps for getting resultsThere are 3 steps! (after getting clicks)151 2 3Pouring clicksinto KafkaRecording themas behaviorsVisualizing them0gather clicks
  16. 16. Backend for Genn.aihttp://genn.ai/Structure (Pouring into Kafka)16StormTopology(Filter)Kafkakakan.puTomcatiPad(APP)MongoDB321Genn.ai Front(Based on Finagle)Querygenn.ai/web)Click StreamsFrontend for Genn.aiVisualizer for Genn.aiZoomdata
  17. 17. Backend for Genn.aihttp://genn.ai/Structure (Recording as behaviors)17StormTopology(Filter)Kafkakakan.puTomcatiPad(APP)MongoDBGenn.ai Front(Based on Finagle)Querygenn.ai/web)Click Streams321Visualizer for Genn.aiFrontend for Genn.aiZoomdata
  18. 18. Backend for Genn.aiVisualizer for Genn.aihttp://genn.ai/Structure (Visualizing customers)18StormTopology(Filter)Kafkakakan.puTomcatiPad(APP)MongoDBGenn.ai Front(Based on Finagle)Querygenn.ai/web)Click Streams321Frontend for Genn.aiZoomdata
  19. 19. http://genn.ai/How is Genn.ai composed?Genn.ai Frontend! : Gathering clicks.Genn.ai Backend! : Recording behaviors.Genn.ai Visualizer! : Visualizing customers’ attrs.↑Kafka : Used for message busMongoDB : Storing Additional tablesStorm : Processing click streams19
  20. 20. http://genn.ai/Details of recording behaviors.20
  21. 21. Backend for Genn.aihttp://genn.ai/Structure (Recording behaviors)21StormTopology(Filter)Kafkakakan.puTomcatiPad(APP)MongoDBGenn.ai Front(Based on Finagle)Querygenn.ai/web)Click Streams321Visualizer for Genn.aiZoomdataFrontend for Genn.ai
  22. 22. http://genn.ai/Calculated valuesRecording behaviorsUseful values for each sites Ex.)Hotel reservation site,22{"_id": 154,"largeAreaCntAcl": {"Tokyo": 3,"Berlin": 1},"largeAreaCntPre": {"Tokyo": 4,"Berlin": 3},"rateAvgAcl": 4200,"rateAvgPre": 6200,"rateCntAcl": [4, 1, 0, 0, 0],"rateCntPre": [4, 1, 2, 0, 0],"lastUpdate": "2013-04-16T04:04:37.432Z"}
  23. 23. http://genn.ai/Calculated valuesRecording behaviorsUseful values for each sites Ex.)Hotel reservation site, Where is the favorite place?23{"_id": 154,"largeAreaCntAcl": {"Tokyo": 3,"Berlin": 1},"largeAreaCntPre": {"Tokyo": 4,"Berlin": 3},"rateAvgAcl": 4200,"rateAvgPre": 6200,"rateCntAcl": [4, 1, 0, 0, 0],"rateCntPre": [4, 1, 2, 0, 0],"lastUpdate": "2013-04-16T04:04:37.432Z"}
  24. 24. http://genn.ai/Calculated valuesRecording behaviorsUseful values for each sites Ex.)Hotel reservation site, Where is the favorite place? Where is the this searching place?24{"_id": 154,"largeAreaCntAcl": {"Tokyo": 3,"Berlin": 1},"largeAreaCntPre": {"Tokyo": 4,"Berlin": 3},"rateAvgAcl": 4200,"rateAvgPre": 6200,"rateCntAcl": [4, 1, 0, 0, 0],"rateCntPre": [4, 1, 2, 0, 0],"lastUpdate": "2013-04-16T04:04:37.432Z"}
  25. 25. http://genn.ai/Calculated valuesRecording behaviorsUseful values for each sites Ex.)Hotel reservation site, Where is the favorite place? Where is the this searching place? What price range has he booked?25{"_id": 154,"largeAreaCntAcl": {"Tokyo": 3,"Berlin": 1},"largeAreaCntPre": {"Tokyo": 4,"Berlin": 3},"rateAvgAcl": 4200,"rateAvgPre": 6200,"rateCntAcl": [4, 1, 0, 0, 0],"rateCntPre": [4, 1, 2, 0, 0],"lastUpdate": "2013-04-16T04:04:37.432Z"} etc..
  26. 26. http://genn.ai/Functions for recording behaviorsTime shift functionTime sensitive counter (old item will be expired and deleted)Facet ( like Solr )Categorized counterRange Facet ( like Solr )Dynamic categorized counter26321
  27. 27. http://genn.ai/Functions for recording behaviorsTime shift functionTime sensitive counter (old item will be expired and deleted)Facet ( like Solr )Categorized counterRange Facet ( like Solr )Dynamic categorized counter27321
  28. 28. http://genn.ai/Time Shift function?We make 3 min time window and now start.( no clicks here )28tNow
  29. 29. http://genn.ai/Time Shift function?In our 3 min time window, 1.5 min are captured.2 clicks have been recorded.291.5 minsNowTime window▲Click▲Click2 clicks are captured.t
  30. 30. http://genn.ai/Time Shift function?There are 3 clicks in the past.The length of the capturing window becomesmax.303 minsNowTime window▲Click▲Click▲Clickt
  31. 31. http://genn.ai/Time Shift function?There are 4 clicks in the past.Ignore the first 2 clicks31▲Click▲ClickNowTime window▲Click▲Click1.5 min 3 minst
  32. 32. http://genn.ai/Time Shift function?There are 4 clicks in the past.Ignore the first 3 clicks32▲Click▲ClickNowTime window▲Click▲Click3 mins3 minst
  33. 33. http://genn.ai/Functions for recording behaviorsTime shift functionTime sensitive counter (old item will be expired and deleted)Facet ( like Solr )Categorized counterRange Facet ( like Solr )Dynamic categorized counter33321
  34. 34. http://genn.ai/Functions for recording behaviorsTime shift functionTime sensitive counter (old item will be expired and deleted)Facet ( like Solr )Categorized counterRange Facet ( like Solr )Dynamic categorized counter34321
  35. 35. http://genn.ai/Counting the frequencyThis function is under the effect of the Timeshift function.35{"_id": 154,"largeAreaCntAcl": {"Tokyo": 3,"Berlin": 1},"largeAreaCntPre": {"Tokyo": 4,"Berlin": 3},"rateAvgAcl": 4200,"rateAvgPre": 6200,"rateCntAcl": [4, 1, 0, 0, 0],"rateCntPre": [4, 1, 2, 0, 0],"lastUpdate": "2013-04-16T04:04:37.432Z"}
  36. 36. http://genn.ai/Counting the frequencyThis function is under the effect of the Timeshift function.You have booked 1 stay in Berlin and 3 staysin Tokyo in this 3 weeks.36▲L.A.▲S.F.tNowTime window▲Berlin▲Tokyo1.5 week 3 weeks▲Tokyo"largeAreaCntAcl": {"Tokyo": 3,"Berlin": 1}▲Tokyo
  37. 37. http://genn.ai/Details of visualization.37
  38. 38. Backend for Genn.aihttp://genn.ai/Visualizing the customers38StormTopology(Filter)Kafkakakan.puTomcatiPad(APP)MongoDBGenn.ai Front(Based on Finagle)Querygenn.ai/web)Click Streams321Visualizer for Genn.ai
  39. 39. Backend for Genn.aihttp://genn.ai/Visualizing the customers39StormTopology(Filter)Kafkakakan.puTomcatiPad(APP)MongoDBGenn.ai Front(Based on Finagle)Querygenn.ai/web)Click Streams321Visualizer for Genn.ai
  40. 40. http://genn.ai/Kafka consumerKakan.puThe program for relaying clicks from Kafka to theother systems.The enriching function (joining the MongoDB data)The converting function (for following systems)40
  41. 41. Backend for Genn.aihttp://genn.ai/Visualizing the customers41StormTopology(Filter)Kafkakakan.puTomcatiPad(APP)MongoDBGenn.ai Front(Based on Finagle)Querygenn.ai/web)Click Streams321Visualizer for Genn.aiZoomdata
  42. 42. http://genn.ai/Visualizing toolZoomdataA product containing a set of server app and ipadapp for visualizing event data.42321
  43. 43. http://genn.ai/ZoomdataZoomdata has the functions like..WebAPI for streaming data.Own event processor for vizualizing.43321The bar and bubble graph on default setting.Customizable visualizing templates.
  44. 44. http://genn.ai/Feature plan.44
  45. 45. http://genn.ai/Genn.ai EvolutionAdding functions on Genn.ai core.Genn.ai should have filtering / aggrigation functionsfor federating with other systems.Historical rewinding function will be implemented withthe Hadoop cluster.45
  46. 46. http://genn.ai/Future planGenn.ai wants friends! We are looking for co-challenging partners for tuningand improving Genn.ai. You can use Genn.ai on your web sites for totally free(infrastructure etc..) if we could share the dream. Genn.ai codes will be opensourced in the future.Please feel free to contact us! http://genn.ai/46
  47. 47. http://genn.ai/Thanks!47
  48. 48. 48
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×