Codebits Handivi

Technology in a startup @ 7syntax Celso Pinto Coder, headbanger, biker and founder

And Python lover

Then: 2 + 1 idea

Now: a 5 men army

Fighting the evil empire!

A tech startup lives by it's tech

TECH FAIL

From the very back end... http://flickr.com/photos/your_teacher/133262843/

Question time!

So, about data storage

Relational is dead... to me! ✔ Fast key based access ✔ Cheetah-fast list fetches ✔ Prefer to search with Lucene

Cheetah fast reads ✔ Fast key based access ✔ Cheetah-fast list fetches ✔ Prefer to search with Lucene

Stuff I actually considered ✔ Standard mailboxes, accessible via POP/SMTP

Stuff I actually considered ✔ Standard mailboxes, accessible via POP/SMTP ✔ Fixed block files

Stuff I actually considered ✔ Standard mailboxes, accessible via POP/SMTP ✔ Fixed block files ✔ MogileFS (plus Lucene for complete indexing)

But then...

Any day now

What we get from CouchDB ✔ Easy sharding ✔ Incredibly fast reads, faster than cheetahs! ✔ Develop views in a(ny) familiar language ✔ One instance can handle 500.000 databases ✔ Each database can easily store millions of records ✔ Online backups/snapshots and compaction

CouchDB has warts too :-( ✔ It's a “tad” slow on inserts ✔ 50 inserts per second ✔ We can push it to 500 by dropping fsync's and using tmpfs But it doesn't matter: we <3 CouchDB!

Any questions so far?

Programming language(s)

Programming languages

The Snake * you need Acme::Python to understand this Hisssssssssssssssss Hiss hiss Hiss hiss Hissss hiss Hisss hisss Hissss hiss Hiss hiss Hiss hisss Hisss hisssssss Hiss hisss Hiss hissssss Hiss hiss Hisss hissss Hisss hiss Hiss hiss Hisss hiss Hisss hiss Hiss hiss Hiss hisss Hisss hisss Hiss hiss Hissss hissss Hiss hiss Hissss hisssssss Hiss hiss Hiss hiss Hiss hisss Hisssss hissss Hiss hiss Hissss hisssss Hiss hiss Hisss hiss Hisssss hiss Hisss hisss Hissss hiss Hisss hiss Hisss hiss Hissss hissssssss Hiss hisssssss Hissss hisss Hiss hisss Hissss hiss Hiss hisss Hiss hiss Hisss hisss Hissss hiss Hisss hissss Hiss hiss Hissss hisssssss Hiss hissss Hiss hissss Hiss hisss Hisss hissss Hisss hiss Hiss hisssss Hisss hisss Hissss hiss Hisss hisssssss Hiss hisss Hisss hissss Hiss hisss Hiss hissssss Hiss hisss Hissss hiss Hisss hiss Hiss hisss Hiss hiss Hisss hissss Hiss hiss Hissss hiss Hiss hisssss Hisss hisssssss Hiss hissss Hiss hisss Hissss hiss Hiss hiss Hiss hiss Hissss hisss Hissss hiss Hisss hisssssss Hiss hisssss Hisss hisss Hiss hiss Hiss hisss Hiss hiss Hisss hisss Hissss hiss Hisss hiss Hiss hiss Hiss hiss Hissss hisssss Hisssss hiss Hisssssss hissss Hiss hissss Hiss hisss Hisss hiss Hissss hissss Hiss hiss Hiss hisssss

Only one restriction 4 space indents But you should be doing that already!

Other advantages Here we have Python Some other language

After one year Still Python Some other language

On the mobile

On the web front

Any questions?

Frameworks vs. Libraries

Siza Vieira

The blue pill

Why Django? ✔ Modular: we can replace have replaced many parts ✔ Stable/solid: impressive # of tests, great docs! ✔ Easily hackable: it's Python after all

No, seriously...

Alright, you win

What we replaced ✔ Auth: we built our own from the start ✔ Sessions: in-house developed stateless sessions ✔ ORM: now on it's way to meet the dodo! ✔ By extension: we never got the chance to use the admin application

What we're keeping ✔ Templates: inheritance is great! ✔ Request handling/routing rules engine ✔ Forms: lots of validation there ✔ … other bits I can't really remember

How we're using Django

Any questions about Django?

Messaging

Why is it important to us? ✔ Throttling, balancing, loose coupling ✔ We can tap into any queues and experiment ✔ Remember CouchDB? MQ is the MDA for each “mailbox”

Lots of good stuff out there

Our choice ✔ ActiveMQ: stable, small and fast enough ✔ Many protocols: we chose STOMP, nice to debug ✔ Had to create AsyncIO Python lib

Final bits on messaging ✔ Does MDB mean anything to you? ✔ Python has no MDB container, had to create one ✔ Python + processing (new in Python 3000): ✔ Configuration similar to Django's ✔ 1 process => 1 destination consumer

Any questions about messaging?

Wrapping up

Current architecture mobile web ? perlbal API static Ct. adapter (django apps) writes reads S3 consumers CouchDB accounts User 1 User 2 User n

Any final questions?

Thank you very much! Celso Pinto // cpinto@7syntax.com

http://blog.cpinto.net	163
http://codebits.sapo.pt	80
http://codebits.eu	26
http://localhost	7
http://nenufaresmahometanos.blogspot.com.es	4
http://www.historietascontadaspormi.blogspot.com	3
http://capnuria.blogspot.com	2
http://rele20082010.blogspot.com	2
http://historietascontadaspormi.blogspot.com	2
http://entrefutboleros.blogspot.com	1
http://www.capnuria.blogspot.com	1
http://static.slideshare.net	1
http://sunala.blogspot.com	1
http://feeds.feedburner.com	1
http://www.slideshare.net	1
http://futbolsala-marga.blogspot.com	1
http://elinfiernodelosbanqueros.blogspot.com	1

Codebits Handivi

by cfpinto on Nov 15, 2008

Accessibility

Categories

Tags

Upload Details

Usage Rights

17 Embeds 297

Statistics

Codebits Handivi — Presentation Transcript