These are the slides of a small lightning talk I gave at yesterday's Amsterdam.js meetup. It mainly shows the tools I use in my projects and some examples on how to use them. It also includes a sneak-preview of a NLP (Natural Language Processing) library I'm writing in Javascript, called Sponge.

1. JS loves Big Data
2010 7 15

2. Big Data?
One user = Lot’s of Data and Processing
Many total DB Rows
A lot of ‘background processing’
Making sense out of data: ranking, merging,
connecting, etc.
2010 7 15

3. Cool Visualizations!
2010 7 15

4. Heuristics
Make a distinction between raw and analyzed
data
Duplication in raw data is OK
Think about data retrieval when doing data
insertions
Complex systems need many unit tests,
simulate everything!
2010 7 15

5. The Tools
2010 7 15

6. Key/value JSON store
Great for storing many rows
Buy some memory!
Cloud service: MongoHQ
2010 7 15

7. Server-side JavaScript
Built on Chrome’s V8
Not for softies
2010 7 15

8. MongoDB-Native
2010 7 15

9. Mongoose
2010 7 15

10. ExpressJS + Auth
2010 7 15

11. The Browser
Browser can do more ‘work’.
Need more workers? Add active users!
2010 7 15

12. JSpec
2010 7 15

13. Sponge
Natural Language Parsing in JS
Runs Server-side and Client-side
Specialized in Micro-content
2010 7 15

14. 2010 7 15

15. 2010 7 15

16. 2010 7 15

17. 2010 7 15

18. 2010 7 15

19. Me:
Twitter @dominiek
Blog http://synaptify.com/
Consultancy http://consulting.synaptify.com/
2010 7 15

20. Links
InfoVis Toolkit, http://thejit.org/
JSpec, http://visionmedia.github.com/jspec/
MongoDB, http://mongodb.org/
NodeJS, http://nodejs.org/
ExpressJS, http://expressjs.com/
Mongoose, http://github.com/LearnBoost/
mongoose
2010 7 15