1.
Tips of
CakePHP & MongoDB
2011/9/4
CakeFest2011
Yasushi Ichikawa

2.
I am
Yasushi Ichikawa
Ichi
@ichikaway
http://cake.eizoku.com/blog

3.
Topic
● What's MongoDB?
● Using MongoDB with CakePHP
● Setup
● Usage
● Security
● Future
@ichikaway http://cake.eizoku.com/blog/

4.
MongoDB
NoSQL
Performance
Scalability
@ichikaway http://cake.eizoku.com/blog/

5.
Good for
● Social-Apps
● Calculation on distributed servers
● log analysis
● Questionnaire form
@ichikaway http://cake.eizoku.com/blog/

6.
Terms
RDB MongoDB
Table Collection
Row Document
Column Field
@ichikaway http://cake.eizoku.com/blog/

7.
Schema free
Posts Collection
id, title, body
id, name, tel, fax
id, name, nickname, email
Posts collection
@ichikaway http://cake.eizoku.com/blog/

8.
Schema free
Screen
Blog Blog collection
Title xxxx Title : xxxx
Text yyyy Text : yyyy
data Tag: [tag1,tag2,tag3]
tag1,tag2,tag3 Comment:
[
Comment1 comment1,
Comment2 comment2,
Comment3 comment3
]
@ichikaway http://cake.eizoku.com/blog/

9.
MongoDB operators
Find operators
$gt, $gte db.posts.find(
$lt, $lte { age : { $gt: 5 }}
$ne )
$in
$nin
$or
http://www.mongodb.org/display/DOCS/Advanced+Queries
@ichikaway http://cake.eizoku.com/blog/

10.
MongoDB operators
Update operators
$inc db.posts.update(
$set { name: “Ichi” },
$push { $inc: { cnt: 1 }}
$pull )
$pop
$unset
http://www.mongodb.org/display/DOCS/Updating
@ichikaway http://cake.eizoku.com/blog/

11.
Functions
● Geospatial index (location info)
● Map/Reduce
● Binary file saving (GridFS)
● Sharding
● etc
@ichikaway http://cake.eizoku.com/blog/

12.
WebSite
@ichikaway http://cake.eizoku.com/blog/

13.
http://kanael.net
@ichikaway http://cake.eizoku.com/blog/

14.
http://kanael.net
@ichikaway http://cake.eizoku.com/blog/

15.
kanael.net
●Server
● VPS(2.4GHz-2core, 1.5GMem) x 1
●Application
● 40% write, 60% read
● 300,000 ducuments
@ichikaway http://cake.eizoku.com/blog/

16.
kanael.net
● Peak traffic
● 100,000+ requests/day
● CPU 75% (MongoDB 10%)
@ichikaway http://cake.eizoku.com/blog/

17.
Topic
● What's MongoDB?
● Using MongoDB with CakePHP
● Setup
● Usage
● Security
● Future
@ichikaway http://cake.eizoku.com/blog/

18.
CakePHP MongoDB
Repository
github.com/ichikaway
/cakephp-mongodb/
@ichikaway http://cake.eizoku.com/blog/

19.
CakePHP MongoDB
Repository
●Test files
●API documents
●Sample Applications
@ichikaway http://cake.eizoku.com/blog/

20.
CakePHP MongoDB
 PHP5+
 CakePHP1.2, 1.3, 2.0-beta
 Pecl Mongo driver
 Documents
● https://github.com/ichikaway/cakephp-
mongodb/wiki
@ichikaway http://cake.eizoku.com/blog/

21.
Structure
Model
CakePHP-MongoDB Datasource
MongoDB
MongoCollection
MongoCursor
@ichikaway http://cake.eizoku.com/blog/

22.
Setup
@ichikaway http://cake.eizoku.com/blog/

23.
Setup pecl mongo
pecl install mongo
vi php.ini
extension=mongo.so
@ichikaway http://cake.eizoku.com/blog/

24.
CakePHP1.3
@ichikaway http://cake.eizoku.com/blog/

25.
Setup Cake Mongo(1.3)
cd app/plugins
git clone
git://github.com/ichikaway/cakephp-
mongodb.git mongodb
vi app/config/database.php
@ichikaway http://cake.eizoku.com/blog/

26.
database.php Cake1.3
class DATABASE_CONFIG {
public $default = array(
'driver' => 'mongodb.mongodbSource',
'database' => 'blog',
'host' => 'localhost',
'port' => 27017,
);
@ichikaway http://cake.eizoku.com/blog/

27.
CakePHP2.0
@ichikaway http://cake.eizoku.com/blog/

28.
Setup Cake Mongo(2.0)
cd app/Plugin
git clone
git://github.com/ichikaway/cakephp-
mongodb.git Mongodb
git checkout -b cake2.0 origin/cake2.0
vi app/Config/database.php
@ichikaway http://cake.eizoku.com/blog/

29.
database.php Cake2.0
// app/Config/database.php
class DATABASE_CONFIG {
public $default = array(
'datasource' => 'Mongodb.MongodbSource',
'host' => 'localhost',
'database' => 'blog',
'port' => 27017,
);
@ichikaway http://cake.eizoku.com/blog/

30.
Load plugin Cake2.0
//app/Config/bootstrap.php
CakePlugin::load('Mongodb')
@ichikaway http://cake.eizoku.com/blog/

31.
Sample Post Model
class Post extends AppModel
{
public $primaryKey = '_id';
}
@ichikaway http://cake.eizoku.com/blog/

32.
Useage
@ichikaway http://cake.eizoku.com/blog/

33.
find data
class PostsController extends AppController
{
public function index() {
$this->Post->find('all', $options);
}
} fields, conditions,
order, limit
@ichikaway http://cake.eizoku.com/blog/

34.
Insert data
$data = array('name' => 'Ichi'
'age' => 32 );
$this->Post->save($data);
_id:xxx1, name: 'Ichi', 'age':32
Posts collection
@ichikaway http://cake.eizoku.com/blog/

35.
Update data
$data = array( '_id' => 'xxx1',
'name' => 'Yasu' );
$this->Post->save($data);
// in Cake-Mongo DataSource
$MongoCollection->update(
array('_id' => 'xxx001'),
array('$set' => array('name' => 'Yasu')),
);
@ichikaway http://cake.eizoku.com/blog/

36.
$set operator
Without $set
id:xxx1, name: 'Yasu'
Posts collection
With $set
id:xxx1, name: 'Yasu', 'age':32
Posts collection
@ichikaway http://cake.eizoku.com/blog/

37.
Use other
update
operators
@ichikaway http://cake.eizoku.com/blog/

38.
Update operator ($inc)
$data = array( '_id' => 'xxx1',
'$inc' => array('age' => 1) );
$this->Post->save($data);
// in Cake-Mongo DataSource
$MongoCollection->update(
array('_id' => 'xxx001'),
array('$inc' => array('age' => 1)),
);
@ichikaway http://cake.eizoku.com/blog/

39.
Update operator(result)
_id:xxx1, name: 'Ichi', 'age':32
Posts collection
_id:xxx1, name: 'Ichi', 'age':33,
Posts collection
@ichikaway http://cake.eizoku.com/blog/

40.
Update operator(complex)
$data = array(
'_id' => 'xxx1',
'$inc' => array('age' => 1),
'$push' => array('tags' => array('php', 'mongo'))
);
$this->Post->save($data);
@ichikaway http://cake.eizoku.com/blog/

41.
Update operator(result)
_id:xxx1, name: 'Ichi', 'age':32
Posts collection
_id:xxx1, name: 'Ichi', 'age':33,
tags: ['php', 'mongo']
Posts collection
@ichikaway http://cake.eizoku.com/blog/

42.
Update operator
●see Wiki
● https://github.com/ichikaway/cakephp-
mongodb/wiki/How-to-use-MongoDB-update-
operators
● see test code
● testUpdate()
● testUpdateWithoutMongoSchemaProperty()
@ichikaway http://cake.eizoku.com/blog/

43.
Get
Cake Mongo
DataSource
Object
@ichikaway http://cake.eizoku.com/blog/

44.
Source methods
● ensureIndex()
● mapreduce()
● group()
See wiki
https://github.com/ichikaway/cakephp-mongodb/wiki/_pages
@ichikaway http://cake.eizoku.com/blog/

45.
ex. make index
$ds = $this->Post->getDataSource();
$ds->ensureIndex(
$this->Post,
array('title' => 1)
);
@ichikaway http://cake.eizoku.com/blog/

46.
Get
MongoDB Object
@ichikaway http://cake.eizoku.com/blog/

47.
MongoDB Object
● CakeMongo DataSource
● not support all functions of MongoDB
– gridFs
– DbRef
@ichikaway http://cake.eizoku.com/blog/

48.
get MongoDB Object
$mongo =
$this->Post->getMongoDb();
@ichikaway http://cake.eizoku.com/blog/

49.
get MongoDB Object
$mongo->getGridFs();
$mongo->setSlaveOkay();
$mongo->createDbRef();
See php manual
http://php.net/manual/en/class.mongodb.php
@ichikaway http://cake.eizoku.com/blog/

50.
Get
MongoCollection
Object
@ichikaway http://cake.eizoku.com/blog/

51.
get Mongo Collection
$mongo =
$this->Model->getMongoDb();
$collection = $mongo->
selectCollection('posts');
@ichikaway http://cake.eizoku.com/blog/

52.
get Mongo Collection
$collection->find();
$collection->update();
$collection->insert();
$collection->createDbRef();
See php manual
http://php.net/manual/en/class.mongocollection.php
@ichikaway http://cake.eizoku.com/blog/

53.
Replica Sets
@ichikaway http://cake.eizoku.com/blog/

54.
Replica sets
● master/slave replication
● automatic failover
● automatic recovery
@ichikaway http://cake.eizoku.com/blog/

55.
Replica sets
Replication
Server1 Server2
Primary Secondary
Replication
Application
Server3
Server
Secondary
(CakePHP)
@ichikaway http://cake.eizoku.com/blog/

56.
Replica sets
Replication
Server1 Server2
Primary Secondary
Replication
Application
Server3
Server
Secondary
(CakePHP)
@ichikaway http://cake.eizoku.com/blog/

57.
Replica sets
Server1 Server2
Primary Primary
Replication
Application
Server3
Server
Secondary
(CakePHP)
@ichikaway http://cake.eizoku.com/blog/

58.
database.php Cake1.3
class DATABASE_CONFIG {
public $default = array(
'driver' => 'mongodb.mongodbSource',
'database' => 'blog',
'replicaset' => array(
'host' =>'mongodb://loginid:password@
Server1:27021,Server2:27022/blog',
'options' => array('replicaSet' => 'myRepl')
),
);
https://github.com/ichikaway/cakephp-mongodb/wiki/How-to-connect-to-replicaset-servers
@ichikaway http://cake.eizoku.com/blog/

59.
Topic
● What's MongoDB?
● Using MongoDB with CakePHP
● Setup
● Usage
● Security
● Future
@ichikaway http://cake.eizoku.com/blog/

60.
Injection
Attack
@ichikaway http://cake.eizoku.com/blog/

61.
ONLY
PHP ( ； ´Д ｀ )
@ichikaway http://cake.eizoku.com/blog/

62.
WHY??
@ichikaway http://cake.eizoku.com/blog/

63.
Injection Attack
$user = $collection->find(array(
"username" => $_GET['username'],
"passwd" => $_GET['passwd']
));
● PHP makes array data from GET/POST request
●
ex. login.php?username=admin&passwd[$ne]=1
@ichikaway http://cake.eizoku.com/blog/

64.
Injection Attack
$user = $collection->find(array(
"username" => $_GET['username'],
'admin',
"passwd" => $_GET['passwd']
array("$ne" => 1)
));
● PHP makes array data from GET/POST request
●
ex. login.php?username=admin&passwd[$ne]=1
@ichikaway http://cake.eizoku.com/blog/

65.
Solution
●
Don't trust user input data
● GET/POST/Cookie
● Solution
● Cast to string
● Check all keys of array
@ichikaway http://cake.eizoku.com/blog/

66.
Solution
Cast to string
@ichikaway http://cake.eizoku.com/blog/

67.
Solution(cast to string)
$cursor = $collection->find(array(
"username" => (string)$_GET['username'],
"passwd" => (string)$_GET['passwd']
));
@ichikaway http://cake.eizoku.com/blog/

68.
Solution(cast to string)
$cursor = $collection->find(array(
"username" => 'admin',
"passwd" => 'Array'
));
@ichikaway http://cake.eizoku.com/blog/

69.
Solution
Check keys
of
input data
@ichikaway http://cake.eizoku.com/blog/

70.
Solution(check keys)
SecurePHP
Library
https://github.com/ichikaway/SecurePHP
@ichikaway http://cake.eizoku.com/blog/

71.
SecurePHP
●
Check Post/Get/Cookie
● Check all array keys
●
allow: a-z0-9:-_./
● Check null byte
@ichikaway http://cake.eizoku.com/blog/

72.
SecurePHP
vi webroot/index.php
require_once(
'SecurePHP/config/bootstrap.php'
);
$Dispatcher = new Dispatcher();
$Dispatcher->dispatch();
@ichikaway http://cake.eizoku.com/blog/

73.
Topic
● What's MongoDB?
● Using MongoDB with CakePHP
● Setup
● Usage
● Security
● Future
@ichikaway http://cake.eizoku.com/blog/

74.
In the future
Relational data fetch
coming soon
(hasOne, hasMany, belongsTo)
relation branch
@ichikaway http://cake.eizoku.com/blog/

75.
Summary
● What's MongoDB?
● Using MongoDB with CakePHP
● Setup
● Usage(find, save, MongoObject)
● Security
● Injection attack
● Future
● Relational data fetch
@ichikaway http://cake.eizoku.com/blog/

76.
THANK YOU
@ichikaway http://cake.eizoku.com/blog/