This document discusses Noah, a system for orchestration and coordination of infrastructure components like configuration management tools, applications, servers, and services. Noah uses a hierarchical data model and API to represent these components as objects that can be manipulated and watched. It aims to address the need for orchestration beyond single nodes and provide synchronization between different aspects of infrastructure.

1. Beyond the Node Advanced 'Arkestration' with Noah PuppetConf 2011

3. Orchestration

4. Overview of Noah

5. Use Cases

6. Q&A

8. A Brief History of Time (with apologies to Hawking)

10. Configuration Management

11. Configuration Management

13. Scripted

14. Configuration Management

16. Scripted

17. Intelligent

18. CFEngine

19. Chef

20. Puppet

22. Scripted

23. Intelligent

24. So we've solved this, right?

25. “ I think..and I don't know if anyone would agree, that configuration management is a solved problem at this point, right?”

26. “ I think..and I don't know if anyone would agree, that configuration management is a solved problem at this point, right?” WTF?

27. "The point I want to make..Configuration management is not a solved problem...and it's dangerous to make the mistake to think that the way we do things now is the best way to do them..." - Andrew Clay Shafer

28. “ what I was attempting to say ... is that the current crop of configuration management tools have reached a usable point where they do enough (for now). What we’re seeing as questions now are 'How do I think beyond the single node where this tool is running?'”

29. “ what I was attempting to say (epic fail, I might add) is that the current crop of configuration management tools have reached a usable point where they do enough (for now). What we’re seeing as questions now are ' How do I think beyond the single node where this tool is running? '”

31. Provide mechanisms for coordination between applications, nodes, services, configuration management and other infrastructure aspects

32. Example Use Case 1) Capacity Reached. Tell Noah 2) Noah tells provisioning system 3) Capacity allocated. Tell Noah 4) Noah triggers Puppet on LB 5) Noah triggers Puppet on Nagios Noah Nagios Puppet (app) Load Balancer

33. “ Inspired” by

34. "ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services. All of these kinds of services are used in some form or another by distributed applications."

36. Leader election, locking, configuration, sequences

37. Distributed and highly available

39. Official bindings are C and Java

40. Somewhat "complex" to setup and run

42. Watches and making it work over HTTP using JSON

43. Noah Basics

45. Has status ( up , down , pending )

46. Can have Services

48. Can have Configurations

49. Configurations

50. Can belong to many Applications

52. Identified by a “path”

53. Tags

54. Can be applied to any Primitive or Ephemeral

56. Can be applied at any hierarchy or specific object

58. GET ting Data

59. { "foo": { "created_at" : "2011-04-20 04:50:41 UTC", "updated_at" : "2011-04-20 04:50:41 UTC", "tags" : [ ], "id" : "4af53f8d-36d2-2158-c4a1-514ff3578048", "links" : [ ], "services": { }, "status": "up" }, "bar": { } }

61. { "foo" : { "created_at": "2011-04-20 04:50:41 UTC", "updated_at": "2011-04-20 04:50:41 UTC", "tags": [ ], "id": "4af53f8d-36d2-2158-c4a1-514ff3578048", "links": [ ], "services": { “ mysql”:”pending”, “ httpd”:”up” }, "status": "up" }, "bar": { } } Host Name

62. { "foo": { "created_at": "2011-04-20 04:50:41 UTC", "updated_at": "2011-04-20 04:50:41 UTC", "tags": [ ], "id": "4af53f8d-36d2-2158-c4a1-514ff3578048", "links": [ ], "services" : { “ mysql”:”pending”, “ httpd”:”up” }, "status": "up" }, "bar": { } } Services

64. Services

65. { "foo_svc" : { "foo" : { "created_at": "2011-04-20 05:09:44 UTC", "updated_at": "2011-04-20 05:09:44 UTC", "tags": [ ], "id": "53504526-a5d7-a604-5fe8-1f8fd2e1aef0", "links": [ ], "status": "down" } }, "both": { } } Service name

66. { "foo_svc" : { "foo" : { "created_at": "2011-04-20 05:09:44 UTC", "updated_at": "2011-04-20 05:09:44 UTC", "tags": [ ], "id": "53504526-a5d7-a604-5fe8-1f8fd2e1aef0", "links": [ ], "status": "down" } }, "both": { } } Host Name

68. Services

69. Applications

70. { "myrailsapp1" : { "created_at": "2011-04-21 06:57:42 UTC", "updated_at": "2011-04-21 06:57:42 UTC", "tags": [ "sample_data", "production" ], "id": "8774fead-e63a-8e5c-0453-1b5330bbd04c", "links": [ "/my_sample_organization" ], "configurations": { "database.yml": { "format": "yaml", "body": "development: database: development_database adapter: mysql username: dev_user password: dev_password" } } }, "myrestapp1": { } } App Name

71. { "myrailsapp1": { "created_at": "2011-04-21 06:57:42 UTC", "updated_at": "2011-04-21 06:57:42 UTC", "tags": [ "sample_data", "production" ], "id": "8774fead-e63a-8e5c-0453-1b5330bbd04c", "links": [ "/my_sample_organization" ], "configurations" : { "database.yml": { "format": "yaml", "body": "development: database: development_database adapter: mysql username: dev_user password: dev_password" } } }, "myrestapp1": { } } Configs

73. Services

74. Applications

75. Configurations *

76. { "barconf1" : { "created_at": "2011-04-27 01:20:37 UTC", "format": "string", "body": "barbody1", "updated_at": "2011-04-27 01:20:37 UTC", "tags": [ ], "id": "aa183dce-30ec-2d7e-c6f9-f3385161a7e6", "links": [ ] }, "barconf2": { } }

78. Services

79. Applications

80. Configurations *

81. Ephemerals *

83. Services

84. Applications

85. Configurations *

86. Ephemerals *

87. /ephemerals/my/config/setting returns the data stored there.

89. / services /service_name/host_name

90. / applications /application_name

91. / configurations /configuration_name

92. / ephemerals /arbitrary/path/to/whatever

94. / services / service_name / host_name

95. / applications / application_name

96. / configurations / configuration_name

97. / ephemerals / arbitrary / path / to / whatever

99. Service {“status”:”up”,”host_status”:”up”}

100. Application {“name”:”app_name”}

101. Configuration {“format”:”format_type”,”body”:”data”}

102. Ephemeral raw data

104. /services/ service_name / host_name

105. /applications/ application_name

106. /configurations/ configuration_name

107. /ephemerals/ arbitrary / path / to / whatever

109. e.g. ' /applications/some_application/tag'

110. {“tags”:”sometag”} or {“tags”:[“tag1”,”tag2”]}

111. Call DELETE instead of PUT to remove tags

112. GET ' /tags ' for all tags or ' /tag/tagname ' for specific tag

114. e.g. ' /applications/some_application/link'

115. {“link_name”:”my_organization”}

116. Call DELETE instead of PUT to remove links *

117. GET ' /link_name ' for all linked objects *

118. Designed to allow custom namespaces

119. Watches

121. Async

122. Persistent *

123. Pluggable (URI pattern based)

124. Hierarchical (superset and subset)

125. Append ' /watch ' to almost any url path

126. {“endpoint”:”http://some_host:port/ping_me”}

127. ' /watch ' root endpoint as well

128. {

129. “ endpoint”:”http://some_host/ping”,

130. ” pattern”:”//noah/applications/app_name”

131. }

132. Create a Watch $ curl -XPUT -d '{“pattern”:”//noah/applications”,"endpoint":" http://host/ping "}' http://noahserver/watches

133. Perform some operation $ curl -XPUT -d '{"name":"fooapp2"}' http://noahserver/applications/fooapp2

134. Message sent to Endpoint { "id":"be9f6a45-0d49-3f00-59a8-c6ad61da24e1", "tags":[], "links":[], "name":"fooapp2" , "created_at":"2011-09-15 03:07:39 UTC", "updated_at":"2011-09-15 03:07:39 UTC", "configurations":{}, "action":"create" , "pubcategory":"//noah/applications/fooapp2" }

135. Perform another operation $ curl -XPUT -d '{"tags":"footag2"}' http://noahserver/applications/fooapp2/tag

136. Message sent to Endpoint { "id":"be9f6a45-0d49-3f00-59a8-c6ad61da24e1", "tags":["footag"] , "links":[], "name":"fooapp2" , "created_at":"2011-09-15 03:07:39 UTC", "updated_at":"2011-09-15 03:15:03 UTC", "configurations":{}, "action":"update" , "pubcategory":"//noah/applications/fooapp2" }

138. amqp://user:pass@host:port/exchange

139. rundeck: //token@host :port/job_id

140. puppet://hostname/

141. statsd://host:port/metric.path.name.action

142. Currently based on Event Machine

143. Future based on Actors and worker pools

145. Don't have to use the “official” watch daemon

146. You can watch the watches (PubSub)

148. ENC, Functions and Facts

149. Hosts -> Nodes

150. Host's Services -> Classes

151. Configurations -> Facts (string types only)

152. So where does it fit? Noah Puppet Apps Scripts Monitoring Deploy CI

153. Noah + Puppet + Applications Noah Puppet Applications

155. App has configuration file

156. Configuration file controlled by Puppet

157. Puppet client run required to update file

159. Devs must learn ERB

160. Devs might even have to learn Puppet

161. Introducing new settings and communication

162. Daemon-mode is exception rather than rule

164. Move volatile settings into Noah

165. Configuration file controlled by Puppet

166. App gets volatile settings from Noah *

167. Future Puppet runs update Noah

168. Noah tells App *

169. Truth vs. Reality

170. My DB master is foo

171. My DB master right NOW is bar

173. “ Elasticity ” - Pool of worker node EC2 ips

174. Ad-hoc configuration – Logging levels

175. Environment aware – Nodes of class “foo”

177. Devs don't HAVE to learn Puppet

178. Ops and Dev friendly bridge point

179. No unintended changes released

180. Integration with CI Noah Puppet CI Deploy

182. Jenkins triggers Puppet (or deploy) on appropriate nodes

183. Jenkins is always “current”

184. Integration with Monitoring Noah Puppet Monitoring App

186. Nagios updates Noah status (event handler)

187. Noah optionally fires watches based on status change

188. Endpoint is application. App “reconfigures”

189. Integration with Scripts Noah Scripts (node 1) Scripts (node 2) Scripts (node 3)

191. Stop dealing with lock files on host

192. Use ephemerals and curl

194. Data redundancy based on Redis

195. No ACLs *

196. Async

198. Doozer

199. NoSQL stores (Redis + Webdis, Riak) *

200. Nesoi *

201. Write your own!

202. Questions?

204. IRC: #noah

207. Github: http://github.com/lusis

208. IRC: lusis

209. LinkedIn: http://linkedin.com/in/lusis

211. Thank You!