This document discusses system monitoring tools and techniques. It introduces several open source monitoring tools like Nagios, Zabbix, and JFFNMS. It also discusses using Computer Telephony Integration (CTI) to call administrators when issues arise, but warns that phone bills may be high. The document demonstrates how to use the Telephony::CTPort module to make calls and receive calls for notification purposes. It also shows how to build a customizable and pluggable monitoring system using App::MadEye and integrating notification plugins like sending HTTP requests or updating a Trac ticket.

1. - TMTOWTMS -
There’s More Than One
Way To Monitor System(s)
May 16 2008
Toshiyuki Sugimoto
Shuichi Tajiri
Jong-jin Lee

2. Who are We?

3. http://d.hatena.ne.jp/antipop/20080501/1209636817

4. Let me introduce myself to you

5. JEEN

6. Perldoc-kr

7. ~ !
Yesterday, I got an incredible super sexy item.
Jesse T-Shirt

8. He said,
“If you make a patch for Prophet during this talk,
I’ll give you this T-shirt.”
Jesse
“Prophet
T-Shirt ”

9. But I did nothing!
...

10. Hmm...

11. Maybe What He thought would be...

12. “How Pity!”
“ ”

13. It’s a Joke!

14. Anyway, Thanks so so much Jesse!
Jesse !

15. Your Free Software “will” be running at our company

18. 2007 2008
Silver Sponsor Gold Sponsor

19. Company Works

20. System Monitoring, Maintenance

22. Promotion Support

24. EC Service Support

25. And

26. CodeRepos

27. CodeRepos

28. http://www.infomarks.co.jp/
http://blog.infomarks.co.jp/

29. - Index

30. - Index
• System Monitoring
• About System Monitoring
• What to Monitor?
• CTI
• Nagios || App::MadEye
• Trac
• Demo
• Summary

32. System Monitoring

33. Why?

34. It’s a main job of our company

35. There has been too many session
about

36. System Monitoring

37. in
YAPC::(.+) (¥d+)

38. Yeah, That Is Why I’m talking about

39. “Too Many” eq “Very Important”

40. True / False ?

41. It’s Your Choice.

43. TALOMT

44. It Means...

45. There’s A Lot Of Monitoring Tools

46. • •Nagios
http://www.nagios.org/
• •Zabbix
http://www.zabbix.com/
• •JFFNMS
http://www.jffnms.org/
• •Big Brother
http://bb4.com/
• •Big Sister
http://bigsister.graeff.com/
• Etc

48. What To Monitor

49. • Port-Availability
• HTTP, HTTPS, SSH,TELNET
• FTP, SMTP, IMAP
• POP3
• etc

50. • System Resources
• DISK
• CPU
• Memory
• Swap
• Network
• I/O
• Load Average
• Process
• etc

51. • Application/Daemons
• MySQL/Oracle
• DNS
• Mail
• Apache
• etc

52. • System/Application Log
• Kernel log
• DB error.log
• Web server error.log / access.log
• etc

53. There’s More Than
One Way
To Notify Warnings!

54. Mail

55. Instant Messenger

56. IRC

57. and...

58. VFD?

59. But No one knows
SOMETHING WRONG

60. Like This...

62. Or

63. Warning Lamp?

64. What do you think about
CTI?
CTI

66. CTI

67. CTI ?

68. Computer Telephony Integration

69. CTI
•
•
•
•

70. Computer Telephony Integration

71. CTI is used on...

72. Tele-Banking

73. Customer Support

74. Tele-Marketing

75. Voice Phishing
( )

76. And so on...

77. Before CTI
CTI

78. We used to get
inbound calls
From Several Services Whenever
system is in trouble

79. But, It Costs Every Months
...

80. ¥
But, It Costs Every Months
...

81. Hmm...

82. We always wanted to make a system that is either

83. a Low Cost

84. Scalable

85. under our Control

86. The Answer is ...
,

87. CTI

88. And

89. OSS

90. CTI with Closed Source
CTI

91. - OS $200
- Application $3000
- from www.voicetronix.com.au

92. But, Open Source is...

93. - OS ¥0
- Application ¥0
- from www.voicetronix.com.au

94. Wow!

95. Voicetronix
OpenPCI Card
- CPAN Module
(Telephony::CTPort)
- Low Cost ($400~)
- RJ-11

96. CTI on System
Monitoring?
CTI
?

97. Call
Log
Warning! / Critical!

98. ex >
while(Monitoring)

99. HTTP is down!

100. Ringing~

101. Off Hook

102. Hello?

103. “Somethings Wrong!”
“ ”

104. “Somethings Wrong!!”
“ ”

105. Somethings Wrong!!!
“ ”

106. the CTI Notifier(?) just called us
CTI

107. Whenever SA hears
“Somethings Wrong”
” ”

108. • He would be ( )
• stressed ( )
• impatient ( )
• angry ( )
• et cetra....( )

109. Like This

110. “WTF?” “ ”

111. In the Graph...

112. SA’s Stress
100
75
50
25
0
1 2 3 4 5
System trouble (# of Calls)

113. we wish SA for some happiness

114. Is there any good solution?

116. !

117. Yatta~

118. After We have Completed
this Mission,

119. SA will be
(.+)
whenever
Service goes Down

120. • Happy( )
• Less Stress( )
• etc( )

121. In Visual Mode

122. SA’s Stress
70.0
52.5
35.0
17.5
0
1 2 3 4 5
System trouble (Call)

123. More x 2 Visual Mode

124. Like This

126. Why?
?

127. What’s happened to him?

128. The Silver Bullet is what
we gave to him is...
...

130. Code

131. use Telephony::CTPort

132. Methods

133. Methods
• on_hook(), off_hook()

134. Methods
• on_hook(), off_hook()
• wait_for_ring(), wait_for_dialtone()

135. Methods
• on_hook(), off_hook()
• wait_for_ring(), wait_for_dialtone()
• record($file_name, $timeout,$term_key)

136. Methods
• on_hook(), off_hook()
• wait_for_ring(), wait_for_dialtone()
• record($file_name, $timeout,$term_key)
• collect($max_digits, $max_sec)

137. Methods
• on_hook(), off_hook()
• wait_for_ring(), wait_for_dialtone()
• record($file_name, $timeout,$term_key)
• collect($max_digits, $max_sec)
• dial($number)

138. Make a Call

139. Make a Call
on_hook()

140. Make a Call
on_hook()

141. Make a Call
on_hook() off_hook()

142. Make a Call
on_hook() off_hook()

143. Make a Call
on_hook() off_hook() wait_for_dial_tone()

144. Make a Call
on_hook() off_hook() wait_for_dial_tone()

145. Make a Call
on_hook() off_hook() wait_for_dial_tone()
dial($num)

146. Make a Call
on_hook() off_hook() wait_for_dial_tone()
dial($num)

147. Make a Call
on_hook() off_hook() wait_for_dial_tone()
dial($num)
Ring~ Ring~

148. Make a Call
on_hook() off_hook() wait_for_dial_tone()
dial($num)
Ring~ Ring~

149. Make a Call
on_hook() off_hook() wait_for_dial_tone()
dial($num)
Ring~ Ring~

150. Make a Call
on_hook() off_hook() wait_for_dial_tone()
dial($num)
Ring~ Ring~
some_event()

151. Receive a Call

152. Receive a Call
on_hook()

153. Receive a Call
on_hook()

154. Receive a Call
on_hook() wait_for_ring()

155. Receive a Call
on_hook() wait_for_ring()

156. Receive a Call
on_hook() wait_for_ring() Ring~ Ring~

157. Receive a Call
on_hook() wait_for_ring() Ring~ Ring~

158. Receive a Call
on_hook() wait_for_ring() Ring~ Ring~

159. Receive a Call
on_hook() wait_for_ring() Ring~ Ring~
off_hook()

160. Receive a Call
on_hook() wait_for_ring() Ring~ Ring~
off_hook()

161. Receive a Call
on_hook() wait_for_ring() Ring~ Ring~
off_hook()
some_event()

162. # CTI daemon
$ ctserver -d
#
use strict;
use warnings;
use CTIServer;
my @list = (#phone numbers#);
my $ct = CTIServer->new(port => 1234);
foreach my $person (@list) {
if ($ct->call($person, 20)) { # Call! $person = PHS number
do_something() if 1 == $ct->play(“39_warn.wav”);
}
}
sub do_something { blahblah; }

163. It will be a very Amazing System with
previously mentioned features.

164. But, It has a Critical Weakness!
CTI

165. It is...

166. Phone Bill
100
75
50
25
0
1/4 2/4 3/4 4/4
While we were testing CTI,
our company received a huge telephone bill.
CTI
.....

167. orz

168. I hope...

169. Please Don’t Use
CTI for
Voice Phishing! :-)
“ ”

170. Nagios
or
App::MadEye

171. use Class::Component;

172. Pluggable Monitoring System

174. Why Trac?

175. package App::MadEye::Plugin::Notify::HTTP;
use LWP::UserAgent;
sub request : Hook(‘notify’) {
$ua = LWP::UserAgent->new;
$url = $posts->{target} . “?” . $parameter;
$res = $ua->get($url);
}

176. package App::MadEye::Plugin::Notify::Trac;
use DBI;
sub request : Hook(‘notify’) {
my $dbh = DBI->connect(“dbi:SQLite:trac.db”,””,””);
my $sth = $dbh->prepare(“INSERT INTO ticket ....”);
$sth->execute(...);
}

178. Demo

179. Summary
• CTI will be the best choice to happy M.S.
(but, you have to be with HOOO MOOO)
• WARNING : Telephone bill
• One Way on TMTOWTMS is Telephony ?

180. Thank You!

181. Any Questions?