This document discusses the development of high-performance services at Mail.ru for tasks like serving avatars. It describes how they use technologies like Perl, AnyEvent, IProto and Tarantool to process over 100,000 requests per second on a single server. Key points are: 1. Mail.ru uses Perl 7 with AnyEvent and IProto to build asynchronous services that can handle 40,000-120,000 requests per second per core. 2. They store data in the Tarantool NoSQL database for its performance and ability to handle multiple indexes. 3. By using these technologies like async Perl and Tarantool, they can process over 100,000 requests per second with a

2. Современная разработка
в Mail.ru
На Perl и не только

3. Mythes
Perl 5.6 Apache 1
CGI
?

5. How many servers
enough to process
100k requests
per second
with 0.01s delay?
Thequestion

6. Users

7. Reademail

8. Andwant

9. Andwantavatars

10. Fromeverywhere

11. Many
4Krps

12. Andfast
4Krps
0.01s

13. Filin
Introduce:Filin
4Krps
Сервер на C,
который отдает
аватарки и иконки

14. Whatthesource?

15. Own…

16. Mail,Fb,Ok,Gravatar,ICQ,…
… … …

17. Filin
Owndataondisk
4Krps
disk
1Krps

18. Filin
Wheretheothers?
4Krps 3Krps
disk
1Krps
?

19. Filin
Codename“Avatard”
4Krps 3Krps
Сервис, умеющий
искать и отдавать
аватарки. Быстроdisk
1Krps

20. IProto
Filin
HTTP–Overhead.IProto!
4Krps 3Krps
disk
1Krps
struct packet {
uint32_t type,
uint32_t length,
uint32_t sequence,
char[] data
}

21. Srv
IProto
Filin
Avatardinside:theserver
4Krps 3Krps

22. Srv
Srv
IProto
Filin
Avatard:servers
4Krps 3Krps

23. DBSrv
Srv
IProto
Filin
Takedatafromdatabase
4Krps 3Krps

24. MSrv
Srv
IProto
Filin
Replicated
4Krps 3Krps S

25. M1Srv
Srv
S1
Mn Sn
IProto
Filin
Ofcourse,sharded
4Krps 3Krps
Tarantool

26. M1Srv
Srv
Que
S1
Mn Sn
IProto
Filin
Butwheretheyfrom?
4Krps 3Krps
Tarantool
очередь

27. M1Srv
Srv
Que
S1
Mn Sn
IProto
Filin
Fromtheinternet)
4Krps
…
3Krps
Res
Tarantool

28. M1Srv
Srv
Que
S1
Mn Sn
IProto
HTTP
Filin
Svc
SomeHTTPRequests
4Krps
…
3Krps
3Krps
Res
Tarantool

29. M1Srv
Srv
Que
S1
Mn Sn
IProto
HTTP
Filin
Svc
Gotaproblem!
4Krps
…
3Krps
3Krps
Res
Tarantool
0.01s
3s
1.5s
2.5s

30. Howemailworks?
письмо SMTP Server
SMTP Mail.ru
Хранилище
http://e.mail.ru
Агент Mail.ru
Письмо
или
список писем
Когда
узнаем
Когда
показываем
+ аватарки

31. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Filin
Svc
MTA
Improve!
4Krps
5Krps
disk…
3Krps
3Krps
5Krps Res
Tarantool
>>3s

32. M1Srv
Srv
Que
S1
Mn Sn
IProto
IProto
HTTP
Filin
Svc
MTA
Secondproblem:RAM
4Krps
5Krps
…
3Krps
3Krps
5Krps Res
Tarantool

33. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Filin
Svc
MTA
RAMisnotrubber.Usedisk
4Krps
5Krps
disk…
3Krps
3Krps
5Krps Res
Tarantool
Зачем хранить в памяти
неиспользуемые?

34. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Filin
Svc
MTA
Welldone!
4Krps
5Krps
disk…
3Krps
3Krps
5Krps Res
Tarantool

35. Language?

36. C?

37. Avoidit

38. Perl!
TIMTOWTDI

39. Fast dev
early deploy

40. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Modernlanguage!
Res
Perl 7!

41. WellknownPerl5.

42. Perl6.O’RLY?

43. Perl7!Now!

44. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Modernlanguage!
Res
Perl 7! (5.16)

45. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Modernasyncframefork!
Res
Perl 7!
AnyEvent

46. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Modernasyncframefork!
Res
Perl 7!
AnyEvent
IProto::Server

47. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Modernasyncframefork!
Res
Perl 7!
AnyEvent
IProto::Server
(40k rps/core)

48. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Modernasyncframefork!
Res
Perl 7!
AnyEvent
IProto::Server
(40k rps/core)
HTTP::Server

49. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Modernasyncframefork!
Res
Perl 7!
AnyEvent
IProto::Server
(40k rps/core)
HTTP::Server
(8k rps/core)

50. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Modernasyncframefork!
Res
Perl 7!
AnyEvent
IProto::Server
(40k rps/core)
HTTP::Server
(8k rps/core)
Tarantool

51. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Modernasyncframefork!
Res
Perl 7!
AnyEvent
IProto::Server
(40k rps/core)
HTTP::Server
(8k rps/core)
Tarantool
HTTP

52. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Modernasyncframefork!
Res
Perl 7!
AnyEvent
IProto::Server
(40k rps/core)
HTTP::Server
(8k rps/core)
Tarantool
HTTP
EV

53. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Modernasyncframefork!
Res
Perl 7!
AnyEvent
IProto::Server
(40k rps/core)
HTTP::Server
(8k rps/core)
Tarantool
HTTP
EV
XS

54. Sourcesavailable
Perl 7!
AnyEvent
IProto::Server
(40k rps/core)
HTTP::Server
(8k rps/core)
Tarantool
HTTP
EV
XS
github.com/Mons/AnyEvent-IProto
github.com/Mons/AnyEvent-HTTP-Server-II
Twiggy,
Twisted,
Node.js,
(but not nginx ;)
Faster than

55. Perl 5.6?Perl 5.6!
M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Res
Perl 7!
Apache!Apache?
CGI!CGI?

56. Perl5.16vsPerl5.8
- Released 11.03.2013
- Lower memory usage up to 25%
- Lower CPU usage up to 10%
- The best Unicode 6 support
- Many modern features
- Latest libraries
- Support for new libraries
- No old bugs
- New regular expression
- Async frameworks
- Green threads
Perl 5.16
- Released 31.01.2006
- Buggy
- Obsoleted!
Perl 5.8

57. Database?

58. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
NoSQLDatabase
Res
Tarantool
Tarantool
- High performance
- Latest stable
- Built in Lua
- Multiple indexes
- Composite indexes

59. M1Srv
Srv
Que
S1
Mn Sn
sw
p
IProto
IProto
HTTP
Andalsoqueue
Res
Tarantool
Tarantool
- High performance
- Latest stable
- Built in Lua
- Multiple indexes
- Composite indexes
- Lua-based queue

60. How many servers
enough to process
100k requests
per second
with 0.01s delay?
So,thequestion…

61. Theansweris…

62. Morecorrectanswer;)

63. Profit: effective highload
IProto: 120k rps / server
HTTP: 40k rps / server
Fast development – early deploy

64. Profit: effective highload
1400%
reservation

65. Appliance
High performance applications
U
Complex logic with many data sources

66. Mons Anderson
Р у к о в од и т ел ь отд ел а , П оч т а @ M a i l . r u
< m o n s @ c p a n . o r g >
< v. p e r e p e l i t s a @ c o r p . m a i l . r u >