Okbuy 李小红好乐买自动化运维实践

•

0 likes•562 views

This document discusses Puppet, an open source configuration management tool. It can be used to automate system configuration, deployment, and administration tasks across Linux, Unix, and Windows systems. Puppet uses a master-slave architecture with Puppet masters distributing configuration files to Puppet agents. It provides a declarative language to define system configurations and resources.

Self Improvement Technology

• python
• (<10 )
• Linux BSD
• Dell Redhat

• ssh+koan/
• kernel/initrd grub
• reboot

• koan/kvm
• cobbler RAM/CPU/DISK
• xen/vmware

puppet
puppet

puppet

puppet
puppet
maser puppet

puppet
CA

puppet

2

3

soft repo
pp
pp master pp master

1

2 4

3

soft repo
pp
pp master pp master

1

1 repo

soft repo
pp
pp master pp master

2

1 repo

soft repo
pp
pp master pp master

2

1 repo

3

soft repo
pp
pp master pp master

4
2

1 repo

3

soft repo
pp
pp master pp master

4
2

3

soft repo
pp
pp master pp master

1

2

pp 2 pp master

pp master pp master

1

2

3

pp 2 pp master

pp master pp master

1

2
4

3

pp 2 pp master

pp master pp master

1

pp master pp master

cobbler pp subversion

IP/ /

pp master pp master

cobbler pp subversion

10

IP/ / / /

pp master pp master

cobbler pp subversion

Puppet

nginx nginx

mongrel mongrel mongrel mongrel mongrel mongrel mongrel mongrel

puppet master puppet master

SVN puppet master

SVN subversion

Puppet

• cfengine/chef
• google/twitter/zynga

code...
201106190
01122
conﬁg

201106180
deploy releases
01122

201106170
01122

shared system conﬁg.inc

code...
201106190
01122
conﬁg

201106180
deploy releases
01122

201106170
01122

current

shared system conﬁg.inc

code...
201106190
01122
conﬁg conﬁg.inc

201106180
deploy releases
01122

201106170
01122

current

shared system conﬁg.inc

• weibo @

• blog.sina.com.cn/lixiaohong

• twitter: @lixiaohong

This document discusses transcoding video files using Kubernetes jobs. It describes creating different job pods for each transcoding task, such as 1080p, 720p, etc. It shows configuring the jobs with specifications for parallelism, completions, and restart policies. The document also discusses using the Kubernetes client API to watch for job status changes in order to manage the transcoding workflow.

The document discusses using NetApp snapshot technology to improve database refreshes for development, QA, and testing environments. Currently refresh takes over 10 days using RMAN backup and restore. The proposed solution uses FlexVol cloning to create private copies of the production database with minimal storage. This allows frequent refreshes without impacting production performance or other environments. It provides scalability improvements over the existing process.

Rocket Fuelled Cucumbers

Joseph Wilk

Rocket Fuelled Cucumbers discusses strategies for dealing with slow cucumber test suites, including: - Using Spork to preload support code to speed up test runs - Tagging tests to run focused subsets based on features, filenames, or tags - Distributing tests across multiple servers using Testjour to parallelize testing - Looking to cloud providers like EC2 to gain additional hardware resources - Dividing applications and tests along service boundaries to isolate components

The Berkshelf Way

Chef Software, Inc.

Pinto+Stratopan+Love

Jeffrey Ryan Thalhammer

Ansible 實戰：top down 觀點

William Yeh

This document provides an introduction to using Ansible in a top-down approach. It discusses using Ansible to provision infrastructure including load balancers, application servers, and databases. It covers using ad-hoc commands and playbooks to configure systems. Playbooks can target groups of hosts, apply roles to automate common tasks, and allow variables to customize configurations. Selective execution allows running only certain parts of a playbook. Overall the document demonstrates how Ansible can be used to deploy and manage infrastructure and applications in a centralized, automated way.

Configure Switch Nortel 8600

ELI KENDEL אלי קנדל

1. The document provides instructions for upgrading the image on an 8600 switch, including copying new image and configuration files from a server, formatting the flash memory, and rebooting the switch with the new image. 2. It then lists configurations for various protocols and features including OSPF, MLT, Spanning Tree, DHCP Relay, port mirroring, NTP, Radius, VRRP, MAC security, broadcast/multicast rate limiting, static routes, ATM PVCs with VLAN mapping, and RIP. 3. The document finishes with configurations for access policies, syslog server, port tagging, and global port settings.

Migrating to Puppet 5

Kris Buytaert

Moving to Git

Tim Moore

The document discusses moving a project from Subversion to Git version control. It describes the typical Subversion workflow with a trunk branch and stable release tags. It then outlines some of the issues this can cause like merge hell and broken builds. The document proposes migrating the codebase to Git, describing how to convert the Subversion repository to Git, mirror changes between the two systems, and migrate tools and developers over to the new Git workflow. It contrasts the new Git workflow with branches for features and bug fixes that can be easily merged into the master branch.

Shipping python project by docker

Wei-Ting Kuo

This document discusses how to use Docker to containerize and deploy Python web applications. It provides steps to install Docker, build a sample Flask application into a Docker image, run the container locally, and deploy the containerized application to AWS. Key points covered include using Dockerfiles to create images, the Docker index for sharing images, and port mapping when running containers.

When traditional configuration management is to slow for your needs

Kris Buytaert

Develop and Maintain a Distro with Open Build Service

SUSE Labs Taipei

Behind the Scenes at LiveJournal: Scaling Storytime

SergeyChernyshev

XebiCon'18 - Boostez vos modèles avec du Deep Learning distribué

Publicis Sapient Engineering

Lorsque la quantité de données est très grande et que l'architecture de votre réseau de neurones est complexe, la question du temps d'entraînement et de la capacité de votre machine deviennent primordiales. Un entraînement de modèle peut vite prendre plusieurs heures voire jours, ou même ne pas tenir en mémoire. Il est alors temps de parler de Deep Learning distribué ! Au cours de cette présentation, nous allons voir différentes solutions et bonnes pratiques pour accélérer l'entraînement de modèles de Deep Learning en les distribuant sur un cluster ou sur des plateformes multi-GPUs. Par Yoann Benoit, Data Scientist et Technical Officer chez Xebia Toutes les informations sur xebicon.fr

Comp architecture : branch prediction

rinnocente

The document discusses speculation and speculative execution in modern microprocessors. It explains that processors predict upcoming instructions and speculatively execute them to improve performance. If the prediction is correct, the results are committed, but if not the results are discarded. The document also discusses how transistor counts have increased quadratically compared to linear speed increases, enabling more complex superscalar and pipeline designs to exploit instruction level parallelism.

Repositories as Code

Kris Buytaert

Infrastructure as Data with Ansible

Carlo Bonamico

Infrastructure as data with Ansible: systems and cloud deployment and management for the lazy developer Abstract: Great programmers and sysadmins are lazy people: rightly, they prefer avoiding manual, time consuming and error-prone tasks such as installing and configuring a Linux/Apache/Tomcat cluster for the tenth time. Ansible, an infrastructure (server, cloud) deployment automation & configuration both powerful AND simple (in most cases simpler than shell scripts and maven poms!), will make developers and it staff more productive and effective. http://www.ansible.cc

Infrastructure as data with Ansible: systems and cloud deployment and managem...

Codemotion

Great programmers and sysadmins are lazy people: rightly, they prefer avoiding manual, time consuming and error-prone tasks such as installing and configuring a Linux, Apache, Tomcat cluster for the tenth time. With Ansible, an infrastructure (server, cloud) deployment automation & configuration both powerful AND simple (in most cases simpler than shell scripts and maven poms!), you can enjoy your coffee while it does all the work. The talk is very practical: I will set up a whole cluster in real time before the talk ends.

新浪李晓栋非商业网络设备的新浪应用之路

guiyingshenxia

华为余洲定制化服务器

guiyingshenxia

Similar to Okbuy 李小红好乐买自动化运维实践

Devoxx 2009 University session Jbpm4 In Action

Joram Barrez

Ncm2010 ruo ando

Ruo Ando

RabbitMQ with python and ruby RuPy 2009

Paolo Negri

Snapmirror Design

OkieUnix

Rocket Fuelled Cucumbers

Joseph Wilk

The Berkshelf Way

Chef Software, Inc.

Pinto+Stratopan+Love

Jeffrey Ryan Thalhammer

Ansible 實戰：top down 觀點

William Yeh

Configure Switch Nortel 8600

ELI KENDEL אלי קנדל

Migrating to Puppet 5

Kris Buytaert

Moving to Git

Tim Moore

Shipping python project by docker

Wei-Ting Kuo

When traditional configuration management is to slow for your needs

Kris Buytaert

Develop and Maintain a Distro with Open Build Service

SUSE Labs Taipei

Behind the Scenes at LiveJournal: Scaling Storytime

SergeyChernyshev

XebiCon'18 - Boostez vos modèles avec du Deep Learning distribué

Publicis Sapient Engineering

Comp architecture : branch prediction

rinnocente

Repositories as Code

Kris Buytaert

Infrastructure as Data with Ansible

Carlo Bonamico

Infrastructure as data with Ansible: systems and cloud deployment and managem...

Codemotion

Similar to Okbuy 李小红好乐买自动化运维实践 (20)

Devoxx 2009 University session Jbpm4 In Action

Ncm2010 ruo ando

RabbitMQ with python and ruby RuPy 2009

Snapmirror Design

Rocket Fuelled Cucumbers

The Berkshelf Way

Pinto+Stratopan+Love

Ansible 實戰：top down 觀點

Configure Switch Nortel 8600

Migrating to Puppet 5

Moving to Git

Shipping python project by docker

When traditional configuration management is to slow for your needs

Develop and Maintain a Distro with Open Build Service

Behind the Scenes at LiveJournal: Scaling Storytime

XebiCon'18 - Boostez vos modèles avec du Deep Learning distribué

Comp architecture : branch prediction

Repositories as Code

Infrastructure as Data with Ansible

Infrastructure as data with Ansible: systems and cloud deployment and managem...

More from guiyingshenxia

新浪李晓栋非商业网络设备的新浪应用之路

华为余洲定制化服务器

百度刘宁系统也智慧

阿里云张旭集群运维管理平台

阿里巴巴叶正盛数据库性能量化

阿里巴巴林钰网站存储经验谈

Cisco 刘洋从“路由”回归“交换”

This document discusses the evolution of data center networks from routing to switching. It introduces FabricPath, a technology that brings routing capabilities like equal-cost multipathing to layer 2 switching networks. FabricPath uses IS-IS for its control plane and encapsulates frames with MAC-in-MAC headers to implement multi-destination trees and distributed forwarding across the fabric. This allows large layer 2 domains with fast convergence and scalability comparable to routing networks, while maintaining simplicity of configuration and operation of traditional switching.

淘宝任卿打造高效能的Cdn系统

guiyingshenxia

More from guiyingshenxia (8)

新浪李晓栋非商业网络设备的新浪应用之路

华为余洲定制化服务器

百度刘宁系统也智慧

阿里云张旭集群运维管理平台

阿里巴巴叶正盛数据库性能量化

阿里巴巴林钰网站存储经验谈

Cisco 刘洋从“路由”回归“交换”

淘宝任卿打造高效能的Cdn系统

Okbuy 李小红好乐买自动化运维实践

3. • 2007 • B2C • www.okbuy.com

7. • python • (<10 ) • Linux BSD • Dell Redhat

8. • MAC • IP •

10. • ssh+koan/ • kernel/initrd grub • reboot

11. • koan/kvm • cobbler RAM/CPU/DISK • xen/vmware

12. • • / • • • • ... ...

13.

14. puppet puppet puppet puppet puppet maser puppet puppet CA puppet

15. soft repo pp pp master pp master

16. soft repo pp pp master pp master 1

17. 2 soft repo pp pp master pp master 1

18. 2 3 soft repo pp pp master pp master 1

19. 2 4 3 soft repo pp pp master pp master 1

20. soft repo pp pp master pp master

21. 1 repo soft repo pp pp master pp master

22. 2 1 repo soft repo pp pp master pp master

23. 2 1 repo 3 soft repo pp pp master pp master

24. 4 2 1 repo 3 soft repo pp pp master pp master

25. soft repo pp pp master pp master

26. soft repo pp pp master pp master 1

27. 2 soft repo pp pp master pp master 1

28. 2 3 soft repo pp pp master pp master 1

29. 4 2 3 soft repo pp pp master pp master 1

30. pp pp master pp master

31. pp pp master pp master 1

32. 2 pp pp master pp master 1

33. 2 3 pp pp master pp master 1

34. 4 2 3 pp pp master pp master 1

35. pp pp master pp master

36. pp pp master pp master 1

37. pp 2 pp master pp master pp master 1

38. 2 pp 2 pp master pp master pp master 1

39. 2 3 pp 2 pp master pp master pp master 1

40. 2 4 3 pp 2 pp master pp master pp master 1

41. pp master pp master cobbler pp subversion

42. IP/ / pp master pp master cobbler pp subversion

43. IP/ / / / pp master pp master cobbler pp subversion

44. IP/ / / / pp master pp master cobbler pp subversion

45. 10 IP/ / / / pp master pp master cobbler pp subversion

46. • • • •

47. Puppet nginx nginx mongrel mongrel mongrel mongrel mongrel mongrel mongrel mongrel puppet master puppet master SVN puppet master SVN subversion

48. Puppet • cfengine/chef • google/twitter/zynga

49. Capistrano • ruby gem • •

50. subversion

51. 1 SVN subversion

52. 2 1 SVN subversion

53. code... 201106190 01122 conﬁg 201106180 deploy releases 01122 201106170 01122 shared system conﬁg.inc

54. code... 201106190 01122 conﬁg 201106180 deploy releases 01122 201106170 01122 current shared system conﬁg.inc

55. code... 201106190 01122 conﬁg 201106180 deploy releases 01122 201106170 01122 current shared system conﬁg.inc

56. code... 201106190 01122 conﬁg 201106180 deploy releases 01122 201106170 01122 current shared system conﬁg.inc

57. code... 201106190 01122 config config.inc 201106180 deploy releases 01122 201106170 01122 current shared system config.inc

58. code... 201106190 01122 config config.inc 201106180 deploy releases 01122 201106170 01122 current shared system config.inc

59. code... 201106190 01122 config config.inc 201106180 deploy releases 01122 201106170 01122 current shared system config.inc

60.

61.

62. ganglia • • •

63. ganglia

64.

65. nagios • ganglia • •

66. (zookeeper) cmdb

67. • weibo @ • blog.sina.com.cn/lixiaohong • twitter: @lixiaohong

Okbuy 李小红好乐买自动化运维实践

Recommended

Recommended

More Related Content

Similar to Okbuy 李小红好乐买自动化运维实践

Similar to Okbuy 李小红好乐买自动化运维实践 (20)

More from guiyingshenxia

More from guiyingshenxia (8)

Okbuy 李小红好乐买自动化运维实践

Okbuy 李小红 好乐买自动化运维实践

Recommended

Recommended

More Related Content

Similar to Okbuy 李小红 好乐买自动化运维实践

Similar to Okbuy 李小红 好乐买自动化运维实践 (20)

More from guiyingshenxia

More from guiyingshenxia (8)

Okbuy 李小红 好乐买自动化运维实践

Okbuy 李小红好乐买自动化运维实践

Similar to Okbuy 李小红好乐买自动化运维实践

Similar to Okbuy 李小红好乐买自动化运维实践 (20)

Okbuy 李小红好乐买自动化运维实践