Ceph Based Large Scale Application Case and Technology in Financial Industry ...Ceph Community
Cephalocon APAC 2018
March 22-23, 2018 - Beijing, China
Wang Gang, Yuancore Cloud Technology Co-Founder/ R&D General Manager
Lan Dongping, PingAn Technology Storage Lead
The Apache™ Hadoop® project develops open-source software for reliable, scalable, distributed computing.
The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures.
Ceph Based Large Scale Application Case and Technology in Financial Industry ...Ceph Community
Cephalocon APAC 2018
March 22-23, 2018 - Beijing, China
Wang Gang, Yuancore Cloud Technology Co-Founder/ R&D General Manager
Lan Dongping, PingAn Technology Storage Lead
The Apache™ Hadoop® project develops open-source software for reliable, scalable, distributed computing.
The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures.
Using Docker containers to keep consistency between developer workstations, build slaves, testing within docker-compose orchestration and OpenShift projects.
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Pyt...Erik Wright
'django-lean' is an open source a/b split-test experimentation framework for Django.
'django-lean' was created by Akoha, a Montreal-based startup building the world's first social reality game.
This presentation was delivered on September 30th, 2009 at Montreal Python 9, by Erik Wright, Director of Engineering for Akoha.
For further details visit:
http://bitbucket.org/akoha/django-lean/
http://akoha.com
http://twitter.com/erikwright
Using Docker Containers to Improve Reproducibility in Software and Web Engine...Vincenzo Ferme
The ability to replicate and reproduce scientific results has become an increasingly important topic for many academic disciplines. In computer science and, more specifically, software and Web engineering, contributions of scientific work rely on developed algorithms, tools and prototypes, quantitative evaluations, and other computational analyses. Published code and data come with many undocumented assumptions, dependencies, and configurations that are internal knowledge and make reproducibility hard to achieve. This tutorial presents how Docker containers can overcome these issues and aid the reproducibility of research artefacts in software engineering and discusses their applications in the field.
Cite us: http://link.springer.com/chapter/10.1007/978-3-319-38791-8_58
Accelerating Cognitive Business with Hybrid CloudDenny Muktar
IBM Indonesia BusinessConnect Events, March 22nd, 2016.
Disruptors are reinventing business processes and leading their industries with digital transformations. Cognitive Business extends digital business with cognitive computing - both of which exist in and are built using the cloud. This presentation covers an IBM approach of building and starting the Hybrid Cloud Journey.
Making Your Results Visible - A Test Result Dashboard and Comparison ToolXiaoxing Hu
If a test fails in the woods and nobody’s there to see it does anyone care, does anyone even notice? What happens when failing tests become the norm and you can’t see the wood from the trees?
After watching last year’s Allure Report presentation I was inspired. Selenium tests (and automation tests in general) are often poorly understood by the team as a whole. Reports/emails go unread with tests failing becoming an expected outcome rather than a glaring red flag. We looked at what Allure brought to the table and from that base created a dashboard that was designed to:
Display the results of test runs in a way that was useful to managers, testers and the rest of the development team. Including tools to filter out specific test runs and view the overall trend of the test run results.
Make debugging tests easier by grouping errors, displaying history of test results, filtering tests and offering visual comparison of test runs.
Help mitigate the problems flaky tests cause with test run result reporting (say that three times fast).
Help with our mobile device certification process, by easily providing a view to compare test runs across devices.
Since its creation the dashboard has been used and praised by managers and developers alike. With our full suite of tests from unit to integration to selenium and Appium being stored on the dashboard. We’ve managed to:
Decrease the time taken to debug test cases.
Increase the visibility of all our test suites, with managers having a better idea of how our selenium test suite is progressing and testers better understanding the coverage of unit tests.
Focus the organization on quality.
We are working with legal at present to have this project open sourced and available to all prior to Selenium Conf 2015.
(The presentation is in Chinese. I will upload the English edition soon.)
达尔文信息云浏览器:自主进化式的信息云用户界面平台
对于IT(Information Technology,信息技术)产业而言,云代表的是普及化的T(Technology,技术),而浏览器式的易用用户界面代表的是普及化的I(Information,信息)。这两者相辅相成。云提供集中式的高效低成本的服务,而浏览器式客户端则在客户端提供个性化和社会化的用户体验。
This is a business plan in Chinese.
iDarwin is a platform for information cloud: navigate, analyze, represent, annotate and evolve.
达尔文信息云平台(iDarwin)提供对信息云的导航、分析、展示、批注,用户界面进化和信息模型进化。简单来说,它就是信息云的客户端。它的独特之处在于它可以以业务的变化速度来进化。
技术优势:信息云处理技术,包括多种类,大数据量,复杂数据关系和进化管理四个方面。单一地解决每一个方面都不是非常困难,但是iDarwin同时实现了这几个方面。
转化阶段:目前已经实现了信息云的导航、分析、展示、用户界面进化,目前正在实现批注和信息模型进化最后两个功能。
目前已经支持主要的十几种传统数据库,OData协议,未来还可加入语义互联网支持。
应用领域:直接的应用领域是广义的商务智能,以无比的易用性和通用性方便最终用户对各类信息进行处理。最深远的影响是其作为一个进化平台,可以支持信息管理系统的开发和运维。
2. 内容安排 WHY: today we're going to talk about cloud storage? WHAT: you understand cloud storage? HOW: to help users build cloud storage? WHEN: moment to talk about the cloud storage? WHO: faced with a different user, you should talk about the cloud storage? 2 戴尔机密
4. 企业愿景、使命与策略 4 戴尔机密 什么是云存储? Cloud storage in the cloud computing (cloud computing) conceptually extended and developed a new concept. Cloud computing is a distributed processing (Distributed Computing), parallel processing (Parallel Computing) and grid computing (Grid Computing) development, through the network will be a huge computing handlers automatically split into numerous smaller subroutines, then handed over to the server through an extensive system of calculation of the results of the work after the return to the user. Adoption of cloud computing technologies, network service providers can within seconds, the processing of millions or even billions of information, meet and "super computer" equally powerful network services. Cloud storage concepts and cloud computing are similar, it refers to the application through clusters, grid technology or distributed file system and other functions, in the network all the different types of storage devices through software applications work together, common external provides data storage and business access features of a system. 云并不是一种产品 云是一种构架 云是一种服务
41. 容量虚拟及在线扩展 22 戴尔机密 对服务器全透明的容量在线扩展 应用层 统一的企业级 IP SAN 单一“组” 单个 TCP/IP 地址 相同的管理 云组 Group 最佳的扩展能力 逻辑层 逻辑卷 Volume 物理层 云成员 Member 具有高可用性和可靠性的 SAN 组件(受保护的 RAID)
42. 23 戴尔机密 数据保护 Windows 文件 服务器 Exchange 或SQL 服务器 备份 服务器 虚拟化 监控者 Linux 服务器 Oracle 服务器 Linux 服务器 VSS 千兆以太网iSCSI SAN 恢复文件 服务器 恢复应用 服务器 WAN VM 电子邮件 Linux 份额 VM SQL DB 快照 SQL 日志 快照 MS SQL NTFS 份额 Oracle DR/远程SAN Oracle 副本 自由空间 SQL 副本 VM 副本 PS系列阵列 自由空间 VM 副本 电子邮件 副本 PS系列阵列
43. 24 戴尔机密 数据保护 ASM/ VMware Edition有选择的VM 恢复解决方案 EqualLogic Group Active VMFS Volume VMFS Volume Snapshot VMFS VMFS
“Dell EqualLogic” can be positioned as the key component into Dell “Cloud Storage” framework with the following 7 key characteristics (unique values of Dell Cloud Storage): · Cloud Addressing – almost unlimited addressing scalability:· We support IPv6 natively on both management, applications and iSCSI initiator level (unlike other storage solution which only support IPv6 on management port only)· Cloud Transparency - Location transparent (virtualization):· Path virtualization - can make the actual location of the resource/volume transparent into the Cloud and when we move the volume and array to other location, the server can automatically follow· Location Virtualization - able to join multiple storage arrays together into the cloud and essentially make the location less sensitive· Resource Virtualization - volume can automatic place into multiple arrays and with build-in data cloning and replication, we can easy make the data move from one place to another and yet enjoy increase performance benefit· Cloud scalable performance - linear performance scalability:· Storage array can be online added into the cloud to make the “Storage Cloud” stronger and bigger and can be easily scale back online to provide the ultimate flexibility in the infrastructure· Cloud Load Balancing - Automatic Performance Load Balancing – dynamic workload balancing:· Automatic transparent network load balancing make the cloud storage infrastructure be able to scale with the loading· Cloud Storage virtual capacity - Capacity virtualization:· Our high flexible Thin Provisioning feature can make storage sizing control much more flexible – easily allocated and take back the pre-allocated space, and this feature work within the cloud either locally or remotely (Thin Replica)Cloud level Data protection without performance impact:At the end of the day, no matter how strong is the cloud, data simply can’t loss and yet performance need to be guaranteed, “Dell Cloud Storage” can deliver the promiseCloud-wide MonitoringWe will offer the total visibility into Cloud Storage management – operation and performance wise using our upcoming SAN-HQ, this make the move to the “Cloud Storage” easier