In the last year, we've gone from millions of pieces of data to billions of pieces of data. I will speak on a solution for scaling up and about the challenges presented. Also covered will be the future of data at Qihoo 360 with MongoDB.
In the last year, we've gone from millions of pieces of data to billions of pieces of data. I will speak on a solution for scaling up and about the challenges presented. Also covered will be the future of data at Qihoo 360 with MongoDB.
Linux Virtual Server (LVS) is an open source load balancing software for Linux, it can be used to build highly scalable network services. The talk will give a brief introduction about the LVS project and its software, and outline over 14 years development and milestones, which includes community development and global collaboration, and finally conclude some personal experience from open source development of LVS.
share the common java memory problem cases solutions,including:
1. java.lang.OutOfMemoryError
2. full gc frequently
3. cms gc error: promotion failed or concurrent mode failure
Strata Beijing - Deep Learning in Production on SparkAdam Gibson
Recent talk at strata beijing - half english half chinese covering use cases of deep learning, deep learning in production and the different components of deeplearning4j.
Pegasus: Designing a Distributed Key Value System (Arch summit beijing-2016)涛 吴
This slide delivered by Zuoyan Qin, Chief engineer from XiaoMi Cloud Storage Team, was for talk at Arch summit Beijing-2016 regarding how Pegasus was designed.
How do we manage more than one thousand of Pegasus clusters - backend partacelyc1112009
A presentation in Apache Pegasus meetup in 2021 from Wang Dan.
Know more about Pegasus https://pegasus.apache.org, https://github.com/apache/incubator-pegasus
38. 编写高性能Java代码
JVM
◦ 内存管理
OOM
request {} bytes for {}. Out of swap space?
只有Java crash才会看到:hs_err_pid[$pid].log
原因可能是
地址空间不够用
32 bit
C Heap内存泄露
google perf-tools
经典的Inflater/Deflater Case
Direct ByteBuffer Case
52. 参考资料
Java代码的执行
学习JVM的References
Building memory-efficient Java
Applications
Achieving Rapid Response Times in Large
Online Services
highscalability.com
Research at Google
Facebook Engineering
53. 推荐书籍
《Java并发编程实战》
《Programming Concurrency on the JVM》
《JRockit: The Definitive Guide》
《The Garbage Collection Handbook》
《Memory Systems》
《Fundamental Networking in Java》
《Pro (IBM) WebSphere Application Server 7
Internals》
《虚拟机:系统与进程的通用平台》
《What every programmer should know about
memory》
《Java Performance》