In the last year, we've gone from millions of pieces of data to billions of pieces of data. I will speak on a solution for scaling up and about the challenges presented. Also covered will be the future of data at Qihoo 360 with MongoDB.
In the last year, we've gone from millions of pieces of data to billions of pieces of data. I will speak on a solution for scaling up and about the challenges presented. Also covered will be the future of data at Qihoo 360 with MongoDB.
How do we manage more than one thousand of Pegasus clusters - backend partacelyc1112009
A presentation in Apache Pegasus meetup in 2021 from Wang Dan.
Know more about Pegasus https://pegasus.apache.org, https://github.com/apache/incubator-pegasus
share the common java memory problem cases solutions,including:
1. java.lang.OutOfMemoryError
2. full gc frequently
3. cms gc error: promotion failed or concurrent mode failure
13. java.lang.OutOfMemoryError: {$reason}
GC overhead limit exceeded
Java Heap Space
Unable to create new native thread
PermGen Space
Direct buffer memory
request {} bytes for {}. Out of swap space?
14. GC overhead limit exceeded
Java Heap Space
未处理异常会造成线程退出
线程调度慢
系统响应慢或无响应
▪ because gc频繁
Out of Swap
Java进程crash
15. GC overhead limit exceeded
Java Heap Space
monitor app log & gc log
heap dump or jmap –histo|-dump when oom
mat analyze heap dump
app developer or btrace to find where cause
16. Out of swap
crash log
google-perftools
then btrace to find where cause
ps: 也可以先尝试下把-XX:+DisableExplicitGC去
掉,原因见此link。