• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Troubleshooting Cassandra
 

Troubleshooting Cassandra

on

  • 1,155 views

A lightning talk on tips and general recommendations for troubleshooting Apache Cassandra.

A lightning talk on tips and general recommendations for troubleshooting Apache Cassandra.

Statistics

Views

Total Views
1,155
Views on SlideShare
1,144
Embed Views
11

Actions

Likes
4
Downloads
0
Comments
0

1 Embed 11

https://twitter.com 11

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Troubleshooting Cassandra Troubleshooting Cassandra Presentation Transcript

    • #CASSANDRA13Jeremy Hanna | Support Engineer at DataStax | @jeromatronTroubleshooting Cassandra
    • #CASSANDRA13Java*Latest 1.6 Oracle JDK (not OpenJDK)*Make sure JNA is enabled “JNA mlockall successful”
    • #CASSANDRA13Garbage Collection*Look for warnings:GC for [ParNew|ConcurrentMarkSweep]: 3000 msHeap is 0.93 full. You may need to ...*Enable GC logging in cassandra-env.shcorrelate with system.log pauses*Heap dump*OpsCenter GC graphs
    • #CASSANDRA13Memory*MAX_HEAPSIZEKeep as low as you can (ideally ≤ 8G)*HEAP_NEWSIZENo more than 800M*Disable swap*Trend towards off-heap*Be careful with cache (even off-heap cache)
    • #CASSANDRA13Troubleshooting*Narrow down bottlenecks*Query tracing in 1.2+*What has changed recently? (conf, data size, deletions, etc.)*OpsCenterRelevant graphsDiagnostics in 3.x
    • #CASSANDRA13Special note on SSD performance*Look at your tpstatsHigh pending or blocked on flush writerCoincides with relatively idle disk usage*Update device queue settingsecho noop > /sys/block/sda/queue/schedulerecho 0 > /sys/block/sda/queue/read_ahead_kbecho 0 > /sys/block/sda/queue/rotational*Change mount options/dev/sda /var/commitlog          ext4 noatime,nodiratime,discard,errors=remount-ro 1 2