People with kidney disease should avoid high potassium foods. Potassium is usually removed by healthy kidneys, but those with kidney disease retain potassium which can lead to dangerous heart rhythm problems. Some high potassium foods to avoid include bananas, oranges, potatoes, tomatoes, and leafy greens.