The urinary system removes waste from the blood through the kidneys, ureters, bladder, and urethra. The kidneys filter the blood and remove waste, which travels through the ureters and is stored in the bladder. When full, the bladder empties waste out through the urethra. Failure to treat a bladder infection can lead to a kidney infection as bacteria can travel back up the urinary system.