The hymn describes how the singer finds joy and inspiration in their faith despite hardships and troubles in the world. It discusses how their faith gives them an inner calm and hope that allows them to lift their voice in song, even when tyrants tremble or when imprisoned, because of their savior who lives and gives them a new song. The peace of being Christ's fills their heart with joy that cannot be contained.