The poem describes the falling autumn leaves drifting by the window in shades of red and gold. It recalls summer memories of kisses and holding hands that are now gone since their departure. As the days grow longer and winter's song approaches, the speaker misses their darling most of all, especially when autumn leaves start to fall.