The poem describes a man who worked in the Maryland mills and would visit his family on weekends. The speaker remembers the man standing by the whitewashed house as a boy and looking up at his tan face in the tree's shadows. The man is described as an uncle the speaker never really knew but who made an impression. The speaker remembers the man and thinks of him when teaching beside a school where the man could have worked.