To attend an office hour session, students should log into the online platform during the scheduled date and time and click the home icon. They will then see the professor's icon turn green, indicating an active session. Clicking on the professor's icon will take students to the office hour room, where they can type questions, raise their virtual hand, or share files with the professor.