Gesture Recognition• Kinect can only recognize locations of joints and bones, notgestures• Use relative locations of various joints to recognize gestures• Left hand move up/down: Compare location of left wrist withshoulder left, hip center:• Right hand move up/down: Compare location of right wristwith shoulder right, hip center:
Control Virtual Human• Unity program and Kinect program communicate via a socket.• Change Heart Rate: Move Left hand up or down• Change Blood Pressure: Move Right hand up or down
Doing CPR• Move both hands in and out.• Kinect sends locations of Left Wrist/Right Wrist and ShoulderCenter joint to the Unity program.• Measure distance between Left Wrist/Right Wrist andShoulder Center joint.• The Unit program know that user want to do CPR.
Virtual Human Animations• Mathematically Driven Virtual Human• Human reactions to Low(<60), normal(60-100), higher heartrate(100-150 and BP>120) ,heart attack(>150) and CPRprocedure.• Motion captured from real human by MS Kinect• Heart beating animation• CPR animation
CPR posture identification• From MS kinect tracking data of human skeleton.• Bend both arms and release them would be count as oneeffective electric shock using defibrillator .• Three times of shocks would make the patient back to live.