Motion recognition method and apparatus

• US 10,247,626 B2
• Filed: 07/30/2014
• Issued: 04/02/2019
• Est. Priority Date: 08/05/2013
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Park, Gyu-tae, Kang, Seok-myong, Kim, Tae-ho, Lee, Yeon-woo, Kim, Won-il
• Primary Examiner(s): Ngon, Ricky
• Application Number:
  US14/446,535
• Publication Number:
  US 20150039259A1
• Time in Patent Office: 1,707 Days
• Field of Search: 702139
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/214 for locating contacts on a surface, e.g. floor mats or touch pads
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: G01L 1/00 Measuring force or stress, in general measuring force due to impact G01L5/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0334 Foot operated pointing devices
• CPC Class Codes: H04N 21/422 Input-only peripherals , i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] input devices also receiving signals from specially adapted client devices H04N21/4104
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4781 Games

Abstract

A apparatus for recognizing a motion of an object is disclosed. The apparatus comprises a camera configured to photograph images of the object having the motion, a plurality of pressure and position sensors configured to be installed on a floor and to measure a floor contact position, a floor contact area and a floor contact pressure of the object and a motion analyzer configured to analyze the motion of the object by combining two or more among the images, floor contact position, floor contact area and floor contact pressure of the object.

Claims

1. A method of determining a motion type of a body of a user among a plurality of motion types of the body of the user using multifaceted sensing, the method comprising:

photographing, by a camera, images of the user having a motion;

measuring, by a plurality of pressure and position sensors installed apart from each other at a predetermined distance and in the form of a matrix on a floor, a floor contact position, a floor contact area, and a floor contact pressure of the user, the plurality of pressure and position sensors comprising identical sensors;

identifying, by way of a processor, characteristics of the motion of the body based on at least one of the measured floor contact position, the measured floor contact area, and the measured floor contact pressure of the user; and

identifying, by way of the processor, the motion type of the body corresponding to the identified characteristics of the motion of the body among the plurality of motion types of the body identified based on the photographed images, the plurality of motion types of the body being different from each other.

2. The method according to claim 1, wherein the plurality of pressure and position sensors are arranged at a predetermined interval on a mattress.

3. The method according to claim 1, wherein the identifying the motion type of the body is performed in one of a computer, a server, and a display apparatus.

4. The method according to claim 3, wherein a result from identifying the motion type of the body is applied to an image of the user or a content object displayed on the display apparatus.

5. The method according to claim 1, wherein the identifying the motion type of the body is performed by combining two or more among changes in the photographed images of the user, the floor contact position, the floor contact area, and the floor contact pressure over time.

6. The method according to claim 5, wherein the change in the floor contact position over time is used in analyzing a horizontal activity of the user.

7. The method according to claim 5, wherein the change in the floor contact area over time is used in analyzing a balance of the user.

8. The method according to claim 5, wherein the change in the floor contact pressure over time is used in analyzing a moved height of the user.

9. The method according to claim 1, wherein a result from identifying the motion type of the body is applied to one among measurement of an user'"'"'s weight, face recognition, gesture recognition, measurement of moving speed, measurement of an exercise amount, and a game control signal.

10. An apparatus for determining a motion type of a body of a user among a plurality of motion types of the body of the user, the apparatus comprising:

a camera to photograph images of the user having the motion;

a plurality of pressure and position sensors configured to be installed apart from each other at a predetermined distance and in the form of a matrix on a floor and to measure a floor contact position, a floor contact area and a floor contact pressure of the user, the plurality of pressure and position sensors comprising identical sensors; and

a motion analyzer configured to identify characteristics of the motion of the body based on at least one of the measured floor contact position, the measured floor contact area, and the measured floor contact pressure of the user, and to identify the motion type of the body corresponding to the identified characteristics of the motion of the body among the plurality of motion types of the body identified based on the photographed images, the plurality of motion types of the body being different from each other.

11. The apparatus according to claim 10, wherein the plurality of pressure and position sensors are arranged at a predetermined interval on a mattress.

12. The apparatus according to claim 10, wherein the motion analyzer is provided in one of a computer, a server, and a display apparatus.

13. The apparatus according to claim 12, wherein a result from identifying the motion type of the body is applied to an image of the user or a content object displayed on the display apparatus.

14. The apparatus according to claim 10, wherein the motion analyzer identifies the motion type of the body by combining two or more among changes in the photographed images of the user, the floor contact position, the floor contact area, and the floor contact pressure over time.

15. The apparatus according to claim 14, wherein the change in the floor contact position over time is used in analyzing horizontal activity of the user.

16. The apparatus according to claim 14, wherein the change in the floor contact area over time is used in analyzing balance of the user.

17. The apparatus according to claim 14, wherein the change in the floor contact pressure over time is used in analyzing moved height of the user.

18. The apparatus according to claim 10, wherein a result from identifying the motion type of the body is applied to one among measurement of an user'"'"'s weight, face recognition, gesture recognition, measurement of moving speed, measurement of an exercising amount, and a game control signal.