TELEPRESENCE METHOD AND SYSTEM FOR TRACKING HEAD MOVEMENT OF A USER

• US 20150015707A1
• Filed: 07/10/2013
• Published: 01/15/2015
• Est. Priority Date: 07/10/2013
• Status: Abandoned Application

• Current Assignee: SubC Control Limited
• Original Assignee: SubC Control Limited
• Inventors: COLLETT, Chad Joseph, ROWE, Adam Paul
• Application Number:
  US13/938,695
• Publication Number:
  US 20150015707A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

A telepresence system and method is disclosed for removing error introduced to video images displayed to a user. A remote pan and tilt system tracks the motion of the user'"'"'s head, and moves a pan and tilt system to capture images of the remote environment. By sensing noise in the movement of the user and/or the motion of the vehicle, error caused by noise is reduced within the displayed video images.

Claims

1. A method comprising:

sensing the movement of a head of a user with a first sensor;

providing by the first sensor a first signal indicative of the sensed movement of the head of the user;

coupling a second sensor to a vehicle and sensing the movement of the vehicle with the second sensor;

providing by the second sensor a second signal, the second signal comprising a component indicative of the sensed movement of the vehicle;

cancelling an error from the first signal comprising cancelling the component of the second signal indicative of the sensed movement of the vehicle to provide a third signal; and

moving a pan and tilt system in correlation with the third signal.

2. The method according to claim 1 wherein the user is a passenger of the vehicle, the cancelling for removing motion of the head of the user resulting from motion of the vehicle.

3. The method according to claim 1 wherein the pan and tilt system is aboard the vehicle, the cancelling for removing motion artefacts within feedback from the vehicle.

4. The method according to claim 1 wherein the error is cancelled for changing a relative position of the pan and tilt system to the vehicle during the movement of the vehicle.

5. The method according to claim 1 wherein the error is cancelled for changing a relative position of the pan and tilt system to the vehicle during the movement of the vehicle and movement of the head of the user, the change relating only to the movement of the head of the user.

6. The method according claim 1 wherein the error is cancelled for changing a relative position of the pan and tilt system to the vehicle during the movement of the vehicle and movement of the head of the user, the change relating to aligning motion of the pan and tilt system with the movement of the head of the user and filtering high frequency motion of the vehicle but other than related to low frequency motion of the vehicle.

7. The method according to claim 1 wherein cancelling the error reflected in the second signal comprises providing an indication to a user that an error is cancelled from the first signal to produce the third signal.

8. The method according to claim 1 comprising an input port from a user for receiving one of an ON and OFF signal, wherein dependent on the signal, the error in the first signal is other than cancelled.

16. The method according to claim 1 wherein the first sensor is worn by the user.

17. The method according to claim 1 wherein the vehicle is a remote vehicle for being controlled by the user.

9. A method comprising:

aligning a remote pan and tilt system (PATS) with the position of a head of a user wherein aligning comprises aligning the remote pan and tilt system with the position of the head of the user to define a set of aligned positions therebetween {(p1head,p1pats), (p2head, p2pats) (p3head, p3pats), . . . } such that moving the head of the user from a first aligned position p1head in alignment with the pan and tilt system at p1pats to a second other position p2head results in automatic motion of the pan and tilt system to a second PATS position p2pats in alignment with the second other position p2head;

after moving the remote pan and tilt system to maintain alignment with the movement of the head of the user, detecting automatically misalignment between a detected position of the remote pan and tilt system and a detected position of the head of the user; and

in response to automatically detecting misalignment, automatically realigning the relative position between the remote pan and tilt system with the head of the user to correct for the misalignment.

10. The method according to claim 9 wherein realigning the relative position comprises providing an indication to the user that the remote pan and tilt system and the head of the user is misaligned.

11. The method according to claim 9 comprising:

restricting motion of the head of the user to a first range of motion when a misalignment is detected.

12. The method according to claim 9 comprising:

detecting a position of the head of the user;

providing the detected position of the head of the user to a processor;

correlating the detected position of the head of the user with a known location of the pan and tilt system to determine when a position of the user'"'"'s head is out of alignment with the pan and tilt system for determining that the pan and tilt system is obstructed; and

in response to detecting that the pan and tilt system is obstructed, guiding the head of the user to a first position p1head within the range of motion and positioning the pan and tilt system to the first position p1pats.

13. The method according to claim 12 comprising providing the user with an indication that movement of the pan and tilt system is obstructed.

14. The method according to claim 9 comprising:

detecting a position of the head of the user and rate of change of the position;

providing the detected position of the head of the user and the rate of change to a processor;

correlating the detected position of the head of the user with a known location of the pan and tilt system to determine when a position of the head of the user is out of alignment with the pan and tilt system for determining that head of the user is moving faster than the pan and tilt system; and

in response to detecting that the head of the user is moving faster, continuing to move the pan and tilt system toward a detected position of the head of the user.

15. The method according to claim 14 comprising providing the user with an indication that movement of the head of the user is faster than a speed of movement of the pan and tilt system.

18. A system comprising:

a first sensor for sensing movement of a head of a user and for transmitting a first signal indicative of the sensed movement of the head of the user;

a vehicle sensor for sensing movement of a vehicle and for transmitting a second signal indicative of the sensed movement of the vehicle;

a receiver for receiving the first signal and the second signal;

a processor for cancelling error based on the second signal from the first signal to produce a third signal; and

a remote pan and tilt system disposed remote from the first sensor and comprising a controller, movement of the remote pan and tilt system dependent upon the third signal.

19. The system according to claim 18 comprising an actuator for in response thereto disabling the cancelling error.

20. The system according to claim 18 comprising:

a head mounted device coupled to the head of the user wherein the first sensor is coupled to the head mounted device;

a video camera coupled to the pan and tilt system for capturing images; and

a display coupled to the head mounted device, the display for displaying to the user video images indicative of the images captured by the video camera.

21. The system according to claim 18 comprising:

a head mounted device coupled to the head of the user wherein the first sensor is coupled to the head mounted device;

a video camera coupled to the pan and tilt system for capturing images; and

a display other than coupled to the head mounted device, the display for displaying to the user video images indicative of the images captured by the video camera.