SYSTEM AND METHOD FOR CONTROLLING AN EXTERNAL SYSTEM USING A REMOTE DEVICE WITH A DEPTH SENSOR
First Claim
Patent Images
1. A method for controlling a user interface, the method comprising:
- acquiring a first set of close range depth images of a part of a first user'"'"'s body with a first depth sensor, wherein the first depth sensor is coupled to a first remote control device;
identifying from the first set of depth images movement of the part of the first user'"'"'s body;
tracking the movement of the part of the first user'"'"'s body;
providing feedback on the tracked movement of the part of the first user'"'"'s body;
transmitting a first set of tracking data associated with the tracked movement of the part of the first user'"'"'s body to a controlled device, wherein the first set of tracking data is used to control the user interface for the controlled device.
3 Assignments
0 Petitions
Accused Products
Abstract
A system and method for implementing a remote controlled user interface using close range object tracking are described. Close range depth images of a user'"'"'s hands and fingers or other objects are acquired using a depth sensor. Using depth image data obtained from the depth sensor, movements of the user'"'"'s hands and fingers or other objects are identified and tracked. The tracking data is transmitted to an external control device, thus permitting the user to interact with an object displayed on a screen controlled by the external control device, through movements of the user'"'"'s hands and fingers.
20 Citations
20 Claims
-
1. A method for controlling a user interface, the method comprising:
-
acquiring a first set of close range depth images of a part of a first user'"'"'s body with a first depth sensor, wherein the first depth sensor is coupled to a first remote control device; identifying from the first set of depth images movement of the part of the first user'"'"'s body; tracking the movement of the part of the first user'"'"'s body; providing feedback on the tracked movement of the part of the first user'"'"'s body; transmitting a first set of tracking data associated with the tracked movement of the part of the first user'"'"'s body to a controlled device, wherein the first set of tracking data is used to control the user interface for the controlled device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A system for controlling a user interface, the system comprising:
-
a remote control device communicatively coupled to a controlled device, wherein the remote control device comprises; a depth sensor configured to acquire depth images of a user'"'"'s movements; an output module configured to transmit information to the controlled device, wherein the information includes data generated by the depth sensor; the controlled device, wherein the controlled device comprises; an input module configured to receive the information from the remote control device and convert the information into signals; a device software module configured to receive the signals from the input module to control the user interface for the controlled device. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19)
-
-
20. A system for controlling a user interface, the system comprising:
-
means for acquiring close range depth images of a part of a user'"'"'s body with a depth sensor, wherein the depth sensor is coupled to a remote control device; means for identifying from the depth images movement of the part of the user'"'"'s body; means for tracking the movement of the part of the user'"'"'s body; means for providing feedback on the tracked movement to the user; means for transmitting tracking data to a controlled device, wherein the tracking data are used to control the user interface for the controlled device.
-
Specification