REMOTE CONTROL APPARATUS, REMOTE CONTROL METHOD, REMOTE CONTROL SYSTEM, AND PROGRAM
First Claim
1. A signal processing device, comprising:
- at least one processor; and
a recording medium encoded with instructions that, when executed by the at least one processor, perform a method of;
receiving a first image signal output from an imaging device;
calculating, based on the first image signal, a first relationship between a first position of an eye of a user, a first position of a hand of the user, and a first position associated with a first target device; and
providing, when the first relationship matches a first particular relationship, a control signal to the first target device to control an operation of the first target device.
1 Assignment
0 Petitions
Accused Products
Abstract
The present disclosure relates to a remote control apparatus, a remote control method, a remote control system, and a program that are capable of achieving remote control by an intuitive motion using only a hand and an eye.
A plurality of imaging units capture images of a space in which an eye and a hand of a user and an operation target device are present. Positions of the eye and the hand of the user and the operation target device are specified on the basis of the captured images. A line of sight of the user is specified on the basis of a positional relationship between the eye of the user and the operation target device. A motion of the user that is made while the hand is located on a straight line being the line of sight is assumed as an operation instruction given to the operation target device. The operation instruction is transmitted to the operation target device to cause the operation target device to operate. The present disclosure can be applied to a remote control apparatus.
10 Citations
26 Claims
-
1. A signal processing device, comprising:
-
at least one processor; and a recording medium encoded with instructions that, when executed by the at least one processor, perform a method of; receiving a first image signal output from an imaging device; calculating, based on the first image signal, a first relationship between a first position of an eye of a user, a first position of a hand of the user, and a first position associated with a first target device; and providing, when the first relationship matches a first particular relationship, a control signal to the first target device to control an operation of the first target device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A signal processing method, comprising:
-
receiving a first image signal output from an imaging device; calculating, based on the first image signal, a first relationship between a first position of an eye of a user, a first position of a hand of the user, and a first position associated with a first target device; and providing, when the first relationship matches a first particular relationship, a control signal to the first target device to control an operation of the first target device.
-
-
14. A system, comprising
an imaging device configured to capture a first image signal; - and
at least one processor; and a recording medium encoded with instructions that, when executed by the computer processor, perform a method of; receiving a first image signal output from an imaging device; calculating, based on the first image signal, a first relationship between a first position of an eye of a user, a first position of a hand of the user, and a first position associated with a first target device; and providing, when the first relationship matches a first particular relationship, a control signal to the first target device to control an operation of the first target device. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22, 23, 25)
- and
-
26. The system according to claim 24, wherein the second image signal is output from a second imaging device.
Specification
-
- Resources
-
Current AssigneeSony Corporation (Sony Group Corp.)
-
Original AssigneeSony Corporation (Sony Group Corp.)
-
InventorsOkamoto, Hideo, Nakagawa, Takaaki, Doi, Hiromasa, Kondo, Kazuhio
-
Application NumberUS15/894,031Publication NumberTime in Patent OfficeDaysField of SearchUS Class CurrentCPC Class CodesG06F 3/01 Input arrangements or combi...G06F 3/013 Eye tracking input arrangem...G06F 3/017 Gesture based interaction, ...G06F 3/0304 Detection arrangements usin...G06F 3/0426 tracking fingers with respe...G06F 3/04842 Selection of displayed obje...G06T 7/292 Multi-camera trackingG06T 7/70 Determining position or ori...G06V 40/165 using facial parts and geom...G06V 40/28 Recognition of hand or arm ...G08C 17/02 using a radio linkG08C 2201/30 User interfaceG08C 2201/32 Remote control based on mov...
