Control system employing identification of a displayed image
First Claim
Patent Images
1. A control system for use in an environment having a display device, comprising:
- a user-manipulated device, the user-manipulated device including a video camera;
the user-manipulated device further comprising control circuitry including one or more processors with associated programs implementing image processing and control processing functions under programmed control, the image processing implemented functions including receiving image information from the video camera in response to user operation of the video camera of the user-manipulated device, the image information corresponding to a captured scene which includes at least part of a display device in the field of view of the camera and also background around the display device, the image processing isolating the display image information from the background scene using known characteristics of the display, the image processing further identifying within the display portion of the image one or more displayed reference patterns, the control processing controlling an application using the reference patterns.
1 Assignment
0 Petitions
Accused Products
Abstract
An application control system and method is adapted for use with an entertainment system of a type including a display such as a monitor or TV and having display functions. A control device may be conveniently held by a user and employs an imager. The control system and method images the screen of the TV or other display to detect distinctive markers displayed on the screen. This information is transmitted to the entertainment system for control of an application or is used by the control device to control an application.
-
Citations
18 Claims
-
1. A control system for use in an environment having a display device, comprising:
-
a user-manipulated device, the user-manipulated device including a video camera; the user-manipulated device further comprising control circuitry including one or more processors with associated programs implementing image processing and control processing functions under programmed control, the image processing implemented functions including receiving image information from the video camera in response to user operation of the video camera of the user-manipulated device, the image information corresponding to a captured scene which includes at least part of a display device in the field of view of the camera and also background around the display device, the image processing isolating the display image information from the background scene using known characteristics of the display, the image processing further identifying within the display portion of the image one or more displayed reference patterns, the control processing controlling an application using the reference patterns. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A control system for use in an environment having a display device, comprising:
-
a user-manipulated device, the user-manipulated device including a video camera; the user-manipulated device further comprising control circuitry including one or more processors with associated programs implementing image processing and control functions under programmed control, the image processing implemented functions including receiving image information from the video camera in response to user operation of the video camera of the user-manipulated device, the image information corresponding to a captured scene which includes at least part of a display device in the field of view of the camera including at least one reference field incorporated as graphical information displayed on a screen of the display device to provide reference information for controlling an application, the user-manipulated device processor implementing program instructions identifying the at least one reference field based on one or more colors of the at least one reference field, based on a shape of the at least one reference field, and based on a pattern of elements that comprise the at least one reference field, the control functions including controlling an application based on said reference information. - View Dependent Claims (9, 10)
-
-
11. A control system adapted for use in an environment having a display device presenting display information including predetermined objects, the system comprising:
-
a control device including a video camera associated therewith and movable so as to be pointed by the user to image a desired field of view; the control device further comprising control circuitry including one or more processors with associated programs implementing processing functions under programmed control, the programmed processor implemented functions including;
an image control processing programmed to receive image information from the video camera, the image information capturing a scene in response to user operation of the video camera of the control device which includes at least part of a display device including a displayed pattern of reference elements;
an identification control processing to identify an object in said image information employing the displayed pattern of reference elements to provide object reference information; and
an application control processing to initiate control of an application based on the identified object reference information. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18)
-
Specification