Pattern codes used for interactive control of computer applications

• US 7,972,211 B2
• Filed: 03/12/2010
• Issued: 07/05/2011
• Est. Priority Date: 05/10/2004
• Status: Expired due to Term

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Marks, Richard L.
• Primary Examiner(s): Lewis; David L.
• Assistant Examiner(s): TORIMIRO, ADETOKUNBO OLUSEGUN
• Application Number:
  US12/723,144
• Publication Number:
  US 20100173710A1
• Time in Patent Office: 480 Days
• Field of Search: 463/1, 463/4, 463/5, 463 30- 36, 463/47, 345/156
• US Class Current: 463/36
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: G06K 19/06009 with optically detectable marking G06K19/063, G06K19/08 take precedence

Abstract

Methods for determining input to be supplied to a computer program are provided. One of the methods include processing a first video frame having a pattern code before light is applied to the pattern code. The first video frame defines a first characteristic of the pattern code, and the pattern code is defined by at least two tags. The method further includes processing a second video frame having the pattern code when light is applied to the pattern code, such that the second video frame defines a second characteristic of the pattern code. Then, decoding the first characteristic and the second characteristic of the pattern code to produce decoded information. An interactive command is then initiated to the computer program. A type of the interactive command is defined by the decoded information, wherein one of the tags has a reflective surface and one of the tags has a non-reflective surface.

Claims

1. A method for determining input to be supplied to a computer program, comprising:

processing a first video frame having a pattern code before light is applied to the pattern code, the first video frame defining a first characteristic of the pattern code, the pattern code defined by at least two tags;

processing a second video frame having the pattern code when light is applied to the pattern code, the second video frame defining a second characteristic of the pattern code;

decoding the first characteristic and the second characteristic of the pattern code to produce decoded information; and

initiating an interactive command to the computer program, a type of the interactive command defined by the decoded information;

wherein one of the tags has a reflective surface and one of the tags has a non-reflective surface, and wherein at least some of the operations of the method are executed by a processor.

2. The method claim 1, wherein the second characteristic of the pattern code has more illumination coming from the reflective surface while less coming from the non-reflective surface.

3. The method of claim 1, wherein the first characteristic of the pattern code has a color that is darker in the non-reflective surface and lighter in the reflective surface.

4. The method of claim 1, wherein each of the two tags is capable of having a specific color.

5. The method of claim 1, wherein the second pattern configuration that is define when the light is not applied to the pattern code is visually defined by characteristics of each portion of the tags of the pattern code.

6. The method of claim 1, wherein the computer program is one of an application or a computer game.

7. The method of claim 1, further comprising,

arranging tags in a row and column array that is either symmetric or non-symmetric.

8. The method of claim 1, further comprising,

arranging tags in a joined configuration to define geometric shapes.

9. The method of claim 1, wherein the type of the interactive command command defined by the decoded information includes tracking one of merchandise, vehicles, objects in transit, inventor of goods, people entering a place to verify authority, people that have access to programs or services.

10. The method of claim 1, wherein the tags are associated with a user by either wearing of the tags or displaying of the tags, or an object having the tags associated therewith.

11. The method of claim 1, wherein the type of the interactive command defined by the decoded information triggers an action by a video game, the action being one of a special power or special interactivity during play of the video game.

12. The method of claim 1, wherein the type of the interactive command defined by the decoded information causes access to an attribute during play of a video game.

13. The method of claim 12, wherein the access is one of an unlock of an aspect of the video game.

14. The method of claim 1, further comprising;

determining a color of the light that is applied, the color including any one of white light or a color variation that is different than white, where a different color acts to cause the type of interactive command defined by the decoded information to change.

15. The method of claim 1, wherein the reflective surface is one of a cloth material or a plastic-type material that is capable of reflecting the light.

16. The method of claim 1, wherein the at least two tags form a holistic graphic, where part of the holistic graphic is reflective and another part is not reflective.

17. An apparatus, comprising:

a processor for executing program instructions, the program instructions defining control instructions for interfacing with a light application device for applying light, and executing instructions for receiving captured video from the video capture device, the light application device being configured to apply light at a first and second tags of a pattern code and the control instructions for the light application device determining when to apply the light, the light being applied at both of the first and second tags of the pattern code defining a first pattern configuration when light is applied and a second pattern configuration that is different than the first pattern configuration when the light is not applied, wherein the first and second characteristic each define a code state of the pattern code before and after light is applied onto the pattern code to define an input to a computer program.

18. The Apparatus of claim 17, wherein one of the tags has a reflective surface and one of the tags has a non-reflective surface.

19. The Apparatus of claim 17, wherein the first pattern configuration has more illumination defined from the reflective surface and less illumination from the non-reflective surface.

20. The Apparatus of claim 17, wherein the second pattern configuration that is define when the light is not applied to the pattern code is visually defined by characteristics of each portion of the tags of the pattern code.

21. The Apparatus of claim 17, wherein the characteristics of each tag is defined by color.

22. A computer program embodied on a computer readable medium for determining input to be supplied to the computer program, the computer program comprising:

program instructions for processing a first video frame having a pattern code before light is applied to the pattern code, the first video frame defining a first characteristic of the pattern code, the pattern code defined by at least two tags;

program instructions for processing a second video frame having the pattern code when light is applied to the pattern code, the second video frame defining a second characteristic of the pattern code;

program instructions for decoding the first characteristic and the second characteristic of the pattern code to produce decoded information; and

program instructions for initiating an interactive command to the computer program, a type of the interactive command defined by the decoded information;

wherein one of the tags has a reflective surface and one of the tags has a non-reflective surface.

23. The computer program of claim 22, wherein the second characteristic of the pattern code has more illumination coming from the reflective surface while less coming from the non-reflective surface.

24. The computer program of claim 22, wherein the first characteristic of the pattern code has a color that is darker in the non-reflective surface and lighter in the reflective surface.

25. The computer program of claim 22, wherein each of the two tags is capable of having a specific color.

26. The computer program of claim 22, wherein the second pattern configuration that is define when the light is not applied to the pattern code is visually defined by characteristics of each portion of the tags of the pattern code.

27. The computer program of claim 22, wherein the computer program is one of an application or a computer game.

28. A method for analyzing light data, comprising:

identifying in a first video frame a pattern code before light is applied to the pattern code, the first video frame defining a first characteristic of the pattern code, the pattern code defined by at least two tags;

identifying in a second video frame the pattern code when light is applied to the pattern code, the second video frame defining a second characteristic of the pattern code;

decoding the first characteristic and the second characteristic of the pattern code to produce decoded information; and

initiating an interactive command to a computer program, a type of the interactive command defined by the decoded information, wherein one of the tags has a reflective surface and one of the tags has a non-reflective surface.