POSITION DETECTION AND/OR MOVEMENT TRACKING VIA IMAGE CAPTURE AND PROCESSING

• US 20080316324A1
• Filed: 06/09/2008
• Published: 12/25/2008
• Est. Priority Date: 06/22/2007
• Status: Abandoned Application

• Current Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Rofougaran, Maryam, ROFOUGARAN, AHMADREZA (REZA)
• Application Number:
  US12/135,332
• Publication Number:
  US 20080316324A1
• Time in Patent Office: Days
• US Class Current: 348/222.1
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/57 Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game A63F13/56 takes precedence
• CPC Class Codes: A63F 13/573 using trajectories of game objects, e.g. of a golf ball according to the point of impact
• CPC Class Codes: A63F 13/825 Fostering virtual characters
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/1031 using a wireless connection, e.g. Bluetooth, infrared connections
• CPC Class Codes: A63F 2300/5553 user representation in the game field, e.g. avatar
• CPC Class Codes: G01S 13/003 Bistatic radar systems; Multistatic radar systems
• CPC Class Codes: G01S 13/426 Scanning radar, e.g. 3D radar G01S13/66 takes precedence
• CPC Class Codes: G01S 13/723 by using numerical data
• CPC Class Codes: G01S 13/878 Combination of several spaced transmitters or receivers of known location for determining the position of a transponder or a reflector G01S13/874 takes precedence
• CPC Class Codes: G01S 7/412 based on a comparison between measured values and known or stored values
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact

Abstract

Position detection and/or movement tracking via image capture and processing. Digital cameras perform image capture of one or more objects within a particular region (e.g., a physical gaming environment). A game module or processing module processes the images captured by the digital cameras to identify a position of and/or track movement of objects (e.g., a player, a gaming object, a game controller, etc.). Various digital image processing techniques may be employed including pattern recognition of objects, color recognition/distinction, intensity recognition/distinction, relative size comparison, etc. to identify objects and/or track their movement. The coupling between the digital cameras and the game module or processing module may be wired, wireless, or a combination thereof. If wireless, any number of different signaling means may be employed including Code Division Multiple Access (CDMA) signaling, Time Division Multiple Access (TDMA) signaling, or Frequency Division Multiple Access (FDMA) signaling.

Claims

1. An apparatus, comprising:

a plurality of digital cameras that generates a plurality of digital images, wherein an object is depicted within at least some of the plurality of digital images; and

a processing module coupled to;

receive the plurality of digital images;

identify characteristics of the object within the at least some of the plurality of digital images to produce identified object characteristics; and

determine position of the object with respect to the plurality of digital cameras based on the identified object characteristics.

2. The apparatus of claim 1, wherein:

the identified object characteristics includes a plurality of directional vectors extending from at least some of the plurality of digital cameras to the object; and

the processing module determines the position of the object with respect to the plurality of digital cameras based on the plurality of directional vectors.

3. The apparatus of claim 2, wherein:

one of the plurality of directional vectors extends from a reference point of a digital image sensor of one digital camera to a physical pixel within the digital image sensor that corresponds to an image pixel of one digital image captured by the one digital camera.

4. The apparatus of claim 1, wherein:

the processing module employs a pattern recognition process to identify the characteristics of the object.

5. The apparatus of claim 1, wherein:

the object includes a sensing tag; and

at least one of the identified object characteristics is the sensing tag.

6. The apparatus of claim 5, wherein:

the sensing tag is at least one of;

a light reflective material;

a light absorbent material;

an infrared source such that at least one of the plurality of digital cameras is infrared sensitive; and

a color.

7. The apparatus of claim 1, wherein:

the object has a predetermined size;

the processing module employs a pattern recognition process to identify the object within the at least some of the plurality of digital images;

the identified object has an image size; and

based on the predetermined size and the image size, the processing module determines a distance between the object and the processing module or at least one of the plurality of digital cameras.

8. The apparatus of claim 1, wherein:

the processing module maps the position of the object within a virtual three-dimensional coordinate system.

9. The apparatus of claim 1, wherein:

a field of view of one camera of the plurality of digital cameras is adjusted based on the position of the object.

10. The apparatus of claim 1, wherein:

an image capture rate of one of the plurality of digital cameras is adjusted based on at least one of;

a predetermined setting within the processing module;

a user-selected setting within the processing module;

a movement history of the object;

a current movement of the object; and

an expected future movement of the object.

11. The apparatus of claim 1, wherein:

the processing module determines the position of the object during a first time;

the processing module determines at least one additional position of the object during a second time; and

the processing module estimates movement of the object by comparing the determined position and the at least one additional determined position.

12. The apparatus of claim 1, wherein:

the object includes a first radio frequency (RF) transceiver;

the processing module includes a second RF transceiver; and

based on an RF signal transmitted from the first RF transceiver to the second RF transceiver, the processing module determines a distance between the processing module and the object.

13. The apparatus of claim 1, wherein:

one of the plurality of digital cameras includes a first radio frequency (RF) transceiver;

the processing module includes a second RF transceiver; and

based on an RF signal transmitted from the first RF transceiver to the second RF transceiver, the processing module determines a distance between the processing module and the one digital camera.

14. The apparatus of claim 1, wherein:

a plurality of integrated circuits is distributed throughout a region in which the object is located; and

one of the plurality of digital cameras is a digital image sensor implemented on a surface of one of the plurality of integrated circuits.

15. An apparatus, comprising:

a gaming object for use within a gaming environment;

a plurality of digital cameras that generates a plurality of digital images, wherein the gaming object is depicted within at least some of the plurality of digital images; and

a game console coupled to;

receive the plurality of digital images;

identify characteristics of the gaming object within the at least some of the plurality of digital images to produce identified object characteristics; and

determine position of the gaming object within the gaming environment with respect to the plurality of digital cameras based on the identified object characteristics.

16. The apparatus of claim 15, wherein:

the gaming object is associated with a player located within the gaming environment; and

the game console determines position of the player based on the position of the gaming object.

17. The apparatus of claim 15, wherein:

the identified object characteristics includes a plurality of directional vectors extending from at least some of the plurality of digital cameras to the gaming object; and

the game console determines the position of the gaming object with respect to the plurality of digital cameras based on the plurality of directional vectors.

18. The apparatus of claim 17, wherein:

one of the plurality of directional vectors extends from a reference point of a digital image sensor of one digital camera to a physical pixel within the digital image sensor that corresponds to an image pixel of one digital image captured by the one digital camera.

19. The apparatus of claim 15, wherein:

the game console employs a pattern recognition process to identify the characteristics of the gaming object.

20. The apparatus of claim 15, wherein:

the gaming object includes a sensing tag; and

at least one of the identified object characteristics is the sensing tag.

21. The apparatus of claim 20, wherein:

the sensing tag is at least one of;

a light reflective material;

a light absorbent material;

an infrared source such that at least one of the plurality of digital cameras is infrared sensitive; and

a color.

22. The apparatus of claim 15, wherein:

the gaming object has a predetermined size;

the game console employs a pattern recognition process to identify the gaming object within the at least some of the plurality of digital images;

the identified gaming object has an image size; and

based on the predetermined size and the image size, the game console determines a distance between the gaming object and the game console or at least one of the plurality of digital cameras.

23. The apparatus of claim 15, wherein:

the game console maps the position of the gaming object within a virtual three-dimensional coordinate system.

24. The apparatus of claim 15, wherein:

an image capture rate of one of the plurality of digital cameras is adjusted based on at least one of;

a predetermined setting within the game console;

a player-selected setting within the game console;

a movement history of the gaming object;

a current movement of the gaming object; and

an expected future movement of the gaming object.

25. The apparatus of claim 15, wherein:

the position is a first position;

the game console determines the first position during a first time;

the game console determines a second position of the gaming object during a second time; and

the game console estimates movement of the gaming object by comparing the first position and the second position.

26. An apparatus, comprising:

a plurality of digital cameras, associated with a gaming object, that generates a plurality of digital images such that a plurality of predetermined references is depicted within at least some of the plurality of digital images; and

a game console coupled to;

receive the plurality of digital images;

identify characteristics of at least some of the plurality of predetermined references to produce identified characteristics; and

determine position of the gaming object with respect to the plurality of predetermined references based on the identified characteristics.

27. The apparatus of claim 26, wherein:

the identified characteristics includes a plurality of directional vectors extending from at least some of the plurality of digital cameras to the at least some of the plurality of predetermined references; and

the game console determines the position of the gaming object with respect to the plurality of digital cameras based on the plurality of directional vectors.

28. The apparatus of claim 27, wherein:

one of the plurality of directional vectors extends from a physical pixel within a digital image sensor of one digital camera, that corresponds to an image pixel of one digital image captured by the one digital camera, to a reference point of the digital image sensor.

29. The apparatus of claim 26, wherein:

the gaming object is associated with a player located within the gaming environment; and

the game console determines position of the player based on the position of the gaming object.

30. The apparatus of claim 26, wherein:

the game console employs a pattern recognition process to identify the characteristics of at least some of the plurality of predetermined references.

31. The apparatus of claim 26, wherein:

the game console maps the position of the gaming object within a virtual three-dimensional coordinate system.

32. The apparatus of claim 26, wherein:

the position is a first position;

the game console determines the first position during a first time;

the game console determines a second position of the gaming object during a second time; and

the game console estimates movement of the gaming object by comparing the first position and the second position.