System and method for object extraction for embedding a representation of a real world object into a computer graphic

• US 9,636,588 B2
• Filed: 08/07/2013
• Issued: 05/02/2017
• Est. Priority Date: 08/04/2009
• Status: Expired due to Fees

• Current Assignee: EyeCue Vision Technologies LTD
• Original Assignee: EyeCue Vision Technologies LTD
• Inventors: Horovitz, Ronen, Kaftory, Ran
• Primary Examiner(s): Geroleo, Francis G
• Application Number:
  US13/960,866
• Publication Number:
  US 20130321447A1
• Time in Patent Office: 1,364 Days
• Field of Search: 348143, 348370, 396 80, 396 89, 345419, 345156, 703 1, 382103
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/46 Computing the game score
• CPC Class Codes: A63F 13/63 by the player, e.g. authoring using a level editor
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: A63F 13/795 for finding other players; for building a team; for providing a buddy list
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/6018 where the game content is authored by the player, e.g. level editor or by game device at runtime, e.g. level is created from music data on CD
• CPC Class Codes: A63F 2300/61 Score computation
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

Systems and methods for extracting an image of a physical object constructed of for example bricks are presented. The method and system may detect boundaries and edges of a background using an edge detection operator, perform a perspective transformation calculation to compute a corrected virtual grid that is substantially aligned with the physical object'"'"'s image, locate a color calibration palette in the digital image and extract color value information for pixels of the color calibration palette, and discern bricks as part of the physical object'"'"'s image, the discernment being based in part on a determination of the brick'"'"'s color compared to the color palette and the background color, the discerned bricks forming the extracted image. A computer readable medium may include instructions causing a system to extract an image of a physical object constructed of bricks according to the method.

Claims

1. A system comprising:

an imager; and

a processor, said processor configured to;

(a) capture, by said imager, a first captured image, said first captured image including a first image of a first physical object, said first physical object having been made with first multiple construction bricks of a plurality of passive interlocking construction bricks;

(b) extract from said first captured image, as a first extracted image, said first image of said first physical object, said first extracted image including an image of at least one of said first multiple construction bricks, wherein said first image of said first physical object is extracted from said first captured image using a priori knowledge of at least some physical attributes of said first multiple construction bricks, said physical attributes being selected from one or more of;

shapes, sizes, and colors of said first multiple construction bricks;

(c) represent said first extracted image on a digital display as a digital representation of said first physical object, said digital representation of said first physical object including a digital representation of at least one of said first multiple construction bricks;

(d) embed said digital representation of said first physical object into a computer graphic, said computer graphic representing part of a virtual world or video game; and

(e) on a screen rendering of said computer graphic in said virtual world or video game, in response to user interaction with said virtual world or video game, manipulate on the screen said digital representation of said first extracted image of said first physical object as a whole, within said virtual world or video game and within parameters of said virtual world or video game.

2. The system as in claim 1, wherein said processor is configured to manipulate said digital representation on said screen by changing a location of said digital representation on said screen.

3. The system as in claim 1, wherein said processor is configured to instruct a user of said system to build said first physical object.

4. The system as in claim 3, wherein an instruction includes a target digital representation of said first physical object to be built from construction bricks.

5. The system as in claim 1, wherein a color of at least one of said first multiple construction bricks displayed in said digital representation of said first extracted image of said first physical object corresponds to a color of one of said first multiple construction bricks in said first extracted image of said first physical object.

6. The system as in claim 1, wherein

said first image of said first physical object comprising said first multiple construction bricks includes an image of a first of said first multiple construction bricks as having a first height dimension, and an image of a second of said first multiple construction bricks as having a second height dimension, and

said processor is to display said digital representation of said first of said first multiple construction bricks as having said first height dimension and said digital representation of said second of said first multiple construction bricks as having said second height dimension.

7. The system of claim 1 wherein said processor is further configured to:

obtain a second captured image captured by said imager, said second captured image including a second image of a second physical object, said second physical object comprising second multiple passive interlocking construction bricks, said second physical object being distinct from said first physical object;

extract from said second captured image, as a second extracted image, said second image of said second physical object, wherein said second image of said second physical object is extracted from said second captured image using a priori knowledge of at least some attributes of said second multiple passive interlocking construction bricks forming said second physical object, said attributes being selected from one or more of;

shapes, sizes, and colors of said second construction bricks;

combine said first image of said first physical object with said second image of said second physical object, wherein said digital representation of said first extracted image includes said second extracted image, and wherein

said first extracted image is manipulated in combination with said second extracted image.

8. The system of claim 1 wherein said extract from said first captured image, as said first extracted image, identifies at least one brick in said first captured image.

9. A method for embedding a representation of a physical real world object into a computer graphic, the method comprising:

(A) capturing, by an imager, a captured image, said captured image including said physical real world object, said physical real world object having been made with multiple first construction bricks of a plurality of passive interlocking construction bricks;

(B) extracting from said captured image, an image of said physical real world object, as an extracted image, said extracted image including an image of at least one of said multiple first construction bricks, wherein said image of said physical real world object is extracted from said captured image using a priori knowledge of at least some physical attributes of said multiple first construction bricks, said physical attributes being selected from one or more of;

shapes, sizes, and colors of said multiple first construction bricks;

(C) representing said extracted image on a digital display as a digital representation of said physical real world object, said digital representation of said physical real world object including a digital representation of at least one of said multiple first construction bricks;

(D) embedding said digital representation of said physical real world object into said computer graphic representing part of a virtual world or video game; and

(E) on a screen, rendering of said computer graphic in said virtual world or video game, in response to user interaction with said virtual world or video game, manipulating said embedded digital representation of said physical real world object, as a whole, within said virtual world or video game and within parameters of said virtual world or video game.

10. The method as in claim 9, wherein said manipulating in (E) comprise changing a location of said digital representation of said physical real world object on said screen.

11. The method as in claim 9, wherein said embedding said digital representation of said physical real world object in (D) comprises embedding a representation of said at least one of said multiple first construction bricks, where a color of said representation of said at least one of said multiple first construction bricks corresponds to a color of a corresponding said at least one of said multiple first construction bricks in said captured image.

12. The method as in claim 9, comprising issuing an instruction to build said physical real world object from said multiple first construction bricks.

13. The method as in claim 9, wherein said representing said extracted image includes representing at least one of said multiple first construction bricks in said digital representation as having a first height dimension, and representing a second of said multiple first construction bricks in said digital representation as having a second height dimension.

14. The method of claim 9 further comprising:

(F)(1) said imager capturing a second captured image, said second captured image including a second physical real world object, said second physical real world object having been made with second construction bricks of said plurality of passive interlocking construction bricks;

(F)(2) extracting from said second captured image, as a second extracted image, an image of said second physical real world object, said second extracted image including an image of at least one of said second construction bricks, wherein said image of said second physical real world object is extracted from said second captured image using said a priori knowledge of said at least some physical attributes of said second construction bricks;

wherein said digital representation of said physical real world object embedded into said computer graphic in (D) includes a digital representation of said second physical real world object, and

wherein said manipulating in (E) manipulates said digital representation of said physical real world object in combination with said digital representation of said second physical real world object.

15. A method comprising:

(A) obtaining a first captured image, said first captured image including a first real world physical object, said first real world physical object being formed from first multiple construction bricks of a plurality of passive interlocking construction bricks;

(B) extracting from said first captured image, a first image of said first real world physical object, wherein said first image of said first real world physical object is extracted from said first captured image using a priori knowledge of at least some attributes of at least some of said first multiple construction bricks forming said first real world physical object, said attributes being selected from one or more of;

shapes, sizes, and colors of said first multiple construction bricks;

(C) obtaining a second captured image, said second captured image including a second real world physical object, said second real world physical object being formed from second multiple construction bricks of said plurality of passive interlocking construction bricks;

(D) extracting from said second captured image, a second image of said second real world physical object, wherein said second image of said second real world physical object is extracted from said second captured image using said a priori knowledge of at least some attributes of at least some of said second multiple construction bricks forming said second real world physical object;

(E) forming a combination digital representation of said first image in combination with said second image, said combination digital representation corresponding to said first real world physical object in combination with said second real world physical object; and

(F) embedding said combination digital representation into a computer graphic; and

(G) manipulating, on a screen and as a whole, said embedded combination digital representation of said first image in combination with said second image.

16. The method of claim 15 wherein said second image is scaled to fit with said first image.

17. The method of claim 15 wherein said computer graphic represents part of a virtual world or video game, and wherein said manipulating in (G) occurs on a screen rendering of said computer graphic in said virtual world or video game, in response to user interaction with said virtual world or video game.

18. The method of claim 17 wherein said manipulating in (G) is within parameters of said virtual world or video game.