Infrared reflective device interactive projection effect system

• US 9,993,733 B2
• Filed: 07/09/2014
• Issued: 06/12/2018
• Est. Priority Date: 07/09/2014
• Status: Active Grant

• Current Assignee: LUMO Interactive Incorporated
• Original Assignee: LUMO Interactive Incorporated
• Inventors: Athavale, Meghan Jennifer, Iverach-Brereton, Chris, Wachs, Curtis
• Primary Examiner(s): McClellan, James S
• Assistant Examiner(s): Carter, Kevin
• Application Number:
  US14/327,404
• Publication Number:
  US 20160008718A1
• Time in Patent Office: 1,434 Days
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition

Abstract

Some embodiments herein include systems, methods, and software for IR object identification and motion detection. Consumers may project an interactive projection surface on the wall or floor of any room, and when IR object motion is detected, the interactive projection may update in response to the motion. A newly introduced IR object may be identified, and an effect specific to the IR object may be projected into the IR object.

Claims

1. A method of providing a virtual environment, the method comprising:

detecting a first ambient infra-red (IR) light level;

projecting a first IR light pattern onto an upper side of a target surface and onto an IR object positioned above the upper side of the target surface, the first IR light pattern having an associated first intensity level selected according to the detected first ambient IR light level;

capturing a first IR image, the first IR image including the IR object and at least a portion of the upper side of the target surface; and

identifying the IR object and identifying an IR object location within the first IR image;

generating an animated graphical effect based on the IR object identification and the IR object location; and

projecting the animated graphical effect onto the upper side of the target surface.

2. The method of claim 1, the method further including:

detecting a second ambient IR light level;

comparing the detected second ambient IR light level with the detected first ambient IR light level, the second ambient IR light level being different from the first ambient IR light level; and

projecting a second IR light pattern onto the IR object, the second IR light pattern having an associated second intensity level selected according to the comparing of the first and second detected ambient IR light levels.

3. The method of claim 1, the method further including:

identifying a non-IR object and non-IR object location within the captured first IR image;

wherein generating the animated graphical effect is further based on identifying the non-IR object and the non-IR object location; and

wherein projecting the animated graphical effect onto the upper side of the target surface includes projecting the animated graphical effect onto the non-IR object to interact with the non-IR object.

4. The method of claim 1, the method further including:

capturing a second IR image, the second IR image being different from the first IR image;

comparing the first IR image to the second IR image, the comparison identifying an IR object motion and an updated location of the IR object;

generating a second animated graphical effect in response to the comparison; and

projecting the second animated graphical effect onto the upper side of the target surface, the second animated graphical effect providing a displayed motion effect adjacent to the IR object to interact with the IR object.

5. A method of providing a virtual environment, the method comprising:

capturing a first IR image and a second IR image of an upper side of a target surface, the first IR image being different from the second IR image;

comparing the first IR image to the second IR image, the comparison identifying movement of a persistent IR object present in both images and introduction of an introduced IR object in the second image;

generating an animated graphical effect in response to the comparison; and

projecting the animated graphical effect onto the upper side of the target surface, the animated graphical effect providing a displayed motion effect adjacent to the IR object.

6. The method of claim 5, further including projecting an IR light onto the upper side of the target surface and onto the IR object.

7. The method of claim 6, wherein projecting the IR light onto the IR object includes projecting an IR pattern.

8. The method of claim 6, further including detecting an IR object signature reflected by the IR object.

9. The method of claim 5, further including detecting an IR object signature generated by the IR object.

10. The method of claim 5, wherein identifying the IR image of an IR object includes identifying a motion of the IR object.

11. The method of claim 10, wherein updating the animated graphical effect includes updating a location of a virtual object within the animated graphical effect in response to the motion of the IR object.

12. The method of claim 10, further including predicting a future motion of the IR object.

13. The method of claim 5, wherein:

updating the animated graphical effect includes adding an object-specific graphical component in response to identifying the IR image of the IR object; and

projecting the animated graphical effect onto the upper side of the target surface includes projecting the object-specific graphical component onto the IR object.

14. The method of claim 13, wherein projecting the object-specific graphical component onto the IR object includes adding an appearance of an object to the the IR object.

15. An infrared reflective device interactive projection effect system, the system comprising:

an ambient IR light level detector;

an IR pattern projector configured to vary a projected IR pattern according to an ambient IR light level detected by the ambient IR light level detector;

an IR image sensor configured to capture a first IR image, the first IR image including a IR object positioned above an upper side of a target surface and including at least a portion of the upper side of the target surface;

a processor configured to;

identify the IR object and an IR object location within the first IR image; and

generate a first animated graphical effect based on identifying the IR object and the IR object location; and

a visible light projector configured to project the first animated graphical effect onto the upper side of the target surface in response to the captured first IR image.

16. The system of claim 15, wherein the visible light projector changes the appearance of the IR object by projecting the first animated graphical effect onto the IR object.

17. The system of claim 15, the processor further configured to:

identify a non-IR object and non-IR object location within the first IR image; and

generate the first animated graphical effect based on identifying the non-IR object and the non-IR object location.

18. The system of claim 17, wherein:

the IR image sensor is further configured to capture a second IR image, the second IR image being different from the first IR image, the second IR image including the IR object and at least a portion of the upper side of the target surface;

the processor is further configured to;

compare the first IR image to the second IR image, the comparison identifying an IR object motion and an updated location of the IR object; and

generate a second animated graphical effect in response to the comparison; and

the visible light projector is further configured to project the second animated graphical effect onto the upper side of the target surface, the second animated graphical effect providing a displayed motion effect adjacent to the IR object to interact with the IR object.

19. The system of claim 18, wherein:

the second animated graphical effect includes a projected object in a first projected object location;

the second animated graphical effect includes a projected object in a second projected object location, the second projected object location being different from the first projected object location; and

the visible light projector is configured to project the second animated graphical effect after projecting the first animated graphical effect to provide an appearance of motion of the projected object.

20. The system of claim 18, wherein the processor is further configured to:

identify, using the updated location of the IR object, a predicted motion of the IR object; and

generate a third animated graphical effect in response to identifying the predicted motion; and

cause the visible light projector to project the third animated graphical effect.