Projected display to enhance computer device use

• US 8,549,418 B2
• Filed: 12/23/2009
• Issued: 10/01/2013
• Est. Priority Date: 12/23/2009
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Lamarca, Anthony G., Philipose, Matthal, Harrison, Beverly L.
• Primary Examiner(s): SALOMON, PHENUEL S
• Application Number:
  US12/646,607
• Publication Number:
  US 20110154233A1
• Time in Patent Office: 1,378 Days
• Field of Search: 715/764, 715/863, 345/157, 353/28, 353/69
• US Class Current: 715/764
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Methods, apparatuses and systems to receive, via at least one sensor device, data related to an area around the at least one sensor device. A target area around the sensor device to project an interactive display space via a projector is determined based, at least in part, on the data received from the at least one sensor device. The target area will include a projected interactive display space wherein interactions and objects within the projected interactive display space are to be processed via a computing device operatively coupled to the at least one sensor device.

Claims

1. A system included in a mobile computing device and comprising:

a sensor device to capture a first image data of an area around the mobile computing device and a second image data of a projected interactive display space and an object within the projected interactive display space and not included in the first image data, wherein some user and object interactions within the projected interactive display space are not to be processed via the mobile computing device, and interactions with the object are not to be processed via the mobile computing device;

a projector to project the interactive display space; and

projector control logic, communicatively coupled to the sensor device and the projector, to;

analyze the first image data of the area around the mobile computing device to dynamically identify and select a projection surface around the mobile computing device for projecting the interactive display space, including eliminating one or more projection surfaces from being selected based on a context of the user;

determine a target area on the dynamically selected projection surface around the mobile computing device, wherein a size of the target area is determined based, at least in part, on the first image data of the area around the mobile computing device;

send control data to the projector to project the interactive display space onto the target area on the dynamically selected projection surface around the mobile computing device, wherein the interactive display space is to be projected in tandem with a display of the mobile computing device and is to include content different and related to a content of the display of the mobile computing device;

analyze the second image data of the projected interactive display space and the object not included in the first image data to determine surface properties of the target area of the dynamically selected projection surface and properties of the object; and

send control data to the projector to calibrate the projection of the interactive display space for projecting onto the target area and the object based on the surface properties of the target area of the dynamically selected projection surface and properties of the object not included in the first image data.

2. The system of claim 1, further comprising:

interaction processing logic to process interactions in the projected interactive display space.

3. The system of claim 2, wherein processing of the interactions within the projected interactive display space comprises at least one of hand gesture recognition processing, object recognition processing, or processing to recognize manipulations being performed on an object.

4. The system of claim 3, wherein hand gesture recognition processing includes hand gestures being performed in relation to particular projected graphical interface components of the interactive display space.

5. The system of claim 2, the sensor device to further capture at least one of audio or video data of an area around the system, and the interaction processing logic to further:

retrieve activity data of a user of the system;

determine an environmental context of an execution of an application utilizing the interactive display space based, at least in part, on the user activity data and the audio or video data of the area around the system, the context to include at least one of;

an identity of an environment of the user of the system, and

an identity of the user activity; and

alter the execution of the application based, at least in part, on the environmental context of the execution of the application.

6. The system of claim 1, wherein the target area on the dynamically selected projection surface around the sensor device is projected for a first user of the system, the projector control logic to further:

determine a second target area from the first image data to project a second interactive display space for a second user of the system, wherein the second interactive display space comprises less content than the interactive display space; and

send control data to the projector to project the second interactive display space onto the second target area.

7. The system of claim 6, wherein the second interactive display space is not projected in tandem with the display of the mobile computing device.

8. An article of manufacture comprising a computer-readable storage medium having instructions stored thereon to cause a processor to perform operations including:

analyzing a first image data received from a sensor device included in a mobile computing device of an area around the mobile computing device to dynamically identify and select a projection surface included in the first image data of the area around the mobile computing device for projecting an interactive display space, including eliminating one or more projection surfaces from being selected based on a context of the user;

determining a target area on the dynamically selected projection surface around the mobile computing device to project the interactive display space via a projector included in the mobile computing device, wherein a size of the target area is determined based, at least in part, on the first image data of the area around the mobile computing device;

sending control data to the projector to project the interactive display space onto the target area on the dynamically selected projection surface around the mobile computing device, wherein the interactive display space is to be projected in tandem with a display of the mobile computing device and is to include content different and related to a content of the display of the mobile computing device;

processing some user and object interactions within the projected interactive display space;

analyzing a second image data received from the sensor device of the projected interactive display space projected on the target area of the dynamically selected projection surface and an object within the target area and not included in the first image data to determine surface properties of the target area of the dynamically selected projection surface and properties of the object not included in the first image data, wherein interactions with the object within the projected interactive display space are not to be processed; and

sending control data to the projector to calibrate the projection of the interactive display space for projecting onto the target area and the object based on the surface properties of the target area of the dynamically selected projection surface and properties of the object not included in the first image data.

9. The article of manufacture of claim 8, wherein processing user or object interactions within the projected interactive display space includes at least one of hand gesture recognition processing, object recognition processing, or processing to recognize manipulations being performed on an object.

10. The article of manufacture of claim 8, wherein the data received from the sensor device includes audio data, and the processor to further perform operations including:

determining the context of a user of the mobile computing device based, at least in part, on the audio data.

11. The article of manufacture of claim 8, the processor to further perform operations including:

receiving accelerometer data from the sensor device; and

detecting user interactions with the interactive display space from the accelerometer data.

12. The article of manufacture of claim 8, the processor to further perform operations including:

sending control data to the projector to project the interactive display space in tandem with a display of the mobile computing device and to include content different and related to a content of the display of the mobile computing device.

13. A method comprising:

receiving, via a sensor device included in a mobile computing device, a first image data of an area around the mobile computing device;

analyzing the first image data to dynamically identify and select a projection surface included in the first image data of the area around the mobile computing device for projecting an interactive display space, including eliminating one or more projection surfaces from being selected based on a context of the user;

determining a target area on the dynamically selected projection surface around the mobile computing device to project the interactive display space via a projector included in the mobile computing device, wherein a size of the target area is determined based, at least in part, on the first image data of the area around the mobile computing device;

projecting the interactive display space onto the target area on the dynamically selected projection surface around the mobile computing device, wherein some user and object interactions within the projected interactive display space are to be processed via the mobile computing device, and wherein the interactive display space is projected in tandem with a display of the mobile computing device and includes content different and related to a content of the display of the mobile computing device;

receiving, via the sensor device, a second image data of the projected interactive display space projected on the target area of the dynamically selected projection surface and an object within the target area and not included in the first image data, wherein interactions with the object within the projected interactive display space are not to be processed via the mobile computing device;

analyzing the second image data of the projected interactive display space and the object not included in the first image data to determine surface properties of the target area of the dynamically selected projection surface and properties of the object; and

calibrating the projection of the interactive display space for projecting onto the target area and the object based on the surface properties of the target area of the dynamically selected projection surface and the properties of the object not included in the first image data.

14. The method of claim 13, further comprising:

receiving audio data from the sensor device; and

determining the context of a user of the mobile computing device based, at least in part, on the audio data.