Presentation of a digital image of an object

• US 10,168,833 B2
• Filed: 09/03/2014
• Issued: 01/01/2019
• Est. Priority Date: 09/03/2014
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Short, David Bradley, Kang, Jinman, Lim, Ruth Ann
• Primary Examiner(s): Eurice, Michael J
• Application Number:
  US15/508,373
• Publication Number:
  US 20170308241A1
• Time in Patent Office: 1,581 Days
• CPC Class Codes: G01B 11/002 for measuring two or more coordinates
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

An example method is provided for. The method comprises receiving an image of an object on a surface, detecting features of the object, and presenting the image on the surface based on the features of the object. The features include location and dimensions, wherein dimensions of the image match the dimensions of the object and location of the image overlap with the location of the object on the surface.

Claims

1. A system, comprising:

a camera to capture a digital image of an object positioned in a location within a field of view of the camera;

a projector unit, communicatively coupled to the camera, to project the digital image in the location of the object, wherein a size of the digital image matches a size of the object;

a plurality of sensors; and

a calibration module to perform calibration between the plurality of sensors using a three-dimensional (3 D)-to-two-dimensional (2D) mapping that maps between 3D coordinates of a first sensor of the plurality of sensors and 2D coordinates of a second sensor of the plurality of sensors.

2. The system of claim 1, wherein the projector unit is calibrated with respect to the camera.

3. The system of claim 1, further comprising a computing device to cause the camera to scan the object to produce the digital image and then to cause the projector unit to project the digital image back on the object, wherein the digital image and the object overlap.

4. The system of claim 1, wherein the plurality of sensors comprise a depth detection sensor.

5. The system of claim 1, further comprising a touch sensitive mat, wherein the object is located on the touch sensitive mat, and the digital image is projected on the touch sensitive mat in the same location as the object.

6. The system of claim 1, wherein the camera is to capture the digital image of the object placed on a mat, and the plurality of sensors comprise a sensor to track movement of an input object moved across the mat, the input object comprising at least one from among a stylus and a user'"'"'s finger.

7. The system of claim 1, further comprising a computing device, wherein the projector unit comprises a base and a mounting member rotatably attached to the computing device.

8. The system of claim 1, further comprising an all-in-one computer communicatively coupled to the camera and the projector unit.

9. The system of claim 8, wherein the all-in-one computer comprises the calibration module, the calibration module to calibrate the projector unit with respect to the camera.

10. The system of claim 8, wherein the all-in-one computer stores mapping information relating to mappings between the camera and the projector unit in a common coordinate system.

11. The system of claim 10, wherein the calibration module is to calibrate the camera and the projector unit using the mapping information.

12. A method, comprising:

receiving, from a sensor of a plurality of sensors, an image of an object on a surface;

detecting features of the object, the features including a location and dimensions;

presenting the image on the surface based on the features of the object, wherein dimensions of the image match the dimensions of the object, and a location of the image overlaps with the location of the object on the surface; and

performing calibration between the plurality of sensors using a three-dimensional (3D)-to-two-dimensional (2D) mapping that maps between 3D coordinates of a first sensor of the plurality of sensors and 2D coordinates of a second sensor of the plurality of sensors.

13. The method of claim 12, wherein presenting the image on the surface based on the features of the object comprises instructing a projector to project the image on the surface based on the features of the object.

14. The method of claim 12, wherein presenting the image on the surface based on the features of the object comprises instructing a display unit to display the image of the object based on the features of the object, wherein the surface is the display screen of the display unit.

15. The method of claim 12, wherein receiving the image comprises receiving the image from a camera that captures the digital image of the object placed on a mat, and the plurality of sensors comprise a sensor to track movement of an input object moved across the mat, the input object comprising at least one from among a stylus and a user'"'"'s finger.

16. A non-transitory machine-readable storage medium comprising instructions executable by a processing resource of a computing system, the instructions executable to:

calibrate a camera with respect to a projector unit, the camera being part of a plurality of sensors;

receive an image of an object positioned in a location within a field of view of the camera;

provide the image to be presented in the location of the object, wherein size of the image is same as the object; and

perform a calibration between the plurality of sensors using a three-dimensional (3D)-to-two-dimensional (2D) mapping that maps between 3D coordinates of a first sensor of the plurality of sensors and 2D coordinates of a second sensor of the plurality of sensors.

17. The non-transitory machine-readable storage medium of claim 16, further comprising instructions executable to:

map coordinates of the camera to a common coordinate space; and

derive a mapping between coordinates in a coordinate space of a projector that provides the image and the common coordinate space based on the mapped coordinates and the coordinates in the coordinate space of the projector.