Virtualization of tangible interface objects

• US 9,939,961 B1
• Filed: 12/19/2016
• Issued: 04/10/2018
• Est. Priority Date: 10/15/2012
• Status: Active Grant

• Current Assignee: Tangible Play, Inc. (Think & Learn Pvt Ltd.)
• Original Assignee: Tangible Play, Inc. (Think & Learn Pvt Ltd.)
• Inventors: Sharma, Pramod Kumar, Scholler, Jerome
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US15/384,075
• Time in Patent Office: 477 Days
• CPC Class Codes: G06F 1/1632 External expansion units, e.g. docking stations
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming

Abstract

An example system includes a computing device located proximate to a physical activity surface, a video capture device, and a detector. The video capture device is coupled for communication with the computing device and is adapted to capture a video stream that includes an activity scene of the physical activity surface and one or more interface objects physically intractable with by a user. The detector processes the video stream to detect the one or more interface objects included in the activity scene, to identify the one or more interface objects that are detectable, to generate one or more events describing the one or more interface objects, and to provide the one or more events to an activity application configured to render virtual information on the one or more computing devices based on the one or more events.

Claims

1. A platform for virtualization a physical environment comprising:

a stand including a first slot in a top side of the stand that receives a first edge of a computing device and braces the computing device in an angled position, the stand further comprises;

a base protruding from a back edge of the stand, the base supporting the stand as the computing device rests in the angled position; and

a channel that intersects with a front edge of the first slot, the channel shaped to receive a camera adapter; and

the camera adapter including a second slot and an optical element, the second slot receives a second edge of the computing device, the second edge located opposite the first edge of the computing device.

2. The platform of claim 1, wherein the optical element rests at an angle within the camera adapter to redirect a field of view of a video capture device coupled to the computing device.

3. The platform of claim 2, wherein the optical element includes a mirror that redirects the field of view of the video capture device towards an activity surface.

4. The platform of claim 2, wherein the camera adapter covers the field of view of at least a portion of the video capture device.

5. The platform of claim 1, wherein the camera adapter includes a first opposing side that extends beyond a first side of the optical element and a second opposing side that extends beyond a second side opposite the first side of the optical element, the first opposing side and the second opposing side rest along a front of the computing device to hold the camera adapter in place when the second slot receives the second edge of the computing device.

6. The platform of claim 1, further comprising:

a board integrated with a front edge of the stand.

7. The platform of claim 1, wherein the first slot extends partially downward into the stand at an angle.

8. A platform for virtualizing a physical environment comprising:

a stand including a channel and a first slot, the first slot receives a first edge of a computing device and allows the computing device to rest in an angled position against a side of the first slot, the channel intersecting perpendicularly with a front edge of the first slot; and

an adapter including a second slot and an optical element, the second slot receives a second edge of the computing device so as to cover a field of view of at least a portion of a camera of the computing device, the second edge opposite the first edge of the computing device, the adapter being secured within the channel of the stand when not in use.

9. The platform of claim 8, wherein the adapter has a tapered shape to rest flush within the channel of the stand when not in use.

10. The platform of claim 8, wherein the adapter is secured within the channel by magnetically coupling the adapter within the channel of the stand.

11. The platform of claim 8, further comprising:

a board coupled with a front edge of the stand.

12. The platform of claim 8, wherein the optical element directs the field of view of the camera of the computing device toward an activity surface.

13. The platform of claim 12, wherein the optical element includes a mirror that reflects the field of view of the camera.

14. A platform for virtualizing a physical environment comprising:

a stand including a first slot that receives a first edge of a computing device and allows the computing device to rest in an angled position against a side of the first slot; and

an adapter including a second slot and an optical element, the second slot receives a second edge of the computing device, the second edge located opposite the first edge of the computing device.

15. The platform of claim 14, wherein the optical element redirects a field of view of a video capture device of the computing device.

16. The platform of claim 15, wherein the optical element includes a mirror that redirects the field of view of the video capture device towards an activity surface.

17. The platform of claim 14, further comprising:

a board integrated with the stand.

18. The platform of claim 14, wherein the stand includes a channel that intersects with a front edge of the first slot, the channel shaped to receive the adapter when not in use.

19. The platform of claim 14, wherein the adapter further comprises:

extendable sides positioned adjacent to opposite sides of the optical element, the extendable sides forming a front side of the second slot and bracing against a front side of the computing device when the second slot receives the second edge of the computing device.

20. The platform of claim 14, wherein the angled position is an angled back position.