SPATIALLY AWARE POINTER FOR MOBILE APPLIANCES

• US 20140267031A1
• Filed: 03/12/2013
• Published: 09/18/2014
• Est. Priority Date: 03/12/2013
• Status: Abandoned Application

• Current Assignee: Huebner, Kenneth J.
• Original Assignee: Huebner, Kenneth J.
• Inventors: Huebner, Kenneth J.
• Application Number:
  US13/796,728
• Publication Number:
  US 20140267031A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

A spatially aware pointer that can augment a pre-existing mobile appliance with remote control, hand gesture detection, and/or 3D spatial depth sensing abilities. In at least one embodiment, a spatially aware pointer can be operatively connected to the data port of a mobile appliance (e.g., mobile phone or tablet computer) to provide remote control, hand gesture detection, and 3D spatial depth sensing abilities to the mobile appliance. Such an enhancement may, for example, allow a user with a mobile appliance to make a 3D spatial model of at least a portion of an environment, or remotely control a TV set with hand gestures, or engage other mobile appliances to create interactive projected images.

Claims

1. A spatially aware pointer for use with a host appliance that is mobile and handheld, comprising:

a control unit disposed within a housing;

a data coupler disposed in association with the housing to enable communication between the pointer and the host appliance;

an indicator projector positioned in the housing and operatively coupled to the control unit, wherein the indicator projector illuminates a pointer indicator on an at least one remote surface; and

a viewing sensor positioned in the housing and operatively coupled to the control unit, wherein the viewing sensor captures one or more light views of the at least one remote surface.

2. The pointer of claim 1, wherein the indicator projector projects at least infrared light and the viewing sensor is sensitive to at least infrared light.

3. The pointer of claim 1, wherein the pointer indicator is comprised of data-encoded modulated light.

4. The pointer of claim 1, wherein the pointer indicator is comprised of a shape or pattern having a one-fold rotational symmetry.

5. The pointer of claim 1, wherein the viewing sensor captures one or more light views of an at least a portion of the pointer indicator, and wherein the pointer further comprises a depth analyzer that analyzes the one or more light views of the at least a portion of the pointer indicator and computes one or more surface distances to the at least one remote surface.

6. The pointer of claim 1, wherein the viewing sensor captures one or more light views of an at least a portion of the pointer indicator, and wherein the pointer further comprises a depth analyzer that analyzes the one or more light views of the at least a portion of the pointer indicator and computes one or more 3D depth maps of the at least one remote surface.

7. The pointer of claim 6, wherein the pointer further comprises a surface analyzer that analyzes the one or more 3D depth maps and constructs a 3D spatial model that represents the at least one remote surface.

8. The pointer of claim 7, wherein the pointer creates and transmits a data event comprising the 3D spatial model to the host appliance.

9. The pointer of claim 7, wherein the 3D spatial model is comprised of an at least one computer-aided design (CAD) data file, 3D model data file, and/or 3D computer graphic data file.

10. The pointer of claim 1 further comprising a gesture analyzer that detects and identifies a type of hand gesture from a user, wherein the pointer creates and transmits a data event comprising the type of hand gesture to the host appliance.

11. The pointer of claim 10, wherein the type of hand gesture includes a touch gesture that corresponds to a user touching the at least one remote surface.

12. The pointer of claim 1 further comprising an indicator analyzer operable to analyze the one or more light views to detect at least a portion of a second pointer indicator from a second spatially aware pointer and compute an indicator position of the second pointer indicator.

13. The pointer of claim 12, wherein the pointer is operable to create and transmit a data event comprising the indicator position of the second pointer indicator to the host appliance.

14. The pointer of claim 1, wherein the housing is configured to receive the preexisting host appliance.

15. A spatially aware pointer for use with a host appliance, comprising:

a housing separate from the host appliance;

a control unit disposed within the housing;

a data coupler positioned to communicate between the control unit of the pointer and the host appliance;

an indicator projector positioned in the housing and operatively coupled to the control unit to illuminate a pointer indicator on at least one remote surface; and

a viewing sensor positioned in the housing and operatively coupled to the control unit to capture one or more light views of the at least one remote surface,

wherein the control unit communicates a data event to the host appliance through the data coupler such that the host appliance operates based upon the data event from the pointer.

16. The pointer of claim 15, wherein the control unit generates the data event to the host appliance based upon the one or more light views from the viewing sensor.

17. The pointer of claim 15, wherein the host appliance includes at least a host image projector, wherein the host appliance operates the host image projector based upon the data event.

18. The pointer of claim 15, wherein the housing is configured to receive the preexisting host appliance.

19. The pointer of claim 15, wherein the indicator projector projects at least infrared light and the viewing sensor is sensitive to at least infrared light.

20. A method for utilizing a spatially aware pointer in association with a host appliance that is mobile and handheld, the method comprising:

establishing a communication link between the host appliance and the pointer through a data coupler, the pointer comprising;

a housing;

the data coupler disposed in association with the housing;

a control unit disposed within the housing;

an indicator projector operatively coupled to the control unit and operable to illuminate a pointer indicator on an at least one remote surface; and

a viewing sensor operatively coupled to the control unit and operable to capture one or more light views of the at least one remote surface;

generating a data event signal in the control unit based upon the one or more light views; and

controlling the operation of the host appliance based upon the data event signal from the pointer.

21. The method of claim 20, wherein the viewing sensor captures one or more light views of an at least a portion of the pointer indicator, and wherein the pointer further comprises a depth analyzer to analyze the one or more light views of the at least a portion of the pointer indicator and create one or more 3D depth maps of the at least one remote surface.

22. The method of claim 21, wherein the surface analyzer analyzes the one or more 3D depth maps and constructs a 3D spatial model that represents the at least one remote surface.

23. The method of claim 22, wherein the pointer creates and transmits the data event signal comprising the 3D spatial model to the host appliance.

24. The method of claim 20, wherein the viewing sensor captures one or more light views of an at least a portion of a second pointer indicator from a second spatially aware pointer, the pointer analyzes the one or more light views of the at least a portion of the second pointer indicator and computes an indicator position of the second pointer indicator.

25. The method of claim 22, wherein the pointer creates and transmits the data event signal comprised of the indicator position of the second pointer indicator to the host appliance.

26. The method of claim 20, wherein the housing receives the host appliance.