Manipulating And Displaying An Image On A Wearable Computing System

• US 20130021374A1
• Filed: 11/08/2011
• Published: 01/24/2013
• Est. Priority Date: 07/20/2011
• Status: Abandoned Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Miao, Xiaoyu, Heinrich, Mitchell Joseph
• Application Number:
  US13/291,416
• Publication Number:
  US 20130021374A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

Example methods and systems for manipulating and displaying a real-time image and/or photograph on a wearable computing system are disclosed. A wearable computing system may provide a view of a real-world environment of the wearable computing system. The wearable computing system may image at least a portion of the view of the real-world environment in real-time to obtain a real-time image. The wearable computing system may receive at least one input command that is associated with a desired manipulation of the real-time image. The at least one input command may be a hand gesture. Then, based on the at least one received input command, the wearable computing system may manipulate the real-time image in accordance with the desired manipulation. After manipulating the real-time image, the wearable computing system may display the manipulated real-time image in a display of the wearable computing system.

Claims

1. A method comprising:

a wearable computing system providing a view of a real-world environment of the wearable computing system;

imaging at least a portion of the view of the real-world environment in real-time to obtain a real-time image;

the wearable computing system receiving at least one input command that is associated with a desired manipulation of the real-time image, wherein the at least one input command comprises an input command that identifies a portion of the real-time image to be manipulated, wherein the input command that identifies the portion of the real-time image to be manipulated comprises a hand gesture detected in a region of the real-world environment, wherein the region corresponds to the portion of the real-time image to be manipulated;

based on the at least one received input command, the wearable computing system manipulating the real-time image in accordance with the desired manipulation; and

the wearable computing system displaying the manipulated real-time image in a display of the wearable computing system.

2. The method of claim 1, wherein the hand gesture further identifies the desired manipulation.

3. The method of claim 1, wherein the hand gesture forms a border.

4. The method of claim 3, wherein the border surrounds an area in the real-world environment, and wherein the portion of the real-time image to be manipulated corresponds to the surrounded area.

5. The method of claim 4, wherein a shape of the hand gesture identifies the desired manipulation.

6. The method of claim 3, wherein the border is selected from the group consisting of a substantially circular border and a substantially rectangular border.

7. The method of claim 1, wherein the hand gesture comprises a pinch-zoom hand gesture.

8. The method of claim 1, wherein the desired manipulation is selected from the group consisting of zooming in on at least a portion of the real-time image, panning through at least a portion of the real-time image, rotating at least a portion of the real-time image, and editing at least a portion of the real-time image.

9. The method of claim 1, wherein the desired manipulation is panning through at least a portion of the real-time image, and wherein the hand gesture comprises a sweeping hand motion, wherein the sweeping hand motion identifies a direction of the desired panning.

10. The method of claim 1, wherein the desired manipulation is rotating a given portion of the real-time image, and wherein the hand gesture comprises (i) forming a border around an area in the real-world environment, wherein the given portion of the real-time image to be manipulated corresponds to the surrounded area and (ii) rotating the formed border in a direction of the desired rotation.

11. The method of claim 1, wherein the wearable computing system receiving at least one input command that is associated with a desired manipulation of the real-time image comprises:

a hand-gesture detection system receiving data corresponding to the hand gesture;

the hand-gesture detection system analyzing the received data to determine the hand gesture.

12. The method of claim 11, wherein the hand-gesture detection system comprises a laser diode system configured to detect the hand gestures.

13. The method of claim 11, wherein the hand-gesture detection system comprises a camera selected from the group consisting of a video camera and an infrared camera.

14. The method of claim 1, wherein the at least one input command further comprises a voice command, wherein the voice command identifies the desired manipulation of the real-time image.

15. The method of claim 1, wherein imaging at least a portion of the view of the real-world environment in real-time to obtain a real-time image comprises a video camera operating in viewfinder mode to obtain a real-time image.

16. The method of claim 1, wherein displaying the manipulated real-time image in a display of the wearable computing system comprises overlaying the manipulated real-time image over the view of a real-world environment of the wearable computing system.

17. A non-transitory computer readable medium having instructions stored thereon that, in response to execution by a processor, cause the processor to perform operations, the instructions comprising:

instructions for providing a view of a real-world environment of a wearable computing system;

instructions for imaging at least a portion of the view of the real-world environment in real-time to obtain a real-time image;

instructions for receiving at least one input command that is associated with a desired manipulation of the real-time image, wherein the at least one input command comprises an input command that identifies a portion of the real-time image to be manipulated, wherein the input command that identifies the portion of the real-time image to be manipulated comprises a hand gesture detected in a region of the real-world environment, wherein the region corresponds to the portion of the real-time image to be manipulated;

instructions for, based on the at least one received input command, manipulating the real-time image in accordance with the desired manipulation; and

instructions for displaying the manipulated real-time image in a display of the wearable computing system.

18. A wearable computing system comprising:

a head-mounted display, wherein the head-mounted display is configured to provide a view of a real-world environment of the wearable computing system, wherein providing the view of the real-world environment comprises displaying computer-generated information and allowing visual perception of the real-world environment;

an imaging system, wherein the imaging system is configured to image at least a portion of the view of the real-world environment in real-time to obtain a real-time image;

a controller, wherein the controller is configured to (i) receive at least one input command that is associated with a desired manipulation of the real-time image and (ii) based on the at least one received input command, manipulate the real-time image in accordance with the desired manipulation, wherein the at least one input command comprises an input command that identifies a portion of the real-time image to be manipulated, wherein the input command that identifies the portion of the real-time image to be manipulated comprises a hand gesture detected in a region of the real-world environment, wherein the region corresponds to the portion of the real-time image to be manipulated; and

a display system, wherein the display system is configured to display the manipulated real-time image in a display of the wearable computing system.

19. The wearable computing system of claim 18, further comprising a hand-gesture detection system, wherein the hand-gesture detection system is configured to detect the hand gestures.

20. The wearable computing system of claim 19, wherein the hand detection system comprises a laser diode.