MOBILE DEVICE AND RELATED CONTROL METHOD FOR EXTERNAL OUTPUT DEPENDING ON USER INTERACTION BASED ON IMAGE SENSING MODULE

• US 20110154249A1
• Filed: 12/21/2010
• Published: 06/23/2011
• Est. Priority Date: 12/21/2009
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: JANG, Si Hak, KIM, Hee Woon
• Application Number:
  US12/974,320
• Publication Number:
  US 20110154249A1
• Time in Patent Office: Days
• US Class Current: 715/781
• CPC Class Codes: G06F 1/1639 the display being based on projection
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/03542 Light pens for emitting or receiving light
• CPC Class Codes: H04M 1/0272 for a projector or beamer module assembly constructional features of projectors per se G03B21/00; constructional details of projectors using electronic spatial light modulators per se H04N9/31

Abstract

A mobile device for supporting an external output function has a projector module and at least one image sensing module. The mobile device activates the image sensing module when entering into an external output mode, and outputs screen data externally in the external output mode. The mobile device detects a user interaction based on the image sensing module in the external output mode, and controls the external output of the screen data, according to the user interaction. An image of the screen data outputted externally may be acquired using the image sensing module and, based on the acquired image, new content may be created.

Claims

1. A method for controlling an external output of a mobile device, the method comprising:

activating an image sensing module when entering into an external output mode;

outputting screen data externally in the external output mode;

detecting a user interaction based on the image sensing module in the external output mode; and

controlling the external output of the screen data according to the user interaction.

2. The method of claim 1, wherein the detecting of the user interaction comprises:

detecting at least one of a first interaction occurring between the mobile device and an external screen on which the screen data is displayed, and a second interaction occurring around the mobile device.

3. The method of claim 2, wherein the controlling of the external output comprises:

identifying specific content for the external output and a particular function corresponding to the first interaction;

updating the screen data according to the particular function; and

outputting externally the updated screen data.

4. The method of claim 3, further comprising:

acquiring an image of the updated screen data after outputting the updated screen data externally; and

creating and storing new content based on the acquired image.

5. The method of claim 4, wherein the new content includes a combination of the updated screen data and an object produced on the updated screen data by the user interaction.

6. The method of claim 2, wherein the controlling of the user interaction comprises:

identifying specific content for the external output and a particular function corresponding to the second interaction;

updating the screen data according to the particular function; and

outputting externally the updated screen data.

7. The method of claim 2, wherein the detecting of the first interaction comprises:

detecting at least one of a user gesture that is made within a recognizable range of the image sensing module detecting the first interaction, the formation of a distinguishably shaped or colored point by means of a pointing tool or a laser pointer on the screen data projected onto the external screen, and the formation of a particular sign by means of a marker on the screen data projected onto the external screen.

8. The method of claim 2, wherein the detecting of the second interaction comprises:

detecting a predefined user gesture that is made within a recognizable range of the image sensing module detecting the second interaction.

9. The method of claim 2, wherein the detecting of the user interaction comprises:

detecting the first interaction by a first image sensing module and the second interaction by a second image sensing module.

10. A mobile device comprising:

a projector module for outputting screen data to an external screen;

a memory unit for storing setting information related to a control of an external output function;

at least one image sensing module for detecting a user interaction in an external output mode based on the projector module; and

a control unit for receiving the user interaction from the image sensing module and, according to the received user interaction, for controlling an external output of the screen data.

11. The mobile device of claim 10, wherein the control unit updates the screen data in response to at least one of a first interaction and a second interaction and outputs the updated screen data to the external screen, the first interaction occurring between the mobile device and the external screen on which the screen data is displayed, and the second interaction occurring around the mobile device.

12. The mobile device of claim 11, wherein the image sensing module includes:

a first image sensing module for detecting the first interaction; and

a second image sensing module for detecting the second interaction.

13. The mobile device of claim 12, wherein the control unit updates the screen data according to a particular function mapped to the first interaction when receiving the first interaction, and outputs the updated screen data to the external screen.

14. The mobile device of claim 13, wherein the control unit enables the first image sensing module to acquire an image of the updated screen data after outputted externally, and creates and stores new content based on the acquired image.

15. The mobile device of claim 14, wherein the new content comprises a combination of the updated screen data and an object produced on the updated screen data by the user interaction.

16. The mobile device of claim 12, wherein the control unit updates the screen data according to a particular function mapped to the second interaction when receiving the second interaction, and controls the output of the updated screen data to the external screen.

17. The mobile device of claim 12, wherein the first image sensing module detects at least one of a user gesture that is made within a recognizable range of the image sensing module detecting the first interaction, the formation of a distinguishably shaped or colored point via a pointing tool or a laser pointer on the screen data projected onto the external screen, and the formation of a particular sign via a marker on the screen data projected onto the external screen, and produces the first interaction.

18. The mobile device of claim 12, wherein the second image sensing module detects a predefined user gesture that is made within a recognizable range of the image sensing module detecting the second interaction, and produces the second interaction.

19. The mobile device of claim 12, wherein the control unit produces the updated screen data according to the first interaction by a first image sensing module and the second interaction by a second image sensing module, and outputs the updated screen data to the external screen.

20. A method of controlling an external output of a mobile device, the method comprising:

projecting an image from the mobile device to an external object while operating in an external output mode;

detecting a user interaction while operating in the external output mode; and

controlling the projection of the image according to the detected user interaction,

wherein the user interaction is one of a first user interaction occurring between the mobile device and the external object and a second user interaction occurring around the mobile device but not necessarily between the mobile device and the external object.