Portable device and method for controlling the same

• US 9,046,918 B2
• Filed: 11/19/2013
• Issued: 06/02/2015
• Est. Priority Date: 02/06/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Yongsin, Kim, Jihwan, Kim, Jihyun
• Primary Examiner(s): HARRIS, DOROTHY H
• Application Number:
  US14/084,345
• Publication Number:
  US 20140071047A1
• Time in Patent Office: 560 Days
• Field of Search: 345/156
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1652 the display being flexible, e.g. mimicking a sheet of paper, or rollable
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04102 Flexible digitiser, i.e. constructional details for allowing the whole digitising part of a device to be flexed or rolled like a sheet of paper
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04M 1/0268 including a flexible display panel
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion

Abstract

A method for controlling a portable device is provided. The method includes detecting bending of the portable device and determining whether to perform motion sensing correction due to the bending; acquiring a motion sensing correction factor for performing the motion sensing correction due to the bending; performing motion sensing correction of at least one motion sensor using the motion sensing correction factor; and controlling the portable device according to the corrected motion sensing.

Claims

1. A method for controlling a portable device, the method comprising:

detecting a first direction of the portable device using a motion sensor and a camera;

displaying an augmented reality image based on the first direction detected by a motion sensor of the portable device;

detecting bending of the portable device, wherein the bending of the portable device affects motion sensing of the motion sensor and a second direction of the portable device is detected by the motion sensor due to the bending;

when the first direction detected by the camera of the portable device is maintained, maintaining the augmented reality image based on the first direction of the portable device; and

when the first direction detected by the camera of the portable device is changed to the second direction, displaying the augmented reality image based on the second direction of the portable device.

2. The method according to claim 1, wherein when the first direction detected by the motion sensor is changed to the second direction and the first direction detected by the camera of the portable device is maintained, the portable device determines that the motion sensing correction is necessary.

3. The method according to claim 1, wherein when the first direction detected by the motion sensor and the camera is changed to the second direction, the portable device determines that a motion sensing correction is not necessary.

4. The method according to claim 1, wherein maintaining the augmented reality image based on the first direction includes acquiring a motion sensing correction factor for performing a motion sensing correction due to the bending of the portable device.

5. The method according to claim 4, wherein maintaining the augmented reality image based on the first direction further includes performing the motion sensing correction of the motion sensor using the motion sensing correction factor.

6. The method according to claim 5, wherein the performing the motion sensing correction of the motion sensor includes:

resetting a sensing reference of the motion sensor using the motion sensing correction factor; and

performing the motion sensing according to the reset sensing reference.

7. The method according to claim 5, wherein maintaining the augmented reality image based on the first direction further includes carrying out an operation in the bent portable device according to the corrected motion sensing of the motion sensor.

8. The method according to claim 1, wherein displaying the augmented reality image based on the second direction includes carrying out an operation in the bent portable device according to uncorrected motion sensing of the motion sensor.

9. The method according to claim 1, wherein the augmented reality image is displayed based on only a direction which is detected by the motion sensor before the bending of the portable device is detected, and the augmented reality image is displayed based on both directions which are detected by the motion sensor and the camera respectively after the bending of the portable device is detected.

10. A portable device comprising:

a motion sensor and a camera each configured to detect a direction of the portable device;

a display unit configured to display an augmented reality image;

a bending sensor configured to detect bending of the portable device; and

a controller configured to control the motion sensor, the display unit and the bending sensor,

wherein the controller is further configured to;

detect a first direction of the portable device through the motion sensor and the camera,

display an augmented reality image based on the first direction detected through the motion sensor of the portable device,

detect bending of the portable device, wherein the bending of the portable device affects motion sensing of the motion sensor and a second direction of the portable device is detected by the motion sensor due to the bending,

when the first direction detected by the camera of the portable device is maintained, maintain the augmented reality image based on the first direction of the portable device, and

when the first direction detected by the camera of the portable device is changed to the second direction, display the augmented reality image based on the second direction of the portable device.

11. The portable device according to claim 10, wherein when the first direction detected by the motion sensor is changed to the second direction and the first direction detected by the camera of the portable device is maintained, the portable device determines that a motion sensing correction is necessary.

12. The portable device according to claim 10, wherein when the first direction detected by the motion sensor and the camera is changed to the second direction, the portable device determines that a motion sensing correction is not necessary.

13. The portable device according to claim 10, wherein maintaining the augmented reality image based on the first direction includes acquiring a motion sensing correction factor for performing a motion sensing correction due to the bending of the portable device.

14. The portable device according to claim 13, wherein maintaining the augmented reality image based on the first direction further includes performing the motion sensing correction of the motion sensor using the motion sensing correction factor.

15. The portable device according to claim 14, wherein the performing the motion sensing correction of the motion sensor includes:

resetting a sensing reference of the motion sensor using the motion sensing correction factor; and

performing the motion sensing according to the reset sensing reference.

16. The portable device according to claim 14, wherein maintaining the augmented reality image based on the first direction further includes carrying out an operation in the bent portable device according to the corrected motion sensing of the motion sensor.

17. The portable device according to claim 10, wherein displaying the augmented reality image based on the second direction includes carrying out an operation in the bent portable device according to uncorrected motion sensing of the motion sensor.

18. The portable device according to claim 10, wherein the augmented reality image is displayed based on only a direction which is detected by the motion sensor before the bending of the portable device is detected, and the augmented reality image is displayed based on both directions which are detected by the motion sensor and the camera respectively after the bending of the portable device is detected.