Information processing method, system and electronic device

• US 9,396,386 B2
• Filed: 09/29/2014
• Issued: 07/19/2016
• Est. Priority Date: 02/18/2014
• Status: Active Grant

• Current Assignee: Lenovo (Beijing) Limited (Lenovo Group Ltd.), Lenovo Company Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo (Beijing) Limited (Lenovo Group Ltd.), Lenovo Company Limited (Lenovo Group Ltd.)
• Inventors: Feng, Xiaoyi
• Primary Examiner(s): Cunningham, Gregory F
• Application Number:
  US14/499,635
• Publication Number:
  US 20150235078A1
• Time in Patent Office: 659 Days
• Field of Search: 382/103
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06V 20/00 Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: G06V 40/107 Static hand or arm

Abstract

An information processing method, system and an electronic device are provided according to the embodiments of the disclosure, and applied to an electronic device having at least a first panel, with a first surface of the first panel being provided with a display unit and at least one image acquisition apparatus, where the at least one image acquisition apparatus is positioned below the display unit in the case that the first panel stands on a plane. After an image for a to-be-recognized object and the plane is acquired by the image acquisition apparatus, whether the object contacts the plane is determined based on the acquired image, and information about position change on the object is detected in the case that it is determined that the object contacts the plane.

Claims

1. An information processing method for an electronic device, the electronic device including an image acquisition apparatus and a processor, the information processing method comprising:

acquiring, by the image acquisition apparatus, an image for an object and a plane on which the electronic device stands;

determining, by the processor, whether the object contacts the plane based on the acquired image;

detecting, by the processor, position-changed information of the object in response to the object contacting the plane; and

in response to the object separating from the plane, discontinuing the detecting the position-changed information of the object.

2. The method according to claim 1, wherein the method further comprises, before acquiring the image for the object and the plane:

obtaining, by the processor, an angle between a first panel and a second panel of the electronic device; and

turning on, by the processor, the image acquisition apparatus of the electronic device in response to the angle between the first panel and the second panel being greater than a preset threshold.

3. The method according to claim 1, wherein determining, by the processor, whether the object contacts the plane comprises:

obtaining, by the processor, edge data of the object and edge data of the plane; and

determining, by the processor, that the object contacts the plane in response to detecting an intersection between the edge data of the object and the edge data of the plane.

4. The method according to claim 3, wherein detecting, by the processor, the position-changed information of the object comprises:

detecting, by the processor, a position of the object in the image frame-by-frame; and

determining, by the processor, that the position of the object changes in response to detecting that the position of the object in the image changes from one frame to another.

5. The method according to claim 1, wherein determining, by the processor, whether the object contacts the plane based on the acquired image comprises:

synthesizing, by the processor, images acquired at the same time by at least two image acquisition apparatuses of the electronic device into a frame of depth image that carries coordinates of the object and coordinates of points in the plane, wherein the at least two image acquisition apparatuses includes the image acquisition apparatus; and

determining, by the processor, whether the object contacts the plane based on the coordinates of the object and the coordinates of the points in the plane.

6. The method according to claim 5, wherein detecting, by the processor, the position-changed information of the object comprises:

obtaining, by the processor, a first group of coordinates of the object and a second group of coordinates of the object that are respectively carried in two adjacent frames of depth images; and

determining, by the processor, that the position of the object changes in response to detecting that the first group of coordinates and the second group of coordinates are different.

7. An information processing system applied to an electronic device including a first panel, wherein a first surface of the first panel is provided with an image acquisition apparatus, wherein the image acquisition apparatus acquires an image for an object and a plane, and wherein the system comprises a processor that is configured to:

determine whether the object contacts the plane based on the image acquired by the image acquisition apparatus;

detect position-changed information of the object in response to the object contacting the plane; and

in response to the object separating from the plane, stop detection of the position-changed information of the object.

8. The system according to claim 7, wherein the electronic device has the first panel and a second panel, wherein the first panel and the second panel are movably connected through a rotating shaft, and wherein the processor is further configured to:

obtain an angle between the first panel and the second panel; and

turn on the image acquisition apparatus in response to the angle between the first panel and the second panel being greater than a preset threshold.

9. The system according to claim 7, wherein the processor is configured to:

obtain edge data of the object and edge data of the plane; and

determine that the object contacts the plane in response to detecting an intersection between the edge data of the object and the edge data of the plane.

10. The system according to claim 9, wherein the processor is configured to:

detect a position of the object in the image frame-by-frame in response to detecting the object contacting the plane; and

determine that the position of the object changes in response to detecting that the position of the object in the image changes from one frame to another.

11. The system according to claim 7, wherein the first surface of the first panel is provided with at least two image acquisition apparatuses including the image acquisition apparatuses, and wherein the processor is configured to:

synthesize images acquired at the same time by the at least two image acquisition apparatuses into a frame of depth image that carries coordinates of the object and coordinates of points in the plane; and

determine whether the object contacts the plane based on the coordinates of the object and the coordinates of the points in the plane.

12. The system according to claim 11, wherein the processor is configured to:

obtain a first group of coordinates of the object and a second group of coordinates of the object that are respectively carried in two adjacent frames of depth images; and

determine that the position of the object changes in response to detecting that the first group of coordinates and the second group of coordinates are different.

13. An electronic device, comprising:

a first panel that stands on a plane;

an image acquisition apparatus provided on a first surface of the first panel; and

a processor configured to;

determine whether an object contacts the plane based on an image acquired by the image acquisition apparatus;

detect position-changed information of the object in response to the object contacting the plane; and

in response to the object separating from the plane, stop detection of the position-changed information of the object.

14. The electronic device according to claim 13, wherein the electronic device has the first panel and a second panel, the first panel and the second panel are movably connected through a rotating shaft;

and the processor is further configured to;

obtain an angle between the first panel and the second panel; and

turn on the image acquisition apparatus in response to the angle between the first panel and the second panel being greater than a preset threshold.

15. The electronic device according to claim 13, wherein the processor is configured to:

obtain edge data of the object and edge data of the plane; and

determine that the object contacts the plane in response to detecting an intersection between the edge data of the object and the edge data of the plane.

16. The electronic device according to claim 15, wherein the processor is configured to:

detect a position of the object in the image frame-by-frame in response to the object contacting the plane; and

determine that the position of the object changes in response to detecting that the position of the object in the image changes from one frame to another.

17. The electronic device according to claim 13, wherein the first surface of the first panel is provided with at least two image acquisition apparatuses including the image acquisition apparatus, and the processor is configured to:

synthesize images acquired at the same time by the at least two image acquisition apparatuses into a frame of depth image that carries coordinates of the object and coordinates of points in the plane; and

determine whether the object contacts the plane based on the coordinates of the object and the coordinates of the points in the plane.

18. The electronic device according to claim 17, wherein the processor is configured to:

obtain a first group of coordinates of the object and a second group of coordinates of the object that are carried in two adjacent frames of depth images; and

determine that the position of the object changes in response to detecting that the first group of coordinates and the second group of coordinates are different.