Shooting control method, shooting control apparatus and user equipment

• US 10,582,116 B2
• Filed: 06/29/2016
• Issued: 03/03/2020
• Est. Priority Date: 06/30/2015
• Status: Active Grant

• Current Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Original Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Inventors: Ding, Dayong
• Primary Examiner(s): Retallick, Kaitlin A
• Application Number:
  US15/197,693
• Publication Number:
  US 20170006217A1
• Time in Patent Office: 1,343 Days
• Field of Search: None
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/681 Motion detection
• CPC Class Codes: H04N 23/684 performed by controlling the image sensor readout, e.g. by controlling the integration time
• CPC Class Codes: H04N 23/687 by shifting the lens or sensor position

Abstract

A shooting control method, a shooting control apparatus and a user equipment are provided. A method comprises acquiring eye movement information related to that at least one eye of a user gazes an image capturing equipment, and adjusting shooting of shooting parameters of the image capturing equipment at least according to a non-saccade eye movement part in the eye movement information. Shooting parameters of an image capturing equipment can be adjusted according to a non-saccade eye movement part of the image capturing equipment gazed by a user, to perform shooting shake compensating on relative movement between the head of the user and the image capturing equipment corresponding to the non-saccade eye movement part.

Claims

1. A method, comprising:

acquiring eye movement caused by unintended relative movement between a head of a user and an image capturing equipment, the eye movement being related to determining that an eye of the user gazes at the image capturing equipment;

determining the unintended relative movement between the head of the user and the image capturing equipment at least according to a non-saccade eye movement part in the eye movement information and movement information of the image capturing equipment corresponding to a period corresponding to the non-saccade eye movement part, wherein the determining of the unintended relative movement comprises;

determining eye movement components of the non-saccade eye movement part having a changing frequency corresponding to a movement change frequency feature of the movement information; and

determining a relative movement at least according to the eye movement components; and

adjusting shooting parameters of the image capturing equipment to reduce an effect of the unintended relative movement on shooting, wherein the shooting parameters are related to determining that the image capturing equipment shoots the user.

2. The method of claim 1, further comprising:

processing the eye movement information to obtain the non-saccade eye movement part.

3. The method of claim 1, wherein the non-saccade eye movement part comprises:

a smooth pursuit eye movement part.

4. The method of claim 3, wherein the non-saccade eye movement part further comprises:

a fixation eye movement part.

5. The method of claim 1, wherein the shooting parameters comprise at least one of:

a compensating lens shifting parameter, an imaging sensor shifting parameter, a shutter speed parameter or a photosensibility parameter.

6. The method of claim 1, wherein the determining the unintended relative movement at least according to the non-saccade eye movement part comprises:

determining the unintended relative movement at least according to the non-saccade eye movement part and at least one piece of reference non-saccade eye movement information.

7. The method of claim 1, further comprising:

before the determining the unintended relative movement at least according to the non-saccade eye movement part, acquiring the movement information.

8. An apparatus, comprising:

a memory that stores executable modules; and

a processor, coupled to the memory, that executes or facilitates execution of the executable modules, the executable modules comprising;

an eye movement information acquisition module configured to acquire eye movement caused by unintended relative movement between a head of a user and an image capturing equipment, the eye movement being related to that at least one eye of the user is gazing at the image capturing equipment; and

a shooting parameter adjustment module configured to;

determine the unintended relative movement between the head of the user and the image capturing equipment at least according to a non-saccade eye movement part in the eye movement information and movement information of the image capturing equipment corresponding to a period corresponding to the non-saccade eye movement part, wherein determination of the unintended relative movement by the shooting parameter adjustment module comprises;

a first determination of eye movement components of the non-saccade eye movement part having a changing frequency corresponding to a movement change frequency feature of the movement information; and

a second determination of a relative movement at least according to the eye movement components; and

adjust shooting parameters of the image capturing equipment to reduce an effect of the unintended relative movement on shooting, wherein the shooting parameters are related to that the image capturing equipment shoots the user.

9. The apparatus of claim 8, wherein the executable modules further comprise:

an eye movement information processing module configured to process the eye movement information to obtain the non-saccade eye movement part.

10. The apparatus of claim 8, wherein the non-saccade eye movement part comprises:

a smooth pursuit eye movement part.

11. The apparatus of claim 10, wherein the non-saccade eye movement part further comprises:

a fixation eye movement part.

12. The apparatus of claim 8, wherein the shooting parameters comprise at least one of:

a compensating lens shifting parameter, an imaging sensor shifting parameter, a shutter speed parameter or a photosensibility parameter.

13. The apparatus of claim 8, wherein the shooting parameter adjustment module comprises:

a determination unit configured to determine the unintended relative movement at least according to the non-saccade eye movement part and at least one piece of reference non-saccade eye movement information.

14. The apparatus of claim 8, wherein the executable modules further comprise:

a movement information acquisition module configured to acquire the movement information.

15. A user equipment, comprising:

an image sensor configured to shoot;

a memory configured to store a program; and

a processor configured to execute the program stored by the memory, the program causing the processor to perform operations, comprising;

acquiring eye movement caused by unintended relative movement between a head of a user and the user equipment, the eye movement being related to a determination that an eye of the user is gazing at the user equipment;

determining the unintended relative movement between the head of the user and the image sensor at least according to a non-saccade eye movement part in the eye movement information and movement information of the image capturing equipment corresponding to a period corresponding to the non-saccade eye movement part, wherein the determining of the unintended relative movement comprises;

determining eye movement components of the non-saccade eye movement part having a changing frequency corresponding to a movement change frequency feature of the movement information; and

determining a relative movement at least according to the eye movement components; and

adjusting shooting parameters of the user equipment to reduce an effect of the unintended relative movement on shooting.

17. The user equipment of claim 15, wherein the non-saccade eye movement part comprises a smooth pursuit eye movement part.

19. The user equipment of claim 15, wherein the operations further comprise:

processing the eye movement information to obtain the non-saccade eye movement part.

21. The user equipment of claim 15, wherein the non-saccade eye movement part further comprises:

a fixation eye movement part.

23. The user equipment of claim 15, wherein the shooting parameters comprise at least one of:

a compensating lens shifting parameter, an imaging sensor shifting parameter, a shutter speed parameter or a photosensibility parameter.

16. An image capturing equipment, comprising:

a memory configured to store a program; and

a processor configured to execute the program stored by the memory, the program causing the processor to perform operations, comprising;

acquiring eye movement caused by unintended relative movement between a head of a user and the image capturing equipment, the eye movement being related to at least one eye of the user being determined to be gazing at the image capturing equipment;

determining the unintended relative movement between the head of the user and the image capturing equipment based on input from the user at least according to a non-saccade eye movement part in the eye movement information and movement information of the image capturing equipment corresponding to a period corresponding to the non-saccade eye movement part, wherein the determining of the unintended relative movement comprises;

determining eye movement components of the non-saccade eye movement part having a changing frequency corresponding to a movement change frequency feature of the movement information; and

determining a relative movement at least according to the eye movement components; and

adjusting shooting parameters of the image capturing equipment to reduce an effect of the unintended relative movement on shooting.

18. The image capturing equipment of claim 16, wherein the non-saccade eye movement part comprises a smooth pursuit eye movement part.

20. The image capturing equipment of claim 16, wherein the operations further comprise:

processing the eye movement information to obtain the non-saccade eye movement part.

22. The image capturing equipment of claim 16, wherein the non-saccade eye movement part further comprises:

a fixation eye movement part.

24. The image capturing equipment of claim 16, wherein the shooting parameters comprise at least one of:

a compensating lens shifting parameter, an imaging sensor shifting parameter, a shutter speed parameter or a photosensibility parameter.