Movement and touch recognition for controlling user-specified operations in a digital image processing apparatus

• US 8,823,637 B2
• Filed: 10/20/2009
• Issued: 09/02/2014
• Est. Priority Date: 12/15/2008
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Iwase, Ayako, Ozawa, Hiroyuki
• Primary Examiner(s): Amadiz, Rodney
• Application Number:
  US12/582,046
• Publication Number:
  US 20100149132A1
• Time in Patent Office: 1,778 Days
• Field of Search: 345/156, 345/158, 345/173, 345/175, 715700-866, 382/118, 382190-195, 382/224, 382/305, 707/723
• US Class Current: 345/156
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 2200/1636 Sensing arrangement for detection of a tap gesture on the housing
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces

Abstract

An image processing apparatus includes: a determining unit configured to determine one or more pieces of image data to be processed; a motion detecting unit configured to detect the motion of the image processing apparatus; a processing unit configured to execute predetermined processing regarding the one or more pieces of image data determined via the determining unit; and a processing control unit configured to execute control so as to execute the predetermined processing via the processing unit, in the case of detecting that a particular operation has been executed as to the image processing apparatus via the motion detecting unit.

Claims

1. An image processing apparatus comprising:

circuitry configured to;

determine one or more pieces of image data to be processed;

detect a motion of said image processing apparatus; and

perform processing control so as to execute a predetermined processing based on detecting, via said motion detecting, that a predetermined operation has been executed with respect to said image processing apparatus,

wherein the predetermined processing includes executing an image search using at least one user-specified image as a search key, and

wherein said processing control includes graphically representing transmission of said one or more pieces of image data to another apparatus by depicting a decrease in a remaining number of said one or more pieces of image data to be transmitted along with a corresponding increase in a received number of said one or more pieces of image data that have been received.

2. The image processing apparatus according to claim 1, wherein the predetermined operation detected via said motion detecting corresponds to at least one of laying over or raising said image processing apparatus, shaking said image processing apparatus, and tapping said image processing apparatus.

3. The image processing apparatus according to claim 1, wherein said processing control includes storing said one or more pieces of image data in a storage.

4. The image processing apparatus according to claim 1, wherein said processing control includes executing playback of said one or more pieces of image data.

5. The image processing apparatus according to claim 1, wherein said processing control includes executing recording of said one or more pieces of image data in a predetermined storage destination.

6. The image processing apparatus according to claim 1, wherein said processing control includes determining a face area of at least one person in a user-specified image and extracting image files including the at least one person, each of the extracted image files having a corresponding face area, area differences between the face area and the corresponding face areas each being specified by one of at least three predetermined ranges, each of which is associated with a corresponding predetermined degree of association.

7. The image processing apparatus according to claim 1, wherein a user specifies the at least one user-specified image using a touch panel of the image processing apparatus.

8. The image processing apparatus according to claim 1, wherein the processing control further includes reading image analysis information associated with the at least one user-specified image and extracts the image files, which have the same image analysis information.

9. The image processing apparatus according to claim 1, wherein the processing control further includes reading image analysis information associated with the at least one user-specified image and extracts the image files, which have image analysis information that is within a predetermined degree of similarity.

10. An image processing method for operating an image processing apparatus comprising the steps of:

determining one or more pieces of image data to be processed;

detecting, via motion detecting circuitry in said image processing apparatus, a motion of said image processing apparatus; and

controlling execution of a predetermined processing regarding said one or more pieces of image data determined via said determining based on detecting that a predetermined operation has been executed with respect to said image processing apparatus in said detecting,

wherein the predetermined processing includes executing an image search using at least one user-specified image as a search key, and

wherein said controlling execution includes graphically representing transmission of said one or more pieces of image data to another apparatus by depicting a decrease in a remaining number of said one or more pieces of image data to be transmitted along with a corresponding increase in a received number of said one or more pieces of image data that have been received.

11. The image processing method according to claim 10, wherein said predetermined processing includes determining a face area of at least one person in a user-specified image and extracting image files including the at least one person, each of the extracted image files having a corresponding face area, area differences between the face area and the corresponding face areas each being specified by one of at least three predetermined ranges, each of which is associated with a corresponding predetermined degree of association.

12. A non-transitory computer-readable storage medium having computer readable program codes embodied in the computer readable storage medium that, when executed cause a computer implemented in an image processing apparatus to execute:

determining one or more pieces of image data to be processed;

detecting a motion of said image processing apparatus; and

controlling execution of a predetermined processing regarding said one or more pieces of image data determined via said determining based on detecting that a predetermined operation has been executed with respect to said image processing apparatus in said detecting,

wherein the predetermined processing includes executing an image search using at least one user-specified image as a search key, and

wherein said controlling execution includes graphically representing transmission of said one or more pieces of image data to another apparatus by depicting a decrease in a remaining number of said one or more pieces of image data to be transmitted along with a corresponding increase in a received number of said one or more pieces of image data that have been received.

13. The non-transitory computer-readable storage medium according to claim 12, wherein said predetermined processing includes determining a face area of at least one person in a user-specified image and extracting image files including the at least one person, each of the extracted image files having a corresponding face area, area differences between the face area and the corresponding face areas each being specified by one of at least three predetermined ranges, each of which is associated with a corresponding predetermined degree of association.

14. An image processing apparatus comprising:

a determining unit configured to determine one or more pieces of image data to be processed;

a motion detecting unit configured to detect a motion of said image processing apparatus; and

a processing control unit configured to control execution of a predetermined processing based on detecting, via said motion detecting unit, that a predetermined operation has been executed with respect to said image processing apparatus, wherein the predetermined processing includes executing an image search using at least one user-specified image as a search key, and

wherein said processing control unit graphically represents transmission of said one or more pieces of image data to another apparatus by depicting a decrease in a remaining number of said one or more pieces of image data to be transmitted along with a corresponding increase in a received number of said one or more pieces of image data that have been received.

15. The image processing apparatus according to claim 14, wherein said processing control includes determining a face area of at least one person in a user-specified image and extracting image files including the at least one person, each of the extracted image files having a corresponding face area, area differences between the face area and the corresponding face areas each being specified by one of at least three predetermined ranges, each of which is associated with a corresponding predetermined degree of association.

16. An image processing method comprising the steps of:

determining of, with a determining unit of an image processing apparatus, one or more pieces of image data to be processed;

detecting of, with a motion detecting unit of the image processing apparatus, a motion of said image processing apparatus; and

controlling execution of a predetermined processing regarding said one or more pieces of image data determined via said determining based on detecting that a predetermined operation has been executed with respect to said image processing apparatus in said detecting,

wherein the predetermined processing includes executing an image search using at least one user-specified image as a search key, and

wherein said controlling execution includes graphically representing transmission of said one or more pieces of image data to another apparatus by depicting a decrease in a remaining number of said one or more pieces of image data to be transmitted along with a corresponding increase in a received number of said one or more pieces of image data that have been received.

17. The image processing method according to claim 16, wherein said predetermined processing includes determining a face area of at least one person in a user-specified image and extracting image files including the at least one person, each of the extracted image files having a corresponding face area, area differences between the face area and the corresponding face areas each being specified by one of at least three predetermined ranges, each of which is associated with a corresponding predetermined degree of association.

18. A non-transitory computer-readable storage medium having computer readable program codes embodied in the computer readable storage medium that, when executed cause an image processing apparatus to execute:

determining, with a determining unit of the image processing apparatus, one or more pieces of image data to be processed;

detecting, with a motion detecting unit of the image processing apparatus, a motion of said image processing apparatus; and

controlling execution of a predetermined processing regarding said one or more pieces of image data determined via said determining based on detecting that a predetermined operation has been executed with respect to said image processing apparatus in said detecting,

wherein the predetermined processing includes executing an image search using at least one user-specified image as a search key, and

wherein said controlling execution includes graphically representing transmission of said one or more pieces of image data to another apparatus by depicting a decrease in a remaining number of said one or more pieces of image data to be transmitted along with a corresponding increase in a received number of said one or more pieces of image data that have been received.

19. The non-transitory computer-readable storage medium according to claim 18, wherein said processing control includes determining a face area of at least one person in a user-specified image and extracting image files including the at least one person, each of the extracted image files having a corresponding face area, area differences between the face area and the corresponding face areas each being specified by one of at least three predetermined ranges, each of which is associated with a corresponding predetermined degree of association.