Display apparatus, display method, and program

• US 9,810,907 B2
• Filed: 02/23/2016
• Issued: 11/07/2017
• Est. Priority Date: 02/24/2015
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Kitazawa, Takayuki, Tanaka, Hideki, Maruyama, Yuya
• Primary Examiner(s): ADAMS, EILEEN M
• Application Number:
  US15/050,743
• Publication Number:
  US 20160249008A1
• Time in Patent Office: 623 Days
• Field of Search: None
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera

Abstract

A display apparatus includes a camera that outputs live motion images, a recorded motion image output section that outputs recorded motion images produced, a reversed motion image formation section that forms reversed motion images produced by reversing the live motion images, a skin color image extraction section that extracts images having a skin color from the live motion images and reverses the extracted images to form skin color reversed motion images, a motion image display section having a first display section and a second display section, and a display content setting section that sets display contents that are contents to be displayed in the first display section and the second display section, and the display content setting section selects contents to be displayed motion image display section from the live motion images, the recorded motion images, the reversed motion images, and the skin color reversed motion images.

Claims

1. A rehabilitation display apparatus comprising:

a memory that includes computer-readable instructions and that stores recorded motion images;

a camera that outputs live motion images;

a motion image display having a first display section and a second display section; and

a processor that is configured to execute the computer-readable instructions to;

output the recorded motion images;

reverse the live motion images so as to form reversed motion images, the reversed motion images being line symmetric images of the live motion images;

extract images having a desired skin color from the live motion images so as to form extracted images;

reverse the extracted images so as to form skin color reversed motion images, the skin color reversed motion images being line symmetric images of the extracted images; and

set display contents that are displayed in the first display section and the second display section,

wherein the processor is configured to set one of the live motion images, the recorded motion images, the reversed motion images, and the skin color reversed motion images as the display contents in the first display section, and

the processor is configured to set the one of the live motion images, the recorded motion images, the reversed motion images, and the skin color reversed motion images or another one of the live motion images, the recorded motion images, the reversed motion images, and the skin color reversed motion images as the display contents in the second display section.

2. The rehabilitation display apparatus according to claim 1,

wherein the motion image display has a setting display section, the processor is configured to prompt input of the display contents, which are displayed in the first and second display sections, in the setting display section, and

the setting display section is formed of a single setting screen, and the processor is configured to display both the display contents displayed in the first display section and displayed in the second display section in the setting display section.

3. The rehabilitation display apparatus according to claim 1,

wherein the processor is configured to display the live motion images in one of the first display section and the second display section, and the processor is configured to display the recorded motion images in the other of the first display section and the second display section.

4. The rehabilitation display apparatus according to claim 1,

wherein the motion image display is a light-transmissive head-mounted display, and

when no motion images are displayed in the first display section and the second display section, a scene having passed through the motion image display is visible.

10. The rehabilitation display apparatus according to claim 1,

wherein the recorded motion images are produced by capturing an guidance action image.

11. The rehabilitation display apparatus according to claim 1,

wherein the recorded motion images are produced by repeatedly capturing a clenched human hand image and a unclenched human hand image.

12. The rehabilitation display apparatus according to claim 1,

wherein the reversed motion images are produced by capturing a normal body part image and by reversing the normal body part image into a line symmetric image of the normal body part image.

5. A rehabilitation display method for causing a processor to execute computer-readable instructions stored in a memory, the method comprising executing on the processor the steps of:

displaying motion images in a first display section and a second display section by using one of the following combinations;

a first combination in which recorded motion images are displayed in the first display section and live motion images are displayed in the second display section;

a second combination in which the live motion images are displayed in the first display section and reversed motion images produced by reversing the live motion images into line symmetric images are displayed in the second display section; and

a third combination in which the recorded motion images are displayed in the first display section and the second display section,

wherein in the second combination, skin color reversed motion images produced by extracting skin color images having a skin color from the live motion images and reversing the extracted skin color images into line symmetric images are displayed in the second display section.

6. The rehabilitation display method according to claim 5,

wherein the recorded motion images are produced by capturing an guidance action image.

7. The rehabilitation display method according to claim 5,

wherein the recorded motion images are produced by repeatedly capturing a clenched human hand image and a unclenched human hand image.

8. The rehabilitation display method according to claim 5,

wherein the reversed motion images are produced by capturing a normal body part image and by reversing the normal body part image into a line symmetric image of the normal body part image.

9. A non-transitory computer-readable medium for causing a computer to execute a process, comprising instructions thereon, that when executed on a processor, perform the steps of:

providing live motion images;

providing recorded motion images;

reversing the live motion images into line symmetric images to form reversed motion images;

extracting images having a skin color from the live motion images and reversing the extracted images into line symmetric images to form skin color reversed motion images; and

setting display contents that are contents to be displayed in a first display section and a second display section,

wherein the processor is configured to set one of the live motion images, the recorded motion images, the reversed motion images, and the skin color reversed motion images as the display contents.

13. The non-transitory computer-readable medium according to claim 9,

wherein the recorded motion images are produced by capturing an guidance action image.

14. The non-transitory computer-readable medium according to claim 9,

wherein the recorded motion images are produced by repeatedly capturing a clenched human hand image and a unclenched human hand image.

15. The non-transitory computer-readable medium according to claim 9,

wherein the reversed motion images are produced by capturing a normal body part image and by reversing the normal body part image into a line symmetric image of the normal body part image.

16. A rehabilitation display method for causing a processor to execute computer-readable instructions stored in a memory, the method comprising executing on the processor the steps of:

displaying motion images in a first display section and a second display section by using one of the following combinations;

a first combination in which recorded motion images are displayed in the first display section and live motion images are displayed in the second display section;

a second combination in which the live motion images are displayed in the first display section and reversed motion images produced by reversing the live motion images into line symmetric images are displayed in the second display section; and

a third combination in which the recorded motion images are displayed in the first display section and the second display section,

wherein the recorded motion images are produced by repeatedly capturing a clenched human hand image and a unclenched human hand image.

17. The rehabilitation display method according to claim 16,

wherein in the second combination, skin color reversed motion images produced by extracting skin color images having a skin color from the live motion images and reversing the extracted skin color images into line symmetric images are displayed in the second display section.