Methods and systems for verifying ownership of a physical work or facilitating access to an electronic resource associated with a physical work

• US 9,195,819 B2
• Filed: 07/25/2013
• Issued: 11/24/2015
• Est. Priority Date: 07/26/2012
• Status: Active Grant

• Current Assignee: Rakuten Kobo Inc. (Rakuten Group, Inc.)
• Original Assignee: BitLit Media, Inc. (Rakuten Group, Inc.)
• Inventors: Hudson, Peter Michael Bruce, Muja, Marius Constantin
• Primary Examiner(s): AZARIAN, SEYED H
• Application Number:
  US14/384,198
• Publication Number:
  US 20150131870A1
• Time in Patent Office: 852 Days
• Field of Search: 382100-103, 382112-116, 382135-140, 382/155, 382/162, 382/168, 382/173, 382181-188, 382/209, 382/219, 382/232, 382/243, 382/254, 382/274, 382/276, 382282-299, 382/305, 382/312, 382/321, 705/26, 705/26.1, 709/219, 709/217, 235/375
• US Class Current: 1/1
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06Q 10/0833 Tracking
• CPC Class Codes: G06V 20/63 Scene text, e.g. street names
• CPC Class Codes: G06V 20/80 Recognising image objects characterised by unique random patterns
• CPC Class Codes: G06V 20/95 Pattern authentication; Markers therefor; Forgery detection
• CPC Class Codes: G06V 2201/131 Book
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
• CPC Class Codes: G06V 30/416 Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors

Abstract

A method and system for allowing owners of a physical work, such as a book, to purchase an electronic version of the work by validating their ownership of the work using a personal electronic device, such as a smartphone, and marking the work. The owner is instructed to mark the work and to capture camera images of the work. The images are analyzed to identify the work, determine whether the work has been previously marked, and to verify that the work has been marked by the owner. Analysis may be performed remotely by a server in communication with the personal electronic device. Various means for authenticating ownership of the work are also disclosed, including 3D analysis, page curvature analysis, concurrent still image and video capture, detection of use of a video display to spoof the work, and geofencing.

Claims

1. A computer implemented method for verifying ownership of a physical work, the method comprising:

a) instructing a user to uniquely mark a first specified unmarked portion of the physical work in a specified way;

b) instructing the user to capture one or more camera images of one or more specified portions of the physical work, including the first specified portion subsequent to unique marking thereof;

c) providing data to a computer, said data including said one or more camera images in digital format;

d) analyzing the one or more camera images by the computer to determine whether one or more predetermined conditions have been fulfilled, wherein said one or more predetermined conditions include verification that the user has marked the first specified portion of the physical work in the specified way; and

e) upon determining that said one or more predetermined conditions have been fulfilled, verifying, by the computer, ownership of the physical work;

wherein said instructing the user to mark the first specified portion of the physical work and said instructing the user to capture one or more camera images is performed by a personal electronic device.

2. The method according to claim 1, wherein another one of said camera images captures the first specified portion prior to marking thereof, and wherein said one or more predetermined conditions include verification that the first specified portion of the physical work was unmarked prior to the user having marked the first specified portion of the physical work in the specified way.

3. The method according to claim 2, wherein instructing the user to capture said one of said camera images comprises displaying, on a video screen, a live preview image of content presented to the camera overlaid with said other one of said camera images, and instructing the user to match the live preview image with said overlaid other one of said camera images prior to capturing said one of said camera images, thereby matching perspective of said one of said camera images with perspective of said other one of said camera images.

4. The method according to claim 1, wherein said one or more predetermined conditions include verifications of identity of the physical work, authenticity of the physical work, or both.

5. The method according to claim 4, further comprising instructing the user to capture at least one of the one or more camera images from a predetermined angle, and wherein verifying authenticity of the physical work comprises verifying that the user is capable of capturing at least one of the one or more camera images from said predetermined angle.

6. The method according to claim 4, wherein verifying authenticity of the physical work comprises determining sizes of the physical work in one or more dimensions and determining whether said determined sizes correspond to known characteristics of the physical work.

7. The method according to claim 4, wherein verifying authenticity of the physical work comprises analyzing said one or more camera images to determine whether the camera images are of a representation of the physical work displayed on a video screen.

8. The method according to claim 7, wherein determining whether the camera images are of the representation of the physical work displayed on a video screen comprises causing operation of a camera flash when capturing at least one of said camera images and analyzing said at least one camera image for reflective artifacts due to the flash, said reflective artifacts indicative that the at least one camera image is of the representation of the physical work displayed on a video screen.

9. The method according to claim 4, wherein the physical work is a book, wherein at least one of said camera images captures one or more pages of the book when opened, the method further comprising processing at least one of said camera images to detect a curvature of the one or more pages, and wherein verifying authenticity of the physical work comprises determining whether said curvature is within a predetermined range of expected curvatures.

10. The method according to claim 9, wherein said at least one of said camera images captures a first page and a second, facing page of the book when opened, and wherein verifying authenticity of the physical work comprises determining whether the curvature of the first page falls within a first predetermined range of expected curvatures and the curvature of the second page falls within a second predetermined range of expected curvatures, said first and second predetermined ranges depending on a location of said first and second pages relative to a beginning and an end of the book.

11. The method according to claim 1, wherein said data further includes a geographic location of a device used to capture the one or more camera images during said capturing of the one or more camera images, and wherein said one or more predetermined conditions include verification that said geographic location is within a predetermined acceptable region, outside of a predetermined unacceptable region, or both.

12. The method according to claim 1, further comprising obtaining a geographic location of a device used to capture the one or more camera images during said capturing of the one or more camera images, wherein operations for verifying ownership of the physical work are inhibited when said geographic location is outside a predetermined acceptable region.

13. The method according to claim 1, wherein at least one of said one or more camera images is a still camera image.

14. The method according to claim 1, wherein at least one of said one or more camera images is a video image comprising a series of further still camera images or video frames captured over time.

15. The method according to claim 14, wherein said video image is processed to infer a three-dimensional size, three-dimensional shape, or both three-dimensional size and three-dimensional shape, of the physical work, and wherein said one or more predetermined conditions include verification of authenticity of the physical work based on said three-dimensional size, three-dimensional shape, or both three-dimensional size and three-dimensional shape.

16. The method according to claim 1, wherein a first one of said one or more camera images is a still camera image, and wherein another of said one or more camera images is a video image comprising a series of further still camera images or video frames captured over time, said video image captured concurrently with said still camera image.

17. The method according to claim 1, wherein said one or more predetermined conditions include conditions of access to an electronic resource associated with the physical work, the method further comprising facilitating access by the user to the electronic resource upon verifying ownership of the physical work.

18. The method according to claim 1, wherein the user is assigned a trustworthiness level based on a history of activity associated with the user, and wherein an extent to which ownership of the physical work is verified is adjusted based on said trustworthiness level.

19. The method according to claim 1, wherein instructing the user to capture one or more camera images is repeated until said determination of whether said one or more predetermined conditions have been fulfilled is made with a predetermined level of confidence.

20. The method according to claim 1, wherein said analyzing the one or more camera images is performed at least in part by a human operator.

21. A computer program product comprising a non-transitory computer readable medium storing computer executable instructions thereon that when executed by a computer perform the method steps of claim 1.

22. A computer implemented method for verifying ownership of a physical work, the method comprising:

a) instructing a user to capture one or more camera images of one or more specified portions of the physical work, said one or more specified portions including a first specified portion, said first specified portion expected to have been previously uniquely marked in a specified way if the physical work had previously been used in a prior attempt to claim ownership of the physical work, said prior attempt having required unique marking of the first specified unmarked portion in the specified way;

b) providing data to a computer, said data including the one or more camera images in digital format;

c) analyzing the one or more camera images by the computer to determine whether one or more predetermined conditions have been fulfilled, wherein said one or more predetermined conditions include verification that the first specified portion of the physical work had not been previously marked in association with said prior attempt to claim ownership of the physical work; and

d) upon determining that said one or more predetermined conditions have been fulfilled, verifying ownership by the user of the physical work by the computer;

wherein said instructing the user to capture one or more camera images is performed by a personal electronic device.

23. A system for verifying ownership of a physical work, the system comprising:

a) a personal electronic device comprising a user interface module configured to;

instruct a user to uniquely mark a first specified unmarked portion of the physical work in a specified way; and

instruct the user to capture, using the personal electronic device, one or more camera images of one or more specified portions of the physical work, wherein one of said camera images captures the first specified portion subsequent to unique marking thereof;

b) a server communicatively coupled to personal electronic device, the personal electronic device and the server collectively comprising one or more processing modules configured to;

obtain data including the one or more camera images from the personal electronic device in digital format for analysis;

analyze the one or more camera images to determine whether one or more predetermined conditions have been fulfilled, wherein said one or more predetermined conditions include verification that the user has uniquely marked the first specified unmarked portion of the physical work in the specified way; and

verify the user'"'"'s ownership of the physical work upon determining that said one or more predetermined conditions have been fulfilled.

24. The system according to claim 23, wherein the one or more processing modules are further configured to direct operation of the user interface.

25. The system according to claim 23, wherein another one of said camera images captures the first specified portion prior to marking thereof, and wherein said one or more predetermined conditions include verification that the first specified portion of the physical work was unmarked prior to the user having marked the first specified portion of the physical work in the specified way.

26. The system according to claim 25, wherein instructing the user to capture said one of said camera images comprises displaying, on a video screen of the personal electronic device, a live preview image of content presented to the camera overlaid with said other one of said camera images, and instructing the user to match the live preview image with said overlaid other one of said camera images prior to capturing said one of said camera images, thereby matching perspective of said one of said camera images with perspective of said other one of said camera images.

27. The system according to claim 23, wherein said one or more predetermined conditions include verifications of identity of the physical work, authenticity of the physical work, or both.

28. The system according to claim 27, the user interface further configured to instruct the user to capture at least one of the camera images from a predetermined angle, and wherein verifying authenticity of the physical work comprises verifying that the user is capable of capturing said at least one of the camera images from said predetermined angle.

29. The system according to claim 27, wherein verifying authenticity of the physical work comprises determining sizes of the physical work in one or more dimensions and determining whether said determined sizes correspond to known characteristics of the physical work.

30. The system according to claim 27, wherein verifying authenticity of the physical work comprises analyzing said one or more camera images to determine whether the camera images are of a representation of the physical work displayed on a video screen.

31. The system according to claim 30, wherein determining whether the camera images are of the representation of the physical work displayed on a video screen comprises causing operation of a camera flash when capturing at least one of said camera images and analyzing said at least one camera image for reflective artifacts due to the flash, said reflective artifacts indicative that the at least one camera image is of the representation of the physical work displayed on a video screen.

32. The system according to claim 27, wherein the physical work is a book, wherein at least one of said camera images captures one or more pages of the book when opened, the one or more processing modules further configured to process at least one of said camera images to detect a curvature of the one or more pages, and wherein verifying authenticity of the physical work comprises determining whether said curvature is within a predetermined range of expected curvatures.

33. The system according to claim 32, wherein said at least one of said camera images captures a first page and a second, facing page of the book when opened, and wherein verifying authenticity of the physical work comprises determining whether the curvature of the first page falls within a first predetermined range of expected curvatures and the curvature of the second page falls within a second predetermined range of expected curvatures, said first and second predetermined ranges depending on location of said first and second pages within the book.

34. The system according to claim 23, wherein said data further includes a geographic location of a device used to capture the one or more camera images during said capturing of the one or more camera images, and wherein said one or more predetermined conditions include verification that said geographic location is within a predetermined acceptable region.

35. The system according to claim 23, further comprising obtaining a geographic location of a device used to capture the one or more camera images during said capturing of the one or more camera images, wherein operations for verifying ownership of the physical work are inhibited when said geographic location is outside a predetermined acceptable region.

36. The system according to claim 23, wherein at least one of said one or more camera images is a still camera image.

37. The system according to claim 23, wherein at least one of said one or more camera images is a video image comprising a series of further still camera images or video frames captured over time.

38. The system according to claim 37, wherein said video image is processed to infer a three-dimensional size, three-dimensional shape, or both three-dimensional size and three-dimensional shape, of the physical work, and wherein said one or more predetermined conditions include verification of authenticity of the physical work based on said three-dimensional size, three-dimensional shape, or both three-dimensional size and three-dimensional shape.

39. The system according to claim 23, wherein a first one of said one or more camera images is a still camera image, and wherein another of said one or more camera images is a video image comprising a series of further still camera images or video frames captured over time, said video image captured concurrently with said still camera image.

40. The system according to claim 23, further comprising facilitating access by the user to an electronic resource associated with the physical work upon verifying ownership of the physical work.

41. The system according to claim 23, wherein the user is assigned a trustworthiness level based on a history of activity associated with the user, and wherein an extent to which ownership of the physical work is verified is adjusted based on said trustworthiness level.

42. The system according to claim 23, wherein instructing the user to capture one or more camera images is repeated until said determination of whether said one or more predetermined conditions have been fulfilled is made with a predetermined level of confidence.

43. The system according to claim 23, wherein said analyzing the one or more camera images is performed at least in part by a human operator.

44. A system for verifying ownership of a physical work, the system comprising:

a) a personal electronic device comprising a user interface module configured to;

instruct a user to capture, using the personal electronic device, one or more camera images of one or more specified portions of the physical work, said one or more specified portions including a first specified portion, said first specified portion having been previously uniquely marked in a specified way if the physical work had previously been used in a prior attempt to claim ownership of the physical work, said prior attempt having required unique marking of the first specified unmarked portion in the specified way;

b) a server communicatively coupled to the personal electronic device, the personal electronic device and the server collectively comprising one or more processing modules configured to;

obtain data including the one or more camera images from the personal electronic device in digital format for analysis;

analyze the one or more camera images to determine whether one or more predetermined conditions of have been fulfilled, wherein said one or more predetermined conditions include verification that the first specified unmarked portion of the physical work had not been previously uniquely marked in association with said prior attempt to claim ownership of the physical work; and

verify the user'"'"'s ownership of the physical work upon determining that said one or more predetermined conditions have been fulfilled.

45. A computer implemented method for facilitating access by a user to an electronic resource associated with a physical work, the method comprising:

a) instructing a user to uniquely mark a specified unmarked portion of the physical work in a specified way;

b) instructing the user to capture a camera image of the specified portion of the physical work;

c) providing the camera image in digital format to a computer;

d) analyzing the camera image by the computer to determine whether the specified unmarked portion of the physical work has been previously uniquely marked by another user;

e) upon determining that the specified portion has been previously uniquely marked by another user, denying, by the computer, the first user access to the electronic resource;

f) upon determining that the specified unmarked portion has not been previously marked by another user, determining, by the computer, whether or not the specified portion was correctly marked by the user;

g) upon determining that the specified portion has been marked by the user in the specified manner, granting, by the computer, the user access to an electronic resource via the computer or another computer;

wherein said instructing the user to uniquely mark the specified unmarked portion of the physical work and said instructing the user to capture the camera image is performed by a personal electronic device.

46. A system for facilitating access to an electronic resource associated with a physical work, the system comprising:

a) a user interface module configured to instruct a user to uniquely mark a specified unmarked portion of a physical work in a specific manner, and to capture camera images of the specified portion of the physical work;

b) an image capture module configured to obtain the camera images;

c) a processing module configured to receive the camera images from the image capture module and analyze the camera images to determine whether the specified portion has been previously uniquely marked by another user;

d) an access control module configured, upon determining that the specified portion has been previously marked by another user, to deny the user access to the electronic resource;

e) a processing module that, upon determining that the specified portion has not been previously uniquely marked by another user, determines whether the specified portion has been marked in the specified manner; and

f) an access control module that, upon determining that the specified portion has been uniquely marked in the specified manner, provides the user access to an electronic resource via a computer.