Augmented reality display apparatus and related methods using database record data

• US 9,785,640 B2
• Filed: 03/09/2015
• Issued: 10/10/2017
• Est. Priority Date: 10/12/2011
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Bailey, Samuel W.
• Primary Examiner(s): Nguyen, Phu K
• Application Number:
  US14/642,409
• Publication Number:
  US 20150178994A1
• Time in Patent Office: 946 Days
• Field of Search: 345419
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

Disclosed are examples of methods, apparatus, systems, and computer program products for providing an augmented reality display of an image with record data. In one example, image data is received at one or more processors. A request message is sent requesting record data associated with the image data from one or more of a plurality of records stored in a database system. In some implementations, when the requested record data is received, a graphical display of the record data in combination with the image can be provided on a display device.

Claims

1. A system for providing an augmented reality display of an image with social network data, the system comprising:

a database storing a plurality of database records; and

at least one server in communication with the database, the at least one server comprising at least one processor configurable to cause;

responsive to detection of a marker associated with an image received at a server from a computing device, identifying, using data of the image or using information associated with the image data, at least one of the database records identifying data of a social network profile of a user of a social networking system;

retrieving the social network profile data of the user; and

causing a graphical display of the image on a display device to be augmented with the social network profile data based at least in part on one or both of a position or an orientation of the image, the augmented graphical display comprising a three dimensional (3D) representation of the social network profile data, the 3D representation of the social network profile data being overlaid on the image in the graphical display, the 3D representation of the social network profile data being alterable in response to alteration of the position or orientation of the image.

2. The system of claim 1, wherein the marker comprises one or more of:

an alphanumeric string, a geometric shape, facial image data, a name of an organization, a name of a person, a phone number, or an email address.

3. The system of claim 2, wherein the 3D representation of the social network profile data is altered based on a position or an orientation of the marker.

4. The system of claim 3, wherein altering the 3D representation of the social network profile data comprises at least one of:

scaling, resizing, rotating, shifting, tilting, or turning the 3D representation of the social network profile data.

5. The system of claim 1, wherein the 3D representation of the social network profile data comprises at least one interactive selection.

6. The system of claim 1, the at least one processor further configurable to cause:

matching the marker with the social network profile data.

7. The system of claim 6, wherein the marker is associated with an entity type, and the at least one processor is further configurable to cause:

identifying a 3D representation model based on the entity type, the 3D representation based on the 3D representation model.

8. The system of claim 1, wherein the 3D representation of the social network profile data is formatted as a virtual business card identifying locations for displaying the social network profile data.

9. The system of claim 1, wherein the social networking profile data comprises at least one of:

a profile image, a name of a user, a status, a name of an organization, a group, a title, or a social network post count.

10. A mobile display apparatus comprising:

a display; and

at least one processor configurable to cause;

receiving or generating data of an image,

responsive to detection of a marker associated with an image received at a server from a computing device, identifying, using data of the image or using information associated with the image data, at least one of the database records identifying data of a social network profile of a user of a social networking system;

retrieving the social network profile data of the user; and

causing a graphical display of the image on a display device to be augmented with the social network profile data based at least in part on one or both of a position or an orientation of the image, the augmented graphical display comprising a three dimensional (3D) representation of the social network profile data, the 3D representation of the social network profile data being overlaid on the image in the graphical display, the 3D representation of the social network profile data being alterable in response to alteration of the position or orientation of the image.

11. The mobile display apparatus of claim 10, wherein the marker comprises one or more of:

an alphanumeric string, a geometric shape, facial image data, a name of an organization, a name of a person, a phone number, or an email address.

12. The mobile display apparatus of claim 10, wherein the 3D representation of the social network profile data comprises at least one interactive selection.

13. The mobile display apparatus of claim 10, wherein the 3D representation of the social network profile data is formatted as a virtual business card identifying locations for displaying the social network profile data.

14. A computer program product comprising computer-readable program code capable of being executed by one or more processors when retrieved from a non-transitory computer-readable medium, the program code including instructions configurable to cause:

responsive to detection of a marker associated with an image received at a server from a computing device, identifying, using data of the image or using information associated with the image data, at least one of the database records identifying data of a social network profile of a user of a social networking system;

retrieving the social network profile data of the user; and

causing a graphical display of the image on a display device to be augmented with the social network profile data based at least in part on one or both of a position or an orientation of the image, the augmented graphical display comprising a three dimensional (3D) representation of the social network profile data, the 3D representation of the social network profile data being overlaid on the image in the graphical display, the 3D representation of the social network profile data being alterable in response to alteration of the position or orientation of the image.

15. The computer program product of claim 14, wherein the marker comprises one or more of:

an alphanumeric string, a geometric shape, facial image data, a name of an organization, a name of a person, a phone number, or an email address.

16. The computer program product of claim 14, wherein the 3D representation of the social network profile data comprises at least one interactive selection.

17. The computer program product of claim 14, wherein the 3D representation of the social network profile data is formatted as a virtual business card identifying locations for displaying the social network profile data.

18. A method for providing an augmented reality display of an image with social network data, the method comprising:

receiving, at at least one server associated with a database system, data of the image;

responsive to detection of a marker associated with the image, identifying, using the image data or using information associated with the image data, at least one database record identifying data of a social network profile of a user of a social networking system, the at least one database record stored in a database of a database system associated with the social networking system,

retrieving the social network profile data of the user, and

causing a graphical display of the image on a display device to be augmented with the social network profile data based at least in part on one or both of a position or an orientation of the image, the augmented graphical display comprising a three dimensional (3D) representation of the social network profile data, the 3D representation of the social network profile data being overlaid on the image in the graphical display, the 3D representation of the social network profile data being alterable in response to alteration of the position or orientation of the image.

19. The method of claim 18, wherein the marker comprises one or more of:

an alphanumeric string, a geometric shape, facial image data, a name of an organization, a name of a person, a phone number, or an email address.

20. The method of claim 18, wherein the 3D representation of the social network profile data comprises at least one interactive selection.