SYSTEM AND METHOD FOR FACILITATING USER INTERACTION WITH A SIMULATED OBJECT ASSOCIATED WITH A PHYSICAL LOCATION

• US 20150350223A1
• Filed: 08/13/2015
• Published: 12/03/2015
• Est. Priority Date: 05/27/2009
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Zambala LLLP
• Inventors: Spivack, Nova T.
• Granted Patent: US 10,855,683 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/217 using environment-related information, i.e. information generated otherwise than by the player, e.g. ambient temperature or humidity
• CPC Class Codes: A63F 13/332 using wireless networks, e.g. cellular phone networks
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 13/69 by enabling or updating specific game elements, e.g. unlocking hidden features, items, levels or versions
• CPC Class Codes: A63F 13/71 using secure communication between game devices and game servers, e.g. by encrypting game data or authenticating players
• CPC Class Codes: A63F 2300/205 for detecting the geographical location of the game platform
• CPC Class Codes: A63F 2300/6009 for importing or creating game content, e.g. authoring tools during game development, adapting content to different platforms, use of a scripting language to create content
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 2221/2111 Location-sensitive, e.g. geographical location, GPS
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: H04L 63/102 Entity profiles
• CPC Class Codes: H04L 67/131 : Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/52 : specially adapted for the location of the user terminal
• CPC Class Codes: H04L 69/28 : Timers or timing mechanisms used in protocols
• CPC Class Codes: H04W 4/02 : Services making use of location information
• CPC Class Codes: H04W 4/027 : using movement velocity, acceleration information
• CPC Class Codes: H04W 4/029 : Location-based management or tracking services

Abstract

Systems and methods for facilitating user interaction with a simulated object that is associated with a physical location in the real world environment is herein disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of identifying the simulated object that is available for access based on location data. The location data can include a location of a device in a time period, the device for use by a user to access the simulated object. One embodiment includes, verifying an identity of the user; and in response to determining that the user is authorized to access the simulated object, providing the simulated object for presentation to the user via the device.

Claims

1. A method of facilitating interaction, via a mobile device, of a user with a simulated object that is associated with a physical object at a physical location in a real environment, the method, comprising:

searching simulated objects based on timing data or location data associated with the mobile device in response to a user request received via an input device associated with the mobile device;

identifying a simulated object from a result of the search;

determining whether the simulated object is available for access based on the timing data,

wherein, the simulated object allows a plurality of types of access, each determined based on whether the timing data meets a different timing criterion indicating when the simulated object is accessible;

verifying an identity of the user;

in response to determining that the simulated object is available for access and that the user is authorized to access the simulated object, providing the simulated object for presentation to the user via an output device input device associated with the mobile device;

wherein, the presentation of the simulated object is based at least in part on a perceptible characteristic of the physical object;

rendering a simulated environment in which the simulated object is provided, the simulated environment presented to the user via the output device;

in response to a detected external stimulus occurring in the real environment surrounding the mobile device, adjusting the presentation of the simulated environment via the output device,

wherein the user request includes a search parameter including one or more of timing data and location data.

2. The method of claim 1, wherein, the simulated object that is available for access is further identified using location data.

3. The method of claim 1, wherein, the external stimulus comprises environmental factors in the physical location.

4. The method of claim 1, wherein, the external stimulus comprises a user stimulus provided by the user or another user.

5. The method of claim 1, further comprising:

receiving a request, via the input device, from the user to perform a requested action on the simulated object; and

in response to determining the user is authorized to perform the requested action, updating at least a portion of the characteristics of the simulated object presented via the output device according to an effect of the requested action such that updates are perceived by the user.

6. The method of claim 1, further comprising:

detecting motion of the mobile device; and

adjusting a perspective of the simulated environment presented on the output device associated with the mobile device according to the detected motion of the mobile device.

7. The method of claim 1, further comprising:

continuously or periodically determining updated locations of the mobile device;

identifying an updated set of simulated objects available for access based on the updated locations;

accordingly presenting the updated set of simulated objects in the simulated environment to the user through the output device associated with the mobile device.

8. The method of claim 6, wherein detecting the motion of the mobile device comprises one or more of detecting velocity and detecting acceleration.

9. The method of claim 6, wherein detecting the motion of the mobile device comprises sensing a particular gesture.

10. The method of claim 1, wherein, the simulated object is controlled at least in part by a real user.

11. The method of claim 1, wherein, the simulated object is not controlled by a real user.

12. The method of claim 1, further comprising:

rendering a user interface for display on the output device associated with the mobile device, the user interface having a map of the physical location depicted in the simulated environment;

receiving a selection, via an input device associated with the mobile device, of a region on the map made by the user in the user interface,

wherein the region that is selected corresponds to a set of selected physical locations;

detecting simulated objects that are available for access in the region selected by the user; and

presenting the simulated objects to be perceived by the user via the display of the mobile device.

13. The method of claim 1, further comprising:

automatically detecting other simulated objects that are available for access;

wherein, the other simulated objects represent real users or simulated users.

14. The method of claim 1, wherein, the mobile device includes a wearable device including a mobile-enabled watch or head-mounted display device.

15. The method of claim 1, wherein, the search parameter further includes identification of the user.

16. A method of time-based manipulation of a simulated object that is associated with a physical object at a physical location in a real world environment, comprising:

generating the simulated object when qualifying timing data is detected,

wherein the qualifying timing data meets a criterion specifying when the simulated object can be generated,

wherein, the object is implemented using a data structure containing a set of metadata,

wherein, the set of metadata includes a link to another simulated object,

wherein, the set of metadata further includes a computer program to control actions of the simulated object;

enabling access to the generated object to a user via a mobile device, in response to determining that the user has access permission of the object,

wherein, the qualifying timing data includes a time when the mobile device is at the physical location,

in response to enabling access to the simulated object, presenting the simulated object to the user via a display of the mobile device,

wherein, the presentation of the simulated object is based at least in part on a perceptible characteristic of the physical object; and

in response to a detected external stimulus occurring in the real environment, adjusting the presentation of the simulated object.

17. The method of claim 16,

wherein, the criterion further specifies qualifying location data,

wherein, the object is associated with a unique identifier,

wherein, the unique identifier is associated with a location data structure having a set of location data that includes the qualifying location data.

18. The method of claim 16, wherein, the actions of the object can further be controlled by the user via the device.

19. The method of claim 16, wherein, the set of metadata further includes the qualifying timing data that satisfy a criterion for access of the object to be enabled.

20. The method of claim 17, wherein, the set of metadata further includes the qualifying location data that satisfies the criterion for access of the object to be enabled.

21. The method of claim 17, wherein, the qualifying location data is specified with a set of longitude and latitude coordinates.

22. The method of claim 17, wherein, the qualifying location data is specified with GPS coordinates.

23. The method of claim 17, wherein, the qualifying location data is specified using a relative position.

24. The method of claim 16, wherein, the set of metadata further includes a link to data from the Web.

25. The method of claim 16, wherein, the link is a semantic link.

26. The method of claim 16, wherein, the object is a representation of a living object.

27. The method of claim 16, wherein, the object is a representation of an inanimate object.

28. The method of claim 16, wherein, the mobile device includes a wearable device including a mobile-enabled watch or head-mounted display device.

29. A system for facilitating interaction of a user with a simulated object that is associated with a physical object at a physical location in a real environment, the system comprising:

a processor;

an input device;

an output device; and

a memory having stored thereon instructions which when executed by the processor, cause the system to;

search simulated objects based on timing data or location data associated with the system in response to a user request received via the input device;

identify a simulated object from a result of the search;

determine whether the simulated object is available for access based on the timing data,

wherein, the simulated object allows a plurality of types of access, each determined based on whether the timing data meets a different timing criterion indicating when the simulated object is accessible;

verify an identity of the user;

provide the simulated object for presentation to the user via the output device, in response to determining that the simulated object is available for access and that the user is authorized to access the simulated object;

render a simulated environment in which the simulated object is provided, the simulated environment presented to the user via the output device;

wherein, the presentation of the simulated object is based at least in part on perceptible characteristics of the physical object; and

adjust the presentation of the simulated environment via the output device, in response to a detected external stimulus occurring in the real environment,

wherein the user request includes a search parameter including one or more of timing data and location data.

30. The system of claim 29, wherein, the simulated object that is available for access is further identified using location data.

31. The system of claim 29, wherein the memory has additional instructions stored thereon, which when executed by the processor, cause the system to further:

receive, via the input device, a request from the user to perform a requested action on the simulated object; and

update at least a portion of the characteristics of the simulated object presented via the output device according to an effect of the requested action such that updates are perceived by the user, in response to determining the user is authorized to perform the requested action.

32. The system of claim 29, wherein the memory has additional instructions stored thereon, which when executed by the processor, cause the system to further:

detect a motion of at least one component of the system; and

adjust a perspective of the simulated environment presented via output device according to the detected motion.

33. The system of claim 29, wherein the memory has additional instructions stored thereon, which when executed by the processor, cause the system to further:

continuously or periodically determine updated locations of the system;

identify an updated set of simulated objects available for access based on the updated locations;

accordingly present the updated set of simulated objects in the simulated environment to the user via the wearable output device.

34. The system of claim 29, wherein the memory has additional instructions stored thereon, which when executed by the processor, cause the system to further:

render a user interface for display via the output device, the user interface having a map of the physical location depicted in the simulated environment;

receive, via the input device, a selection of a region on the map made by the user in the user interface,

wherein the region that is selected corresponds to a set of selected physical locations;

detect simulated objects that are available for access in the region selected by the user; and

present the simulated objects to be perceived by the user via the output device.

35. The system of claim 29, wherein the input and output devices include wearable devices including a mobile-enabled watch or head-mounted display device.