Methods and systems for detecting objects by non-visible radio frequencies and displaying associated augmented reality effects
First Claim
1. A method for rendering an Augmented Reality (AR) image on a display of a mobile device with one or more objects detected by radio frequency signals, excluding visible spectrum frequencies, (“
- non-visible RF signals”
), the method comprising the steps of;
(1) repeatedly detecting and registering the objects located within a vicinity of the mobile device, by one or more sensors of the mobile device communicating with the objects by the non-visible RF signals;
(2) repeatedly tracking a relative location of each of the objects located within a vicinity of the mobile device, relative to the mobile device;
(3) generating in real time an AR element of each of the objects with an AR type as Large-AR-Image (LARI) and located inside a visual scan area by;
(a) determining a boundary of the AR element, the boundary configured to surround a real-world image of the object;
(b) determining a cut-out area within the boundary, the cut-out area configured to show a predetermined portion of the real-world image of the object, and(c) rendering an AR effect within the boundary, excluding the cut-out area, the AR effect scaled and oriented based on the relative location and an orientation of the object; and
(4) displaying the AR image rendered with the AR element anchored to each of the objects located inside the visual scan area; and
wherein the cut-out area is determined based on;
a distance between the mobile device and each of multiple transmission broadcast units (“
TBUs”
) locate along a peripheral of a projected cut-out area, the distance determined based on a response time for each TBU to respond to the mobile device via the non-visible RF signals and in a sequence of the TBUs; and
a distance between each pair of consecutive TBUs.
3 Assignments
0 Petitions
Accused Products
Abstract
Methods and systems for detecting and identifying one or more objects in the vicinity using radio frequency signals, excluding visible spectrum frequencies, (the “non-visible RF signals”) and displaying an AR image with an AR element associated with each of the one or more identified objects are disclosed. An exemplary method includes the steps of: detecting and registering one or more objects in the vicinity of a mobile device by non-visible RF signals; tracking the registered objects; rendering the AR elements associated with the registered objects; and displaying an AR image with the AR elements anchored to the associated objects in the visual scan area of the mobile device. This embodiment may further include a step of rendering a special kind of AR elements, called LARI AR elements, that includes a boundary and a cut-out area, and the associated AR effect rendered is limited to the area in the boundary but excluding the cut-out area. As such, in this embodiment, the object with a LARI AR element would appear entirely or partially framed by the AR element in the AR image.
-
Citations
48 Claims
-
1. A method for rendering an Augmented Reality (AR) image on a display of a mobile device with one or more objects detected by radio frequency signals, excluding visible spectrum frequencies, (“
- non-visible RF signals”
), the method comprising the steps of;(1) repeatedly detecting and registering the objects located within a vicinity of the mobile device, by one or more sensors of the mobile device communicating with the objects by the non-visible RF signals; (2) repeatedly tracking a relative location of each of the objects located within a vicinity of the mobile device, relative to the mobile device; (3) generating in real time an AR element of each of the objects with an AR type as Large-AR-Image (LARI) and located inside a visual scan area by; (a) determining a boundary of the AR element, the boundary configured to surround a real-world image of the object; (b) determining a cut-out area within the boundary, the cut-out area configured to show a predetermined portion of the real-world image of the object, and (c) rendering an AR effect within the boundary, excluding the cut-out area, the AR effect scaled and oriented based on the relative location and an orientation of the object; and (4) displaying the AR image rendered with the AR element anchored to each of the objects located inside the visual scan area; and wherein the cut-out area is determined based on; a distance between the mobile device and each of multiple transmission broadcast units (“
TBUs”
) locate along a peripheral of a projected cut-out area, the distance determined based on a response time for each TBU to respond to the mobile device via the non-visible RF signals and in a sequence of the TBUs; anda distance between each pair of consecutive TBUs. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 19)
- non-visible RF signals”
-
11. A system for rendering an Augmented Reality (AR) image, comprising a mobile device including:
-
(1) a display; (2) one or more sensors of radio frequency signals, excluding visible spectrum frequencies (“
non-visible RF signals”
);(3) an object registering module configured to repeatedly detect and register one or more objects located within a vicinity of the mobile device, by the sensors communicating with the objects by the non-visible RF signals; (4) an object tracking module configured repeatedly track a relative location of each of the objects located within a vicinity of the mobile device; and (5) an AR rendering module configured to; (a) generate in real time an AR element of each of the objects with an AR type as Large-AR-Image (LARI) and located inside a visual scan area by; A. determining a boundary of the AR element, the boundary configured to surround a real-world image of the object; B. determining a cut-out area within the boundary, the cut-out area configured to show a predetermined portion of the real-world image of the object, and C. rendering an AR effect within the boundary, excluding the cut-out area, the AR effect scaled and oriented based on the relative location and an orientation of the object, and (b) display the AR image rendered with the AR element anchored to each of the objects located inside the visual scan area, and wherein the cut-out area is determined based on; a distance between the mobile device and each of multiple transmission broadcast units (“
TBUs”
) locate along a peripheral of a projected cut-out area, the distance determined based on a response time for each TBU to respond to the mobile device via the non-visible RF signals and in a sequence of the TBUs; anda distance between each pair of consecutive TBUs. - View Dependent Claims (12)
-
-
13. A method for rendering an Augmented Reality (AR) image on a display of a mobile device with one or more objects detected by radio frequency signals, excluding visible spectrum frequencies, (“
- non-visible RF signals”
), the method comprising the steps of;(1) repeatedly detecting and registering the objects located within a vicinity of the mobile device, by one or more sensors of the mobile device communicating with the objects by the non-visible RF signals; (2) repeatedly tracking a relative location of each of the objects located within a vicinity of the mobile device, relative to the mobile device; (3) generating in real time an AR element of each of the objects with an AR type as Large-AR-Image (LARI) and located inside a visual scan area by; (a) determining a boundary of the AR element, the boundary configured to surround a real-world image of the object; (b) determining a cut-out area within the boundary, the cut-out area configured to show a predetermined portion of the real-world image of the object, and (c) rendering an AR effect within the boundary, excluding the cut-out area, the AR effect scaled and oriented based on the relative location and an orientation of the object; and (4) displaying the AR image rendered with the AR element anchored to each of the objects located inside the visual scan area; and wherein the cut-out area is determined based on; a predetermined shape of the cut-out area; predetermined locations of multiple transmission broadcast units (“
TBUs”
) relative to a projected cut-out area;a distance between the mobile device and each TBU determined based on a response time for each TBU to respond to the mobile device via the non-visible RF signals; and a distance between each pair of the TBUs. - View Dependent Claims (14, 15, 16, 17, 18, 20, 21, 22)
- non-visible RF signals”
-
23. A method for rendering an Augmented Reality (AR) image on a display of a mobile device with one or more objects detected by radio frequency signals, excluding visible spectrum frequencies, (“
- non-visible RF signals”
), the method comprising the steps of;(1) repeatedly detecting and registering the objects located within a vicinity of the mobile device, by one or more sensors of the mobile device communicating with the objects by the non-visible RF signals; (2) repeatedly tracking a relative location of each of the objects located within a vicinity of the mobile device, relative to the mobile device; (3) generating in real time an AR element of each of the objects with an AR type as Large-AR-Image (LARI) and located inside a visual scan area by; (a) determining a boundary of the AR element, the boundary configured to surround a real-world image of the object; (b) determining a cut-out area within the boundary, the cut-out area configured to show a predetermined portion of the real-world image of the object, and (c) rendering an AR effect within the boundary, excluding the cut-out area, the AR effect scaled and oriented based on the relative location and an orientation of the object; and (4) displaying the AR image rendered with the AR element anchored to each of the objects located inside the visual scan area; and wherein the boundary is determined based on; a predetermined shape of the boundary; predetermined locations of multiple transmission broadcast units (“
TBUs”
) relative to a projected boundary;a distance between the mobile device and each TBUs determined in real time based on a response time for each TBU to respond to the mobile device via the non-visible RF signals; and a distance between each pair of the TBUs. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30, 31, 32)
- non-visible RF signals”
-
33. A method for rendering an Augmented Reality (AR) image on a display of a mobile device with one or more objects detected by radio frequency signals, excluding visible spectrum frequencies, (“
- non-visible RF signals”
), the method comprising the steps of;(1) repeatedly detecting and registering the objects located within a vicinity of the mobile device, by one or more sensors of the mobile device communicating with the objects by the non-visible RF signals; (2) repeatedly tracking a relative location of each of the objects located within a vicinity of the mobile device, relative to the mobile device; (3) generating in real time an AR element of each of the objects with an AR type as Large-AR-Image (LARI) and located inside a visual scan area by; (a) determining a boundary of the AR element, the boundary configured to surround a real-world image of the object; (b) determining a cut-out area within the boundary, the cut-out area configured to show a predetermined portion of the real-world image of the object, and (c) rendering an AR effect within the boundary, excluding the cut-out area, the AR effect scaled and oriented based on the relative location and an orientation of the object; and (4) displaying the AR image rendered with the AR element anchored to each of the objects located inside the visual scan area; and wherein the boundary is determined based on; a predetermined shape of the boundary; locations of multiple transmission broadcast units (“
TBUs”
) relative to a projected boundary;a distance between the mobile device and each TBUs determined in real time based on a response time for each TBU to respond to the mobile device via the non-visible RF signals; and a distance between each pair of the TBUs. - View Dependent Claims (34, 35, 36, 37, 38, 39, 40, 41, 42)
- non-visible RF signals”
-
43. A system for rendering an Augmented Reality (AR) image, comprising a mobile device including:
-
(1) a display; (2) one or more sensors of radio frequency signals, excluding visible spectrum frequencies (“
non-visible RF signals”
);(3) an object registering module configured to repeatedly detect and register one or more objects located within a vicinity of the mobile device, by the sensors communicating with the objects by the non-visible RF signals; (4) an object tracking module configured repeatedly track a relative location of each of the objects located within a vicinity of the mobile device; and (5) an AR rendering module configured to; (a) generate in real time an AR element of each of the objects with an AR type as Large-AR-Image (LARI) and located inside a visual scan area by; A. determining a boundary of the AR element, the boundary configured to surround a real-world image of the object; B. determining a cut-out area within the boundary, the cut-out area configured to show a predetermined portion of the real-world image of the object, and C. rendering an AR effect within the boundary, excluding the cut-out area, the AR effect scaled and oriented based on the relative location and an orientation of the object, and (b) display the AR image rendered with the AR element anchored to each of the objects located inside the visual scan area, and wherein the cut-out area is determined based on; a predetermined shape of the cut-out area; predetermined locations of multiple transmission broadcast units (“
TBUs”
) relative to a projected cut-out area;a distance between the mobile device and each TBU determined based on a response time for each TBU to respond to the mobile device via the non-visible RF signals; and a distance between each pair of the TBUs. - View Dependent Claims (44)
-
-
45. A system for rendering an Augmented Reality (AR) image, comprising a mobile device including:
-
(1) a display; (2) one or more sensors of radio frequency signals, excluding visible spectrum frequencies (“
non-visible RF signals”
);(3) an object registering module configured to repeatedly detect and register one or more objects located within a vicinity of the mobile device, by the sensors communicating with the objects by the non-visible RF signals; (4) an object tracking module configured repeatedly track a relative location of each of the objects located within a vicinity of the mobile device; and (5) an AR rendering module configured to; (a) generate in real time an AR element of each of the objects with an AR type as Large-AR-Image (LARI) and located inside a visual scan area by; A. determining a boundary of the AR element, the boundary configured to surround a real-world image of the object; B. determining a cut-out area within the boundary, the cut-out area configured to show a predetermined portion of the real-world image of the object, and C. rendering an AR effect within the boundary, excluding the cut-out area, the AR effect scaled and oriented based on the relative location and an orientation of the object, and (b) display the AR image rendered with the AR element anchored to each of the objects located inside the visual scan area, and wherein the boundary is determined based on; (6) a predetermined shape of the boundary; predetermined locations of multiple transmission broadcast units (“
TBUs”
) relative to a projected boundary;a distance between the mobile device and each TBUs determined in real time based on a response time for each TBU to respond to the mobile device via the non-visible RF signals; and a distance between each pair of the TBUs. - View Dependent Claims (46)
-
-
47. A system for rendering an Augmented Reality (AR) image, comprising a mobile device including:
-
(1) a display; (2) one or more sensors of radio frequency signals, excluding visible spectrum frequencies (“
non-visible RF signals”
);(3) an object registering module configured to repeatedly detect and register one or more objects located within a vicinity of the mobile device, by the sensors communicating with the objects by the non-visible RF signals; (4) an object tracking module configured repeatedly track a relative location of each of the objects located within a vicinity of the mobile device; and (5) an AR rendering module configured to; (a) generate in real time an AR element of each of the objects with an AR type as Large-AR-Image (LARI) and located inside a visual scan area by; A. determining a boundary of the AR element, the boundary configured to surround a real-world image of the object; B. determining a cut-out area within the boundary, the cut-out area configured to show a predetermined portion of the real-world image of the object, and C. rendering an AR effect within the boundary, excluding the cut-out area, the AR effect scaled and oriented based on the relative location and an orientation of the object, and (b) display the AR image rendered with the AR element anchored to each of the objects located inside the visual scan area, and wherein the boundary is determined based on; a predetermined shape of the boundary; locations of multiple transmission broadcast units (“
TBUs”
) relative to a projected boundary;a distance between the mobile device and each TBUs determined in real time based on a response time for each TBU to respond to the mobile device via the non-visible RF signals; and a distance between each pair of the TBUs. - View Dependent Claims (48)
-
Specification