Trip replay experience

• US 9,986,197 B2
• Filed: 08/24/2016
• Issued: 05/29/2018
• Est. Priority Date: 08/24/2016
• Status: Active Grant

• Current Assignee: Navico Incorporated (Brunswick Corporation)
• Original Assignee: Navico Holding A.S. (Brunswick Corporation)
• Inventors: Gaynor, Phillip King
• Primary Examiner(s): Dang, Hung
• Assistant Examiner(s): Wendmagegn, Girumsew
• Application Number:
  US15/245,618
• Publication Number:
  US 20180063467A1
• Time in Patent Office: 643 Days
• CPC Class Codes: B63B 79/15 for monitoring environmental variables, e.g. wave height or weather data
• CPC Class Codes: B63J 99/00 Subject matter not provided for in other groups of this subclass
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/775 between a recording apparatus and a television receiver

Abstract

Whether for enjoyment, research, or other reasons, operators and occupants of marine vessels often want to re-live their experience. Embodiments of the present invention seek to utilize data captured during a trip to generate a trip replay experience that provides a re-creation experience for the viewer. In this regard, data from the systems and sensors of the marine vessel during the trip may be gathered and provided to a remote server. The data may be correlated as a function of time and intermingled to create a first-person type view from a “dashboard” to give the viewer a more realistic re-creation experience of the trip. Such a trip replay experience allows the operator, owner, or anyone else to relive a trip taken in the marine vessel.

Claims

1. An apparatus comprising a processor and memory including computer program code, wherein the computer program code is configured to, with the processor, cause the apparatus to:

receive trip data, wherein the trip data is generated from a plurality of sensors or systems associated with a marine vessel during a trip conducted by the marine vessel, wherein the trip defines a beginning and an end;

generate a trip replay experience based on the trip data received from the plurality of sensors or systems during the trip conducted by the marine vessel, wherein the trip replay experience includes a time-based illustration that shows a representation of the trip data as the trip data is gathered from the beginning of the trip to the end of the trip, wherein the trip replay experience shows a plurality of types of trip data including at least a location of the marine vessel as a function of time during the trip and one or more other types of trip data as a function of time during the trip, wherein the trip replay experience is formed into a representative first person view such that the plurality of types of trip data are presented intermingled on a single screen so as to provide the user with a re-creation experience of the trip, wherein the trip replay experience is formed into a graphical user interface that includes a plurality of parameters for user selection, wherein the graphical user interface forms the representative first person view by including;

at least one map region including a map showing the location of the marine vessel during the trip, wherein the map region is displayed on a first portion of the graphical user interface, and

at least one gauge region including at least one gauge graphic that displays at least one of engine data, battery data, or propulsion system data, wherein the at least one gauge region is displayed on a second portion of the graphical user interface at least partially imposed on the first portion; and

cause display of the trip replay experience of the trip of the marine vessel on a screen.

2. The apparatus of claim 1, wherein the beginning of the trip is defined as receiving trip data that indicates ignition of an engine of the marine vessel is detected, and wherein the end of the trip is defined as receiving trip data that indicates deignition of the engine of the marine vessel is detected.

3. The apparatus of claim 2, wherein the computer program code is further configured to, with the processor, cause the apparatus to automatically generate the trip replay experience upon receipt of the trip data that indicates deignition of the engine of the marine vessel.

4. The apparatus of claim 1, wherein the beginning of the trip is defined as receiving trip data that indicates motion of the marine vessel for a first predetermined amount of time is detected, and wherein the end of the trip is defined as receiving trip data that indicates no motion of the marine vessel for a second predetermined amount of time is detected.

5. The apparatus of claim 1, wherein the trip data generated from a plurality of sensors or systems associated with the marine vessel is comprised of at least one of sonar data, user mobile device data, radar data, chart data, environmental data, or watercraft data.

6. The apparatus of claim 5, wherein the sonar data is received from a sonar system in communication with a marine electronic device associated with the marine vessel, wherein the sonar system is configured to gather sonar data from the underwater environment around the marine vessel.

7. The apparatus of claim 5, wherein the user mobile device data is comprised of at least one of picture data, video data, music data, or wearable device data.

8. The apparatus of claim 5, wherein the watercraft data is comprised of at least one of engine data, battery data, propulsion system data, navigational instructions data, alert data, or diagnostic system data.

9. The apparatus of claim 1, wherein the trip data is further generated from a source external to the marine vessel, and wherein the computer program code, is further configured to, with the processor, cause the apparatus to generate the trip replay experience based at least on the trip data received from the plurality of sensors or systems associated with the marine vessel and the source external to the marine vessel during the trip conducted by the marine vessel.

10. The apparatus of claim 9, wherein the trip data received from the source external to the marine vessel is comprised of weather data.

11. The apparatus of claim 1, wherein the graphical user interface further comprises at least one picture region configured to display picture data comprised of one or more pictures received by the apparatus, and wherein the picture region is located on a third portion of the graphical user interface, and wherein the third portion is at least partially imposed on the first portion.

12. The apparatus of claim 1, wherein the graphical user interface further comprises at least one scrolling timeline region configured to display a timeline of the trip from the beginning to the end, and wherein the scrolling timeline region is located on a fourth portion of the graphical user interface, and wherein the fourth portion and the second portion are different.

13. A computer program product comprising a non-transitory computer readable medium including computer program code configured to, with a processor, cause an apparatus to:

receive trip data, wherein the trip data is generated from a plurality of sensors or systems associated with a marine vessel during a trip conducted by the marine vessel, wherein the trip defines a beginning and an end;

generate a trip replay experience based on the trip data received from the plurality of sensors or systems during the trip conducted by the marine vessel, wherein the trip replay experience includes a time-based illustration that shows a representation of the trip data as the trip data is gathered from the beginning of the trip to the end of the trip, wherein the trip replay experience shows a plurality of types of trip data including at least a location of the marine vessel as a function of time during the trip and one or more other types of trip data as a function of time during the trip, wherein the trip replay experience is formed into a representative first person view such that the plurality of types of trip data are presented intermingled on a single screen so as to provide the user with a re-creation experience of the trip, wherein the trip replay experience is formed into a graphical user interface that includes a plurality of parameters for user selection, wherein the graphical user interface forms the representative first person view by including;

at least one map region including a map showing the location of the marine vessel during the trip, wherein the map region is displayed on a first portion of the graphical user interface, and

at least one gauge region including at least one gauge graphic that displays at least one of engine data, battery data, or propulsion system data, wherein the at least one gauge region is displayed on a second portion of the graphical user interface at least partially imposed on the first portion; and

cause display of the trip replay experience of the trip of the marine vessel on a screen.

14. The computer program product of claim 13, the beginning of the trip is defined as receiving trip data that indicates ignition of an engine of the marine vessel is detected, and wherein the end of the trip is defined as receiving trip data that indicates deignition of the engine of the marine vessel is detected.

15. The computer program product of claim 14, wherein the computer program code is further configured to, with the processor, cause the apparatus to automatically generate the trip replay experience upon receipt of the trip data that indicates deignition of the engine of the marine vessel.

16. The computer program product of claim 13, wherein the beginning of the trip is defined as receiving trip data that indicates motion of the marine vessel for a first predetermined amount of time is detected, and wherein the end of the trip is defined as receiving trip data that indicates no motion of the marine vessel for a second predetermined amount of time is detected.

17. The computer program product of claim 13, wherein the trip data generated from a plurality of sensors or systems associated with the marine vessel is comprised of at least one of sonar data, user mobile device data, radar data, chart data, environmental data, or watercraft data.

18. The computer program product of claim 13, wherein the graphical user interface further comprises at least one picture region configured to display picture data comprised of one or more pictures received by the apparatus, and wherein the picture region is located on a third portion of the graphical user interface, and wherein the third portion is at least partially imposed on the first portion.

19. The computer program product of claim 13, wherein the graphical user interface further comprises at least one scrolling timeline region configured to display a timeline of the trip from the beginning to the end, and wherein the scrolling timeline region is located on a fourth portion of the graphical user interface, and wherein the fourth portion and the second portion are different.

20. A method comprising:

receiving trip data, wherein the trip data is generated from a plurality of sensors or systems associated with a marine vessel during a trip conducted by the marine vessel, wherein the trip defines a beginning and an end;

generating a trip replay experience based on the trip data received from the plurality of sensors or systems during the trip conducted by the marine vessel, wherein the trip replay experience includes a time-based illustration that shows a representation of the trip data as the trip data is gathered from the beginning of the trip to the end of the trip, wherein the trip replay experience shows a plurality of types of trip data including at least a location of the marine vessel as a function of time during the trip and one or more other types of trip data as a function of time during the trip, wherein the trip replay experience is fonned into a representative first person view such that the plurality of types of trip data are presented inteimingled on a single screen so as to provide the user with a re-creation experience of the trip, wherein the trip replay experience is formed into a graphical user interface that includes a plurality of parameters for user selection, wherein the graphical user interface forms the representative first person view by including;

at least one map region including a map showing the location of the marine vessel during the trip, wherein the map region is displayed on a first portion of the graphical user interface, and

at least one gauge region including at least one gauge graphic that displays at least one of engine data, battery data, or propulsion system data, wherein the at least one gauge region is displayed on a second portion of the graphical user interface at least partially imposed on the first portion; and

causing display of the trip replay experience of the trip of the marine vessel on a screen.