Enhancing live sports broadcasting with synthetic camera views

• US 20020080279A1
• Filed: 08/29/2001
• Published: 06/27/2002
• Est. Priority Date: 08/29/2000
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Rafey, Richter A., Wang, Sidney, Gong, Hubert Le Van
• Application Number:
  US09/943,044
• Publication Number:
  US 20020080279A1
• Time in Patent Office: Days
• US Class Current: 348/584
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/338 using television networks
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 2300/409 Data transfer via television network
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: A63F 2300/8017 Driving on land or water; Flying
• CPC Class Codes: H04N 21/4781 Games
• CPC Class Codes: H04N 9/74 for obtaining special effects H04N9/65 - H04N9/73 take precedence

Abstract

A method for enhancing broadcasts, such as sporting events. In one embodiment, data is received to create a synthetic scene comprising at least one dynamic synthetic object. Data reflective of at least one real dynamic object corresponding to the at least one dynamic synthetic object is also received. A synthetic scene is generated comprising the at least one dynamic synthetic object using data reflective of the at least one corresponding real dynamic object.

Claims

1. A method comprising:

receiving data to create a synthetic scene comprising at least one dynamic synthetic object;

receiving data reflective of at least one real dynamic object corresponding to the at least one dynamic synthetic object; and

generating a synthetic scene comprising the at least one dynamic synthetic object using data reflective of the at least one corresponding real dynamic object.

2. The method as set forth in claim 1, further comprising combining the at least one synthetic object with a live broadcast such that the synthetic object appears at least a part of the broadcast.

3. The method as set forth in claim 1, further comprising specifying a synthetic camera including a synthetic field of view of the synthetic camera, said generating comprising displaying the synthetic scene within the synthetic field of view.

4. The method as set forth in claim 3, wherein the synthetic field of view is set according to a criteria selected from the group consisting of following a position of the at least one real dynamic object, specification by a viewer, correspondence to a field of view of a real camera.

5. The method as set forth in claim 3, wherein the data reflective of the at least one corresponding real dynamic object comprises position information of the real dynamic object.

6. The method as set forth in claim 3, wherein the synthetic scene corresponds to a one of live or recorded audio/visual (A/V) data.

7. The method as set forth in claim 6, wherein the A/V data comprises a broadcast.

8. The method as set forth in claim 6, wherein the synthetic camera is specified to correspond to a real camera of the A/N data.

9. The method as set forth in claim 1, further comprising:

setting a synthetic field of view to correspond to a field of view of a real camera recording real images;

combining the synthetic scene within the synthetic field of view with real images within the field of view of the real camera.

10. A client device comprising:

a first input coupled to receive data to create a synthetic scene comprising at least one dynamic synthetic object;

a second input coupled to receive data reflective of at least one dynamic real object corresponding to the at least one dynamic synthetic object; and

a processing device configured togenerate a synthetic scene comprising the at least one dynamic synthetic object using data reflective of the at least one corresponding dynamic real object.

11. The client device as set forth in claim 10, wherein the processor is further configured to combine the at least one synthetic object with a live broadcast such that the synthetic object appears at least a part of the broadcast.

12. The client device as set forth in claim 10, further comprising specifying a synthetic camera including a synthetic field of view of the synthetic camera, said generating comprising displaying the synthetic scene within the synthetic field of view.

13. The client device as set forth in claim 12, wherein the synthetic field of view is set according to a criteria selected from the group consisting of following a position of the at least one real dynamic object, specification by a viewer, correspondence to a field of view of a real camera.

14. The client device as set forth in claim 10, wherein the data reflective of the at least one corresponding real dynamic object comprises position information of the real dynamic object.

15. The client device as set forth in claim 12, wherein the synthetic scene corresponds to a one of live or recorded audio/visual (A/V) data.

16. The client device as set forth in claim 15, wherein the A/V data comprises a broadcast.

17. The client device as set forth in claim 15, wherein the synthetic camera is specified to correspond to a real camera of the A/V data.

18. The client device as set forth in claim 10, wherein the processor is further configured to set a synthetic field of view to correspond to a field of view of a real camera recording real images and combine the synthetic scene within the synthetic field of view with real images within the field of view of the real camera.

19. The client device as set forth in claim 10, wherein the client device is selected from the group consisting of a signal processor, general purpose processor, set top box and video game console.

20. A system comprising:

a broadcast server configured to provide data to create a synthetic scene comprising at least one dynamic synthetic object, data reflective of at least one dynamic real object corresponding to the at least one dynamic synthetic object;

a client device coupled to the broadcast server, said device receiving data to create a synthetic scene comprising at least one dynamic synthetic object, receiving data reflective of at least one real dynamic object corresponding to the at least one dynamic synthetic object, and generating a synthetic scene comprising the at least one dynamic synthetic object using data reflective of the at least one corresponding real dynamic object.

21. The system as set forth in claim 20, said broadcast server further configured to provide a live broadcast, said client device further configured to combine at least a portion of the synthetic scene with the live broadcast.

22. The system as set forth in claim 21, further comprising specifying a synthetic camera including a synthetic field of view of the synthetic camera, said client device displaying the synthetic scene within the synthetic field of view.

23. The system as set forth in claim 22, wherein the synthetic field of view is set according to a criteria selected from the group consisting of following a position of the at least one real dynamic object, specification by a viewer at the client device, correspondence to a field of view of a real camera coupled to the broadcast server.

24. The system as set forth in claim 21, wherein the data reflective of the at least one corresponding real dynamic object comprises position information of the real dynamic object.

25. The system as set forth in claim 24, wherein the position information is communicated frequently from the broadcast server to the client device such the synthetic scene comprising the at least one dynamic synthetic object is frequently updated to correspond to the corresponding dynamic real object.

26. The system as set forth in claim 22, wherein the processor is further configured to set a synthetic field of view to correspond to a field of view of a real camera recording real images and combine the synthetic scene within the synthetic field of view with real images within the field of view of the real camera.

27. The client device as set forth in claim 20, wherein the client device is selected from the group consisting of a signal processor, general purpose processor, set top box and video game console.

29. The broadcast device as set forth in claim 28, said broadcast device further configured to provide a live broadcast, wherein at least a portion of the synthetic scene is combined with the live broadcast.

30. The broadcast device as set forth in claim 28, said broadcast device further configured to specify a synthetic camera including a synthetic field of view of the synthetic camera, wherein the synthetic scene is displayed within the synthetic field of view.

31. The broadcast device as set forth in claim 30, wherein the synthetic field of view is set according to a criteria selected from the group consisting of following a position of the at least one real dynamic object, specification by a viewer at the client device, correspondence to a field of view of a real camera coupled to the broadcast server.

32. The broadcast device as set forth in claim 28, wherein the data reflective of the at least one corresponding real dynamic object comprises position information of the real dynamic object.

33. The broadcast device as set forth in claim 32, wherein the position information is updated frequently such the synthetic scene comprising the at least one dynamic synthetic object is frequently updated to correspond to the corresponding dynamic real object.

34. The broadcast device as set forth in claim 29, said broadcast device further configured to set a synthetic field of view to correspond to a field of view of a real camera recording the live broadcast and combine the synthetic scene within the synthetic field of view with real images within the field of view of the real camera.

28. A broadcast device a configured to provide data to create a synthetic scene comprising at least one dynamic synthetic object, data reflective of at least one dynamic real object corresponding to the at least one dynamic synthetic object;

wherein a synthetic scene comprising the at least one dynamic synthetic object using data reflective of the at least one corresponding real dynamic object is generated.