TECHNIQUES FOR CONSISTENT WRITES IN A SPLIT MESSAGE STORE

• US 20190207882A1
• Filed: 12/29/2017
• Published: 07/04/2019
• Est. Priority Date: 12/29/2017
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Nishtala, Rajesh, Jenks, Jason Curtis, Kasheff, Zardosht, Rash, Samuel
• Granted Patent: US 10,645,040 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/31 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: H04L 51/046 Interoperability with other network applications or services
• CPC Class Codes: H04L 51/42 Mailbox-related aspects, e.g. synchronisation of mailboxes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/564 Enhancement of application control based on intercepted application data
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

Techniques for consistent writes in a split message store are described. In one embodiment, an apparatus may comprise a client front-end component of a messaging system operative to receive a message, the message comprising message metadata and a message body; and store the message in a message queue; and the message queue operative to initiate a storing of the message metadata in a metadata store; delay a storing of the message body in a message store until a metadata storage success indication is received from the metadata store; receive the metadata storage success indication from the metadata store; and store the message body in the message store in response to receiving the metadata storage success indication from the metadata store. Other embodiments are described and claimed.

Claims

1. A computer-implemented method, comprising:

receiving a message at a messaging system, the message comprising message metadata and a message body;

initiating a storing of the message metadata in a metadata store;

delaying a storing of the message body in a message store until a metadata storage success indication is received from the metadata store;

receiving the metadata storage success indication from the metadata store; and

storing the message body in the message store in response to receiving the metadata storage success indication from the metadata store.

2. The method of claim 1, the metadata store located on a first storage device system, the message store located on a second storage device system, the first storage device system distinct from the second storage device system.

3. The method of claim 2, the first storage device system comprising a higher-speed storage device system than the second storage device system.

4. The method of claim 1, further comprising:

storing the message body in the message store in response to receiving the metadata storage success indication from a secondary metadata store.

5. The method of claim 1, further comprising:

delaying storing the message body in the message store until the metadata storage success indication is received and a metadata replicated storage success indication is received;

receiving the metadata replicated storage success indication; and

storing the message body in the message store in response to receiving the metadata storage success indication and the metadata replicated storage success indication.

6. The method of claim 5, the metadata replicated storage success indication indicating successful replication of the message metadata to one or more secondary metadata stores.

7. The method of claim 1, the message received as a message mutation, further comprising:

storing the message mutation in the metadata store in association with the message metadata as a temporary cache of the message mutation.

8. An apparatus, comprising:

a client front-end component of a messaging system operative to receive a message, the message comprising message metadata and a message body; and

store the message in a message queue; and

the message queue operative to initiate a storing of the message metadata in a metadata store;

delay a storing of the message body in a message store until a metadata storage success indication is received from the metadata store;

receive the metadata storage success indication from the metadata store; and

store the message body in the message store in response to receiving the metadata storage success indication from the metadata store.

9. The apparatus of claim 8, the metadata store located on a first storage device system, the message store located on a second storage device system, the first storage device system distinct from the second storage device system.

10. The apparatus of claim 9, the first storage device system comprising a higher-speed storage device system than the second storage device system.

11. The apparatus of claim 8, further comprising:

the message queue operative to store the message body in the message store in response to receiving the metadata storage success indication from a secondary metadata store.

12. The apparatus of claim 8, further comprising:

the message queue operative to delay storing the message body in the message store until the metadata storage success indication is received and a metadata replicated storage success indication is received;

receive the metadata replicated storage success indication; and

store the message body in the message store in response to receiving the metadata storage success indication and the metadata replicated storage success indication.

13. The apparatus of claim 12, the metadata replicated storage success indication indicating successful replication of the message metadata to one or more secondary metadata stores.

14. The apparatus of claim 8, the message received as a message mutation, further comprising:

the message queue operative to store the message mutation in the metadata store in association with the message metadata as a temporary cache of the message mutation.

15. At least one computer-readable storage medium comprising instructions that, when executed, cause a system to:

receive a message at a messaging system, the message comprising message metadata and a message body;

initiate a storing of the message metadata in a metadata store;

delay a storing of the message body in a message store until a metadata storage success indication is received from the metadata store;

receive the metadata storage success indication from the metadata store; and

store the message body in the message store in response to receiving the metadata storage success indication from the metadata store.

16. The computer-readable storage medium of claim 15, the metadata store located on a first storage device system, the message store located on a second storage device system, the first storage device system distinct from the second storage device system, the first storage device system comprising a higher-speed storage device system than the second storage device system.

17. The computer-readable storage medium of claim 15, comprising further instructions that, when executed, cause a system to:

store the message body in the message store in response to receiving the metadata storage success indication from a secondary metadata store.

18. The computer-readable storage medium of claim 15, comprising further instructions that, when executed, cause a system to:

delay storing the message body in the message store until the metadata storage success indication is received and a metadata replicated storage success indication is received;

receive the metadata replicated storage success indication; and

store the message body in the message store in response to receiving the metadata storage success indication and the metadata replicated storage success indication.

19. The computer-readable storage medium of claim 18, the metadata replicated storage success indication indicating successful replication of the message metadata to one or more secondary metadata stores.

20. The computer-readable storage medium of claim 15, the message received as a message mutation, comprising further instructions that, when executed, cause a system to:

store the message mutation in the metadata store in association with the message metadata as a temporary cache of the message mutation.