Large group chat
Differences between livecast room vs 10K group chat
Number of participants
For pure 10K group chat scenarios, 10K is already super big group
For livecast room scenarios, 10K is pretty common, and it could be as high as million or 10 millions of participates.
1M or 10M participates
Relationship between user and group
For pure 10K group chat scenarios, the frequency of joining/leaving groups are pretty low.
For livecast room scenarios, the frequency of joining/leaving livecast rooms are pretty high.
10K/s-20K/s joining/leaving livecast room per second.
Duration of groups
For pure 10K group chat scenarios, group memberships could last at least for months or years.
For livecast room scenarios, group memberships could only last a few hours.
Challenges of livecast room
Latency: Livecast room requires realtime interactions and low latency in APIs.
End user experience: From end user perspective, each screen could fit 10-20 messages. If there are more than 20 messages per second pushed down to user device, the screen will stuck in a refreshing loop, resulting in bad user experience.
Bottleneck of large group chat
Batch requests to get presence status
Batch requests to the same client gateway
Handle online users separately from offline users
Save offline messages asynchrnously
Different queue speed for different group
References
Last updated