Highlights

  • Discord, the popular communication platform, has achieved a remarkable feat by expanding the capacity of a single server to support 15 million users, a significant leap from the previous limit of around 1 million users.
  • The challenge began when the MidJourney server’s growth threatened to surpass Discord’s established user limit per server.
  • One of the critical issues encountered was a performance drop due to pathological garbage collection, which occurred when freeing small memory allocations outside the heap. The solution was to tune the virtual binary heap size, which allowed for the enabling of offload and significantly improved throughput.