2022 01 11 bench results

Benchmarked on: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz, 32G RAM

Config:

b4f96b6 Tue, 11 Jan 2022 10:35:33 +0000 Trisfald use move semantics in cpp benches
- GRPC_BENCHMARK_DURATION=120s
- GRPC_BENCHMARK_WARMUP=30s
- GRPC_SERVER_CPUS=1
- GRPC_SERVER_RAM=512m
- GRPC_CLIENT_CONNECTIONS=50
- GRPC_CLIENT_CONCURRENCY=1000
- GRPC_CLIENT_QPS=0
- GRPC_CLIENT_CPUS=9
- GRPC_REQUEST_SCENARIO=complex_proto

1 CPU Server

-----------------------------------------------------------------------------------------------------------------------------------------
| name                        |   req/s |   avg. latency |        90 % in |        95 % in |        99 % in | avg. cpu |   avg. memory |
-----------------------------------------------------------------------------------------------------------------------------------------
| rust_tonic_st               |   47433 |       20.60 ms |       25.05 ms |       26.53 ms |       29.63 ms |  102.16% |      18.7 MiB |
| rust_thruster_st            |   43354 |       22.60 ms |       26.18 ms |       28.38 ms |       31.92 ms |  101.48% |     13.33 MiB |
| rust_tonic_mt               |   40467 |       24.40 ms |       10.46 ms |       11.85 ms |      584.84 ms |  101.02% |     18.15 MiB |
| rust_thruster_mt            |   36296 |       27.26 ms |       11.90 ms |       13.54 ms |      667.92 ms |  101.31% |     14.54 MiB |
| scala_akka                  |   35389 |       26.49 ms |       62.77 ms |       74.83 ms |       96.32 ms |  101.97% |    235.09 MiB |
| dotnet_grpc                 |   34409 |       26.38 ms |       47.22 ms |       64.28 ms |       81.12 ms |  100.95% |    112.14 MiB |
| java_quarkus                |   33761 |       28.90 ms |       51.74 ms |       56.21 ms |       74.03 ms |  100.27% |    104.79 MiB |
| rust_grpcio                 |   32998 |       30.05 ms |       33.38 ms |       34.27 ms |       37.12 ms |  101.87% |     24.82 MiB |
| java_hotspot_grpc_pgc       |   32094 |       30.17 ms |       56.28 ms |       61.95 ms |       83.88 ms |  101.37% |    187.38 MiB |
| java_hotspot_grpc_g1gc      |   29974 |       32.55 ms |       58.96 ms |       64.63 ms |       88.19 ms |  101.38% |    165.94 MiB |
| cpp_grpc_st                 |   28644 |       34.74 ms |       38.44 ms |       40.30 ms |       43.54 ms |  102.37% |      9.25 MiB |
| java_hotspot_grpc_zgc       |   28420 |       34.37 ms |       63.45 ms |       71.47 ms |       86.04 ms |  100.54% |    117.72 MiB |
| cpp_grpc_mt                 |   27808 |       35.80 ms |       39.87 ms |       41.29 ms |       44.29 ms |   102.6% |      9.29 MiB |
| cpp_asio_grpc               |   26619 |       37.42 ms |       42.33 ms |       43.50 ms |       46.19 ms |  101.78% |      8.67 MiB |
| java_hotspot_grpc_she       |   26397 |       37.24 ms |       71.96 ms |       86.03 ms |      101.76 ms |  101.25% |    392.39 MiB |
| java_openj9_grpc_gencon     |   24969 |       38.99 ms |       75.29 ms |       92.09 ms |      198.89 ms |  100.98% |     123.3 MiB |
| java_hotspot_grpc_sgc       |   23281 |       42.23 ms |       74.13 ms |       81.14 ms |       94.91 ms |  100.89% |     81.53 MiB |
| crystal_grpc                |   21783 |       44.94 ms |       54.81 ms |       56.16 ms |       62.42 ms |  127.81% |     38.55 MiB |
| kotlin_grpc                 |   17105 |       57.57 ms |       95.25 ms |      104.07 ms |      179.77 ms |  101.71% |    212.94 MiB |
| java_micronaut              |   11739 |       84.66 ms |      104.43 ms |      116.86 ms |      301.15 ms |  102.68% |    467.53 MiB |
| java_micronaut_workstealing |   11691 |       85.10 ms |       99.33 ms |      107.76 ms |      274.78 ms |  101.91% |    457.09 MiB |
| go_grpc                     |   10012 |       96.01 ms |      194.13 ms |      207.85 ms |      302.57 ms |  100.73% |     31.31 MiB |
| scala_zio                   |    5534 |      179.74 ms |      287.09 ms |      313.76 ms |      508.74 ms |  100.34% |    273.61 MiB |
| erlang_grpcbox              |    5183 |      192.49 ms |      202.26 ms |      206.85 ms |      220.55 ms |  101.72% |     93.51 MiB |
| csharp_grpc                 |    4890 |      203.88 ms |      258.73 ms |      271.58 ms |      286.25 ms |  102.13% |     98.21 MiB |
| elixir_grpc                 |    4604 |      216.67 ms |      243.76 ms |      249.94 ms |      266.60 ms |  100.82% |    124.54 MiB |
| node_grpcjs_st              |    4117 |      241.84 ms |      267.83 ms |      273.13 ms |      288.13 ms |  100.39% |      44.7 MiB |
| scala_fs2                   |    2754 |      361.86 ms |      395.20 ms |      588.27 ms |      796.27 ms |  101.93% |    231.15 MiB |
| python_async_grpc           |    2598 |      383.55 ms |      409.33 ms |      416.56 ms |      450.36 ms |  101.67% |     57.99 MiB |
| python_grpc                 |    2160 |      460.95 ms |      489.49 ms |      493.37 ms |      503.54 ms |  101.99% |     35.19 MiB |
| ruby_grpc                   |    1907 |      521.94 ms |      588.68 ms |      611.91 ms |      697.86 ms |  102.17% |     35.91 MiB |
| java_aot                    |    1661 |      597.73 ms |         1.00 s |         1.19 s |         1.49 s |  100.72% |    177.05 MiB |
| php_grpc                    |     895 |         1.11 s |         1.19 s |         1.19 s |         1.20 s |   101.6% |     66.53 MiB |
-----------------------------------------------------------------------------------------------------------------------------------------

2 CPU Server

3 CPU Server