Occamy against Guacamole¶
The comparison benchmark's results in bench-realtime-2.json, as bench/report.py analyses them: each series' median of every metric in each scenario and network, the improvement of one series over the other, and whether the difference is significant.
How Occamy is measured describes the scenarios, the networks and the metrics, and Analysis the statistics, which were fixed before any data was collected.
The run¶
- Started at 2026-11-03T00:42:45.33314Z, on Apple M5 Pro (18 CPUs, darwin), with podman version 6.0.2.
- 6 runs with seed 20261103; each scenario that measures a key's latency timed 100 keys a run.
- Before each result, the harness waited until the host's 1-minute load average was below 8.
- 352 results analysed, and 8 failed.
- The series are Guacamole and Occamy; Run a comparison gives each one's name in the results files.
How to read this report¶
Each value is the median of the runs, followed by its 95% interval in brackets: an exact interval from order statistics, which assumes nothing about how the values are distributed.
Improvement is the baseline's value divided by the candidate's, or the candidate's divided by the baseline's for a metric where higher is better, such as frames shown a second. Above 1×, the candidate is better: 3× is a third of the baseline's latency, or three times its frames. It's the Hodges–Lehmann estimate of that ratio, with its exact 95% interval from the Mann–Whitney distribution.
p is the exact two-sided permutation test of the rank sum, over every split of the runs. Each scenario's primary metric is the one its comparison is judged on. p (Holm) corrects the primary metrics' p-values with Holm's method, and a difference is significant where it's below 0.05. The other metrics, the secondary ones, are exploratory, and their p-values aren't corrected.
Failed results¶
These results failed, and the analysis leaves them out.
| Series | Scenario | Network | Run | Error |
|---|---|---|---|---|
| Guacamole | Key during motion, RDP, 2% lost | 50 ms, 20 Mbit/s | 0 | probe key 2: context deadline exceeded |
| Guacamole | Key during motion, VNC, 2% lost | 50 ms, 20 Mbit/s | 1 | probe key 58: context deadline exceeded |
| Guacamole | Key during motion, RDP, 2% lost | 50 ms, 20 Mbit/s | 1 | probe key 10: context deadline exceeded |
| Guacamole | Key during motion, RDP, 2% lost | 50 ms, 20 Mbit/s | 2 | probe key 5: context deadline exceeded |
| Guacamole | Key during motion, VNC, 2% lost | 50 ms, 20 Mbit/s | 3 | probe key 20: context deadline exceeded |
| Guacamole | Key during motion, RDP, 2% lost | 50 ms, 20 Mbit/s | 3 | probe key 10: context deadline exceeded |
| Guacamole | Key during motion, RDP, 2% lost | 50 ms, 20 Mbit/s | 4 | probe key 2: context deadline exceeded |
| Guacamole | Key during motion, RDP, 2% lost | 50 ms, 20 Mbit/s | 5 | probe key 47: context deadline exceeded |
Primary metrics¶
Each scenario's primary metric for Guacamole and Occamy, and the improvement of Occamy over Guacamole: above 1×, Occamy is better. Holm's correction is over these 29 tests.
| Scenario | Network | Metric | Guacamole | Occamy | Improvement | p | p (Holm) |
|---|---|---|---|---|---|---|---|
| Typing, SSH, 0% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 22.2 [22.2, 22.4] | 21.4 [21.3, 21.6] | 1.04× [1.03, 1.05] | 0.0022 | 0.0628 |
| Typing, SSH, 0.5% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 22.4 [22.0, 22.8] | 21.6 [21.4, 22.8] | 1.04× [1.00, 1.06] | 0.0411 | 0.4113 |
| Typing, SSH, 2% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 27.3 [22.3, 31.9] | 22.2 [21.5, 24.4] | 1.18× [0.998, 1.46] | 0.0649 | 0.5844 |
| Key press, VNC, 0% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 35.9 [35.7, 36.4] | 24.4 [24.4, 24.6] | 1.47× [1.46, 1.48] | 0.0022 | 0.0628 |
| Key press, VNC, 0.5% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 35.6 [35.5, 36.1] | 24.5 [24.4, 26.4] | 1.45× [1.37, 1.47] | 0.0022 | 0.0628 |
| Key press, VNC, 2% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 35.8 [35.6, 37.4] | 25.2 [24.4, 52.4] | 1.43× [0.703, 1.47] | 0.3939 | 1.0000 |
| Key press, RDP, 0% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 38.5 [38.2, 38.7] | 27.3 [26.4, 32.4] | 1.41× [1.19, 1.46] | 0.0022 | 0.0628 |
| Key press, RDP, 0.5% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 38.6 [38.0, 39.9] | 27.3 [26.4, 135] | 1.41× [0.295, 1.46] | 0.0649 | 0.5844 |
| Key press, RDP, 2% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 39.9 [38.1, 44.9] | 42.3 [27.7, 73.1] | 0.982× [0.615, 1.41] | 0.9372 | 1.0000 |
| Key during motion, VNC, 0% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 132 [123, 172] | 59.1 [56.3, 93.6] | 2.23× [1.84, 2.42] | 0.0022 | 0.0628 |
| Key during motion, VNC, 0.5% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 164 [152, 184] | 68.7 [63.8, 132] | 2.35× [1.40, 2.67] | 0.0022 | 0.0628 |
| Key during motion, VNC, 2% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 255 [209, 2,857] | 119 [104, 153] | 2.16× [1.69, 18.6] | 0.0022 | 0.0628 |
| Key during motion, RDP, 0% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 121 [117, 130] | 80.6 [80.4, 118] | 1.50× [1.10, 1.57] | 0.0043 | 0.0628 |
| Key during motion, RDP, 0.5% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 165 [153, 1,734] | 96.5 [92.5, 98.0] | 1.73× [1.60, 17.7] | 0.0022 | 0.0628 |
| Key during motion, RDP, 2% lost | 20 ms, 100 Mbit/s | Latency, 95th percentile (ms) | 2,188 [264, 4,186] | 149 [120, 171] | 7.85× [1.82, 28.5] | 0.0022 | 0.0628 |
| Typing, SSH, 0% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 52.6 [52.3, 55.5] | 51.7 [51.5, 52.0] | 1.02× [1.01, 1.07] | 0.0022 | 0.0628 |
| Typing, SSH, 0.5% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 52.5 [52.4, 53.2] | 51.6 [51.5, 52.0] | 1.02× [1.01, 1.03] | 0.0022 | 0.0628 |
| Typing, SSH, 2% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 52.7 [52.4, 55.7] | 52.7 [51.7, 117] | 1.00× [0.475, 1.02] | 0.9372 | 1.0000 |
| Key press, VNC, 0% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 66.0 [65.7, 71.5] | 54.6 [54.4, 56.1] | 1.21× [1.20, 1.27] | 0.0022 | 0.0628 |
| Key press, VNC, 0.5% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 66.1 [65.7, 71.6] | 54.5 [54.4, 101] | 1.21× [0.71, 1.27] | 0.0649 | 0.5844 |
| Key press, VNC, 2% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 66.2 [66.1, 66.5] | 54.9 [54.4, 118] | 1.21× [0.563, 1.22] | 0.0649 | 0.5844 |
| Key press, RDP, 0% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 69.0 [68.3, 71.4] | 56.8 [56.7, 58.7] | 1.21× [1.20, 1.22] | 0.0022 | 0.0628 |
| Key press, RDP, 0.5% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 68.8 [68.0, 69.9] | 57.2 [56.5, 59.4] | 1.20× [1.16, 1.22] | 0.0022 | 0.0628 |
| Key press, RDP, 2% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 77.6 [67.7, 81.0] | 57.9 [56.9, 123] | 1.21× [0.658, 1.39] | 0.1320 | 0.5844 |
| Key during motion, VNC, 0% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 184 [169, 219] | 98.2 [90.7, 971] | 1.92× [0.226, 2.27] | 0.0649 | 0.5844 |
| Key during motion, VNC, 0.5% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 339 [276, 3,942] | 169 [129, 249] | 2.18× [1.43, 22.5] | 0.0022 | 0.0628 |
| Key during motion, VNC, 2% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 7,053 | 379 [350, 430] | 18.0× [14.5, 22.5] | 0.0095 | 0.1048 |
| Key during motion, RDP, 0% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 179 [172, 226] | 113 [111, 114] | 1.59× [1.55, 1.98] | 0.0022 | 0.0628 |
| Key during motion, RDP, 0.5% lost | 50 ms, 20 Mbit/s | Latency, 95th percentile (ms) | 5,575 [362, 7,941] | 196 [166, 273] | 27.1× [2.18, 36.3] | 0.0022 | 0.0628 |
0 of the 29 differences are significant after the correction. With this many runs, the exact test's smallest p is 0.0022, so after the correction over 29 tests no difference can be significant, and the intervals carry the evidence.
Secondary metrics¶
The other metrics that each scenario records, for Guacamole and Occamy. They're exploratory, and their p-values aren't corrected.
| Scenario | Network | Metric | Guacamole | Occamy | Improvement | p |
|---|---|---|---|---|---|---|
| Typing, SSH, 0% lost | 20 ms, 100 Mbit/s | Latency, median (ms) | 21.8 [21.6, 21.9] | 21.1 [21.0, 21.1] | 1.04× [1.03, 1.04] | 0.0022 |
| Typing, SSH, 0% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 93.2 [42.0, 147] | 67.3 [16.3, 78.5] | 1.67× [0.609, 6.05] | 0.1797 |
| Typing, SSH, 0% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 58.3 [52.3, 64.7] | 51.1 [43.8, 55.1] | 1.18× [1.03, 1.30] | 0.0043 |
| Typing, SSH, 0.5% lost | 20 ms, 100 Mbit/s | Latency, median (ms) | 21.7 [21.5, 21.9] | 21.1 [21.0, 21.4] | 1.03× [1.02, 1.04] | 0.0022 |
| Typing, SSH, 0.5% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 95.0 [39.7, 124] | 71.0 [18.5, 73.2] | 1.59× [0.587, 2.18] | 0.2403 |
| Typing, SSH, 0.5% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 56.0 [53.2, 59.0] | 47.3 [43.8, 63.6] | 1.20× [0.928, 1.29] | 0.0649 |
| Typing, SSH, 2% lost | 20 ms, 100 Mbit/s | Latency, median (ms) | 21.8 [21.7, 21.9] | 21.1 [21.0, 21.2] | 1.03× [1.03, 1.04] | 0.0022 |
| Typing, SSH, 2% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 94.8 [42.0, 148] | 68.6 [10.8, 75.2] | 1.99× [0.575, 3.89] | 0.6667 |
| Typing, SSH, 2% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 58.9 [54.1, 67.3] | 50.4 [45.6, 57.1] | 1.17× [1.04, 1.29] | 0.0260 |
| Key press, VNC, 0% lost | 20 ms, 100 Mbit/s | Latency, median (ms) | 34.8 [34.7, 35.0] | 23.8 [23.7, 23.9] | 1.46× [1.46, 1.47] | 0.0022 |
| Key press, VNC, 0% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 85.9 [50.5, 123] | 70.6 [23.4, 78.5] | 1.65× [0.68, 4.88] | 0.3939 |
| Key press, VNC, 0% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 63.2 [58.2, 517] | 63.4 [52.5, 64.9] | 1.10× [0.948, 7.95] | 0.4848 |
| Key press, VNC, 0.5% lost | 20 ms, 100 Mbit/s | Latency, median (ms) | 34.7 [34.7, 34.8] | 23.7 [23.7, 24.1] | 1.46× [1.44, 1.47] | 0.0022 |
| Key press, VNC, 0.5% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 86.3 [30.9, 123] | 71.5 [25.6, 73.8] | 1.66× [0.667, 2.17] | 0.6991 |
| Key press, VNC, 0.5% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 64.6 [60.6, 69.1] | 57.9 [53.2, 74.0] | 1.12× [0.934, 1.20] | 0.0649 |
| Key press, VNC, 2% lost | 20 ms, 100 Mbit/s | Latency, median (ms) | 34.7 [34.7, 34.9] | 23.7 [23.6, 23.8] | 1.47× [1.46, 1.47] | 0.0022 |
| Key press, VNC, 2% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 86.4 [50.0, 123] | 68.5 [17.6, 78.8] | 1.61× [0.689, 2.84] | 0.3939 |
| Key press, VNC, 2% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 59.8 [58.5, 68.5] | 59.3 [52.7, 60.5] | 1.03× [0.987, 1.15] | 0.3095 |
| Key press, RDP, 0% lost | 20 ms, 100 Mbit/s | Latency, median (ms) | 37.1 [37.0, 37.3] | 25.9 [25.8, 26.2] | 1.43× [1.42, 1.44] | 0.0022 |
| Key press, RDP, 0% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 110 [72.0, 145] | 52.7 [49.3, 68.7] | 1.80× [1.36, 2.89] | 0.0022 |
| Key press, RDP, 0% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 68.6 [64.0, 454] | 66.6 [59.7, 210] | 1.05× [0.884, 2.16] | 0.6991 |
| Key press, RDP, 0.5% lost | 20 ms, 100 Mbit/s | Latency, median (ms) | 37.1 [37.0, 37.2] | 25.9 [25.9, 33.6] | 1.43× [1.11, 1.43] | 0.0022 |
| Key press, RDP, 0.5% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 108 [71.5, 145] | 52.8 [47.5, 54.1] | 2.01× [1.35, 2.89] | 0.0022 |
| Key press, RDP, 0.5% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 68.5 [66.4, 482] | 63.2 [57.5, 87.6] | 1.10× [1.01, 5.50] | 0.0411 |
| Key press, RDP, 2% lost | 20 ms, 100 Mbit/s | Latency, median (ms) | 37.1 [37.0, 37.2] | 25.9 [25.9, 26.0] | 1.43× [1.43, 1.44] | 0.0022 |
| Key press, RDP, 2% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 99.0 [71.6, 144] | 55.2 [49.0, 60.8] | 1.75× [1.27, 2.65] | 0.0022 |
| Key press, RDP, 2% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 66.4 [65.0, 70.7] | 64.0 [58.5, 212] | 1.04× [0.334, 1.12] | 0.0649 |
| Key during motion, VNC, 0% lost | 20 ms, 100 Mbit/s | Frames shown a second (frames/s) | 27.2 [24.4, 28.1] | 29.8 [28.1, 30.2] | 1.09× [1.06, 1.15] | 0.0043 |
| Key during motion, VNC, 0% lost | 20 ms, 100 Mbit/s | Scene frames never shown (%) | 9.17 [6.24, 18.6] | 0.829 [-0.502, 6.25] | –× | 0.0043 |
| Key during motion, VNC, 0% lost | 20 ms, 100 Mbit/s | Gap between frames, 95th percentile (ms) | 59.6 [55.5, 75.3] | 48.0 [47.2, 52.3] | 1.23× [1.15, 1.44] | 0.0022 |
| Key during motion, VNC, 0% lost | 20 ms, 100 Mbit/s | Data per frame (KiB) | 49.8 [49.0, 51.2] | 14.2 [14.1, 14.4] | 3.51× [3.46, 3.57] | 0.0022 |
| Key during motion, VNC, 0% lost | 20 ms, 100 Mbit/s | Server CPU per frame (ms) | 46.1 [45.4, 51.0] | 19.2 [18.8, 20.5] | 2.41× [2.30, 2.51] | 0.0022 |
| Key during motion, VNC, 0% lost | 20 ms, 100 Mbit/s | Server CPU time (ms) | 12,714 [12,449, 14,333] | 5,674 [5,635, 5,854] | 2.24× [2.19, 2.45] | 0.0022 |
| Key during motion, VNC, 0% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 86.4 [50.2, 123] | 70.3 [53.3, 76.2] | 1.24× [0.682, 2.19] | 1.0000 |
| Key during motion, VNC, 0% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 5,019 [4,945, 5,650] | 2,121 [2,104, 2,227] | 2.35× [2.26, 2.54] | 0.0022 |
| Key during motion, VNC, 0.5% lost | 20 ms, 100 Mbit/s | Frames shown a second (frames/s) | 24.4 [23.2, 25.7] | 29.7 [26.5, 29.8] | 1.21× [1.14, 1.25] | 0.0022 |
| Key during motion, VNC, 0.5% lost | 20 ms, 100 Mbit/s | Scene frames never shown (%) | 18.7 [14.3, 22.6] | 0.941 [0.546, 11.8] | 19.9× [1.92, 32.6] | 0.0022 |
| Key during motion, VNC, 0.5% lost | 20 ms, 100 Mbit/s | Gap between frames, 95th percentile (ms) | 74.6 [69.4, 83.3] | 58.5 [54.6, 71.7] | 1.28× [1.14, 1.41] | 0.0087 |
| Key during motion, VNC, 0.5% lost | 20 ms, 100 Mbit/s | Data per frame (KiB) | 44.3 [40.6, 47.8] | 14.2 [14.1, 14.3] | 3.11× [2.87, 3.35] | 0.0022 |
| Key during motion, VNC, 0.5% lost | 20 ms, 100 Mbit/s | Server CPU per frame (ms) | 45.5 [44.6, 46.4] | 19.1 [18.9, 27.0] | 2.39× [1.72, 2.43] | 0.0022 |
| Key during motion, VNC, 0.5% lost | 20 ms, 100 Mbit/s | Server CPU time (ms) | 12,549 [12,276, 12,943] | 5,643 [5,607, 7,191] | 2.21× [1.80, 2.25] | 0.0022 |
| Key during motion, VNC, 0.5% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 86.5 [44.1, 123] | 66.1 [51.3, 73.3] | 1.29× [0.694, 2.24] | 1.0000 |
| Key during motion, VNC, 0.5% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 5,055 [4,971, 5,186] | 2,148 [2,076, 2,289] | 2.35× [2.26, 2.42] | 0.0022 |
| Key during motion, VNC, 2% lost | 20 ms, 100 Mbit/s | Frames shown a second (frames/s) | 16.1 [1.08, 16.6] | 27.8 [27.0, 28.6] | 1.73× [1.67, 25.1] | 0.0022 |
| Key during motion, VNC, 2% lost | 20 ms, 100 Mbit/s | Scene frames never shown (%) | 46.4 [44.7, 96.4] | 7.45 [4.82, 9.89] | 9.15× [5.49, 12.8] | 0.0022 |
| Key during motion, VNC, 2% lost | 20 ms, 100 Mbit/s | Gap between frames, 95th percentile (ms) | 121 [108, 1,553] | 67.7 [62.8, 72.4] | 1.80× [1.62, 21.5] | 0.0022 |
| Key during motion, VNC, 2% lost | 20 ms, 100 Mbit/s | Data per frame (KiB) | 32.9 [31.5, 551] | 14.3 [14.1, 14.4] | 2.31× [2.20, 38.3] | 0.0022 |
| Key during motion, VNC, 2% lost | 20 ms, 100 Mbit/s | Server CPU per frame (ms) | 49.4 [48.6, 336] | 19.5 [19.1, 20.8] | 2.54× [2.47, 16.1] | 0.0022 |
| Key during motion, VNC, 2% lost | 20 ms, 100 Mbit/s | Server CPU time (ms) | 12,714 [12,293, 67,251] | 5,486 [5,340, 5,789] | 2.32× [2.23, 11.6] | 0.0022 |
| Key during motion, VNC, 2% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 86.6 [50.3, 123] | 58.6 [49.5, 78.3] | 1.27× [0.751, 2.44] | 0.2403 |
| Key during motion, VNC, 2% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 4,933 [4,719, 7,602] | 2,044 [1,904, 2,283] | 2.45× [2.28, 3.33] | 0.0022 |
| Key during motion, RDP, 0% lost | 20 ms, 100 Mbit/s | Frames shown a second (frames/s) | 24.3 [24.0, 24.6] | 24.4 [23.6, 24.9] | 1.01× [0.984, 1.02] | 0.6991 |
| Key during motion, RDP, 0% lost | 20 ms, 100 Mbit/s | Scene frames never shown (%) | 18.8 [18.1, 20.0] | 18.7 [17.1, 21.3] | 1.02× [0.939, 1.10] | 0.6991 |
| Key during motion, RDP, 0% lost | 20 ms, 100 Mbit/s | Gap between frames, 95th percentile (ms) | 48.7 [46.3, 53.8] | 43.5 [41.5, 69.5] | 1.11× [0.774, 1.17] | 0.0931 |
| Key during motion, RDP, 0% lost | 20 ms, 100 Mbit/s | Data per frame (KiB) | 66.2 [66.1, 67.2] | 14.2 [14.0, 14.3] | 4.70× [4.63, 4.76] | 0.0022 |
| Key during motion, RDP, 0% lost | 20 ms, 100 Mbit/s | Server CPU per frame (ms) | 55.4 [54.6, 56.1] | 19.9 [19.3, 25.7] | 2.77× [2.19, 2.84] | 0.0022 |
| Key during motion, RDP, 0% lost | 20 ms, 100 Mbit/s | Server CPU time (ms) | 13,451 [13,357, 13,635] | 4,834 [4,789, 6,214] | 2.78× [2.19, 2.83] | 0.0022 |
| Key during motion, RDP, 0% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 107 [64.4, 141] | 73.1 [67.7, 77.4] | 1.40× [0.909, 2.01] | 0.6991 |
| Key during motion, RDP, 0% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 5,776 [5,583, 5,838] | 1,775 [1,679, 1,807] | 3.25× [3.17, 3.37] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 20 ms, 100 Mbit/s | Frames shown a second (frames/s) | 22.3 [4.58, 22.9] | 24.3 [24.1, 24.6] | 1.09× [1.06, 5.26] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 20 ms, 100 Mbit/s | Scene frames never shown (%) | 25.7 [23.5, 84.7] | 18.9 [18.1, 19.7] | 1.35× [1.23, 4.30] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 20 ms, 100 Mbit/s | Gap between frames, 95th percentile (ms) | 82.2 [73.5, 877] | 59.3 [55.9, 59.6] | 1.39× [1.29, 14.7] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 20 ms, 100 Mbit/s | Data per frame (KiB) | 50.1 [47.1, 300] | 14.2 [14.1, 14.3] | 3.52× [3.33, 20.9] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 20 ms, 100 Mbit/s | Server CPU per frame (ms) | 51.1 [50.7, 185] | 20.0 [19.7, 20.3] | 2.56× [2.52, 9.09] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 20 ms, 100 Mbit/s | Server CPU time (ms) | 14,467 [13,887, 48,582] | 4,833 [4,794, 4,938] | 2.98× [2.89, 9.84] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 106 [62.8, 144] | 72.0 [67.9, 78.2] | 1.38× [0.907, 2.04] | 0.5887 |
| Key during motion, RDP, 0.5% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 6,487 [6,232, 9,133] | 1,807 [1,739, 1,833] | 3.59× [3.46, 4.98] | 0.0022 |
| Key during motion, RDP, 2% lost | 20 ms, 100 Mbit/s | Frames shown a second (frames/s) | 6.64 [0.591, 14.4] | 24.4 [24.0, 24.8] | 8.78× [1.70, 40.7] | 0.0022 |
| Key during motion, RDP, 2% lost | 20 ms, 100 Mbit/s | Scene frames never shown (%) | 77.9 [52.0, 98.0] | 18.7 [17.2, 20.0] | 4.06× [2.75, 5.49] | 0.0022 |
| Key during motion, RDP, 2% lost | 20 ms, 100 Mbit/s | Gap between frames, 95th percentile (ms) | 1,211 [131, 2,426] | 64.8 [62.2, 72.1] | 9.09× [2.07, 38.1] | 0.0022 |
| Key during motion, RDP, 2% lost | 20 ms, 100 Mbit/s | Data per frame (KiB) | 537 [33.8, 1,055] | 14.1 [14.1, 14.2] | 13.6× [2.40, 74.4] | 0.0022 |
| Key during motion, RDP, 2% lost | 20 ms, 100 Mbit/s | Server CPU per frame (ms) | 378 [54.4, 721] | 19.8 [19.7, 19.9] | 10.0× [2.76, 36.3] | 0.0022 |
| Key during motion, RDP, 2% lost | 20 ms, 100 Mbit/s | Server CPU time (ms) | 76,455 [13,653, 142,099] | 4,899 [4,865, 4,979] | 9.05× [2.81, 29.0] | 0.0022 |
| Key during motion, RDP, 2% lost | 20 ms, 100 Mbit/s | Server memory, peak (MiB) | 103 [63.8, 143] | 73.7 [65.2, 81.4] | 1.35× [0.888, 1.99] | 0.5887 |
| Key during motion, RDP, 2% lost | 20 ms, 100 Mbit/s | Client CPU time (ms) | 8,835 [5,608, 12,098] | 1,839 [1,812, 1,898] | 4.49× [3.05, 6.56] | 0.0022 |
| Typing, SSH, 0% lost | 50 ms, 20 Mbit/s | Latency, median (ms) | 52.0 [52.0, 52.2] | 51.2 [51.1, 51.3] | 1.02× [1.01, 1.02] | 0.0022 |
| Typing, SSH, 0% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 95.0 [42.0, 124] | 65.1 [12.7, 70.2] | 1.64× [1.08, 3.30] | 0.0411 |
| Typing, SSH, 0% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 57.4 [51.4, 67.0] | 50.6 [46.1, 59.3] | 1.14× [0.995, 1.30] | 0.0931 |
| Typing, SSH, 0.5% lost | 50 ms, 20 Mbit/s | Latency, median (ms) | 52.1 [52.0, 52.3] | 51.1 [51.1, 51.5] | 1.02× [1.02, 1.02] | 0.0022 |
| Typing, SSH, 0.5% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 95.0 [41.8, 148] | 68.3 [15.2, 81.2] | 1.63× [0.648, 2.76] | 0.3095 |
| Typing, SSH, 0.5% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 63.1 [56.2, 68.2] | 48.3 [42.1, 59.1] | 1.29× [1.11, 1.43] | 0.0087 |
| Typing, SSH, 2% lost | 50 ms, 20 Mbit/s | Latency, median (ms) | 52.0 [51.9, 52.2] | 51.1 [51.0, 51.4] | 1.02× [1.02, 1.02] | 0.0022 |
| Typing, SSH, 2% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 112 [75.9, 148] | 68.4 [7.14, 70.8] | 2.13× [1.09, 10.6] | 0.0022 |
| Typing, SSH, 2% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 56.2 [50.2, 65.2] | 46.2 [45.1, 50.9] | 1.20× [1.10, 1.37] | 0.0043 |
| Key press, VNC, 0% lost | 50 ms, 20 Mbit/s | Latency, median (ms) | 65.1 [64.9, 65.5] | 53.9 [53.8, 54.0] | 1.21× [1.20, 1.22] | 0.0022 |
| Key press, VNC, 0% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 86.5 [50.0, 123] | 67.4 [18.8, 73.2] | 1.69× [0.707, 2.65] | 0.6991 |
| Key press, VNC, 0% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 65.5 [59.6, 73.3] | 60.9 [58.2, 67.2] | 1.07× [0.964, 1.20] | 0.3095 |
| Key press, VNC, 0.5% lost | 50 ms, 20 Mbit/s | Latency, median (ms) | 65.1 [64.8, 65.9] | 53.8 [53.7, 55.3] | 1.21× [1.19, 1.21] | 0.0022 |
| Key press, VNC, 0.5% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 86.9 [50.3, 123] | 60.2 [21.5, 82.2] | 1.71× [0.708, 4.70] | 0.1797 |
| Key press, VNC, 0.5% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 60.8 [59.1, 77.5] | 59.1 [57.3, 75.6] | 1.03× [0.984, 1.19] | 0.1320 |
| Key press, VNC, 2% lost | 50 ms, 20 Mbit/s | Latency, median (ms) | 65.1 [65.0, 65.5] | 53.8 [53.8, 54.1] | 1.21× [1.21, 1.21] | 0.0022 |
| Key press, VNC, 2% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 86.5 [50.0, 123] | 70.3 [13.8, 73.4] | 1.71× [0.699, 4.82] | 0.3680 |
| Key press, VNC, 2% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 63.5 [57.4, 76.6] | 57.9 [53.6, 72.0] | 1.09× [0.925, 1.21] | 0.0931 |
| Key press, RDP, 0% lost | 50 ms, 20 Mbit/s | Latency, median (ms) | 67.2 [67.1, 67.9] | 56.1 [56.0, 56.5] | 1.20× [1.19, 1.21] | 0.0022 |
| Key press, RDP, 0% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 109 [71.6, 146] | 51.4 [30.4, 53.9] | 2.53× [1.39, 3.11] | 0.0022 |
| Key press, RDP, 0% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 72.5 [68.0, 395] | 64.9 [61.4, 86.8] | 1.12× [0.956, 4.55] | 0.1320 |
| Key press, RDP, 0.5% lost | 50 ms, 20 Mbit/s | Latency, median (ms) | 67.2 [67.1, 67.4] | 56.0 [55.9, 56.7] | 1.20× [1.19, 1.20] | 0.0022 |
| Key press, RDP, 0.5% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 111 [71.9, 145] | 52.7 [49.4, 56.2] | 2.01× [1.35, 2.86] | 0.0022 |
| Key press, RDP, 0.5% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 67.4 [63.4, 388] | 64.5 [58.0, 82.8] | 1.08× [0.947, 4.69] | 0.3095 |
| Key press, RDP, 2% lost | 50 ms, 20 Mbit/s | Latency, median (ms) | 67.2 [67.1, 67.3] | 56.0 [56.0, 56.2] | 1.20× [1.20, 1.20] | 0.0022 |
| Key press, RDP, 2% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 98.3 [52.6, 144] | 51.7 [47.1, 55.5] | 1.85× [1.12, 2.84] | 0.0152 |
| Key press, RDP, 2% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 63.9 [61.1, 71.4] | 61.1 [59.3, 62.7] | 1.05× [1.00, 1.14] | 0.0411 |
| Key during motion, VNC, 0% lost | 50 ms, 20 Mbit/s | Frames shown a second (frames/s) | 26.0 [22.8, 26.8] | 29.7 [10.8, 30.1] | 1.14× [0.475, 1.24] | 0.0649 |
| Key during motion, VNC, 0% lost | 50 ms, 20 Mbit/s | Scene frames never shown (%) | 13.3 [10.6, 24.1] | 1.15 [-0.418, 63.9] | –× | 0.0649 |
| Key during motion, VNC, 0% lost | 50 ms, 20 Mbit/s | Gap between frames, 95th percentile (ms) | 66.6 [60.6, 76.0] | 49.4 [47.2, 386] | 1.32× [0.197, 1.49] | 0.0649 |
| Key during motion, VNC, 0% lost | 50 ms, 20 Mbit/s | Data per frame (KiB) | 46.1 [46.0, 47.5] | 14.2 [14.1, 19.9] | 3.26× [2.39, 3.31] | 0.0022 |
| Key during motion, VNC, 0% lost | 50 ms, 20 Mbit/s | Server CPU per frame (ms) | 45.4 [44.5, 52.1] | 19.3 [18.7, 36.2] | 2.36× [1.44, 2.60] | 0.0022 |
| Key during motion, VNC, 0% lost | 50 ms, 20 Mbit/s | Server CPU time (ms) | 16,652 [16,255, 19,031] | 5,752 [5,634, 8,653] | 2.89× [2.20, 3.24] | 0.0022 |
| Key during motion, VNC, 0% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 85.7 [49.1, 121] | 67.1 [48.5, 73.2] | 1.31× [0.707, 2.37] | 0.6991 |
| Key during motion, VNC, 0% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 6,779 [6,482, 7,940] | 2,236 [2,076, 2,412] | 3.06× [2.89, 3.51] | 0.0022 |
| Key during motion, VNC, 0.5% lost | 50 ms, 20 Mbit/s | Frames shown a second (frames/s) | 13.8 [1.85, 20.2] | 27.5 [25.4, 29.0] | 2.01× [1.44, 13.7] | 0.0022 |
| Key during motion, VNC, 0.5% lost | 50 ms, 20 Mbit/s | Scene frames never shown (%) | 54.2 [32.8, 93.8] | 8.40 [3.32, 15.3] | 6.74× [3.74, 16.0] | 0.0022 |
| Key during motion, VNC, 0.5% lost | 50 ms, 20 Mbit/s | Gap between frames, 95th percentile (ms) | 154 [104, 1,395] | 73.6 [71.3, 83.3] | 2.08× [1.46, 17.9] | 0.0022 |
| Key during motion, VNC, 0.5% lost | 50 ms, 20 Mbit/s | Data per frame (KiB) | 39.0 [33.9, 297] | 14.2 [14.1, 14.8] | 2.69× [2.40, 20.0] | 0.0022 |
| Key during motion, VNC, 0.5% lost | 50 ms, 20 Mbit/s | Server CPU per frame (ms) | 53.3 [47.8, 204] | 19.6 [19.0, 23.6] | 2.72× [2.44, 8.66] | 0.0022 |
| Key during motion, VNC, 0.5% lost | 50 ms, 20 Mbit/s | Server CPU time (ms) | 16,420 [16,051, 67,404] | 6,300 [5,761, 6,864] | 2.72× [2.41, 9.82] | 0.0022 |
| Key during motion, VNC, 0.5% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 86.3 [49.1, 122] | 62.2 [51.9, 81.5] | 1.21× [0.699, 2.31] | 1.0000 |
| Key during motion, VNC, 0.5% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 6,435 [5,793, 9,911] | 2,302 [2,243, 2,474] | 2.77× [2.54, 4.01] | 0.0022 |
| Key during motion, VNC, 2% lost | 50 ms, 20 Mbit/s | Frames shown a second (frames/s) | 0.534 | 16.8 [15.5, 17.8] | 31.6× [24.9, 40.2] | 0.0095 |
| Key during motion, VNC, 2% lost | 50 ms, 20 Mbit/s | Scene frames never shown (%) | 98.2 | 44.1 [40.8, 48.3] | 2.23× [2.04, 2.40] | 0.0095 |
| Key during motion, VNC, 2% lost | 50 ms, 20 Mbit/s | Gap between frames, 95th percentile (ms) | 3,270 | 150 [138, 154] | 22.1× [20.0, 23.9] | 0.0095 |
| Key during motion, VNC, 2% lost | 50 ms, 20 Mbit/s | Data per frame (KiB) | 473 | 14.6 [14.4, 15.4] | 31.3× [26.8, 38.4] | 0.0095 |
| Key during motion, VNC, 2% lost | 50 ms, 20 Mbit/s | Server CPU per frame (ms) | 597 | 24.1 [23.6, 25.4] | 24.0× [19.6, 29.7] | 0.0095 |
| Key during motion, VNC, 2% lost | 50 ms, 20 Mbit/s | Server CPU time (ms) | 146,271 | 8,630 [8,275, 9,358] | 16.7× [15.4, 17.9] | 0.0095 |
| Key during motion, VNC, 2% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 85.2 | 67.2 [45.3, 72.0] | 1.35× [0.701, 2.13] | 0.7619 |
| Key during motion, VNC, 2% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 9,987 | 2,614 [2,487, 2,810] | 3.75× [3.26, 4.46] | 0.0095 |
| Key during motion, RDP, 0% lost | 50 ms, 20 Mbit/s | Frames shown a second (frames/s) | 24.2 [23.4, 24.5] | 24.4 [24.0, 24.7] | 1.01× [0.991, 1.03] | 0.1320 |
| Key during motion, RDP, 0% lost | 50 ms, 20 Mbit/s | Scene frames never shown (%) | 19.3 [18.3, 21.9] | 18.6 [17.7, 20.2] | 1.06× [0.961, 1.14] | 0.1320 |
| Key during motion, RDP, 0% lost | 50 ms, 20 Mbit/s | Gap between frames, 95th percentile (ms) | 59.6 [54.6, 70.3] | 45.0 [42.3, 54.2] | 1.30× [1.11, 1.42] | 0.0022 |
| Key during motion, RDP, 0% lost | 50 ms, 20 Mbit/s | Data per frame (KiB) | 53.9 [50.8, 54.6] | 14.2 [14.1, 14.4] | 3.78× [3.60, 3.84] | 0.0022 |
| Key during motion, RDP, 0% lost | 50 ms, 20 Mbit/s | Server CPU per frame (ms) | 52.1 [50.7, 59.5] | 20.0 [19.8, 21.4] | 2.61× [2.51, 2.78] | 0.0022 |
| Key during motion, RDP, 0% lost | 50 ms, 20 Mbit/s | Server CPU time (ms) | 18,280 [17,675, 22,684] | 4,890 [4,836, 5,224] | 3.73× [3.61, 4.34] | 0.0022 |
| Key during motion, RDP, 0% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 99.6 [60.6, 136] | 69.5 [67.5, 76.2] | 1.30× [0.878, 1.96] | 1.0000 |
| Key during motion, RDP, 0% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 7,918 [7,445, 10,045] | 1,912 [1,867, 2,028] | 4.14× [3.91, 4.95] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 50 ms, 20 Mbit/s | Frames shown a second (frames/s) | 0.601 [0.521, 11.8] | 24.1 [22.5, 24.4] | 39.1× [2.06, 44.2] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 50 ms, 20 Mbit/s | Scene frames never shown (%) | 98.0 [60.5, 98.3] | 19.6 [18.8, 25.1] | 4.82× [3.22, 5.11] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 50 ms, 20 Mbit/s | Gap between frames, 95th percentile (ms) | 2,918 [167, 3,020] | 82.6 [73.8, 89.6] | 33.9× [2.27, 37.3] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 50 ms, 20 Mbit/s | Data per frame (KiB) | 923 [34.8, 1,050] | 14.2 [14.1, 14.3] | 64.8× [2.48, 74.0] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 50 ms, 20 Mbit/s | Server CPU per frame (ms) | 703 [58.4, 769] | 20.3 [19.8, 21.2] | 34.3× [2.95, 37.6] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 50 ms, 20 Mbit/s | Server CPU time (ms) | 149,871 [16,176, 217,332] | 5,945 [5,312, 6,555] | 25.1× [3.05, 33.2] | 0.0022 |
| Key during motion, RDP, 0.5% lost | 50 ms, 20 Mbit/s | Server memory, peak (MiB) | 100 [60.7, 134] | 73.0 [68.3, 78.8] | 1.30× [0.844, 1.89] | 0.8182 |
| Key during motion, RDP, 0.5% lost | 50 ms, 20 Mbit/s | Client CPU time (ms) | 12,898 [6,038, 19,024] | 2,212 [1,951, 2,389] | 5.83× [3.10, 7.96] | 0.0022 |
What packet loss adds to the primary metrics¶
For each series, what losing a share of the packets to the client added to a metric, over the same scenario and network without loss. Both are measured on a link emulated in the kernel. Added is the Hodges–Lehmann estimate of the difference, in the metric's unit, with its exact 95% interval from the Mann–Whitney distribution; the network's round trip is beside it, for scale. The table has each scenario's primary metric, and Holm's correction is over its 39 tests.
| Series | Scenario | Network | Loss | Metric | Without loss | With loss | Added | Round trip | p | p (Holm) |
|---|---|---|---|---|---|---|---|---|---|---|
| Guacamole | Typing, SSH | 20 ms, 100 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 22.2 [22.2, 22.4] | 22.4 [22.0, 22.8] | 0.121 [-0.182, 0.45] | 20 ms | 0.4848 | 1.0000 |
| Occamy | Typing, SSH | 20 ms, 100 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 21.4 [21.3, 21.6] | 21.6 [21.4, 22.8] | 0.15 [-0.028, 1.16] | 20 ms | 0.0649 | 1.0000 |
| Guacamole | Typing, SSH | 20 ms, 100 Mbit/s | 2% | Latency, 95th percentile (ms) | 22.2 [22.2, 22.4] | 27.3 [22.3, 31.9] | 5.02 [0.134, 9.51] | 20 ms | 0.0043 | 0.1299 |
| Occamy | Typing, SSH | 20 ms, 100 Mbit/s | 2% | Latency, 95th percentile (ms) | 21.4 [21.3, 21.6] | 22.2 [21.5, 24.4] | 0.71 [0.112, 2.77] | 20 ms | 0.0043 | 0.1299 |
| Guacamole | Key press, VNC | 20 ms, 100 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 35.9 [35.7, 36.4] | 35.6 [35.5, 36.1] | -0.25 [-0.623, 0.194] | 20 ms | 0.0931 | 1.0000 |
| Occamy | Key press, VNC | 20 ms, 100 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 24.4 [24.4, 24.6] | 24.5 [24.4, 26.4] | 0.0775 [-0.094, 1.72] | 20 ms | 0.4848 | 1.0000 |
| Guacamole | Key press, VNC | 20 ms, 100 Mbit/s | 2% | Latency, 95th percentile (ms) | 35.9 [35.7, 36.4] | 35.8 [35.6, 37.4] | -0.0775 [-0.468, 0.993] | 20 ms | 0.6991 | 1.0000 |
| Occamy | Key press, VNC | 20 ms, 100 Mbit/s | 2% | Latency, 95th percentile (ms) | 24.4 [24.4, 24.6] | 25.2 [24.4, 52.4] | 0.653 [0.014, 27.7] | 20 ms | 0.0411 | 1.0000 |
| Guacamole | Key press, RDP | 20 ms, 100 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 38.5 [38.2, 38.7] | 38.6 [38.0, 39.9] | 0.0935 [-0.439, 1.18] | 20 ms | 0.6991 | 1.0000 |
| Occamy | Key press, RDP | 20 ms, 100 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 27.3 [26.4, 32.4] | 27.3 [26.4, 135] | 0.207 [-1.31, 103] | 20 ms | 0.8182 | 1.0000 |
| Guacamole | Key press, RDP | 20 ms, 100 Mbit/s | 2% | Latency, 95th percentile (ms) | 38.5 [38.2, 38.7] | 39.9 [38.1, 44.9] | 1.44 [-0.07, 6.26] | 20 ms | 0.0649 | 1.0000 |
| Occamy | Key press, RDP | 20 ms, 100 Mbit/s | 2% | Latency, 95th percentile (ms) | 27.3 [26.4, 32.4] | 42.3 [27.7, 73.1] | 12.9 [1.20, 40.7] | 20 ms | 0.0087 | 0.2424 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 132 [123, 172] | 164 [152, 184] | 27.9 [12.3, 50.4] | 20 ms | 0.0152 | 0.3939 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 59.1 [56.3, 93.6] | 68.7 [63.8, 132] | 9.96 [2.44, 38.4] | 20 ms | 0.0411 | 1.0000 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Latency, 95th percentile (ms) | 132 [123, 172] | 255 [209, 2,857] | 123 [77.9, 2,685] | 20 ms | 0.0022 | 0.0844 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Latency, 95th percentile (ms) | 59.1 [56.3, 93.6] | 119 [104, 153] | 59.8 [44.2, 88.3] | 20 ms | 0.0022 | 0.0844 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 121 [117, 130] | 165 [153, 1,734] | 41.8 [31.9, 1,605] | 20 ms | 0.0022 | 0.0844 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 80.6 [80.4, 118] | 96.5 [92.5, 98.0] | 15.4 [-19.6, 17.2] | 20 ms | 0.0649 | 1.0000 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Latency, 95th percentile (ms) | 121 [117, 130] | 2,188 [264, 4,186] | 2,065 [148, 4,057] | 20 ms | 0.0022 | 0.0844 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Latency, 95th percentile (ms) | 80.6 [80.4, 118] | 149 [120, 171] | 64.8 [39.0, 83.3] | 20 ms | 0.0022 | 0.0844 |
| Guacamole | Typing, SSH | 50 ms, 20 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 52.6 [52.3, 55.5] | 52.5 [52.4, 53.2] | -0.09 [-2.31, 0.595] | 50 ms | 0.6991 | 1.0000 |
| Occamy | Typing, SSH | 50 ms, 20 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 51.7 [51.5, 52.0] | 51.6 [51.5, 52.0] | -0.0945 [-0.408, 0.082] | 50 ms | 0.3939 | 1.0000 |
| Guacamole | Typing, SSH | 50 ms, 20 Mbit/s | 2% | Latency, 95th percentile (ms) | 52.6 [52.3, 55.5] | 52.7 [52.4, 55.7] | 0.097 [-0.53, 0.938] | 50 ms | 0.5887 | 1.0000 |
| Occamy | Typing, SSH | 50 ms, 20 Mbit/s | 2% | Latency, 95th percentile (ms) | 51.7 [51.5, 52.0] | 52.7 [51.7, 117] | 0.911 [0.098, 65.2] | 50 ms | 0.0411 | 1.0000 |
| Guacamole | Key press, VNC | 50 ms, 20 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 66.0 [65.7, 71.5] | 66.1 [65.7, 71.6] | 0.0525 [-1.34, 3.14] | 50 ms | 0.8182 | 1.0000 |
| Occamy | Key press, VNC | 50 ms, 20 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 54.6 [54.4, 56.1] | 54.5 [54.4, 101] | -0.014 [-0.369, 44.7] | 50 ms | 0.9372 | 1.0000 |
| Guacamole | Key press, VNC | 50 ms, 20 Mbit/s | 2% | Latency, 95th percentile (ms) | 66.0 [65.7, 71.5] | 66.2 [66.1, 66.5] | 0.227 [-4.97, 0.66] | 50 ms | 0.5887 | 1.0000 |
| Occamy | Key press, VNC | 50 ms, 20 Mbit/s | 2% | Latency, 95th percentile (ms) | 54.6 [54.4, 56.1] | 54.9 [54.4, 118] | 0.269 [-0.303, 62.0] | 50 ms | 0.4848 | 1.0000 |
| Guacamole | Key press, RDP | 50 ms, 20 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 69.0 [68.3, 71.4] | 68.8 [68.0, 69.9] | -0.208 [-1.45, 0.727] | 50 ms | 0.5887 | 1.0000 |
| Occamy | Key press, RDP | 50 ms, 20 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 56.8 [56.7, 58.7] | 57.2 [56.5, 59.4] | 0.416 [-0.306, 2.36] | 50 ms | 0.3095 | 1.0000 |
| Guacamole | Key press, RDP | 50 ms, 20 Mbit/s | 2% | Latency, 95th percentile (ms) | 69.0 [68.3, 71.4] | 77.6 [67.7, 81.0] | 7.81 [-0.859, 11.6] | 50 ms | 0.0931 | 1.0000 |
| Occamy | Key press, RDP | 50 ms, 20 Mbit/s | 2% | Latency, 95th percentile (ms) | 56.8 [56.7, 58.7] | 57.9 [56.9, 123] | 1.12 [0.082, 64.4] | 50 ms | 0.0411 | 1.0000 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 184 [169, 219] | 339 [276, 3,942] | 144 [93.7, 3,723] | 50 ms | 0.0022 | 0.0844 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 98.2 [90.7, 971] | 169 [129, 249] | 60.4 [-722, 110] | 50 ms | 0.0649 | 1.0000 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Latency, 95th percentile (ms) | 184 [169, 219] | 7,053 | 6,859 [5,701, 8,011] | 50 ms | 0.0095 | 0.2571 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Latency, 95th percentile (ms) | 98.2 [90.7, 971] | 379 [350, 430] | 271 [-540, 316] | 50 ms | 0.0649 | 1.0000 |
| Guacamole | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 179 [172, 226] | 5,575 [362, 7,941] | 5,376 [190, 7,715] | 50 ms | 0.0022 | 0.0844 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Latency, 95th percentile (ms) | 113 [111, 114] | 196 [166, 273] | 83.7 [55.1, 159] | 50 ms | 0.0022 | 0.0844 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 2% | Latency, 95th percentile (ms) | 113 [111, 114] | 519 [415, 585] | 407 [304, 471] | 50 ms | 0.0022 | 0.0844 |
0 of the 39 differences are significant after the correction. With this many runs, the exact test's smallest p is 0.0022, so after the correction over 39 tests no difference can be significant, and the intervals carry the evidence.
What packet loss adds to the secondary metrics¶
The other metrics that each scenario records. They're exploratory, and their p-values aren't corrected.
| Series | Scenario | Network | Loss | Metric | Without loss | With loss | Added | Round trip | p |
|---|---|---|---|---|---|---|---|---|---|
| Guacamole | Typing, SSH | 20 ms, 100 Mbit/s | 0.5% | Latency, median (ms) | 21.8 [21.6, 21.9] | 21.7 [21.5, 21.9] | -0.0855 [-0.238, 0.078] | 20 ms | 0.3095 |
| Guacamole | Typing, SSH | 20 ms, 100 Mbit/s | 0.5% | Server memory, peak (MiB) | 93.2 [42.0, 147] | 95.0 [39.7, 124] | 0.00477 [-70.6, 72.2] | 20 ms | 1.0000 |
| Guacamole | Typing, SSH | 20 ms, 100 Mbit/s | 0.5% | Client CPU time (ms) | 58.3 [52.3, 64.7] | 56.0 [53.2, 59.0] | -2.71 [-7.96, 2.08] | 20 ms | 0.3939 |
| Occamy | Typing, SSH | 20 ms, 100 Mbit/s | 0.5% | Latency, median (ms) | 21.1 [21.0, 21.1] | 21.1 [21.0, 21.4] | 0.035 [-0.054, 0.262] | 20 ms | 0.3939 |
| Occamy | Typing, SSH | 20 ms, 100 Mbit/s | 0.5% | Server memory, peak (MiB) | 67.3 [16.3, 78.5] | 71.0 [18.5, 73.2] | 1.64 [-15.1, 53.7] | 20 ms | 0.6991 |
| Occamy | Typing, SSH | 20 ms, 100 Mbit/s | 0.5% | Client CPU time (ms) | 51.1 [43.8, 55.1] | 47.3 [43.8, 63.6] | -2.63 [-7.31, 8.46] | 20 ms | 0.5887 |
| Guacamole | Typing, SSH | 20 ms, 100 Mbit/s | 2% | Latency, median (ms) | 21.8 [21.6, 21.9] | 21.8 [21.7, 21.9] | 0.0165 [-0.097, 0.139] | 20 ms | 0.8182 |
| Guacamole | Typing, SSH | 20 ms, 100 Mbit/s | 2% | Server memory, peak (MiB) | 93.2 [42.0, 147] | 94.8 [42.0, 148] | -0.0381 [-71.4, 105] | 20 ms | 0.9091 |
| Guacamole | Typing, SSH | 20 ms, 100 Mbit/s | 2% | Client CPU time (ms) | 58.3 [52.3, 64.7] | 58.9 [54.1, 67.3] | 0.085 [-5.66, 7.52] | 20 ms | 1.0000 |
| Occamy | Typing, SSH | 20 ms, 100 Mbit/s | 2% | Latency, median (ms) | 21.1 [21.0, 21.1] | 21.1 [21.0, 21.2] | 0.0385 [-0.072, 0.144] | 20 ms | 0.3290 |
| Occamy | Typing, SSH | 20 ms, 100 Mbit/s | 2% | Server memory, peak (MiB) | 67.3 [16.3, 78.5] | 68.6 [10.8, 75.2] | 0.348 [-23.8, 52.2] | 20 ms | 1.0000 |
| Occamy | Typing, SSH | 20 ms, 100 Mbit/s | 2% | Client CPU time (ms) | 51.1 [43.8, 55.1] | 50.4 [45.6, 57.1] | 1.55 [-4.97, 6.57] | 20 ms | 0.6991 |
| Guacamole | Key press, VNC | 20 ms, 100 Mbit/s | 0.5% | Latency, median (ms) | 34.8 [34.7, 35.0] | 34.7 [34.7, 34.8] | -0.113 [-0.192, -0.011] | 20 ms | 0.0152 |
| Guacamole | Key press, VNC | 20 ms, 100 Mbit/s | 0.5% | Server memory, peak (MiB) | 85.9 [50.5, 123] | 86.3 [30.9, 123] | -0.219 [-72.3, 71.8] | 20 ms | 0.8182 |
| Guacamole | Key press, VNC | 20 ms, 100 Mbit/s | 0.5% | Client CPU time (ms) | 63.2 [58.2, 517] | 64.6 [60.6, 69.1] | 0.468 [-447, 6.43] | 20 ms | 0.9372 |
| Occamy | Key press, VNC | 20 ms, 100 Mbit/s | 0.5% | Latency, median (ms) | 23.8 [23.7, 23.9] | 23.7 [23.7, 24.1] | -0.0505 [-0.14, 0.239] | 20 ms | 0.3290 |
| Occamy | Key press, VNC | 20 ms, 100 Mbit/s | 0.5% | Server memory, peak (MiB) | 70.6 [23.4, 78.5] | 71.5 [25.6, 73.8] | 0.0525 [-18.9, 48.1] | 20 ms | 1.0000 |
| Occamy | Key press, VNC | 20 ms, 100 Mbit/s | 0.5% | Client CPU time (ms) | 63.4 [52.5, 64.9] | 57.9 [53.2, 74.0] | -4.24 [-7.87, 9.08] | 20 ms | 0.6991 |
| Guacamole | Key press, VNC | 20 ms, 100 Mbit/s | 2% | Latency, median (ms) | 34.8 [34.7, 35.0] | 34.7 [34.7, 34.9] | -0.0875 [-0.139, 0.077] | 20 ms | 0.2229 |
| Guacamole | Key press, VNC | 20 ms, 100 Mbit/s | 2% | Server memory, peak (MiB) | 85.9 [50.5, 123] | 86.4 [50.0, 123] | -0.0429 [-71.7, 71.8] | 20 ms | 0.9372 |
| Guacamole | Key press, VNC | 20 ms, 100 Mbit/s | 2% | Client CPU time (ms) | 63.2 [58.2, 517] | 59.8 [58.5, 68.5] | -2.60 [-448, 2.21] | 20 ms | 0.3095 |
| Occamy | Key press, VNC | 20 ms, 100 Mbit/s | 2% | Latency, median (ms) | 23.8 [23.7, 23.9] | 23.7 [23.6, 23.8] | -0.048 [-0.183, 0.066] | 20 ms | 0.2403 |
| Occamy | Key press, VNC | 20 ms, 100 Mbit/s | 2% | Server memory, peak (MiB) | 70.6 [23.4, 78.5] | 68.5 [17.6, 78.8] | -1.25 [-27.3, 44.9] | 20 ms | 0.8485 |
| Occamy | Key press, VNC | 20 ms, 100 Mbit/s | 2% | Client CPU time (ms) | 63.4 [52.5, 64.9] | 59.3 [52.7, 60.5] | -4.14 [-6.51, 5.10] | 20 ms | 0.3095 |
| Guacamole | Key press, RDP | 20 ms, 100 Mbit/s | 0.5% | Latency, median (ms) | 37.1 [37.0, 37.3] | 37.1 [37.0, 37.2] | 0.014 [-0.114, 0.118] | 20 ms | 0.9372 |
| Guacamole | Key press, RDP | 20 ms, 100 Mbit/s | 0.5% | Server memory, peak (MiB) | 110 [72.0, 145] | 108 [71.5, 145] | -0.0954 [-71.6, 71.3] | 20 ms | 1.0000 |
| Guacamole | Key press, RDP | 20 ms, 100 Mbit/s | 0.5% | Client CPU time (ms) | 68.6 [64.0, 454] | 68.5 [66.4, 482] | 2.44 [-4.70, 28.0] | 20 ms | 0.5887 |
| Occamy | Key press, RDP | 20 ms, 100 Mbit/s | 0.5% | Latency, median (ms) | 25.9 [25.8, 26.2] | 25.9 [25.9, 33.6] | 0.0405 [-0.139, 7.33] | 20 ms | 0.4848 |
| Occamy | Key press, RDP | 20 ms, 100 Mbit/s | 0.5% | Server memory, peak (MiB) | 52.7 [49.3, 68.7] | 52.8 [47.5, 54.1] | -0.701 [-14.6, 4.10] | 20 ms | 0.8182 |
| Occamy | Key press, RDP | 20 ms, 100 Mbit/s | 0.5% | Client CPU time (ms) | 66.6 [59.7, 210] | 63.2 [57.5, 87.6] | -2.64 [-123, 6.05] | 20 ms | 0.5887 |
| Guacamole | Key press, RDP | 20 ms, 100 Mbit/s | 2% | Latency, median (ms) | 37.1 [37.0, 37.3] | 37.1 [37.0, 37.2] | 0.0625 [-0.084, 0.171] | 20 ms | 0.5887 |
| Guacamole | Key press, RDP | 20 ms, 100 Mbit/s | 2% | Server memory, peak (MiB) | 110 [72.0, 145] | 99.0 [71.6, 144] | -0.42 [-71.7, 67.1] | 20 ms | 0.8182 |
| Guacamole | Key press, RDP | 20 ms, 100 Mbit/s | 2% | Client CPU time (ms) | 68.6 [64.0, 454] | 66.4 [65.0, 70.7] | -0.427 [-383, 2.63] | 20 ms | 0.8182 |
| Occamy | Key press, RDP | 20 ms, 100 Mbit/s | 2% | Latency, median (ms) | 25.9 [25.8, 26.2] | 25.9 [25.9, 26.0] | 0.0105 [-0.269, 0.078] | 20 ms | 0.8182 |
| Occamy | Key press, RDP | 20 ms, 100 Mbit/s | 2% | Server memory, peak (MiB) | 52.7 [49.3, 68.7] | 55.2 [49.0, 60.8] | 1.33 [-7.88, 7.47] | 20 ms | 0.6991 |
| Occamy | Key press, RDP | 20 ms, 100 Mbit/s | 2% | Client CPU time (ms) | 66.6 [59.7, 210] | 64.0 [58.5, 212] | -1.38 [-13.8, 5.26] | 20 ms | 0.6991 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Frames shown a second (frames/s) | 27.2 [24.4, 28.1] | 24.4 [23.2, 25.7] | -2.51 [-4.02, -0.656] | 20 ms | 0.0152 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Scene frames never shown (%) | 9.17 [6.24, 18.6] | 18.7 [14.3, 22.6] | 8.37 [2.19, 13.4] | 20 ms | 0.0152 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Gap between frames, 95th percentile (ms) | 59.6 [55.5, 75.3] | 74.6 [69.4, 83.3] | 14.7 [8.05, 22.8] | 20 ms | 0.0152 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Data per frame (KiB) | 49.8 [49.0, 51.2] | 44.3 [40.6, 47.8] | -5.84 [-8.74, -3.17] | 20 ms | 0.0022 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Server CPU per frame (ms) | 46.1 [45.4, 51.0] | 45.5 [44.6, 46.4] | -0.741 [-4.57, 0.361] | 20 ms | 0.2403 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Server CPU time (ms) | 12,714 [12,449, 14,333] | 12,549 [12,276, 12,943] | -248 [-1,390, 110] | 20 ms | 0.1320 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Server memory, peak (MiB) | 86.4 [50.2, 123] | 86.5 [44.1, 123] | -0.11 [-71.8, 71.9] | 20 ms | 1.0000 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Client CPU time (ms) | 5,019 [4,945, 5,650] | 5,055 [4,971, 5,186] | 26.6 [-464, 137] | 20 ms | 0.3939 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Frames shown a second (frames/s) | 29.8 [28.1, 30.2] | 29.7 [26.5, 29.8] | -0.198 [-1.65, 0.221] | 20 ms | 0.5887 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Scene frames never shown (%) | 0.829 [-0.502, 6.25] | 0.941 [0.546, 11.8] | 0.66 [-0.737, 5.51] | 20 ms | 0.5887 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Gap between frames, 95th percentile (ms) | 48.0 [47.2, 52.3] | 58.5 [54.6, 71.7] | 9.95 [6.52, 19.4] | 20 ms | 0.0022 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Data per frame (KiB) | 14.2 [14.1, 14.4] | 14.2 [14.1, 14.3] | 0.0222 [-0.104, 0.128] | 20 ms | 0.6991 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Server CPU per frame (ms) | 19.2 [18.8, 20.5] | 19.1 [18.9, 27.0] | 0.00576 [-0.896, 6.56] | 20 ms | 1.0000 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Server CPU time (ms) | 5,674 [5,635, 5,854] | 5,643 [5,607, 7,191] | -27.2 [-126, 1,338] | 20 ms | 0.3939 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Server memory, peak (MiB) | 70.3 [53.3, 76.2] | 66.1 [51.3, 73.3] | -2.91 [-17.7, 12.2] | 20 ms | 0.3939 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 0.5% | Client CPU time (ms) | 2,121 [2,104, 2,227] | 2,148 [2,076, 2,289] | 19.4 [-78.7, 87.8] | 20 ms | 0.5887 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Frames shown a second (frames/s) | 27.2 [24.4, 28.1] | 16.1 [1.08, 16.6] | -11.5 [-23.8, -9.71] | 20 ms | 0.0022 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Scene frames never shown (%) | 9.17 [6.24, 18.6] | 46.4 [44.7, 96.4] | 38.2 [32.4, 79.4] | 20 ms | 0.0022 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Gap between frames, 95th percentile (ms) | 59.6 [55.5, 75.3] | 121 [108, 1,553] | 60.1 [49.3, 1,477] | 20 ms | 0.0022 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Data per frame (KiB) | 49.8 [49.0, 51.2] | 32.9 [31.5, 551] | -16.9 [-18.4, 500] | 20 ms | 0.3939 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Server CPU per frame (ms) | 46.1 [45.4, 51.0] | 49.4 [48.6, 336] | 3.39 [1.87, 285] | 20 ms | 0.0260 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Server CPU time (ms) | 12,714 [12,449, 14,333] | 12,714 [12,293, 67,251] | 0.036 [-531, 52,918] | 20 ms | 1.0000 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Server memory, peak (MiB) | 86.4 [50.2, 123] | 86.6 [50.3, 123] | -0.0715 [-71.7, 71.4] | 20 ms | 1.0000 |
| Guacamole | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Client CPU time (ms) | 5,019 [4,945, 5,650] | 4,933 [4,719, 7,602] | -80.6 [-312, 1,952] | 20 ms | 0.5887 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Frames shown a second (frames/s) | 29.8 [28.1, 30.2] | 27.8 [27.0, 28.6] | -1.90 [-2.59, -1.06] | 20 ms | 0.0087 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Scene frames never shown (%) | 0.829 [-0.502, 6.25] | 7.45 [4.82, 9.89] | 6.34 [3.53, 8.64] | 20 ms | 0.0087 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Gap between frames, 95th percentile (ms) | 48.0 [47.2, 52.3] | 67.7 [62.8, 72.4] | 19.1 [14.7, 24.0] | 20 ms | 0.0022 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Data per frame (KiB) | 14.2 [14.1, 14.4] | 14.3 [14.1, 14.4] | 0.118 [-0.0249, 0.245] | 20 ms | 0.0931 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Server CPU per frame (ms) | 19.2 [18.8, 20.5] | 19.5 [19.1, 20.8] | 0.328 [-0.72, 0.907] | 20 ms | 0.3939 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Server CPU time (ms) | 5,674 [5,635, 5,854] | 5,486 [5,340, 5,789] | -215 [-340, -64.8] | 20 ms | 0.0411 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Server memory, peak (MiB) | 70.3 [53.3, 76.2] | 58.6 [49.5, 78.3] | -5.38 [-24.7, 11.2] | 20 ms | 0.2403 |
| Occamy | Key during motion, VNC | 20 ms, 100 Mbit/s | 2% | Client CPU time (ms) | 2,121 [2,104, 2,227] | 2,044 [1,904, 2,283] | -85.4 [-206, 56.8] | 20 ms | 0.0649 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Frames shown a second (frames/s) | 24.3 [24.0, 24.6] | 22.3 [4.58, 22.9] | -1.97 [-19.4, -1.31] | 20 ms | 0.0022 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Scene frames never shown (%) | 18.8 [18.1, 20.0] | 25.7 [23.5, 84.7] | 6.57 [4.37, 64.7] | 20 ms | 0.0022 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Gap between frames, 95th percentile (ms) | 48.7 [46.3, 53.8] | 82.2 [73.5, 877] | 33.1 [24.9, 824] | 20 ms | 0.0022 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Data per frame (KiB) | 66.2 [66.1, 67.2] | 50.1 [47.1, 300] | -16.5 [-19.0, 233] | 20 ms | 0.0649 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Server CPU per frame (ms) | 55.4 [54.6, 56.1] | 51.1 [50.7, 185] | -4.12 [-4.76, 129] | 20 ms | 0.0649 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Server CPU time (ms) | 13,451 [13,357, 13,635] | 14,467 [13,887, 48,582] | 971 [530, 34,946] | 20 ms | 0.0022 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Server memory, peak (MiB) | 107 [64.4, 141] | 106 [62.8, 144] | 1.34 [-69.7, 72.2] | 20 ms | 0.5887 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Client CPU time (ms) | 5,776 [5,583, 5,838] | 6,487 [6,232, 9,133] | 730 [504, 3,295] | 20 ms | 0.0022 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Frames shown a second (frames/s) | 24.4 [23.6, 24.9] | 24.3 [24.1, 24.6] | -0.122 [-0.503, 0.486] | 20 ms | 0.5887 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Scene frames never shown (%) | 18.7 [17.1, 21.3] | 18.9 [18.1, 19.7] | 0.408 [-1.62, 1.68] | 20 ms | 0.5887 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Gap between frames, 95th percentile (ms) | 43.5 [41.5, 69.5] | 59.3 [55.9, 59.6] | 14.7 [-9.82, 17.2] | 20 ms | 0.0649 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Data per frame (KiB) | 14.2 [14.0, 14.3] | 14.2 [14.1, 14.3] | 0.0578 [-0.083, 0.233] | 20 ms | 0.3095 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Server CPU per frame (ms) | 19.9 [19.3, 25.7] | 20.0 [19.7, 20.3] | 0.0114 [-5.36, 0.433] | 20 ms | 1.0000 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Server CPU time (ms) | 4,834 [4,789, 6,214] | 4,833 [4,794, 4,938] | -1.98 [-1,276, 113] | 20 ms | 1.0000 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Server memory, peak (MiB) | 73.1 [67.7, 77.4] | 72.0 [67.9, 78.2] | -0.839 [-5.43, 4.39] | 20 ms | 0.8182 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 0.5% | Client CPU time (ms) | 1,775 [1,679, 1,807] | 1,807 [1,739, 1,833] | 29.4 [-3.14, 102] | 20 ms | 0.0931 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Frames shown a second (frames/s) | 24.3 [24.0, 24.6] | 6.64 [0.591, 14.4] | -17.6 [-23.9, -9.97] | 20 ms | 0.0022 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Scene frames never shown (%) | 18.8 [18.1, 20.0] | 77.9 [52.0, 98.0] | 58.8 [33.2, 79.5] | 20 ms | 0.0022 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Gap between frames, 95th percentile (ms) | 48.7 [46.3, 53.8] | 1,211 [131, 2,426] | 1,161 [84.3, 2,372] | 20 ms | 0.0022 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Data per frame (KiB) | 66.2 [66.1, 67.2] | 537 [33.8, 1,055] | 470 [-32.3, 988] | 20 ms | 1.0000 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Server CPU per frame (ms) | 55.4 [54.6, 56.1] | 378 [54.4, 721] | 323 [-0.448, 665] | 20 ms | 0.1320 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Server CPU time (ms) | 13,451 [13,357, 13,635] | 76,455 [13,653, 142,099] | 62,959 [296, 128,617] | 20 ms | 0.0022 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Server memory, peak (MiB) | 107 [64.4, 141] | 103 [63.8, 143] | 0.749 [-70.1, 70.7] | 20 ms | 0.9372 |
| Guacamole | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Client CPU time (ms) | 5,776 [5,583, 5,838] | 8,835 [5,608, 12,098] | 3,125 [-120, 6,311] | 20 ms | 0.2403 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Frames shown a second (frames/s) | 24.4 [23.6, 24.9] | 24.4 [24.0, 24.8] | -0.059 [-0.489, 0.499] | 20 ms | 0.9372 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Scene frames never shown (%) | 18.7 [17.1, 21.3] | 18.7 [17.2, 20.0] | 0.197 [-1.66, 1.63] | 20 ms | 0.9372 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Gap between frames, 95th percentile (ms) | 43.5 [41.5, 69.5] | 64.8 [62.2, 72.1] | 20.6 [2.67, 26.3] | 20 ms | 0.0411 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Data per frame (KiB) | 14.2 [14.0, 14.3] | 14.1 [14.1, 14.2] | -0.0346 [-0.184, 0.101] | 20 ms | 0.9372 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Server CPU per frame (ms) | 19.9 [19.3, 25.7] | 19.8 [19.7, 19.9] | -0.145 [-5.82, 0.434] | 20 ms | 0.1320 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Server CPU time (ms) | 4,834 [4,789, 6,214] | 4,899 [4,865, 4,979] | 56.6 [-1,234, 130] | 20 ms | 0.3939 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Server memory, peak (MiB) | 73.1 [67.7, 77.4] | 73.7 [65.2, 81.4] | 1.30 [-6.77, 8.13] | 20 ms | 0.8182 |
| Occamy | Key during motion, RDP | 20 ms, 100 Mbit/s | 2% | Client CPU time (ms) | 1,775 [1,679, 1,807] | 1,839 [1,812, 1,898] | 75.2 [31.6, 143] | 20 ms | 0.0022 |
| Guacamole | Typing, SSH | 50 ms, 20 Mbit/s | 0.5% | Latency, median (ms) | 52.0 [52.0, 52.2] | 52.1 [52.0, 52.3] | 0.0215 [-0.179, 0.215] | 50 ms | 0.3939 |
| Guacamole | Typing, SSH | 50 ms, 20 Mbit/s | 0.5% | Server memory, peak (MiB) | 95.0 [42.0, 124] | 95.0 [41.8, 148] | -0.0954 [-61.5, 38.7] | 50 ms | 0.9740 |
| Guacamole | Typing, SSH | 50 ms, 20 Mbit/s | 0.5% | Client CPU time (ms) | 57.4 [51.4, 67.0] | 63.1 [56.2, 68.2] | 4.14 [-3.37, 11.1] | 50 ms | 0.3939 |
| Occamy | Typing, SSH | 50 ms, 20 Mbit/s | 0.5% | Latency, median (ms) | 51.2 [51.1, 51.3] | 51.1 [51.1, 51.5] | -0.0655 [-0.185, 0.124] | 50 ms | 0.1797 |
| Occamy | Typing, SSH | 50 ms, 20 Mbit/s | 0.5% | Server memory, peak (MiB) | 65.1 [12.7, 70.2] | 68.3 [15.2, 81.2] | 4.01 [-2.74, 27.9] | 50 ms | 0.5887 |
| Occamy | Typing, SSH | 50 ms, 20 Mbit/s | 0.5% | Client CPU time (ms) | 50.6 [46.1, 59.3] | 48.3 [42.1, 59.1] | -2.33 [-9.30, 3.75] | 50 ms | 0.4848 |
| Guacamole | Typing, SSH | 50 ms, 20 Mbit/s | 2% | Latency, median (ms) | 52.0 [52.0, 52.2] | 52.0 [51.9, 52.2] | -0.054 [-0.23, 0.132] | 50 ms | 0.3095 |
| Guacamole | Typing, SSH | 50 ms, 20 Mbit/s | 2% | Server memory, peak (MiB) | 95.0 [42.0, 124] | 112 [75.9, 148] | 28.3 [-38.3, 71.9] | 50 ms | 0.1797 |
| Guacamole | Typing, SSH | 50 ms, 20 Mbit/s | 2% | Client CPU time (ms) | 57.4 [51.4, 67.0] | 56.2 [50.2, 65.2] | -1.66 [-9.90, 6.86] | 50 ms | 0.5887 |
| Occamy | Typing, SSH | 50 ms, 20 Mbit/s | 2% | Latency, median (ms) | 51.2 [51.1, 51.3] | 51.1 [51.0, 51.4] | -0.125 [-0.234, 0.046] | 50 ms | 0.0844 |
| Occamy | Typing, SSH | 50 ms, 20 Mbit/s | 2% | Server memory, peak (MiB) | 65.1 [12.7, 70.2] | 68.4 [7.14, 70.8] | 0.377 [-51.7, 16.3] | 50 ms | 0.9372 |
| Occamy | Typing, SSH | 50 ms, 20 Mbit/s | 2% | Client CPU time (ms) | 50.6 [46.1, 59.3] | 46.2 [45.1, 50.9] | -4.19 [-10.5, 0.537] | 50 ms | 0.0649 |
| Guacamole | Key press, VNC | 50 ms, 20 Mbit/s | 0.5% | Latency, median (ms) | 65.1 [64.9, 65.5] | 65.1 [64.8, 65.9] | 0.0165 [-0.356, 0.362] | 50 ms | 1.0000 |
| Guacamole | Key press, VNC | 50 ms, 20 Mbit/s | 0.5% | Server memory, peak (MiB) | 86.5 [50.0, 123] | 86.9 [50.3, 123] | 0.143 [-71.8, 72.0] | 50 ms | 0.7338 |
| Guacamole | Key press, VNC | 50 ms, 20 Mbit/s | 0.5% | Client CPU time (ms) | 65.5 [59.6, 73.3] | 60.8 [59.1, 77.5] | -1.75 [-11.9, 8.17] | 50 ms | 0.8182 |
| Occamy | Key press, VNC | 50 ms, 20 Mbit/s | 0.5% | Latency, median (ms) | 53.9 [53.8, 54.0] | 53.8 [53.7, 55.3] | -0.0375 [-0.149, 1.26] | 50 ms | 0.6991 |
| Occamy | Key press, VNC | 50 ms, 20 Mbit/s | 0.5% | Server memory, peak (MiB) | 67.4 [18.8, 73.2] | 60.2 [21.5, 82.2] | 0.186 [-43.9, 19.4] | 50 ms | 1.0000 |
| Occamy | Key press, VNC | 50 ms, 20 Mbit/s | 0.5% | Client CPU time (ms) | 60.9 [58.2, 67.2] | 59.1 [57.3, 75.6] | -1.17 [-7.13, 8.43] | 50 ms | 0.5887 |
| Guacamole | Key press, VNC | 50 ms, 20 Mbit/s | 2% | Latency, median (ms) | 65.1 [64.9, 65.5] | 65.1 [65.0, 65.5] | 0.022 [-0.396, 0.247] | 50 ms | 0.8182 |
| Guacamole | Key press, VNC | 50 ms, 20 Mbit/s | 2% | Server memory, peak (MiB) | 86.5 [50.0, 123] | 86.5 [50.0, 123] | -0.0954 [-72.0, 71.8] | 50 ms | 0.8420 |
| Guacamole | Key press, VNC | 50 ms, 20 Mbit/s | 2% | Client CPU time (ms) | 65.5 [59.6, 73.3] | 63.5 [57.4, 76.6] | -1.91 [-9.51, 5.31] | 50 ms | 0.8182 |
| Occamy | Key press, VNC | 50 ms, 20 Mbit/s | 2% | Latency, median (ms) | 53.9 [53.8, 54.0] | 53.8 [53.8, 54.1] | -0.028 [-0.122, 0.163] | 50 ms | 0.7013 |
| Occamy | Key press, VNC | 50 ms, 20 Mbit/s | 2% | Server memory, peak (MiB) | 67.4 [18.8, 73.2] | 70.3 [13.8, 73.4] | 0.463 [-46.2, 19.4] | 50 ms | 0.8182 |
| Occamy | Key press, VNC | 50 ms, 20 Mbit/s | 2% | Client CPU time (ms) | 60.9 [58.2, 67.2] | 57.9 [53.6, 72.0] | -3.30 [-8.22, 4.81] | 50 ms | 0.3939 |
| Guacamole | Key press, RDP | 50 ms, 20 Mbit/s | 0.5% | Latency, median (ms) | 67.2 [67.1, 67.9] | 67.2 [67.1, 67.4] | -0.0325 [-0.53, 0.208] | 50 ms | 0.6667 |
| Guacamole | Key press, RDP | 50 ms, 20 Mbit/s | 0.5% | Server memory, peak (MiB) | 109 [71.6, 146] | 111 [71.9, 145] | -0.296 [-72.0, 72.2] | 50 ms | 0.9372 |
| Guacamole | Key press, RDP | 50 ms, 20 Mbit/s | 0.5% | Client CPU time (ms) | 72.5 [68.0, 395] | 67.4 [63.4, 388] | -4.83 [-19.6, 5.33] | 50 ms | 0.2403 |
| Occamy | Key press, RDP | 50 ms, 20 Mbit/s | 0.5% | Latency, median (ms) | 56.1 [56.0, 56.5] | 56.0 [55.9, 56.7] | -0.0415 [-0.317, 0.16] | 50 ms | 0.4848 |
| Occamy | Key press, RDP | 50 ms, 20 Mbit/s | 0.5% | Server memory, peak (MiB) | 51.4 [30.4, 53.9] | 52.7 [49.4, 56.2] | 2.79 [-1.85, 19.0] | 50 ms | 0.3095 |
| Occamy | Key press, RDP | 50 ms, 20 Mbit/s | 0.5% | Client CPU time (ms) | 64.9 [61.4, 86.8] | 64.5 [58.0, 82.8] | -3.04 [-13.5, 5.55] | 50 ms | 0.6991 |
| Guacamole | Key press, RDP | 50 ms, 20 Mbit/s | 2% | Latency, median (ms) | 67.2 [67.1, 67.9] | 67.2 [67.1, 67.3] | -0.0435 [-0.628, 0.118] | 50 ms | 0.6991 |
| Guacamole | Key press, RDP | 50 ms, 20 Mbit/s | 2% | Server memory, peak (MiB) | 109 [71.6, 146] | 98.3 [52.6, 144] | -1.19 [-73.7, 71.9] | 50 ms | 0.3095 |
| Guacamole | Key press, RDP | 50 ms, 20 Mbit/s | 2% | Client CPU time (ms) | 72.5 [68.0, 395] | 63.9 [61.1, 71.4] | -8.64 [-324, -2.78] | 50 ms | 0.0152 |
| Occamy | Key press, RDP | 50 ms, 20 Mbit/s | 2% | Latency, median (ms) | 56.1 [56.0, 56.5] | 56.0 [56.0, 56.2] | -0.0565 [-0.307, 0.046] | 50 ms | 0.1797 |
| Occamy | Key press, RDP | 50 ms, 20 Mbit/s | 2% | Server memory, peak (MiB) | 51.4 [30.4, 53.9] | 51.7 [47.1, 55.5] | 1.27 [-4.12, 16.7] | 50 ms | 0.4848 |
| Occamy | Key press, RDP | 50 ms, 20 Mbit/s | 2% | Client CPU time (ms) | 64.9 [61.4, 86.8] | 61.1 [59.3, 62.7] | -3.95 [-24.2, -0.534] | 50 ms | 0.0152 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Frames shown a second (frames/s) | 26.0 [22.8, 26.8] | 13.8 [1.85, 20.2] | -12.2 [-23.1, -6.24] | 50 ms | 0.0022 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Scene frames never shown (%) | 13.3 [10.6, 24.1] | 54.2 [32.8, 93.8] | 40.6 [20.8, 76.9] | 50 ms | 0.0022 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Gap between frames, 95th percentile (ms) | 66.6 [60.6, 76.0] | 154 [104, 1,395] | 87.8 [43.6, 1,319] | 50 ms | 0.0022 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Data per frame (KiB) | 46.1 [46.0, 47.5] | 39.0 [33.9, 297] | -7.73 [-12.2, 250] | 50 ms | 0.3939 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Server CPU per frame (ms) | 45.4 [44.5, 52.1] | 53.3 [47.8, 204] | 7.86 [1.69, 152] | 50 ms | 0.0152 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Server CPU time (ms) | 16,652 [16,255, 19,031] | 16,420 [16,051, 67,404] | -154 [-2,168, 48,373] | 50 ms | 0.6991 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Server memory, peak (MiB) | 85.7 [49.1, 121] | 86.3 [49.1, 122] | 0.238 [-71.8, 71.1] | 50 ms | 0.6753 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Client CPU time (ms) | 6,779 [6,482, 7,940] | 6,435 [5,793, 9,911] | -392 [-1,403, 1,971] | 50 ms | 0.3095 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Frames shown a second (frames/s) | 29.7 [10.8, 30.1] | 27.5 [25.4, 29.0] | -1.79 [-3.28, 14.6] | 50 ms | 0.0931 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Scene frames never shown (%) | 1.15 [-0.418, 63.9] | 8.40 [3.32, 15.3] | 5.96 [-48.6, 10.9] | 50 ms | 0.0931 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Gap between frames, 95th percentile (ms) | 49.4 [47.2, 386] | 73.6 [71.3, 83.3] | 24.6 [-303, 34.0] | 50 ms | 0.0649 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Data per frame (KiB) | 14.2 [14.1, 19.9] | 14.2 [14.1, 14.8] | 0.0118 [-5.03, 0.396] | 50 ms | 0.9372 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Server CPU per frame (ms) | 19.3 [18.7, 36.2] | 19.6 [19.0, 23.6] | 0.252 [-12.6, 1.89] | 50 ms | 0.6991 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Server CPU time (ms) | 5,752 [5,634, 8,653] | 6,300 [5,761, 6,864] | 356 [-1,789, 1,052] | 50 ms | 0.1320 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Server memory, peak (MiB) | 67.1 [48.5, 73.2] | 62.2 [51.9, 81.5] | 1.28 [-17.8, 19.3] | 50 ms | 0.6991 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 0.5% | Client CPU time (ms) | 2,236 [2,076, 2,412] | 2,302 [2,243, 2,474] | 65.0 [-9.78, 230] | 50 ms | 0.1320 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Frames shown a second (frames/s) | 26.0 [22.8, 26.8] | 0.534 | -25.5 [-26.2, -22.3] | 50 ms | 0.0095 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Scene frames never shown (%) | 13.3 [10.6, 24.1] | 98.2 | 84.9 [74.4, 87.3] | 50 ms | 0.0095 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Gap between frames, 95th percentile (ms) | 66.6 [60.6, 76.0] | 3,270 | 3,202 [2,982, 3,309] | 50 ms | 0.0095 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Data per frame (KiB) | 46.1 [46.0, 47.5] | 473 | 426 [346, 511] | 50 ms | 0.0095 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Server CPU per frame (ms) | 45.4 [44.5, 52.1] | 597 | 549 [447, 666] | 50 ms | 0.0095 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Server CPU time (ms) | 16,652 [16,255, 19,031] | 146,271 | 128,627 [121,389, 134,931] | 50 ms | 0.0095 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Server memory, peak (MiB) | 85.7 [49.1, 121] | 85.2 | -0.0954 [-71.7, 71.0] | 50 ms | 0.8095 |
| Guacamole | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Client CPU time (ms) | 6,779 [6,482, 7,940] | 9,987 | 2,776 [1,122, 4,638] | 50 ms | 0.0095 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Frames shown a second (frames/s) | 29.7 [10.8, 30.1] | 16.8 [15.5, 17.8] | -12.6 [-14.1, 4.69] | 50 ms | 0.0649 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Scene frames never shown (%) | 1.15 [-0.418, 63.9] | 44.1 [40.8, 48.3] | 41.9 [-15.6, 47.0] | 50 ms | 0.0649 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Gap between frames, 95th percentile (ms) | 49.4 [47.2, 386] | 150 [138, 154] | 97.9 [-232, 105] | 50 ms | 0.0649 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Data per frame (KiB) | 14.2 [14.1, 19.9] | 14.6 [14.4, 15.4] | 0.361 [-4.48, 0.554] | 50 ms | 0.0649 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Server CPU per frame (ms) | 19.3 [18.7, 36.2] | 24.1 [23.6, 25.4] | 4.85 [-10.8, 6.29] | 50 ms | 0.0649 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Server CPU time (ms) | 5,752 [5,634, 8,653] | 8,630 [8,275, 9,358] | 2,825 [705, 3,316] | 50 ms | 0.0260 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Server memory, peak (MiB) | 67.1 [48.5, 73.2] | 67.2 [45.3, 72.0] | -0.238 [-13.9, 18.8] | 50 ms | 1.0000 |
| Occamy | Key during motion, VNC | 50 ms, 20 Mbit/s | 2% | Client CPU time (ms) | 2,236 [2,076, 2,412] | 2,614 [2,487, 2,810] | 401 [250, 567] | 50 ms | 0.0022 |
| Guacamole | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Frames shown a second (frames/s) | 24.2 [23.4, 24.5] | 0.601 [0.521, 11.8] | -23.4 [-23.8, -12.7] | 50 ms | 0.0022 |
| Guacamole | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Scene frames never shown (%) | 19.3 [18.3, 21.9] | 98.0 [60.5, 98.3] | 77.9 [42.2, 79.2] | 50 ms | 0.0022 |
| Guacamole | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Gap between frames, 95th percentile (ms) | 59.6 [54.6, 70.3] | 2,918 [167, 3,020] | 2,855 [113, 2,949] | 50 ms | 0.0022 |
| Guacamole | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Data per frame (KiB) | 53.9 [50.8, 54.6] | 923 [34.8, 1,050] | 870 [-15.9, 996] | 50 ms | 0.0649 |
| Guacamole | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Server CPU per frame (ms) | 52.1 [50.7, 59.5] | 703 [58.4, 769] | 648 [7.72, 709] | 50 ms | 0.0043 |
| Guacamole | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Server CPU time (ms) | 18,280 [17,675, 22,684] | 149,871 [16,176, 217,332] | 130,375 [-1,499, 194,648] | 50 ms | 0.0649 |
| Guacamole | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Server memory, peak (MiB) | 99.6 [60.6, 136] | 100 [60.7, 134] | -1.31 [-72.6, 69.7] | 50 ms | 0.5887 |
| Guacamole | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Client CPU time (ms) | 7,918 [7,445, 10,045] | 12,898 [6,038, 19,024] | 4,935 [-1,407, 8,979] | 50 ms | 0.0649 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Frames shown a second (frames/s) | 24.4 [24.0, 24.7] | 24.1 [22.5, 24.4] | -0.448 [-1.79, 0.0967] | 50 ms | 0.0649 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Scene frames never shown (%) | 18.6 [17.7, 20.2] | 19.6 [18.8, 25.1] | 1.49 [-0.322, 5.97] | 50 ms | 0.0649 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Gap between frames, 95th percentile (ms) | 45.0 [42.3, 54.2] | 82.6 [73.8, 89.6] | 37.5 [29.9, 44.1] | 50 ms | 0.0022 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Data per frame (KiB) | 14.2 [14.1, 14.4] | 14.2 [14.1, 14.3] | -0.053 [-0.207, 0.0801] | 50 ms | 0.5887 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Server CPU per frame (ms) | 20.0 [19.8, 21.4] | 20.3 [19.8, 21.2] | 0.215 [-0.379, 0.909] | 50 ms | 0.3939 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Server CPU time (ms) | 4,890 [4,836, 5,224] | 5,945 [5,312, 6,555] | 1,019 [476, 1,331] | 50 ms | 0.0022 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Server memory, peak (MiB) | 69.5 [67.5, 76.2] | 73.0 [68.3, 78.8] | 2.76 [-2.16, 5.92] | 50 ms | 0.3095 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 0.5% | Client CPU time (ms) | 1,912 [1,867, 2,028] | 2,212 [1,951, 2,389] | 307 [83.8, 376] | 50 ms | 0.0043 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 2% | Frames shown a second (frames/s) | 24.4 [24.0, 24.7] | 15.6 [14.9, 18.1] | -8.83 [-9.32, -6.63] | 50 ms | 0.0022 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 2% | Scene frames never shown (%) | 18.6 [17.7, 20.2] | 48.2 [39.8, 50.4] | 29.4 [22.1, 31.1] | 50 ms | 0.0022 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 2% | Gap between frames, 95th percentile (ms) | 45.0 [42.3, 54.2] | 120 [104, 151] | 74.2 [61.3, 99.5] | 50 ms | 0.0022 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 2% | Data per frame (KiB) | 14.2 [14.1, 14.4] | 14.1 [14.0, 14.2] | -0.101 [-0.252, 0.0345] | 50 ms | 0.2403 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 2% | Server CPU per frame (ms) | 20.0 [19.8, 21.4] | 25.1 [23.1, 28.6] | 5.00 [3.31, 7.16] | 50 ms | 0.0022 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 2% | Server CPU time (ms) | 4,890 [4,836, 5,224] | 11,145 [10,430, 13,228] | 6,263 [5,565, 8,003] | 50 ms | 0.0022 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 2% | Server memory, peak (MiB) | 69.5 [67.5, 76.2] | 70.4 [62.4, 78.5] | 0.873 [-6.47, 7.93] | 50 ms | 0.5887 |
| Occamy | Key during motion, RDP | 50 ms, 20 Mbit/s | 2% | Client CPU time (ms) | 1,912 [1,867, 2,028] | 3,205 [3,085, 3,401] | 1,304 [1,182, 1,446] | 50 ms | 0.0022 |
occamyd's runtime¶
For each scenario and network, the median of the runs: the memory occamyd allocated and the garbage collection cycles it ran during the scenario, and its heap in use and its goroutines at the end.
| Series | Scenario | Network | Allocated (MiB) | GC cycles | Heap (MiB) | Goroutines |
|---|---|---|---|---|---|---|
| Occamy | Typing, SSH, 0% lost | 20 ms, 100 Mbit/s | 1.39 | 0 | 38.0 | 8.00 |
| Occamy | Typing, SSH, 0.5% lost | 20 ms, 100 Mbit/s | 1.41 | 0 | 43.5 | 9.00 |
| Occamy | Typing, SSH, 2% lost | 20 ms, 100 Mbit/s | 1.43 | 0 | 24.5 | 9.00 |
| Occamy | Key press, VNC, 0% lost | 20 ms, 100 Mbit/s | 10.5 | 0.5 | 33.9 | 8.00 |
| Occamy | Key press, VNC, 0.5% lost | 20 ms, 100 Mbit/s | 10.6 | 1.00 | 21.2 | 8.50 |
| Occamy | Key press, VNC, 2% lost | 20 ms, 100 Mbit/s | 10.6 | 1.00 | 17.3 | 9.00 |
| Occamy | Key press, RDP, 0% lost | 20 ms, 100 Mbit/s | 22.6 | 2.00 | 25.4 | 8.00 |
| Occamy | Key press, RDP, 0.5% lost | 20 ms, 100 Mbit/s | 22.3 | 1.50 | 27.8 | 8.50 |
| Occamy | Key press, RDP, 2% lost | 20 ms, 100 Mbit/s | 22.4 | 1.50 | 29.0 | 9.00 |
| Occamy | Key during motion, VNC, 0% lost | 20 ms, 100 Mbit/s | 203 | 13.0 | 34.8 | 8.00 |
| Occamy | Key during motion, VNC, 0.5% lost | 20 ms, 100 Mbit/s | 193 | 13.0 | 28.9 | 8.50 |
| Occamy | Key during motion, VNC, 2% lost | 20 ms, 100 Mbit/s | 159 | 10.5 | 29.6 | 9.00 |
| Occamy | Key during motion, RDP, 0% lost | 20 ms, 100 Mbit/s | 105 | 5.50 | 41.6 | 8.00 |
| Occamy | Key during motion, RDP, 0.5% lost | 20 ms, 100 Mbit/s | 101 | 4.50 | 48.1 | 8.50 |
| Occamy | Key during motion, RDP, 2% lost | 20 ms, 100 Mbit/s | 101 | 4.00 | 49.0 | 9.00 |
| Occamy | Typing, SSH, 0% lost | 50 ms, 20 Mbit/s | 1.42 | 0 | 38.9 | 9.00 |
| Occamy | Typing, SSH, 0.5% lost | 50 ms, 20 Mbit/s | 1.41 | 0 | 44.1 | 9.00 |
| Occamy | Typing, SSH, 2% lost | 50 ms, 20 Mbit/s | 1.43 | 0 | 46.1 | 9.00 |
| Occamy | Key press, VNC, 0% lost | 50 ms, 20 Mbit/s | 10.6 | 0.5 | 32.9 | 9.00 |
| Occamy | Key press, VNC, 0.5% lost | 50 ms, 20 Mbit/s | 10.6 | 0.5 | 32.9 | 8.50 |
| Occamy | Key press, VNC, 2% lost | 50 ms, 20 Mbit/s | 10.6 | 1.00 | 20.3 | 9.00 |
| Occamy | Key press, RDP, 0% lost | 50 ms, 20 Mbit/s | 22.0 | 2.00 | 26.7 | 9.00 |
| Occamy | Key press, RDP, 0.5% lost | 50 ms, 20 Mbit/s | 22.2 | 1.00 | 29.7 | 8.50 |
| Occamy | Key press, RDP, 2% lost | 50 ms, 20 Mbit/s | 22.0 | 1.50 | 27.6 | 9.00 |
| Occamy | Key during motion, VNC, 0% lost | 50 ms, 20 Mbit/s | 181 | 12.0 | 32.6 | 9.00 |
| Occamy | Key during motion, VNC, 0.5% lost | 50 ms, 20 Mbit/s | 165 | 11.0 | 28.7 | 8.50 |
| Occamy | Key during motion, VNC, 2% lost | 50 ms, 20 Mbit/s | 222 | 14.0 | 30.7 | 9.00 |
| Occamy | Key during motion, RDP, 0% lost | 50 ms, 20 Mbit/s | 88.7 | 4.00 | 44.5 | 9.00 |
| Occamy | Key during motion, RDP, 0.5% lost | 50 ms, 20 Mbit/s | 101 | 5.00 | 52.4 | 8.50 |
| Occamy | Key during motion, RDP, 2% lost | 50 ms, 20 Mbit/s | 126 | 7.00 | 46.8 | 8.00 |
Sensitivity to the host's load¶
None of the 352 results started while the host's 1-minute load average was above the gate of 8, so no conclusion on a primary metric depends on the host's load.
Figures¶
Each figure shows a metric's median for each series in each scenario, with its 95% interval, in a panel for each network. Where the values span more than a factor of ten, the axis is logarithmic.