17 KiB
System Requirements
Physical server
- LibreQoS works best on a dedicated, physical x86_64 device.
- While it is possible to run LibreQoS in VM, it comes at a significant 30% performance penalty (even when using NIC passthrough). For VMs, NIC passthrough is required to achieve throughput above 10 Gbps (XDP vs generic XDP).
CPU
- 2 or more CPU cores are required
- Choose a CPU with high single-thread performance within your budget. Queuing is CPU-intensive, and requires high single-thread performance.
Single-thread CPU performance will determine the maximum capacity of a single HTB (cpu core), and in turn, the maximum capacity of any top level node in the network hierarchy (for example, top-level sites in your network). This also impacts the maximum speed plan you can offer customers within safe margins.
| Top Level Node Max | Single-Thread Score |
|---|---|
| 1 Gbps | 1000 |
| 2 Gbps | 1500 |
| 3 Gbps | 2000 |
| 5 Gbps | 4000 |
| Customer Max Plan | Single-Thread Score |
|---|---|
| 100 Mbps | 1000 |
| 250 Mbps | 1250 |
| 500 Mbps | 1500 |
| 1 Gbps | 1750 |
| 2.5 Gbps | 2000 |
| 5 Gbps | 4000 |
Below is a table of approximate aggregate capacity, assuming a a CPU with a single thread performance of 1000 / 2000 / 4000:
| CPU Cores | Single-Thread Score = 1000 | Single-Thread Score = 2000 | Single-Thread Score = 4000 |
|---|---|---|---|
| 2 | 1 Gbps | 3 Gbps | 7 Gbps |
| 4 | 3 Gbps | 5 Gbps | 13 Gbps |
| 6 | 4 Gbps | 8 Gbps | 20 Gbps |
| 8 | 5 Gbps | 10 Gbps | 27 Gbps |
| 16 | 10 Gbps | 21 Gbps | 54 Gbps |
| 32 | 21 Gbps | 42 Gbps | 108 Gbps |
| 64 | 42 Gbps | 83 Gbps | 216 Gbps |
Memory
- Recommended RAM:
| RAM (using CAKE) | Max Subscribers |
|---|---|
| 4 GB | 1,000 |
| 8 GB | 2,000 |
| 16 GB | 5,000 |
| 32 GB | 10,000 |
| 64 GB | 20,000 |
| 128 GB | 40,000 |
Server Recommendations
Here are some convenient, off-the-shelf server options to consider:
| Throughput | 1 Gbps | 2.5 Gbps | 10 Gbps | 10 Gbps | 10 Gbps | 25 Gbps |
|---|---|---|---|---|---|---|
| Per Node / Per CPU Core | 1 Gbps | 2.5 Gbps | 3 Gbps | 5 Gbps | 5 Gbps | 3 Gbps |
| Model | Supermicro SYS-E100-12T-H | Supermicro SYS-E102-13R-E | Supermicro AS-1115S-FWTRT | Supermicro SYS-511R-M | Dell PowerEdge R260 | Supermicro AS-1115S-FWTRT |
| CPU Option | i7-1185GRE | Default | 8124P | E-2488 | E-2456 | 8534P |
| RAM Option | 2x8GB | 2x8GB | 2x16GB | 2x32GB | 2x32GB | 4x16GB |
| NIC Option | Built-in | Built-in | Mellanox (2 x SFP28) | 10-Gigabit X710-BM2 (2 x SFP+) | Intel X710-T2L (2 x 10G RJ45) | Mellanox (2 x SFP28) |
| Extras | USB-C RJ45 | USB-C RJ45 | ||||
| Temp Range | -30°C ~ 50°C | 0°C ~ 40°C | 0°C ~ 40°C | 0°C ~ 40°C | 5–40°C | 0°C ~ 40°C |
| Temp Range | (-22°F to 122°F) | (32°F ~ 104°F) | (32°F ~ 104°F) | (32°F ~ 104°F) | (41–104°F) | (32°F ~ 104°F) |
| ECC | No | No | Yes | Yes | Yes | Yes |
| Power | 12-24V DC | 12-24V DC | AC | AC | AC | AC |
| Suitable For | Tower Enclosure | Indoors / Server Room | Indoors / Server Room | Indoors / Server Room | Indoors / Server Room | Indoors / Server Room |
Another cost-effective solution is to procure a used server from a reputable vendor, such as TheServerStore. Such vendors often stock servers capable of 10 Gbps throughput, for around $500 USD.
Network Interface Requirements
- One management network interface completely separate from the traffic shaping interfaces. Usually this would be the Ethernet interface built in to the motherboard.
- A Dedicated Network Interface Card for Two Shaping Interfaces
Officially supported Network Interface Cards for the two shaping interfaces are listed below:
| NIC Controller | Port Speed | Suggested Models | Known Issues |
|---|---|---|---|
| Intel X520 | 10 Gbps | Module compatibility* | |
| Intel X710 | 10 Gbps | X710-BM2 10G | Module compatibility* |
| Intel XXV710 | 10 / 25 Gbps | XXV710 25G | Module compatibility* |
| Intel XL710 | 10 / 40 Gbps | XL710-BM2 40G | Module compatibility* |
| Mellanox ConnectX-4 Lx | 10/25/40/50 Gbps | No known issues. | |
| Mellanox ConnectX-5 | 100 Gbps | MCX516A-CCAT 100G | Extreme heat at high load (50+ Gbps). Use Liquid CPU Cooler kit on chip to avoid overheating. |
| Mellanox ConnectX-6 | 10/25 Gbps | MCX631102AN-ADAT | No known issues. |
| Mellanox ConnectX-6 | 100 Gbps | MCX623106AN-CDAT 100G | No known issues. |
| Mellanox ConnectX-7 | 200 Gbps | MCX755106AS-HEAT 200G | No known issues. |
(*) Intel often vendor-locks SFP+ module compatibility. Check module compatibility before buying. Mellanox does not have this problem.
We will ONLY provide support for systems using a NIC listed above. Some other NICs may work, but will not be officially supported by LibreQoS. If you want to test the compatability of another card, please be aware of these fundamental NIC requirements:
- NIC must have multiple TX/RX transmit queues, greater than or equal to the number of CPU cores. Here's how to check from the command line.
- NIC must have XDP driver support for high-throughput (10 Gbps+).
If you discover that a card not listed in the table above is compatible, please let us know by emailing support [at] libreqos.io.