Servers and Databases¶
Attention
For stable operation of the server, databases, and system components, your system should meet all of the listed requirements. Failure to meet any of the requirements may cause the system to work incorrectly.
Server Requirements¶
The computer processing power, RAM, and disk capacity requirements depend on the number of agents.
Operating System¶
Staffcop servers can be installed onto:
Ubuntu Server 18.04;
Ubuntu Server 20.04;
Ubuntu Server 22.04;
Astra Linux Special Edition 1.7.
Warning
PostgreSQL requires database reindexing when updating the server operating system,.
Processing power and RAM¶
x86/x64 architecture requirements, depending on the number of agents used:
Agent Amount |
RAM |
CPU |
|---|---|---|
10 |
4 |
2 |
50 |
16 |
4 |
100 |
32 |
8 |
200 |
48 |
10 |
500 |
64 |
10 |
1000 |
96 |
14 |
Performance Optimization¶
Starting from version 4.9, Staffcop Enterprise has a new data loading proces (ETL), which significantly reduces the processing load and allows for more efficient disk subsystem use.
Avoid installing additional resource-intensive services or applications on the server, except for the following:
Grafana: load metrics analytics service, installed via service commands along with pre-installed metrics.
Zabbix: a tool for system load monitoring.
Antivirus software. If installed, exclude the postgresql and staffcop directories from scans. See exclusions.
Database Requirements¶
Staffcop supports:
PostgreSQL 11 and 15;
Jatoba 4;
ClickHouse*.
Note: ClickHouse is an additional database used to improve report speed. When installing Staffcop, the current version of ClickHouse is provided.
Store databases on SSDs for high-speed access. Use HDDs for storing files, where performance is less critical
Note
If you use 10-50 agents, you do not need to separate the database and file storage, as the system generates too little data to impact performance.
Disk for Main Database and Staffcop Server¶
For optimal disk subsystem performance:
use NVMe solid-state drives with a speed of at least 1500 MB/s,
ensure IOPS of at least 5000 IOPS.
Attention
Storing the database on HDDs can lead to system instability.
On average, each agent generates about 350 MB of events per month.
The data spooler buffer /var/lib/staffcop/etl should be stored on a SSD.
Specific database recommendations are listed below.
Agent Amount |
1 Month Storage |
3 Month Storage |
12 Month Storage |
|---|---|---|---|
10 |
34 GB (Database + Files) |
101 GB (Database + Files) |
402 GB (Database + Files) |
50 |
170 GB (Database + Files) |
502 GB (Database + Files) |
2 TB (Database + Files) |
100 |
35 GB |
103 GB |
411 GB |
200 |
69 GB |
206 GB |
821 GB |
500 |
171 GB |
513 GB |
2 TB |
1000 |
342 GB |
1,13 TB |
4,1 TB |
Disk for File Storage¶
On average, one agent generates about 4 GB of data per month.
This estimate is based on the following active security policies:
Screen capture every 5 minutes
Full HD screenshots on switching windows
Instant messengers and email interception
If screen recording, webcams, audio and batch snapshots are used, additional calculations are required.
Agent Amount |
1 Month Storage |
3 Month Storage |
12 Month Storage |
|---|---|---|---|
10 |
34 GB (Database + Files) |
101 GB (Database + Files) |
402 GB (Database + Files) |
50 |
170 GB (Database + Files) |
502 GB (Database + Files) |
2 TB (Database + Files) |
100 |
300 GB |
900 GB |
3,6 TB |
200 |
600 GB |
1,8 TB |
7,2 TB |
500 |
1,5 TB |
4,5 TB |
18 TB |
1000 |
4 TB |
12 TB |
36 TB |
Disk for Video File Storage¶
These requirements are based on recording one Full HD screen for eight hours per day. Adjust accordingly if your usage differs.
Agent Amount |
1 Month Storage |
3 Month Storage |
|---|---|---|
10 |
350 GB |
1050 GB |
50 |
1750 GB |
5,2 TB |
100 |
3,5 TB |
10,5 TB |
200 |
7 TB |
21 TB |
500 |
17,5 TB |
52,5 TB |
1000 |
35 TB |
105 TB |
Note
The total IOPS must be at least 5000 operations.
ClickHouse Databases¶
ClickHouse is an additional database used to improve web console performance
Use ClickHouse if you:
manage more than 100 agents,
need to store data longer than 3 months.
The database volume is calculated as 40–50% of the main database data volume.
Agent Amount |
RAM |
1 Month Storage |
3 Month Storage |
12 Month Storage |
|---|---|---|---|---|
100 |
10 GB |
18 GB |
54 GB |
216 GB |
200 |
12 GB |
36 GB |
108 GB |
432 GB |
500 |
14 GB |
90 GB |
270 GB |
1080 GB |
1000 |
16 GB |
180 GB |
540 GB |
2160 GB |
Note
ClickHouse requires an NVMe drive with a read/write speed of 1500 MB/s and a total IOPS of at least 5000 operations to safely store data.
Database Recommendations¶
If the database exceeds 1 TB:
Separate data into hot and cold storage. Transfer infrequently used data to cold storage with secure access via the server address. The server web console will display only the selected database.
Make weekly database backups. The server writes data to the file storage: ensure both the database and file storage are included in the backups.
Clean your database. Run VACUUM and ANALYZE on your database every 2 to 3 months.
Selecting Server Configuration¶
Use these sites to select compatible server hardware: