Zabbix - Update to the latest version 7.0 LTS

Domů / Wiki / Zabbix / Zabbix – Update to the latest version 7.0 LTS

This time, we will show you how to update Zabbix to the latest version 7.0 LTS. We will base the update on Zabbix version 6.0, PHP version 8.0, and PostgreSQL 13 with its TimescaleDB extension.

Preparation Steps

Read the “release notes” [Official release notes for Zabbix 7.0 LTS].
Thoroughly read the “upgrade notes” [Official upgrade notes for Zabbix 7.0 LTS].
Check and optimize the performance of the current database according to vendor recommendations and the requirements of the Zabbix instance.
Ensure that the versions of all components match the compatibility matrix of the new Zabbix version.
Back up the configuration files of the Zabbix server and Zabbix proxy.
Back up the databases of the Zabbix server, and if applicable, the Zabbix proxy.
Back up all custom modifications that have been manually made at the Zabbix level.

Version Check

First, we will check the versions of all components that the operation of Zabbix and its parts depend on, to ensure they precisely match the official compatibility matrix for Zabbix 7.0.

php-fpm -v
psql -V

Backup of Zabbix Configuration Files

Before proceeding with the next steps, we will back up all configuration files of the Zabbix server and Zabbix Proxy.

cp /etc/zabbix/zabbix_server.conf /<backup directory>/
cp /etc/zabbix/zabbix_agent2.conf /<backup directory>/
cp -R /usr/lib/zabbix/alertscripts/ /<backup directory>/
cp -R /usr/lib/zabbix/externalscripts/ /<backup directory>/
cp -R /usr/share/zabbix/ /<backup directory>/
cp /etc/httpd/conf/httpd.conf /<backup directory>/
cp /etc/httpd/conf.d/zabbix.conf /<backup directory>/
cp /etc/zabbix/web/zabbix.conf.php /<backup directory>/

Stopping Services

First, we will stop the Zabbix server and web server to prevent any further writing to the database.

systemctl stop zabbix-server
systemctl stop httpd

PHP Update

The new version Zabbix 7.0 requires PHP versions ranging from 8.0.0 to 8.3.x. Currently, we have version 8.0 on the server, but we will perform an update nonetheless.

We will carry out the update by changing the package management system settings using dnf at the OS level. We have had good experiences with the penultimate version, as using the latest version may introduce a bug directly in PHP, which could cause usage issues.

dnf module switch-to php:8.2 -y

Database Update

First, we will stop the currently running PostgreSQL service:

systemctl stop postgresql-13

Next, we will install the specifically supported version, in our case PostgreSQL version 16:

dnf install -y postgresql16-server

Next, we will install the TimescaleDB extension, but we must install it in the same version as your old database! If it is not in the same version, the upgrade command will not work. Using the following command, you can compare the currently installed version for PostgreSQL 13 and install the same version of the packages for PostgreSQL 16:

VERSION=$(rpm -qa | grep timescaledb-2-postgresql-13 | head -1 | sed -n 's/.*-\([0-9]\+\.[0-9]\+\.[0-9]\+\)-.*/\1/p') && dnf install -y timescaledb-2-loader-postgresql-16-$VERSION-0.el9.x86_64 timescaledb-2-postgresql-16-$VERSION-0.el9.x86_64

Note: If the version of the TimescaleDB extension is not the same, you will see the following error during the upgrade:

Now we can proceed with the initialization of the new version of the PostgreSQL database:

/usr/pgsql-16/bin/postgresql-16-setup initdb

After successfully installing all dependencies, we will run the provided update script, which will check for compatibility and, if necessary, fix internal tables and schemas according to changes between versions (as the postgres user):

su - postgres

We will transfer the configuration of permissions (pg_hba.conf) from the old version to the new one:

cat /var/lib/pgsql/13/data/pg_hba.conf > /var/lib/pgsql/16/data/pg_hba.conf

Optionally, we will also transfer the configuration of the database server itself (ensure the compatibility of individual configuration directives between versions beforehand):

cat /var/lib/pgsql/13/data/postgresql.conf > /var/lib/pgsql/16/data/postgresql.conf

We will start the database migration.

/usr/pgsql-16/bin/pg_upgrade -b /usr/pgsql-13/bin -B /usr/pgsql-16/bin -d /var/lib/pgsql/13/data -D /var/lib/pgsql/16/data -k

We will log out from the postgres user:

logout

Now, we can disable the automatic startup of the old service:

systemctl disable postgresql-13.service

And start the new version of the PostgreSQL database server, including enabling it to start automatically at system boot:

systemctl enable postgresql-16.service --now

After successfully starting the PostgreSQL server, the first step is to check and, if necessary, update our TimescaleDB within the Zabbix database:

su - postgres

psql -X

\c zabbix

In the next step, we will update the state within the PostgreSQL database itself:

ALTER EXTENSION timescaledb UPDATE;

After the successful update, we will safely exit the psql console:

exit

After the successful update, we recommend performing VACUUM and reindexing the databases. This can be done with the following commands:

/usr/pgsql-16/bin/vacuumdb --all --analyze-in-stages
reindexdb

The next step is to delete the old PostgreSQL cluster:

./delete_old_cluster.sh
rm -rf 13 delete_old_cluster.sh

Now we can remove the old package versions. We will log out from the postgres user and remove the unnecessary packages. The TimescaleDB packages have been replaced, so they are no longer present on the system and do not need to be removed:

logout

dnf remove postgresql13-*

In the final step, we can delete the folder containing the configuration files of the old version:

rm -rf /usr/pgsql-13/

Updating Zabbix

We have successfully backed up everything and updated all dependent component versions according to the official compatibility matrix for the new version of Zabbix.

Now we will proceed with updating Zabbix itself and all its components.

First, we will download the installation packages for the repositories of the new Zabbix version and clear the installation cache:

rpm -Uvh https://repo.zabbix.com/zabbix/7.0/centos/9/x86_64/zabbix-release-7.0-1.el9.noarch.rpm
dnf clean all

After this step, we have the repositories for the new version available, and we can update all other Zabbix components, including all Zabbix Proxies, sequentially:

dnf update zabbix-* -y

Since our Zabbix database uses the TimescaleDB extension, we must also run an SQL script again to initialize hypertables. A new feature in version 7.0 is the hypertabled auditlog table.

cat /usr/share/zabbix-sql-scripts/postgresql/timescaledb/schema.sql | sudo -u zabbix psql zabbix

After successfully completing the update of the Zabbix server packages and all its components, we can restart the service:

systemctl start zabbix-server.service
systemctl start httpd

The gradual activities and the entire update process, including any changes to the database schema, can be monitored in the Zabbix server log file:

tail -f /var/log/zabbix/zabbix_server.log

Note: If a database compatibility error appears after restarting the Zabbix server, simply adjust the following directive in the Zabbix server configuration file.

In this version of Zabbix, this is not a compatibility error but rather a missing TimescaleDB version number in the Zabbix source code itself!

Always refer to the compatibility matrix in the official Zabbix documentation for the appropriate versions of the database and its extensions for your specific version.

Open the Zabbix server configuration file:

nano /etc/zabbix/zabbix_server.conf

Here, we will adjust the following parameter:

AllowUnsupportedDBVersions=1

Finally, we will restart the Zabbix server service:

systemctl restart zabbix-server.service

Subsequently, the Zabbix server should start and initiate the database structure upgrade:

tail -f /var/log/zabbix/zabbix_server.log

Performance Tuning After PostgreSQL Upgrade

After successfully starting the Zabbix server, we can take an additional optional step by running the timescaledb-tune script again to fine-tune the database after the upgrade.

For this command, we will specify the path to the PostgreSQL configuration file and increase the limit on the maximum number of incoming connections to the database, which is implicitly too low for monitoring needs:

timescaledb-tune --pg-config=/usr/pgsql-16/bin/pg_config --max-conns=100

To apply the newly set configuration parameters, we will restart the PostgreSQL service (ideally, stop the Zabbix server during this process, but it is not necessary):

systemctl restart postgresql-16.service

Final Steps

Verify that the Zabbix server and database server are running correctly and have the correct version.
Check that all Zabbix proxies are running and have the correct version. (From version 6.4, there is backward compatibility, but we still recommend using the same version as the Zabbix server).
Check the status of the Zabbix server and Zabbix proxies (log files, unsupported items, queues, monitoring scripts, etc.).
Ensure that your servers are assigned the latest versions of the official Zabbix templates. [Zabbix GIT]

Support for the New Item Browser

All necessary steps can be found in a separate guide on our wiki HERE.

Installation of Components and Configuration for Reporting