Installing a Virtual Tape Library: Difference between revisions
Tlamprecht (talk | contribs) mNo edit summary |
A.lauterer (talk | contribs) quadstors VTL is available again in a limited standard edition |
||
| Line 1: | Line 1: | ||
== Introduction == |
== Introduction == |
||
Proxmox Backup Server includes support for tape backup, allowing you to save 'Datastores' to tape |
Proxmox Backup Server includes support for tape backup, allowing you to save ''Datastores'' to tape and manage tape libraries and tape pools. |
||
Since testing backup and restore with real tape hardware takes a lot of time, it can be a good idea to use a faster Virtual Tape Library (VTL) for evaluation and for testing |
Since testing backup and restore with real tape hardware takes a lot of time, it can be a good idea to use a faster Virtual Tape Library (VTL) for evaluation and for testing |
||
| Line 10: | Line 10: | ||
== Installing the QUADStor VTL == |
== Installing the QUADStor VTL == |
||
| ⚫ | |||
<div class="sticky-box notice-box">As of Q4'2024 Quadstor stopped providing their VTL software download publicly, contact [mailto:support@quadstor.com support@quadstor.com] for inquiring your best options for evaluation and/or purchase.</div> |
|||
| ⚫ | |||
Two disks are needed. One for the Debian OS installation (for example 16 GiB) |
Two disks are needed. One for the Debian OS installation (for example, 16 GiB) and a larger one to store virtual tapes on it. A disk of at least 220 GiB allows you to fully utilize the capacity of two LTO-1 (100 GB) tapes. While real LTO-1 is not [https://pbs.proxmox.com/docs/tape-backup.html#supported-hardware supported hardware] by Proxmox Backup Server, it is still convenient for testing purposes due to its low capacity compared to modern types like LTO-8 with 12 TB. |
||
For our example, Debian has the static IP address |
For our example, Debian has the static IP address <code.10.20.1.59</code>. |
||
The following instructions are performed in the Debian VM and are based on the [https://www.quadstor.com/vtlsupport/145-installation-on-rhel-centos-sles-debian.html official QUADStor documentation]. |
The following instructions are performed in the Debian VM and are based on the [https://www.quadstor.com/vtlsupport/145-installation-on-rhel-centos-sles-debian.html official QUADStor documentation]. |
||
| Line 25: | Line 24: | ||
#::a2enmod cgi |
#::a2enmod cgi |
||
#::systemctl restart apache2</pre> |
#::systemctl restart apache2</pre> |
||
# Look up the current Debian package version number on the [https://www.quadstor.com/vtl- |
# Look up the current Debian package version number on the [https://www.quadstor.com/vtl-std-edition-downloads.html QUADStor website] and set it as a variable. For example: |
||
#:<pre> |
#:<pre> |
||
#::version=3.0.79. |
#::version=3.0.79.27</pre> |
||
# Download and install the package |
# Download and install the package; this may take a while: |
||
#:<pre> |
#:<pre> |
||
#::wget -c https://www.quadstor.com/vtldownloads/quadstor-vtl-ext-$version-debian12-x86_64.deb |
#::wget -c https://www.quadstor.com/vtldownloads/quadstor-vtl-ext-$version-debian12-x86_64.deb |
||
| Line 39: | Line 38: | ||
== Updating the QUADStor VTL and Debian == |
== Updating the QUADStor VTL and Debian == |
||
If the VTL is used for a longer period of time, we recommend installing available updates |
If the VTL is used for a longer period of time, we recommend installing available updates regularly. |
||
''' Updating Debian ''' |
''' Updating Debian ''' |
||
| Line 51: | Line 50: | ||
The following configurations are performed in the QUADStor web interface and are the minimum required ones. Details can be found in the [https://www.quadstor.com/vtl-documentation.html official QUADStor documentation]. |
The following configurations are performed in the QUADStor web interface and are the minimum required ones. Details can be found in the [https://www.quadstor.com/vtl-documentation.html official QUADStor documentation]. |
||
:1. Go to the tab 'Physical Storage' |
:1. Go to the tab ''Physical Storage'' |
||
::The table should show the empty disk |
::The table should show the empty disk; click on 'Add' and submit the 'Default' 'Storage Pool'. |
||
:2. Go to 'Device Definitions' |
:2. Go to ''Device Definitions'' |
||
::You need a 'Changer' and 'Drive' definition. Their exact properties should not be that important for our virtualization purpose. If in doubt, you can also download and import the templates [https://www.quadstor.com/uscripts/changer-definitions.txt changer-definitions.txt] and [https://www.quadstor.com/uscripts/drive-definitions.txt drive-definitions.txt] from https://www.quadstor.com/uscripts/. |
::You need a ''Changer'' and ''Drive'' definition. Their exact properties should not be that important for our virtualization purpose. If in doubt, you can also download and import the templates [https://www.quadstor.com/uscripts/changer-definitions.txt changer-definitions.txt] and [https://www.quadstor.com/uscripts/drive-definitions.txt drive-definitions.txt] from https://www.quadstor.com/uscripts/. |
||
:3. Go to 'Virtual Libraries' |
:3. Go to ''Virtual Libraries'' |
||
::Add a Virtual Tape Library (VTL) by setting your desired properties. For example: |
::Add a Virtual Tape Library (VTL) by setting your desired properties. For example: |
||
{| class="wikitable" style="margin-left: 80px" |
{| class="wikitable" style="margin-left: 80px" |
||
| Line 66: | Line 65: | ||
| Changer Definition || style="text-align:right" | IBM_3584 || |
| Changer Definition || style="text-align:right" | IBM_3584 || |
||
|- |
|- |
||
| Drive Definition || style="text-align:right" | IBM_LTO1 || for example LTO1 to virtualize a capacity of 100 GB |
| Drive Definition || style="text-align:right" | IBM_LTO1 || for example, LTO1 to virtualize a capacity of 100 GB |
||
|- |
|- |
||
| Number of VDrives || style="text-align:right" | 2 || concurrently usable tapes |
| Number of VDrives || style="text-align:right" | 2 || concurrently usable tapes |
||
| Line 75: | Line 74: | ||
|} |
|} |
||
:4. Finally, click 'Add VCartridge' |
:4. Finally, click ''Add VCartridge'' |
||
::Specify how many tapes should be inserted into the VSlots now (for example, 2). The 'Label/Prefix' (for example, tape00) must have 6 characters, including a zero for the auto-numbering scheme. |
::Specify how many tapes should be inserted into the VSlots now (for example, 2). The ''Label/Prefix'' (for example, tape00) must have 6 characters, including a zero for the auto-numbering scheme. |
||
The newly created VTL can now be added to a Proxmox Backup Server instance. |
The newly created VTL can now be added to a Proxmox Backup Server instance. |
||
| Line 89: | Line 88: | ||
#:<pre>apt install open-iscsi</pre> |
#:<pre>apt install open-iscsi</pre> |
||
# To automatically log in to the iSCSI targets on boot, carry out the following steps: |
# To automatically log in to the iSCSI targets on boot, carry out the following steps: |
||
## |
## Open the iSCSI config (<code>editor /etc/iscsi/iscsid.conf</code>) and change <code>node.startup = manual</code> to <code>node.startup = automatic</code> |
||
## |
## Then restart <code>iscsid</code> by executing <code>systemctl restart open-iscsi.service</code> |
||
# Now discover the changer and drive iSCSI targets via <code>iscsiadm</code>. Please do not forget to adapt the IP address if you chose a different one for your QUADStor VTL VM. |
# Now discover the changer and drive iSCSI targets via <code>iscsiadm</code>. Please do not forget to adapt the IP address if you chose a different one for your QUADStor VTL VM. |
||
#:<pre>iscsiadm -m discovery -t st -p 10.20.1.59</pre> |
#:<pre>iscsiadm -m discovery -t st -p 10.20.1.59</pre> |
||
| Line 107: | Line 106: | ||
In the web interface of your Proxmox Backup Server: |
In the web interface of your Proxmox Backup Server: |
||
# Go to 'Tape Backup' |
# Go to ''Tape Backup'' → ''Changers'' |
||
#: Click on 'Add', give the changer a name (for example, autoloader), and select its path in the drop-down list. |
#: Click on ''Add'', give the changer a name (for example, autoloader), and select its path in the drop-down list. |
||
# Go to 'Tape Backup' |
# Go to ''Tape Backup'' → ''Drives'' |
||
## Click on 'Add', give the drive a name (for example, drive1), select the changer and keep the 'Drive Number' |
## Click on ''Add'', give the drive a name (for example, <code>drive1</code>), select the changer, and keep the ''Drive Number'' <code>0</code>. The correct ''Path'' can be chosen by comparing the serial numbers with those in the QUADStor web interface, under ''Virtual Libraries''. |
||
## When adding a second drive, proceed with 'Drive Number' |
## When adding a second drive, proceed with ''Drive Number'' <code>1</code>. |
||
The VTL can now be used like a normal library in Proxmox Backup Server. |
The VTL can now be used like a normal library in Proxmox Backup Server. |
||
Revision as of 15:59, 19 December 2025
Introduction
Proxmox Backup Server includes support for tape backup, allowing you to save Datastores to tape and manage tape libraries and tape pools.
Since testing backup and restore with real tape hardware takes a lot of time, it can be a good idea to use a faster Virtual Tape Library (VTL) for evaluation and for testing of the correct allocation and retention policies matching your use case.
One example of such a VTL is the QUADStor VTL. This tutorial will guide you through the installation and configuration of a QUADStor VTL, and also show you how to integrate it into Proxmox Backup Server.
Installing the QUADStor VTL
This tutorial assumes the use of an official Debian 12 (Bookworm), for example, running as a virtual machine on a Proxmox VE host.
Two disks are needed. One for the Debian OS installation (for example, 16 GiB) and a larger one to store virtual tapes on it. A disk of at least 220 GiB allows you to fully utilize the capacity of two LTO-1 (100 GB) tapes. While real LTO-1 is not supported hardware by Proxmox Backup Server, it is still convenient for testing purposes due to its low capacity compared to modern types like LTO-8 with 12 TB.
For our example, Debian has the static IP address <code.10.20.1.59.
The following instructions are performed in the Debian VM and are based on the official QUADStor documentation.
- Install supporting packages:
- apt update
- apt install uuid-runtime build-essential sg3-utils apache2 gzip xz-utils postgresql libpq-dev psmisc linux-headers-`uname -r`
- a2enmod cgi
- systemctl restart apache2
- Look up the current Debian package version number on the QUADStor website and set it as a variable. For example:
- version=3.0.79.27
- Download and install the package; this may take a while:
- wget -c https://www.quadstor.com/vtldownloads/quadstor-vtl-ext-$version-debian12-x86_64.deb
- apt install ./quadstor-vtl-ext-$version-debian12-x86_64.deb
- Run
systemctl enable --now quadstorvtl.serviceand wait for its completion to verify that no errors occur. - Finally, reboot the VM:
reboot
You can now access the VTL configuration interface over HTTP using your web browser. In our example, we visit http://10.20.1.59.
Updating the QUADStor VTL and Debian
If the VTL is used for a longer period of time, we recommend installing available updates regularly.
Updating Debian
- For example, run
apt update,apt full-upgradeandreboot. If your Debian major version will not receive any more updates in the future, we recommend setting up a new VM and VTL for the sake of simplicity.
Updating QUADStor VTL
- Run
apt remove quadstor-vtl-extand follow the installation section above, starting with step 2.
Configuring the VTL
The following configurations are performed in the QUADStor web interface and are the minimum required ones. Details can be found in the official QUADStor documentation.
- 1. Go to the tab Physical Storage
- The table should show the empty disk; click on 'Add' and submit the 'Default' 'Storage Pool'.
- 2. Go to Device Definitions
- You need a Changer and Drive definition. Their exact properties should not be that important for our virtualization purpose. If in doubt, you can also download and import the templates changer-definitions.txt and drive-definitions.txt from https://www.quadstor.com/uscripts/.
- 3. Go to Virtual Libraries
- Add a Virtual Tape Library (VTL) by setting your desired properties. For example:
| Field | Value | Note |
|---|---|---|
| VTL Name | my-tape-lib | |
| Changer Definition | IBM_3584 | |
| Drive Definition | IBM_LTO1 | for example, LTO1 to virtualize a capacity of 100 GB |
| Number of VDrives | 2 | concurrently usable tapes |
| Number of VSlots | 20 | to park tapes |
| Number of IE Ports | 4 | for tape import/export |
- 4. Finally, click Add VCartridge
- Specify how many tapes should be inserted into the VSlots now (for example, 2). The Label/Prefix (for example, tape00) must have 6 characters, including a zero for the auto-numbering scheme.
The newly created VTL can now be added to a Proxmox Backup Server instance.
Adding the VTL to Proxmox Backup Server
The following commands must all be executed on the Proxmox Backup Server.
Making devices available over iSCSI
- Since the VTL will be added to Proxmox Backup Server via iSCSI, make sure that the open-iscsi package is installed:
apt install open-iscsi
- To automatically log in to the iSCSI targets on boot, carry out the following steps:
- Open the iSCSI config (
editor /etc/iscsi/iscsid.conf) and changenode.startup = manualtonode.startup = automatic - Then restart
iscsidby executingsystemctl restart open-iscsi.service
- Open the iSCSI config (
- Now discover the changer and drive iSCSI targets via
iscsiadm. Please do not forget to adapt the IP address if you chose a different one for your QUADStor VTL VM.iscsiadm -m discovery -t st -p 10.20.1.59
- The resulting output should look like this:
- 10.20.1.59:3260,1 iqn.2006-06.com.quadstor.vtl.my-tape-lib.autoloader
- 10.20.1.59:3260,1 iqn.2006-06.com.quadstor.vtl.my-tape-lib.drive1
- 10.20.1.59:3260,1 iqn.2006-06.com.quadstor.vtl.my-tape-lib.drive2
- To populate
/dev/tape/with all discovered devices, runiscsiadm -m discovery -l -p 10.20.1.59. Alternatively, you can also log in manually:- iscsiadm -m node -l --targetname iqn.2006-06.com.quadstor.vtl.my-tape-lib.autoloader
- iscsiadm -m node -l --targetname iqn.2006-06.com.quadstor.vtl.my-tape-lib.drive1
- iscsiadm -m node -l --targetname iqn.2006-06.com.quadstor.vtl.my-tape-lib.drive2
Adding the Changer and Drives to Proxmox Backup Server
In the web interface of your Proxmox Backup Server:
- Go to Tape Backup → Changers
- Click on Add, give the changer a name (for example, autoloader), and select its path in the drop-down list.
- Go to Tape Backup → Drives
- Click on Add, give the drive a name (for example,
drive1), select the changer, and keep the Drive Number0. The correct Path can be chosen by comparing the serial numbers with those in the QUADStor web interface, under Virtual Libraries. - When adding a second drive, proceed with Drive Number
1.
- Click on Add, give the drive a name (for example,
The VTL can now be used like a normal library in Proxmox Backup Server.