Difference between revisions of "Roadmap"

From Proxmox Backup Server
Jump to navigation Jump to search
m
(11 intermediate revisions by 2 users not shown)
Line 2: Line 2:
  
 
* Proxmox VE host backup
 
* Proxmox VE host backup
−
* Proxmox Mail Gateway host backup
+
* Backup to one (physical) datastore from multiple  Proxmox VE clusters, avoiding backup naming conflicts
−
* Encryption configuration improvements
+
* GUI restore improvements (including VMs)
−
* backup to one (physical) datastore from multiple  Proxmox VE clusters, avoiding backup naming conflicts
 
−
* Updates via GUI, xterm.js host console
 
−
* GUI restore improvements
 
−
* Documentation improvements
 
−
* Add comments to backups
 
 
* Set manual protection (immutable) flag for backups
 
* Set manual protection (immutable) flag for backups
 +
* Importer for existing vzdump archives into Proxmox Backup Server
 +
* LDAP/AD Authentication
 +
* Backup clients for other operating systems
 
* ...
 
* ...
  
Line 15: Line 13:
  
 
See also [https://forum.proxmox.com/forums/announcements.7/ Announcement forum]
 
See also [https://forum.proxmox.com/forums/announcements.7/ Announcement forum]
 +
 +
== Proxmox Backup Server 2.0 ==
 +
'''Released 13. July 2021'''
 +
* Based on Debian Bullseye (11)
 +
* Kernel 5.11
 +
* ZFS 2.0
 +
 +
'''Changelog Overview'''
 +
 +
* Tape Backup:
 +
** Matured from technology preview to the first stable release
 +
** Improve restore flexibility, allowing you to select multiple snapshots for one restore job
 +
** Read chunks sorted by inode on backup, to leverage improved read speed on slow spinning disks with increased sequential access
 +
 +
* Backend:
 +
** Support for Single-Sign-On (SSO) with the new OpenID Connect access realm type
 +
**: You can integrate external authorization servers, either using existing public services or your own identity and access management solution, for example, Keycloak or LemonLDAP::NG.
 +
** ACME/Let's Encrypt integration with stand-alone and DNS Plugins, for easy deployment of trusted certificates
 +
** Improved caching for <code>proxmox-backup-client map</code>
 +
** Single file-restore support for VMs that use ZFS or LVM internally
 +
** Support setting an HTTP proxy for package updates and subscription check requests
 +
 +
* Enhancements in the web interface (GUI):
 +
** Make dashboard status panel more detailed, showing, among other things, uptime, Kernel version, CPU info and a high level repository status overview.
 +
** New Repository management panel in the <code>Administration</code> tab shows an in-depth status and a list of all configured repositories.
 +
**: Basic repository management, for example, activating or deactivating a repository, is also supported.
 +
** ACME/Let's Encrypt GUI integration
 +
** Support setting comments on a backup group
 +
** Updated ExtJS JavaScript framework to latest GPL release 7.0
 +
** Improved translations, including:
 +
*** Arabic
 +
*** French
 +
*** German
 +
*** Japanese
 +
*** Polish
 +
*** Turkish
 +
 +
* Installer:
 +
** Rework the installer environment to use <code>switch_root</code> instead of <code>chroot</code>, when transitioning from initrd to the actual installer.
 +
**: This improves module and firmware loading, and slightly reduces memory usage during installation.
 +
** Automatically detect HiDPI screens, and increase console font and GUI scaling accordingly. This improves UX for workstations with Proxmox VE (for example, for passthrough).
 +
** Improve ISO detection:
 +
*** Support ISOs backed by devices using USB Attached SCSI (UAS), which modern USB3 flash drives often do.
 +
*** Linearly increase the delay of subsequent scans for a device with an ISO image, bringing the total check time from 20s to 45s. This allows for the detection of very slow devices, while continuing faster in general.
 +
** Use <code>zstd</code> compression for the initrd image and the squashfs images.
 +
** Update to busybox 1.33.1 as the core-utils provider.
 +
 +
<div id="2.0-known-issues"></div>
 +
'''Known Issues'''
 +
 +
* '''Network''': Due to the updated systemd version, and for most upgrades, the newer kernel version (5.4 to 5.11), some network interfaces might change upon reboot:
 +
** Some may change their name. For example, due to newly supported functions, a change from <code>enp33s0f0</code> to <code>enp33s0f0np0</code> could occur.
 +
**: We observed such changes with high-speed Mellanox models.
 +
** [https://sources.debian.org/src/bridge-utils/1.7-1/debian/NEWS/#L3-L23 Bridge MAC address selection has changed in Debian Bullseye] - it is now generated based on the interface name and the <code>machine-id (5)</code> of the system.
 +
**: Note that by default, Proxmox Backup Server does not uses a Linux Bridge for networking, so most setups are unaffected.
 +
 +
'''Upgrade from 1.1'''
 +
 +
See [[Upgrade from 1.1 to 2.x]]
 +
 +
== Proxmox Backup Server 1.1 ==
 +
'''Released 15. April 2021'''
 +
* Based on Debian Buster (10.9)
 +
* Kernel 5.4.106
 +
* ZFS 2.0
 +
 +
* Tape Backup (Technology Preview)
 +
** Tape technology has stood the test of time, when it comes to highly reliable, economic and flexible long-term storage of large amounts of data. Key advantages being:
 +
*** the inherent offline nature of the stored data - mitigating crypto-locker attacks;
 +
*** the portability of the tapes - making them ideal for off-site archiving;
 +
*** the existence of WORM (write once read many) tapes - a key requirement for compliance with data integrity regulations in certain environments;
 +
*** the low cost per storage unit;
 +
** Tape backup jobs back up datastores to a media pool, and multiple datastores can be backed up to the same media pool. Choose to write all snapshots of a datastore or only the latest snapshot per group to the media set.
 +
** Tape restore jobs restore the content of a media set to one or more datastores - this enables operators to restore multiple datastores from a media set, even if the system does not have the free disk space required in a single datastore (potentially multiple 100 TB).
 +
** Flexible retention policies (e.g., always recycle tapes, never recycle tapes, recycle tapes after a particular calendar event).
 +
** New user space tape driver written in Rust.
 +
** Support for tape encryption using the hardware encryption feature of the LTO tape drive.
 +
** Support for tape autoloaders - by rewriting the <code>mtx</code> tool in Rust (now <code>pmtx</code>), most autoloaders supported by other tape-backup solutions available on Linux will work with Proxmox Backup Server.
 +
** For stand-alone tape drives without an attached changer, users are notified via e-mail about necessary (load/unload) operations.
 +
** The configuration of all necessary components, jobs, and schedules can be carried out comfortably via the web interface.
 +
** The Proxmox LTO Barcode Label Generator, a small web-app, can be used to generate and print barcode labels for the tapes on standard adhesive label sheets. These help to identify the tapes in an autoloader.
 +
 +
* Two-factor authentication (TFA) for the web interface
 +
** The web interface can now be configured to use TFA with one or more of the following implementations:
 +
*** Time-base One-Time Password (TOTP), for clients like FreeOTP, Google Authenticator, etc.
 +
*** WebAuthn, a general standard for authentication. This is implemented by various security devices, like hardware keys or by the trusted platform modules (TPM) of a computer or smartphone.
 +
*** Recovery keys for single use (as backup, should you lose your authenticators).
 +
** The activation and configuration of TFA can be done by the users themselves or by an administrator.
 +
** TFA is complemented by the existing, token-based authentication for granting automated access to Proxmox Backup Server resources, for example, when configuring a Proxmox Backup Server storage in a Proxmox VE setup.
 +
 +
* HTTP compression via Content-Encoding
 +
** Responses from the Proxmox Backup Server API can get quite large, but in general can be compressed well. By adding support for deflate Content-Encoding, bandwidth is saved and response times are improved, especially over bandwidth constricted links.
 +
 +
* Compression of file-level ZIP archive downloads
 +
** Downloading a directory from a file-level backup will now produce a compressed ZIP archive, reducing bandwidth and local space required.
 +
 +
* Notable enhancements and bug fixes
 +
** Improved handling of POSIX ACL entries on files.
 +
** Improved hand-over to new process when upgrading the Proxmox Backup Server packages.
 +
** Use the local filesystem to handle synchronization, in order to avoid issues with locking on remote filesystems (CIFS/NFS).
 +
** Changed HTTP timeouts to work more robustly, even over high latency and low bandwidth links, which are not uncommon for remote backup sites.
 +
** Better error-handling during garbage-collection, coping with the case when there's no space left on a datastore filesystem.
 +
** Improved UX when using a GPG master key.
 +
** Verification: Sort chunks by their inode to speed-up access on a storage with slow random-IO, for example, spinning disks.
 +
== Proxmox Backup Server 1.0 ==
 +
'''Released 11. November 2020'''
 +
* Based on Debian Buster (10.6)
 +
* Kernel 5.4 LTS
 +
* ZFS 0.8.4
 +
 +
* Backup & Restore (core functionality):
 +
** Deduplication<br />Periodic backups produce large amounts of duplicate data. The deduplication layer avoids redundancy and minimizes the used storage space. Deduplication is performed per datastore.
 +
** Incremental backups<br />Changes between backups are typically small. Reading and sending only the delta reduces the storage and network impact of backups.
 +
** Data Integrity<br />The built in SHA-256 checksum algorithm ensures the accuracy and consistency of your backups.
 +
** Compression <br />The ultra-fast Zstandard compression is able to compress several gigabytes of data per second.
 +
** Encryption <br /> Backups can be encrypted on the client-side using AES-256 in Galois/Counter mode. This authenticated encryption mode provides very high performance on modern hardware.
 +
** Verification <br />Backups on disk can be verified with the stored SHA-256 checksums to protect against corruption and bitrot. This can be scheduled periodically including regular re-verification.
 +
** Remote Sync<br />It is possible to efficiently synchronize data from remote sites. Only deltas containing new data are transferred. Optimized and tested for high-latency links.
 +
** Performance<br />The whole software stack is written in Rust, to provide high speed and memory efficiency.
 +
** Open Source<br />Proxmox Backup Server is free and open-source software. The source code is licensed under GNU AGPL, v3.
 +
** And of course - Backups can be restored comfortably!
 +
* Proxmox VE Integration
 +
** Support for incremental, deduplicated backups of qemu virtual machines (supporting QEMU dirty bitmaps) and containers.
 +
** Simply configurable as a Storage Backend on Proxmox VE
 +
** Granular restore:
 +
*** Mapping for QEMU virtual disks to loop back block devices
 +
*** File-level restore of container backups
 +
** Current backup state is preserved across migrations inside Proxmox VE
 +
* Enterprise support<br />With the release of version 1.0, support subscriptions for Proxmox Backup Server are available, providing access to the stable Enterprise Repository (recommended for production use) and to technical support from the Proxmox team.
 +
* Web interface<br />Manage Proxmox backups with the integrated, web-based user interface.
 +
** Start operations from within the views in which they are relevant
 +
** Widgets in the GUI provide useful popups when you hoover over (e.g., individual states in the task summary, on the dashboard)
 +
** Improved and mature user experience in the GUI - many features known from other Proxmox products were ported to the new Rust code-base to provide the same level of comfort during daily work:
 +
*** Online reference documentation for the current version, available in the GUI via the Help button
 +
*** System console via xterm.js
 +
*** System updates and changelogs
 +
*** Display of the system's journal
 +
* Scheduling
 +
** Management and scheduling of maintenance tasks provides all the settings necessary to just configure it once and not have to think about it
 +
** Scheduling based on the flexible systemd-time specification
 +
* E-mail notifications for scheduled background tasks (verification, pruning, garbage collection, sync jobs).
 +
* Vastly improved user interface
 +
* Sensible encryption-key handling
 +
** Proxmox Backup Server encryption keys are stored as simple json files, and can be easily stored off-site for disaster recover purposes
 +
** They can also be exported as QR-codes for printing on paper and storing off-line
 +
* Flexible Access Control:
 +
** Support for fine-grained ACLs for separate users on different objects (datastores, remotes, system configuration)
 +
** Token based authentication with reduced privileges:<br />A user can create tokens with a subset of their privileges, instead of having to store their password on a client
 +
 +
== Proxmox Backup Server Beta (2nd ISO release) ==
 +
 +
'''Released 5. October 2020'''
 +
 +
* Beta Release
 +
* Update to recent package versions with many fixes and feature additions
 +
* Based on Debian 10.6 Buster
 +
* Updated kernel (5.4) and include latest security fixes
  
 
== Proxmox Backup Server Beta ==
 
== Proxmox Backup Server Beta ==

Revision as of 10:15, 13 July 2021

Roadmap

  • Proxmox VE host backup
  • Backup to one (physical) datastore from multiple Proxmox VE clusters, avoiding backup naming conflicts
  • GUI restore improvements (including VMs)
  • Set manual protection (immutable) flag for backups
  • Importer for existing vzdump archives into Proxmox Backup Server
  • LDAP/AD Authentication
  • Backup clients for other operating systems
  • ...

Release History

See also Announcement forum

Proxmox Backup Server 2.0

Released 13. July 2021

  • Based on Debian Bullseye (11)
  • Kernel 5.11
  • ZFS 2.0

Changelog Overview

  • Tape Backup:
    • Matured from technology preview to the first stable release
    • Improve restore flexibility, allowing you to select multiple snapshots for one restore job
    • Read chunks sorted by inode on backup, to leverage improved read speed on slow spinning disks with increased sequential access
  • Backend:
    • Support for Single-Sign-On (SSO) with the new OpenID Connect access realm type
      You can integrate external authorization servers, either using existing public services or your own identity and access management solution, for example, Keycloak or LemonLDAP::NG.
    • ACME/Let's Encrypt integration with stand-alone and DNS Plugins, for easy deployment of trusted certificates
    • Improved caching for proxmox-backup-client map
    • Single file-restore support for VMs that use ZFS or LVM internally
    • Support setting an HTTP proxy for package updates and subscription check requests
  • Enhancements in the web interface (GUI):
    • Make dashboard status panel more detailed, showing, among other things, uptime, Kernel version, CPU info and a high level repository status overview.
    • New Repository management panel in the Administration tab shows an in-depth status and a list of all configured repositories.
      Basic repository management, for example, activating or deactivating a repository, is also supported.
    • ACME/Let's Encrypt GUI integration
    • Support setting comments on a backup group
    • Updated ExtJS JavaScript framework to latest GPL release 7.0
    • Improved translations, including:
      • Arabic
      • French
      • German
      • Japanese
      • Polish
      • Turkish
  • Installer:
    • Rework the installer environment to use switch_root instead of chroot, when transitioning from initrd to the actual installer.
      This improves module and firmware loading, and slightly reduces memory usage during installation.
    • Automatically detect HiDPI screens, and increase console font and GUI scaling accordingly. This improves UX for workstations with Proxmox VE (for example, for passthrough).
    • Improve ISO detection:
      • Support ISOs backed by devices using USB Attached SCSI (UAS), which modern USB3 flash drives often do.
      • Linearly increase the delay of subsequent scans for a device with an ISO image, bringing the total check time from 20s to 45s. This allows for the detection of very slow devices, while continuing faster in general.
    • Use zstd compression for the initrd image and the squashfs images.
    • Update to busybox 1.33.1 as the core-utils provider.

Known Issues

  • Network: Due to the updated systemd version, and for most upgrades, the newer kernel version (5.4 to 5.11), some network interfaces might change upon reboot:
    • Some may change their name. For example, due to newly supported functions, a change from enp33s0f0 to enp33s0f0np0 could occur.
      We observed such changes with high-speed Mellanox models.
    • Bridge MAC address selection has changed in Debian Bullseye - it is now generated based on the interface name and the machine-id (5) of the system.
      Note that by default, Proxmox Backup Server does not uses a Linux Bridge for networking, so most setups are unaffected.

Upgrade from 1.1

See Upgrade from 1.1 to 2.x

Proxmox Backup Server 1.1

Released 15. April 2021

  • Based on Debian Buster (10.9)
  • Kernel 5.4.106
  • ZFS 2.0
  • Tape Backup (Technology Preview)
    • Tape technology has stood the test of time, when it comes to highly reliable, economic and flexible long-term storage of large amounts of data. Key advantages being:
      • the inherent offline nature of the stored data - mitigating crypto-locker attacks;
      • the portability of the tapes - making them ideal for off-site archiving;
      • the existence of WORM (write once read many) tapes - a key requirement for compliance with data integrity regulations in certain environments;
      • the low cost per storage unit;
    • Tape backup jobs back up datastores to a media pool, and multiple datastores can be backed up to the same media pool. Choose to write all snapshots of a datastore or only the latest snapshot per group to the media set.
    • Tape restore jobs restore the content of a media set to one or more datastores - this enables operators to restore multiple datastores from a media set, even if the system does not have the free disk space required in a single datastore (potentially multiple 100 TB).
    • Flexible retention policies (e.g., always recycle tapes, never recycle tapes, recycle tapes after a particular calendar event).
    • New user space tape driver written in Rust.
    • Support for tape encryption using the hardware encryption feature of the LTO tape drive.
    • Support for tape autoloaders - by rewriting the mtx tool in Rust (now pmtx), most autoloaders supported by other tape-backup solutions available on Linux will work with Proxmox Backup Server.
    • For stand-alone tape drives without an attached changer, users are notified via e-mail about necessary (load/unload) operations.
    • The configuration of all necessary components, jobs, and schedules can be carried out comfortably via the web interface.
    • The Proxmox LTO Barcode Label Generator, a small web-app, can be used to generate and print barcode labels for the tapes on standard adhesive label sheets. These help to identify the tapes in an autoloader.
  • Two-factor authentication (TFA) for the web interface
    • The web interface can now be configured to use TFA with one or more of the following implementations:
      • Time-base One-Time Password (TOTP), for clients like FreeOTP, Google Authenticator, etc.
      • WebAuthn, a general standard for authentication. This is implemented by various security devices, like hardware keys or by the trusted platform modules (TPM) of a computer or smartphone.
      • Recovery keys for single use (as backup, should you lose your authenticators).
    • The activation and configuration of TFA can be done by the users themselves or by an administrator.
    • TFA is complemented by the existing, token-based authentication for granting automated access to Proxmox Backup Server resources, for example, when configuring a Proxmox Backup Server storage in a Proxmox VE setup.
  • HTTP compression via Content-Encoding
    • Responses from the Proxmox Backup Server API can get quite large, but in general can be compressed well. By adding support for deflate Content-Encoding, bandwidth is saved and response times are improved, especially over bandwidth constricted links.
  • Compression of file-level ZIP archive downloads
    • Downloading a directory from a file-level backup will now produce a compressed ZIP archive, reducing bandwidth and local space required.
  • Notable enhancements and bug fixes
    • Improved handling of POSIX ACL entries on files.
    • Improved hand-over to new process when upgrading the Proxmox Backup Server packages.
    • Use the local filesystem to handle synchronization, in order to avoid issues with locking on remote filesystems (CIFS/NFS).
    • Changed HTTP timeouts to work more robustly, even over high latency and low bandwidth links, which are not uncommon for remote backup sites.
    • Better error-handling during garbage-collection, coping with the case when there's no space left on a datastore filesystem.
    • Improved UX when using a GPG master key.
    • Verification: Sort chunks by their inode to speed-up access on a storage with slow random-IO, for example, spinning disks.

Proxmox Backup Server 1.0

Released 11. November 2020

  • Based on Debian Buster (10.6)
  • Kernel 5.4 LTS
  • ZFS 0.8.4
  • Backup & Restore (core functionality):
    • Deduplication
      Periodic backups produce large amounts of duplicate data. The deduplication layer avoids redundancy and minimizes the used storage space. Deduplication is performed per datastore.
    • Incremental backups
      Changes between backups are typically small. Reading and sending only the delta reduces the storage and network impact of backups.
    • Data Integrity
      The built in SHA-256 checksum algorithm ensures the accuracy and consistency of your backups.
    • Compression
      The ultra-fast Zstandard compression is able to compress several gigabytes of data per second.
    • Encryption
      Backups can be encrypted on the client-side using AES-256 in Galois/Counter mode. This authenticated encryption mode provides very high performance on modern hardware.
    • Verification
      Backups on disk can be verified with the stored SHA-256 checksums to protect against corruption and bitrot. This can be scheduled periodically including regular re-verification.
    • Remote Sync
      It is possible to efficiently synchronize data from remote sites. Only deltas containing new data are transferred. Optimized and tested for high-latency links.
    • Performance
      The whole software stack is written in Rust, to provide high speed and memory efficiency.
    • Open Source
      Proxmox Backup Server is free and open-source software. The source code is licensed under GNU AGPL, v3.
    • And of course - Backups can be restored comfortably!
  • Proxmox VE Integration
    • Support for incremental, deduplicated backups of qemu virtual machines (supporting QEMU dirty bitmaps) and containers.
    • Simply configurable as a Storage Backend on Proxmox VE
    • Granular restore:
      • Mapping for QEMU virtual disks to loop back block devices
      • File-level restore of container backups
    • Current backup state is preserved across migrations inside Proxmox VE
  • Enterprise support
    With the release of version 1.0, support subscriptions for Proxmox Backup Server are available, providing access to the stable Enterprise Repository (recommended for production use) and to technical support from the Proxmox team.
  • Web interface
    Manage Proxmox backups with the integrated, web-based user interface.
    • Start operations from within the views in which they are relevant
    • Widgets in the GUI provide useful popups when you hoover over (e.g., individual states in the task summary, on the dashboard)
    • Improved and mature user experience in the GUI - many features known from other Proxmox products were ported to the new Rust code-base to provide the same level of comfort during daily work:
      • Online reference documentation for the current version, available in the GUI via the Help button
      • System console via xterm.js
      • System updates and changelogs
      • Display of the system's journal
  • Scheduling
    • Management and scheduling of maintenance tasks provides all the settings necessary to just configure it once and not have to think about it
    • Scheduling based on the flexible systemd-time specification
  • E-mail notifications for scheduled background tasks (verification, pruning, garbage collection, sync jobs).
  • Vastly improved user interface
  • Sensible encryption-key handling
    • Proxmox Backup Server encryption keys are stored as simple json files, and can be easily stored off-site for disaster recover purposes
    • They can also be exported as QR-codes for printing on paper and storing off-line
  • Flexible Access Control:
    • Support for fine-grained ACLs for separate users on different objects (datastores, remotes, system configuration)
    • Token based authentication with reduced privileges:
      A user can create tokens with a subset of their privileges, instead of having to store their password on a client

Proxmox Backup Server Beta (2nd ISO release)

Released 5. October 2020

  • Beta Release
  • Update to recent package versions with many fixes and feature additions
  • Based on Debian 10.6 Buster
  • Updated kernel (5.4) and include latest security fixes

Proxmox Backup Server Beta

Released 10. July 2020

  • First public beta release
  • Based on Debian Buster (10.4)
  • Kernel 5.4 LTS with ZFS 0.8.4
Retrieved from "https://pbs.proxmox.com/wiki/index.php?title=Roadmap&oldid=65"