Backup rotation scheme

A backup rotation scheme refers to a system of backing up data to computer media (such as tapes) that minimizes, via re-use, the number of media used. The scheme determines how and when each piece of removable storage is used for a backup job and how long it is retained once it has backup data stored on it. Different techniques have evolved over time to balance data retention and restoration needs with the cost of extra data storage media. Such a scheme can be quite complicated if it takes incremental backups, multiple retention periods, and off-site storage into consideration.

Schemes

First In, First Out

A First In, First Out (FIFO) backup scheme saves new or modified files onto the "oldest" media in the set, i.e. the media which contain the oldest and thus least useful previously backed up data. Performing a daily backup onto a set of 14 media, the backup depth would be 14 days. Each day, the oldest media would be inserted when performing the backup. This is the simplest rotation scheme, and is usually the first to come to mind.

This scheme has the advantage that it retains the longest possible tail of daily backups. It can be used when archived data is unimportant (or is retained separately from the short-term backup data) and data before the rotation period is irrelevant.

However this scheme suffers from the possibility of data loss: suppose an error is introduced into the data but the problem is not identified until several generations of backups and revisions have taken place. Thus when the error is detected, all the backup files contain the error. It would then be useful to have at least one older version of the data, as it would not have the error.

Grandfather-father-son

Grandfather-father-son backup refers to a common rotation scheme for backup media. In this scheme there are three or more backup cycles, such as daily, weekly and monthly. The daily backups are rotated on a daily basis using a FIFO system as above. The weekly backups are similarly rotated on a weekly basis, and the monthly backup on a monthly basis. In addition, quarterly, half-yearly, and/or annual backups could also be separately retained. Often some of these backups are removed from the site for safekeeping and disaster recovery purposes.

Tower of Hanoi

The Tower of Hanoi rotation method is more complex. It is based on the mathematics of the Tower of Hanoi puzzle, using a recursive method to optimize the back-up cycle. Every tape corresponds to a disk in the puzzle, and every disk movement to a different peg corresponds with a backup to that tape. So the first tape is used every other day (1, 3, 5, 7, 9,...), the second tape is used every fourth day (2, 6, 10, ...), the third tape is used every eighth day (4, 12, 20, ...).[1]

A set of n tapes (or other media) will allow backups for 2n-1 days before the last set is recycled. So, three tapes will give four days' worth of backups and on the fifth day Set C will be overwritten; four tapes will give eight days, and Set D is overwritten on the ninth day; five tapes will give 16 days, etc. Files can be restored from 1, 2, 4, 8, 16, ..., 2n-1 days ago.[2]

The following tables show which tapes are used on which days of various cycles. A disadvantage of the method is that half the backups are overwritten after only two days.

Three-tape Hanoi schedule

Day of the Cycle
01 02 03 04 05 06 07 08
Set A A A A
B B
C C

Four-tape Hanoi schedule

Day of the Cycle
01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16
Set A A A A A A A A
B B B B
C C
D D

Five-tape Hanoi schedule

Day of the Cycle
01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32
Set A A A A A A A A A A A A A A A A
B B B B B B B B
C C C C
D D
E E

Extensions and Example

Many variations are possible or desirable, and the concepts are readily extended to disc-based directories containing backups. Here are some options:

Coverage automatically gets sparser the further backup in time you go, which approximates the likelihood of needing to do restores from past backups.

And, Tower of Hanoi has the huge advantage of freeing implementers from having to deal with managing hourly, daily, weekly, monthly, quarterly or annual management strategies.

In general, backup set number set is used at seq=2^(set-1) + j * 2^set, j = 0, 1, 2, 3,4,..., where seq is the sequence or serial number of a backup (also the Tower of Hanoi move number).

Here's an example showing coverage, including set 0, keeping at least the last 4 days, and recycling.

Weighted random distribution

An alternative arrangement is to keep generations distributed across all points in time is by deleting (or overwriting) past generations (except the oldest and the most-recent-n generations) when necessary in a weighted-random fashion. For each deletion, the weight assigned to each deletable generation corresponds to the probability of it being deleted.

One acceptable weight is a constant exponent (possibly the square) of the multiplicative inverse of the duration (possibly expressed in the number of days) between the dates of the generation and the generation preceding it. Using a larger exponent leads to a more uniform distribution of generations, whereas a smaller exponent leads to a distribution with more recent and fewer older generations. This technique probabilistically ensures that past generations are always distributed across all points in time as is desired.

The Weighted Random method has no practical advantage over a more systematic approach.

Incremented media method

This method has many variations and names. A set of numbered media is used until the end of the cycle. Then the cycle is repeated using media numbered the same as the previous cycle, but incremented by one. The lowest numbered tape from the previous cycle is retired and kept permanently. Thus, one has access to every backup for one cycle, and one backup per cycle before that. This method has the advantage of ensuring even media wear, but requires a schedule to be precalculated.

See also

References

  1. ↑ San Francisco Computer Repair (2008-01-13). "Backup Methods". Retrieved 2008-02-21.
  2. ↑ Alvechurch Data Ltd (2007-11-27). "Tower of Hanoi pattern for backup". Retrieved 2008-03-12.
This article is issued from Wikipedia - version of the 8/14/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.