Unstable versions of
scdbackup
to scdbackup homepage
If you download the development version, please check the buglists some
weeks later.
Current development version :
Changelist:
- 27 Aug 2004 | 0.8 0.8.1
Most recent bug fix in 0.8
Most recent bug fix in 0.8.1
- 24 Aug 2004 | 0.8.1
It is now possible to configure DVD for
cdrecord-ProDVD
rather than for growisofs. Nevertheless, there seems to be no way
to use it without a 4.5 GB buffer file.
- 19 Aug 2004 | 0.8.1
New general options -version , -where , -which if given as
the only argument to any of the commands, return on stdout :
scdbackup version timestamp, scdbackup directory, effective worker script.
Symbolic links are now enabled as input for mkisofs 2.0 or newer.
- 17 Aug 2004 | 0.8.1
Installation instructions in README and examples.html have been
overhauled. It is now possible to install scdbackup without any
superuser authority.
The backup script is now able to detect failures of mkisofs which up
to now were hidden by its position in pipes. Unless file
scdbackup_exit0_if_burn_failed exists, the backup run will
abort in such a case.
- 15 Aug 2004 | 0.8.1
A failed burn should now abort the whole backup run and advise
to restart with -resume as soon as the problem is solved.
Locking may now be done in an arbitrary directory outside the
installation directory. Info script ASKME is now created in the
tmp directory of the installation rather than in the user's $HOME
directory. Language may be switched between english and german
per user. Automatically created backup scripts now have the same
(english) name in both dialog languages.
- 08 Aug 2004 | 0.8.1
New script ./SET_PERMISSIONS and quite restrictive default
settings during ./CONFIGURE_* .
- 07 Aug 2004 | 0.8 0.8.1
The amount of padding with writing CD or DVD has been increased
to 300 kB. This became necessary because new drives and drivers
fail to read data at the end of a CD even more than old ones.
- 04 Aug 2004 | 0.8.1
The intermediate scripts like volume_preburn_script now got specialized
siblings like volume_preburn_script_cd and volume_preburn_script_dvd.
The CD specific command scripts like scdbackup have been divided from
the general backup tasks like burning a set of ISO media. The old
command scripts are deprecated but may still be installed by
./SUPERUSER_CONFIGURE -install_old_style
- 30 Jul 2004 | 0.8.1
If automatic blanking is set then it is not necessary any more to
manually blank second and further CD-RWs of an oversized afio volume.
Handling of large files is now configurable within ./CONFIGURE_CD and
./CONFIGURE_DVD. Another input prompt. (sigh)
- 11 Jul 2004 | 0.8.1
Together with -split_large_files it is now possible to
include raw block devices by option -special_file.
Wether a restored copy of a block device will work or not, depends
much on the meaning of the content and the similarity of the restore
environment in respect to the source environment. (E.g.: Consider
/etc/fstab in a partition image which moves from /dev/hda3 to /dev/hdb2.)
- 26 Jun 2004 | 0.8.1
Previously idle sdvdbackup_blank now got a job.
It overwrites DVD media with pseudo random bytes in order to make
the old data content unreadable. Privacy issue : It is easy to read
old backup remains from a DVD until they really get overwritten.
- 12 Jun 2004 | 0.8.1
New options -split_large_files,-cut_file,-split_list_adr
as a first attempt to provide a solution to the various problems with
large files. Still a lot of work to do.
- 3 Mar 2004 | 0.8.1
afio compression can now be used independendly of file buffering by
setting environment variable SCDBACKUP_AFIO_COMPRESS either
to "0" or to "1". If the variable is empty or contains "-" then
afio compression is triggered by buffering.
For use of afio with compression but without buffer file you will need
either a fast processor and disks or writer hardware which tolerates
buffer underruns, such as DVD+RW or BURN-Proof CD-RW. It is wise
to reduce writing speed.
- 2 Mar 2004 | 0.8
- New as (hopefully) stable features :
-
- Verification of write success and media readability
- Set of commands for writing on DVD
- Incremental backups enhanced by checksums, list of vanished files
- Large File Support (depending on afio and mkisofs and operating system)
- Simplified upgrade from previous versions by
FETCH_CONFIGURATION
- With incremental backups
-max_size
and some other options can be overridden
Special thanks to Andy Polyakov for creating
dvd+rw-tools
as well as
Dirk Lison and Karsten Lengwenus for testing the new commands with
their DVD writers.
- 05 Dec 2003 | 0.7
Most recent bug fix in 0.7 .
There was a blind spot of one hour with incremental backups during
daylight saving time. If you made incremental backups then better
do a -level 1 now.
- 07 Nov 2003 | 0.7.1
From now on the C programs get compiled with Large File Support to be
able to handle file sizes over 2 GB.
Important: If you really have files larger than 2 GB you will also need
very recent versions of mkisofs (cdrtools-2.01a19) and/or afio
(afio-2.4.7.9beta4) which can handle such files.
Be aware that possibly the ISO file system driver of your operating system
is not ready for reading large files. Make a test to be sure.
- 07 Nov 2003 | 0.7.1
The size determination for planning of backups in format afio is now
done more accurately by an internal function. If you need the old behavior
add option -dir_size_cmd 'du -sk' to your backup command.
- 29 Aug 2003 | 0.7.1
The scripts for restoring directory permissions and for removing obsolete
(vanished) files now use the target addresses and not the source addresses
of their file objects. The lists of content and directory properties now
contain both, source and target addresses. New options
-delete_targetlist
and -verify_targetlist can make use of the target addresses.
- 23 Aug 2003 | 0.7.1
New option-max_size_stack allows to handle situations with media
of different sizes.
- 14 Mar 2003 | 0.7.1
The text dvd_hack.txt explains how to use Andy Polyakov's
program growisofs to write backups on DVD+RW with more
than 4 GB of capacity.
- 17 Jan 2003 | 0.7.1
Inspired by Alex Pozgaj a command for verifying result CDs has
been introduced: scdbackup_verify. It uses a list of
checksum records to compare the output of a CD with the former output
of mkisofs or afio during the backup run. See its
-help text.
cd_backup_planer learned to act as a filter which determines
length and checksum of the data of a backup volume. New options are :
-filter_md5 -filter_crc32 -compare_checksum
-list_checksum -search_md5
Since some CD-reading devices have trouble to read all bytes from a CD,
option -pad needed to be added to file
scdbackup_cdrecord_opt_value (see also: man cdrecord).
- 1 Jan 2003 | 0.7.1
./CONFIGURE now examines locally installed cdrecord
and mkisofs to advise the user wether to prefer them
over the old binaries from the scdbackup package. It automatically
detects wether mkisofs needs option -graft-points or
if it knows option -path-list .
- 28 Dec 2002 | 0.7.1
Various new options of cd_backup_planer enable
incremental backups to detect changes even if the timestamps
do not indicate them. These options are :
-changetest_options , -complete_list_adr , -content_list_adr ,
-list_output_format , -load_old_tree , -vanish_list_adr ,
-vanish_script_adr.
Other new options are
-disable_safe_leveling , -working_directory.
Some of these options are now automatically set by ./CONFIGURE
and cd_backup_planer -level -create_configuration.
- 13 Apr 2002 | 0.7.1
The new program saskme and its start script
scdbackup_askme
speed up finding of files in large ASKME scripts. They also provide
search with regular expressions and a dialog mode.
See text
scdbackup_askme_help for details.
- 7 Apr 2002 | 0.7.1
Option -form_path_list_mkisofs allows to use option
-path-list which is available with newer versions of mkisofs.
With this output format a very large setting of -max_items
is permittable.
- 7 Feb 2002 | 0.7.1
CONFIGURE now can prepare for cooperation with burnproof recorders.
Needs installed cdrecord-1.9 or newer. Answer "b" or "gb" to
question "Use mkisofs_prog and cdrecord_prog ?".
- 15 Nov 2001 | 0.7
Incremental backups with an arbitrary number of levels. Option
-conf_dir chooses a particular configuration. Option
-level chooses an update level. The ASKME script of
an update may use the ASKME scripts of lower levels to locate
a file.
- 03 Nov 2001 | 0.6.1
CONFIGURE now can prepare for cooperation with mkisofs from
cdrtools-1.10. To question "Use mkisofs_prog and cdrecord_prog ?"
answer "g" rather than "n" in order to get mkisofs option
-graft-points and to omit Option -J.
- 20 Oct 2001 | 0.6.1
scdbackup-0.6.1.tar.gz does no longer contain binaries of the included
C programs. Binaries of cdrecord and mkisofs are still provided.
- 28 Dec 2000 | 0.6.1
A new option -last_volume_count prints the number of volumes
in the most recently prepared backup. Together with some other changes
it is now possible to control the planning of a backup and the creation
of its volumes by shell scripts and to perform own activities in between.
See outer_loop
- 12 Dec 2000 | 0.6.1
Provisions to create particular volumes independently.
A new option -prepare_only prevents immediate start of
the first volume. A -
before the number given with -resume
creates only that volume number and not the following ones.
There should be no more obstacle to create several volumes
simultaneously.
- 12 Sep 2000 | 0.6.1
Some bugfixes and new options in cd_backup_planer.c .
Two of them may be used as options of scdbackup* :
-accept_all_filetypes , -localdev
Two others help to use cd_backup_planer for other purposes :
-form_raw , -volume_info
- 26 Jun 2000 | 0.6.1
Bugfixes in cd_backup_planer.c . Many thanks to Volker Apelt
and Jake Hamby who not only discovered them but also sent
corrections.
A new parameter in ./CONFIGURE can set an installation
directory other than /usr/local (in my new SuSE 6.4 there
is no /usr/local/sbin).
- 5 Feb 2000 | 0.6.1
A first attempt on incremental backups: -younger_than
See cd_backup_planer -help for details.
- 19 Jan 2000 | 0.6
Former version 0.5.3 with adjusted documentation.
- 12 Jan 2000 | 0.5.3
The script change_shell_to_use
contains hints and commands for changing the shell if /bin/sh is not
suitable on your system. (There has been made a Solaris port by
James Craig Ostheimer and he experienced that $(...) was not recognized
by his /bin/sh.)
- 18 Dec 1999 | 0.5.3
When creating ISO9660 filesystems, the characters ~ and #
in file names can now be replaced by +23+ resp. +7E+ .
Enabled by option -filecheck -append_hexcode
- 0.5.3
Multi-volume afio archives are possible now. They are automatically created
if a piece does not fit on a single CD. Use -max_size 1000g to
create a single multi-volume archive rather than multiple single-volume
archives.
About the multi-volume technology
scdbackup_home now accepts the options of cd_backup_planer
like the other commands
New option -scattering -on enables better usage of -max_size
New option -xdev excludes all filesystems which are mounted
below the items of the backuplist
- 14 Dec 1999 | 0.5.2
Changed in cd_backup_command : from $@ to "$@"
- 09 Dec 1999 | 0.5.2
Replaced usage of find by cd_backup_planer -find
- 08 Dec 1999 | 0.5.2
Replaced the usage of var=$(line) by read var
- 0.5.2
Restartability of interupted backups. ( scdbackup -resume )
The awkward default combination of backup script and information script is
now replaced by a random access function. An information script is only
generated when stated explicitely with -info_script .
- 0.5.1
Better balanced distribution over CDs ( cd_backup_planer -min_size_percent )
but too ill. This is working now in 0.5.2 .
Most recent frozen version :
Unresolved bugs:
- 22 Jan 2000 | 0.5.2 (maybe 0.5.3) |
The file object /root/.kde/share/apps/kmp3/unique_fifo
causes the program to hang. The type of this object is yet unknown
(since i do not have KDE installed).
Workaround: explicitely exclude this file if it exists on your system.
Resolved bugs:
- 26 Aug 2004 | 0.8 , 0.8.1 | corrected in 0.8 and 0.8.1 after 27 Aug 2004
Incremental backups of relative adresses were not done properly.
All files were included regardless of age or checksum.
Commands scdbackup_home and sdvdbackup_home
were affected.
Eventually rerun them with -level -update_configuration.
With version 0.8 do not use relative addresses in incremental backups.
Both *_home commands have been changed to use absolute addresses.
Many thanks to Marco.
- 14 Aug 2004 | 0.8 , 0.8.1 | corrected in 0.8 and 0.8.1 after 15 Aug 2004
Option -accept_all_filetypes (used automatically with afio
formatted backups) did not work properly when directories had to be
splitted. All files in such a directory which were not data files or
directories have been skipped. Although this is not very probable with
a system backup - better redo it with the repaired programs.
Many thanks to Tony Charles.
- 07 Aug 2004 | 0.8 , 0.8.1 | corrected in 0.8 and 0.8.1 after 09 Aug 2004
Preparing the content list of an incremental backup stalled
at the first named pipe encoutered. The checksum generator
waited patiently for somebody to talk into that named pipe.
Many thanks to Tony Charles.
A questionable C construct of mine has been exposed by a questionable
output of gcc on PPC Linux. The remedy was to clean up my part.
It happened to be the same function as with above named pipe bug. So
i decided to introduce the change into (not so) stable version 0.8.
Many thanks to Michael Evans
- 19 Jul 2004 | 0.8.1 | corrected in 0.8.1 after 20 Jul 2004
With -split_large_files the first part of any large file
was missing if the file was not given explicitely as argument.
If you alread used -split_large_files then better redo
the backups or check carefully wether your backups are affected.
- 30 Jun 2004 | 0.8 , 0.8.1 | corrected in 0.8 and 0.8.1 after 02 Jul 2004
Defining a new incremental backup by option
-level -create_configuration led to a double sized
backup. -level -update_configuration was ill, too.
The resulting definitions are ok, nevertheless. There was no
problem with subsequent -level 0 or any higher level.
Many thanks to Samuele E. Locatelli.
- 22 Jun 2004 | 0.8 , 0.8.1 | corrected in 0.8 and 0.8.1 after 24 Jun 2004
Since the various users of an scdbackup installation produced the same
temporary files there could occur problems when overwriting them
(depends on directory sticky bit and variant of command rm).
As preliminary solution the names of automatically created scripts and
lists now get appended the content of environment variable EUID.
If you manually change s*backup_path_list_value, then make sure it
contains a name with "mkisofs_path_list" where "_"$EUID will get
appended or a text mark "=EUID=" for which $EUID will get substituted.
If your shell does not automatically set EUID, you may write one into
file $HOME/.scdbackup_userid. Set a different id number for each user.
Find inspiration in /etc/passwd.
Many thanks to Dirk Heutzeroth.
- 23 May 2004 | 0.8 , 0.8.1 | corrected in 0.8 and 0.8.1 after 24 May 2004
Locking and DVD-speed "any" did not work well together :
Runtime error (func=(main), adr=15): Divide by zero
.../scdbackup-0.8/temp_lock : unknown option -lifetime
The problem was in scripts lock and refresh
when dividing by $factor.
Many thanks to Florian Reichert.
- 09 Feb 2004 | 0.7.1 , 0.8 | corrected in 0.8 after 09 Feb 2004
When redirecting a symbolic link which was given explicitely as
argument to its original data source the target was changed too.
- 20 Jan 2004 | 0.7.1 | corrected in 0.7.1 after 20 Jan 2004
The wrapper scripts *_dvd of the DVD hack did not pass arguments
like -resume or -help properly to the scdbackup* commands.
Many thanks to Dirk Lison.
- 05 Dec 2003 | 0.6.1 , 0.7 , 0.7.1 | corrected in 0.7 , 0.7.1 after 05 Dec 2003
Timecode strings like "061211362003" or "A30612.1136" were converted
without taking into respect daylight saving time. So during summer the
timecodes generated by an incremental backup left a gap of one hour
when used with the next backup level.
- 04 Nov 2003 | all versions | corrected in 0.7.1 after 7 Nov 2003
scdbackup_sys and scdbackup_afio use program
du
for determining the size of a directory tree. In case of a sparsely filled
file du might return much less bytes than afio will
need for
the copy in its archive. Not a fault of du but a wrong choice by me.
A function for size determination is now built into version 0.7.1 :
-dir_size_cmd -internal . It seems that
-dir_size_cmd 'du -sk'
is up to three times faster but less accurate even with well filled files.
The new internal function is now used by default.
- 29 Aug 2003 | 0.7.1 | corrected in 0.7.1 after 29 Aug 2003
./CONFIGURE issued a confusing message and ignored the
existence of locally installed mkisofs if this mkisofs did not
understand the option -version.
- 22 Aug 2003 | 0.7.1 | corrected in 0.7.1 after 29 Aug 2003
The various file lists did not reflect the possible mappings from
source addresses to target addresses. Therefore it would be cumbersome
to restore layered backups by help of these lists and scripts.
- 29 Jul 2003 | 0.7.1 | corrected in 0.7.1 after 29 Jul 2003
The slow but more accurate method of precomputing the size of afio
backups was broken because of a change in the output format of
program raedchen . An error message appeared :
expr: non-numeric argument
Many thanks to Chris Gianniotis.
- 23 Jul 2003 | 0.7.1 | corrected in 0.7.1 after 24 Jul 2003
Relative source addresses like mnt/my_file were not checked properly
by filter option -verify_sources . They were reported as
"--- missing :"
with empty addresses and excluded from the backup.
Many thanks to Rocky Essing.
- 3 Jun 2003 | 0.7.1 | corrected in 0.7.1 after 4 Jun 2003
Incremental backup planning ended with SIGSEGV if there had been
vanished files recorded two levels below.
- 3 Apr 2003 | 0.7.1 | corrected in 0.7 and 0.7.1 after 4 Apr 2003
When upgrading from a previous version of scdbackup the script
SUPERUSER_CONFIGURE used the settings and programs in the old
version's directory rather than those in the current directory.
Version 0.7.1 complains about a missing file and bad sed expressions.
Many thanks to Pierre Maziere.
- 30 Jan 2003 | 0.7.1 | corrected in 0.7 and 0.7.1 after 31 Jan 2003
The more exact method for determination of the size of compressed
afio archives was not ready for directory names which contain blanks.
Also, the files askme_example and verify_beispiel
were missing in the tarball of 0.7.1.
Many thanks to Philipp Becker.
- 18 Jan 2003 | 0.7.1 | corrected in 0.7.1 after 19 Jan 2003
The new features for incremental backups like -load_old_tree
and -vanish_list_adr were quite buggy with higher levels.
Even a SIGSEGV was among the ill effects.
Those bugs were included since 28 December 2002.
- 16 Mar 2002 | 0.7.1 | corrected in 0.7 and 0.7.1 after 17 Mar 2002
Contradicting the published software requirements, the program
bc was necessary for creating ISO9660 CDs.
Many thanks to Philipp Becker.
- 24 Jan 2002 | 0.7 | corrected in 0.7 after 24 Jan 2002
More or less randomly the stored parameters of a leveled backup
definition were not read in.
Solved by: Erich Steiner
- 24 Jan 2002 | 0.7 | corrected in 0.7 and 0.6.1 after 24 Jan 2002
File or directory names containing characters with special meaning
to the shell (like blanks) were not processed properly. The determination
of the file objects size led to 0 bytes.
Solved by: Erich Steiner
- 20 Oct 2001 | 0.6.1 | corrected in 0.6 and 0.6.1 after 02 Nov 2001
The backup plan does only contain file addresses up to the first
faulty one. All further addresses get omitted.
Note that the static binary in scdbackup-0.6.tar.gz does not contain
that bug fix. One has to run ./CONFIGURE to get a corrected binary.
- 25 Jun 2000 | 0.6.1 | corrected in 0.6 and 0.6.1 after 27 Jun 2000
The size determination for a directory fails if its name contains
a single quote character. Error message (of FreeBSD):
"Syntax error: Unterminated quoted string"
during the planning of a backup.
Many thanks to Jake Hamby.
- 07 Mar 2000 | 0.6.1 | corrected in 0.6 and 0.6.1 after 08 Mar 2000
The file object FreeWRL-0.22/.javapipej which shows permissions
prw-r--r-- causes the program to hang. This is probably
the same problem as with /root/.kde/share/apps/kmp3/unique_fifo
which is listed above as "unresolved".
- 22 Jan 2000 | 0.5.3 | corrected in 0.5.3 and 0.6 after 22 Jan 2000
While running CONFIGURE, compilation of raedchen fails on some systems:
raedchen.c:56: initializer element is not constant
caused by static FILE *zielfp= stdout;
Workaround: split declaration and initialization of zielfp and readfp
Many thanks to Michael Schaefers.
- 21 Dec 1999 | 0.5.2 | corrected in 0.5.2 and 0.5.3 after 21 Dec 1999
mkisofs aborts without any output bytes.
Caused by the names with ~ or # in directories
which get split by cd_backup_planer
Workaround: append to scdbackup and scdbackup_home
the options -filecheck -off -filecheck -exclude to override
the default settings.
Disadvantage: file names with ~ and #
are ignored by mkisofs .
Many thanks to Dirk Allard.
- 14 Dec 1999 | 0.5.2 | corrected in in 0.5.2
mkisofs prints: Invalid node - ...
and ends with empty output.
Caused by whitespace characters in the filename and $@
rather than "$@" in cd_backup_command
Many thanks to Dominik Bodi.
- 09 Dec 1999 | 0.5 | corrected in 0.5.2
scdbackup_sys prints: find: invalid predicate `-'
and begins to write prematurely.
Caused by a directory name which isn't suitable for the 'find' program.
Many thanks to Germain Malenfant.
- 08 Dec 1999 | 0.5 | corrected in 0.5.2 , workaround for 0.5
The shell command line isn't available on most systems.
Many thanks to Germain Malenfant.
Future plans:
- a flexible restore program for multi level backups
- network burn command to be invoked via ssh
- divide installation : read-only part and configurable read-write part
- remove all references to installation address from configuration files
- make DVD more independend of CD configuration
- provide a way to handle POSIX ACLs (getfacl/setfacl)
- checksum records as padding and scdbackup_verify -scan
- querying ASKME for split files and a split file restorer program
- try to use afio -Z -Q -P for avoiding need for split file directory
- sourcecode needs better structure and could be much more readable.
to scdbackup homepage