TLUG Talk: TLE-BU, 2004 - Revision history

Digimer at 01:18, 13 October 2009

2009-10-13T01:18:48Z

← Older revision		Revision as of 01:18, 13 October 2009
Line 1:		Line 1:
	{{talk_header}}		{{talk_header}}

	~~'''Note''': This talk still needs to be formatted. Obviously.~~

	'''Note''': This program is no longer being developed as the parent company, TLE, is no longer in busines. This is here mainly for historical reasons. This was the first of two talks I gave on [[TLE-BU]]. This one first introduced TLE-BU as an open source program.		'''Note''': This program is no longer being developed as the parent company, TLE, is no longer in busines. This is here mainly for historical reasons. This was the first of two talks I gave on [[TLE-BU]]. This one first introduced TLE-BU as an open source program.

Digimer: /* Creating and Scheduling Backup Jobs */

2009-10-13T01:17:36Z

Creating and Scheduling Backup Jobs

Show changes

Digimer: /* Preparing Partitions, Directories and Files for Backup */

2009-10-13T01:10:34Z

Preparing Partitions, Directories and Files for Backup

← Older revision		Revision as of 01:10, 13 October 2009
Line 117:		Line 117:
	== Preparing Partitions, Directories and Files for Backup ==		== Preparing Partitions, Directories and Files for Backup ==

	The first menu you will use is '[ Part. Conf. ]' (partition configuration). This is the menu where you will see each partition on your system and where you will manage those partitions. If you have not yet connected your USB2/Firewire drive(s) you can do so at any time and simply reload the '[ Part. Conf. ]' menu to see and use them.		The first menu you will use is '[ Part. Conf. ]' (partition configuration). This is the menu where you will see each partition on your system and where you will manage those partitions. If you have not yet connected your USB2/Firewire drive(s) you can do so at any time and simply reload the '[ Part. Conf. ]' menu to see and use them.

	fig. 1.0, The 'Part. Conf.' Menu:		fig. 1.0, The 'Part. Conf.' Menu:
			[[Image:TLUG_Talk_TLE-BU_2004_01.png\|center\|The 'Part. Conf' Screen]]

	To start you need to select which partitions you want to save data from and assign them as a "source" partitions. Next you need to connect each drive/partitions that you want to save data to and assign them as a "destination" partition.		To start you need to select which partitions you want to save data from and assign them as a "source" partitions. Next you need to connect each drive/partitions that you want to save data to and assign them as a "destination" partition.

	It is very helpful if you add a comment (or catalog number) of your choice to each source and destination partition. You can do this from here as well by clicking on "[ Add/Edit Part. Comment ]" and entering any plain-text string. This will come in very handy when you search for files because the location of each search result is indicated by this comment.		It is very helpful if you add a comment (or catalog number) of your choice to each source and destination partition. You can do this from here as well by clicking on "[ Add/Edit Part. Comment ]" and entering any plain-text string. This will come in very handy when you search for files because the location of each search result is indicated by this comment.

	At this point you have already done enough to backup your system. If you do no more each partition you selected will be fully backup when you run a backup job that calls a given source. If you want to refine which directories and files you wish to backup simply click on the "[ Add/Edit Backup List ]" button which is visible for each source. This will start a scan of what is on the source you chose. This scan can take a while depending on the speed of your computer and the number of files (not the size) on the source partition. This is because TLE-BU records all of the file and directory names and information in it's database. This is how TLE-BU can offer it's archival functions and allow you to search within off-line partitions.		At this point you have already done enough to backup your system. If you do no more each partition you selected will be fully backup when you run a backup job that calls a given source. If you want to refine which directories and files you wish to backup simply click on the "[ Add/Edit Backup List ]" button which is visible for each source. This will start a scan of what is on the source you chose. This scan can take a while depending on the speed of your computer and the number of files (not the size) on the source partition. This is because TLE-BU records all of the file and directory names and information in it's database. This is how TLE-BU can offer it's archival functions and allow you to search within off-line partitions.

	fig. 1.1, The Partition Update Screen:		fig. 1.1, The Partition Update Screen:
			[[Image:TLUG_Talk_TLE-BU_2004_02.png\|center\|The 'Partition Update' Screen]]

			As you can see above the program displays a status block after every 1,000 files and directories are processed. This acts as a type of progress bad and lets you know that the program is still working. When the update is finished TLE-BU will fully vacuum the database because the update can create a lot of database activity. If you have done a lot of other work in TLE-BU before you updated the partition the vacuum could take a bit of time. Please be patient during this step. When the vacuum is finished a final performance display block will show you how many files and directories where updated, how long it took and how long the full vacuum took. This can be useful when you first setup TLE-BU if you are playing with your database configuration and want a benchmark of how the changes effected your performance.

			When the update is finished the next step is to click on the "[ Select Files For Backup ]" button. This will take you to a file browser that looks and functions like many other file browsers and should be very familiar to you.
	As you can see above the program displays a status block after every 1,000 files and directories are processed. This acts as a type of progress bad and lets you know that the program is still working. When the update is finished TLE-BU will fully vacuum the database because the update can create a lot of database activity. If you have done a lot of other work in TLE-BU before you updated the partition the vacuum could take a bit of time. Please be patient during this step. When the vacuum is finished a final performance display block will show you how many files and directories where updated, how long it took and how long the full vacuum took. This can be useful when you first setup TLE-BU if you are playing with your database configuration and want a benchmark of how the changes effected your performance.

	When the update is finished the next step is to click on the "[ Select Files For Backup ]" button. This will take you to a file browser that looks and functions like many other file browsers and should be very familiar to you.

	fig. 1.2, The File Browser:		fig. 1.2, The File Browser:
			[[Image:TLUG_Talk_TLE-BU_2004_03.png\|center\|The File Browser Screen]]

	From a user interface point of view the File Browser is probably the most complex part of TLE-BU. Along the top is a status bar that shows you if the partition you are viewing is a source ("Backup") or a destination ("Recover"). The next item is the partition's current mount point. This may be helpful to you if you want to look at the contents of a file before you decide to back it up or not. The third item is the partition's block path which may help in some cases where you are using a separate disk management software. The last item is the partition's "UUID" number which is what TLE-BU uses internally to identify and track partitions.		From a user interface point of view the File Browser is probably the most complex part of TLE-BU. Along the top is a status bar that shows you if the partition you are viewing is a source ("Backup") or a destination ("Recover"). The next item is the partition's current mount point. This may be helpful to you if you want to look at the contents of a file before you decide to back it up or not. The third item is the partition's block path which may help in some cases where you are using a separate disk management software. The last item is the partition's "UUID" number which is what TLE-BU uses internally to identify and track partitions.

	The Directory Tree starts with a summary showing how many files are currently visible and how many directories there are total on this partition. Below that each directory will be displayed with a check box that you will use to tell TLE-BU if you want to backup or not the directory, it's sub-directories and files. The second item is an icon that shows if there are subdirectories below the directory or not and if so whether it has been expanded yet or not. A hyphen ('-') indicates that there are no subdirectories, a right-pointing arrow indicates that there are hidden subdirectories and a downward-pointing icon which indicates that there are subdirectories and that they are currently visible. The last item is the name of the directory itself. When you click on the directory it's contents will be displayed in the file list to the right.

	The ~~File List~~ starts with a ~~header~~ showing ~~you~~ how many files are ~~in the current directory, which directory is being shown~~ and ~~column headers indicating each file's size, modification date and the "More Info~~.~~" icon. To the left of~~ each ~~file name is~~ a check box ~~which~~ you ~~can~~ use to ~~indicate whether~~ you want ~~each individual file backed up~~ or not~~. The rest of each line shows~~ the ~~file name~~, ~~the file~~'s ~~human~~-~~readable size,~~ the ~~date~~ and ~~time the file was last copied~~ or ~~edited~~ and ~~finally an~~ icon that ~~you can place you mouse over which will show extended information on the file~~. ~~That~~ is the ~~gray bar you can see in~~ the ~~screen capture above~~. ~~This extra information includes~~ the ~~file size~~ in ~~bytes, the user and group that owns~~ the file ~~and~~ the ~~file's permissions~~.		The Directory Tree starts with a summary showing how many files are currently visible and how many directories there are total on this partition. Below that each directory will be displayed with a check box that you will use to tell TLE-BU if you want to backup or not the directory, it's sub-directories and files. The second item is an icon that shows if there are subdirectories below the directory or not and if so whether it has been expanded yet or not. A hyphen ('-') indicates that there are no subdirectories, a right-pointing arrow indicates that there are hidden subdirectories and a downward-pointing icon which indicates that there are subdirectories and that they are currently visible. The last item is the name of the directory itself. When you click on the directory it's contents will be displayed in the file list to the right.

	~~You may have noticed that unlike~~ many file ~~browsers~~ of ~~this type~~, the ~~TLE~~-BU file ~~browser does not list directories in~~ the file ~~list~~. ~~This may be added later but at this time I could not~~ see ~~a good reason to add~~ the ~~complexity that would be needed to have~~ the ~~directories~~ in the file ~~list~~ and ~~have them behave like other similar~~ file ~~browsers. I would love to hear feedback from users on how they feel about this. If there is enough demand for this feature I will add it~~.		The File List starts with a header showing you how many files are in the current directory, which directory is being shown and column headers indicating each file's size, modification date and the "More Info." icon. To the left of each file name is a check box which you can use to indicate whether you want each individual file backed up or not. The rest of each line shows the file name, the file's human-readable size, the date and time the file was last copied or edited and finally an icon that you can place you mouse over which will show extended information on the file. That is the gray bar you can see in the screen capture above. This extra information includes the file size in bytes, the user and group that owns the file and the file's permissions.

	~~A note on selecting~~ directories ~~and files; When you select or unselect a directory for backup the setting you changed~~ the ~~directory to will propagate to all of it's subdirectories and files~~. ~~Because of~~ this ~~it is most effecting~~ to ~~make you selection starting at top level~~ directories ~~and refining down until you reach the files~~ in ~~each directory. This will save you~~ the ~~possible headache~~ and ~~making all of you selections only to~~ have them ~~lost when you change the backup state of a parent directory~~.		You may have noticed that unlike many file browsers of this type, the TLE-BU file browser does not list directories in the file list. This may be added later but at this time I could not see a good reason to add the complexity that would be needed to have the directories in the file list and have them behave like other similar file browsers. I would love to hear feedback from users on how they feel about this. If there is enough demand for this feature I will add it.

	~~You now know how to refine what is backed up from each partition down to the individual file. You will notice the each destination partition has the button labeled "[ View/Recover Data ]". If~~ you select ~~this~~ you ~~will go through~~ the ~~exact same steps as you did when you selected which files~~ to ~~backup. For now making a selection on a destination~~ will ~~not accomplish anything~~. ~~Later (by v0.4)~~ this ~~will allow~~ you ~~to select~~ files ~~to be recovered back to your system (either to their original location or to an alternate location) easily~~. ~~For now to recover data simply bring the destination partition on-line, mount it (which~~ you ~~can do from~~ the ~~"Part. Conf." menu)~~ and ~~use your system's file browser~~ to ~~copy any files~~ you ~~wish to recover~~.		A note on selecting directories and files; When you select or unselect a directory for backup the setting you changed the directory to will propagate to all of it's subdirectories and files. Because of this it is most effecting to make you selection starting at top level directories and refining down until you reach the files in each directory. This will save you the possible headache and making all of you selections only to have them lost when you change the backup state of a parent directory.

			You now know how to refine what is backed up from each partition down to the individual file. You will notice the each destination partition has the button labeled "[ View/Recover Data ]". If you select this you will go through the exact same steps as you did when you selected which files to backup. For now making a selection on a destination will not accomplish anything. Later (by v0.4) this will allow you to select files to be recovered back to your system (either to their original location or to an alternate location) easily. For now to recover data simply bring the destination partition on-line, mount it (which you can do from the "Part. Conf." menu) and use your system's file browser to copy any files you wish to recover.

	Creating and Scheduling Backup Jobs:		= Creating and Scheduling Backup Jobs =

	After you have assigned your source and destination partitions and refined what you want to backup the next step is to create a "Backup Job". You can create multiple backup jobs and each can use some or all of the source and destination partitions. Each job can also be scheduled to run independently of one another. Once a job is created you will also be able to manually run a backup job by simply clicking "[ Run Now ]" from the main scheduling menu.		After you have assigned your source and destination partitions and refined what you want to backup the next step is to create a "Backup Job". You can create multiple backup jobs and each can use some or all of the source and destination partitions. Each job can also be scheduled to run independently of one another. Once a job is created you will also be able to manually run a backup job by simply clicking "[ Run Now ]" from the main scheduling menu.

Digimer: /* Installation */

2009-10-13T01:01:47Z

Installation

@@ Line 94: / Line 94: @@
 At the moment there is no installer package for TLE-BU. To install it you simply need to extract the source tarball which will show two directories; 'cgi-bin' and 'non-cgi'. I will assume for now that you know how to configure Apache and PostgresSQL. If you do not, I will explain that step after the presentation is over. There will also be detailed instruction in the attached 'readme.txt' file in the 'cgi-bin' directory as v0.2 gets closer.
-. First you need to create an account on your system that TLE-BU will run as. For me, I simply decided to use my own personal account because I will be the one managing it. You will need to tell the web server you decide to use to run as this user. If you have another web server already on your system that is used by another project you may want to install a parallel copy or use a separate dedicated web server like 'thttpd'. There are plans to integrate a dedicated web server (like 'CUPS' does) before v0.4 but that is a little ways off.
+# First you need to create an account on your system that TLE-BU will run as. For me, I simply decided to use my own personal account because I will be the one managing it. You will need to tell the web server you decide to use to run as this user. If you have another web server already on your system that is used by another project you may want to install a parallel copy or use a separate dedicated web server like 'thttpd'. There are plans to integrate a dedicated web server (like 'CUPS' does) before v0.4 but that is a little ways off.
-. Copy the files from the 'cgi-bin' directory either into the directory (or a subdirectory) you specified as the 'cgi-bin alias'. If you will use the web server for anything else you will find it helpful to create a subdirectory just for TLE-BU. Next, copy the files under the 'non-cgi' into the directory (or subdirectory) that you set as the 'document root' in your web server. Like the 'cgi-bin alias', if you will use the server for other projects you may want to place these files in a sub-directory.
+At this point you should be able to simply browse to the URL you specified above as the 'url_non_cgi' path (ie: 'http://localhost/tle-bu/' and see TLE-BU running!
 == Preparing Partitions, Directories and Files for Backup ==

Digimer at 01:00, 13 October 2009

2009-10-13T01:00:05Z

Show changes

Digimer: Created page with '{{talk_header}} '''Note''': This talk still needs to be formatted. Obviously. '''Note''': This program is no longer being developed as the parent company, TLE, is no longer in …'

2009-10-13T00:52:25Z

Created page with '{{talk_header}} '''Note''': This talk still needs to be formatted. Obviously. '''Note''': This program is no longer being developed as the parent company, TLE, is no longer in …'

Show changes