January 2009 Archives

TSM (Tivoli) and compressed ZFS with Cyrus IMAP

| | TrackBacks (0)
Just for the numbers:

Our tsm backup job scans 31 million files in 3 hours, including 300,000 deletes and 25,000 new files backed up:

01/03/09   23:38:48 --- SCHEDULEREC STATUS BEGIN
01/03/09   23:38:48 Total number of objects inspected: 31,305,555
01/03/09   23:38:48 Total number of objects backed up:   25,347
01/03/09   23:38:48 Total number of objects updated:          0
01/03/09   23:38:48 Total number of objects rebound:          0
01/03/09   23:38:48 Total number of objects deleted:          0
01/03/09   23:38:48 Total number of objects expired:    308,991
01/03/09   23:38:48 Total number of objects failed:           0
01/03/09   23:38:48 Total number of bytes transferred:    2.56 GB
01/03/09   23:38:48 Data transfer time:                  280.87 sec
01/03/09   23:38:48 Network data transfer rate:        9,594.01 KB/sec
01/03/09   23:38:48 Aggregate data transfer rate:        209.05 KB/sec
01/03/09   23:38:48 Objects compressed by:                   15%
01/03/09   23:38:48 Elapsed processing time:           03:34:49
01/03/09   23:38:48 --- SCHEDULEREC STATUS END
01/03/09   23:38:48 --- SCHEDULEREC OBJECT END SA_SO_MAIL 01/03/09   20:00:00
01/03/09   23:38:48
Executing Operating System command or script:
   /mail/bin/pr_backupsnapshot_off


This fantastical performance was achieved after activating GZIP compression on the mail zfs pool and copying all mail files to compressed format.

The machine is a 2xOpteron Dual Core with 20 GB of memory and 1200 mail users online connected.

Machine load did not go up noticeably. The mail pool is a zfs mirror with two SAN pools (7 TB each resulting in 7 TB mail capacity).

Tivoli Compression is set to on, and we use encryption to our TSM server.
We are using TSM client 5.5.1.0 for Solaris x86:

# dsmc
IBM Tivoli Storage Manager
Command Line Backup/Archive Client Interface
  Client Version 5, Release 5, Level 1.0 
  Client date/time: 01/08/09   09:40:56
(c) Copyright by IBM Corporation and other(s) 1990, 2008. All Rights Reserved.

Using that TSM client

memoryefficientbackup   yes
is very important in dsm.sys, otherwise dsmc will crash after having used 4 GB of RAM (it is a 32 bit executable, there is no 64 bit version for Solaris x86 available from IBM yet - in contrast to the SPARC 64 bit-Version).


December 2015

Sun Mon Tue Wed Thu Fri Sat
    1 2 3 4 5
6 7 8 9 10 11 12
13 14 15 16 17 18 19
20 21 22 23 24 25 26
27 28 29 30 31    

About

This blog is owned by:

Pascal Gienger
J├Ągerstrasse 77
8406 Winterthur
Switzerland


Google+: Profile
YouTube Channel: pascalgienger