Situational AnalysisEnterprise Backup SolutionThis document was prepared to analyze the backup infrastructure, and prepare an action plan, for the Ridgefield location. Content1Situation Analysis32Objective33Situation Fact34Options44.
1Option # 1: Veritas Netbackup44. 2Option # 2: Legato Networker54. 3Option #3: Commvault Galaxy74. 4Enterprise Backup Solution – Evaluation Analysis84. 5Summary of options available114.
6Updated analysis of Legato Networker subsequent to inclusion of Visual Storage Resource Migrator and Alphastor115Recommendation171Situation AnalysisThis document was prepared to analyze the current backup environment and prepare an action plan, for the Ridgefield location regarding the incorporation an Enterprise Backup Solution. 2ObjectiveOur objective is to determine the best course of action regarding the selection and implementation of an Enterprise Backup Solution. 3Situation FactThe current network environment has been outgrown the ability of Veritas BackupExec, the backup software platform used by BI Ridgefield- Production Services, in terms of amount of data being backed up, functionality, and reliability. At the time of its initial purchase approximately six years ago (with BackupExec 7. x), the server infrastructure consisted of approximately 80 clients with one TB of data captured on a weekly full backup.
This small-business level backup solution provided a good fit for the environment and served the company’s data protection needs well. Accordingly, we continued to leverage BackupExec 8. x – 9. x in our organization as the network infrastructure expanded though out the years. The server environment has now grown to the point where there are 370 servers with approximately 16 Terabytes of data captured on a weekly full backup. In light of this, meeting the established backup/restore service agreement is becoming increasingly challenging.
Some of the functionality/features required to address this challenge includes:-The ability to direct multiple streams of data to one media device simultaneously (Multiplexing). -A provision for re-starting backup jobs from the point at which they failed (Checkpointing). -Descriptive reporting on backup media content. -Automation of Media Duplication and Vaulting tasks. -Compete compatibility with SANs and NAS supportAs a result, Production Services has evaluated a number of solutions from the leading backup software manufacturers. The final list was narrowed down to three competitors we thought could best meet our outlined requirements.
They are: Veritas NetBackup, Legato Networker, and Commvault Galaxy. The tables below list the details of the evaluations. 4Options The reviews of the three options are listed in the following table:4. 1Option # 1: Veritas NetBackupOption Table # 1: ProsConsAdministrative/management tasks performed from a centralized location.
(Familiar Microsoft Management Console style interface). Provides the ability to browse resources through Graphical User Interface when creating backup and restore jobs, reducing the possibility of typographical errors. Provides straightforward media management. Multiple media erased, moved and exported at once. Existing BackupExec 9. 1 tape media can be imported / read in NetBackup.
Eliminates need to keep BackupExec media servers in environment. Remote agents can be deployed remotely to many servers at once. Only requires one agent install for all applications (SQL,Oracle. Sybase).
One can view real-time alert and job status (Byte Count, Rate, Files backed up, Errors, etc). There is also a troubleshooter option to provide error explanations and recommended actions. Limited Grooming capability. The application requires Storage Migrator component for advanced features. Pre and post job scripted commands are difficult to implement into job.
Synthetic backups allow for quick client backups restore from a single backup image. This is essentially the process of combining multiple incremental/differential backups into one image. Robust backup / restore performance with the use of streams and multiplexing. Up to 32 streams per drive supported.
Disk to tape staging for increased backup performance. Inline tape copy is also supported (write to multiple media simultaneously). Restarting a backup job can be from the point of failure is accomplished with the Checkpoint feature. Log purge subsequent to a SQL full recovery backup can be performed NetBackup can also invoke RMAN for Oracle on-line backups. Open File Option (Veritas Snapshot Provider) is included with product.
Windows 2003 Server backups use Microsoft Volume Shadow Copy Service. Fully supports VMWare ESX/GSX Virtual Server host / instance backups. The application requires Bare Metal Recovery component for OS and System State recovery. This is an additional cost item.
Comprehensive reporting which includes_Media=ServerResource reportServer=Media needed for recovery reportVaulting tasks can be set up to automatically duplicate data, create reports, and eject tapes for archiving. Master server implementation in a clustered configuration provides fault tolerance. 4. 2Option # 2: Legato NetworkerOption Table # 2:Ease of management/administration has been added through the incorporation of the Networker Management Console user interface version 7. 1.
The application also includes enhancement of Media Management through the Networker Management Console version 7. 1. The application can simultaneously erase, move and export Multiple mediaDe-centralized Management Structure. Use of Networker Administration Console, Networker Management Console, and Networker User interfaces to manage operations.
Does not show real-time rate, percentage complete, or current file/directory being backed up in activity monitor. There is no ability to Browse when setting up backup or restore jobs. No built in reports for: Media=ServerResource report or Server=Media needed for recovery report. We evaluated Visual Storage Resource Migrator for this additional functionality and this type of report was still not included.
Networker agent cannot be pushed to remote clients. Clients have to be visited to locally install agent. Checkpointing provides ability to restart/resume jobs. Re-runs only the save sets that failed from the point at which they failed without having to create new separate backup jobs.
Save Set Consolidation combines multiple incremental backups into one full backup image. Backups using Save Set Consolidation consume less network bandwidth and decrease the impact on the application host. With the use of streams and parallelism, more rapid backup performance can be achieved. Cannot write to multiple media simultaneously (In-line tape copy). Requires Open File Manager for open file backups.
This is an additional cost component. Uses ASR recovery for Windows 2003 Server Disaster Recovery. Uses SMTP to send logs and alerts vial e-mail. Uses Volume Shadow Copy Services for Window 2003 Snapshots.
Fully supports VMWare ESX/GSX Virtual Server host/instance backups. Grooming cannot be performed to meet our requirements with the base Networker Product. As a result, EMC provided Visual Storage Resource Migrator at no additional cost. While this product can do certain types of grooming, NetWorker still does not provide the type of grooming we require. In order to groom data-based on modified and accessed dates, NetWorker must first move them to an alternate data directory.
While this does not seem like a large issue at first, we must think about the potential volume of the data to be groomed (sometimes upwards of 1 TB) and the additional storage that will need to be purchased as a result. Inability to purge SQL transaction logs subsequent to full backup. Vaulting tasks can be set up to automatically, duplicate data, create reports, and eject tapes for offsite storage using AlphaStor. This product was added by EMC at no additional cost. NetBackup is a very intuitive tool that provides a great deal of additional functionality with respect to tape lifecycle management. Master Server can be clustered for fault toleranceCan leverage with existing Legato Networker implementation in the UNIX environment.
4. 3Option #3: Commvault GalaxyThe Web management console appears and acts the same as the Media Server management console. This allows for same functionality in both places. (Java based).
Difficult to monitor jobs. Does not show real-time rate, percentage complete, or current file/directory being backed up in activity monitorDifficult media management. Can only erase one tape at a time. Non-intuitive GUI. Duplication of options at many levels makes job management difficultFast backup performance with the use of Streams and Multiplexing. Up to 32 streams per drive can be configured.
Synthetic backups allow for quick client backups restore from a single backup image. This is essentially the process of combining multiple incremental/differential backups into one image. Agent is pushed from CD. Requires separate agents for every application (SQL, Oracle, Sybase, etc). Cannot write to multiple media simultaneously (In-line tape copy). Inability to perform SQL transaction log purge subsequent to full database backup.
Checkpoint feature. Able to restart from point of backup failure rather than re-running entire job. Uses SMTP to send alerts and errors via e-mail. Requires quick recovery option for OS/System State restore. Can be clustered for fault toleranceLimited reporting capabilities.
No reports for_Media=ServerResourceServer=Media needed for recovery4. 4Enterprise Backup Solution – Evaluation AnalysisIT To what does “it” refer? If a pronoun is used without first identifying for what it stands, the reader might be confused. (28) System/Technology Analysis System or technology list (Blue) Analysis Requirements (Yellow)Veritas NetBackupLegato NetworkerCommvault GalaxyHardware/Software/Installation1OS requirementsWindows 2000/2003Windows 2000/2003Windows 2000/20032Leverage existing hardwareYes; However, will require processor and memory upgradesYes; However, will require processor and memory upgradesYes; However, will require processor and memory upgrades3Multi-Vendor SupportYes, STK, BrocadeYes, STK, BrocadeYes, STK, Brocade4SQL / InstallationN/AN/AYes5Automatic Device DiscoveryYesYesYes6Media discoveryStraight ForwardStraight ForwardStraight Forward7Master Server setupStraight ForwardStraight ForwardStraight Forward8Media server setupStraight ForwardStraight ForwardStraight Forward9Master server failure / recoveryCluster awareCluster awareCluster aware10Media server failure / recoveryStraight ForwardStraight ForwardStraight Forward Job Management1Centralized Management ConsoleYes, MMC StyleNo, Uses Networker Administrative console and Networker Management ConsoleYes, Java-based2Job CreationStraight ForwardMostly Straight ForwardMostly Straight Forward3Policy setupStraight ForwardMostly Straight ForwardMostly Straight Forward4Remote system discoveryYes NoNo5Remote system agent installationYesNoYes6Remote system resource selectionYesNoNo7Ability to browse network resources when creating a backup or restore taskYesNoNo8Redirection of files during restoreStraight ForwardDifficultDifficult9Alignment with policy / scheduleStraight ForwardStraight ForwardDifficult10Viewing of scheduled tasksStraight ForwardMostly Straight ForwardDifficult11Viewing of active tasksStraight ForwardMostly Straight ForwardDifficult12Viewing of completed tasksStraight ForwardMostly Straight ForwardDifficult13Manual start of scheduled tasksStraight ForwardStraight ForwardDifficult14One time run of a taskStraight ForwardStraight ForwardDifficult15Grooming of a serverYes, Can be scripted using BPARCHIVE command in base product. Not in base product. Limited in Visual SRM. Must first move data to additional folder before deleting.
No16Pause / Resume of JobYesYesYes Media Management1Viewing of available mediaStraight ForwardStraight ForwardDifficult2Viewing of used mediaStraight ForwardStraight ForwardDifficult3Viewing of offsite mediaStraight ForwardStraight ForwardDifficult4Viewing of retired mediaStraight ForwardStraight ForwardDifficult5Manual recycling of mediaStraight ForwardMostly Straight ForwardDifficult6Cataloging of mediaStraight ForwardMostly Straight ForwardDifficult7Setup of media sets / poolsStraight ForwardStraight ForwardStraight Forward8Retention for mediaStraight ForwardStraight ForwardStraight Forward9Move data between media sets / poolsStraight ForwardStraight ForwardStraight Forward Alert management1Viewing of active alertsStraight ForwardStraight ForwardDifficult2Clearing of active alertsStraight ForwardStraight ForwardDifficult3Viewing of alert historyStraight ForwardStraight ForwardDifficult Remote agent installation / use1SQL 7 /2000Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents2Oracle 7 / 8 / 9iYes: 1 Agent for allYes: Separate AgentsYes: Separate Agents3Exchange 5. 5Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents4Exchange 2003Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents5LinuxYes: 1 Agent for allYes: Separate AgentsYes: Separate Agents6Windows NT4. 0Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents7Windows 2000Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents8Windows 2003Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents Backup Scenarios1Standard file backupStraight ForwardStraight ForwardStraight Forward2OS backupStraight ForwardStraight ForwardStraight Forward3System State backupStraight ForwardStraight ForwardStraight Forward4SQL backupStraight ForwardStraight ForwardStraight Forward5Oracle backupStraight ForwardStraight ForwardStraight Forward6Exchange backupStraight ForwardStraight ForwardStraight Forward7Open File backupYes: Included in base productNo – Requires St. Bernard Open File ManagerNo – Requires Open File Option8IDR backupNo – Requires Bare Metal Recovery OptionNo – Requires Network Recovery ManagerNo – Requires Quick Recovery Option9Backup – to – DiskYesYesYes10Disk – to – Tape stagingYesYesYes11Inline Tape Copy (Write to two media simultaneously)YesNoNo12Synthetic Backups/Save Set ConsolidationYesYesYes Recovery Scenarios1Standard file recoveryYesYesYes2OS recoveryNo – Requires Bare Metal Recovery OptionYes – LimitedNo – Requires Quick Recovery Option3SQL recoveryYesYesYes4Oracle recoveryYesYesYes5Exchange recoveryYesYesYes6IDR recoveryNo – Requires Bare Metal Recovery OptionNo – Requires Network Recovery ManagerNo – Requires Quick Recovery Option7VMWare Host recoveryYesYesYes8VM Server recoveryYesYesYes Reporting1Job Success / FailureYesYesYes2Media retentionYesYesYes3Media vaultingYesYesYes4Media = ServerresourceYesNoNo5Server = Media needed for recoveryYesNoNo Other items to review1CheckpointYesYesYes2Device fail overYesYesYes3Job fail overYesYesNo4SQL Transaction log purge subsequent to full backupYesNoNo5Read existing Backup Exec mediaYesNoNo6Multiplexing/ParallelismYesYesYes7Support for NAS/SANYes, EMC, HP, Netapp. NDMP capable.
Yes, EMC, HP, Netapp. NDMP capable. Yes, EMC, HP, Netapp. NDMP capable.
8VaultingYes, vault option must be purchased at additional cost. It What is “it”? Avoid use of undefined pronouns. (28) is a snap in and is fully integrated with base product. Not with base product. AlphaStor was provided by Legato at no additional cost. This is a separate product that is not integrated into base product.
Yes, vault option must be purchased at additional cost. It is a snap in and is fully integrated with base product. Support1Technical Support (24 X 7)YesYesYes Training1Training for ProductsYes, Certification availableYes, Certification availableYes4. 5Summary of options available Option 1: Implement Veritas NetBackup. Option 2: Implement Legato Networker. Option 3: Implement Commvault Galaxy.
4. 6Updated analysis of Legato Networker subsequent to inclusion of Visual Storage Resource Migrator and AlphastorEMC has recently proposed to BI that AlphaStor and Visual SRM will both be delivered free of charge, along with the Legato NetWorker product. AlphaStorThe inclusion of AlphaStor is needed on EMC’s part because vaulting type functionality is a requirement at BI. AlphaStor is an EMC product that works with EMC NetWorker to provide a great deal of additional vaulting functionality that NetWorker lacks. Essentially, AlphaStor is a media management product that also functions as a device resource manager for shared tape device environments.
Originally, it was designed to grant various backup products the ability to share devices. But now for the most part, all major backup vendors have their own media and device management capabilities. Because AlphaStor is a separate product and not an option of NetWorker, it is installed, configured and managed separately. This results in increased system administration and hardware costs since AlphaStor would need to be installed on a separate server and would involve NetWorker administrators to be trained on the new product.
Additionally, AlphaStor may be a point of contention between various NetWorker implementations as it would be another software layer loaded on top of the backup environment. Most importantly, because the AlphaStor server controls all the Networker servers it would present the possibility of disrupting all backup/restore services in the event it is down or unreachable. In contrast, a many of the functionality added by AlphaStor is already available from the NetBackup core product. NetBackup’s “Shared Storage Option” (SSO) provides a centralized and efficient manner to share tape devices among media managers. Likewise, Veritas’ Vault option provides a robust and easy to use way of managing media onsite as well as offsite.
NetBackup offers flexible vaulting schedules, in-line tape copy/duplication, and comprehensive reporting of tape media. Additionally it can generate reports in the format acceptable to various vaulting vendors like Iron Mountain. NetBackup can also create reports for the dockworkers to pull tapes out of the tape library docks and put them into bins for offsite storage. This is end-to-end media management, and integrated and centralized inside of the core NetBackup product.
Below is a matrix with a side-by-side comparison of the functionality of both products. Installation and ConfigurationFeatureNetBackupAlphaStor and NetWorkerCommentsInstallation of productNASeparateAlphaStor is installed as a separate product from NetWorkerConfigurationSimple, Wizard-based ComplexNetBackup provides wizards for device, media configurations. AlphaStor lists a total of 15 steps to configure itself. There are additional steps needed to configure NetWorker to work with AlphaStor. AdministrationSingle GUI-based consoleSeparateAlphaStor and NetWorker use different GUIs for each product.
In addition NetWorker uses different GUIs for different platforms like Windows and UNIXShared Storage OptionPart of Media manager (Option)Part of AlphaStorNetBackup SSO is a licensable optionVaultOptionPart of AlphaStorVault is a licensable option of NetBackupMedia ConfigurationStepsOnceTwiceThe media is configured twice. Once in AlphaStor and once in NetWorker. The products are not integrated properlyUsability FeatureNetBackupAlphaStor and NetWorkerCommentsSeparate ServerNoYesBecause AlphaStor uses a separate server to store the database and manage media, it can be an added point of failure. If the AlphaStor server or services are unreachable, the whole backup/restore service is DOWN!GUIJava-basedWeb-based, UNIX and/or WindowsAlphaStor uses a web-based GUI. But NetWorker uses a platform-based GUI.
All three are inconsistent with each otherAdministration conflictsNonePossibleBecause NetBackup uses its own media management software, the administrator can make good choices about media and devices. Because AlphaStor admin is usually separate, s/he may be a point of contention for NetWorker admins. Database SynchronizationNAMUSTAlphaStor and NetWorker databases need to sync’ed. If they are not in sync, backups/restores may fail ReportingExtensiveLimitedNetBackup allows extensive reports about media not only when using Vault option but many valuable reports can be obtained within core product itself. NetBackup’s reporting capability is unmatched in the industryMedia ManagementWhen AlphaStor is installed and configured, NetWorker has to be configured again to work with AlphaStorFeatureNetBackupAlphaStor and NetWorkerCommentsOnsite and OffsiteYesYesAlphaStor takes care of the offsite media management.
NetWorker does not keep track of the location of tapesAdding MediaOnceTwiceThe media is added twice. Once into AlphaStor and once into NetWorker. Managing media poolOnceTwiceBoth AlphaStor and NetWorker must manage media pools independently. The media pool if deleted from AlphaStor has to be deleted from NetWorker again. Robot management and inventoryCore ProductAlphaStorNetBackup core product can do the robot configuration and inventory.
Rotation scheduleYesYesAlphaStor uses a counter to reset a rotation of volume. When this counter reaches a certain value the media is rotatedIn Line duplicationYesNoNetBackup allows for making more than 1 copy of the backup stream (upto 4), so as to reduce extraneous vaulting cycles. But vaulting can happen anytime desired by the admin Device Resource ManagementWhen AlphaStor is configured into NetWorker environments, two distinct configurations need to be performed. AlphaStor controls the actual devices while presenting NetWorker with the “virtual jukeboxes” to backup on.
However, while AlphaStor controls the device and media to which the backup would go, it is the NetWorker product, which ultimately has the control over type of media to use for the backup. In all instances, it is assumed that AlphaStor and NetBackup databases are in-sync. AlphaStor allows the administrator to divide the backup device and media infrastructure into resource queues. It then assigns the actual drives to the resource queues. AlphaStor administrator also defines mount class for the devices. The NetWorker administrator uses these predefined resources to make backup requests.
The NetWorker administrator has no control over which resource is used for the operation. If a resource is busy, the NetWorker administrator cannot assign the job to another resource queue without the help from the AlphaStor administrator. If the same individual performs these roles, it requires the user to manage two applications and user interfaces to accomplish this simple task. NetBackup takes this complexity away. Using SSO option, the NetBackup administrator has complete control over devices.
Devices are shared among various NetBackup media managers. SSO is configured using the usual device configuration wizard. NetBackup also allows for special directives to be used on media managers. These directives allow the administrator to reserve a drive only for restores, for example.
If specified, one drive is always kept available for restores. Even if backup jobs are pending, restores can start using this drive. Along with backup restart capability of the NetBackup core product, this facility makes sure that restores are never held up due to backups taking place. FeatureNetBackupAlphaStor and NetWorkerCommentsComplexity of configurationLowHighAlphaStor is a complex product to implement.
Along with NetWorker, the limitations of the products may make configuring them painful. Special DirectivesYesYesNetBackup allows special directives like local drive only, or reserve for restore etcCore product functionality–NetBackup offers many reports, administrative capabilities within the core product. EMC NetWorker does not provide much of it and pushes for AlphaStorAlternate interface for sharing storageYesNoNetBackup allows for separate interfaces to be used for SSO. NetWorker does not offer this functionalityVisual SRM The inclusion of Visual SRM (VSRM) was required on EMC’s part to meet BI Production Services-Server Technologies archive and deletion requirements.
Visual SRM software is designed to provide centralized storage resource management (SRM) for multi-vendor, mid-tier storage environments; ensuring capacity is available when and where it is needed by actively managing the storage resources with powerful visualization tools. With Visual SRM, the operator can manage utilization according to thresholds set and deploy active policies to meet the demands of the critical business applications. Some of the strengths include:Increase capacity utilization, improve availability and automate management processes. Reduce or eliminate server outages due to out-of-control disk space consumption. Eliminate time-consuming processes and reduce costsfor a lower TCO. Shorten backup windows so more work can be done in less time.
Improve capacity planning and charge back capabilities. Focus on core business rather than storage administrative tasks. While this is an extremely powerful product with respect to file system analysis and reporting we still do not feel like this free product will get BI-Production Services-Server Technologies entirely where it needs to go. From the Enterprise Backup project perspective, we are predominantly concerned with the ability to select data efficiently, back data up, and delete data-based on last time accessed/modified and/or data ranges ( referred to as grooming). This particular functionality is not included in the base Networker product. As a result, EMC has offered VSRM to help meet this requirement.
This product does an extremely good job of locating data-based on modified and accessed dates however, it does not have the ability to groom a file system at the level we require it too. In order to groom a file system VSRM requires that the data first be moved to an alternate location, after which a Networker command can be invoked to backup and ultimately delete the data. This would not be an option for us as it will require the purchase of substantial amount of additional storage to accommodate (at times we may have to groom upwards of 500 gigabytes of information). With our current backup software, Veritas BackupExec we are able to groom without having to move the data and as such we would like to continue to operate this way. To this end, VERITAS NetBackup will allow BI to use a command known as bp_archive to help backup data and delete it from primary storage without first moving it to alternate location.
A file list, based on whatever characteristics defined, can be generated then bp_archive can be engaged to meet BI’s needs. Of additional importance, this bp_archive command is part of the base VERITAS NetBackup offering and does not require the implementation of an additional product to accommodate this task. 5RecommendationWhile the inclusion of the AlphaStor and Visual SRM products does put NetWorker a good deal closer to meeting our Vaulting and Grooming requirements it still does not provide “like” functionality with VERITAS NetBackup and will still present many issues for our IT environment. As such, the recommendation for the primary backup software of choice would still be to implement Veritas NetBackup. In summary, this software offers a centralized solution with a wide range of functionality, ease of use/management, and exemplary performance as is outlined in the above documentation.
The recommendation for the secondary backup software of choice goes to Legato Networker. This software also offers a wide variety of features and functions with almost all the capabilities of Veritas NetBackup. However, it is marred by a non-user friendly graphical interface that is less intuitive for performing everyday operations as well as some inherent shortcomings
