This technical paper provides the best practices guide for implementing IBM Storwize V7000 Unified Network Data Management Protocol (NDMP) backup solution using the Symantec NetBackup software. The IBM Storwize V7000 Unified system includes the IBM Storwize V7000 file module and the Storwize V7000 storage system. The IBM Storwize V7000 Unified system supports both block protocols and file protocols.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Prerequisites ............................................................................................................................. 4 IBM Storwize V7000 Unified system ........................................................................................ 4
Two-way NDMP authentication and detection of tape devices ..................................................... 24 Three-way NDMP tape server authentication and tape configuration ........................................... 38 Symantec NetBackup inventory of tape library .............................................................................. 51 Creating a Symantec NetBackup NDMP policy ............................................................................. 55 Storwize V7000 Unified NDMP backup considerations ................................................................. 64 Storwize V7000 Unified NDMP backup (full) ................................................................................. 66
Symantec NetBackup NDMP restore .................................................................................................... 71 Using Symantec NetBackup Direct Access Recovery (DAR) for NDMP restores ......................... 71 Storwize V7000 Unified NDMP restore using Symantec NetBackup restore ................................ 71
Summary ................................................................................................................................. 84 Appendix A: Glossary ............................................................................................................ 85 Appendix B: Materials used in the lab setup ........................................................................ 86 Appendix C: Resources ......................................................................................................... 87 About the author..................................................................................................................... 88 Trademarks and special notices ........................................................................................... 89
Abstract This technical paper provides the best practices guide for implementing IBM Storwize V7000 Unified Network Data Management Protocol (NDMP) backup solution using the Symantec NetBackup software. The IBM Storwize V7000 Unified system includes the IBM Storwize V7000 file module and the Storwize V7000 storage system. The IBM Storwize V7000 Unified system supports both block protocols and file protocols.
NDMP is an open protocol for managing data stored on networked file servers. The NDMP future development is under the direction of the Storage Networking Industry Association (SNIA), which has a work group for NDMP.
Executive summary As an established market leader in data protection, Symantec NetBackup can provide unparalleled next-generation data protection by minimizing cost and complexity and ensuring greater business continuity with a solution that unifies desktop, remote office, and data center protection across the entire enterprise. Symantec also supports a wide range of data protection options including NDMP support.
The IBM® Storwize® V7000 Unified system supports NDMP version 4. The NDMP function is configured and managed on the Storwize V7000 Unified system using the Storwize V7000 Unified command-line interface (CLI) from the active management node. NDMP alerts are written to the alert log on the Storwize V7000 Unified active management node.
This technical report provides details on configuring NDMP feature of IBM Storwize V7000 Unified system and enabling Symantec NetBackup NDMP-specific settings and functionality.
Intended audience
This technical report is intended for:
• Customers and prospects looking to implement effective NDMP backup solution on IBM Storwize V7000 Unified system using the Symantec NetBackup software
• Users and management seeking detailed information to implement NDMP backup solution on IBM Storwize V7000 Unified system using Symantec NetBackup software
Scope
This technical report provides:
• Detailed NDMP backup solution implementation on IBM Storwize V7000 Unified system with Symantec NetBackup 7.0.1
• Detailed NDMP backup implementation guide; configuration best practices
This technical report does not:
• Discuss any performance impact and analysis from a user perspective • Replace any official manuals and documents from IBM and Symantec on the products used in
Prerequisites This technical paper assumes familiarity with the following prerequisites:
• Basic knowledge of IBM Storwize V7000 Unified system • Basic knowledge Symantec NetBackup 7.0.1 or higher • The IBM Storwize V7000 Unified system must have Storwize V7000 file module software version
1.3 GA or higher.
IBM Storwize V7000 Unified system The IBM Storwize V7000 Unified system offers simple, unified storage architecture. In an IBM Storwize V7000 Unified system, the file module is a clustered system comprised of two units that provide file systems for use by network-attached storage (NAS). The file module uses the Storwize V7000 storage system to provide the file module with volumes. Volumes are also provided on the storage area network (SAN).
The IBM Storwize V7000 File Module Software within the Storwize V7000 Unified system contains the interface-node and management node functions. A management node is used for configuring, administering, and monitoring a system. An interface node connects a system to an Internet Protocol (IP) network.
The Storwize V7000 Unified software performs the following functions for the host systems that attach to Storwize V7000 Unified:
• Creates a single pool of storage • Provides logical unit virtualization • Manages logical volumes • Mirrors logical volumes
The Storwize V7000 Unified system also provides the following functions:
• Large scalable cache • Copy services
− IBM Tivoli® Storage FlashCopy® Manager (point-in-time copy) function, including thin-provisioned FlashCopy to make multiple targets affordable
− Metro Mirror (synchronous copy) − Global Mirror (asynchronous copy) − Data migration
• Space management − IBM System Storage® Easy Tier™ to migrate the most frequently used data to higher
performing storage − Metering of service quality when combined with IBM Tivoli Storage Productivity Center − Thin-provisioned logical volumes
This offers customers great flexibility in meeting their storage needs, irrespective of whether file-based or block-based.
Storwize V7000 Unified system NDMP overview
IBM Storwize V7000 Unified system supports the NDMP version 4. NDMP is a network-based protocol used by data management applications primarily for backing up and restoring the files contained within a NAS system, such as IBM Storwize V7000 Unified system.
The Storwize V7000 Unified system NDMP feature provides the capability to backup and restore the files and directories within file systems of the Storwize V7000 Unified system. The granularity of backup is at the directory level. NDMP supports the concept of a full backup and an incremental backup. A full backup backs up all files and directories specified by Storwize V7000 Unified NDMP feature. An incremental backup backs up those files and directories that have changed since the last full backup. Incremental backups are cumulative.
A cumulative incremental backup backs up the files that are specified in the backup selections list that have changed since the last full backup. In the event no previous backup has been finished, all the files are backed up. Cumulative incremental backups occur automatically according to the scheduled criteria. A complete restore requires the last full backup and the last cumulative incremental backup.
A differential incremental backup backs up the files that have changed since the last successful incremental (differential or cumulative) or full backup. If no previous backup has been done, all files are backed up. Differential incremental backups occur automatically according to scheduled criteria. A complete restore requires the last full backup, the last cumulative incremental backup, and all differential incremental backups that have occurred since the last full backup.
Storwize V7000 Unified supported NDMP physical configuration There are two primary NDMP configurations that can be used with the Storwize V7000 Unified system.
• Two-way (or remote) NDMP
• Three-way NDMP
The following sections describe the two-way (or remote) and three-way NDMP configurations in detail.
The two-way NDMP consists of an external data management application, such as Symantec NetBackup, running on a server external to the Storwize V7000 Unified system. The data management application system has some form of storage hierarchy, such as a tape library, that it manages for the storage of backup data.
In addition to the external data management application (Symantec NetBackup) system, an Ethernet network exists that connects the data management application system to the Storwize V7000 file modules on which the NDMP server is running. NDMP control and data traffic flow across this network, between the external data management application system and the Storwize V7000 Unified file modules on which the NDMP server is running.
Recommendation: The recommendation is that this network be a high speed 10 Gb Ethernet network to handle the volume of data being backed up or restored. However, nothing prevents this network from being a 1 Gb Ethernet network.
Figure 3 shows an example of a two-way Storwize V7000 Unified NDMP configuration. It includes an external data management application (Symantec NetBackup) running on a server external to the Storwize V7000 Unified system. The data management application server has an IBM System Storage® TS7650G ProtecTIER® Deduplication Gateway attached to it through an 8 Gbps Fibre Channel (FC) SAN. The System Storage TS7650G ProtecTIER Deduplication Gateway has an IBM System Storage DS5000 storage controller attached to it through 8 Gbps FC links, which in turn has some number of DS5000 disk storage expansion units attached to it through 8 Gbps FC links. The data management application is connected to a 10 Gbps Ethernet network to which the Storwize V7000 Unified file modules are attached. In Figure 3, the lines are intended to show the type and speed on the connections between the various physical components and do not necessarily represent the actual number of physical links.
In a three-way Storwize V7000 Unified NDMP configuration, an NDMP tape server is installed on a server external to the Storwize V7000 Unified system and separate from the server on which the Symantec NetBackup data management application is running. Some forms of storage devices, such as a virtual tape library or real tape library and tape drives, are attached to the server running the NDMP tape server.
The NDMP controls the traffic flow between the Symantec NetBackup data management application system and the Storwize V7000 Unified file modules. NDMP data traffic flows between the Storwize V7000 Unified file modules and the NDMP tape server. In this scenario, only NDMP control traffic is flowing between the Symantec NetBackup data management application system and the Storwize V7000 file modules. Therefore, the Symantec NetBackup data management application system does not need to be on a high-speed network. The Symantec NetBackup (data management application) system can use a lower speed 1 Gbps Ethernet network to connect the Storwize V7000 file modules and the external server on which the NDMP tape server is running.
However, NDMP data traffic (the actual data being backed up or restored) is flowing between the Storwize V7000 Unified file modules and the external server on which the NDMP tape server is running.
Recommendation: It is recommended that the Ethernet network between the NDMP tape server and the Storwize V7000 unified file modules running the NDMP server be a high-speed 10 Gbps Ethernet network.
Figure 4 shows an example of an NDMP three-way configuration. In this example, the Storwize V7000 Unified file modules (used for file serving) and the data management applications are connected on a 1 Gbps Ethernet network. Storwize V7000 Unified file modules used for NDMP backup and restore, are also connected to a 10 Gbps Ethernet network along with the NDMP tape server. The server on which the NDMP tape server is running is connected to an 8 Gbps FC SAN along with an IBM System Storage TS3500 tape library with some FC-attached tape drives, such as IBM Linear Tape-Open data cartridges, Generation 3, Generation 4, or Generation 5 tape drives.
Fundamentals of Storwize V7000 Unified NDMP feature The following points explain the fundamentals of Storwize V7000 Unified NDMP features:
• An NDMP version 4 compliant data server is available on file modules of the Storwize Unified storage system. There is a provision to create both the file modules that will be part of an NDMP_NODE_GROUP. Both the file modules are paired with network group IP addresses that can be assigned to a specific network port. This network port is associated with the NDMP service.
• The NDMP server running on a file module provides for both data and control connections to
servers external to the Storwize V7000 Unified storage system on which a data management application (Symantec NetBackup) is running.
• The ability to configure the NDMP parameters for file modules (the NDMP_NODE_GROUP) is provided through Storwize V7000 Unified CLI commands that are run from the file module, which stores the NDMP configuration parameters in the Samba Registry.
• In addition to the Storwize V7000 Unified CLI commands available to store and retrieve NDMP
configuration parameters, a set of CLI commands are provided allowing to view NDMP session information and NDMP log information, and stop currently running NDMP sessions.
• An NDMP backup session provides backup of a specific directory in an IBM General Parallel File
System (IBM GPFS™) and all files and subdirectories contained within it. Besides the basic data of the files and directories, all extended GPFS attributes are saved for every file and directory. In order to provide the provision to back up a directory structure at a given point in time, a snapshot is used and it is actually the snapshot of the directory structure that is backed up. This snapshot also accounts for files that might be open or in use during the backup, as a point-in-time representation of the file is backed up by NDMP.
• An NDMP restore session will restore all of the files and directories in the proper structure of
subdirectories, and so on. In addition to the actual file contents, the GPFS extended attributes are also restored.
The following Storwize V7000 Unified CLI commands (shown in Table 1) are available for configuring, monitoring, and managing the NDMP configuration parameters and NDMP sessions.
Table 1: Storwize V7000 Unified system CLI command description
Storwize V7000 Unified system configuration in lab
In the lab:
• The Storwize V7000 Unified system has one Storwize V7000 storage system for block access functionality.
• The Storwize V7000 Unified system has two file modules that act as management nodes, interface nodes, and storage nodes for file-level access: mgmt001st001 and mgmt002st001
• The Storwize V7000 Unified system file cluster is defined as: ifs1isv.storage.tucson.ibm.com • There are 10 Gb Ethernet cards on each file modules and configured ethX1 to access the
bonded ports
(Refer to “Appendix B: Materials used in the lab setup” for more information)
Storwize NDMP network group configuration
This section provides the guidelines to create and configure a network group that includes file modules to service NDMP requests for the NDMP node group.
• Create a network group comprising two file modules using mknwgroup Storwize V7000 Unified CLI command on file modules.
Note: Visit the URL: http://oav.net/mirrors/cidr.html to figure out the Classless Inter-Domain Routing (CIDR). In this case, the team used 23. In this example, mknw cli use 17.0.0.0/24…
Validate the newly created network using the lsnw Storwize V7000 Unified CLI command on file modules.
Attach the newly created network group, ndmp_nw_group, to the newly created network using the attachnw Storwize V7000 Unified CLI command on file modules.
attachnw 17.0.0.0/24 ethX0 -g ndmp_nw_group
Storwize V7000 Unified NDMP node group configuration using GUI
In order to use Storwize V7000 Unified GUI to configure NDMP, log in to Storwize V7000 Unified system GUI using https://<IP Address>:1081.
Note: It is recommended to use the Mozilla Firefox browser to use Storwize V7000 GUI for appropriate functional performance.
1. Click the Files icon in the left pane and the click Services to start configuring NDMP backup, as shown in Figure 5.
5. In the General tab of the New NDMP Node Group window, select the Enable NDMP session check box and enter the NDMP node group name. Select a file system from the File system list to be used for backup or restore operations through NDMP, and select a network group from the corresponding list. After selecting the network group, the network group’s interface nodes and network group’s public IP addresses will be displayed in the New NDMP Node Group window. Refer to Figure 9.
6. In the Advanced tab, select the advanced options for NDMP configuration. You can choose to keep default options. Activate the prefetch functionality by selecting the Prefetch activated check box and the click OK, as shown in the Figure 10.
Figure 10: Configuring NDMP Node Group
7. The wizard creates and configures the NDMP backup node group and the summary is displayed, as shown in the Figure 11. Verify the summary information and click Close.
8. The newly configured NDMP node group will be displayed in the main window. From the Actions list, select Activate to activate the newly created NDMP node group, as shown in the Figure 12.
Figure 12: Activating the NDMP node group
9. The wizard activates NDMP configuration and the summary is displayed, as shown in the Figure 13. Verify the summary information and click Close.
Storwize V7000 Unified NDMP node group configuration using CLI
This section provides appropriate guidelines to create and configure the Storwize V7000 Unified NDMP node group.
• A Storwize V7000 Unified NDMP configuration can be defined only for an NDMP node group. • A Storwize V7000 Unified NDMP node group must be created before any other specific Storwize
V7000 NDMP node group configuration parameters can be set. • A Storwize V7000 NDMP node group is created, configured, and activated appropriately, before
an NDMP backup or restore can be configured on the Symantec NetBackup Data Management Application (DMA) server.
To configure the Storwize V7000 Unified NDMP node group:
1. Create an NDMP node group using the --create option of the cfgndmp command on Storwize Unified file module.
2. Attach the newly configured network group, ndmp_nw_group, (refer to the “Storwize NDMP network group configuration” section) to the newly created Storwize V7000 Unified NDMP node group using the cfgndmp Storwize V7000 Unified CLI command with the --networkGroup option on the file module.
4. Add the file system mount point paths to the NDMP node group configuration using the --addPaths option of the cfgndmp command on the Storwize V7000 Unified file module.
5. A default NDMP backup prefetch configuration is assigned to a newly created NDMP node group, with the function deactivated. Optionally, use the cfgndmpprefetch CLI command to change the NDMP backup prefetch configuration and activate the function for improved NDMP backup performance. Refer to the “Configuring Storwize V7000 Unified NDMP backup prefetch” section for more information.
6. Activate the NDMP node group with the --activate option of the cfgndmp CLI command.
Note: You can use the lsndmp CLI command with the -ndmpServiceStatus option to verify that NDMP has started on all the nodes in the NDMP node group, on the Storwize V7000 Unified file module.
The NDMP backup prefetch function navigates the directory that is being backed up, reading files in advance to the files actually coming due to be backed up. The prefetch function opens files in read-only mode and places the files in the file module’s cache for improved backup performance.
NDMP backup prefetch is designed to work on files that are less than or equal to 1 MB in size.
Restriction: Storwize V7000 Unified NDMP backup prefetch will not work for a file system that has a block size that is greater than 1 MB.
• To activate the NDMP backup prefetch feature, use the cfgndmpprefetch CLI command with the --activate option. Specify the NDMP node group to enable NDMP prefetch feature with Storwize V7000 Unified NDMP node group, as in the following example on the Storwize V7000 Unified file module. cfgndmpprefetch -c ifs1isv.storage.tucson.ibm.com ndmp_node_grp1 --activate
Note: If NDMP is not active on the specified NDMP node group, a message is displayed indicating that prefetch for NDMP will be activated when NDMP is activated.
• To set a limit for the number of applications that can simultaneously use Storwize V7000 Unified NDMP backup prefetch for a node, (including multiple instances of the same program, such as multiple Storwize V7000 Unified NDMP sessions) use the cfgndmpprefetch CLI command with the --appLimit option, as in the following example on the Storwize V7000 Unified file module.
Note: If NDMP is not active on the specified NDMP node group, a message is displayed indicating that the configuration for prefetch for NDMP has been updated.
• To set a limit for the number of prefetching threads on file module, use the cfgndmpprefetch CLI command with the -numThreads option, as in the following example on the Storwize V7000 Unified file module.
Note: The value for the --numThreads option must be a positive integer, greater than 50 and less than or equal to 180. The default value is 100.
• To display NDMP backup prefetch status information, use the lsndmpprefetch CLI command using the -s or --status option, and optionally adding the -g option to limit display to the specified NDMP node group, as in the following example on the Storwize V7000 Unified file module.
Concurrent Storwize V7000 Unified NDMP backup and restore usage with other Storwize V7000 Unified functions
The information in Table 2 helps you identify the Storwize V7000 Unified features and functions that might be currently used on the same Storwize V7000 Unified system.
Features
and functions
Anti-virus scanning
Asynchronous replication
Hierarchical Storage
management (HSM)
processing
NDMP backup
and restore
IBM Tivoli Storage Manager backup
and restore
Storwize V7000 Unified block
functions
Anti-virus scanning N/A
Same system: Yes Same file module: Yes
Same system: Yes Same file module: Yes Refer Note 3
Same system: Yes Same file module: Yes
Same system: Yes Same file module: Yes Yes
Asynchronous replication
Same system: Yes Same file module: Yes N/A
Same system: Yes Same file module: Yes Refer Note 2
Same system: Yes Same file module: Yes
Same system: Yes Same file module: Yes Yes
HSM processing
Same system: Yes Same file module: Yes Refer Note 3
Same system: Yes Same file module: Yes Refer Note 2 N/A
Same system: No Same file module: No
Same system: Yes Same file module: Yes Yes
NDMP backup and restore
Same system: Yes Same file module: Yes
Same system: Yes Same file module: Yes
Same system: No Same file module: No N/A
Same system: No Same file module: No Refer Note 1 Yes
Tivoli Storage Manager backup and restore
Same system: Yes Same file module: Yes
Same system: Yes Same file module: Yes
Same system: Yes Same file module: Yes
Same system: No Same file module: No Refer Note 1 N/A Yes
• IBM Tivoli Storage Manager backup / restore and NDMP backup / restore provide the same basic functionality of backing up or restoring file systems and the directories and files within the file systems. It is not recommended and not supported to have both Tivoli Storage Manager backup restore processing and NDMP backup restore processing being used on the same Storwize V7000 Unified system.
• NDMP backup are normally scheduled operations, which can be scheduled at a time when other activity, such as general purpose file serving, is low. If possible, it is recommended to perform NDMP backups during periods when other file serving activity is generally lower, perhaps late in the evening or early in the mornings.
• In case, the NDMP backup or restore processing significantly interferes with other Storwize V7000 Unified functions, such as network file serving (CIFS, NFS, FTP, HTTP) then consider increasing the processing energy and memory configuration of the Storwize V7000 file modules. Many Storwize V7000 Unified functions invoke the GPFS policy engine to evaluate a GPFS policy to determine the list of files to operate on. These include:
The GPFS policy engine scans the file system metadata to determine the files that match the criteria specified in the policy. This scan of the file system metadata can generate a significant amount of I/O to the storage systems to read all the file system metadata, especially for file systems containing very large number of files, such as 10s or 100s of millions of files. Therefore, it is recommended not to start all the Storwize V7000 Unified functions at exactly the same time, but instead be staggered over time.
Considerations for Symantec NetBackup DMA for Storwize V7000 Unified system NDMP backup Obtain either the IP address or host name for the file module to be used for this NDMP session.
• Host Name: Configure a DNS server with a common host name mapped to all of the IP addresses that are associated with the network group that is associated with the NDMP node group. If this host name is used, any of the file modules that are associated with the NDMP node group can be assigned based on a round robin IP address assignment from the DNS server.
• IP address: Submit the lsnwinterface CLI command using the -x option on the file module of the Storwize V7000 Unified system and choose an appropriate IP address or multiple IP addresses, if multiple backup policies are to be run simultaneously. This method is useful when multiple NDMP backup policies are used and you want to distribute the NDMP workload across file modules and ensure that the same file module will not be used for all of the backup policies that will be run from the DMA server.
Configure the Symantec NetBackup DMA server with the configuration parameters of the NDMP server for the file module that are available to perform NDMP services, including the user name and password associated with the NDMP node group. If a port other than 10000 was selected for the NDMP control port, then that control port's information needs to be configured on the DMA server.
Monitoring NDMP session on Storwize V7000 Unified system
Note: Read this information after configuring Symantec NetBackup NDMP configuration and staging appropriate Storwize V7000 Unified NDMP backup or restore. Refer to the “Symantec NetBackup NDMP Configuration” section for more information
• The lsndmpsession CLI command enables to monitor the NDMP session on Storwize V7000 Unified system. Use -n or -nodes option to view the NDMP sessions running on a specified file module or with the -g or --nodeGroupName option to view the NDMP sessions running on specified NDMP node groups.
Only file modules can be specified when using the -n or --nodes option. Multiple file modules and multiple node groups in a list must be separated with commas. If no file modules or node groups are specified, the output displays information for all of the file modules in the cluster. To determine the file modules that are running NDMP sessions for an NDMP node group, submit the following command that shows the file modules that have NDMP sessions running and the sessions that are running on the nodes:
• Use the Storwize V7000 Unified CLI lsndmpsession command with the -i or --sessionID option to view the verbose information of the NDMP session identified by the specified session ID (sid) running on the specified file module. In the following example, the sid 1284990 is specified. Use the Storwize V7000 CLI lsndmpsession command with the -i or --sessionID option to view the verbose information of the NDMP session identified by the specified session ID running on the specified file module.
Monitoring NDMP log information on Storwize V7000 Unified system
You can view Storwize V7000 Unified NDMP log using the lsndmplog CLI command.
• Use the Storwize V7000 Unified CLI lsndmplog command with the -n or --nodes option to view all of the NDMP log information related to the specified file module. In the following example, the file module mgmt001st001 is specified:
• Use the Storwize V7000 Unified CLI lsndmplog command with the -l or --lines option to view the
most recent lines of the NDMP log information related to the specified interface node. In the following example, the node int005st001 and 25 lines are specified:
• Use the Storwize V7000 CLI lsndmplog command with the -o or --outputLogFilePath option to save the log file as a temporary file, as in the following example:
8. Select Use the following credentials for this NDMP host on all media servers (Not valid for back-level servers) and enter the NDMP user name and password of the Storwize V7000 Unified storage system, and click OK to continue. Note: By default, the Storwize V7000 Unified NDMP user name is ndmp and the password is ndmp.
Figure 21: Specifying the Storwize V7000 Unified NDMP credentials
12. Validate the appropriate tape library connected to the Symantec NetBackup host, and then click Next to continue. Note: Click Properties to validate the appropriate serial number of the connected tape library.
Figure 25: Reviewing the devices that NetBackup has found
13. After the scanning process is complete, Symantec NetBackup would detect all available tape
devices connected to the host. Select the appropriate tape library and click Next to continue.
Note: To change the tape device mapping, drag and drop the tape devices between robots (only if you are sure about tape library element ID and device ID). However, it is not recommended to change default configuration.
Figure 27: Verifying drive configuration
14. Click Yes to commit the new device configuration.
17. In the Symantec NetBackup Administrator Console window, navigate to Media and Device Management Devices Robots and validate the configured tape library and tape drives, as show in the Figure 31.
Figure 31: NetBackup Administration Console
18. In the Symantec NetBackup Administration Console window under Media and Device
Management Credentials NDMP Hosts, validate the NDMP host information, as show in the Figure 32.
6. Click New and enter an appropriate Storwize V7000 Unified NDMP management node and NDMP tape server IP address. Then, click OK to continue (as shown in the Figure 37).
Figure 37: Device configuration wizard with the option to add NDMP host
7. Select Use the following credentials for this NDMP host on all media servers (Not valid for back-level servers), then enter the user name and password of the storage system, and click OK to continue (as shown in the Figure 38).
Note: By default, the Storwize V7000 Unified NDMP user name is ndmp and the password is ndmp.
9. Symantec NetBackup scans the NDMP tape server and the tape drives that are connected to the NDMP tape server. Click Next to continue (as shown in the Figure 40).
Figure 40: Scanning the tape server configured tape library
12. After the scanning process is complete, Symantec NetBackup would detect all available tape devices connected to the NDMP tape server. Select the appropriate tape library and click Next to continue.
Note: To change tape device mapping, drag and drop the tape devices between robots (only if you are sure about tape library element ID and device ID). However, it is not recommended to change the default configuration.
Figure 44: A listing of the tape devices connected to the NDMP tape server
13. Click Yes to commit the new device configuration, as shown in the Figure 45.
Figure 45: Committing the new device configuration
14. Symantec NetBackup updates the new device configuration changes and restarts the device-related services. Click Next to continue, as shown in the Figure 46.
Figure 46: Updating the new device configuration changes
15. After successful completion of the steps, click Finish, as shown in the Figure 47.
Figure 47: Final NetBackup Device Configuration Wizard page
16. Validate the configured tape library and tape drives in Symantec NetBackup Administration Console under Media and Device Management Devices Robots, as shown in the Figure 48.
19. Validate the configured tape server in Symantec NetBackup Administration Console under Media and Device Management Credentials NDMP hosts, as shown in the Figure 49.
2. From the Robot list, select the tape library that is appropriate to the device host, select Update volume configuration, and then click Start (as shown in the Figure 51).
Figure 51: Selecting the device host and the inventory operation
3. Click Yes to confirm the updation of volume configuration, as show in the Figure 52.
Figure 52: Confirming to update volume configuration
4. The Robot Inventory will provide information about the configured tape library volume information. Repeat the steps for tape library configuration of NDMP tape server for the three-way NDMP configuration.
Perform the following steps to create an NDMP policy on NetBackup Administration Console.
1. In the NetBackup Administration Console window, right-click Summary of all Policies and click New policy to create a new Storwize V7000 Unified NDMP policy, as shown in the Figure 54.
Figure 54: Creating a new Storwize V7000 NDMP policy
2. Enter a new Storwize V7000 Unified NDMP policy name, and select the Use Backup Policy Configuration Wizard check box, and click OK to continue (as shown in the Figure 55).
Figure 55: Specify a name for the new policy
3. In the Backup Policy Configuration Wizard, click Next to continue.
5. Click Add and then provide an appropriate Storwize V7000 Unified NDMP configured management node associated IP address (as source Storwize V7000 Unified NDMP client to backup) and press Enter, and then click Next to continue.
Figure 58: Specifying clients
6. Select the NDMP, NDMP option for client hardware and operating system. Then, click OK to continue.
Figure 59: Selecting the client hardware and operating system
12. Click Finish to complete the Storwize V7000 Unified NDMP policy creation.
Figure 65: Finalize the Storwize V7000 Unified NDMP backup policy
Storwize V7000 Unified NDMP backup considerations
There are specific Storwize V7000 Unified NDMP environment variables, which are treated as parameters and can be passed to the NDMP server from data management applications performing NDMP backups. The following two parameters can be configured through data management applications.
• BACKUP_GROUP_NAME: This is the name of a backup group where all the backup directories within the backup group share the same Storwize V7000 Unified snapshot.
− Note 1: The way to set this environment variable is to have a line similar to the following
in the backup policy: SET BACKUP_GROUP_NAME=NDMP_EXISTING_snap1
− Note 2: If the BACKUP_GROUP_NAME parameter begins with NDMP_EXISTING, then
it is assumed that the Storwize V7000 Unified system is configured to use a snapshot, which has a name corresponding to this environment variable value. In this special case, it is also assumed that the user will delete the corresponding snapshot manually.
− Note 3: The maximum length of the backup group name is 32 characters (inclusive of a
• BACKUP_GROUP_EXPIRATION: This parameter helps to configure the amount of valid time that the snapshot is associated with BACKUP_GROUP_NAME. After the age of the snapshot has surpassed the expiration value, a new snapshot will be taken and all the new NDMP backup sessions associated with BACKUP_GROUP_NAME will use the new snapshot. This Storwize V7000 Unified NDMP parameter is very important to effectively schedule incremental or differential backup that has less than 1 hour incremental and differential backup expiration schedule time.
− Note 1: The way to set this environment variables is to have a line similar to the following
line in the backup policy:
SET BACKUP_GROUP_EXPIRATION = 1_DAY − Note 2: The following values are acceptable for this environment variable:
− Note 3: If no value is given for the expiration, the default will be 1 hour. − Note 4: If the user wants to ensure that a separate snapshot is taken for every directory,
then an expiration value of 0_SEC should be specified.
Perform the following steps for a manual full Storwize V7000 Unified NDMP backup.
1. In the NetBackup Administration Console window, right-click a newly-created Storwize V7000 Unified NDMP backup policy and click Change, as show in the Figure 66.
3. In the Backup Selections tab, click New to update Storwize V7000 Unified NDMP backup policy (full) with appropriate Storwize V7000 Unified NDMP environment variables. Click OK to continue.
This section describes Symantec NetBackup NDMP restore feature.
Using Symantec NetBackup Direct Access Recovery (DAR) for NDMP restores
By default, Symantec NetBackup for NDMP is configured to use DAR when restoring files or directories. DAR is used differently for file restore when compared to directory restore, as follows:
• For each restore of files (not of directories), Symantec NetBackup automatically determines whether the use of DAR speeds up the restore. Symantec NetBackup uses DAR only when it results in a faster restore.
• For restore of directories, by default DAR is always used when restoring a subdirectory but never used when restoring the directory containing an entire image. For example, if /vol/vol0 contains the entire image, and /vol/vol0/dir1 is a subdirectory, DAR is used by default when restoring /vol/vol0/dir1. But it is not used when restoring /vol/vol0. For restore of subdirectories, Symantec NetBackup does not attempt to gauge the effectiveness of using DAR. Unless DAR is manually disabled, Symantec NetBackup always uses DAR when restoring subdirectories.
Storwize V7000 Unified NDMP restore using Symantec NetBackup restore
This section provides the steps involved in Storwize V7000 Unified NDMP restore on Symantec NetBackup Backup, Archive, and Restore NetBackup client.
1. Launch the Symantec Symantec NetBackup Backup, Archive, and Restore NetBackup client.
Note: In Microsoft® Windows®, click Start All Programs Symantec NetBackup Backup, Archive, Restore.
In Linux®, click the Backup, Archive, Restore node.
• To restore data to a different location, select Restore everything to a different location (maintaining existing structure) and click Start Restore to initiate restore.
• To restore individual files, select Restore individual folders and files to different locations (double-click to modify) and click Start Restore to initiate the restore.
Figure 86: Restoring individual files and folders to a different location
13. Click Yes to view the progress of the restore job as shown in Figure 87. The job status can also
be viewed from the Job screen, similar to backup jobs details.
Summary The IBM Storwize V7000 Unified system is a virtualizing RAID storage system that supports both block protocols and file protocols. This unified system includes the IBM Storwize V7000 file module and the Storwize V7000 storage system.
The file module is a clustered system comprising two units that provide file systems for use by network-attached storage. The file module uses the Storwize V7000 storage system to provide the file module with volumes. Other volumes, which are block volumes, are provided on the SAN to be presented to hosts.
The Storwize V7000 Unified system has incorporated the NDMP technology and support the NDMP protocol version 4. Leveraging Symantec NetBackup NDMP backup support, the Storwize V7000 Unified data files can seamlessly back up to the tape devices and perform restore from the tape device.
This technical content is intended to be a reference guide for users who want to use Symantec NetBackup for backing up files (using NDMP protocol) that are incorporated on Storwize V7000 Unified system. This technical report is not meant to be an implementation or solution guide. For details on actual implementation or solution design, refer to the documentation provided in the “Resources” section of this technical paper.
• IBM Storwize V7000 Unified system – Build on IBM high-performance computing experience, and designed to support both block and file storage protocols, Storwize V7000 Unified system provides the performance, high availability, single management interface, and functionality that are essential to address strategic storage requirements.
• Network Data Management Protocol (NDMP) – An industry standard protocol created to ease
the process of integrating backup and restore for NAS with data protection software, such as NetBackup. The NDMP is the data transfer protocol and one piece of the overall data protection solution. For more information about the NDMP protocol and the NDMP standards group, visit http://www.ndmp.org/info/faq.shtml.
• Two-way (or remote) Storwize V7000 Unified NDMP – An NDMP configuration supported by
Storwize V7000 Unified storage system. The two-way NDMP consists of an external data management application, such as Symantec NetBackup, running on a server external to the Storwize V7000 Unified storage system. The data management application has some form of storage hierarchy, such as a tape library that it manages for the storage of backup data.
• Three-way Storwize V7000 Unified NDMP – An NDMP configuration supported by Storwize
V7000 Unified storage system. In a three-way Storwize V7000 Unified NDMP configuration, an NDMP tape server is installed on a server external to the Storwize V7000 Unified storage system and separate from the system where Symantec NetBackup data management application is running.
• Symantec NetBackup – NDMP Data Management Application (DMA) used to backup Storwize
V7000 Unified data, using Storwize V7000 Unified NDMP technology.
• Direct access recovery (DAR) – Symantec NetBackup uses DAR to restore a directory or individual files from a backup image. DAR can greatly reduce the time it takes to restore files and directories. DAR is enabled by default (no configuration is required).
• Symantec NetBackup Administrator’s Guide for Windows: http://www.symantec.com/business/support/resources/sites/BUSINESS/content/live/TECHNICAL_SOLUTION/135000/TECH135525/en_US/357098.pdf
• Symantec NetBackup Administrator's Guide for UNIX and Linux: http://www.symantec.com/business/support/resources/sites/BUSINESS/content/live/TECHNICAL_SOLUTION/135000/TECH135524/en_US/357099.pdf
About the author Udayasuryan Kodoly is a Storage Technology Specialist in IBM Systems and Technology Group (ISV Enablement) Organization. Uday has several years of experience on designing, architecting storage solutions, and developing solution best practices on various NAS and SAN appliance data protection (backup) solutions. Uday is an expert on virtualization technologies and the virtual machine data protection strategies. Presently, Uday is working on enabling various ISV backup, disaster recovery, and virtualization solutions for IBM SONAS and IBM Storwize V7000 systems.
References in this document to IBM products or services do not imply that IBM intends to make them available in every country.
IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at "Copyright and trademark information at www.ibm.com/legal/copytrade.shtml.
Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.
Intel, Intel Inside (logos), MMX, and Pentium are trademarks of Intel Corporation in the United States, other countries, or both.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Linux is a trademark of Linus Torvalds in the United States, other countries, or both.
SET and the SET Logo are trademarks owned by SET Secure Electronic Transaction LLC.
Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.
Other company, product, or service names may be trademarks or service marks of others.
Information is provided "AS IS" without warranty of any kind.
All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.
Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products.
All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Contact your local IBM office or IBM authorized reseller for the full text of the specific Statement of Direction.
Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning.
Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here.
Photographs shown are of engineering prototypes. Changes may be incorporated in production models.
Any references in this information to non-IBM websites are provided for convenience only and do not in any manner serve as an endorsement of those websites. The materials at those websites are not part of the materials for this IBM product and use of those websites is at your own risk.