Loading...

Creating a Pseudo-Client for Hadoop

After installing the Hadoop package on the data access nodes, you must configure a pseudo-client.

Procedure

  1. From the CommCell Browser, right-click Client Computers, point to New Client > File System and then click Hadoop.

    The Create Hadoop Client dialog box appears.

  2. Enter the HDFS user and library path details to connect to the Hadoop cluster:
    1. In the Client Name box, type a name for the pseudo-client.
    2. In the Instance Name box, type a name for the instance.
    3. HDFS URI: Commvault recommends using the default value for HDFS URI. The URI details are automatically fetched from the core-site.xml file that is located in the hadoop_installation_directory/conf/ directory.
    4. Optional: In the HDFS User box, type the Hadoop user name if a non-root user account is used to manage the Hadoop cluster.
    5. In the Hadoop Native Library Path box, type or click Browse to specify the path to the Hadoop native library (libhdfs.so).

      Syntax:

      /path_containing_hadoop_install_directory_native_folder

      Example:

      /usr/hadoop-2.6.1/lib/native

    6. In the JVM Library Path box, type or click Browse to specify the path to the JVM library (libjvm.so).

      Syntax:

      /path_containing_jvm_jre_folder

      Example:

      /usr/lib/jvm/java-XX.xx-openjdk-XX.xx.x86_64/jre/lib/amd64/server

  3. On the Hadoop tab, specify the data access nodes that will be part of the instance.
    1. In the Master Node list, select one of the data access nodes as a master node for the instance.
    2. Under Data Access Nodes, select the required data access nodes, and then click Add to include them in the instance.
    3. In the Number of Data Readers box, enter the number of data streams.

      Tip: For optimal sharing of the backup load, the number of data readers must be greater than the number of data access nodes.

  4. On the Storage Device tab, select a storage policy from the Storage Policy list.
  5. Optional: To create a new storage policy, click Create Storage Policy, and then follow the instructions in the storage policy creation wizard.
  6. Optional: To perform LAN-free backup and restores, select a grid storage policy.

    For more information, see GridStor® (Alternate Data Paths) - Overview.

  7. Click OK.

Last modified: 1/30/2020 7:32:46 AM