- Check to make sure you have at least three hosts in your cluster and are running at least three ZooKeeper servers.
- Check to make sure that the HDFS and ZooKeeper services are not in Maintenance Mode.These services will be stopped and started when enabling NameNode HA. Maintenance Mode will prevent those start and stop operations from occurring. If the HDFS or ZooKeeper services are in Maintenance Mode the NameNode HA wizard will not complete successfully.
- In Ambari Web, select
Services > HDFS > Summary. - Select Service Actions and choose Enable NameNode HA.
- The Enable HA Wizard launches. This wizard describes the set of automated and manual steps you must take to set up NameNode high availability.
- Get Started : This step gives you an overview of the process and allows you to select a Nameservice ID. You use this Nameservice ID instead of the NameNode FQDN once HA has been set up. Click
Nextto proceed.
- Select Hosts : Select a host for the additional NameNode and the JournalNodes. The wizard suggest options that you can adjust using the drop-down lists. Click
Nextto proceed.
- Review : Confirm your host selections and click
Next.
- Create Checkpoints : Follow the instructions in the step. You need to log in to your current NameNode host to run the commands to put your NameNode into safe mode and create a checkpoint. When Ambari detects success, the message on the bottom of the window changes. Click
Next.
- Configure Components : The wizard configures your components, displaying progress bars to let you track the steps. Click
Nextto continue.
- Initialize JournalNodes : Follow the instructions in the step. You need to login to your current NameNode host to run the command to initialize the JournalNodes. When Ambari detects success, the message on the bottom of the window changes. Click Next.
- Start Components : The wizard starts the ZooKeeper servers and the NameNode, displaying progress bars to let you track the steps. Click
Nextto continue.
- Initialize Metadata : Follow the instructions in the step. For this step you must log in to both the current NameNode and the additional NameNode. Make sure you are logged in to the correct host for each command. Click
Nextwhen you have completed the two commands. A Confirmation pop-up window displays, reminding you to do both steps. ClickOKto confirm.
- Finalize HA Setup : The wizard the setup, displaying progress bars to let you track the steps. Click
Doneto finish the wizard. After the Ambari Web GUI reloads, you may see some alert notifications. Wait a few minutes until the services come back up. If necessary, restart any components using Ambari Web.
- If you are using Hive, you must manually change the Hive Metastore FS root to point to the Nameservice URI instead of the NameNode URI. You created the Nameservice ID in the Get Started step.
- Check the current FS root. On the Hive host:
hive --config /etc/hive/conf.server --service metatool -listFSRootThe output looks similar to the following:
Listing FS Roots... hdfs://<namenode-host>/apps/hive/warehouse - Use this command to change the FS root:
$ hive --config /etc/hive/conf.server --service metatool -updateLocation <new-location><old-location>For example, where the Nameservice ID is mycluster:
$ hive --config /etc/hive/conf.server --service metatool -updateLocation hdfs://mycluster/apps/hive/warehouse hdfs://c6401.ambari.apache.org/apps/hive/warehouseThe output looks similar to the following:
Successfully updated the following locations...Updated X records in SDS table
- Check the current FS root. On the Hive host:
- Adjust the ZooKeeper Failover Controller retries setting for your environment.
- Browse to
Services > HDFS > Configs >Advanced core-site. - Set
ha.failover-controller.active-standby-elector.zk.op.retries=120
- Browse to
3 Responses so far.