ORANGE WORDS need to be changed on your OWN!!!!!

Common setting:

1 set up host name of local machine and clusters:

$ vi etc/hosts

192.168.5.1 cdh1.cluster
192.168.5.2 cdh2.cluster
192.168.5.3 cdh3.cluster

192.168.5.123 dgctrl localhost

2 copy cluster config file to dgctrl machine:

$ mkdir -p /etc/hadoop/conf
$ scp -r cdh1.cluster:/etc/hadoop/conf/* /etc/hadoop/conf/

3 config HDFSAgent.properties file

DgSecure 5.0.x & earlier 5.1.x:

$ vi /opt/Dataguise/DgSecure/tomcat6/webapps/HDFSAgent/WEB-INF/classes/com/dataguise/hadoop/util/HDFSAgentConfig.properties

fs.default.name=hdfs://cdh1.cluster
fs.default.port=8020
mapred.job.tracker=cdh1.cluster
mapred.default.port=8021
user=hdfs
distro=cdh
YARN=Y

late DgSecure 5.1.x with jetty:

$ vi /opt/Dataguise/DgSecure/Agents/HDFSAgent/expandedArchive/WEB-INF/classes/com/dataguise/hadoop/util/HDFSAgentConfig.properties

fs.default.name=hdfs://cdh1.cluster
fs.default.port=8020
mapred.job.tracker=cdh1.cluster
mapred.default.port=8021
user=hdfs
distro=cdh
YARN=Y

DgSecure 5.2.x:

$ vi /opt/Dataguise/DgSecure/Agents/HDFSAgent/expandedArchive/WEB-INF/classes/com/dataguise/hadoop/util/HDFSAgentConfig.properties

# Following 3 properties are required for all Hadoop distributions
user=hdfs
distro=cdh5
YARN=Y

4 restart service
For tomcat version:

$ /opt/Dataguise/DgSecure/tomcate6/stop.sh

check if tomcat has stopped:

$ ps -aux | grep tomcat

if it is not stopped, do

$ kill [tomcat pid]

start tomcat:

$ /opt/Dataguise/DgSecure/tomcate6/start.sh

For jetty version:

$ /opt/Dataguise/DgSecure/Agents/HDFSAgent/stop.sh

$ /opt/Dataguise/DgSecure/Agents/HDFSAgent/start.sh

FAQ:

Q: HDFS Task Failed : Queue default doesn’t exist, for domain: default (Sometimes shows in Cloudera Cluster)
A: edit HDFSAgentConfig.properties, search “default.queue.name”, change the queue name to “root.hdfs” or your selfdefined one.

Q: Log shows error with ${hdp.version}
A: First, get your Hortonworks version: Go to /usr/hdp and there is a folder of your version of Hortonworks like

[root@hdp1 hdp]# ls /usr/hdp
2.2.9.0-3393  current

Second, edit /opt/Dataguise/DgSecure/Agents/HDFSAgent/jetty-embedded.properties: JavaOptions=-Dhdp.version=2.2.9.0-3393

Q: MapR hadoop config file location?
A: If mapr install as default, it should at: /opt/mapr/hadoop/hadoop-2.7.0/etc/hadoop/