Tag Archives: hadoop

Wordcount for Hadoop

Java sample code: http://dl.huangshiyang.com/hadoopUtilTools.zip import java.io.IOException; import java.util.*; import org.apache.hadoop.fs.Path; import org.apache.hadoop.conf.*; import org.apache.hadoop.io.*; import... Read More | Share it now!

How to install a MapR(5.1, 5.0, 4.1) cluster on Centos VM

Operating System Support Matrix This matrix shows the operating systems and versions supported by each MapR release. MapR Version OS Version MapR 5.2.0 MapR 5.1.0 MapR 5.0.0 MapR 4.1.0 MapR 4.0.2 MapR 4.0.1 MapR 3.1.x MapR... Read More | Share it now!

Aggregation is not enabled. Try the nodemanager at IP:HOST

Question: Aggregation service start hadoop 2.2.0, I want to view Tracking UI,so I visit http://172.11.12.6:8088/cluster,then I click History of Completed Job,such as follows: MapReduce Job job_1392601388579_0001 Attempt Number Start Time Node Logs 1... Read More | Share it now!

How to configure Kerberos on HDP and integrate with Active Directory

http://zh.hortonworks.com/blog/enabling-kerberos-hdp-active-directory-integration/ Hadoop is a business-critical data platform at many of the world’s largest enterprises. These corporations require a layered security model focusing on four aspects of... Read More | Share it now!

Download the MapR Converged Data Platform for Free!

  The MapR Converged Data Platform is available in two editions – the Converged Community Edition, for free, unlimited production use, and the Converged Enterprise Edition, for critical deployments requiring business continuity. Click here... Read More | Share it now!

Hive:简单查询不启用Mapreduce job而启用Fetch task

如果你想查询某个表的某一列,Hive默认是会启用MapReduce Job来完成这个任务,如下: 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 hive> SELECT id,... Read More | Share it now!

Hortonworks installer RHEL/CentOS/Oracle Linux 6

http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_Installing_HDP_AMB/content/_download_the_ambari_repo_lnx6.html Before installing Hortonworks, please set up your Centos Envirenment: ... Read More | Share it now!

out of Memory Error in Hadoop

http://stackoverflow.com/questions/8464048/out-of-memory-error-in-hadoop I am getting the following Exception java.lang.OutOfMemoryError: Java heap space Please suggest a solution so that i can try out the example. The entire Exception is listed below.... Read More | Share it now!

JCE cannot authenticate the provider BC

// // // // // Caused by: java.lang.SecurityException: JCE cannot authenticate the provider BC at javax.crypto.Cipher.getInstance(Cipher.java:657) at javax.crypto.Cipher.getInstance(Cipher.java:596) at... Read More | Share it now!

Oozie Shell Action 配置

Shell Action Shell action运行一个shell命令,需要配置的有job-tracker,name-node和一些必要的参数。 经过配置,在启动Shell... Read More | Share it now!