Hortonworks Error Log 2014-05-20 17:29:32,242 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:lpinsight (auth:SIMPLE) cause:java.io.IOException: Filesystem closed 2014-05-20 17:29:32,243 WARN... Read More | Share it now!
Category Archives: Hadoop
HIVE nested ARRAY in MAP data type
http://stackoverflow.com/questions/18812025/hive-nested-array-in-map-data-type Hive’s default delimiters are: Row Delimiter => Control-A (‘\001’) Collection Item Delimiter => Control-B (‘\002’) Map Key Delimiter... Read More | Share it now!
hive array、map、struct使用
hive提供了复合数据类型： Structs： structs内部的数据可以通过DOT（.）来存取，例如，表中一列c的类型为STRUCT{a INT; b... Read More | Share it now!
hive的数据导入与数据导出：（本地，云hdfs，hbase），列分隔符的设置
hive表的数据源有四种： hbase hdfs 本地 其他hive表 而hive表本身有两种: 内部表和外部表。 而hbase的数据在hive中，可以建立对应的外部表（参看hive和hbase整合） 内部表和外部表 区别：删除时，内部表删除hadoop上的数据；而外部表不删，其数据在外部存储，hive表只是查看数据的形式，看时从外部读入数据: 内部表：CREATETABLE... Read More | Share it now!
Hive中添加自定义udf udaf udtf等函数的jar文件的三种方法
在开发了hive的udf udaf udtf函数的jar文件后，需要将jar文件放入hive的环境中才可以使用。可以通过以下三种方法加入： 1. 使用add jar... Read More | Share it now!
Pivotal HD Automated Install with Ambari 2.1.2
http://pivotalhd.docs.pivotal.io/docs/install-ambari-212.html 1. Getting Ready This section describes the information and materials you should get ready to install a PHD cluster using Ambari. Ambari provides an end-to-end management and monitoring... Read More | Share it now!
hadoop的dfs.replication
首先 dfs.replication这个参数是个client参数，即node... Read More | Share it now!
Reset the maxlife of a kerberos ticket
http://stackoverflow.com/questions/27012033/reset-the-maxlife-of-a-kerberos-ticket-more-than-24h To change the max-lifetime of a ticket in kerberos from default 24 hrs to 5min follow the following steps: Add the max_life property to the... Read More | Share it now!
Install a new MIT KDC Kerberos
http://docs.hortonworks.com/HDPDocuments/Ambari-2.1.1.0/bk_Ambari_Security_Guide/content/_optional_install_a_new_mit_kdc.html Install a new MIT KDC The following gives a very high level description of the KDC installation process. To get... Read More | Share it now!
Hive Function Cheat Sheet
Hive Function Meta commands SHOW FUNCTIONS– lists Hive functions and operators DESCRIBE FUNCTION – displays short description of the function DESCRIBE FUNCTION EXTENDED – access extended description of the function Types of Hive... Read More | Share it now!