Hortonworks Error Log 2014-05-20 17:29:32,242 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:lpinsight (auth:SIMPLE) cause:java.io.IOException: Filesystem closed 2014-05-20 17:29:32,243 WARN... Read More | Share it now!
Tag Archives: hadoop
hive的数据导入与数据导出：（本地，云hdfs，hbase），列分隔符的设置
hive表的数据源有四种： hbase hdfs 本地 其他hive表 而hive表本身有两种: 内部表和外部表。 而hbase的数据在hive中，可以建立对应的外部表（参看hive和hbase整合） 内部表和外部表 区别：删除时，内部表删除hadoop上的数据；而外部表不删，其数据在外部存储，hive表只是查看数据的形式，看时从外部读入数据: 内部表：CREATETABLE... Read More | Share it now!
Hive中添加自定义udf udaf udtf等函数的jar文件的三种方法
在开发了hive的udf udaf udtf函数的jar文件后，需要将jar文件放入hive的环境中才可以使用。可以通过以下三种方法加入： 1. 使用add jar... Read More | Share it now!
Pivotal HD Automated Install with Ambari 2.1.2
http://pivotalhd.docs.pivotal.io/docs/install-ambari-212.html 1. Getting Ready This section describes the information and materials you should get ready to install a PHD cluster using Ambari. Ambari provides an end-to-end management and monitoring... Read More | Share it now!
hadoop的dfs.replication
首先 dfs.replication这个参数是个client参数，即node... Read More | Share it now!
Reset the maxlife of a kerberos ticket
http://stackoverflow.com/questions/27012033/reset-the-maxlife-of-a-kerberos-ticket-more-than-24h To change the max-lifetime of a ticket in kerberos from default 24 hrs to 5min follow the following steps: Add the max_life property to the... Read More | Share it now!
kinit
kinit SYNOPSIS kinit -k -t /etc/security/keytabs/hdfs.headless.keytab hdfs@KBR.DG kinit ] ] DESCRIPTION kinit obtains and caches an initial ticket-granting ticket for principal. OPTIONS -V display verbose output. -l... Read More | Share it now!
Install a new MIT KDC Kerberos
http://docs.hortonworks.com/HDPDocuments/Ambari-2.1.1.0/bk_Ambari_Security_Guide/content/_optional_install_a_new_mit_kdc.html Install a new MIT KDC The following gives a very high level description of the KDC installation process. To get... Read More | Share it now!
Hive Function Cheat Sheet
Hive Function Meta commands SHOW FUNCTIONS– lists Hive functions and operators DESCRIBE FUNCTION – displays short description of the function DESCRIBE FUNCTION EXTENDED – access extended description of the function Types of Hive... Read More | Share it now!
“add jar” command throws “Insufficient privileges to execute add” exception even for admin role
https://issues.apache.org/jira/browse/SENTRY-147 0: jdbc:hive2://......:10000/default> add jar /home/direp_hv_qa/satish/hive-udf-7.jar; Error: Insufficient privileges to execute add (state=42000,code=0) java.sql.SQLException: Insufficient... Read More | Share it now!