Author Archives: Huang Shiyang

试用AWS的Lambda和API Gateway

http://blog.csdn.net/aws0to1/article/details/46990313   目标 使用Lambda和API gateway搭建一个HTTP API,返回文本信息 步骤 在Lambda中创建python函数 函数名 helloWorld 函数体: import json print('Loading... Read More | Share it now!

Exception in thread “main” org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /testtxt. could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s) are excluded in this operation.

Issue: When you upload a file to HDFS, you may encounter following exception. Exception: Exception in thread “main” org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /testtxt. could only be replicated to 0 nodes instead of... Read More | Share it now!

MapReduce:详解Shuffle过程

http://langyu.iteye.com/blog/992916   Shuffle过程是MapReduce的核心,也被称为奇迹发生的地方。要想理解MapReduce,... Read More | Share it now!

[转]利用IntelliJ IDEA与Maven开始你的Scala之旅

转自:https://www.jianshu.com/p/ecc6eb298b8f   一. IntelliJ IDEA安装及配置 1.1 IntelliJ IDEA下载及安装 首先在 CHOOSE YOUR EDITION... Read More | Share it now!

linux日志显示too many open files解决

某linux服务器的日志每隔几天就会报错。内容如下: ERROR ipnet.dc.pmprobe.SnmpScalarQueryJoe.execute()(146) – Too many open files       java.net.SocketException: Too many open files 向同事咨询了一下,一般报Too... Read More | Share it now!

Script to install jenkins on ubuntu

echo "START" >> /tmp/status.txt sudo chmod 777 /tmp/status.txt # config jenkins installer on ubuntu sudo add-apt-repository ppa:webupd8team/java -y wget -q -O - https://pkg.jenkins.io/debian/jenkins.io.key | sudo apt-key add - # config java8... Read More | Share it now!

Creating gCloud instance with Terraform

main.tf // Create a new instance resource "google_compute_instance" "default" { name = "${var.cluster-name}" machine_type = "${var.machine-type}" zone = "${var.gcloud-zone}" boot_disk { initialize_params { ... Read More | Share it now!

避免’sudo echo x >’ 时’Permission denied’

http://blog.csdn.net/hejinjing_tom_com/article/details/7767127 避免’sudo echo x >’ 时’Permission denied’ 甲: 示例 sudo echo a > 1.txt -bash: 1.txt: Permission denied 乙: 分析: bash... Read More | Share it now!

Installing Java Automatically (With Silent Option)

Auto agree with licence. https://askubuntu.com/questions/190582/installing-java-automatically-with-silent-option If OpenJDK/OpenJRE works fine for you, I recommend using that package instead as suggested by @SAM. However, some software really... Read More | Share it now!