Skip to content

Huang Shiyang

Shawn's TechBlog

Month: November 2018

avro

How to create schema containing list of objects using Avro?

Huang Shiyang November 29, 2018

You need to use array type for creating the list. Following is the updated schema that handles your usecase. { "name": "Parent", "type":"record", "fields": } } } ] } ... Read More | Share it now!

MySQL

Mysql 高可用(HA)

Huang Shiyang November 28, 2018

1、Mysql... Read More | Share it now!

nifi, Schema Registry

Apache NiFi – Records and Schema Registries

Huang Shiyang November 28, 2018

https://bryanbende.com/development/2017/06/20/apache-nifi-records-and-schema-registries Apache NiFi 1.2.0 and 1.3.0 have introduced a series of powerful new features around record processing. There have already been a couple of great blog posts... Read More | Share it now!

nifi

Python Script in NiFi

Huang Shiyang November 28, 2018

Short Description: A brief introduction to using Python inside NiFi to manipulate FlowFiles in stream using python.​ Article In NiFi the data being passed between operators is referred to as a FlowFile and can be accessed via various scripting... Read More | Share it now!

nifi

『NiFi 学习之路』入门 —— 下载、安装与简单使用

Huang Shiyang November 27, 2018November 27, 2018

一、概述 “光说不练假把式。” 官网上的介绍多少让人迷迷糊糊的,各种高大上的词语仿佛让 NiFi 离我们越来越远。 实践是最好的老师。那就让我们试用一下 NiFi... Read More | Share it now!

Maven

rpm-maven-plugin

Huang Shiyang November 27, 2018November 29, 2018

https://www.mojohaus.org/rpm-maven-plugin/index.html Caused by: java.io.IOException: Cannot run program "rpmbuild" (in directory "xxxx/SPECS"): error=2, No such file or directory Install rpmbuild on your OS: Centos: yum install rpm-build... Read More | Share it now!

linux

disown 后台挂载

Huang Shiyang November 21, 2018November 21, 2018

场景: 我们已经知道,如果事先在命令前加上 nohup 或者 setsid 就可以避免 HUP 信号的影响。但是如果我们未加任何处理就已经提交了命令,该如何补救才能让它避免 HUP... Read More | Share it now!

Java, Maven

解决PKIX:unable to find valid certification path to requested target 的问题

Huang Shiyang November 15, 2018

MVN build 时候忽然遇到这样的异常: e: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested... Read More | Share it now!

MySQL

MySQL Pretty Print in Command Line

Huang Shiyang November 14, 2018

I was looking for a better way to output mysql tables in console, and came across the following gem: mysql> pager less -SFX mysql> SELECT * FROM... Read More | Share it now!

Schema Registry

Confluent介绍

Huang Shiyang November 12, 2018November 12, 2018

https://www.cnblogs.com/zdfjf/p/5646525.html Confluent Quick Start: https://docs.confluent.io/3.0.0/quickstart.html#quickstart 最开始接触confluent是通过这篇博客,How to Build a Scalable ETL Pipeline with Kafka... Read More | Share it now!

  • 1
  • 2
  • >

Search

Tags

angularjs avro aws build cassandra centos command docker git github google cloud hadoop hive hortonworks hostname install cluster iptables jar java javascript json kafka kerberos kubernetes linux mac mapr mapreduce mongodb mysql nginx nodejs npm Prometheus python RabbitMQ raspberry pi redis schema shell ssl time ubuntu vi yum

Categories

  • 3d printer
  • Android
  • AngularJS
  • ansible
  • avro
  • AWS
  • C++
  • cassandra
  • CICD
  • Cloud
  • Database
  • Dataguise
  • Django
  • Docker
  • EC2
  • elasticsearch
  • express
  • Game
  • github
  • golang
  • Google Cloud
  • Google Map
  • Hadoop
  • helm
  • hexo
  • Hive
  • IOS
  • Java
  • Javascript
  • jekyll
  • jenkins
  • Kafka
  • kubernetes
  • linux
  • Log
  • Mac
  • Maven
  • Mongodb
  • MySQL
  • networking
  • nginx
  • nifi
  • Nodejs
  • Photoshop
  • PHP
  • Pig
  • prometheus
  • Python
  • RabbitMQ
  • raspberry pi
  • redis
  • Scala
  • Schema Registry
  • sublime
  • tenserflow
  • terraform
  • testing
  • TFS
  • Uncategorized
  • website
  • windows
  • 杂篇
November 2018
M T W T F S S
 1234
567891011
12131415161718
19202122232425
2627282930  
« Oct   Dec »

Recent Posts

  • How to trigger a Kubernetes cronjob manually
  • python终止线程
  • python2 python3 hash() function
  • htop
  • Fakeapp

Archives

  • January 2021
  • December 2020
  • November 2020
  • October 2020
  • September 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
  • April 2020
  • March 2020
  • December 2019
  • November 2019
  • October 2019
  • September 2019
  • August 2019
  • July 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • January 2019
  • December 2018
  • November 2018
  • October 2018
  • September 2018
  • August 2018
  • July 2018
  • June 2018
  • May 2018
  • April 2018
  • March 2018
  • February 2018
  • January 2018
  • December 2017
  • November 2017
  • October 2017
  • September 2017
  • August 2017
  • July 2017
  • May 2017
  • April 2017
  • March 2017
  • February 2017
  • January 2017
  • December 2016
  • October 2016
  • September 2016
  • August 2016
  • July 2016
  • June 2016
  • May 2016
  • April 2016
  • March 2016
  • February 2016
  • January 2016
  • December 2015
  • November 2015
  • October 2015
  • September 2015
  • August 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • March 2015

Count per Day

  • 603120Total reads:
  • 403748Total visitors:
  • 108Visitors today:
  • 0Visitors currently online:

Meta

  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org
Proudly powered by WordPress | Theme: Amadeus by Themeisle.