Skip to content

Huang Shiyang

Shawn's TechBlog

Tag: schema

avro, Python

Avro Schema python serialize and deseralize

Huang Shiyang January 22, 2019

Seralize and Deseralize avro data with schema ahead import avro.schemafrom avro.datafile import DataFileReader, DataFileWriterfrom avro.io import DatumReader, DatumWriter, BinaryDecoder, BinaryEncoderimport ioclass panAvroDataSchem: def dReader... Read More | Share it now!

avro, Java

Java读写avro例子

Huang Shiyang January 2, 2019January 4, 2019

https://www.cnblogs.com/fillPv/p/5009737.html avro是一个数据序列化框架,可以高效得进行序列化和反序列化,支持C, C++, C#, Java, PHP, Python,... Read More | Share it now!

avro

How to create schema containing list of objects using Avro?

Huang Shiyang November 29, 2018

You need to use array type for creating the list. Following is the updated schema that handles your usecase. { "name": "Parent", "type":"record", "fields": } } } ] } ... Read More | Share it now!

Schema Registry

Installing a local Hortonworks Registry to use

Huang Shiyang November 7, 2018November 9, 2018

https://community.hortonworks.com/articles/119766/installing-a-local-hortonworks-registry-to-use-wit.html Objective This tutorial walks you through how to install and setup a local Hortonworks Registry to interact with Apache NiFi. Environment This... Read More | Share it now!

avro

AVRO 规范-Schema的定义和声明

Huang Shiyang August 24, 2015August 24, 2015

参考自http://avro.apache.org/docs/current/spec.html Avro... Read More | Share it now!

Search

Tags

angularjs avro aws build cassandra centos command docker git github google cloud hadoop hive hortonworks hostname install cluster iptables jar java javascript json kafka kerberos kubernetes linux mac mapr mapreduce mongodb mysql nginx nodejs npm Prometheus python RabbitMQ raspberry pi redis schema shell ssl time ubuntu vi yum

Categories

  • 3d printer
  • Android
  • AngularJS
  • ansible
  • avro
  • AWS
  • C++
  • cassandra
  • CICD
  • Cloud
  • Database
  • Dataguise
  • Django
  • Docker
  • EC2
  • elasticsearch
  • express
  • Game
  • github
  • golang
  • Google Cloud
  • Google Map
  • Hadoop
  • helm
  • hexo
  • Hive
  • IOS
  • Java
  • Javascript
  • jekyll
  • jenkins
  • Kafka
  • kubernetes
  • linux
  • Log
  • Mac
  • Maven
  • Mongodb
  • MySQL
  • networking
  • nginx
  • nifi
  • Nodejs
  • Photoshop
  • PHP
  • Pig
  • prometheus
  • Python
  • RabbitMQ
  • raspberry pi
  • redis
  • Scala
  • Schema Registry
  • sublime
  • tenserflow
  • terraform
  • testing
  • TFS
  • Uncategorized
  • website
  • windows
  • 杂篇
January 2021
M T W T F S S
 123
45678910
11121314151617
18192021222324
25262728293031
« Dec    

Recent Posts

  • How to trigger a Kubernetes cronjob manually
  • python终止线程
  • python2 python3 hash() function
  • htop
  • Fakeapp

Archives

  • January 2021
  • December 2020
  • November 2020
  • October 2020
  • September 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
  • April 2020
  • March 2020
  • December 2019
  • November 2019
  • October 2019
  • September 2019
  • August 2019
  • July 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • January 2019
  • December 2018
  • November 2018
  • October 2018
  • September 2018
  • August 2018
  • July 2018
  • June 2018
  • May 2018
  • April 2018
  • March 2018
  • February 2018
  • January 2018
  • December 2017
  • November 2017
  • October 2017
  • September 2017
  • August 2017
  • July 2017
  • May 2017
  • April 2017
  • March 2017
  • February 2017
  • January 2017
  • December 2016
  • October 2016
  • September 2016
  • August 2016
  • July 2016
  • June 2016
  • May 2016
  • April 2016
  • March 2016
  • February 2016
  • January 2016
  • December 2015
  • November 2015
  • October 2015
  • September 2015
  • August 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • March 2015

Count per Day

  • 603128Total reads:
  • 403751Total visitors:
  • 111Visitors today:
  • 0Visitors currently online:

Meta

  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org
Proudly powered by WordPress | Theme: Amadeus by Themeisle.