Monthly Archives: November 2018

How to create schema containing list of objects using Avro?

You need to use array type for creating the list. Following is the updated schema that handles your usecase. { "name": "Parent", "type":"record", "fields": } } } ] } ... Read More | Share it now!

Apache NiFi – Records and Schema Registries

https://bryanbende.com/development/2017/06/20/apache-nifi-records-and-schema-registries Apache NiFi 1.2.0 and 1.3.0 have introduced a series of powerful new features around record processing. There have already been a couple of great blog posts... Read More | Share it now!

Python Script in NiFi

Short Description: A brief introduction to using Python inside NiFi to manipulate FlowFiles in stream using python.​ Article In NiFi the data being passed between operators is referred to as a FlowFile and can be accessed via various scripting... Read More | Share it now!

『NiFi 学习之路』入门 —— 下载、安装与简单使用

一、概述 “光说不练假把式。” 官网上的介绍多少让人迷迷糊糊的,各种高大上的词语仿佛让 NiFi 离我们越来越远。 实践是最好的老师。那就让我们试用一下 NiFi... Read More | Share it now!

rpm-maven-plugin

https://www.mojohaus.org/rpm-maven-plugin/index.html Caused by: java.io.IOException: Cannot run program "rpmbuild" (in directory "xxxx/SPECS"): error=2, No such file or directory Install rpmbuild on your OS: Centos: yum install rpm-build... Read More | Share it now!

disown 后台挂载

场景: 我们已经知道,如果事先在命令前加上 nohup 或者 setsid 就可以避免 HUP 信号的影响。但是如果我们未加任何处理就已经提交了命令,该如何补救才能让它避免 HUP... Read More | Share it now!

解决PKIX:unable to find valid certification path to requested target 的问题

MVN build 时候忽然遇到这样的异常: e: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested... Read More | Share it now!

MySQL Pretty Print in Command Line

I was looking for a better way to output mysql tables in console, and came across the following gem: mysql> pager less -SFX mysql> SELECT * FROM... Read More | Share it now!

Confluent介绍

https://www.cnblogs.com/zdfjf/p/5646525.html Confluent Quick Start: https://docs.confluent.io/3.0.0/quickstart.html#quickstart 最开始接触confluent是通过这篇博客,How to Build a Scalable ETL Pipeline with Kafka... Read More | Share it now!