Serialization (Avro, Message Pack, Kryo)

SerializationAvro, Message Pack, Kryo

Han O Seok

What is Serialization?

What is Serialization?

Avro

• Apache Foundation

• JSON defineded Schema

Avro

• Created by Doug Cutting, the Creator of Hadoop

• Data is always accompanied by a schema- Support for dynamic typing-code generation is not required

Performance of Avro

• Avro is not the fastest, But is in the top half

Message Pack

• Rich data structures - JSON

• Interface Definition Language(IDL) - thrift

• Create Schema Based Annotaion

• RPC Sync, Async Support Event-Driven I/O

Format of Message Pack

Performance of Message Pack

Kryo

• Google Code

• Easy to Collect Serializers Case By Class

• Support Compression

• Kryo TCP & UDP client/server library

Benchmarking V2

• http://code.google.com/p/thrift-protobuf-compare/wiki/BenchmarkingV2

Thanks :)