Cascading Avro Tap performance
March 18, 2011
Back in January, Matt Pouttu-Clarke posted his results from using the Cascading Avro tap we’d created a while back.
The most interesting result was comparing performance between parsing CSV files and reading Avro files:
Time to parse files (shorter is better)
13.5x faster is a nice improvement over the very common practice of using text files for information exchange.
Side note: we recently released the 1.0 version, and pushed it to the Conjars repository.