Apache ORC

Apache ORC (Optimized Row Columnar) is a free and open-source column-oriented data storage format of the Apache Hadoop ecosystem. It is similar to the other columnar-storage file formats available in the Hadoop ecosystem such as RCFile and Parquet. It is compatible with most of the data processing frameworks in the Hadoop environment.

Apache ORC
Initial release20 February 2013 (2013-02-20)[1]
Stable release
1.6.0 / 3 September 2019 (2019-09-03)[2]
RepositoryORC Repository
Operating systemCross-platform
TypeDatabase management system
LicenseApache License 2.0
Websitehttps://orc.apache.org/

In February 2013, the Optimized Row Columnar (ORC) file format was announced by Hortonworks in collaboration with Facebook.[3] A month later, the Apache Parquet format was announced, developed by Cloudera and Twitter.[4]

Comparison

Apache ORC is comparable to RCFile and Parquet file formats---all three fall under the category of columnar data storage within the Hadoop ecosystem. They all have better compression and encoding with improved read performance at the cost of slower writes.

See also

References

  1. "The Stinger Initiative: Making Apache Hive 100 Times Faster". Retrieved Jan 1, 2019.
  2. "Releases".
  3. Alan Gates (February 20, 2013). "The Stinger Initiative: Making Apache Hive 100 Times Faster". Hortonworks blog. Retrieved Dec 31, 2018.
  4. Justin Kestelyn (March 13, 2013). "Introducing Parquet: Efficient Columnar Storage for Apache Hadoop". Cloudera blog. Archived from the original on September 19, 2016. Retrieved May 4, 2017.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.