BigQuery

BigQuery
Type of site
 Infrastructure as a service
Available in English
Owner Google
Website cloud.google.com/products/bigquery/
Registration Required
Launched May 19, 2010 (2010-05-19)
Current status Active

BigQuery is a RESTful web service that enables interactive analysis of massively large datasets working in conjunction with Google Storage. It is an Infrastructure as a Service (IaaS) that may be used complementarily with MapReduce.

History

After a limited testing period in 2010, BigQuery was generally available in November 2011 at the Google Atmosphere conference.[1] In 2014, MapR introduced the Apache Drill project, which was meant to solve similar problems.[2] In April, 2016, European users of the service suffered a 12-hour outage.[3] In May, 2016, support was announced for Google Sheets.[4]

Design

BigQuery provides external access to the Dremel technology,[5][6] a scalable, interactive ad hoc query system for analysis of read-only nested data. To use the data in BigQuery, it first must be uploaded to Google Storage and in a second step imported using the BigQuery HTTP API. BigQuery requires all requests to be authenticated, supporting a number of Google-proprietary mechanisms as well as OAuth.

Features

  • Managing data - create and delete tables based on a JSON-encoded schema, import data encoded as CSV or JSON from Google Storage.
  • Query - the queries are expressed in a standard SQL dialect[7] and the results are returned in JSON with a maximum reply length of approximately 128 MB, or an unlimited size when large query results are enabled.[8]
  • Integration - BigQuery can be used from Google Apps Script[9] (e.g. as a bound script in Google Docs), or any language that can work with its REST API or client libraries[10].
  • Access control - is possible to share datasets with arbitrary individuals, groups, or the world.

References

  1. ↑ Iain Thomson (November 14, 2011). "Google opens BigQuery for cloud analytics: Dangles free trial to lure doubters". Retrieved August 26, 2016.
  2. ↑ Neil McAllister (September 16, 2014). "Is your data boring? MapR wants you to bore it back with Apache Drill: New release adds support for Google-y SQL-on-Hadoop tech". Retrieved August 26, 2016.
  3. ↑ Simon Sharwood (April 7, 2016). "Google Euro-cloud glitch". Retrieved August 26, 2016.
  4. ↑ Jordan Novet (May 6, 2016). "Google BigQuery now lets you analyze data from Google Sheets". Retrieved August 26, 2016.
  5. ↑ Sergey Melnik; Andrey Gubarev; Jing Jing Long; Geoffrey Romer; Shiva Shivakumar; Matt Tolton; Theo Vassilakis (2010). "Dremel: Interactive Analysis of Web-Scale Datasets". Proc. of the 36th International Conference on Very Large Data Bases (VLDB).
  6. ↑ Kazunori Sato (2012). "An Inside Look at Google BigQuery" (PDF). Google. Retrieved August 26, 2016.
  7. ↑ "SQL Reference". Retrieved 26 June 2017.
  8. ↑ "Quota Policy". Retrieved 26 June 2017.
  9. ↑ "BigQuery Service | Apps Script | Google Developers". March 15, 2018. Retrieved April 23, 2018.
  10. ↑ "BigQuery Client Libraries". Retrieved 26 June 2017.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.