Suvarna Garge (Editor)

BigQuery

Updated on
Edit
Like
Comment
Share on FacebookTweet on TwitterShare on LinkedInShare on Reddit
Available in
  
English

Registration
  
Required

Owner
  
Google

Type of site
  
Infrastructure as a service

Website
  
cloud.google.com/products/bigquery/

Launched
  
May 19, 2010; 6 years ago (2010-05-19)

BigQuery is a RESTful web service that enables interactive analysis of massively large datasets working in conjunction with Google Storage. It is an Infrastructure as a Service (IaaS) that may be used complementarily with MapReduce.

Contents

History

After a limited testing period in 2010, BigQuery was generally available in November 2011 at the Google Atmosphere conference. In 2014, MapR introduced the Apache Drill project, which was meant to solve similar problems. In April, 2016, European users of the service suffered a 12-hour outage. In May, 2016, support was announced for Google Sheets.

Design

BigQuery provides an external access to the Dremel technology, a scalable, interactive ad hoc query system for analysis of read-only nested data. To use the data in BigQuery, it first must be uploaded to Google Storage and in a second step imported using the BigQuery HTTP API. BigQuery requires all requests to be authenticated, supporting a number of Google-proprietary mechanisms as well as OAuth.

Features

  • Managing data - create and delete tables based on a JSON-encoded schema, import data encoded as CSV or JSON from Google Storage.
  • Query - the queries are expressed in a SQL dialect and the results are returned in JSON with a maximum reply length of approximately 64 MB. There are some limitations to the usual SQL queries. For example, BigQuery supports joins, but one of the two JOINed tables must be small enough or use the JOIN EACH keyword instead.
  • Integration - BigQuery can be used from Google Apps Script, Google Spreadsheets, or any language that can work with its REST API.
  • Access control - is possible to share datasets with arbitrary individuals, groups, or the world.

    • References

    BigQuery Wikipedia
    (Text) CC BY-SA


    Similar Topics