Google Cloud Platform – BigQuery

BigQuery and BigTable are Google’s equivalents of SQL for Big Data and a corresponding database. Here’s an example of a BigQuery statement:

logs.datetime: ”2017-07-08T13:51:03″
logs.type: “workflow”
logs.message: “Commencing ETL” “enricher_bl842sr”
apps.log_type: “workflow”

You can run this query:

select logs.datetime, logs.type, logs.message,
from logs inner join apps on logs.type = apps.log_type
where logs.datetime > “2017-07-01T00:00:00” and logs.datetime < “2017-07-02T00:00:00”
group by;

BigQuery and BigTable can be a great transition for develops to switch from open source to Google’s ecosystem. I highly encourage everyone to play with it in GCP!

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s