Google Cloud Platform – BigQuery

BigQuery and BigTable are Google’s equivalents of SQL for Big Data and a corresponding database. Here’s an example of a BigQuery statement:

logs.datetime: ”2017-07-08T13:51:03″
logs.type: “workflow”
logs.message: “Commencing ETL”

apps.name: “enricher_bl842sr”
apps.log_type: “workflow”

You can run this query:

select logs.datetime, logs.type, logs.message, apps.name
from logs inner join apps on logs.type = apps.log_type
where logs.datetime > “2017-07-01T00:00:00” and logs.datetime < “2017-07-02T00:00:00”
group by apps.name;

BigQuery and BigTable can be a great transition for develops to switch from open source to Google’s ecosystem. I highly encourage everyone to play with it in GCP!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s