Search
11 Aug Automating Your Dismissal With BigQuery
Using only one simple python script you too can run up an enormous bill in Google’s BigQuery and gain the animosity of your employer! Read on to find out more (SPOILER: I didn’t get fired)
21 Jun Filling the BigQuery paddling pool from the Kinesis Hosepipe
Introduction This blog post details how we solved the problem of analysing large amounts of HTTP request logs for one of our clients. Spoiler: we used Amazon’s Kinesis and Lambda to stream the data into Google’s BigQuery for analysis. Read on for the juicy details!
30 Mar Creating a serverless ETL nirvana using Google BigQuery
Quite a while back, Google released two new features in BigQuery. One was federated sources. A federated source allows you to query external sources, like files in Google Cloud Storage (GCS), directly using SQL. They also gave us user defined functions (UDF) in that release too. Essentially, a UDF...07 May Shiners interviewed on Google Developer Channel about BigQuery at Telstra
Shiners Luke Alexander and Graham Polley have appeared on the Google Developer Channel discussing the work done by Shine at Telstra using Google’s BigQuery. Having publicly challenged BigQuery to query a 30TB dataset, Luke and Graham were invited to San Francisco last month to film...24 Mar Shine to film Google Developer Channel spot on BigQuery
Shiners Luke Alexander and Graham Polley are currently in San Francisco to film a spot for the Google Developers channel and attend Google Cloud Platform Live. Graham’s recent post on our work with Google BigQuery at Telstra attracted the attention of Felipe Hoffa, Developer Programs Engineer at BigQuery. This...
18 Jan Reeling in Big Data Using Google’s BigQuery
Introduction For me, Jaws is hands down one of the best movies ever made. It’s almost 40 years old but it still looks fantastic and the acting is phenomenal. And it’s able to boast one of the most memorable ad-libs ever quipped by any actor on...