Scheduling BigQuery jobs using Google Apps Script

Do you recoil in horror at the thought of running yet another mundane SQL script just so a table is automatically rebuilt for you each day in BigQuery? Can you barely remember your name first thing in the morning, let alone remember to click “Run Query” so that your boss gets the latest data refreshed in his fancy Data Studio charts, and then takes all the credit for your hard work?

Well, fear not my fellow BigQuery’ians. There’s a solution to this madness.

It’s simple.

It’s quick.

Yes, it’s Google Apps Script to the rescue.

Disclaimer: all credit for this goes to the one and only Felipe Hoffa. He ‘da man!

Triggering Dataflow Pipelines With Cloud Functions

Do you have an unreasonable fear of cronjobs? Find spinning up VMs to be a colossal waste of your towering intellect? Does the thought of checking a folder regularly for updates fill you with an apoplectic rage? If so, you should probably get some help. Maybe find another line of work.

In the meantime, here’s one way to ease your regular file processing anxieties. With just one application of Google Cloud Functions, eased gently up your Dataflow Pipeline, you can find lasting relief from troublesome cronjobs.

Performance Comparison Between Node.js and Java EE For Reading JSON Data from CouchDB

Nodejs

Node.js has impressed me several times with high performance right out of the box. In my last Node.js project it was the same: we beat the given performance targets without having to tweak the application at all. I never really experienced this in Java EE projects. Granted the project was perfectly suited for Node.js: a small project centered around fetching JSON documents from CouchDB. Still I wanted to know: how would Java EE compare to Node.js in this particular case? 

JavaOne 2013 Day Zero

The 18th JavaOne started this Sunday in San Francisco. Covering three hotels in downtown SF, Hilton, Parc55 and Nikkon and with keynotes in the Moscone Centre, Oracle OpenWorld is hands down the biggest conference I’ve ever attended.  It covers 5 days in total and over 500 sessions plus side exhibitions and events. And it certainly needs the room, not only to accommodate the number of attendees going to these sessions but the breadth of the platform itself.

Video of Marc Fasel’s Presentation at Web Directions Code 2013

Shine Technologies’ senior consultant Marc Fasel gave a presentation on asynchronous JavaScript with Node.js at this year’s Web Directions Code conference May 2-3. The title of the presentation is Put on Your Asynchronous Hat and Node, and the video is now available.

Web Directions Code 2013

logoThe second incarnation of the Web Directions Code conference was this year on 2.-3. May, and I was fortunate enough to both attend and speak. The conference held in Melbourne Town Hall was the place to geek out about all things web: JavaScript, HTML5, and CSS3.  More than 250 web professional turned up to learn about new directions the web is taking. In this blog I will summarise those talks that left the biggest impression on me.

Yow! Developer Conference Brisbane.

Yow! Brisbane 2011

I recently had the pleasure of attending the Brisbane Yow! Conference.  This was a great conference with talks to interest developers across many languages platforms and experience.

This blog is a summary of the more interesting talks that I attended and my thoughts on them.