I once again had the opportunity to head to Snowflake’s world tour in Sydney, and thought I would take the time to summarise some of the things I took away from the conference. If you're interested in what I thought last year, you can read...
Anyone who has used GenAI coding assistants knows they can be extremely helpful in some scenarios, but offer only incremental improvements in others. In my consulting role as GM of Engineering at Shine, I’ve worked with clients across various industries who are working to cut...
It's no secret that when it comes to building data platforms, I've spent a fair amount of time building cloud provider native solutions, both in AWS and GCP. So when I saw that Snowflake had a conference showcasing all their latest and greatest features, I...
The Shine attendees (from left to right): Doug Hagan, Tyrus Caldeira and Michael Leroy After a massive week of announcements, AWS re:Invent is all done and dusted for 2023, so it’s time for a recap on how it was from myself and the two other Shiners...
It’s a simple question, often asked by project managers, data scientists, and quality engineers on every data engineering project when that first data source is ingested. How do we know the data that has been ingested into a data lake is accurate and error-free?
Recently I worked on a personal project to help support the Linux distro I use as a daily driver, Manjaro. I set up a package mirror to allow users from the community to connect to my server and pull updates or new packages for install....
There is no mistaking that we are currently living in very strange times. We have a duty to our friends, colleagues and fellow Australians....
Cloudflare Dev Workshop 2020 In mid-February, I had the privilege to attend the first Melbourne Cloudflare dev event. This was just one of a series of sessions they ran across the country to reach out to developers and help educate people around their thinking and the...
Out at Shine's various client sites, our teams often meet to discuss the pros and cons of various technical solutions. And in the past, there was one particular Shine manager who, if he was in attendance, would regularly pipe up and ask the question: what's the problem we're actually trying to solve?