I once again had the opportunity to head to Snowflake’s world tour in Sydney, and thought I would take the time to summarise some of the things I took away from the conference. If you're interested in what I thought last year, you can read...
It's no secret that when it comes to building data platforms, I've spent a fair amount of time building cloud provider native solutions, both in AWS and GCP. So when I saw that Snowflake had a conference showcasing all their latest and greatest features, I...
It’s a simple question, often asked by project managers, data scientists, and quality engineers on every data engineering project when that first data source is ingested. How do we know the data that has been ingested into a data lake is accurate and error-free?
On a recent project we were asked by a client if it would be possible to host a React app using serverless technologies, but also ensure that traffic never left their VPC and corporate network.
In this post I'm going to talk about how we achieved this outcome, and how it proved to be more of a challenge than we first thought it would be.
