It’s a simple question, often asked by project managers, data scientists, and quality engineers on every data engineering project when that first data source is ingested. How do we know the data that has been ingested into a data lake is accurate and error-free?
On a recent project we were asked by a client if it would be possible to host a React app using serverless technologies, but also ensure that traffic never left their VPC and corporate network.
In this post I'm going to talk about how we achieved this outcome, and how it proved to be more of a challenge than we first thought it would be.
During my time with an energy company, I worked in a team which had a set of unicorn fairy lights. Jokingly I suggested that they should have individual RGB LEDs which could tell the status of the app, the weather and...
Homer Simpson as a radio Amateur[/caption]