Writing

Thoughts on IT/OT, AWS, and software engineering

# Scaling Terraform Across many Teams: A Native Framework for Platform Engineering

Scaling Terraform Across 50+ Teams: A Native Framework for Platform Engineering TL;DR: A...

Redesigning This Blog (While Writing About It)

A meta-journey through redesigning a blog's layout - avoiding AI design clichés and building something with actual character

The Hidden Dangers in Our Software Supply Chain: Why It's Bigger Than You Think

In today's fast-paced digital world, software powers everything from the apps on our phones to the...

Why Debian packages are safer then NPM and PyPi

In the world of software development, package repositories are critical for distributing libraries...

Setting Up IOMete: A Cloud-Independent Data Platform Based on Spark

IOMete is a powerful, cloud-independent data platform built on Apache Spark, designed to enable...

DUCKDB, S3 Tables with iceberg using Iceberg Rest API

I wrote my previous article about Duckberg, a combination of PyIceberg with Duckdb to access iceberg...

Duckberg!

I wrote a previous small blog about PyIceberg and Glue iceberg Rest Api This week is saw the...

Collibra Protect , Snowflake and Iceberg tables

Iceberg is gaining traction, and Collibra is expanding its presence as a data governance tool,...

AWS Glue vulnerabilities in default packages

Securing AWS Glue: A Guide to Identifying and Fixing Python Package Vulnerabilities ...

Glue SBOM inspector

Glue SBOM exporter and inspector

Unity Catalog Iceberg Rest Api and PyIceberg

Access Unity tables via the Iceberg Rest Api After working with glue catalog in the...

Unity Iceberg Rest Api and PyIceberg

Using the Unity iceberg rest api with pyiceberg

Re:invent 2024 News

reinvent 24 news

Glue Iceberg Rest Api and PyIceberg

Access Glue Iceberg tables via the Iceberg Rest Api AWS Released silently Iceberg REST-API...

Glue Iceberg Rest Api and PyIceberg

Using the glue iceberg rest api with pyiceberg

Infrastructure Efficiency: The Hidden Environmental Impact of AWS's Latest Announcements

Discover how AWS's latest infrastructure updates, particularly the expansion of Graviton4 processors and R8g instances, are quietly revolutionizing cloud computing sustainability. Learn about real-world performance improvements, cost reductions, and environmental benefits of these strategic changes.

The Human Touch in Digital Transformation: Beyond Just Technology

An architect's perspective on AWS's latest customer experience innovations, including Amazon Connect's AI capabilities and Polly's new synthetic voices. Discover how these technologies are making digital interactions more natural while improving efficiency and customer satisfaction.

The Silent Revolution in Disaster Recovery: How AWS is Changing the Game

Explore how AWS's new zonal shift capabilities and Security Incident Response features are transforming traditional disaster recovery. This technical deep-dive reveals how automatic failover, self-healing systems, and integrated security responses are making DR more reliable and cost-effective than ever before.

The Database Evolution: Breaking Free from Monolithic Thinking

A technical analysis of AWS's latest database innovations, from Aurora's Graviton4 support to OpenSearch Serverless improvements. Learn how these changes are reshaping data architecture patterns and enabling more efficient, distributed database systems with real-world implementation strategies.

Bridging Clouds: A Guide to Connecting AWS Glue Tables with Snowflake

In today's data-driven world, organizations often find themselves working with multiple cloud...

Glue SBOM exporter and vulnerabilities

Glue SBOM exporter and vulnerabilities

Sustainability on AWS

Sustainability is the new topic on AWS. While it has a lot in common with FinOps, it adds emphasis to...

Re:invent 2023 News

reinvent 23 news

Purge a glue table from cli

Sometimes you want to purge a glue table from s3 and delete all files and versions. Lately i had to...

Data Engineering and ChatGPT (Part2)

In my previous post i must have hit some issue with ChatGPT. It's way more impressive then i...

Data Engineering and ChatGPT

ChatGPT is out and everybody is trying it. Blogs, songs are easy, but can it help with Data...

Re:invent 2022 Releases sorted

An overview of all the releases sorted per group. This re:invent was very focused on Data &...

New EC2 Models re:invent 2022

AWS Released 5 new EC2 models in Re:invent 2022. Hereby an...

Re:invent 2022 Releases sorted

Re:invent 2022 Releases sorted

Python and modules for ETL jobs on AWS

Python and modules for ETL jobs on AWS

Overview of the features released for Step Functions

At the Dutch AWS Community Day 2022, i held the following talk. An overview of all the features...

AWSUG.nl talk about Step Functions

AWSUG.nl Communityday talk about Step Functions with the overview of the released features

Secrets and AWS GLUE Custom Connectors

For a project i had to retrieve data from Teradata using a Glue Job. A quick google gave me this:...

AWSUG.nl talk about EventBridge

AWSUG.nl talk about EventBridge with the overview of the released features

AWS Sagemaker Canvas Remove

How to remove AWS Sagemaker Canvas

Docker on Mac with Colima

Use the free alternative Colima to run docker on mac

AWS Community Builder

Part of the AWS Community Builders Program

AWS Links 2 Eventbridge

AWS Links 2 Eventbridge

CDK Day 2022

CDK Day 26 May 2022

Votes and Views Part 1

Votes and Views Part 1

AWS Tools / Resources Part 1

Make your Jupyter Notebook/IPython full width

Make your Jupyter Notebook/IPython full width

Make your Jupyter Notebook/IPython full width

Learning with AWS Workshops

Overview AWS Workshops

Maker's Schedule, Manager's Schedule

Maker's Schedule, Manager's Schedule and why they don't combine.

Autocomplete IAM in vscode

Autocomplete IAM in vscode

AWS Glue with custom Python libraries

Using external python modules in AWS Glue

An ON-AIR sign with IoT

Building an sign with iot to show when you are in a meeting"