Build a Data Lake with Trino, Kubernetes, Helm, and Glue

How to create a Data Lake in AWS using S3 as the storage layer, Glue as the metastore, and Trino on Kubernetes as the query engine.

How to use Presto to query an AWS MySQL RDS instance

We will discuss how to use a multi node Presto cluster to query data in an AWS MySQL RDS instance

How to create a multi-node Presto cluster on AWS EC2

What's wrong with a single node Presto cluster? In a previous post, I created a single-node Presto cluster where the coordinator and worker processes run on the same node. That's a bad idea in large clusters. Processing work on the coordinator can starve the coordinator process of resources and negatively impact scheduling work and monitoring … Continue reading How to create a multi-node Presto cluster on AWS EC2 →

Creating a Presto Cluster on EC2

Today, I am going to create a Presto cluster on an AWS EC2 instance. I am aware of AWS ElasticMapReduce, Amazon's Managed Hadoop offering but since this is a technical exercise to learn about Presto internals, we're going to do things the hard way 🙂 Prerequisites I assume you have some technical knowledge, namely Working … Continue reading Creating a Presto Cluster on EC2 →

Welcome to Norman’s Presto Adventures

I'm working in the tech industry and in a company where Presto is used extensively both for interactive data analysis and ETL. It's a fantastic tool that's performant in interactive data analysis and scales to processing Petabytes of data (if you build it right)