Skip to content

Norman's Deep Dives

Lim Xing Kang Norman's adventures in data ingestion, processing and warehousing.

  • Home
  • About
  • Linkedin
  • Github

Category: minio

Cloud-Agnostic Big Data Processing with Kubernetes, Spark and Minio

In this article I will discuss how to build a cloud agnostic Big Data processing and storage solution running entirely in Kubernetes. This design avoids vendor lock-in by using only open-source technologies and avoiding cloud-managed products such as S3 and Amazon ElasticMapReduce in favour of MinIO and Apache Spark

frenoid AWS, kubernetes, minio, spark 1 Comment May 4, 2022 16 Minutes
Blog at WordPress.com.
  • Follow Following
    • Norman's Deep Dives
    • Already have a WordPress.com account? Log in now.
    • Norman's Deep Dives
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...