Learn Kubernetes Weekly issue 101

100k Docker and 44k Kubernetes deploys, Building resilient applications, Stateful apps in Kubernetes, Do Docker containers share ram?

16 Oct 2024

This newsletter is brought to you by DigitalOcean — unlock the Power of AI with GPUs on DigitalOcean Kubernetes

Articles

1. How we made self-hosting plane a breeze for 100k Docker and 44k Kubernetes deploys

   Learn how Plane made self-hosting a seamless experience for over 100,000 Docker and 445,000 Kubernetes deployments, overcoming challenges with file uploads, user authentication, and migrations.

2. GPU-enabled worker nodes are now available for DigitalOcean Kubernetes

   Diane Hannay

   Access the infrastructure and tools you need for the entire cloud and AI development lifecycle, empowering businesses of all sizes to harness AI and machine learning within Kubernetes environments.

   sponsored

3. Building resilient applications on Kubernetes

   Amila De Silva

   By configuring proper health probes, handling pod termination gracefully, and defining pod disruption budgets, you can reduce downtimes and improve application stability.

   Check out the article for details.

4. Stateful apps in Kubernetes: from history and fundamentals to operators

   By Oleg Saprykin, software engineer

   Learn what you should consider before running stateful components apps in Kubernetes, how these apps work in Kubernetes, and which operators we use for ClickHouse, Redis, Kafka, PostgreSQL, and MySQL.

5. Do Docker containers share ram for files memory mapped from the same layer but a different image?

   Philip Couling

   This question explores how Docker images are created in a layered file system, using copy-on-write for shared libraries stored in physical RAM, and how files are shared between container-based processes via an overlay file system.

6. Monitor GPU nodes in AWS

   Roaming Roadster

   Learn how to track memory allocation and usage on GPU nodes in EKS to prevent memory bottlenecks and discover how to use CloudWatch to monitor GPU metrics.

Articles worth checking out:

• Reducing EKS Windows node 5 min start time to ~90s

• Ephemeral Volume emptyDir backed on EC2 Instance Store NVMe

• You are NOT tackling your infra costs (public cloud and Kubernetes) comprehensively

• Karpenter: why slow is better

• Crossplane is Underrated

• Mastering Kubebuilder v4

• Using ARG in a Dockerfile: beware the gotcha

• Cilium: Network Policies

• Kubernetes policy management engine — Kyverno

• Integrating Cilium with Gateway API, IPv6, and BGP for advanced networking solutions

Migrate to DigitalOcean Kubernetes

DigitalOcean

Thousands of businesses run on DigitalOcean today, achieving top performance and unmatched scalability at significant cost savings.

With DigitalOcean Kubernetes, you can easily spin up GPU-powered environments, scale workloads, and optimize performance with a developer-friendly approach.

See how much you could save

Tutorials

1. Running Meta Llama on DigitalOcean Kubernetes with NVIDIA NIM

   Jack Pearce

   Discover how to run NVIDIA NIMS on DigitalOcean Kubernetes in this step-by-step demo.

   You will learn to deploy a large language model, Meta Llama 3.1, on an NVIDIA H100 GPU with DigitalOcean Kubernetes.

   sponsored

2. Amazon EKS: etcd monitoring and alerting using Container Insights

   Marcin Cuber

   This article provides a step-by-step guide on monitoring and alerting EKS control-plane metrics, including ETCD and APIserver, using Terraform and CloudWatch.

3. Signing and verifying ECR images using Cosign and Kyverno

   Vinayak Pandey

   This article guides you through the process of signing and verifying container images using Cosign and Kyverno.

   It covers the installation of Kyverno and Cosign and provides a step-by-step guide on securing CI/CD pipelines for production deployment.

4. K8sGPT + Ollama: a free Kubernetes automated diagnostic solution

   Addo Zhang

   This tutorial guides you through setting up K8sGPT with Ollama for automated Kubernetes diagnostics and demonstrates how to deploy and configure k8sgpt-operator for automated analysis.

Kubernetes jobs

1. • Software Engineer with HeartFlow, Inc

   • Salary: $133.86K to $200.03K a year

   • Location: remote from the United States

   • Tech stack: Kubernetes, AWS, GCP, Docker, Python, C++, GitHub Actions

2. • DevSecOps Engineer with Uniswap Labs

   • Salary: $264K to $294K a year

   • Location: based in the office in New York, NY, USA

   • Tech stack: Kubernetes, AWS, Azure, GCP, Docker, Python, Javascript, Java

3. • Software Engineer with HeartFlow, Inc

   • Salary: $108K to $181.48K a year

   • Location: remote from the United States

   • Tech stack: Kubernetes, AWS, Docker, Python, C++, Terraform, GitHub Actions, Ansible, Chef

4. • Solution Engineer with Veeam Software

   • Salary: $171.9K to $245.5K a year

   • Location: remote from the United States

   • Tech stack: Kubernetes, AWS, Azure, On-premise, SQL, DynamoDB

5. • Engineering Manager with Defense Unicorns

   • Salary: $165K to $245K a year

   • Location: remote from the United States

   • Tech stack: Kubernetes, AWS, Azure, GCP, Kustomize, Helm, Terraform, Pulumi

Discover more Kubernetes jobs on Kube Careers →

Code & tools

1. metal3-io/baremetal-operator

   The Bare Metal Operator implements a Kubernetes API for managing bare metal hosts.

   It maintains an inventory of available hosts as instances of the BareMetalHost Custom Resource Definition.

2. Kubernetes Resource Recommender

   Kubernetes Resource Recommender is a CLI tool for optimizing resource allocation in Kubernetes clusters.

   It gathers pod usage data from Prometheus and recommends requests and limits for CPU and memory.

   This reduces costs and improves performance.

3. k0smotron

   k0smotron allows you to create and manage clusters in an existing Kubernetes cluster easily.

   This allows unparalleled scalability and flexibility when working with many clusters.

4. Sealed secrets

   Sealed Secrets provides declarative Kubernetes Secret Management in a secure way.

   Since the Sealed Secrets are encrypted, they can be safely stored in a code repository.

5. Kubernetes Secrets Store CSI Driver

   kubernetes-sigs

   The Secrets Store CSI Driver allows Kubernetes to mount multiple secrets, keys, and certs stored in enterprise-grade external secrets stores into their pods as a volume.

   Once the Volume is attached, its data is mounted into the container's file system.

Other interesting projects:

• Multi pod and container log tailing

• CRD to sample YAML

• Disk Auto-Scaler

• GitOps InstallPlan Approver

• Duplicate kubectl plugin

Upcoming Kubernetes events

1. Oct

   23

   Kubernetes Community Days UK

   In-person conference organized by KCD UK.

   • Location: London, UK

   • This event requires an entrance fee

2. Oct

   21

   Advanced Kubernetes course (San Francisco)

   In-person workshop organized by Learnk8s.

   • Location: San Francisco, CA, USA

   • This event requires an entrance fee

3. Oct

   23

   Hands-on workshop on Karpenter: cost-efficiency and reliability

   In-person meetup organized by Cloud Native Melbourne.

   • Location: Melbourne, AU

   • This is a free event.

4. Oct

   17

   Optimize your databases on Kubernetes with this one weird filesystem trick

   Online webinar organized by Ardan Labs.

   • This is a virtual event

   • This is a free event.

5. Oct

   17

   Optimizing database management in Kubernetes

   Online meetup organized by Devops Columbia.

   • This is a virtual event

   • This is a free event.

Discover more Kubernetes events on Kube Events →

Kubernetes Call for Papers

1. expired

   Dutch Cloud Native Day 2024

   The Call For Paper was open until 31 October 2024 at UTC. More info →

   • Location: Amsterdam, NL

   • In-person conference organized by Cloud Native Amsterdam.

   • The conference starts on the 10 December 2024.

   • Apply here

2. expired

   KubeCon + CloudNativeCon Europe 2025

   The Call For Paper was open until 25 November 2024 at UTC. More info →

   • Location: London, UK

   • In-person conference organized by Linux Foundation.

   • The conference starts on the 1 April 2025.

   • Apply here

3. expired

   Tech Internals Conf

   The Call For Paper was open until 1 November 2024 at UTC. More info →

   • Location: Berlin, DE

   • In-person conference organized by TIC.

   • The conference starts on the 27 February 2025.

   • Apply here

4. expired

   DevSecOps 2024

   The Call For Paper was open until 4 November 2024 at UTC. More info →

   • This is a virtual event

   • Online conference organized by Conf42.

   • The conference starts on the 5 December 2024.

   • Apply here

5. expired

   Cybersec Asia 2025

   The Call For Paper was open until 30 November 2024 at UTC. More info →

   • Location: Bangkok, TH

   • In-person conference organized by Cybersec Asia.

   • The conference starts on the 29 January 2025.

   • Apply here

6. 25

   days

   Devopsdays Zurich

   The Call For Paper is open until 15 January 2025 at UTC. More info →

   • Location: Zurich, CH

   • In-person conference organized by Devopsdays.

   • The conference starts on the 12 March 2025.

   • Apply here

7. expired

   Devopsdays Chicago

   The Call For Paper was open until 20 October 2024 at UTC. More info →

   • Location: Chicago, IL, USA

   • In-person conference organized by Devopsdays.

   • The conference starts on the 18 March 2025.

   • Apply here

8. expired

   RuhrSec 2025

   The Call For Paper was open until 10 November 2024 at UTC. More info →

   • Location: Bochum, DE

   • In-person conference organized by Hackmanit.

   • The conference starts on the 21 February 2025.

   • Apply here

9. 16

   days

   QCon London

   The Call For Paper is open until 7 January 2025 at UTC. More info →

   • Location: London, UK

   • In-person conference organized by InfoQ.

   • The conference starts on the 7 April 2025.

   • Apply here

Until next time!

— Dan

Subscribe and, every Wednesday, receive the latest Kubernetes news!