Learn Kubernetes Weekly issue 76

GKE: one bad probe away from disaster, Resource Management using NRI, migrating Kafka to Kubernetes, EKS for running medium-sized workloads in HA

24 Apr 2024

This newsletter is brought to you by StormForge — stop setting Kubernetes requests and limits. Leave it to machine learning and automation.

  1. GKE multi-cluster services : one bad probe away from disaster

    Dan Williams

    Loveholidays faced an outage due to an undocumented issue with readiness probes in GKE Multi-Cluster Services.

    In this article, you will follow their journey into investigating the issue and the action taken to prevent it from happening in the future.

  2. An intro to autonomous cost optimization on Kubernetes

    Erwin Daria and Yofti Makonnen

    Balancing app performance with cost efficiency requires continuous and automatic resource optimization.

    Learn why Kubernetes is not natively designed for resource efficiency and how to implement a suite of tools to achieve it.

    sponsored

  3. Customizing Kubernetes Resource Management using NRI

    Feruzjon Muyassarov

    In this article, you'll learn the intricacies of customizing Kubernetes resource management through the Node Resource Interface (NRI).

    This interface is a cross-runtime extension mechanism, letting you integrate custom resource assignment algorithms.

  4. How to deploy a highly-available application on Kubernetes

    Ewere Diagboya

    This article covers how to deploy a highly available application by looking at the following:

    • Pod Replicas
    • PodAntiAffinity
    • Deployment Strategy
    • Graceful Termination
    • Probes
    • Resource Allocation
    • Scaling
    • PodDisruptionBudget
  5. Seamless transition: migrating Kafka cluster to Kubernetes

    Rui (Frankie) Chen

    In this case study, you will learn how the Zendesk team migrated their Kafka cluster on EC2 to Kubernetes with zero downtime and incidents.

  6. Architecting Amazon EKS for high availability and resilience for running medium-sized workloads.

    Rohit Raj

    This article presents some cluster, node, and application design ideas for running small and medium-sized workloads efficiently and cost-effectively in an EKS cluster.

Articles worth checking out:

Autonomous rightsizing for Kubernetes workloads

StormForge

Double your Kubernetes resource utilization and unburden developers from sizing complexity with the industry's first HPA-compatible vertical pod rightsizing solution.

Autonomous rightsizing for Kubernetes workloads
  1. No restarts, no disruptions: seamless pod resource updates with In-Place Resizing

    Chimbu Chinnadurai

    Kubernetes v1.27 introduces InPlacePodVerticalScaling, allowing seamless pod resource resizing without restarts.

    This feature enhances efficiency, reduces downtime, and offers cost savings.

    Learn how to use it in this tutorial.

  2. Enforcing cluster policy with Open Policy Agent

    Chuk Lee

    In this tutorial, you will learn how to set up the Open Policy Agent to evaluate queries against a set of policies.

    • Software Engineer with Boba Commodities

    • Salary: £110K to £120K a year

    • Location: based in the office (and remote from home) in London, GB

    • Tech stack: Kubernetes, AWS, Python, SQL, Javascript, C#, Flink, Airflow, Kafka, Terraform

    • DevOps Engineer with Madwire

    • Salary: $100K to $160K a year

    • Location: remote from the United States

    • Tech stack: Kubernetes, AWS, GCP, Go, Python, Javascript, Terraform, Pulumi, CircleCI, GitHub Actions

    • DevSecOps Engineer with Monta

    • Salary: kr. 52K to kr. 64K a year

    • Location: based in the office (and remote from home) in Copenhagen, DK

    • Tech stack: Kubernetes, AWS, ArgoCD, PHP, Kotlin, GitHub Actions, Sentry, Grafana Mimir, Grafana, OpenSearch

    • DevOps Engineer with Voltron Data

    • Salary: $175K to $205K a year

    • Location: fully remote

    • Tech stack: Kubernetes, AWS, Azure, GCP, Bare-metal, Docker, Shell, Python, C++, Terraform

Discover more Kubernetes jobs on Kube Careers →

  1. Cloud Development Kit for Kubernetes

    cdk8s is an open-source software development framework for defining Kubernetes applications and reusable abstractions using familiar programming languages and rich object-oriented APIs.

  2. Claudie: managing multi-cloud and hybrid-cloud

    Claudie is a platform for managing multi-cloud Kubernetes clusters with each node pools in a different cloud provider.

  3. Kamaji: control plane manager

    Kamaji is a tool aimed to build and operate a Managed Kubernetes Service with a fraction of the operational burden.

    With Kamaji, you can deploy and operate hundreds of Kubernetes clusters as a hyper-scale cloud provider.

  4. pv-migrate: migrate persistent volumes

    pv-migrate is a CLI tool/kubectl plugin to easily migrate the contents of one Kubernetes PersistentVolumeClaim to another.

  5. gVisor: application kernel for containers

    gVisor is an application kernel written in Go that implements a subset of the Linux system surface.

    It includes an Open Container Initiative (OCI) runtime called runsc that provides an isolation boundary between the application and the host kernel.

Other interesting projects:

Upcoming Kubernetes events

  1. Apr

    25

    Kubernetes Community Days Romania 2024

    In-person conference organized by KCD Romania.

    • Location: Bucharest, RO

    • This is a free event.

  2. Apr

    29

    One Summit

    In-person conference organized by Linux Foundation.

    • Location: San Jose, CA, USA

    • This event requires an entrance fee

  3. Apr

    25

    Reducing container cold start-time up to 95% for large container images

    Online webinar organized by Ardan Labs.

    • This is a virtual event

    • This is a free event.

  4. Apr

    25

    Optimize cost on Amazon EKS with Karpenter and StormForge

    Online workshop organized by StormForge.

    • This is a virtual event

    • This is a free event.

  5. Apr

    27

    Accelerating ran deployment: by hook, by crook, or by Kubernetes & bee-hind the scenes: eBPF

    In-person meetup organized by Cloud Native Security India.

    • Location: Delhi, IN

    • This is a free event.

Discover more Kubernetes events on Kube Events →

Kubernetes Call for Papers

  1. expired

    KubeCon China

    The Call For Paper was open until 5 May 2024 at UTC. More info →
    • Location: Hong Kong, HK

    • In-person conference organized by Linux Foundation.

    • The conference starts on the 21 August 2024.

    • Apply here
  2. expired

    KubeCon North America

    The Call For Paper was open until 10 June 2024 at UTC. More info →
    • Location: Salt Lake City, UT, USA and virtual

    • Online & in-person conference organized by Linux Foundation.

    • The conference starts on the 12 November 2024.

    • Apply here
  3. expired

    Kubernetes Community Days Lima, Perú 2024

    The Call For Paper was open until 16 May 2024 at UTC. More info →
    • Location: Lima, PE

    • In-person conference organized by KCD Lima, Perú.

    • The conference starts on the 20 July 2024.

    • Apply here
  4. expired

    KubeDay Japan

    The Call For Paper was open until 19 May 2024 at UTC. More info →
    • Location: Tokyo, JP

    • In-person conference organized by Linux Foundation.

    • The conference starts on the 27 August 2024.

    • Apply here
  5. expired

    Kubernetes Community Days UK

    The Call For Paper was open until 4 June 2024 at UTC. More info →
    • Location: London, UK

    • In-person conference organized by KCD UK.

    • The conference starts on the 23 October 2024.

    • Apply here
  6. expired

    Devopsdays Ukraine: let's talk security

    The Call For Paper was open until 4 May 2024 at UTC. More info →
    • This is a virtual event

    • Online conference organized by Devopsdays.

    • The conference starts on the 4 June 2024.

    • Apply here
  7. expired

    CloudX 2024

    The Call For Paper was open until 14 June 2024 at UTC. More info →
    • Location: Santa Clara, CA, USA

    • In-person conference organized by DevNetwork.

    • The conference starts on the 14 November 2024.

    • Apply here
  8. expired

    KubeVirt Summit 2024

    The Call For Paper was open until 20 May 2024 at UTC. More info →
    • This is a virtual event

    • Online conference organized by KubeVirt.

    • The conference starts on the 25 June 2024.

    • Apply here
  9. expired

    Civo Navigate Europe 2024

    The Call For Paper was open until 7 May 2024 at UTC. More info →
    • Location: Berlin, DE

    • In-person conference organized by Civo.

    • The conference starts on the 10 September 2024.

    • Apply here

Until next time!

— Dan

Subscribe and, every Wednesday, receive the latest Kubernetes news!

Or follow us on: