Learn Kubernetes Weekly issue 79

Basics of observing Kubernetes, From blue to green: EKS clusters upgrade, deeper dive of kube-scheduler, writing custom kubectl commands

15 May 2024

This newsletter is brought to you by StormForge — stop setting Kubernetes requests and limits. Leave it to machine learning and automation.

  1. The basics of observing Kubernetes: a bird-watcher's perspective

    Miguel Luna

    This detailed article discusses how and what to observe in a Kubernetes cluster.

    It focused on observing the infrastructure over observing applications, giving you a view from the perspective of a cluster administrator.

  2. An intro to autonomous cost optimization on Kubernetes

    Erwin Daria, Yofti Makonnen

    In this 3-part article, you will learn how to optimize your costs on Kubernetes using Karpenter and verify your findings with EKS-Node-Viewer.

    The articles explain some of the other tools you might want to consider (e.g. VPA) and their limitations.

    sponsored

  3. From blue to green: optimizing AWS EKS clusters upgrade

    Kareem Mohamed

    The article describes how OneFootball implemented AWS EKS cluster upgrades with a Blue/Green strategy, focusing on smooth transitions, risk reduction, and reliability.

  4. A deeper dive of kube-scheduler

    This article provides a deep dive into kube-scheduler, focusing on customizing preemption for ML workloads.

    Key topics covered include misconceptions, an overview of the scheduling framework, and a detailed explanation of default preemption.

  5. Vultr Kubernetes Engine (VKE) : pitfalls and shortcomings

    Jonathan

    In this article, the author reviews Vultr Kubernetes Engine (VKE) and notes its limitations, such as the "sub-user" issue with API keys.

    The article discusses VKE's autoscaling and compares it with EKS and GKE.

  6. How does kubectl work: writing custom kubectl commands

    Hasan Bingölbali

    The article explores how kubectl works, focusing on the authentication process and the REST API calls.

    It also provides a step-by-step guide on how to fork the Kubernetes repository and write your commands.

Articles worth checking out:

Autonomous rightsizing for Kubernetes workloads

StormForge

Double your Kubernetes resource utilization and unburden developers from sizing complexity with the industry's first HPA-compatible vertical pod rightsizing solution.

Try it for free

Autonomous rightsizing for Kubernetes workloads
  1. Intro to Kubernetes autoscaling and best practices for successful implementations

    Nikita

    Learn about the complexities and best practices of autoscaling in Kubernetes, including horizontal, vertical, and cluster scaling methods and advanced projects like Karpenter and KEDA.

    sponsored

  2. Monitoring a multi-cluster Kubernetes deployment

    Dan Dascalescu

    In this tutorial, you will learn how to aggregate data from various sources to achieve centralized real-time monitoring across multiple highly resilient clusters using Thanos.

  3. Getting started with Airflow: deploying your first pipeline on Kubernetes

    Rupert Arup

    The article provides a tutorial on deploying Airflow to Kubernetes using minikube, covering topics such as loading DAGs to Airflow and adding dependencies to the Airflow image.

    • 🔥 Software Engineer with Mercari

    • Salary: ¥4.8M to ¥6.34M a year

    • Location: remote from Japan

    • Tech stack: Kubernetes, AWS, GCP, Go, SQL, Javascript, Java, PHP, Swift, Kotlin

    • Site Reliability Engineer with Commify

    • Salary: £70K to £75K a year

    • Location: based in the office (and remote from home) in Nottingham, GB

    • Tech stack: Kubernetes, Azure, Shell, Python, Ruby, C#, Powershell, Terraform, Azure DevOps, Jenkins

    • Software Engineer with Monta

    • Salary: kr. 540K to kr. 660K a year

    • Location: based in the office (and remote from home) in Copenhagen, DK

    • Tech stack: Kubernetes, AWS, Docker, Java, Kotlin, Redis, MySQL, Grafana, Prometheus, Loki

    • DevOps Engineer with PressReader

    • Salary: US$110K to US$130K a year

    • Location: based in the office (and remote from home) in British Columbia, CA

    • Tech stack: Kubernetes, AWS, Azure, GCP, On-premise, ArgoCD, Docker, Openstack, Terraform, Azure DevOps

Discover more Kubernetes jobs on Kube Careers →

  1. Chart-testing: linting and testing charts

    ct is a tool for testing Helm charts.

    It is meant for linting and testing pull requests and automatically detects charts changed against the target branch.

  2. k'exp: Kubernetes explorer

    k'exp is for:

    • Learning and exploring Kubernetes capabilities.
    • Application development (object graph presets for every app).
    • Controller and operator development (dynamic object graphs).
    • Postman-like client and request builder for Kubernetes API.
  3. GitOps bridge

    GitOps Bridge is a community project that aims to showcase best practices and patterns for bridging the process of creating a Kubernetes cluster and subsequently managing everything through GitOps.

    It focuses on using ArgoCD or FluxCD.

  4. Goat: vulnerable by design

    Kubernetes Goat is a **Vulnerable by Design" cluster environment where you can learn and practice Kubernetes security using an interactive, hands-on playground.

  5. netfetch: scan Network Policies

    netfetch is a tool designed to scan Kubernetes namespaces for network policies and check whether a network policy targets your workloads.

Other interesting projects:

Upcoming Kubernetes events

  1. May

    22

    Kubernetes Community Days New York 2024

    In-person conference organized by KCD New York.

    • Location: New York, NY, USA

    • This event requires an entrance fee

      • Use LK8SINKCDNY2024 to get 10% off

  2. May

    20

    Advanced Kubernetes course (London)

    In-person workshop organized by Learnk8s.

    • Location: London, UK

    • This event requires an entrance fee

  3. May

    20

    DevOps Pro Europe

    Online & in-person conference organized by Data Miner.

    • Location: Vilnius, LT and virtual

    • This event requires an entrance fee

      • Use kube15%|doeu24 to get 15% off

  4. May

    22

    OpenInfra Day France

    In-person conference organized by OpenInfra Foundation.

    • Location: Paris, FR

    • This event requires an entrance fee

      • Use KUBE10 to get 10% off

  5. May

    16

    Understanding Amazon EKS blueprints with Amazon EKS add-ons for clusters

    Online meetup organized by AWS User Group Women Bay Area.

    • This is a virtual event

    • This is a free event.

Discover more Kubernetes events on Kube Events →

Kubernetes Call for Papers

  1. 12

    days

    KubeCon North America

    The Call For Paper is open until 10 June 2024 at UTC. More info →
    • Location: Salt Lake City, UT, USA and virtual

    • Online & in-person conference organized by Linux Foundation.

    • The conference starts on the 12 November 2024.

    • Apply here
  2. expired

    Kubernetes Community Days Lima, Perú 2024

    The Call For Paper was open until 16 May 2024 at UTC. More info →
    • Location: Lima, PE

    • In-person conference organized by KCD Lima, Perú.

    • The conference starts on the 20 July 2024.

    • Apply here
  3. expired

    KubeDay Japan

    The Call For Paper was open until 19 May 2024 at UTC. More info →
    • Location: Tokyo, JP

    • In-person conference organized by Linux Foundation.

    • The conference starts on the 27 August 2024.

    • Apply here
  4. 6

    days

    Kubernetes Community Days UK

    The Call For Paper is open until 4 June 2024 at UTC. More info →
    • Location: London, UK

    • In-person conference organized by KCD UK.

    • The conference starts on the 23 October 2024.

    • Apply here
  5. 5

    days

    Kubernetes Community Days Washington DC 2024

    The Call For Paper is open until 3 June 2024 at UTC. More info →
    • Location: Washington, DC, USA

    • In-person conference organized by KCD Washington DC.

    • The conference starts on the 24 September 2024.

    • Apply here
  6. 24

    days

    Kubernetes Community Days Austria 2024

    The Call For Paper is open until 22 June 2024 at UTC. More info →
    • Location: Vienna, AT

    • In-person conference organized by KCD Austria.

    • The conference starts on the 10 October 2024.

    • Apply here
  7. 16

    days

    CloudX 2024

    The Call For Paper is open until 14 June 2024 at UTC. More info →
    • Location: Santa Clara, CA, USA

    • In-person conference organized by DevNetwork.

    • The conference starts on the 5 November 2024.

    • Apply here
  8. expired

    KubeVirt Summit 2024

    The Call For Paper was open until 20 May 2024 at UTC. More info →
    • This is a virtual event

    • Online conference organized by KubeVirt.

    • The conference starts on the 25 June 2024.

    • Apply here
  9. expired

    Devopsdays London

    The Call For Paper was open until 24 May 2024 at UTC. More info →
    • Location: London, UK

    • In-person conference organized by Devopsdays.

    • The conference starts on the 26 September 2024.

    • Apply here

Until next time!

— Dan