Learn Kubernetes Weekly issue 63

Video streaming at scale with Kubernetes and RabbitMQ, Reducing cloud costs by 30%, Don't name your EKS managed nodegroups, Cilium: decoding the packet path

24 Jan 2024

Articles

  1. Video streaming at scale with Kubernetes and RabbitMQ

    Alexandre Olive

    Learn how Skeepers utilizes Kubernetes and RabbitMQ for scalable, cost-efficient global video streaming, addressing video lifecycle, load management, and playback challenges.

  2. Discover how we managed to reduce our cloud costs by 30 percent

    Alexandre Olive

    In this case study, you'll learn how Skeepers cut their cloud costs by 30% saving 6,369€.

    Optimizations included right-sizing resources, implementing caching to reduce network egress fees, archiving redundant data, & optimizing the staging environment.

  3. Don't name your EKS managed nodegroups (unless you want to trigger an incident)

    Christian Alexánder Polanco Valdez

    Learn how naming AWS EKS NodeGroups can cause outages and deployment errors.

    This case study recounts Adevinta's experience and advises using autogenerated names, Pod Disruption Budgets, and the necessity of robust monitoring and continuous learning.

  4. Cilium: decoding the packet path with Security Groups for Pods in EKS

    Amit Gupta

    Containerized apps frequently require access to services running within and outside the cluster.

    In this article, you'll explore how Cilium can be used alongside the security groups for EKS pods when running in chaining mode.

  5. Manage Kubernetes Secrets with Crossplane and External Secrets

    Alex Souslik

    This article will teach you how to easily and securely store your Kubernetes secrets in AWS Secret Manager with Argo CD, Crossplane and External Secrets Operator.

  6. How to use eBPF capabilities to navigate Kubernetes monitoring

    Alex Tan

    In this article, you will learn how to monitor Kubernetes effectively using eBPF for kernel and network insights and leverage tools such as BPFTrace to inspect real-time pod performance.

Articles worth checking out:

Tutorials

  1. Collecting logs in Kubernetes with Vector: benefits, architecture, real cases

    Maksim Nabokikh

    In this tutorial (and related case studies), you will learn how to master Kubernetes log collection using Vector:

    1. Understand its setup
    2. Troubleshoot disk/memory challenges
    3. Explore practical solutions.

  2. Trying out the EKS Pod Identity Agent

    Daniel Tapia

    Traditionally, EKS pods inherit the node's IAM role, contradicting least privilege principles by sharing one IAM role across multiple pods on the same node.

    You can now use the EKS Pod Identity Agent to enable specific role assumption for pods.

  3. How to setup self hosted GitHub action runner on Kubernetes

    Akshay Gopani

    This tutorial teaches you how to set up cost-effective self-hosted GitHub Action runners with custom hardware configurations for enhanced security and compliance.

    You'll also find out how to configure the HorizontalRunnerAutoscaler.

  4. Setting up a GitOps workflow with Argo CD and GitHub Actions

    Arsh Sharma

    This tutorial teaches how to automate updates from commits to live Kubernetes clusters, with Argo CD facilitating change tracking, security, rollbacks, and auto synchronization.

  5. Argo events: how to synchronize GCP secret manager with Kubernetes secrets

    Christian Del Monte

    This tutorial teaches you how to use Argo Events to synchronize GCP Secret Manager secrets with Kubernetes.

Kubernetes jobs

    • Platform Engineer with Smartsheet

    • Salary: $135K to $213.3K a year

    • Location: remote from the United States

    • Tech stack: Kubernetes, AWS, Azure, GCP, Go, Python, Ruby, Terraform

    • Site Reliability Engineer with Ecosio

    • Salary: €51K a year

    • Location: remote from Austria

    • Tech stack: Kubernetes, AWS, GCP, ArgoCD, Docker, Go, Shell, Python, SQL, Java

    • Data Engineer with Numberly

    • Salary: €16.8K to €20.4K a year

    • Location: remote from France

    • Tech stack: Kubernetes, Docker, Python, SQL, Spark, Airflow, Hadoop, Kafka

Discover more Kubernetes jobs on Kube Careers →

Code & tools

  1. Kubernetes Resource Recommender

    Kubernetes Resource Recommender is a CLI tool for optimizing resource allocation in Kubernetes clusters.

    It gathers pod usage data from Prometheus and recommends requests and limits for CPU and memory.

    This reduces costs and improves performance.

  2. Kubernetes scheduler plugins

    This repository contains a list of additional plugins for the Kubernetes scheduler:

    • Capacity Scheduling
    • Coscheduling
    • Node Resources
    • Node Resource Topology
    • Preemption Toleration
    • Trimaran
    • Network-Aware Scheduling

  3. Troubleshoot: Kubernetes diagnostics

    Troubleshoot is a framework for collecting and analyzing diagnostic information about a Kubernetes cluster.

    The customizable framework allows third-party application developers to create troubleshooting specs that cluster operators can run.

  4. eks-multi-cluster-gitops

    This repo contains the implementation of a multi-cluster GitOps system on EKS.

  5. GoNoGo

    GoNoGo is a utility to help users determine upgrade confidence around Kubernetes cluster add-ons.

Other interesting projects:

Upcoming Kubernetes events

  1. Jan

    29

    NDC London 2024

    In-person conference organized by NDC Conferences.

    • Location: London, UK

    • This event requires an entrance fee

  2. Jan

    25

    Advanced Kubernetes course

    Online workshop organized by Learnk8s.

    • This is a virtual event

    • This event requires an entrance fee

  3. Jan

    25

    DevOps 2024

    Online conference organized by Conf42.

    • This is a virtual event

    • This is a free event.

  4. Jan

    31

    Open LLMS on GKE: llama 2 and beyond

    Online webinar organized by Google.

    • This is a virtual event

    • This is a free event.

  5. Jan

    25

    Kubectl apply -f cloud-infrastructure.yaml with Crossplane et al.

    Online meetup organized by Platform Engineers Bangalore.

    • This is a virtual event

    • This is a free event.

Discover more Kubernetes events on Kube Events →

Kubernetes Call for Papers

  1. expired

    Kubernetes Community Days Costa Rica 2024

    The Call For Paper was open until 1 February 2024 at UTC. More info →

    • Location: Heredia, CR

    • In-person conference organized by KCD Costa Rica.

    • The conference starts on the 1 March 2024.

    • Apply here

  2. expired

    Kubernetes Community Days Romania 2024

    The Call For Paper was open until 31 January 2024 at UTC. More info →

    • Location: Bucharest, RO

    • In-person conference organized by KCD Romania.

    • The conference starts on the 25 April 2024.

    • Apply here

  3. expired

    Kubernetes Community Days Texas 2024

    The Call For Paper was open until 5 February 2024 at UTC. More info →

    • Location: Irving, TX, USA

    • In-person conference organized by KCD Texas.

    • The conference starts on the 12 April 2024.

    • Apply here

  4. expired

    Kubernetes Community Days Istanbul

    The Call For Paper was open until 31 January 2024 at UTC. More info →

    • Location: Istanbul, TR

    • In-person conference organized by KCD Istanbul.

    • The conference starts on the 15 May 2024.

    • Apply here

  5. expired

    Kubernetes Community Days Munich 2024

    The Call For Paper was open until 31 January 2024 at UTC. More info →

    • Location: Munich, DE

    • In-person conference organized by KCD Munich.

    • The conference starts on the 2 July 2024.

    • Apply here

  6. expired

    KubeHuddle Toronto 2024

    The Call For Paper was open until 3 February 2024 at UTC. More info →

    • Location: Toronto, CA

    • In-person conference organized by KubeHuddle.

    • The conference starts on the 8 May 2024.

    • Apply here

  7. expired

    Kubernetes Community Days New York 2024

    The Call For Paper was open until 12 February 2024 at UTC. More info →

    • Location: New York, NY, USA

    • In-person conference organized by KCD New York.

    • The conference starts on the 22 May 2024.

    • Apply here

  8. expired

    CloudNativeSecurityCon North America

    The Call For Paper was open until 1 April 2024 at UTC. More info →

    • Location: Seattle, WA, USA

    • In-person conference organized by Linux Foundation.

    • The conference starts on the 26 June 2024.

    • Apply here

  9. expired

    DevOps Pro Europe

    The Call For Paper was open until 15 April 2024 at UTC. More info →

    • Location: Vilnius, LT and virtual

    • Online & in-person conference organized by Data Miner.

    • The conference starts on the 20 May 2024.

    • Apply here

Until next time!

— Dan

Subscribe and, every Wednesday, receive the latest Kubernetes news!

Or follow us on: