Learn Kubernetes Weekly issue 96

Network topology in a non-intrusive way, etcd should not exceed 8GB, KubeAdmiral, etcd and data inconsistency, swapping disks

11 Sept 2024

This newsletter is brought to you by LoxiLB - eBPF based cloud-native load-balancer. Powering Kubernetes|Edge|5G|IoT|XaaS Apps.

  1. Building a network topology of a Kubernetes application in a non-intrusive way

    Ilya Shakhat

    The article discusses building a network topology for a Kubernetes application using eBPF and the Linux kernel in a non-intrusive way.

  2. LoxiLB cluster networking: elevating Kubernetes networking capabilities

    Nikhil Malik

    In this article, you'll explore how LoxiLB provides load balancing, service discovery, security, and endpoint health monitoring features.

    Its eBPF-based data-path core engine operates in the Linux kernel and focuses on enforcing network policies, tracking and tracing network connections, and more.

    sponsored

  3. Why does the etcd community suggest that the database size should not exceed 8GB?

    ByteCook

    Learn why the etcd community recommends limiting the database size to 8GB.

    Discover how to analyze where time is spent and understand the impact of large database sizes on latency.

  4. How to Enable etcd to Support Kubernetes Clusters with Tens of Thousands of Nodes?

    ByteCook

    This article discusses enabling etcd to support Kubernetes clusters with tens of thousands of nodes.

    It explains that etcd uses a Copy-on-Write mechanism to implement its MVCC database, which can lead to frequent querying and writing of larger objects.

  5. KubeAdmiral: next-generation multi-cluster orchestration engine based on Kubernetes

    XIAOXU CHANG

    This article covers KubeAdmiral, a multi-cluster orchestration engine.

    It supports native Kubernetes resources, FederatedDeployment, and FederatedReplicaSet and offers dynamic weight scheduling based on real-time cluster resource utilization.

  6. Why does etcd, based on Raft implementation, still experience data inconsistency?

    ByteCook

    In this article, you will learn how etcd can experience data inconsistency in a Kubernetes cluster, nodes can disappear, and data can be lost.

    The data corruption detection feature of etcd can be enabled to prevent such issues.

Articles worth checking out:

Open source, unified Load Balancer for hyper-scale communication

LoxiLB

LoxiLB turns Kubernetes network load balancing into high-speed, flexible and programmable LB services.

It is open source and primarily designed to power on-premise, edge and public-cloud Kubernetes apps.

Learn more

Open source, unified Load Balancer for hyper-scale communication
  1. Securing multi-cluster ArgoCD

    This article discusses a multi-cluster ArgoCD setup, where a centralized ArgoCD instance manages multiple remote clusters.

    The remote clusters are secured using a short-lived token, which is a service that provides identity and authentication services.

  2. How to deploy loxilb with multi-cloud HA support

    LoxiLB

    The tutorial explains how to deploy loxilb with multi-cloud HA support to deliver seamless traffic distribution across multiple cloud providers, ensuring high availability and automatic failover.

    sponsored

  3. Managing Kubernetes Secrets dynamically from Vault via External Secrets Operator

    Samet Arslantürk

    This article explores how to manage Kubernetes secrets dynamically using HashiCorp Vault and the External Secret Operator.

    You'll learn how to create and manage external secrets on a namespace or global basis.

  4. Grant Kubernetes pods access to AWS services using OpenID Connect

    Meysam

    Learn how to grant Kubernetes pods access to AWS services using OpenID Connect, including setting up the necessary environment variables and configuring the OIDC provider.

    • Software Engineer with Sezzle

    • Salary: TRY 540K to TRY 780K a year

    • Location: remote from Turkey

    • Tech stack: Kubernetes, AWS, Go, Javascript, MySQL, Gitlab, Grafana, Prometheus, Loki

    • Systems Performance Engineer with Hostinger

    • Salary: €42K a year

    • Location: based in the office (and remote from home) in Kaunas / Vilnius, LT

    • Tech stack: Kubernetes, On-premise, Docker, Go, Shell, Python, Terraform, Ansible

    • Software Engineer with Grafana Labs

    • Salary: $148.51K to $178.21K a year

    • Location: remote from the United States

    • Tech stack: Kubernetes, Azure, GCP, Go, SQL, Javascript, Typescript, SQL Server, Grafana Mimir, Grafana

    • System Administrator with Entain

    • Salary: €50K a year

    • Location: based in the office (and remote from home) in Wien, AT

    • Tech stack: Kubernetes, Docker, Shell, Python, Javascript, Powershell, Cassandra, Mongo, Redis, Kafka

Discover more Kubernetes jobs on Kube Careers →

  1. JET pilot: Kubernetes IDE

    unxsist

    JET Pilot is an open-source Kubernetes IDE.

    Features:

    • Real-time Logs.
    • Kubernetes Object Management.
    • Container Shell.
    • Command Palette.
  2. Bottlerocket images cache

    aws-samples

    Bottlerocket-images-cache is a tool that reduces the image pull time of Bottlerocket instances by caching container images in an EBS snapshot.

    It is built by leveraging the data volume of Bottlerocket OS.

  3. Tanka: YAML alternative

    Grafana Tanka is a clean, concise and super flexible alternative to YAML for your Kubernetes cluster.

  4. Kube-green: automatic scaler

    Kube-green is a simple k8s addon that automatically shuts down (some of) your resources when you don't need them.

  5. Helmify: convert YAML into charts

    Helmify is a command-line tool that converts Kubernetes YAML files to Helm charts.

    It is designed for operator charts but can also be used for other purposes.

Other interesting projects:

Upcoming Kubernetes events

  1. Sept

    11

    Balancing Cost and Reliability on Amazon EKS with Karpenter and StormForge

    Online workshop organized by StormForge.

    • This is a virtual event

    • This is a free event.

  2. Sept

    18

    Open Source Summit Europe

    In-person conference organized by Linux Foundation.

    • Location: Vienna, AU

    • This event requires an entrance fee

  3. Sept

    18

    Towards standardized volumes: transitioning Odin's volume management to Kubernetes

    In-person meetup organized by Cloud Native Aarhus.

    • Location: Aarhus, DK

    • This is a free event.

  4. Sept

    18

    GPUs in Kubernetes: past, present, and future

    Online meetup organized by Platformers Community.

    • This is a virtual event

    • This is a free event.

  5. Sept

    18

    Deep dive into DNS on Linux and Kubernetes

    Online webinar organized by Ardan Labs.

    • This is a virtual event

    • This is a free event.

  6. Sept

    19

    Advanced Kubernetes course

    Online workshop organized by Learnk8s.

    • This is a virtual event

    • This event requires an entrance fee

Discover more Kubernetes events on Kube Events →

Kubernetes Call for Papers

  1. expired

    Kubernetes Community Days Denmark 2024

    The Call For Paper was open until 16 September 2024 at UTC. More info →
    • Location: Copenhagen, DK

    • In-person conference organized by KCD Denmark.

    • The conference starts on the 20 November 2024.

    • Apply here
  2. expired

    Dutch Cloud Native Day 2024

    The Call For Paper was open until 31 October 2024 at UTC. More info →
    • Location: Amsterdam, NL

    • In-person conference organized by Cloud Native Amsterdam.

    • The conference starts on the 10 December 2024.

    • Apply here
  3. expired

    Kubernetes Community Days Floripa Brasil 2024

    The Call For Paper was open until 16 September 2024 at UTC. More info →
    • Location: São Paulo, BR

    • In-person conference organized by KCD Brasil.

    • The conference starts on the 6 December 2024.

    • Apply here
  4. expired

    Cloud Technology Townhall Tallinn 2025

    The Call For Paper was open until 15 September 2024 at UTC. More info →
    • Location: Tallinn, EE

    • In-person conference organized by Cloud Technology Townhall Tallinn.

    • The conference starts on the 31 January 2025.

    • Apply here
  5. expired

    Tech Internals Conf

    The Call For Paper was open until 1 November 2024 at UTC. More info →
    • Location: Berlin, DE

    • In-person conference organized by TIC.

    • The conference starts on the 27 February 2025.

    • Apply here
  6. expired

    DevSecOps 2024

    The Call For Paper was open until 4 November 2024 at UTC. More info →
    • This is a virtual event

    • Online conference organized by Conf42.

    • The conference starts on the 5 December 2024.

    • Apply here
  7. expired

    QCon San Francisco

    The Call For Paper was open until 18 September 2024 at UTC. More info →
    • Location: San Francisco, CA, USA

    • In-person conference organized by InfoQ.

    • The conference starts on the 18 November 2024.

    • Apply here
  8. 7

    days

    Cybersec Asia 2025

    The Call For Paper is open until 30 November 2024 at UTC. More info →
    • Location: Bangkok, TH

    • In-person conference organized by Cybersec Asia.

    • The conference starts on the 29 January 2025.

    • Apply here
  9. expired

    Shipped24

    The Call For Paper was open until 14 September 2024 at UTC. More info →
    • This is a virtual event

    • Online conference organized by Octopus Deploy.

    • The conference starts on the 20 November 2024.

    • Apply here

Until next time!

— Dan

Subscribe and, every Wednesday, receive the latest Kubernetes news!

Or follow us on: