Learn Kubernetes Weekly issue 93

Decoding CPU utilization, Observability at the edge, configuration in container registries, comparing multi-tenancy options, Seccomp deep dive

21 Aug 2024

This newsletter is brought to you by CLASTIX — making Kubernetes cluster management boring for SREs.

Articles

1. The art of system debugging  —  decoding CPU utilization

   Emmanuel Livingstone

   Learn how to debug CPU utilization issues in a Java app using asynchronous programming techniques like CompletableFuture.

   Discover how to identify and resolve CPU bottlenecks using JVM arguments and container resource allocation.

2. Observability at the edge

   Brian Chambers

   Chick-fil-A operates 2,800 Edge Kubernetes clusters in restaurants, manages 100k+ IoT devices, and collects billions of MQTT messages.

   To address these challenges, they use Vector, an open-source tool for building observability pipelines.

3. The raise of hosted control plane in Kubernetes

   Adriano Pezzuto

   This article argues that the increasing demand for Kubernetes clusters requires a shift to multicluster deployments and an innovative Hosted Control Plane architecture.

   sponsored

4. Advantages of storing configuration in container registries rather than Git

   Brian Grant

   Learn how storing configuration in container registries over Git can address the scalability, performance, and reliability and leverage policy enforcement capabilities to verify and enforce image properties.

5. Optimize your Kubernetes resources with Azure IAM: managed vs. workload identity

   Artem Lajko

   Learn how to fine-grain access control in Azure Kubernetes clusters using Identity and Access Management (IAM) and Azure Managed Identities.

   Understand how service principals work and how to create and configure them for specific purposes.

6. Comparing multi-tenancy options in Kubernetes

   Learn how to set up a shared Kubernetes platform for multiple teams or projects and understand the challenges associated with it, such as managing network policies, RBAC controls, and data protection.

Articles worth checking out:

• Optimize applications with performance configuration testing

• CRI-O: applying seccomp profiles from OCI registries

• Seccomp internals deep dive

• Intro to Kubernetes API Extensions

• The trend for immutable systems in Linux

• Implementing scalable GitOps with Argo CD and ApplicationSets: a case study

• Comparing k8s load balancers

• Start pods faster by prefetching images

• How to approach intermittent DNS issue in EKS

• Optimize AKS load balancing: upgrading to IP-Address pool management

Build a Managed Kubernetes Service in less than 30 mins

Clastix

Book a demo with Dario from CLASTIX, who will enlight you on the challenges of managing a fleet of Kubernetes clusters and how the innovative Hosted Control Plane architecture can give chill time to your SRE department.

Meet Dario

Tutorials

1. Writing custom Prometheus exporters (in Python)  for  Kubernetes

   Daniel Stankowski

   This article explains how to write custom Prometheus exporters in Python.

   You'll learn about the different types of metrics, such as Counter, and how Exporters convert application-formatted metrics to Prometheus metrics for consumption.

2. Overcoming EKS limitations with Kamaji on AWS

   Dario Tranchitella

   Amazon EKS has several limitations: Kamaji can help you overcome these, maintaining the same ease of a managed service thanks to its Auto-Pilot feature.

   sponsored

3. Managing many Helm charts with kluctl

   Impressum

   Multiple solutions are available for managing your (and all third-party) Helm Charts and Kustomizing deployments.

   Examples are Flux, Argo CD, Helmfile and Kluctl.

   This article focuses on Kluctl and compares it with the other options.

4. Simplify generative AI model development on Kubernetes with Datashim

   Alessandro Pomponio

   Datashim is an open-source project that simplifies data access management on Kubernetes using CRDs and CSI drivers.

   Discover how to set up a staging inference server that uses the latest available checkpoint and a prod server with the stable version.

5. Setting up AWS WAF with Nginx Ingress Controller in Kubernetes

   Benn Simon

   Learn how to set up AWS WAF with Nginx Ingress Controller in Kubernetes.

   This guide covers the steps to integrate AWS WAF, including creating a target group and updating the Kubernetes Service type to ClusterIP.

More tutorials:

• Deploying VMs into multiple clusters using KubeStellar and KubeVirt

• Kubernetes on proxmox

Kubernetes jobs

1. • DevSecOps Engineer with Grafana Labs

   • Salary: £109K to £130K a year

   • Location: remote from the United Kingdom

   • Tech stack: Kubernetes, AWS, Azure, GCP, SQL, Grafana Mimir, Grafana, Grafana Tempo, Loki

2. • Platform Engineer with Domain Tools

   • Salary: ₱115K to ₱192K a year

   • Location: remote from Philippines

   • Tech stack: Kubernetes, AWS, Docker, Go, Shell, Python, Scala, Rust, C++, C

3. • Platform Engineer with Honor

   • Salary: $171K to $190K a year

   • Location: remote from the United States

   • Tech stack: Kubernetes, AWS, ArgoCD, Python, Airflow, Jenkins, Datadog, AWS CloudWatch

4. • Site Reliability Engineer with Luma AI

   • Salary: $200K to $250K a year

   • Location: based in the office in Palo Alto, CA, USA

   • Tech stack: Kubernetes, Terraform, Cloudformation, Grafana, Prometheus, Datadog, ELK, Splunk

Discover more Kubernetes jobs on Kube Careers →

Code & tools

1. Awesome DevOps telegram

   palark

   Awesome-DevOps-telegram is a curated list of public Telegram channels and groups dedicated to DevOps, SRE, and Platform Engineering.

2. KubeShark: traffic analyzer

   Kubeshark is an API traffic analyzer for Kubernetes providing protocol-level visibility, capturing and monitoring all traffic and payloads going in, out and across containers, pods, nodes and clusters.

3. KindScaler

   LoBuHi

   KindScaler is a tool that simplifies the process of adding or removing nodes from KinD clusters, allowing for more efficient development and testing workflows.

4. Velero: backup

   Velero is an open-source tool for safely backing up and restoring, performing disaster recovery, and migrating Kubernetes cluster resources and persistent volumes.

5. Longhorn: cloud native distributed block storage

   Longhorn is a distributed block storage system for Kubernetes.

   Longhorn creates a dedicated storage controller for each block device volume and synchronously replicates the volume across multiple replicas stored on various nodes.

Other interesting projects:

• Volcan: batch jobs

• Vault KMS plugin

Upcoming Kubernetes events

1. Aug

   21

   KubeCon China

   In-person conference organized by Linux Foundation.

   • Location: Hong Kong, HK

   • This is a free event.

2. Aug

   21

   Devopsdays Halifax

   In-person conference organized by Devopsdays.

   • Location: Halifax, CA

   • This event requires an entrance fee

3. Aug

   21

   Karpenter best practices

   Online meetup organized by The Platformers Community San Francisco.

   • This is a virtual event

   • This is a free event.

4. Aug

   24

   Devopsdays Rio De Janeiro

   In-person conference organized by Devopsdays.

   • Location: Rio de Janeiro, BR

   • This event requires an entrance fee

5. Aug

   27

   KubeDay Japan

   In-person conference organized by Linux Foundation.

   • Location: Tokyo, JP

   • This is a free event.

6. Sept

   30

   Advanced Kubernetes course (London)

   In-person workshop organized by Learnk8s.

   • Location: London, GB

   • This event requires an entrance fee

Discover more Kubernetes events on Kube Events →

Kubernetes Call for Papers

1. expired

   Kubernetes Community Days Denmark 2024

   The Call For Paper was open until 16 September 2024 at UTC. More info →

   • Location: Copenhagen, DK

   • In-person conference organized by KCD Denmark.

   • The conference starts on the 20 November 2024.

   • Apply here

2. expired

   KubeCon India

   The Call For Paper was open until 25 August 2024 at UTC. More info →

   • Location: Delhi, IN

   • In-person conference organized by Linux Foundation.

   • The conference starts on the 11 December 2024.

   • Apply here

3. expired

   Kunbernetes Community Days Ghana

   The Call For Paper was open until 31 August 2024 at UTC. More info →

   • This is a virtual event

   • Online conference organized by KCD Ghana.

   • The conference starts on the 26 November 2024.

   • Apply here

4. expired

   Kubernetes Community Days Indonesia 2024

   The Call For Paper was open until 2 September 2024 at UTC. More info →

   • Location: Jakarta, ID

   • In-person conference organized by KCD Indonesia.

   • The conference starts on the 30 November 2024.

   • Apply here

5. expired

   Kube Native 2024

   The Call For Paper was open until 26 August 2024 at UTC. More info →

   • This is a virtual event

   • Online conference organized by Conf42.

   • The conference starts on the 26 September 2024.

   • Apply here

6. expired

   DevSecOps 2024

   The Call For Paper was open until 4 November 2024 at UTC. More info →

   • This is a virtual event

   • Online conference organized by Conf42.

   • The conference starts on the 5 December 2024.

   • Apply here

7. expired

   QCon San Francisco

   The Call For Paper was open until 18 September 2024 at UTC. More info →

   • Location: San Francisco, CA, USA

   • In-person conference organized by InfoQ.

   • The conference starts on the 18 November 2024.

   • Apply here

8. expired

   Devopsdays Bogotá

   The Call For Paper was open until 2 September 2024 at UTC. More info →

   • Location: Bogotá, CO

   • In-person conference organized by Devopsdays.

   • The conference starts on the 29 October 2024.

   • Apply here

9. expired

   Shipped24

   The Call For Paper was open until 14 September 2024 at UTC. More info →

   • This is a virtual event

   • Online conference organized by Octopus Deploy.

   • The conference starts on the 20 November 2024.

   • Apply here

Until next time!

— Dan

Subscribe and, every Wednesday, receive the latest Kubernetes news!