Daniel Weibel
Daniel Weibel

Implementing a custom Kubernetes authentication method

April 2020

Implementing a custom Kubernetes authentication method
This is part 3 of 4 of the Authentication and authorization in Kubernetes series. More

Kubernetes supports several authentication methods out-of-the-box, such as X.509 client certificates, static HTTP bearer tokens, and OpenID Connect.

However, Kubernetes also provides extension points that allow you to bind a cluster to any custom authentication method or user management system.

This article explains how you can implement LDAP authentication for your Kubernetes cluster.

LDAP authentication means that users will be able to authenticate to the Kubernetes cluster with their existing credentials from a Lightweight Directory Access Protocol (LDAP) directory:

Kubernetes LDAP authentication

The role of LDAP authentication in this tutorial is to serve as an illustrative example — the goal of the article is to show the general principles of how to implement a custom authentication method.

You can use the same knowledge that you gain in this article for integrating any other authentication technology.

Think of Kerberos, Keycloak, OAuth, SAML, custom certificates, custom tokens, and any kind of existing single-sign on infrastructure.

You can use all of them with Kubernetes!

Let's start by briefly reviewing the fundamentals of how the access to the Kubernetes API is controlled.

Contents

  1. How access to the Kubernetes API is controlled
  2. Prerequisites
  3. Setting up an LDAP directory
  4. Creating an LDAP user entry
  5. Using the Webhook Token authentication plugin
  6. Implementing the webhook token authentication service
  7. Deploying the webhook token authentication service
  8. Creating the Kubernetes cluster
  9. Testing the LDAP authentication method
  10. Cleaning up
  11. Conclusion

How access to the Kubernetes API is controlled

Every request to the Kubernetes API passes through three stages in the API server: authentication, authorisation, and admission control:

Kubernetes API access

Each stage has a well-defined purpose:

At each stage, a request may be rejected — only requests that successfully make it through all three stages are handled by the Kubernetes API.

Let's have a closer look at the authentication stage.

The task of the authentication stage is to check whether a request comes from a legitimate user and to reject all requests that don't.

This is done by verifying some form of credentials in the request and establishing the identity of the user that these credentials belong to.

Internally, the authentication stage is organised as a sequence of authentication plugins:

Authentication plugins

Each authentication plugin implements a specific authentication method.

An incoming request is presented to each authentication plugin in sequence.

If any of the authentication plugins can successfully verify the credentials in the request, then authentication is complete and the request proceeds to the authorisation stage (the execution of the other authentication plugins is short-circuited).

If none of the authentication plugins can authenticate the request, the request is rejected with a 401 Unauthorized HTTP status code.

Note that the 401 Unauthorized status code is a long-standing misnomer as it indicates authentication errors and not authorisation errors. The HTTP status code for authorisation errors is 403 Forbidden.

So what authentication plugins do there exist?

First of all, Kubernetes does not provide an open plugin mechanism that allows you to develop your own plugins and simply plug them in.

Rather, Kubernetes provides a fixed set of in-tree authentication plugins that are compiled in the API server binary.

These plugins can be selectively enabled and configured with command-line flags on the API server binary at startup time.

You can find the list of available authentication plugins in the Kubernetes documentation.

There are three "closed" authentication plugins that implement specific authentication methods:

Up to and including Kubernetes v1.15, there was additionally the Static Password File authentication plugin which implemented HTTP basic authentication, however, it was deprecated in Kubernetes v1.16.

Furthermore, there are two "open-ended" authentication plugins that don't implement a specific authentication method but provide a point of extensibility for incorporating custom authentication logic:

The flexibility of the Kubernetes authentication mechanisms stems from these two open-ended authentication plugins.

They allow integrating any desired authentication method with Kubernetes.

In this tutorial, you will use the Webhook Token authentication plugin to implement LDAP authentication for your Kubernetes cluster.

To this end, you will create various components — an LDAP directory, an authentication service, and a Kubernetes cluster — and you will wire them up to work smoothly together.

Let's get started!

Prerequisites

This tutorial assumes that you have a Google Cloud Platform (GCP) account and a working installation of the gcloud command-line tool on your system.

If you haven't a GCP account yet, you can create a new one, in which case you get USD 300 credits that you can use for this tutorial.

You can install gcloud by installing the Google Cloud SDK according to the GCP documentation.

The accumulated costs for the GCP resources created in this tutorial are no more than 10 US cents per hour.

All charges will be subtracted from the USD 300 free credits that you get when you create a new account.

Setting up an LDAP directory

The first thing you will do is creating an LDAP directory that will serve as the central user management system of your setup.

Lightweight Directory Access Protocol (LDAP) belongs to a type of application called directory services to which also the Domain Name System (DNS) belongs to.

You can think of an LDAP directory as a database that maps names to values.

In practice, LDAP is often used to centrally store user information, such as personal data (name, address, email address, etc.), usernames, passwords, group affiliations and so on, of all members of an organisation.

This information is then accessed by various applications and services for authentication purposes, such as validating the username and password supplied by the user.

This is called LDAP authentication.

In this tutorial, you will use OpenLDAP as your LDAP directory, which is one of the most popular LDAP directory implementations.

Let's start by creating the necessary GCP infrastructure for the LDAP directory.

First of all, create a new GCP VPC network and subnet:

bash

gcloud compute networks create my-net --subnet-mode custom
gcloud compute networks subnets create my-subnet --network my-net --range 10.0.0.0/16

Next, create a GCP instance for hosting the LDAP directory:

bash

gcloud compute instances create authn \
  --subnet my-subnet \
  --machine-type n1-standard-1  \
  --image-family ubuntu-1804-lts \
  --image-project ubuntu-os-cloud

By default, GCP instances can't accept any traffic unless you define firewall rules that explicitly allow certain types of traffic.

In your case, traffic should be accepted from other instances in the same VPC network as well as from your local machine.

To realise this, create the following firewall rule:

bash

gcloud compute firewall-rules create allow-internal-and-admin \
  --network my-net \
  --allow icmp,tcp,udp \
  --source-ranges 10.0.0.0/16,$(curl checkip.amazonaws.com)

If the public IP address of your local machine ever changes, you can update the firewall rule with gcloud compute firewall-rules update.

Now, log in to instance with SSH:

bash

gcloud compute ssh root@authn

The next step is to install OpenLDAP on the instance.

OpenLDAP is distributed as the slapd Debian package.

Before you install this package, you should preset some of its settings, which will make the configuration easier:

bash

cat <<EOF | debconf-set-selections
slapd slapd/password1 password adminpassword
slapd slapd/password2 password adminpassword
slapd slapd/domain string mycompany.com
slapd shared/organization string mycompany.com
EOF

The above command sets the password of the default LDAP admin user to adminpassword and the base of the LDAP database to mycompany.com.

Now, you can install the slapd package:

bash

apt-get update
apt-get install -y slapd

That's it — OpenLDAP should now be installed and running!

You can now log out from the instance:

bash

exit

Let's test if you can access the LDAP directory from your local machine.

To interact with LDAP directories, you can use the ldapsearch tool which allows making LDAP Search requests.

If you're on macOS, then ldapsearch should be already installed — if you're on Linux, you can install it with:

bash

sudo apt-get install ldap-utils

With ldapsearch installed, run the following command:

bash

ldapsearch -LLL -H ldap://<AUTHN-EXTERNAL-IP> \
  -x -D cn=admin,dc=mycompany,dc=com -w adminpassword \
  -b dc=mycompany,dc=com

Please replace <AUTHN-EXTERNAL-IP> with the external IP address of the authn instance that you just created, which you can find out with gcloud compute instances list.

The above command might look cryptic, but it's the canonical way to interact with an LDAP directory, so here are some explanations:

In general, an LDAP directory is a tree-like hierarchical database (like DNS): a node like dc=mycompany,dc=com (dc stands for domain component) can be read as mycompany.com; so a node like cn=admin,dc=mycompany,dc=com (admin.mycompany.com) is one level under dc=mycompany,dc=com.

In any case, the output of the command should look like that:

dn: dc=mycompany,dc=com
objectClass: top
objectClass: dcObject
objectClass: organization
o: mycompany.com
dc: mycompany

dn: cn=admin,dc=mycompany,dc=com
objectClass: simpleSecurityObject
objectClass: organizationalRole
cn: admin
description: LDAP administrator
userPassword:: e1NTSEF9bHF4NGljTGlyL1BDSkhiYVVFMXcrQ2ZpM045S2laMzc=

These are the two LDAP entries that currently exist in your LDAP directory.

An LDAP entry is like at a DNS record, or a row in a relational database — the basic entity that contains the data.

In general, an LDAP entry consists of a unique identifier called dn (distinguished name) and a set of attributes, such as objectClass, cn (common name), o (organisation), or userPassword.

All in all, the above result tells you that your LDAP directory is working!

Creating an LDAP user entry

Currently, there's not much useful data in your LDAP directory — but let's change that.

Your next task is to create an LDAP entry for the user Alice — the following info should be saved about her:

To store this information as an LDAP entry, you have to express it in the LDAP Data Interchange Format (LDIF) format.

Here's how this looks like (save the following in a file named alice.ldif):

alice.ldif

dn: cn=alice,dc=mycompany,dc=com
objectClass: top
objectClass: inetOrgPerson
gn: Alice
sn: Wonderland
cn: alice
userPassword: alicepassword
ou: dev

The above specification defines an entry with a distinguished name (dn) of cn=alice,dc=mycompany,dc=com — this is the unique identifier of this entry in your LDAP directory.

Furthermore, the entry has the following attributes:

To create this entry, you can use the ldapadd tool which allows making LDAP Add requests to an LDAP directory.

If you installed ldapsearch, you should also have ldapadd because they are bundled together.

Run the following command:

bash

ldapadd -H ldap://<AUTHN-EXTERNAL-IP> \
  -x -D cn=admin,dc=mycompany,dc=com -w adminpassword -f alice.ldif

Please replace <AUTHN-EXTERNAL-IP> with the external IP address of the authn instance.

The output should say:

adding new entry "cn=alice,dc=mycompany,dc=com"

Sounds good!

To be sure that the entry has been added, try to query it with the following command:

bash

ldapsearch -LLL -H ldap://<AUTHN-EXTERNAL-IP> \
  -x -D cn=admin,dc=mycompany,dc=com -w adminpassword \
  -b dc=mycompany,dc=com cn=alice

This command is similar to the ldapsearch command from before, but it has an additional argument at the end (cn=alice) — this is the search filter and it causes only those entries to be returned that match the filter.

The output of the command should look like that:

dn: cn=alice,dc=mycompany,dc=com
objectClass: top
objectClass: inetOrgPerson
givenName: Alice
sn: Wonderland
cn: alice
userPassword:: YWxpY2VwYXNzd29yZA==
ou: dev

That's the entry for Alice that you just created!

Note that the password in the output is Base64-encoded, which is done automatically by LDAP. You can decode it with echo YWxpY2VwYXNzd29yZA== | base64 -D which results in alicepassword.

So, at this point, you have an LDAP directory with a user, Alice, in it.

The final goal of this tutorial will be that Alice can authenticate to the (future) Kubernetes cluster with her username alice and password alicepassword from the LDAP directory.

To this end, you need to create a binding between the LDAP directory and the Kubernetes cluster.

You will start with this next!

Using the Webhook Token authentication plugin

You will use the Webhook Token authentication plugin to bind Kubernetes to the LDAP directory.

Here is how the Webhook Token authentication plugin works:

Webhook Token authentication plugin

The Webhook Token authentication plugin requires requests to include an HTTP bearer token as an authentication credential.

An HTTP bearer token is included in the Authorization header of a request as Authorization: Bearer <TOKEN>.

When the Webhook Token authentication plugin receives a request, it extracts the HTTP bearer token and submits it to an external webhook token authentication service for verification.

The Webhook Token authentication plugin invokes the webhook token authentication service with an HTTP POST request carrying a TokenReview object in JSON format that includes the token to verify.

Here's how this TokenReview object looks like:

tokenreview.json

{
  "apiVersion": "authentication.k8s.io/v1beta1",
  "kind": "TokenReview",
  "spec": {
    "token": "<TOKEN>"
  }
}

The webhook token authentication service is completely independent of Kubernetes and it is implemented and operated by the cluster administrator (that is, by you).

The task of the webhook token authentication service is to verify the token, and, if it's valid, return the identity of the user it belongs to.

The user identity has the form of a UserInfo data structure, which contains the following fields:

The response from the webhook token authentication service to the API server is a TokenReview object as well, with some additional fields that indicate whether the token is valid or not, and in case that the tokens is valid, include the UserInfo of the identified user.

Based on this information, the Webhook Token authentication plugin then either accepts or rejects the request.

So, how do you implement LDAP authentication with the Webhook Token authentication plugin?

Here's a solution:

LDAP authentication

The HTTP bearer token that users have to include in their requests has the following form:

username:password

In this token, username and password are the username and password of the user from the LDAP directory.

In a real-world scenario, the token should be Base64-encoded to correctly handle special characters. This tutorial omits this step for simplicity.

The Webhook Token authentication plugin then submits this token to the webhook token authentication service for verification.

The webhook token authentication service extracts the username and password parts from the token and verifies whether they are correct by talking to the LDAP directory.

In particular, the authentication service makes an LDAP Search request to the LDAP directory, querying for a user entry with the given username and password.

If there is such an entry, the LDAP directory returns it, and the authentication service constructs the user identity (UserInfo) from it that it must return to the API server.

As you can see, the main task for implementing LDAP authentication consists in creating a webhook token authentication service that implements the necessary logic.

You will implement this service in Go in the next section.

You will see later why it's suitable to use Go for implementing this service.

Let's get started!

Implementing the webhook token authentication service

Since you will implement the service with Go, you first have to install Go on your system, if you haven't yet done so.

If you use macOS, you can install Go with:

bash

brew install go

If you use Linux, you can install the latest version of Go as described in the Go documentation:

bash

wget https://dl.google.com/go/go1.14.linux-amd64.tar.gz
sudo tar -C /usr/local -xzf go1.14.linux-amd64.tar.gz
echo "PATH=$PATH:/usr/local/go/bin" >>~/.bash_profile && . ~/.bash_profile

You can verify the installation of Go with:

bash

go version

Next, you need to install two Go packages that are not in the standard library but that you will need in your implementation:

bash

go get github.com/go-ldap/ldap
go get k8s.io/api/authentication/v1

You're now ready to start writing code!

You can find the complete source code of the webhook token authentication service on GitHub in a file named authn.go.

You can download this source file to your local machine:

bash

wget https://raw.githubusercontent.com/learnk8s/authentication/master/authn.go

⟶ If you want, you can directly jump ahead to the deployment of the service.

Otherwise, you can find below some explanations of how the code works:

authn.go

package main

import (
    "encoding/json"
    "fmt"
    "github.com/go-ldap/ldap"
    "io/ioutil"
    "k8s.io/api/authentication/v1"
    "log"
    "net/http"
    "os"
    "strings"
)
# ...

As usual, a Go source file starts with the package declaration and the list of imported packages.

Note that one of the imported packages, k8s.io/api/authentication/v1, comes directly from the Kubernetes source code (which is also written in Go) — you will later use some type definitions of this package.

The ability to import packages from the Kubernetes source code is a big advantage of using Go for Kubernetes-related applications.

The next chunk of the implementation looks as follows:

authn.go

# ...
var ldapURL string

func main() {
    ldapURL = "ldap://" + os.Args[1]
    log.Printf("Using LDAP directory %s\n", ldapURL)
    log.Println("Listening on port 443 for requests...")
    http.HandleFunc("/", handler)
    log.Fatal(http.ListenAndServeTLS(":443", os.Args[3], os.Args[2], nil))
}
# ...

This is the main function of the code — it reads the IP address of the LDAP directory from a command-line argument and sets up an HTTPS web server.

A webhook token authentication service is essentially a web service, as the API server invokes it through HTTPS POST requests.

The biggest part of the rest of the code is the implementation of the HTTPS handler function handler that handles the requests from the Kubernetes API server.

Here's how it starts:

authn.go

# ...
func handler(w http.ResponseWriter, r *http.Request) {

    // Read body of POST request
    b, err := ioutil.ReadAll(r.Body)
    if err != nil {
        writeError(w, err)
        return
    }
    log.Printf("Receiving: %s\n", string(b))
# ...

The above code reads the body data of the received HTTPS POST request — which is expected to be a TokenReview object in JSON format.

The following code deserialises the body data into a Go TokenReview object:

authn.go

# ...
    // Unmarshal JSON from POST request to TokenReview object
    var tr v1.TokenReview
    err = json.Unmarshal(b, &tr)
    if err != nil {
        writeError(w, err)
        return
    }
#...

Note that the TokenReview type comes from the Kubernetes source code package k8s.io/api/authentication/v1. This makes it very easy for you to decode the TokenReview request payload.

The following code extracts the username and password parts from the token in the TokenReview object:

authn.go

# ...
    // Extract username and password from the token in the TokenReview object
    s := strings.SplitN(tr.Spec.Token, ":", 2)
    if len(s) != 2 {
        writeError(w, fmt.Errorf("badly formatted token: %s", tr.Spec.Token))
        return
    }
    username, password := s[0], s[1]
# ...

The following code makes the LDAP Search request with the extracted username and password:

authn.go

# ...
    // Make LDAP Search request with extracted username and password
    userInfo, err := ldapSearch(username, password)
    if err != nil {
        writeError(w, fmt.Errorf("failed LDAP Search request: %v", err))
        return
    }
# ...

The request returns a UserInfo object if the provided username and password are valid, and nil otherwise.

The implementation of the ldapSearch function is further down in the source file.

The following code uses the response of the LDAP Search request to construct the response to the API server:

authn.go

# ...
    // Set status of TokenReview object
    if userInfo == nil {
        tr.Status.Authenticated = false
    } else {
        tr.Status.Authenticated = true
        tr.Status.User = *userInfo
    }
# ...

The response to the API server is also a TokenReview object, and it has a Status.Authenticated field indicating whether the authentication succeeded, and in the case that it did, a Status.User field containing the identity (UserInfo) of the authenticated user.

Finally, the following code sends the response back to the API server:

authn.go

# ...
    // Marshal the TokenReview to JSON and send it back
    b, err = json.Marshal(tr)
    if err != nil {
        writeError(w, err)
        return
    }
    w.Write(b)
    log.Printf("Returning: %s\n", string(b))
}

That's it for the handler function.

Next, there's a helper function for handling errors:

authn.go

# ...
func writeError(w http.ResponseWriter, err error) {
    err = fmt.Errorf("Error: %v", err)
    w.WriteHeader(http.StatusInternalServerError) // 500
    fmt.Fprintln(w, err)
    log.Println(err)
}
# ...

Finally, there's the ldapSearch function that's invoked by the above handler function.

The ldapSearch function takes a username and password as arguments and makes an LDAP Search request for a user entry with the given username and password — if such an entry exists, the function returns a UserInfo object containing the user's identity, else it returns nil.

Here's how the function starts:

authn.go

# ...
func ldapSearch(username, password string) (*v1.UserInfo, error) {

    // Connect to LDAP directory
    l, err := ldap.DialURL(ldapURL)
    if err != nil {
        return nil, err
    }
    defer l.Close()
# ...

The above code establishes the initial connection to the LDAP directory.

The following code authenticates to the LDAP directory as the LDAP admin user (in LDAP, authenticating is done with an LDAP Bind request):

authn.go

# ...
    // Authenticate as LDAP admin user
    err = l.Bind("cn=admin,dc=mycompany,dc=com", "adminpassword")
    if err != nil {
        return nil, err
    }
# ...

The above corresponds to the -x, -D, and -w options you used in the manual LDAP requests with ldapsearch and ldapadd.

The following code makes the actual LDAP Search request:

authn.go

# ...
    // Execute LDAP Search request
    searchRequest := ldap.NewSearchRequest(
        "dc=mycompany,dc=com",  // Search base
        ldap.ScopeWholeSubtree, // Search scope
        ldap.NeverDerefAliases, // Dereference aliases
        0,                      // Size limit (0 = no limit)
        0,                      // Time limit (0 = no limit)
        false,                  // Types only
        fmt.Sprintf("(&(objectClass=inetOrgPerson)(cn=%s)(userPassword=%s))", username, password), // Filter
        nil, // Attributes (nil = all user attributes)
        nil, // Additional 'Controls'
    )
    result, err := l.Search(searchRequest)
    if err != nil {
        return nil, err
    }
# ...

The first statement above sets the request parameters.

The crucial part here is the search filter argument — it defines what the request should "search for".

The above filter searches for an entry with an objectClass of inetOrgPerson, a cn (common name) equalling the provided username, and a userPassword equalling the provided password.

The second statement executes the request.

If the request returns an entry, then the provided username and password are valid and belong to the user whose entry is returned — if the response is empty, it means that the username and password are invalid.

The following code inspects the return value of the LDAP Search request and constructs the return value of the ldapSearch function:

authn.go

# ...
    // If LDAP Search produced a result, return UserInfo, otherwise, return nil
    if len(result.Entries) == 0 {
        return nil, nil
    } else {
        return &v1.UserInfo{
            Username: username,
            UID:      username,
            Groups:   result.Entries[0].GetAttributeValues("ou"),
        }, nil
    }
}

If the LDAP Search response is empty, the ldapSearch function returns nil.

If the LDAP Search response includes an entry, the ldapSearch function returns a UserInfo object initialised with the data of the user.

The UserInfo type is also provided by the k8s.io/api/authentication/v1 package from the Kubernetes source code.

That's it — the complete code of your webhook token authentication service.

The next step is to deploy this code!

Deploying the webhook token authentication service

To deploy the service, you first have to compile it:

bash

GOOS=linux GOARCH=amd64 go build authn.go

This should produce a binary named authn.

You could deploy your service to any machine that's accessible over the internet — for this tutorial, you will deploy it to the same GCP instance that already hosts your LDAP directory.

You can upload the binary to this instance as follows:

bash

gcloud compute scp authn root@authn:

Then, log in to the instance with SSH:

bash

gcloud compute ssh root@authn

Since the service serves HTTPS, it depends on a private key and certificate that must be provided as command-line arguments.

You can create an appropriate private key and certificate with the following command:

bash

openssl req -x509 -newkey rsa:2048 -nodes -subj "/CN=localhost" \
  -keyout key.pem -out cert.pem

The above command creates a self-signed certificate. This is fine for a tutorial, but in a production scenario, you should use a certificate that's signed by a proper certificate authority (CA).

Now, you can launch the service as follows:

bash

./authn localhost key.pem cert.pem &>/var/log/authn.log &

Note the following about the command:

Your webhook token authentication service is now up and running!

You can find out the process ID (PID) of your running service with pgrep authn. If you ever need to kill it, you can do so with pkill authn.

You can now log out from the instance:

bash

exit

Back on your local machine, let's test if the service works as expected.

Create a file with the following content:

tokenreview.json

{
  "apiVersion": "authentication.k8s.io/v1beta1",
  "kind": "TokenReview",
  "spec": {
    "token": "alice:alicepassword"
  }
}

The above is a TokenReview object, which is what your authentication service is supposed to receive from the API server.

For testing your service, you will simulate such a request from the API server by making it manually from your local machine.

Note that the above TokenReview object contains the token alice:alicepassword which consists of the valid username and password of Alice that your previously saved in the LDAP directory — that means, the verification of the token should succeed.

To see how your authentication service will react to the request, stream its logs in a separate terminal window:

bash-1

gcloud compute ssh root@authn --command "tail -f /var/log/authn.log"

Now, make the request with the following command:

bash

curl -k -X POST -d @tokenreview.json https://<AUHTN-EXTERNAL-IP>

Please replace <AUHTN-EXTERNAL-IP> with the external IP address of the authn instance.

The above command makes an HTTP POST request to the authentication service with the TokenReview object included in the body.

The logs of the authentication service should print two lines indicating that an object was received and a response was sent back.

And the response of the curl command should look as follows:

{
  "kind": "TokenReview",
  "apiVersion": "authentication.k8s.io/v1beta1",
  "metadata": {
    "creationTimestamp": null
  },
  "spec": {
    "token": "alice:alicepassword"
  },
  "status": {
    "authenticated": true,
    "user": {
      "username": "alice",
      "uid": "alice",
      "groups": [
        "dev"
      ]
    }
  }
}

Note that in your case, the response is compressed on a single line — but you can pipe the output to jq to format it as shown above:

bash

curl -k -X POST -d @tokenreview.json https://<AUTHN-EXTERNAL-IP> | jq

As you can see, the response object is a TokenReview object and it has the status.authenticated field set to true.

That means that the authentication succeeded!

This is what you expected because the submitted token includes the correct username and password of Alice.

The above is exactly how your authentication service will work in practice, with the only difference that the requests will be made by the Kubernetes API server.

So, your authentication service is ready to be used by Kubernetes!

The next step is to create the Kubernetes cluster.

Creating the Kubernetes cluster

In this section, you will create a Kubernetes cluster and configure it to use the Webhook Token authentication plugin with your webhook token authentication service.

For this tutorial, you will create a small single-node Kubernetes cluster with kubeadm.

In a single-node cluster, the master node acts as the same time as a worker node, that is, it runs workload Pods.

Start by creating a new GCP instance your single-node cluster:

bash

gcloud compute instances create k8s \
  --subnet my-subnet \
  --machine-type e2-medium \
  --image-family ubuntu-1804-lts \
  --image-project ubuntu-os-cloud

Then, log in to the instance:

bash

gcloud compute ssh root@k8s

Since you will install Kubernetes with kubeadm, the first step is to install kubeadm on the instance.

To do so, you first have to register the Kubernetes package repository that hosts the kubeadm package:

bash

apt-get update
apt-get install -y apt-transport-https curl
curl https://packages.cloud.google.com/apt/doc/apt-key.gpg | apt-key add -
echo "deb https://apt.kubernetes.io/ kubernetes-xenial main" >/etc/apt/sources.list.d/kubernetes.list

Now, you can install the kubeadm package — and since Kubernetes depends on Docker, you have to install the Docker package too:

bash

apt-get update
apt-get install -y docker.io kubeadm

You can verify the installation of kubeadm and Docker with:

bash

kubeadm version
docker version

The next step is to install Kubernetes with kubeadm.

The crucial point here is the enabling and configuration of the Webhook Token authentication plugin.

As you can see in the Kubernetes documentation, the Webhook Token authentication plugin is enabled by setting the --authentication-token-webhook-config-file command-line flag of the API server binary.

The value of this flag must be a configuration file that describes how to access the webhook token authentication service — the format of this file is described in the Kubernetes documentation.

Here's how the file looks like for your webhook token authentication service:

/root/authn-config.yaml

apiVersion: v1
kind: Config
clusters:
  - name: authn
    cluster:
      server: https://<AUTHN-INTERNAL-IP>
      insecure-skip-tls-verify: true
users:
  - name: kube-apiserver
contexts:
- context:
    cluster: authn
    user: kube-apiserver
  name: authn
current-context: authn

Please replace <AUTHN-INTERNAL-IP> with the internal IP address of the authn compute instance (must be of the form 10.0.x.x).

Save the above content in a file named authn-config.yaml in the current working directory of the authn instance that you're currently logged into.

Note that the Webhook Token configuration file — somewhat oddly — uses the kubeconfig file format:

That means, in this scenario, the API server is a "user" of a remote service, which is your webhook token authentication service.

The crucial part in the Webhook Token configuration file is the cluster section:

/root/authn-config.yaml

apiVersion: v1
kind: Config
clusters:
  - name: authn
    cluster:
      server: https://<AUTHN-INTERNAL-IP>
      insecure-skip-tls-verify: true
users:
  - name: kube-apiserver
contexts:
- context:
    cluster: authn
    user: kube-apiserver
  name: authn
current-context: authn

The server field defines the URL of the webhook token authentication service.

The insecure-skip-tls-verify field causes the API server to skip the validation of the authentication service's server certificate — this is necessary because your authentication service uses a self-signed certificate that can't be validated by the API server.

In a production scenario where the authentication service uses a properly signed certificate, the configuration file would contain a certificate authority (CA) certificate that allows validating the authentication service's certificate.

The rest of the values in the configuration file, such as authn and kube-apiserver are arbitrary identifiers without any intrinsic meaning.

At this point, your configuration for the Webhook Token authentication plugin is ready.

The next step is to tell kubeadm to wire things up correctly.

To do so, you need to create yet another configuration file — a kubeadm configuration file of type ClusterConfiguration.

Here's how it looks like:

/root/kubeadm-config.yaml

apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
  extraArgs:
    authentication-token-webhook-config-file: /etc/authn-config.yaml
  extraVolumes:
    - name: authentication-token-webhook-config-file
      mountPath: /etc/authn-config.yaml
      hostPath: /root/authn-config.yaml
  certSANs:
    - <K8S-EXTERNAL-IP>

Please replace <K8S-EXTERNAL-IP> with the external IP address of the k8s instance.

Save the above in a file named kubeadm-config.yaml in the current working directory of the k8s instance you're currently logged into.

The above kubeadm configuration file contains three sections:

Now everything is ready to start the installation of Kubernetes.

You can launch the installation with the following command:

bash

kubeadm init --config kubeadm-config.yaml

After this command completes, you're done — you don't need to run any further kubeadm commands since you're creating only a single-node cluster.

However, you have to do some final adjustments to your cluster.

To do so, you will use the default kubeconfig file /etc/kubernetes/admin.conf that kubeadm automatically created.

First, since your master node acts at the same time as a worker node, you have to remove the NoSchedule taint to allow workload Pods to be scheduled to it:

bash

kubectl --kubeconfig /etc/kubernetes/admin.conf \
  taint node k8s node-role.kubernetes.io/master:NoSchedule-

Second, you have to install a Container Network Interface (CNI) plugin which is not done automatically by kubeadm.

There are various CNI plugins that you can choose from — for the current scenario, let's use the Cilium CNI plugin:

bash

kubectl --kubeconfig /etc/kubernetes/admin.conf \
  apply -f https://raw.githubusercontent.com/cilium/cilium/1.7.2/install/kubernetes/quick-install.yaml

You can now watch all the system Pods of your cluster coming alive:

bash

kubectl --kubeconfig /etc/kubernetes/admin.conf \
  get pods --all-namespaces --watch

Your Kubernetes cluster is now complete!

You can log out from the instance:

bash

exit

As a final step, you should make the cluster accessible from your local machine.

To do so, download the kubeconfig file that you previously used on the instance:

bash

gcloud compute scp root@k8s:/etc/kubernetes/admin.conf .

To make this kubeconfig file work on your local machine, you have to replace the internal IP address of the k8s instance in the API server URL with the corresponding external IP address:

bash

kubectl --kubeconfig admin.conf \
  config set-cluster kubernetes --server https://<K8S-EXTERNAL-IP>:6443

Please replace <K8S-EXTERNAL-IP> with the external IP address of the k8s instance.

Now, try to make a request to the cluster from your local machine by using the downloaded kubeconfig file:

bash

kubectl --kubeconfig admin.conf get pods --all-namespaces

Congratulations — you made your cluster accessible from your local machine.

Instead of specifying the kubeconfig file with the --kubeconfig flag for every command, you may also set the KUBECONFIG environment variable.

You already got very far — you created a Kubernetes cluster and configured it to use the Webhook Token authentication plugin with your custom webhook token authentication service.

It's time to test if your custom authentication method works as expected!

Testing the LDAP authentication method

At this point, you have the following:

If your authentication method works as expected, then Alice should now be able to authenticate to the cluster with an HTTP bearer token of alice:alicepassword.

Here's what should happen:

Testing the custom authentication method

Let's see if that works!

To easily make requests with this token, you can add it as a user entry in the kubeconfig file:

bash

kubectl --kubeconfig admin.conf \
  config set-credentials alice --token alice:alicepassword

Now, when you make a kubectl request with the user alice (which you can specify with the --user flag) kubectl will include the token alice:alicepassword as an HTTP bearer token in the request.

To see how your webhook token authentication service will react to the request, stream its logs in a separate terminal window:

bash-1

gcloud compute ssh root@authn --command "tail -f /var/log/authn.log"

Now make a request with the user alice to your cluster:

bash

kubectl --kubeconfig admin.conf --user alice \
  get pods --all-namespaces

Check the logs of the authentication service — you should see two added lines indicating that a request has been received and a response sent back.

And if you look closely at the response, you should see that the TokenReview object has the status.authenticated field set to true.

The authentication succeeded!

However, the response of the kubectl command looks as follows:

Error from server (Forbidden): pods is forbidden: User "alice" cannot list resource "pods" in API group "" \
  at the cluster scope

Guess what — this error has nothing to do with authentication, but with authorisation:

Here's what happened:

Testing the custom authentication method

You can observe that the request returns a 403 Forbidden HTTP status code by increase the log level of the kubectl command with -v 5.

That's good news for you — your authentication method did its job correctly!

However, authorisation failed, so let's fix that by granting some permissions to the user alice:

bash

kubectl --kubeconfig admin.conf --user kubernetes-admin \
  create clusterrolebinding alice --clusterrole cluster-admin --user alice

The above command assigns the cluster-admin default role to the user alice which grants full access to the Kubernetes API.

Note that the above command is made with the kubernetes-admin which was the initial user in your kubeconfig file.

Now, try to repeat the previous request with ther user alice:

bash

kubectl --kubeconfig admin.conf --user alice \
  get pods --all-namespaces
NAMESPACE     NAME                               READY   STATUS    RESTARTS   AGE
kube-system   cilium-dhspr                       1/1     Running   0          54m
kube-system   cilium-operator-6568744949-w7b8r   1/1     Running   0          54m
kube-system   coredns-66bff467f8-dmspz           1/1     Running   0          55m
kube-system   coredns-66bff467f8-r6hjb           1/1     Running   0          55m
kube-system   etcd-k8s                           1/1     Running   0          55m
kube-system   kube-apiserver-k8s                 1/1     Running   0          55m
kube-system   kube-controller-manager-k8s        1/1     Running   0          55m
kube-system   kube-proxy-jxcq8                   1/1     Running   0          55m
kube-system   kube-scheduler-k8s                 1/1     Running   0          55m

Wohoo!

This time the request succeeds — it passed both the authentication and the authorisation stage.

Your expectations came true — Alice is able to access the cluster by using her username and password from the LDAP directory!

If you make several quickly consecutive requests with the same authentication token, only the first one will be handled by the authentication service. This is because the API server caches the response from the authentication service and reuses it for future similar requests. By default, the cache duration is 2 minutes.

Let's make another test.

In the previous test, you used a valid token, but what happens if you use an invalid token?

Change the token in the kubeconfig file to some invalid value as follows:

bash

kubectl --kubeconfig admin.conf \
  config set-credentials alice --token alice:otherpassword

Then, try to make another request as the user alice:

bash

kubectl --kubeconfig admin.conf --user alice \
  get pods --all-namespaces

The logs of the authentication service should print two new lines, but this time the response object has the status.authenticated field set to false.

And the output of the kubectl command looks as follows:

error: You must be logged in to the server (Unauthorized)

The above message means that the authentication failed.

This makes complete sense because the token is invalid.

Here's what happened:

Testing the custom authentication method

You can observe that the request returns a 401 Unauthorized HTTP status code by increasing the log level of the kubectl command with -v 5.

Let's do a final test.

What will happen if Alice changes her password in the LDAP directory to otherpassword and then repeats the above request?

To modify an LDAP entry, you have to create a modification specification in LDIF format.

Here's how you specify a modification of Alice's password to otherPassword:

modify-password.ldif

dn: cn=alice,dc=mycompany,dc=com
changetype: modify
replace: userPassword
userPassword: otherpassword

You then have to submit this specification to the LDAP directory with an LDAP Modify request.

You can do that with the ldapmodify tool:

bash

ldapmodify -H ldap://<AUTHN-EXTERNAL-IP> -x -D cn=admin,dc=mycompany,dc=com -w adminpassword \
  -f modify-password.ldif

Please replace <AUTHN-EXTERNAL-IP> with the external IP address of the authn instance.

The output of the command looks like that:

modifying entry "cn=alice,dc=mycompany,dc=com"

That means, the password of Alice has now been officially changed to otherpassword.

Now try to repeat the request that previously failed:

bash

kubectl --kubeconfig admin.conf --user alice \
  get pods --all-namespaces
NAMESPACE     NAME                               READY   STATUS    RESTARTS   AGE
kube-system   cilium-dhspr                       1/1     Running   0          80m
kube-system   cilium-operator-6568744949-w7b8r   1/1     Running   0          80m
kube-system   coredns-66bff467f8-dmspz           1/1     Running   0          80m
kube-system   coredns-66bff467f8-r6hjb           1/1     Running   0          80m
kube-system   etcd-k8s                           1/1     Running   0          80m
kube-system   kube-apiserver-k8s                 1/1     Running   0          80m
kube-system   kube-controller-manager-k8s        1/1     Running   0          80m
kube-system   kube-proxy-jxcq8                   1/1     Running   0          80m
kube-system   kube-scheduler-k8s                 1/1     Running   0          80m

Bingo!

Since Alice's password in the central LDAP directory is now otherpassword, the token alice:otherpassword is now valid and the authentication succeeded.

With all these results, you can now be pretty sure that your authentication method works as expected!

Congratulations!

You successfully implemented LDAP authentication for Kubernetes!

By now, you should also have noticed the advantages of using an external centralised user management system, such as an LDAP directory:

That's the end of this tutorial.

Cleaning up

You can delete all the GCP resources that you created for this tutorial with the following commands:

bash

gcloud compute instances delete authn k8s
gcloud compute firewall-rules allow-internal-and-admin
gcloud compute networks subnets delete my-subnet
gcloud compute networks delete my-net

Conclusion

This article showed how to implement LDAP authentication for a Kubernetes cluster with the Webhook Token authentication plugin.

There are various directions into which you can go from here:

Going even further, the logical next step after authentication is authorisation.

Stay tuned for a future article about Kubernetes authorisation!

That's all folks!

If you enjoyed this article, you might find the following articles interesting:

Your source for Kubernetes news

You are in!

More K8s news, events and jobs.