Set Kubelet Parameters Via A Configuration File
A subset of the kubelet's configuration parameters may be set via an on-disk config file, as a substitute for command-line flags.
Providing parameters via a config file is the recommended approach because it simplifies node deployment and configuration management.
Create the config file
The subset of the kubelet's configuration that can be configured via a file
is defined by the
KubeletConfiguration
struct.
The configuration file must be a JSON or YAML representation of the parameters in this struct. Make sure the kubelet has read permissions on the file.
Here is an example of what this file might look like:
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
address: "192.168.0.8"
port: 20250
serializeImagePulls: false
evictionHard:
memory.available: "100Mi"
nodefs.available: "10%"
nodefs.inodesFree: "5%"
imagefs.available: "15%"
In this example, the kubelet is configured with the following settings:
address
: The kubelet will serve on IP address192.168.0.8
.port
: The kubelet will serve on port20250
.serializeImagePulls
: Image pulls will be done in parallel.evictionHard
: The kubelet will evict Pods under one of the following conditions:- When the node's available memory drops below 100MiB.
- When the node's main filesystem's available space is less than 10%.
- When the image filesystem's available space is less than 15%.
- When more than 95% of the node's main filesystem's inodes are in use.
The imagefs
is an optional filesystem that container runtimes use to store container
images and container writable layers.
Start a kubelet process configured via the config file
kubeadm init
.
See configuring kubelet using kubeadm for details.
Start the kubelet with the --config
flag set to the path of the kubelet's config file.
The kubelet will then load its config from this file.
Note that command line flags which target the same value as a config file will override that value. This helps ensure backwards compatibility with the command-line API.
Note that relative file paths in the kubelet config file are resolved relative to the location of the kubelet config file, whereas relative paths in command line flags are resolved relative to the kubelet's current working directory.
Note that some default values differ between command-line flags and the kubelet config file.
If --config
is provided and the values are not specified via the command line, the
defaults for the KubeletConfiguration
version apply.
In the above example, this version is kubelet.config.k8s.io/v1beta1
.
Drop-in directory for kubelet configuration files
As of Kubernetes v1.28.0, the kubelet has been extended to support a drop-in configuration directory. The location of it can be specified with
--config-dir
flag, and it defaults to ""
, or disabled, by default.
You can only set --config-dir
if you set the environment variable KUBELET_CONFIG_DROPIN_DIR_ALPHA
for the kubelet process (the value of that variable does not matter).
For Kubernetes v1.28, the kubelet returns an error if you specify --config-dir
without that variable set, and startup fails.
You cannot specify the drop-in configuration directory using the kubelet configuration file; only the CLI argument --config-dir
can set it.
One can use the kubelet configuration directory in a similar way to the kubelet config file.
.conf
. For instance: 99-kubelet-address.conf
For instance, you may want a baseline kubelet configuration for all nodes, but you may want to customize the address
field. This can be done as follows:
Main kubelet configuration file contents:
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
port: 20250
serializeImagePulls: false
evictionHard:
memory.available: "200Mi"
Contents of a file in --config-dir
directory:
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
address: "192.168.0.8"
On startup, the kubelet merges configuration from:
- Command line arguments (lowest precedence).
- the kubelet configuration
- Drop-in configuration files, according to sort order.
- Feature gates specified over the command line (highest precedence).
This produces the same outcome as if you used the single configuration file used in the earlier example.
What's next
- Learn more about kubelet configuration by checking the
KubeletConfiguration
reference.