Validating Cue Kubernetes Configuration with Kubeval
In the previous post I introduced using CUE for managing Kubernetes configuration. In this post we’ll start building a simple workflow.
One of the features of CUE is a declarative scripting language. This can be used to
add your own commands to the cue
CLI. Script files are named *_tool.cue
and are
automatically loaded by the CUE tooling.
First lets lay some of the ground work. This is taken from the Kubernetes tutorial and converts our map of Kubernetes objects to a list.
Save the following as kubernetes_tool.cue
:
package kubernetes
objects: [ x for x in deployment ]
We’ve saved the above in a separate file so it can be reused by other tools more easily.
Next we define our validate
command. For this we’re using Kubeval.
Save the following as validate_tool.cue
:
package kubernetes
import "encoding/yaml"
command validate: {
task kubeval: {
kind: "exec"
cmd: "kubeval --filename \"cue\""
stdin: yaml.MarshalStream(objects)
stdout: string
}
task display: {
kind: "print"
text: task.kubeval.stdout
}
}
Commands are quite powerful, allowing for defining flags and arguments, as well as providing inline help and usage examples. The only place this is documented is in the source and I’ve not been able to get it all working quite yet, but this should be familiar if you’ve build tools using a CLI framework like Cobra in Go before.
With our command defined, what can we now do? We can run it:
$ cue validate
The document "cue" contains a valid Deployment
A few things happened here:
- Our
deployment
defined in CUE was evaluated - The map data structure was flatted and converted to a list
- The list of objects was conerted into a multi-file YAML document
- That document was piped into
kubeval
Their is one caveat with the above, the exit code isn’t passed through. So if Kubeval finds an error it will return a non-zero exit code. But CUE doesn’t yet support passing that along, although I have now opened an issue.
The nice thing about defining aspects of the workflow in the authoring tool is consistency and discoverability. Early adopters might like remembering a bewildering number of discreet tools but it’s nice to build up a considered user interface. CUE doesn’t support everything needed to make this happen as yet, but I did mention that it’s very new.
Future ideas
Kubeval is really a thin wrapper around validation using the Kubernetes JSON Schema. It should be possible to convert JSON Schema to valid CUE templates. That would remove the need for this step completely as evaluating the CUE definitions would catch any issues. I think this should have generic utility for formats where you already have a JSON Schema handy as well as being specifically useful for Kubernetes. I think CUE has some code in the repository looking at generating CUE templates from Go types. That sounds useful, but I think CUE has potential outside just Go (and ask me to rant about the Kubernetes Go client versus the OpenAPI definitions anytime.)