Managing Karpenter Configurations With nOps IaC support

Managing Karpenter Configurations With nOps IaC Support

With IaC support for Karpenter, you can now manage Karpenter configurations either through the nOps dashboard, the CLI, or IaC tools (such as Terraform and CloudFormation). nOps automatically detects and syncs any changes to onboarded NodePools and NodeClasses, allowing you to automatically maintain all your configurations seamlessly through your chosen tools.

Pre-requisites

1. You must have onboarded at least one Kubernetes cluster to nOps Copilot for EKS.

2. The nOps Karpenter agent must be on version 0.4.1 or later.

   a. For a prefilled command, please visit the cluster details page: Configure nOps Karpenter Agent on EKS

Overview of IaC Support for Karpenter

1. nOps automatically scans and displays all of your NodeClass and NodePool objects in the dashboard.

   a. NodeClasses and NodePools created by nOps are marked with an icon to differentiate them from NodeClasses and NodePools that were created outside of nOps. These detected NodeClasses and NodePool objects are not automatically managed by nOps, but their configuration can be viewed in the application.

   

   nOps dashboard showing two NodeClasses created and managed by nOps, a NodeClass created outside of nOps managed by nOps, and a NodeClass created outside of nOps and not managed by nOps

2. A new attribute imported_by: nops defines whether nOps will manage and update your configurations for a NodeClass or NodePool for Spot optimization. If you want nOps to manage a NodeClass or NodePool that was created outside of nOps, add the key:value imported_by: nops under metadata.annotations in your source code. We recommend that you do this in 2 steps.

   a. First add imported_by: nops under metadata.annotations for the NodeClass. This will differentiate the instances launched by nOps and help ensure transparency in the process.

   b. In the next step, add the annotation imported_by: nops under metadata.annotations for the NodePool

3. Once the attribute is added, the object will be automatically detected in approximately one minute.

4. Once detection has taken place, nOps will begin to manage the configuration for your NodePool and automatically optimize workloads being provisioned by it. You are now able to edit the NodeClass from either the nOps UI or your source code, and changes will be automatically synced.

   a. The nOps agent continually monitors the Karpenter resources annotated with imported_by: nops and sends any changes via API to our application. If you edit a NodeClass or a NodePool using the nOps dashboard, the changes will likewise be propagated automatically to your cluster by the nOps agent and API.