Here's a curated list of various amazingly awesome CNCF and non-CNCF projects, components and tools we use to build cloud-native microservices architectures.
Pull requests with additional tools and projects are more than welcome!
- RKE is a CNCF-certified Kubernetes distribution that runs entirely within Docker containers. It works on bare-metal and virtualized servers. RKE solves the problem of installation complexity, a common issue in the Kubernetes community.
- K3s is a highly available, certified Kubernetes distribution designed for production workloads in unattended, resource-constrained, remote locations or inside IoT appliances.
- Metal³ exists to provide components that allow you to do bare metal host management for Kubernetes. works as a Kubernetes application, meaning it runs on Kubernetes and is managed through Kubernetes interfaces.
- kops helps you create, destroy, upgrade and maintain production-grade, highly available, Kubernetes clusters from the command line. AWS (Amazon Web Services) is currently officially supported, with GCE and OpenStack in beta support, and VMware vSphere in alpha, and other platforms planned.
- vcluster - Create fully functional virtual Kubernetes clusters; each vcluster runs inside a namespace of the underlying k8s cluster.
- k8e - The k8e 🚀 (said 'kuber easy') project builds on upstream project K3s as codebase, remove Edge/IoT features and extend enterprise features with best practices.
- k0s is an all-inclusive Kubernetes distribution, configured with all of the features needed to build a Kubernetes cluster simply by copying and running an executable file on each target host.
- Rancher is multi-cluster container management system, built to give team members a 360° view on the cluster.
- Kubernetes dashboard is a web-based Kubernetes user interface. You can use Dashboard to deploy containerized applications to a Kubernetes cluster, troubleshoot your containerized application, and manage the cluster resources.
- Crossplane is an open source Kubernetes add-on that supercharges your Kubernetes clusters enabling you to provision and manage infrastructure, services, and applications from kubectl.
- KubeEdge is a fully open, scalable & portable Kubernetes based Edge Computing platform.
- Kured is a Kubernetes daemonset that performs safe automatic node reboots when the need to do so is indicated by the package management system of the underlying OS.
- kubectl-who-can is a tool that shows which subjects have RBAC permissions to
VERB [TYPE | TYPE/NAME | NONRESOURCEURL]in Kubernetes. - k9s provides a terminal UI to interact with your Kubernetes clusters.
- Kubeman is a tool that attempts to make it easier to find information from Kubernetes clusters, and to investigate issues related to Kubernetes and Istio.
- k8s-image-swapper is a mutating webhook for Kubernetes, downloading images into your own registry and pointing the images to that new location.
- draino automatically drains Kubernetes nodes based on labels and node conditions.
- node-problem-detector aims to make various node problems visible to the upstream layers in the cluster management stack
- kubectl-fields is a cli tool to parse
kubectl explain --recursiveoutput to match given field and print its parental hierarchy in one-liner format. - Arkade provides a portable marketplace for downloading your favourite devops CLIs and installing helm charts, with a single command.
- Another Scheduler is a Kubernetes controller that automatically starts, stops, or restarts pods from a deployment at a specified time using a cron syntax.
- K8sPurger hunts unused resources In kubernetes.
- k8snetlook simple tool to help debug connetivity issues within a Pod or from a specific host in a live kubernetes cluster easily with a single command.
- kubeprober is a diagnostic tool designed for large-scale Kubernetes clusters.
- Datree is a CLI tool to ensure K8s manifests and Helm charts follow best practices as well as your organization’s policies.
- goldilocks is a utility that can help you identify a starting point for resource requests and limits.
- kubeletctl A client for kubelet
- KubeInvaders: it's like Space Invaders but the aliens are pods or worker nodes.
- kubedoom allows you to kill pods inside your Kubernetes cluster by shooting them in Doom!
- ChaosKube is a tool that periodically kills random pods in your Kubernetes cluster to test resiliency.
- PowerfulSeal injects failure into your Kubernetes clusters, so that you can detect problems as early as possible. It allows for writing scenarios describing complete chaos experiments.
- Harbor is an open source registry that secures artifacts with policies and role-based access control, ensures images are scanned and free from vulnerabilities, and signs images as trusted.
- k8scr In-memory k8s container registry
- Sinker is an open source tool that syncs container images from one registry to another. This is useful in cases when you rely on images that exist in a public container registry, but need to pull from a private registry.
- (GCR Only) container-image-promoter is a tool to promote Docker images from one registry to another, based on a declarative YAML manifest
- cAdvisor Analyzes resource usage and performance characteristics of running containers.
- Rook is a cloud-native storage orchestrator platform to enable highly available, durable storage in your Kubernetes cluster.
- Ceph CSI is an interface between CSI enabled Container Orchestrator (CO) and Ceph cluster. It allows dynamically provisioning Ceph volumes and attaching them to workloads.
- Longhorn is an official CNCF project that delivers a powerful cloud-native distributed storage platform for Kubernetes that can run anywhere.
- OpenEBS builds on Kubernetes to enable Stateful applications to easily access Dynamic Local PVs or Replicated PVs. By using the Container Attached Storage pattern users report lower costs, easier management, and more control for their teams.
- pvmigrate allows migrating PVCs between two StorageClasses by creating new PVs, copying over the data, and then changing PVCs to refer to the new PVs.
- Velero gives you tools to back up and restore your Kubernetes cluster resources and persistent volumes. You can run Velero with a public cloud platform or on-premises
- Flux v1 is a tool that automates the deployment of containers to Kubernetes. It fills the automation void that exists between building and monitoring.
- Helm Operator is a Kubernetes operator, allowing one to declaratively manage Helm chart releases. Combined with Flux this can be utilized to automate releases in a GitOps manner, but the use of Flux is not strictly necessary
- Flux v2 Flux version 2 ("Flux v2") is built from the ground up to use Kubernetes' API extension system, and to integrate with Prometheus and other core components of the Kubernetes ecosystem.
- Istio is an open platform for providing a uniform way to integrate microservices, manage traffic flow across microservices, enforce policies and aggregate telemetry data.
- Linkerd is a service mesh for Kubernetes. It makes running services easier and safer by giving you runtime debugging, observability, reliability, and security—all without requiring any changes to your code.
- Kuma is a modern control plane for Microservices & Service Mesh for both K8s and VMs, with support for multiple meshes in one cluster. It provides out-of-the-box L4 + L7 policy architecture to enable zero trust security, observabilty, discovery, routing and traffic reliability in one click.
- Open Service Mesh (OSM) is a lightweight, extensible, cloud native service mesh that allows users to uniformly manage, secure, and get out-of-the-box observability features for highly dynamic microservice environments.
- Meshery is the multi-service mesh management plane offering lifecycle, configuration, and performance management of service meshes and their workloads.
- PostgreSQL with Replication Manager: PostgreSQL is an open source object-relational database known for its reliability and data integrity. This solution includes repmgr, an open-source tool for managing replication and failover on PostgreSQL clusters.
- MongoDB Replicaset with/without arbiter: MongoDB is a cross-platform document-oriented database. Classified as a NoSQL database, MongoDB eschews the traditional table-based relational database structure in favor of JSON-like documents with dynamic schemas, making the integration of data in certain types of applications easier and faster. This solution bootstraps a MongoDB replicaset cluster on k8s that can eventually include an arbiter node.
- MySQL with Vitess.io: Vitess combines many important MySQL features with the scalability of a NoSQL database. Its built-in sharding features let you grow your database without adding sharding logic to your application.
- pgbackupd is Kubernetes cronjob that backups a target PostgreSQL instance, uploads a copy of the backup to a Storage Account in Azure or a AWS S3 bucket (or both) and deletes the local ones older than 14 days
- Nats is a simple, secure and high performance open source messaging system for cloud native applications, IoT messaging, and microservices architectures.
- Apache Pulsar is a cloud-native, distributed messaging and streaming platform.
- NGINX Ingress Controller provides enterprise‑grade delivery services for Kubernetes applications
- Kong Ingress Controller offers all the common Kong feature such as plugins, health checking, load balancing and more in Kong for Kubernetes Services, all using Custom Resource Definitions(CRDs) and Kubernetes-native tooling.
- Traefik is a modern HTTP reverse proxy and load balancer that makes deploying microservices easy
- HAProxy Ingress controller is a fast and reliable TCP and HTTP reverse proxy and load balancer. HAProxy Ingress carefully builds an optimized HAProxy configuration, which allows thousands of requests per second per proxy, despite the size of your cluster, with a very low latency.
- Istio is an open platform for providing a uniform way to integrate microservices, manage traffic flow across microservices, enforce policies and aggregate telemetry data.
- Skipper is the open-source ingress controller that powers 112 Kubernetes clusters at Zalando, which offers HTTP router and reverse proxy for service composition, designed as a library to build your custom proxy.
- Easegress is a Cloud Native traffic orchestration system.
- k8gb is a cloud native Kubernetes Global Balancer.
- Prometheus is an open-source systems monitoring and alerting toolkit originally built at SoundCloud.
- Jaeger is a distributed tracing system released as open source by Uber Technologies. It is used for monitoring and troubleshooting microservices-based distributed systems, including distributed context propagation, distributed transaction monitoring, root cause analysis, service dependency analysis, performance/latency optimization
- Grafana has become the world’s most popular technology used to compose observability dashboards with everything from Prometheus & Graphite metrics, to logs and application data to power plants and beehives.
- Fluentd is an open source data collector for unified logging layer.
- OpenTracing is comprised of an API specification, frameworks and libraries that have implemented the specification, and documentation for the project. OpenTracing allows developers to add instrumentation to their application code using APIs that do not lock them into any one particular product or vendor.
- k8s-job-notify sends an alert to slack whenever there is a Kubernetes cronJob/Job failure/success.
- BotKube is a messaging bot for monitoring and debugging Kubernetes clusters.
- Fairwind Polaris keeps your clusters sailing smoothly. It runs a variety of checks to ensure that Kubernetes pods and controllers are configured using best practices, helping you avoid problems in the future.
- OpenSLO OpenSLO specification for k8s
- SigNoz helps developers monitor their applications & troubleshoot problems, an open-source alternative to DataDog, NewRelic, etc.
- Falco is an open source runtime security tool that parses Linux system calls from the kernel at runtime, and asserts the stream against a powerful rules engine. It can be used for Kubernetes runtime security.
- CloudSploit by Aqua is an open-source project designed to allow detection of security risks in cloud infrastructure accounts, including: Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Oracle Cloud Infrastructure (OCI), and GitHub. These scripts are designed to return a series of potential misconfigurations and security risks.
- kube-hunter is a tool that hunts for security weaknesses in Kubernetes clusters. The tool was developed to increase awareness and visibility for security issues in Kubernetes environments.
- kube-bench is an application that checks whether Kubernetes is deployed securely by running the checks documented in the CIS Kubernetes Benchmark.
- Popeye is a utility that scans live Kubernetes cluster and reports potential issues with deployed resources and configurations. It sanitizes your cluster based on what's deployed and not what's sitting on disk.
- Kubesec Security risk analysis for Kubernetes resources
- ThreatMapper helps you to monitor and secure your running applications, in Cloud, Kubernetes, Docker, and Fargate Serverless.
- Tekton is a powerful and flexible open-source framework for creating CI/CD systems, allowing developers to build, test, and deploy across cloud providers and on-premise systems.
- Keptn is an event-based control plane for continuous delivery and automated operations for cloud-native applications.
- Buildpacks transforms your application source code into images that can run on any cloud.
- Argo provides open source Kubernetes native workflows, events, CI and CD
- Trivy is a simple and comprehensive vulnerability scanner for containers and other artifacts, suitable for CI.
- Spinnaker is an open source, multi-cloud continuous delivery platform for releasing software changes with high velocity and confidence.
- Terrascan detects compliance and security violations across Infrastructure as Code to mitigate risk before provisioning cloud native infrastructure.
- KEDA is a single-purpose and lightweight component that can be added into any Kubernetes cluster. KEDA works alongside standard Kubernetes components like the Horizontal Pod Autoscaler and can extend functionality without overwriting or duplication to provide event driven autoscaling
- CloudEvents is a specification for describing event data in common formats to provide interoperability across services, platforms and systems.
- OpenFaaS makes it easy for developers to deploy event-driven functions and microservices to Kubernetes without repetitive, boiler-plate coding. Package your code or an existing binary in a Docker image to get a highly scalable endpoint with auto-scaling and metrics.
- Kboom (WIP) is a tool that allows you to create short-term load for scale testing and long-term load for soak testing. Supported load out of the box for scale testing are pods and custom resources via CRDs for soak testing is planned. (this is WIP)
- kube-advisor is a diagnostic tool for Kubernetes clusters. At the moment, it returns pods that are missing resource and request limits.
- k6 is a developer-centric, free and open-source load testing tool built for making performance testing a productive and enjoyable experience.
- toxiproxy is a framework for simulating network conditions. It's made specifically to work in testing, CI and development environments, supporting deterministic tampering with connections, but with support for randomized chaos and customization
- Okteto accelerates the development workflow of Kubernetes applications. You write your code locally and okteto detects the changes and instantly updates your Kubernetes applications.
- Minikube is a tool that makes it easy to run Kubernetes locally. Minikube runs a single-node Kubernetes cluster inside a Virtual Machine (VM) on your laptop for users looking to try out Kubernetes or develop with it day-to-day.
- Multipass is a lightweight VM manager for Linux, Windows and macOS.
- Microk8s is an upstream Kubernetes deployment that runs entirely on your workstation or edge device. Being a snap it runs all Kubernetes services natively (i.e. no virtual machines) while packing the entire set of libraries and binaries needed.
- (Windows only) k8s Windows Dev Tools: a batteries included local development environment for Kubernetes on Windows.
- Singer Simple, Composable Open Source ETL
- Apache Airflow is an open-source workflow management platform.
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc.