In this article, we will see how to install vLLM on Linux using 4 easy steps. vLLM is a fast and easy-to-use library for optimized inference engine for running large language models (LLMs) efficiently. It enables fast, memory-efficient, and high-throughput inference using techniques like PagedAttention and continuous batching. It has State-of-the-art serving throughput with Optimized ... Read more
In this article, we will see how to install kuberay operator in a kubernetes cluster using helm. If you are looking to simplify the deployment and management of ray clusters in kubernetes then kuberay operator would be the ideal choice for this purpose. It is a free and open source Kubernetes-native operator designed to manage ... Read more
In this article, we will see how to solve git pull "fatal: unable to auto-detect email address" error. If you have freshly installed git in your system and trying to perform git operations such as git pull to pull the changes from remote branch in a repo to local branch then it is possible that ... Read more
In this article, we will see how to install and use cert manager and cmctl for certificate generation and renewal in Kubernetes Cluster. If you are looking for kubernetes native tool that automatically issues, renew and revoke TLS certificates for workloads running in your cluster then you should always go for cert-manager. It not only ... Read more
In this article, we will see how to install kube-downscaler in Kubernetes cluster using Kubectl. If you are running your applications in a kubernetes cluster and wanted to save some cost of running workloads during less traffic hours or during off business hours when the load is very minimal then kube-downscaler is a must to ... Read more
In this article, we will see how to install kube-downscaler in kubernetes cluster using kustomize and kubectl tool. kube-downscaler is a free and open source kubernetes controller designed to scale down the workloads such as deployments, statefulsets, cronjobs etc. during non office hours to save resources and costs. It is well suited to be used ... Read more
In this article, we will see how to prevent automatic downscaling of your deployment replica in a Kubernetes cluster. I am sure you must have been using kube-downscaler to scale down your workload during off business hours in order to save cost. But at the same time it is also possible that you might be ... Read more
In our last article, we have gone through multiple practice questions for AWS Certified DevOps Engineer - Professional (DOP-C02) exam. If you haven't seen them yet then you can check AWS Certified DevOps Engineer - Professional (DOP-C02) Practice Questions Part - 1 . Here we will continue with some more practice questions to further boost ... Read more
In this article, we will go through latest practice questions that will help you succeed in AWS Certified DevOps Engineer - Professional exam. This certification is designed for testing the advanced technical skills and expertise in automating processes, managing deployments, and implementing DevOps practices using AWS. Passing this exam will showcase individual expertise in infrastructure ... Read more
In this article, we will see how to solve "git push error: RPC failed: HTTP 500 curl 22 The requested URL returned error: 500" which can occur during git push operation to a remote branch in a repo of a Git Server. You might be using any of the git server such as GitHub, GitLab, ... Read more