PinnedVishnu Hari Dadhich·May 2, 2024Multi-region YugabyteDB deployment on AWS EKS with IstioIn today’s distributed cloud landscape, deploying applications across multiple regions and clusters is crucial for scalability…
Vishnu Hari Dadhich·Sep 8Run vLLM on Kubernetes with Minikube, WSL2 and NVIDIA GPUThis is the vLLM entry in my local AI series. After testing Ollama, llama.cpp, and FreeToken, I wanted to run vLLM as a Kubernetes…
Vishnu Hari Dadhich·Sep 7Running a 35B MoE Model on an 8 GB Laptop GPU: Testing FreeTokenRunning large language models locally usually comes down to a hard hardware boundary: video RAM. If a model does not fit into your GPU’s…
Vishnu Hari Dadhich·Feb 14, 2024OPENTOFU VS. TERRAFORM : SAME SAME BUT DIFFERENTIn the rapidly evolving world of cloud computing, the concept of Infrastructure as Code (IaC) has revolutionized how we manage and…
Vishnu Hari Dadhich·Sep 20, 2023TROUBLESHOOTING KUBERNETES LIKE A PRO WITH nsenterContainers have revolutionized the world of software development by providing a lightweight and isolated environment for running…
Vishnu Hari Dadhich·Aug 23, 2019GET PATH AND ACCESS VOLUMES IN DOCKER FOR MACIf you use persistent data volumes in Docker, you might want to access them via command-line. If your docker host is Linux, that’s not a…
