How I run LLMs in isolated containers using kubernetes and dockers

I got tired of LLMs having full access to my personal computer with all my different apps in it.

i found that with my existing kubernetes cluster and some docker magic I could carve out isolated VMs in kubernetes that are perfect for running Claude. I also got browser emulation and a vscode use and ttyd terminal baked in. Check out the open source code:

https://github.com/imran31415/kube-coder

hey, i am new into this forum... also not extremely into tech setups, how does it prevent LLMs from having access to my personal computer? Is it like Ollama accessing my files?

It's more like using VMware or a virtual machine then running Claude on there. Suggest copy pasting the repo I pasted above into an LLM and asking it how to use it and it should explain it pretty good. Please also look at the screenshots at the top of the README

thanks, giving it a try

this is exactly what i was worried about in my clawdbot post. full system access with no sandbox.

do you need an existing kubernetes setup to use this or can someone spin it up just for this? asking because i dont have a cluster and i'm not sure if setting one up just for claude isolation is overkill

Sorry this is probably not for you then if you don't already have a kubernetes cluster or not willing to set one up with enough resources.

This is built on top of kubernetes and helm so it would not work without it. I don't want you to waste your time. There are lots of other solutions out there that provide isolation in another method. I'm sorry I don't have enough knowledge to point you to a specific one but if you do find one please send me an update!

If you cared to explain a bit about what problem you are exactly solving, doesn't have to be too long? would have be easier for others to understand, and you might have got more search reach... just link pasting 🤷🏼‍♂️