Some links here are RunPod referral links: we may earn credits if you sign up. It costs you nothing extra. Details
Plan my project / What fits my GPU
What fits the GPU you already own?
Pick the memory on your graphics card. You see which of the open models in our calculator fit it, which are a squeeze, and which are too big. If your card is enough, you do not need to rent anything, and this page will say so.
What fits my GPU
On your card
| Model | 4-bit compressed | 8-bit less compressed | 16-bit full precision |
|---|
4-bit is the usual choice at home. The "~" figures are the estimated memory each copy needs. Fits = at or below 90% of the card's memory. Tight = 90 to 100%, with little headroom. Too big = more than the card has. The rule and the memory estimates are the ones our VRAM calculator uses (weights, context memory, 10% working memory and 1.5 GB overhead). They are estimates, not measurements: we have not run these models on these cards.
This checks GPU memory only. A model that does not fit can sometimes still run by spilling into ordinary system memory, but much more slowly. One card only: two cards in one PC are not modeled here.
Too big for your card? What renting one would cost*
For each model that does not fit even in 4-bit, the cheapest setup in our rate table that holds it. Rates are RunPod on-demand, checked within the last 30 days, billed by the second. Estimates, not quotes.
Want the cost of a whole session? Use the session cost planner.
Only rent what your own card cannot do
Run the models that fit at home. For the ones that do not, rent a bigger card for an hour or two and see whether the bigger model is worth it to you.
Referral link: we may earn credits if you sign up.
Every model on our list fits this card in 4-bit, by our estimate. You do not need to rent anything to try them.
The link holds the memory size and the context length, and nothing else. Nothing is stored anywhere.
* For education and information only. Not financial advice. We are not financial advisors. Trading and investing involve risk, including loss of principal.