What does clicking "reserve instance" actually do?

1

For Reasons ™ I need an instance that supports:

  1. sm_86 or below (the H100 instances only support sm_90)
  2. 40 GB RAM per GPU or more (so A10 instances don’t work)

I could do with only a single GPU, but two or four would be nicer.
Unfortunately, everythings all full. I clicked the “reserve instance” button, and it said it had noted the reservation …
and nothing else happened.

What does it mean when I push this button?
Is there a dashboard where I can see reservation requests?
Will this create a paid-for reservation without me noticing, starting billing in the background?

Btw, “Reasons™” is “fine tuning mpt-7b-instruct” which uses a model that requires Torch 1.13.1 which doesn’t work with CUDA12/sm90, and it breaks on Torch 2 for other reasons. I’m sure you’re familiar with this level of snake wrangling …

2

Hi @jwatte, when you click the reserved cloud button it should take you to our reserved cloud page, where you have the option to contact our sales team.
Once you fill out that form they will contact you and help you go over your needs and propose a solution.

Feel free to access the same page here.

Thank you,
Mike.

3

Sorry – I meant “request instance” not “reserve instance”

image
image2202×1144 225 KB

4

This request is for demand logging. Our cloud team will use this as a demand measurement to prioritize deployment of new instances.

It will not reserve one automatically for you nor it would run it.

Thank you,
Mike.

1 Like