I need to use large amounts of data (~200GB) which cannot be that uncommon. What is the recommended method or dealing with this? Spinning up a GPU instance and copying into it is out of the question, I do not have a Gbps upload.
So it has to be upload to some service and transferring it from there, which is doable, but feels wasteful, as it gets deleted and there is some cost, particularly egress. Does Lambda have some solution, so I do not have to move the data unnecessarily?