What is the privacy guarantee of the Inference API? Are request/response content logged or stored in any way?
1 Like
I would also like to know the answer to this.
Hey there - sorry about the long delay answering this. I’m one of the engineers at Lambda that works on the Inference API. We do not log or store input prompts or completion results, and we will not use any data for training or other uses. All data flowing through the system is actually encrypted to help make sure we don’t accidentally log something and so no one can view it.
I could have sworn we posted this somewhere, but I do not see it now. So expect something to be added to the docs soon that will clarify this. Let us know if you have any other questions.
Thanks so much, that’s very helpful!