What is the privacy guarantee of the Inference API? Are request/response content logged or stored in any way?
1 Like
I would also like to know the answer to this.
Hey there - sorry about the long delay answering this. I’m one of the engineers at Lambda that works on the Inference API. We do not log or store input prompts or completion results, and we will not use any data for training or other uses. All data flowing through the system is actually encrypted to help make sure we don’t accidentally log something and so no one can view it.
I could have sworn we posted this somewhere, but I do not see it now. So expect something to be added to the docs soon that will clarify this. Let us know if you have any other questions.
Thanks so much, that’s very helpful!
Was this ever clarified in the docs / ToS?
Bump. I too need to know before I can use Lambda Inference.
Hey everyone,
For the Inference API, we only store messages while they are in transit for servicing an inference request, and they are encrypted end-to-end during this process. As soon as the request is completed, they are deleted.
We don’t currently have this outlined in our Privacy Policy, but we are working on adding it. Our inference product is still relatively new, and our focus was on getting the product out to our user base first and foremost. However, this is our current stance on privacy with the Inference API. If this policy changes at any point, we will notify our customers accordingly.
Please let us know if you have any other questions, comments, or concerns.
Hayden
Lambda Team