Semantic Cache Playground

Interested in getting hands-on experience with semantic caching? Our semantic cache playground is an easy way for developers to try out semantic caching.

To improve the accuracy in conversational AI applications, our semantic cache is aware of the context of the user query. For example, the developer sets the scope of the cache with the system prompt (default) or by designating the cache in the client headers.

Our semantic cache also strives to mimic the behavior of human conversations. For example, if you ask the same question over and over again, a human interlocutor will not respond the same way each time.

Please let us know what you think!

Tom and Adrian
June 2024