Cross Contamination #47

Activity

1. louiscb commented on Dec 28, 2025

   

   louiscb

   on Dec 28, 2025

   Last edited by louiscb

   Contributor

   More actions

   Hi @marcelinhov2 thanks for the kind words and apologies for the delayed response.

   I take your issue to mean that you want a single Semcache instance to store different responses to the same prompts, like a namespace. So you don't get key collisions for the same prompts. That's definitely something that could be done and has been discussed in the past.

   How are you interacting with Semcache? Using the cache aside with the python sdk I'd want it work something like this:

   from semcache import Semcache
   
   cache_a = Semcache(
       base_url="http://localhost:8080",
       namespace="agent-1"
   )
   
   cache_a.put("What's your name?", "John")
   
   cache_b = Semcache(
       base_url="http://localhost:8080",
       namespace="agent-2"
   )
   
   cache_b.put("What's your name?", "James")

   What do you think? And PRs are always welcome.
2. louiscb

   self-assigned this

   on Dec 28, 2025
3. marcelinhov2 commented on Dec 29, 2025

   

   marcelinhov2

   on Dec 29, 2025

   Author

   More actions

   Thanks for the response @louiscb .

   I'm using as base_url directly into my openai agent definition. This way you made is good or maybe we could add a header to the request as well, idk.
4. marcelinhov2 commented on Dec 29, 2025

   

   marcelinhov2

   on Dec 29, 2025

   Last edited by marcelinhov2

   Author

   More actions

   even passing the namespace in the querystring would be super nice and useful
5. louiscb

   linked a pull request that will close this issueAdd namespace functionality to divide cache, upgrade FAISS #48on Jan 2, 2026
6. louiscb commented on Jan 2, 2026

   

   louiscb

   on Jan 2, 2026

   Contributor

   More actions

   I've created a PR implementing the namespace feature using headers. It's not released but I've made a docker image for it you can pull it with: semcache/semcache:namespace

   You can set the namespace header with the openai sdk like:

   agent_a = OpenAI(
       base_url="http://localhost:8080",  # Semcache endpoint
       api_key=api_key,
       default_headers={"X-Semcache-Namespace": "agent-a"}
   )
   
   response = agent_a.chat.completions.create(
       model="gpt-4o",
       messages=[{"role": "user", "content": "Make up a random one line limerick!"}]
   )
   print(f"Response: {response.choices[0].message.content}")
   
   agent_b = OpenAI(
       base_url="http://localhost:8080",  # Semcache endpoint
       api_key=api_key,
       default_headers={"X-Semcache-Namespace": "agent-b"}
   )
   
   response = agent_b.chat.completions.create(
       model="gpt-4o",
       messages=[{"role": "user", "content": "Make up a random one line limerick!"}]
   )
   print(f"Response: {response.choices[0].message.content}")
   

   @marcelinhov2 test it out and lmk if it works for your agentic workflow! Once it looks good I'll go ahead and do a release