Skip to content

GenAI memory ops extras (examples/prototypes) #3388

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
nagkumar91 wants to merge 12 commits into from
Closed

GenAI memory ops extras (examples/prototypes) #3388

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
65b6a14
docs(gen-ai): add memory operations proposal
nagkumar91 Jan 6, 2026
aa246b6
docs(gen-ai): fix mermaid flowchart labels
nagkumar91 Jan 6, 2026
7408112
gen-ai: add semantic conventions for memory ops
nagkumar91 Jan 7, 2026
7dfaa2b
gen-ai: keep memory op names recommended
nagkumar91 Jan 7, 2026
9ee0518
gen-ai: add memory op names to operation enum
nagkumar91 Jan 7, 2026
39cff95
prototype(memory): add story suite + App Insights viewer
nagkumar91 Jan 14, 2026
dc27234
Merge main into proposal/genai-memory-ops
nagkumar91 Jan 26, 2026
45c0428
gen-ai memory: add metrics rationale and LangChain examples
nagkumar91 Jan 26, 2026
a064dcc
Merge upstream/main and regenerate docs
nagkumar91 Feb 2, 2026
7660f99
Delete prototype/memory/scenarios/MEETING_FEEDBACK_ACTION_PLAN.md
nagkumar91 Feb 3, 2026
c86089d
chore: move gen-ai memory ops to minimal PR
nagkumar91 Feb 4, 2026
b4c36d8
chore: drop gen-ai memory ops from extras
nagkumar91 Feb 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions docs/gen-ai/anthropic.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -213,12 +213,17 @@ populating this attribute.
| --- | --- | --- |
| `chat` | Chat completion operation such as [OpenAI Chat API](https://platform.openai.com/docs/api-reference/chat) | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_agent` | Create GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_memory_store` | Create/initialize a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory` | Delete memory items (by id, or by scope+namespace) | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory_store` | Delete/deprovision a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `embeddings` | Embeddings operation such as [OpenAI Create embeddings API](https://platform.openai.com/docs/api-reference/embeddings/create) | ![Development](https://img.shields.io/badge/-development-blue) |
| `execute_tool` | Execute a tool | ![Development](https://img.shields.io/badge/-development-blue) |
| `generate_content` | Multimodal content generation operation such as [Gemini Generate Content](https://ai.google.dev/api/generate-content) | ![Development](https://img.shields.io/badge/-development-blue) |
| `invoke_agent` | Invoke GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `retrieval` | Retrieval operation such as [OpenAI Search Vector Store API](https://platform.openai.com/docs/api-reference/vector-stores/search) | ![Development](https://img.shields.io/badge/-development-blue) |
| `search_memory` | Search/query memories from a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `text_completion` | Text completions operation such as [OpenAI Completions API (Legacy)](https://platform.openai.com/docs/api-reference/completions) | ![Development](https://img.shields.io/badge/-development-blue) |
| `update_memory` | Create or update (upsert) memory items | ![Development](https://img.shields.io/badge/-development-blue) |

---

Expand Down
5 changes: 5 additions & 0 deletions docs/gen-ai/aws-bedrock.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -237,12 +237,17 @@ and SHOULD be provided **at span creation time** (if provided at all):
| --- | --- | --- |
| `chat` | Chat completion operation such as [OpenAI Chat API](https://platform.openai.com/docs/api-reference/chat) | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_agent` | Create GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_memory_store` | Create/initialize a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory` | Delete memory items (by id, or by scope+namespace) | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory_store` | Delete/deprovision a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `embeddings` | Embeddings operation such as [OpenAI Create embeddings API](https://platform.openai.com/docs/api-reference/embeddings/create) | ![Development](https://img.shields.io/badge/-development-blue) |
| `execute_tool` | Execute a tool | ![Development](https://img.shields.io/badge/-development-blue) |
| `generate_content` | Multimodal content generation operation such as [Gemini Generate Content](https://ai.google.dev/api/generate-content) | ![Development](https://img.shields.io/badge/-development-blue) |
| `invoke_agent` | Invoke GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `retrieval` | Retrieval operation such as [OpenAI Search Vector Store API](https://platform.openai.com/docs/api-reference/vector-stores/search) | ![Development](https://img.shields.io/badge/-development-blue) |
| `search_memory` | Search/query memories from a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `text_completion` | Text completions operation such as [OpenAI Completions API (Legacy)](https://platform.openai.com/docs/api-reference/completions) | ![Development](https://img.shields.io/badge/-development-blue) |
| `update_memory` | Create or update (upsert) memory items | ![Development](https://img.shields.io/badge/-development-blue) |

---

Expand Down
5 changes: 5 additions & 0 deletions docs/gen-ai/azure-ai-inference.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -238,12 +238,17 @@ and SHOULD be provided **at span creation time** (if provided at all):
| --- | --- | --- |
| `chat` | Chat completion operation such as [OpenAI Chat API](https://platform.openai.com/docs/api-reference/chat) | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_agent` | Create GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_memory_store` | Create/initialize a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory` | Delete memory items (by id, or by scope+namespace) | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory_store` | Delete/deprovision a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `embeddings` | Embeddings operation such as [OpenAI Create embeddings API](https://platform.openai.com/docs/api-reference/embeddings/create) | ![Development](https://img.shields.io/badge/-development-blue) |
| `execute_tool` | Execute a tool | ![Development](https://img.shields.io/badge/-development-blue) |
| `generate_content` | Multimodal content generation operation such as [Gemini Generate Content](https://ai.google.dev/api/generate-content) | ![Development](https://img.shields.io/badge/-development-blue) |
| `invoke_agent` | Invoke GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `retrieval` | Retrieval operation such as [OpenAI Search Vector Store API](https://platform.openai.com/docs/api-reference/vector-stores/search) | ![Development](https://img.shields.io/badge/-development-blue) |
| `search_memory` | Search/query memories from a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `text_completion` | Text completions operation such as [OpenAI Completions API (Legacy)](https://platform.openai.com/docs/api-reference/completions) | ![Development](https://img.shields.io/badge/-development-blue) |
| `update_memory` | Create or update (upsert) memory items | ![Development](https://img.shields.io/badge/-development-blue) |

---

Expand Down
20 changes: 20 additions & 0 deletions docs/gen-ai/mcp.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -246,12 +246,17 @@ deserialize it to an object. When recorded on spans, it MAY be recorded as a JSO
| --- | --- | --- |
| `chat` | Chat completion operation such as [OpenAI Chat API](https://platform.openai.com/docs/api-reference/chat) | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_agent` | Create GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_memory_store` | Create/initialize a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory` | Delete memory items (by id, or by scope+namespace) | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory_store` | Delete/deprovision a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `embeddings` | Embeddings operation such as [OpenAI Create embeddings API](https://platform.openai.com/docs/api-reference/embeddings/create) | ![Development](https://img.shields.io/badge/-development-blue) |
| `execute_tool` | Execute a tool | ![Development](https://img.shields.io/badge/-development-blue) |
| `generate_content` | Multimodal content generation operation such as [Gemini Generate Content](https://ai.google.dev/api/generate-content) | ![Development](https://img.shields.io/badge/-development-blue) |
| `invoke_agent` | Invoke GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `retrieval` | Retrieval operation such as [OpenAI Search Vector Store API](https://platform.openai.com/docs/api-reference/vector-stores/search) | ![Development](https://img.shields.io/badge/-development-blue) |
| `search_memory` | Search/query memories from a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `text_completion` | Text completions operation such as [OpenAI Completions API (Legacy)](https://platform.openai.com/docs/api-reference/completions) | ![Development](https://img.shields.io/badge/-development-blue) |
| `update_memory` | Create or update (upsert) memory items | ![Development](https://img.shields.io/badge/-development-blue) |

---

Expand Down Expand Up @@ -405,12 +410,17 @@ It SHOULD be set to `pipe` if the transport is stdio.
| --- | --- | --- |
| `chat` | Chat completion operation such as [OpenAI Chat API](https://platform.openai.com/docs/api-reference/chat) | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_agent` | Create GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_memory_store` | Create/initialize a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory` | Delete memory items (by id, or by scope+namespace) | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory_store` | Delete/deprovision a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `embeddings` | Embeddings operation such as [OpenAI Create embeddings API](https://platform.openai.com/docs/api-reference/embeddings/create) | ![Development](https://img.shields.io/badge/-development-blue) |
| `execute_tool` | Execute a tool | ![Development](https://img.shields.io/badge/-development-blue) |
| `generate_content` | Multimodal content generation operation such as [Gemini Generate Content](https://ai.google.dev/api/generate-content) | ![Development](https://img.shields.io/badge/-development-blue) |
| `invoke_agent` | Invoke GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `retrieval` | Retrieval operation such as [OpenAI Search Vector Store API](https://platform.openai.com/docs/api-reference/vector-stores/search) | ![Development](https://img.shields.io/badge/-development-blue) |
| `search_memory` | Search/query memories from a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `text_completion` | Text completions operation such as [OpenAI Completions API (Legacy)](https://platform.openai.com/docs/api-reference/completions) | ![Development](https://img.shields.io/badge/-development-blue) |
| `update_memory` | Create or update (upsert) memory items | ![Development](https://img.shields.io/badge/-development-blue) |

---

Expand Down Expand Up @@ -543,12 +553,17 @@ It SHOULD be set to `pipe` if the transport is stdio.
| --- | --- | --- |
| `chat` | Chat completion operation such as [OpenAI Chat API](https://platform.openai.com/docs/api-reference/chat) | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_agent` | Create GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_memory_store` | Create/initialize a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory` | Delete memory items (by id, or by scope+namespace) | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory_store` | Delete/deprovision a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `embeddings` | Embeddings operation such as [OpenAI Create embeddings API](https://platform.openai.com/docs/api-reference/embeddings/create) | ![Development](https://img.shields.io/badge/-development-blue) |
| `execute_tool` | Execute a tool | ![Development](https://img.shields.io/badge/-development-blue) |
| `generate_content` | Multimodal content generation operation such as [Gemini Generate Content](https://ai.google.dev/api/generate-content) | ![Development](https://img.shields.io/badge/-development-blue) |
| `invoke_agent` | Invoke GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `retrieval` | Retrieval operation such as [OpenAI Search Vector Store API](https://platform.openai.com/docs/api-reference/vector-stores/search) | ![Development](https://img.shields.io/badge/-development-blue) |
| `search_memory` | Search/query memories from a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `text_completion` | Text completions operation such as [OpenAI Completions API (Legacy)](https://platform.openai.com/docs/api-reference/completions) | ![Development](https://img.shields.io/badge/-development-blue) |
| `update_memory` | Create or update (upsert) memory items | ![Development](https://img.shields.io/badge/-development-blue) |

---

Expand Down Expand Up @@ -673,12 +688,17 @@ It SHOULD be set to `pipe` if the transport is stdio.
| --- | --- | --- |
| `chat` | Chat completion operation such as [OpenAI Chat API](https://platform.openai.com/docs/api-reference/chat) | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_agent` | Create GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_memory_store` | Create/initialize a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory` | Delete memory items (by id, or by scope+namespace) | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory_store` | Delete/deprovision a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `embeddings` | Embeddings operation such as [OpenAI Create embeddings API](https://platform.openai.com/docs/api-reference/embeddings/create) | ![Development](https://img.shields.io/badge/-development-blue) |
| `execute_tool` | Execute a tool | ![Development](https://img.shields.io/badge/-development-blue) |
| `generate_content` | Multimodal content generation operation such as [Gemini Generate Content](https://ai.google.dev/api/generate-content) | ![Development](https://img.shields.io/badge/-development-blue) |
| `invoke_agent` | Invoke GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `retrieval` | Retrieval operation such as [OpenAI Search Vector Store API](https://platform.openai.com/docs/api-reference/vector-stores/search) | ![Development](https://img.shields.io/badge/-development-blue) |
| `search_memory` | Search/query memories from a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `text_completion` | Text completions operation such as [OpenAI Completions API (Legacy)](https://platform.openai.com/docs/api-reference/completions) | ![Development](https://img.shields.io/badge/-development-blue) |
| `update_memory` | Create or update (upsert) memory items | ![Development](https://img.shields.io/badge/-development-blue) |

---

Expand Down
5 changes: 5 additions & 0 deletions docs/gen-ai/openai.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -240,12 +240,17 @@ and SHOULD be provided **at span creation time** (if provided at all):
| --- | --- | --- |
| `chat` | Chat completion operation such as [OpenAI Chat API](https://platform.openai.com/docs/api-reference/chat) | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_agent` | Create GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `create_memory_store` | Create/initialize a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory` | Delete memory items (by id, or by scope+namespace) | ![Development](https://img.shields.io/badge/-development-blue) |
| `delete_memory_store` | Delete/deprovision a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `embeddings` | Embeddings operation such as [OpenAI Create embeddings API](https://platform.openai.com/docs/api-reference/embeddings/create) | ![Development](https://img.shields.io/badge/-development-blue) |
| `execute_tool` | Execute a tool | ![Development](https://img.shields.io/badge/-development-blue) |
| `generate_content` | Multimodal content generation operation such as [Gemini Generate Content](https://ai.google.dev/api/generate-content) | ![Development](https://img.shields.io/badge/-development-blue) |
| `invoke_agent` | Invoke GenAI agent | ![Development](https://img.shields.io/badge/-development-blue) |
| `retrieval` | Retrieval operation such as [OpenAI Search Vector Store API](https://platform.openai.com/docs/api-reference/vector-stores/search) | ![Development](https://img.shields.io/badge/-development-blue) |
| `search_memory` | Search/query memories from a memory store | ![Development](https://img.shields.io/badge/-development-blue) |
| `text_completion` | Text completions operation such as [OpenAI Completions API (Legacy)](https://platform.openai.com/docs/api-reference/completions) | ![Development](https://img.shields.io/badge/-development-blue) |
| `update_memory` | Create or update (upsert) memory items | ![Development](https://img.shields.io/badge/-development-blue) |

---

Expand Down
16 changes: 16 additions & 0 deletions prototype/memory/.gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
# Local credentials / secrets (never commit)
.env.local
scenarios/.env.local

# Python
__pycache__/
*.pyc
*.pyo
.pytest_cache/

# Virtual environments
.venv/
venv/

# OS
.DS_Store
34 changes: 34 additions & 0 deletions prototype/memory/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
# GenAI Memory Prototype (Stories + Trace Viewer)

This directory contains runnable, non-normative code demonstrating the GenAI **memory operation** semantic conventions through a small story suite and an Azure Application Insights trace viewer.

**Key paths**
- Stories + viewer docs: `prototype/memory/scenarios/README.md`
- One-command runner + viewer: `prototype/memory/scenarios/run_and_view.py`
- Viewer UI: `prototype/memory/scenarios/trace_viewer.py`
- App Insights query logic: `prototype/memory/scenarios/trace_retriever.py`
- Instrumentation helpers (Python): `prototype/memory/core/python/genai_memory_otel`

## Quickstart

```bash
cd prototype/memory

python3 -m venv .venv
source .venv/bin/activate
python3 -m pip install -r requirements-appinsights.txt

# Configure credentials (git-ignored)
cp scenarios/.env.sample scenarios/.env.local

# Run stories + export to App Insights + launch viewer
python3 scenarios/run_and_view.py

# Opt-in (SENSITIVE): include input/output messages, queries, and memory content
python3 scenarios/run_and_view.py --capture-content
```

## Notes

- The viewer queries App Insights via Entra ID (Azure CLI): run `az login` and set `APPINSIGHTS_RESOURCE_ID` (or `APPINSIGHTS_APP` + `APPINSIGHTS_RESOURCE_GROUP`).
- Real LLM calls are optional; if `OPENAI_API_KEY` is unset (or the `openai` package isn’t installed), stories fall back to a mock model.
Loading