Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create AskAstroWeaviateHook which uses OSS Weavaite Hook in ask-astro-load.py #134

Closed
sunank200 opened this issue Nov 17, 2023 · 0 comments · Fixed by #132
Closed

Create AskAstroWeaviateHook which uses OSS Weavaite Hook in ask-astro-load.py #134

sunank200 opened this issue Nov 17, 2023 · 0 comments · Fixed by #132
Assignees
@sunank200
Milestone
0.1.0

Comments

@sunank200
Copy link
Collaborator

sunank200 commented Nov 17, 2023 •
edited
Loading

  • Current DAGs in Ask-Astro don't use OSS Weviate provider. Implement AskAstroWeaviateHook which inherits from WeavaiteHook from OSS.
  • Add ingest data function to AskAstroWeaviateHook.
  • Add upsert data function to AskAstroWeaviateHook.
  • Use AskAstroWeaviateHook as the taskflow API for ask-astro-load.py
@sunank200 sunank200 self-assigned this Nov 17, 2023
@sunank200 sunank200 added this to the 0.1.0 milestone Nov 17, 2023
@sunank200 sunank200 mentioned this issue Nov 17, 2023
Closed
@sunank200 sunank200 changed the title Create AskAstroWeaviateHook which uses OSS Weavaite Hook Create AskAstroWeaviateHook which uses OSS Weavaite Hook in ask-astro-load.py Nov 17, 2023
This was referenced Nov 17, 2023
Closed
Closed
Closed
Closed
Closed
Closed
Merged
pull bot pushed a commit to rpatil524/ask-astro that referenced this issue Nov 24, 2023
@sunank200
Create TaskFlow API to use WeaviateHook and use taskflow API for ask-…
1067794 
…astro-load.py (astronomer#132)

- I have taken airflow Docs ingestion for my implementation. Hence
commits from Michael.
- Create `AskAstroWeaviateHook` which inherits from OSS `WeaviateHook`.
- Add `get_schema`, `check_schema`, `create_schema`,
`handle_upsert_rollback` and `ingest_data`
- Use Taskflow API for `ask-astro-load.py`.
- Add airflow docs as source


closes: astronomer#134
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sunank200 sunank200

Labels
None yet
Projects
None yet
Milestone
0.1.0
1 participant
@sunank200