Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Astro Forum docs #120

Closed
9 tasks
mpgreg opened this issue Nov 14, 2023 · 2 comments · Fixed by #212
Closed
9 tasks

Add Astro Forum docs #120

mpgreg opened this issue Nov 14, 2023 · 2 comments · Fixed by #212
Assignees

Comments

@mpgreg
Copy link
Contributor

mpgreg commented Nov 14, 2023

Please describe the feature you'd like to see
Request from Steven to add https://forum.astronomer.io/ as a data source.

Describe the solution you'd like
Add forum docs for ingest. Some older posts are inaccurate so a "recent" (ie. last 2 years) cutoff date will be needed. Also we would want to check tags for "software" and decide whether we want to ingest those.

Are there any alternatives to this feature?
No

Additional context
Forum is powered by Discourse. https://meta.discourse.org/t/does-discourse-support-export-conversations-as-an-organized-bulk-of-data/180537

Acceptance Criteria

  • All checks and tests in the CI should pass
  • Unit tests
  • Integration tests (if the feature relates to a new database or external service)
  • Example DAG
  • Docstrings in reStructuredText for each of methods, classes, functions and module-level attributes (including Example DAG on how it should be used)
  • Exception handling in case of errors
  • Logging (are we exposing useful information to the user? e.g. source and destination)
  • Improve the documentation (README, Sphinx, and any other relevant)
  • How to use Guide for the feature (example)
@sunank200
Copy link
Collaborator

Note:

  • After the implementation is complete, the data should be ingested to the dev database and the dev slackbot should be deployed.
  • This change should be tested by @vatsrahul1001 and after his take on quality of response, this should be merged

@phanikumv
Copy link
Collaborator

PR being reviewed

pankajastro added a commit that referenced this issue Dec 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants