Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: jira connector (cloud) #1238

Merged
merged 58 commits into from
Sep 6, 2023
Merged

feat: jira connector (cloud) #1238

merged 58 commits into from
Sep 6, 2023

Conversation

ahmetmeleq
Copy link
Contributor

@ahmetmeleq ahmetmeleq commented Aug 29, 2023 •
edited by ryannikolaidis
Loading

Closes #263.

This connector:

  • takes a Jira Cloud URL, user email and api token; to authenticate into Jira Cloud
  • ingests:
    • either all issues in all projects in a Jira Cloud Organization
    • or
      • issues in user specified projects, boards
      • user specified issues
  • processes this kind of data:
    • text fields such as issue summary, description, and comments
    • dropdown fields such as issue type, status, priority, assignee, reporter, labels, and components
    • other data such as issue id, issue key, project id, information on subtasks
    • notes down attachment URLs, however does not process attachments
  • stores each downloaded issue in a txt file, in a predefined template form (consisting of the data above)
  • then processes each downloaded issue document into elements using unstructured library
  • related to: Create a data connector for JIRA #263

To test the changes, make the necessary setups and run the relevant ingest test scripts.

@ahmetmeleq ahmetmeleq self-assigned this Aug 29, 2023
@ahmetmeleq ahmetmeleq marked this pull request as ready for review August 30, 2023 22:08
@ryannikolaidis
Copy link
Contributor

reminder to create a doc page: https://github.com/Unstructured-IO/unstructured/tree/main/docs/source/upstream_connectors

@ryannikolaidis
Copy link
Contributor

reminder to define any of the various data source properties that make sense here (e.g. date_created): https://github.com/Unstructured-IO/unstructured/blob/c49df62967036e8a7922b0cf0104df6768a27ced/unstructured/ingest/interfaces.py#L118C1-L154C1

@ahmetmeleq
Copy link
Contributor Author

reminder to create a doc page: https://github.com/Unstructured-IO/unstructured/tree/main/docs/source/upstream_connectors

Addressed with 91c7f1c

@ahmetmeleq
add properties for issue data and parsed issue fields, utilize cache …
385b5c9 
…for exists property, utilize cache for inside get_file
ryannikolaidis
ryannikolaidis approved these changes Sep 6, 2023
View reviewed changes
Copy link
Contributor

@ryannikolaidis ryannikolaidis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome work! This looks great!

@ryannikolaidis @ahmetmeleq
feat: jira connector (cloud) <- Ingest test fixtures update (#1306)
d3b1367 
This pull request includes updated ingest test fixtures.
Please review and merge if appropriate.

Co-authored-by: ahmetmeleq <[email protected]>
@ahmetmeleq ahmetmeleq merged commit 09cc4bf into main Sep 6, 2023
@ahmetmeleq ahmetmeleq deleted the ahmet/ingest-jira-connector branch September 6, 2023 10:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ryannikolaidis ryannikolaidis ryannikolaidis approved these changes

Assignees

@ahmetmeleq ahmetmeleq

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Create a data connector for JIRA
2 participants
@ahmetmeleq @ryannikolaidis