Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug][GitLab] In-progress Jobs are not getting fetched #8227

Open
2 of 3 tasks
sreeji10 opened this issue Nov 29, 2024 · 1 comment
Open
2 of 3 tasks

[Bug][GitLab] In-progress Jobs are not getting fetched #8227

sreeji10 opened this issue Nov 29, 2024 · 1 comment
Labels
component/plugins This issue or PR relates to plugins devops Something about CI/CD (devops) severity/p2 This bug doesn’t affect the functionality or isn’t evident type/bug This issue is a bug

Comments

@sreeji10
Copy link

sreeji10 commented Nov 29, 2024

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

While trying to fetch CICD metrics from GitLab, "IN_PROGRESS" cicd job details are not getting fetched.
Only successful and failed job details are getting captured.
Table: cicd_tasks
Column name: status, original_status

What do you expect to happen

"cicd_tasks" table should also have "IN_PROGRESS" job details.

How to reproduce

  1. In GitLab trigger a pipeline.
  2. Let the pipeline and associated jobs start executing.
  3. Start data collection/refresh in DevLake
  4. Post data collection, run below SQL query
    "select * from cicd_tasks"

Anything else

No response

Version

devlake-dashboard:v1.0.2-beta4

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@sreeji10 sreeji10 added the type/bug This issue is a bug label Nov 29, 2024
@sreeji10 sreeji10 changed the title [Bug][GitLab] In-progress Jobs are getting fetched [Bug][GitLab] In-progress Jobs are not getting fetched Nov 29, 2024
Copy link

dosubot bot commented Nov 29, 2024

Hello @sreeji10! I'm here to assist you with any bugs, questions, or contributions. Let's tackle this GitLab issue together!

The issue you're experiencing with "IN_PROGRESS" jobs not being captured in the cicd_tasks table might be related to how job statuses are mapped and fetched from GitLab. The possible values for the 'status' and 'original_status' columns in the cicd_tasks table are "DONE", "IN_PROGRESS", and "OTHER". These values are standardized in DevLake based on the possible states of each plugin. If the input matches any of the values in the InProgress list, the status is set to "IN_PROGRESS" [1][2].

Additionally, the data collection process includes error handling and logging, which might help identify why 'IN_PROGRESS' jobs are not being captured. The CollectJobs function uses a logger to log information and errors, which could provide insights into any issues during the job collection process [3].

You might want to check the logs for any errors or issues during the data collection process that could affect capturing 'IN_PROGRESS' jobs. Also, ensure that the configuration settings or parameters in DevLake are correctly set to fetch all job statuses from GitLab.

To continue talking to Dosu, mention @dosu.

@dosubot dosubot bot added component/plugins This issue or PR relates to plugins devops Something about CI/CD (devops) severity/p2 This bug doesn’t affect the functionality or isn’t evident labels Nov 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/plugins This issue or PR relates to plugins devops Something about CI/CD (devops) severity/p2 This bug doesn’t affect the functionality or isn’t evident type/bug This issue is a bug
Projects
None yet
Development

No branches or pull requests

1 participant