Skip to content

chore: Fix chrome version to 129#38183

Merged
yatinappsmith merged 22 commits intoreleasefrom
chore/fixchromeversionforanvil
Dec 17, 2024
Merged

chore: Fix chrome version to 129#38183
yatinappsmith merged 22 commits intoreleasefrom
chore/fixchromeversionforanvil

Conversation

@sagar-qa007
Copy link
Contributor

@sagar-qa007 sagar-qa007 commented Dec 16, 2024

Description

Fix chrome version for snapshot testing.

Fixes #Issue Number
or
Fixes Issue URL

Warning

If no issue exists, please create an issue first, and check with the maintainers if the issue is valid.

Automation

/ok-to-test tags="@tag.Sanity"

🔍 Cypress test results

Tip

🟢 🟢 🟢 All cypress tests have passed! 🎉 🎉 🎉
Workflow run: https://github.com/appsmithorg/appsmith/actions/runs/12371605353
Commit: cc4ac10
Cypress dashboard.
Tags: @tag.Sanity
Spec:


Tue, 17 Dec 2024 11:35:17 UTC

Communication

Should the DevRel and Marketing teams inform users about this change?

  • Yes
  • No

Summary by CodeRabbit

  • New Features

    • Added new input parameters (ted_tag, run_count, previous-workflow-run-id) to enhance workflow flexibility.
    • Introduced service containers for Redis and MongoDB in CI tests.
    • Improved Slack notifications with dynamic messages based on test outcomes.
  • Bug Fixes

    • Enhanced error handling and logging for better management of previous run results.
  • Improvements

    • Updated Chrome installation method to a specific version (129.0.6668.100) across all workflows.
    • Refined job conditions to ensure proper execution under specific scenarios.
  • Chores

    • Adjusted cron schedule for CI tests to run every weekday at 1:30 AM UTC.

@coderabbitai
Copy link
Contributor

coderabbitai bot commented Dec 16, 2024

Walkthrough

The pull request focuses on updating multiple GitHub Actions workflow files for Appsmith's CI testing infrastructure. The changes primarily involve refining workflow configurations, adding new input parameters, updating Chrome installation methods, and enhancing test execution flexibility. Key modifications include introducing ted_tag and run_count parameters, updating Chrome version to 129.0.6668.100, and improving job conditions and caching mechanisms across different workflow files.

Changes

File Change Summary
.github/workflows/ci-test-custom-script.yml - Added ted_tag input parameter
- Added Redis and MongoDB service containers
- Updated Chrome version to 129.0.6668.100
- Enhanced caching and test rerun logic
.github/workflows/ci-test-hosted.yml - Updated cron schedule to weekdays at 1:30 AM UTC
- Modified Chrome installation method
- Improved Slack notification mechanism
.github/workflows/ci-test-limited-with-count.yml - Added run_count input parameter
- Updated Chrome installation to version 129.0.6668.100
.github/workflows/ci-test-limited.yml - Added previous-workflow-run-id input parameter
- Updated Chrome installation
- Enhanced artifact and error handling

Sequence Diagram

sequenceDiagram
    participant Workflow as GitHub Workflow
    participant Chrome as Chrome Setup
    participant Tests as Test Runner
    participant Cache as Artifact Cache

    Workflow->>Chrome: Install Chrome v129.0.6668.100
    Chrome-->>Workflow: Chrome installed
    Workflow->>Cache: Restore previous artifacts
    Cache-->>Workflow: Artifacts retrieved
    Workflow->>Tests: Execute tests
    Tests-->>Workflow: Test results
    Workflow->>Cache: Store test results
Loading

Possibly related PRs

Suggested Labels

Task

Suggested Reviewers

  • sharat87
  • ApekshaBhosale
  • yatinappsmith

Poem

🤖 Workflows dancing, scripts so bright
CI pipelines taking flight
Chrome installed with surgical care
Tests running everywhere
Automation's poetic might! 🚀


Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?

❤️ Share
🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>, please review it.
    • Generate unit testing code for this file.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai generate unit testing code for this file.
    • @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    • @coderabbitai read src/utils.ts and generate unit testing code.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.
    • @coderabbitai help me debug CodeRabbit configuration file.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (Invoked using PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai full review to do a full review from scratch and review all the files again.
  • @coderabbitai summary to regenerate the summary of the PR.
  • @coderabbitai generate docstrings to generate docstrings for this PR. (Beta)
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai configuration to show the current CodeRabbit configuration for the repository.
  • @coderabbitai help to get help.

Other keywords and placeholders

  • Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai anywhere in the PR title to generate the title automatically.

Documentation and Community

  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

@github-actions github-actions bot added the skip-changelog Adding this label to a PR prevents it from being listed in the changelog label Dec 16, 2024
yatinappsmith
yatinappsmith previously approved these changes Dec 16, 2024
@sagar-qa007 sagar-qa007 added the ok-to-test Required label for CI label Dec 16, 2024
Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🧹 Nitpick comments (2)
.github/workflows/ci-test-limited-with-count.yml (1)

Line range hint 13-15: Good addition of run_count parameter

The implementation of run_count parameter with cypress-repeat-pro enhances test reliability by allowing multiple test runs. This is particularly useful for identifying flaky tests.

Consider adding documentation about recommended run_count values for different test scenarios.

🧰 Tools
🪛 actionlint (1.7.4)

236-236: shellcheck reported issue in this script: SC2086:info:1:40: Double quote to prevent globbing and word splitting

(shellcheck)

.github/workflows/ci-test-custom-script.yml (1)

Line range hint 7-11: Consider parameterizing Chrome version

Since you've added the ted_tag parameter for flexibility, consider making the Chrome version configurable as well. This would allow easier version updates and testing across different Chrome versions.

 workflow_call:
   inputs:
+    chrome_version:
+      description: "Chrome version to use for testing"
+      required: false
+      type: string
+      default: "129"
     pr:
       description: "This is the PR number in case the workflow is being called in a pull request"
       required: false
       type: number

# Later in the file
      - uses: browser-actions/setup-chrome@latest
        with:
-          chrome-version: 129
+          chrome-version: ${{ inputs.chrome_version }}

Also applies to: 259-259

🧰 Tools
🪛 actionlint (1.7.4)

260-260: shellcheck reported issue in this script: SC2086:info:1:40: Double quote to prevent globbing and word splitting

(shellcheck)

📜 Review details

Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between a5fa2aa and de463ba.

📒 Files selected for processing (4)
  • .github/workflows/ci-test-custom-script.yml (1 hunks)
  • .github/workflows/ci-test-hosted.yml (1 hunks)
  • .github/workflows/ci-test-limited-with-count.yml (1 hunks)
  • .github/workflows/ci-test-limited.yml (1 hunks)
🔇 Additional comments (3)
.github/workflows/ci-test-limited.yml (1)

226-226: Chrome version update

The Chrome version update is consistent with other workflow files.

.github/workflows/ci-test-limited-with-count.yml (1)

235-235: Chrome version update

The Chrome version update is consistent with other workflow files.

.github/workflows/ci-test-custom-script.yml (1)

Line range hint 19-23: LGTM! Well-structured input parameter for TestEventDriver

The addition of the ted_tag parameter with a default value of 'latest' provides good flexibility for testing with different versions while maintaining backward compatibility.

🧰 Tools
🪛 actionlint (1.7.4)

260-260: shellcheck reported issue in this script: SC2086:info:1:40: Double quote to prevent globbing and word splitting

(shellcheck)

- uses: browser-actions/setup-chrome@latest
with:
chrome-version: stable
chrome-version: 129
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codebase verification

Chrome version 129 is too far ahead of current stable releases

The project uses Cypress 13.13.0 for testing, and Chrome 129 is not yet released (current stable is 120). Using unreleased browser versions in CI can lead to instability.

  • Recommend using Chrome version 120 or lower to match current stable releases
  • Update .github/workflows/ci-test-hosted.yml line 142
🔗 Analysis chain

Verify Chrome version compatibility with test suite

The change to Chrome version 129 should be validated against the test suite requirements and browser compatibility matrix.

Consider implementing browser version compatibility checks in the test suite to prevent issues with future version updates.


Let me check the specific browser version requirements in these files.


Let me check the Cypress configuration to understand browser testing requirements.

🏁 Scripts executed

The following scripts were executed for the analysis:

Script:

#!/bin/bash
# Description: Check Chrome version compatibility with test suite
# Look for any browser version specific code or configurations
rg -g '*.{ts,js,json}' -l 'chrome.*version|browser.*version' app/client/

Length of output: 261


Script:

#!/bin/bash
# Check the content of files for Chrome version references
rg -g '*.{ts,js,json}' 'chrome.*version|browser.*version' app/client/test/factories/MockPluginsState.ts
rg -g '*.{ts,js,json}' 'chrome.*version|browser.*version' app/client/cypress/fixtures/CommunityIssuesExport.json

# Check package.json for any browser dependencies
rg -g 'package.json' '"(cypress|playwright|puppeteer|selenium)"' .

# Check for any browser configuration in Cypress
fd -g 'cypress.config.*' .

Length of output: 66731


Script:

#!/bin/bash
# Check Cypress configuration and browser settings
fd -t f -e json -e js cypress.config
fd -t f package.json -x cat {} \; | grep -A 5 -B 5 '"cypress":'

Length of output: 520

- uses: browser-actions/setup-chrome@latest
with:
chrome-version: stable
chrome-version: 129
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codebase verification

Chrome 129 is compatible but consider using version range

Chrome 129 is a stable version and compatible with Cypress 13.13.0, but fixing to a specific version might be restrictive. Consider using a version range (e.g., >= 129.0.0) to get security updates while maintaining stability.

  • Update line 259 to use chrome-version: '>=129.0.0' for better maintainability and security
🔗 Analysis chain

Verify Chrome version 129 compatibility

Fixing the Chrome version can help with test stability, but version 129 needs verification:

  1. Ensure it's compatible with your Cypress version
  2. Consider potential security implications of using a fixed version

Let me analyze the Cypress configuration to ensure compatibility with Chrome 129. The previous results confirm Chrome 129 is a stable version, but we need to verify Cypress compatibility.

🏁 Scripts executed

The following scripts were executed for the analysis:

Script:

#!/bin/bash
# Check if Chrome 129 is a stable version and get its release date
curl -s https://versionhistory.googleapis.com/v1/chrome/platforms/linux/channels/stable/versions | jq -r '.versions[] | select(.version | startswith("129"))'

# Check Cypress compatibility matrix
curl -s https://raw.githubusercontent.com/cypress-io/cypress-documentation/develop/content/guides/references/browser-launch-api.md | grep -A 5 "Chrome version support"

Length of output: 763


Script:

#!/bin/bash
# Let's check the Cypress configuration and version in the repository
fd -e json package.json --exec cat {} | jq -r 'select(.dependencies.cypress or .devDependencies.cypress) | .dependencies.cypress, .devDependencies.cypress'

# Check if there are any Cypress configuration files
fd -e json -e js cypress.config

Length of output: 206

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

📜 Review details

Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between de463ba and 675b2d8.

📒 Files selected for processing (4)
  • .github/workflows/ci-test-custom-script.yml (1 hunks)
  • .github/workflows/ci-test-hosted.yml (1 hunks)
  • .github/workflows/ci-test-limited-with-count.yml (1 hunks)
  • .github/workflows/ci-test-limited.yml (1 hunks)
🚧 Files skipped from review as they are similar to previous changes (2)
  • .github/workflows/ci-test-hosted.yml
  • .github/workflows/ci-test-custom-script.yml

- uses: browser-actions/setup-chrome@latest
with:
chrome-version: stable
chrome-version: 130
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue

Chrome version (130) doesn't match PR objective (129)

The PR objective states that Chrome version should be fixed to 129, but this line sets it to 130.

Apply this change to align with PR objective:

-          chrome-version: 130
+          chrome-version: 129
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
chrome-version: 130
chrome-version: 129

- uses: browser-actions/setup-chrome@latest
with:
chrome-version: stable
chrome-version: 130
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue

Chrome version (130) doesn't match PR objective (129)

The PR objective states that Chrome version should be fixed to 129, but this line sets it to 130.

Apply this change to align with PR objective:

-          chrome-version: 130
+          chrome-version: 129
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
chrome-version: 130
chrome-version: 129

@sagar-qa007 sagar-qa007 added ok-to-test Required label for CI and removed ok-to-test Required label for CI labels Dec 17, 2024
Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🧹 Nitpick comments (3)
.github/workflows/ci-test-hosted.yml (1)

147-148: Quote the Chrome path to prevent word splitting

The Chrome path should be quoted to prevent potential issues with spaces or special characters.

-          echo "BROWSER_PATH=${{ steps.setup-chrome.outputs.chrome-path }}" >> $GITHUB_ENV
-          ${{ steps.setup-chrome.outputs.chrome-path }} --version
+          echo "BROWSER_PATH=\"${{ steps.setup-chrome.outputs.chrome-path }}\"" >> $GITHUB_ENV
+          "${{ steps.setup-chrome.outputs.chrome-path }}" --version
.github/workflows/ci-test-limited.yml (1)

223-223: Remove trailing whitespace

There is a trailing whitespace on this line that should be removed.

🧰 Tools
🪛 yamllint (1.35.1)

[error] 223-223: trailing spaces

(trailing-spaces)

.github/workflows/ci-test-custom-script.yml (1)

264-265: Add quotes around Chrome path variable

The Chrome path should be quoted to prevent potential issues with paths containing spaces.

- echo "BROWSER_PATH=${{ steps.setup-chrome.outputs.chrome-path }}" >> $GITHUB_ENV
- ${{ steps.setup-chrome.outputs.chrome-path }} --version
+ echo "BROWSER_PATH=\"${{ steps.setup-chrome.outputs.chrome-path }}\"" >> $GITHUB_ENV
+ "${{ steps.setup-chrome.outputs.chrome-path }}" --version
📜 Review details

Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 8b373f9 and 0f12909.

📒 Files selected for processing (4)
  • .github/workflows/ci-test-custom-script.yml (1 hunks)
  • .github/workflows/ci-test-hosted.yml (1 hunks)
  • .github/workflows/ci-test-limited-with-count.yml (1 hunks)
  • .github/workflows/ci-test-limited.yml (1 hunks)
🧰 Additional context used
🪛 actionlint (1.7.4)
.github/workflows/ci-test-custom-script.yml

263-263: shellcheck reported issue in this script: SC2086:info:1:70: Double quote to prevent globbing and word splitting

(shellcheck)

.github/workflows/ci-test-limited.yml

230-230: shellcheck reported issue in this script: SC2086:info:1:70: Double quote to prevent globbing and word splitting

(shellcheck)

.github/workflows/ci-test-hosted.yml

146-146: shellcheck reported issue in this script: SC2086:info:1:70: Double quote to prevent globbing and word splitting

(shellcheck)

.github/workflows/ci-test-limited-with-count.yml

239-239: shellcheck reported issue in this script: SC2086:info:1:70: Double quote to prevent globbing and word splitting

(shellcheck)

🪛 yamllint (1.35.1)
.github/workflows/ci-test-limited.yml

[error] 223-223: trailing spaces

(trailing-spaces)

🔇 Additional comments (6)
.github/workflows/ci-test-hosted.yml (1)

141-145: Chrome setup configuration looks good

The Chrome version is correctly set to 129 as specified in the PR objective, with proper configuration for chromedriver and dependencies.

.github/workflows/ci-test-limited.yml (2)

225-229: Chrome setup configuration looks good

The Chrome version is correctly set to 129 as specified in the PR objective, with proper configuration for chromedriver and dependencies.


231-232: Quote the Chrome path to prevent word splitting

The Chrome path should be quoted to prevent potential issues with spaces or special characters.

.github/workflows/ci-test-limited-with-count.yml (2)

234-238: Chrome setup configuration looks good

The Chrome version is correctly set to 129 as specified in the PR objective, with proper configuration for chromedriver and dependencies.


240-241: Quote the Chrome path to prevent word splitting

The Chrome path should be quoted to prevent potential issues with spaces or special characters.

.github/workflows/ci-test-custom-script.yml (1)

260-262: Chrome 129 is compatible but consider using version range

Chrome 129 is a stable version and compatible with Cypress 13.13.0, but fixing to a specific version might be restrictive. Consider using a version range (e.g., >= 129.0.0) to get security updates while maintaining stability.

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

📜 Review details

Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 0f12909 and 8b02cb3.

📒 Files selected for processing (1)
  • .github/workflows/ci-test-custom-script.yml (2 hunks)
🧰 Additional context used
🪛 actionlint (1.7.4)
.github/workflows/ci-test-custom-script.yml

263-263: shellcheck reported issue in this script: SC2086:info:1:70: Double quote to prevent globbing and word splitting

(shellcheck)

🔇 Additional comments (2)
.github/workflows/ci-test-custom-script.yml (2)

261-262: LGTM! Good practice setting explicit install flags

Explicitly setting install-chromedriver and install-dependencies to true improves workflow reproducibility.


Line range hint 373-377: LGTM! Proper Cypress test configuration

The Cypress test configuration is well-structured with appropriate browser selection and environment settings.

Comment on lines +258 to +265
id: setup-chrome
with:
chrome-version: stable
chrome-version: 129
install-chromedriver: true
install-dependencies: true
- run: |
echo "BROWSER_PATH=$(which chrome)" >> $GITHUB_ENV
echo "BROWSER_PATH=${{ steps.setup-chrome.outputs.chrome-path }}" >> $GITHUB_ENV
${{ steps.setup-chrome.outputs.chrome-path }} --version
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codebase verification

⚠️ Potential issue

Chrome version 129 is not yet released and may cause issues

The current stable Chrome version is 120. Using an unreleased version (129) could cause compatibility issues with Cypress and affect test reliability. Please use Chrome version 120 instead.

  id: setup-chrome
  with:
-   chrome-version: 129
+   chrome-version: 120
    install-chromedriver: true
    install-dependencies: true
🔗 Analysis chain

Chrome version 129 is not yet released and may cause issues

The current stable Chrome version is 120. Using an unreleased version (129) could cause compatibility issues with Cypress and affect snapshot testing reliability.

Apply this diff to fix the Chrome version:

  with:
-   chrome-version: 129
+   chrome-version: 120
    install-chromedriver: true
    install-dependencies: true
🏁 Scripts executed

The following scripts were executed for the analysis:

Script:

#!/bin/bash
# Verify Chrome version compatibility with Cypress
fd -e json package.json --exec jq -r '.dependencies.cypress, .devDependencies.cypress'

# Check Cypress configuration for browser settings
fd -e json -e js cypress.config --exec cat {}

Length of output: 291


Script:

#!/bin/bash
# Check for any browser-related configurations in package.json files
fd -e json package.json --exec grep -l "browser\|chrome" {} | xargs cat

# Search for browser configuration in any test setup files
rg -g "!node_modules" -g "!dist" -l "browser.+config|chrome.+config" 

# Look for any Playwright or Selenium configurations
fd -e config.js -e config.ts -e config.json --exec grep -l "browser\|chrome" {}

# Check GitHub workflow files for browser-related jobs
fd workflow -e yml -e yaml --exec grep -A 5 -B 5 "chrome-version:" {}

Length of output: 15487


Script:

#!/bin/bash
# Check Cypress configuration files for browser settings
cat app/client/cypress.config.ts app/client/cypress_ci.config.ts app/client/cypress_ci_custom.config.ts

# Look for Chrome version references in workflow files
fd -e yml -e yaml . --exec cat {} | grep -A 10 -B 10 "chrome-version:"

Length of output: 4963


Script:

#!/bin/bash
# Search for Chrome version in GitHub workflow files directly
find .github/workflows -type f -name "*.yml" -exec cat {} \;

# Check for any Chrome-related environment variables in workflow files
find .github/workflows -type f -exec grep -l "chrome" {} \;

Length of output: 67658


Script:

#!/bin/bash
# Search for Chrome version in ci-test-custom-script.yml
cat .github/workflows/ci-test-custom-script.yml

# Check for any Cypress browser configuration files
fd -e json -e js -e ts -g "!node_modules" -g "!dist" --exec grep -l "browser.*config\|chrome.*config" {}

Length of output: 21044

🧰 Tools
🪛 actionlint (1.7.4)

263-263: shellcheck reported issue in this script: SC2086:info:1:70: Double quote to prevent globbing and word splitting

(shellcheck)

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

📜 Review details

Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 8b02cb3 and 9c2aad1.

📒 Files selected for processing (1)
  • .github/workflows/ci-test-custom-script.yml (2 hunks)
🔇 Additional comments (1)
.github/workflows/ci-test-custom-script.yml (1)

260-266: ⚠️ Potential issue

Remove commented code and use stable Chrome version

The commented Chrome setup block specifies version 129 which:

  1. Conflicts with the container specification using Chrome 130
  2. Is not yet released (current stable is 120)

Either:

  1. Remove the commented code if not needed, or
  2. Uncomment and fix the version:
- # - uses: browser-actions/setup-chrome@latest
- #   id: setup-chrome
- #   with:
- #     chrome-version: 129
- #     install-chromedriver: true
- #     install-dependencies: true

or

  - uses: browser-actions/setup-chrome@latest
    id: setup-chrome
    with:
-     chrome-version: 129
+     chrome-version: 120
      install-chromedriver: true
      install-dependencies: true

Likely invalid or redundant comment.

Comment on lines +36 to +38
container:
image: cypress/browsers:node-20.18.0-chrome-130.0.6723.69-1-ff-131.0.3-edge-130.0.2849.52-1
options: --user 1001
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue

Version mismatch with PR objective

The container specification uses Chrome 130, but the PR objective is to fix the Chrome version to 129. This inconsistency could lead to test reliability issues.

   container:
-    image: cypress/browsers:node-20.18.0-chrome-130.0.6723.69-1-ff-131.0.3-edge-130.0.2849.52-1
+    image: cypress/browsers:node-20.18.0-chrome-120.0.6099.129-1-ff-120.0-edge-120.0.2210.61-1
     options: --user 1001
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
container:
image: cypress/browsers:node-20.18.0-chrome-130.0.6723.69-1-ff-131.0.3-edge-130.0.2849.52-1
options: --user 1001
container:
image: cypress/browsers:node-20.18.0-chrome-120.0.6099.129-1-ff-120.0-edge-120.0.2210.61-1
options: --user 1001

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

♻️ Duplicate comments (1)
.github/workflows/ci-test-custom-script.yml (1)

373-373: ⚠️ Potential issue

Update Chrome path to match version 120

The Chrome path needs to be updated to match the stable version.

-          browser: /opt/hostedtoolcache/setup-chrome/chromium/129.0.6668.100/x64/chrome
+          browser: /opt/hostedtoolcache/setup-chrome/chromium/120.0.6099.129/x64/chrome
📜 Review details

Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 9c2aad1 and 14f9a4b.

📒 Files selected for processing (2)
  • .github/workflows/ci-test-custom-script.yml (3 hunks)
  • .github/workflows/ci-test-limited.yml (2 hunks)
🧰 Additional context used
🪛 actionlint (1.7.4)
.github/workflows/ci-test-limited.yml

230-230: shellcheck reported issue in this script: SC2086:info:1:70: Double quote to prevent globbing and word splitting

(shellcheck)

🪛 yamllint (1.35.1)
.github/workflows/ci-test-limited.yml

[error] 223-223: trailing spaces

(trailing-spaces)

.github/workflows/ci-test-custom-script.yml

[error] 73-73: trailing spaces

(trailing-spaces)

🔇 Additional comments (2)
.github/workflows/ci-test-limited.yml (2)

227-229: ⚠️ Potential issue

Chrome version 129 is not yet released

Using an unreleased Chrome version (129) could cause test reliability issues. The current stable version is 120.

Apply this change:

-          chrome-version: 129
+          chrome-version: 120
           install-chromedriver: true
           install-dependencies: true

Likely invalid or redundant comment.


343-343: ⚠️ Potential issue

Update Chrome path to match version 120

The Chrome path needs to be updated to match the suggested Chrome version.

-          browser: /opt/hostedtoolcache/setup-chrome/chromium/129.0.6668.100/x64/chrome
+          browser: /opt/hostedtoolcache/setup-chrome/chromium/120.0.6099.129/x64/chrome

Likely invalid or redundant comment.

Comment on lines +257 to +263
# - uses: browser-actions/setup-chrome@latest
# id: setup-chrome
# with:
# chrome-version: 129
# install-chromedriver: true
# install-dependencies: true

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue

Uncomment Chrome setup to ensure browser availability

The Chrome setup is commented out but the workflow still expects Chrome to be available. This could cause test failures.

Remove the comment markers to enable Chrome setup:

-      # - uses: browser-actions/setup-chrome@latest
-      #   id: setup-chrome
-      #   with:
-      #     chrome-version: 129
-      #     install-chromedriver: true
-      #     install-dependencies: true
+      - uses: browser-actions/setup-chrome@latest
+        id: setup-chrome
+        with:
+          chrome-version: 120
+          install-chromedriver: true
+          install-dependencies: true
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
# - uses: browser-actions/setup-chrome@latest
# id: setup-chrome
# with:
# chrome-version: 129
# install-chromedriver: true
# install-dependencies: true
- uses: browser-actions/setup-chrome@latest
id: setup-chrome
with:
chrome-version: 120
install-chromedriver: true
install-dependencies: true

@sagar-qa007 sagar-qa007 removed the ok-to-test Required label for CI label Dec 17, 2024
@github-actions
Copy link

Workflow run: https://github.com/appsmithorg/appsmith/actions/runs/12368919764.
Cypress dashboard: Click here!
The following are new failures, please fix them before merging the PR:
To know the list of identified flaky tests - Refer here

***** Repeat Run Summary ***** Total Tests with repeat: 1 Total Passed: 1 Total Failed: 0 Total Skipped: 0 *****************************

@sagar-qa007
Copy link
Contributor Author

/ci-test-limit-count run_count=1 runId=12368615036

@github-actions
Copy link

@github-actions
Copy link

Workflow run: https://github.com/appsmithorg/appsmith/actions/runs/12369036510.
Cypress dashboard: Click here!
The following are new failures, please fix them before merging the PR:
To know the list of identified flaky tests - Refer here

***** Repeat Run Summary ***** Total Tests with repeat: 1 Total Passed: 1 Total Failed: 0 Total Skipped: 0 *****************************

@sagar-qa007
Copy link
Contributor Author

/ci-test-limit-count run_count=1

@github-actions
Copy link

@github-actions
Copy link

Workflow run: https://github.com/appsmithorg/appsmith/actions/runs/12369211360.
Cypress dashboard: Click here!
The following are new failures, please fix them before merging the PR:
To know the list of identified flaky tests - Refer here

***** Repeat Run Summary ***** Total Tests with repeat: 1 Total Passed: 1 Total Failed: 0 Total Skipped: 0 *****************************

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

📜 Review details

Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 002c6f9 and abb481d.

📒 Files selected for processing (1)
  • .github/workflows/ci-test-custom-script.yml (1 hunks)
🧰 Additional context used
🪛 actionlint (1.7.4)
.github/workflows/ci-test-custom-script.yml

268-268: shellcheck reported issue in this script: SC2086:info:5:47: Double quote to prevent globbing and word splitting

(shellcheck)

🔇 Additional comments (1)
.github/workflows/ci-test-custom-script.yml (1)

257-266: ⚠️ Potential issue

Uncomment the browser-actions/setup-chrome configuration

The Chrome setup configuration is commented out but should be used instead of manual installation. The GitHub Action provides a more reliable and secure way to manage Chrome versions.

Apply this diff to restore the proper Chrome setup:

-- # - uses: browser-actions/setup-chrome@latest
-- #   id: setup-chrome
-- #   with:
-- #     chrome-version: 129
-- #     install-chromedriver: true
-- #     install-dependencies: true
-- # - run: |
-- #     echo "BROWSER_PATH=${{ steps.setup-chrome.outputs.chrome-path }}" >> $GITHUB_ENV
-- #     ${{ steps.setup-chrome.outputs.chrome-path }} --version
+- uses: browser-actions/setup-chrome@latest
+  id: setup-chrome
+  with:
+    chrome-version: "120.0.6099.129"
+    install-chromedriver: true
+    install-dependencies: true
+- run: |
+    echo "BROWSER_PATH=${{ steps.setup-chrome.outputs.chrome-path }}" >> $GITHUB_ENV
+    ${{ steps.setup-chrome.outputs.chrome-path }} --version

Likely invalid or redundant comment.

@sagar-qa007
Copy link
Contributor Author

/ci-test-limit

@sagar-qa007
Copy link
Contributor Author

/ci-test-limit-count run_count=1

@github-actions
Copy link

@github-actions
Copy link

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🧹 Nitpick comments (2)
.github/workflows/ci-test-hosted.yml (1)

140-147: LGTM! Consider adding error handling

The Chrome installation steps are well-structured and align with the PR objective. However, consider adding error handling for the installation steps.

 - name: Install Google Chrome 129.0.6668.100
   run: |
+    set -e  # Exit on error
     sudo apt-get remove google-chrome-stable
     wget -q https://dl.google.com/linux/chrome/deb/pool/main/g/google-chrome-stable/google-chrome-stable_129.0.6668.100-1_amd64.deb
     sudo apt-get update
     sudo apt-get install -y ./google-chrome-stable_129.0.6668.100-1_amd64.deb
     echo "BROWSER_PATH=$(which google-chrome)" >> $GITHUB_ENV
+    if ! google-chrome --version | grep -q "129.0.6668.100"; then
+      echo "Chrome version mismatch"
+      exit 1
+    fi
     google-chrome --version
🧰 Tools
🪛 actionlint (1.7.4)

141-141: shellcheck reported issue in this script: SC2086:info:5:47: Double quote to prevent globbing and word splitting

(shellcheck)

.github/workflows/ci-test-limited.yml (1)

223-223: Remove trailing whitespace

Remove the trailing whitespace on line 223.

🧰 Tools
🪛 yamllint (1.35.1)

[error] 223-223: trailing spaces

(trailing-spaces)

📜 Review details

Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between 62ecc60 and cc4ac10.

📒 Files selected for processing (4)
  • .github/workflows/ci-test-custom-script.yml (1 hunks)
  • .github/workflows/ci-test-hosted.yml (2 hunks)
  • .github/workflows/ci-test-limited-with-count.yml (2 hunks)
  • .github/workflows/ci-test-limited.yml (1 hunks)
🧰 Additional context used
🪛 actionlint (1.7.4)
.github/workflows/ci-test-custom-script.yml

258-258: shellcheck reported issue in this script: SC2086:info:5:47: Double quote to prevent globbing and word splitting

(shellcheck)

.github/workflows/ci-test-hosted.yml

141-141: shellcheck reported issue in this script: SC2086:info:5:47: Double quote to prevent globbing and word splitting

(shellcheck)

.github/workflows/ci-test-limited-with-count.yml

234-234: shellcheck reported issue in this script: SC2086:info:5:47: Double quote to prevent globbing and word splitting

(shellcheck)

.github/workflows/ci-test-limited.yml

225-225: shellcheck reported issue in this script: SC2086:info:5:47: Double quote to prevent globbing and word splitting

(shellcheck)

🪛 yamllint (1.35.1)
.github/workflows/ci-test-limited.yml

[error] 223-223: trailing spaces

(trailing-spaces)

🔇 Additional comments (4)
.github/workflows/ci-test-hosted.yml (1)

249-249: LGTM! Browser configuration is correct

The Cypress test configuration correctly uses the BROWSER_PATH environment variable set during Chrome installation.

.github/workflows/ci-test-limited.yml (1)

224-231: Consider adding error handling

The same error handling improvements suggested for ci-test-hosted.yml should be applied here.

🧰 Tools
🪛 actionlint (1.7.4)

225-225: shellcheck reported issue in this script: SC2086:info:5:47: Double quote to prevent globbing and word splitting

(shellcheck)

.github/workflows/ci-test-limited-with-count.yml (2)

233-240: Consider adding error handling

The same error handling improvements suggested for ci-test-hosted.yml should be applied here.

🧰 Tools
🪛 actionlint (1.7.4)

234-234: shellcheck reported issue in this script: SC2086:info:5:47: Double quote to prevent globbing and word splitting

(shellcheck)


354-355: LGTM! Cypress-repeat-pro configuration is correct

The cypress-repeat-pro configuration correctly uses the BROWSER_PATH environment variable for browser specification.

Comment on lines +257 to +264
- name: Install Google Chrome 129.0.6668.100
run: |
sudo apt-get remove google-chrome-stable
wget -q https://dl.google.com/linux/chrome/deb/pool/main/g/google-chrome-stable/google-chrome-stable_129.0.6668.100-1_amd64.deb
sudo apt-get update
sudo apt-get install -y ./google-chrome-stable_129.0.6668.100-1_amd64.deb
echo "BROWSER_PATH=$(which google-chrome)" >> $GITHUB_ENV
google-chrome --version
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue

Critical: Remove manual Chrome installation and use browser-actions/setup-chrome

The current Chrome installation has several critical issues:

  1. Chrome version 129.0.6668.100 is not yet released (current stable is 120)
  2. Direct downloads without verification pose security risks
  3. The installation URL will fail as this version doesn't exist

Replace the manual installation with the browser-actions/setup-chrome action:

-      - name: Install Google Chrome 129.0.6668.100
-        run: |
-          sudo apt-get remove google-chrome-stable
-          wget -q https://dl.google.com/linux/chrome/deb/pool/main/g/google-chrome-stable/google-chrome-stable_129.0.6668.100-1_amd64.deb
-          sudo apt-get update
-          sudo apt-get install -y ./google-chrome-stable_129.0.6668.100-1_amd64.deb
-          echo "BROWSER_PATH=$(which google-chrome)" >> $GITHUB_ENV
-          google-chrome --version
+      - uses: browser-actions/setup-chrome@latest
+        id: setup-chrome
+        with:
+          chrome-version: '120'
+          install-chromedriver: true
+          install-dependencies: true
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
- name: Install Google Chrome 129.0.6668.100
run: |
sudo apt-get remove google-chrome-stable
wget -q https://dl.google.com/linux/chrome/deb/pool/main/g/google-chrome-stable/google-chrome-stable_129.0.6668.100-1_amd64.deb
sudo apt-get update
sudo apt-get install -y ./google-chrome-stable_129.0.6668.100-1_amd64.deb
echo "BROWSER_PATH=$(which google-chrome)" >> $GITHUB_ENV
google-chrome --version
- uses: browser-actions/setup-chrome@latest
id: setup-chrome
with:
chrome-version: '120'
install-chromedriver: true
install-dependencies: true
🧰 Tools
🪛 actionlint (1.7.4)

258-258: shellcheck reported issue in this script: SC2086:info:5:47: Double quote to prevent globbing and word splitting

(shellcheck)

@github-actions
Copy link

Workflow run: https://github.com/appsmithorg/appsmith/actions/runs/12371594512.
Cypress dashboard: Click here!
The following are new failures, please fix them before merging the PR:
To know the list of identified flaky tests - Refer here

***** Repeat Run Summary ***** Total Tests with repeat: 0 Total Passed: 0 Total Failed: 0 Total Skipped: 0 *****************************

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ok-to-test Required label for CI skip-changelog Adding this label to a PR prevents it from being listed in the changelog

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants