feat(test): Migrate Common.robot to Playwright by vg006 · Pull Request #22630 · goharbor/harbor

vg006 · 2025-12-09T05:27:46Z

Comprehensive Summary of your change

Issue being fixed

Summary

This PR aims to migrate tests in Common.robot. As a first step, few basic testcases are migrated and to track the progress the testcases are listed below.

In addition to that, this PR includes the setup for developing Playwright tests for the project, based on the PR #22462.

Please indicate you've done the following:

Well Written Title and Summary of the PR
Label the PR as needed. "release-note/ignore-for-release, release-note/new-feature, release-note/update, release-note/enhancement, release-note/community, release-note/breaking-change, release-note/docs, release-note/infra, release-note/deprecation"
Accepted the DCO. Commits without the DCO will delay acceptance.
Made sure tests are passing and test coverage is added if needed.
Considered the docs impact and opened a new docs issue or PR with docs changes if needed in website repository.

Signed-off-by: bupd <bupdprasanth@gmail.com>

Signed-off-by: bupd <bupdprasanth@gmail.com> fix: playwright github action Signed-off-by: bupd <bupdprasanth@gmail.com> fix: playwright github action Signed-off-by: bupd <bupdprasanth@gmail.com> fix: rename login logout test Signed-off-by: bupd <bupdprasanth@gmail.com> fix: playwright testing Signed-off-by: bupd <bupdprasanth@gmail.com> feat: correct test Signed-off-by: bupd <bupdprasanth@gmail.com>

Signed-off-by: vg006 <devvg006@gmail.com>

codecov · 2025-12-09T07:44:27Z

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 65.85%. Comparing base (c8c11b4) to head (ce73295).
⚠️ Report is 604 commits behind head on main.

Additional details and impacted files

@@             Coverage Diff             @@
##             main   #22630       +/-   ##
===========================================
+ Coverage   45.36%   65.85%   +20.48%     
===========================================
  Files         244     1073      +829     
  Lines       13333   116095   +102762     
  Branches     2719     2931      +212     
===========================================
+ Hits         6049    76451    +70402     
- Misses       6983    35407    +28424     
- Partials      301     4237     +3936

Flag	Coverage Δ
unittests	`65.85% <ø> (+20.48%)`	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.
see 987 files with indirect coverage changes

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Vad1mo · 2025-12-09T17:10:58Z

Well done

bupd · 2025-12-10T01:01:19Z

src/portal/e2e/group1-nightly/common.spec.ts

I believe we dont need group1-nightly anymore. since all of tests we have would be just UI. We might not need this one. just /src/portal/e2e/common.spec.ts is enough

@bupd Okay I will update it directory structure accordingly after successfully migrating all the test cases!

Signed-off-by: vg006 <devvg006@gmail.com>

vg006 · 2025-12-15T14:30:26Z

Hey @bupd!

As described in this test Verify Download CA Link, I noticed that there isn't any text like Registry Root Certificate in the System Settings[1].

Also I witnessed that this test case was last updated 4 years back during v1.10.7, So the text may be updated or removed due to a major bump. What's your thought on this? How to migrate this test case?

bupd · 2025-12-17T02:03:35Z

@vg006 feel free to remove it. its just for trusting the registry's self signed certificate.

Signed-off-by: vg006 <devvg006@gmail.com>

Copilot

Pull request overview

This PR introduces a Playwright-based E2E test framework for Harbor as a first step in migrating tests from Robot Framework, targeting the Common.robot test suite. It establishes the Playwright infrastructure including configuration, fixtures, utilities, and migrates ~28 test cases.

Changes:

Sets up Playwright test infrastructure (config, fixtures, shared utils) in src/portal/e2e/
Migrates a substantial portion of Common.robot test cases to common.spec.ts with Playwright
Adds a GitHub Actions workflow to run the Playwright tests on pull requests

Reviewed changes

Copilot reviewed 9 out of 11 changed files in this pull request and generated 14 comments.

Show a summary per file

File	Description
`.github/workflows/playwright.yml`	New CI workflow to run Playwright tests; uses `actions/checkout@v5` (inconsistent with repo's `@v6`); sets `BASE_URL` but tests expect `HARBOR_BASE_URL`
`.gitignore`	Adds Playwright artifact exclusions, but paths are root-anchored and won't match artifacts generated under `src/portal/`; also has redundant `node_modules/` entry
`src/portal/.gitignore`	Correctly excludes Playwright-generated artifacts at the portal directory level
`src/portal/.env.sample`	Provides sample environment variables; missing `LOCAL_REGISTRY` and `LOCAL_REGISTRY_NAMESPACE` used extensively in tests
`src/portal/package.json`	Adds `dotenv` and `playwright` as runtime dependencies; both should be in `devDependencies`
`src/portal/playwright.config.ts`	Standard Playwright config using `BASE_URL` environment variable
`src/portal/e2e/fixtures/harbor.ts`	Defines a Harbor-specific test fixture with login/logout helpers; default admin password hardcoded
`src/portal/e2e/utils.ts`	Shared utility functions for Docker operations and UI interactions; has an unused variable in `pushImage` and a timeout-bypass bug in `waitForProjectInList`
`src/portal/e2e/login-logout.spec.ts`	Basic login/logout test with hardcoded credentials
`src/portal/e2e/group1-nightly/common.spec.ts`	Main migration file with 28+ test cases; several tests that modify global settings (read-only mode, project creation policy, system admin) lack cleanup on failure

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot · 2026-03-04T14:09:04Z

src/portal/package.json

+    "dotenv": "^17.2.3",
    "echarts": "^5.5.1",
    "js-yaml": "^4.1.0",
    "ngx-clipboard": "^15.1.0",
    "ngx-cookie": "^6.0.1",
    "ngx-markdown": "16.0.0",
+    "playwright": "^1.54.1",


Both dotenv and playwright are placed in dependencies (production dependencies) but they are only used for testing, not for the Angular application itself. They should be moved to devDependencies alongside @playwright/test. Keeping test-only tools in production dependencies unnecessarily increases the installed package size for production deployments.

Copilot · 2026-03-04T14:09:05Z

src/portal/.env.sample

@@ -0,0 +1,3 @@
+HARBOR_USERNAME="<your_admin_username>" # e.g., admin
+HARBOR_PASSWORD="<your_admin_password>" # e.g., Harbor12345
+HARBOR_BASE_URL="<your_harbor_instance_url>" # e.g., https://harbor.mycompany.com


The LOCAL_REGISTRY and LOCAL_REGISTRY_NAMESPACE environment variables are used extensively in the tests (referenced over 30 times in common.spec.ts) to pull images from a local registry before pushing to Harbor, but they are not documented in .env.sample. Developers setting up the environment will not know these variables exist or what values to use. Please add them to the sample file (e.g., LOCAL_REGISTRY="docker.io" and LOCAL_REGISTRY_NAMESPACE="library").

Suggested change

HARBOR_BASE_URL="<your_harbor_instance_url>" # e.g., https://harbor.mycompany.com

HARBOR_BASE_URL="<your_harbor_instance_url>" # e.g., https://harbor.mycompany.com

LOCAL_REGISTRY="docker.io" # e.g., docker.io for the default Docker Hub registry

LOCAL_REGISTRY_NAMESPACE="library" # e.g., library for official Docker Hub images

Copilot · 2026-03-04T14:09:05Z

src/portal/e2e/utils.ts

+      // No more pages, wait a bit and check one more time
+      await harborPage.waitForTimeout(500);
+      if (await projectLink.isVisible()) {
+        if (goto) {
+          await projectLink.click();
+        }
+        return;
+      }
+      throw new Error(`Project "${projectName}" not found in project list after checking all pages`);


The waitForProjectInList function has a logic bug: when no "Next Page" button is available (i.e., the entire list fits on one page), the function only waits 500ms before throwing an error, completely ignoring the timeout parameter. This is problematic for a newly created project that may take longer to appear in the list, even though no pagination is needed.

The function should implement a retry loop within the single-page case too, continuing to check until the timeout elapses rather than throwing after just one 500ms wait.

Suggested change

// No more pages, wait a bit and check one more time

await harborPage.waitForTimeout(500);

if (await projectLink.isVisible()) {

if (goto) {

await projectLink.click();

}

return;

}

throw new Error(`Project "${projectName}" not found in project list after checking all pages`);

// No more pages; wait a bit before retrying within the overall timeout loop

await harborPage.waitForTimeout(500);

Copilot · 2026-03-04T14:09:05Z

src/portal/e2e/group1-nightly/common.spec.ts

+test('sign-out', async ({ harborPage, harborUser }) => {
+  // Sign-out if already signed in
+  await harborPage.getByRole('button', { name: harborUser.username, exact: true }).click();
+  await harborPage.getByRole('menuitem', { name: 'Log Out' }).click();
+});
+


This test only verifies that a sign-out can be performed, but the harborPage fixture already logs in before the test body executes, and logoutIfPossible automatically logs out after each test. So this test is essentially logging in (via fixture) and then immediately logging out, with no meaningful assertion being validated. It appears to be a carry-over from the Robot Framework test structure which required explicit state management between sequential tests.

This test adds no unique test coverage beyond what the fixture already handles, and could be confusing to future maintainers.

Suggested change

test('sign-out', async ({ harborPage, harborUser }) => {

// Sign-out if already signed in

await harborPage.getByRole('button', { name: harborUser.username, exact: true }).click();

await harborPage.getByRole('menuitem', { name: 'Log Out' }).click();

});

Copilot · 2026-03-04T14:09:06Z

src/portal/e2e/group1-nightly/common.spec.ts

+  await harborPage.getByRole('button', { name: 'SAVE' }).click();
+  await expect(harborPage.getByText(/system is in read only mode/i)).not.toBeVisible({ timeout: 5000 });
+});
+


The cannot copy image in readonly mode test also enables system-wide read-only mode without guaranteed cleanup on failure. If the test fails after enabling read-only mode (line 1404-1406) but before disabling it (line 1435-1437), all subsequent tests that attempt to push images will fail.

This is especially concerning because read-only mode is a global Harbor setting that affects the entire system, not just this test's isolated resources. Consider using test.afterEach or a try/finally block to ensure read-only mode is always disabled.

Suggested change

test.afterEach(async ({ harborPage }) => {

// Ensure Repository Read Only mode is disabled after each test

await harborPage.getByRole('link', { name: 'Configuration' }).click();

await harborPage.getByRole('button', { name: 'System Settings' }).click();

const readOnlyGroup = harborPage

.getByRole('group')

.filter({ hasText: 'Repository Read Only' });

const readOnlyCheckbox = readOnlyGroup.locator('input[type="checkbox"]');

if (await readOnlyCheckbox.isChecked()) {

await readOnlyGroup.locator('clr-checkbox-wrapper label').click();

await harborPage.getByRole('button', { name: 'SAVE' }).click();

await expect(harborPage.getByText(/system is in read only mode/i)).not.toBeVisible({ timeout: 5000 });

}

});

Copilot · 2026-03-04T14:09:07Z

src/portal/e2e/fixtures/harbor.ts

+const harborTest = base.extend<HarborFixtures>({
+    harborUser: async ({}, use) => {
+        await use({
+            username: process.env.HARBOR_USERNAME || 'admin',
+            password: process.env.HARBOR_PASSWORD || 'Harbor12345',


The default password 'Harbor12345' for the admin user is hardcoded as a fallback in harborUser fixture. While having a default for local development is understandable, the same default password 'Harbor12345' is also hardcoded throughout common.spec.ts for user1 and user2 test accounts (e.g., lines 77, 130, 143, 252, 628, 1016, 1715) without any environment variable fallback for these test accounts. Consider adding HARBOR_TEST_USER_PASSWORD or similar to allow overriding test user passwords per environment.

Suggested change

const harborTest = base.extend<HarborFixtures>({

harborUser: async ({}, use) => {

await use({

username: process.env.HARBOR_USERNAME || 'admin',

password: process.env.HARBOR_PASSWORD || 'Harbor12345',

const harborPassword =

process.env.HARBOR_TEST_USER_PASSWORD ||

process.env.HARBOR_PASSWORD ||

'';

const harborTest = base.extend<HarborFixtures>({

harborUser: async ({}, use) => {

await use({

username: process.env.HARBOR_USERNAME || 'admin',

password: harborPassword,

Copilot · 2026-03-04T14:09:07Z

src/portal/e2e/group1-nightly/common.spec.ts

+  // Wait for and verify the repo size is displayed (alpine 2.6 is approximately 3.68MiB)
+  await expect(harborPage.getByText(/3\.6[0-9]MiB/)).toBeVisible({ timeout: 10000 });


The repo size test asserts that the pushed Alpine image size matches the regex /3\.6[0-9]MiB/ (line 1467). This hardcodes an expected image size for a specific version of Alpine (alpine 2.6 as the comment says, but the code pushes alpine without specifying a version). Different Alpine versions have different sizes, and even the latest tag size changes as the image is updated over time. This assertion will be brittle and may fail spuriously when the Alpine image is updated upstream.

Suggested change

// Wait for and verify the repo size is displayed (alpine 2.6 is approximately 3.68MiB)

await expect(harborPage.getByText(/3\.6[0-9]MiB/)).toBeVisible({ timeout: 10000 });

// Wait for and verify that a repository size in MiB is displayed

await expect(harborPage.getByText(/\d+(\.\d+)?MiB/)).toBeVisible({ timeout: 10000 });

Copilot · 2026-03-04T14:09:08Z

.github/workflows/playwright.yml

+          echo "TOKEN_PRIVATE_KEY_PATH=${GITHUB_WORKSPACE}/src/github.com/goharbor/harbor/tests/private_key.pem" >> $GITHUB_ENV
+          IP=`hostname -I | awk '{print $1}'`
+          echo "IP=$IP" >> $GITHUB_ENV
+          echo "BASE_URL=https://$IP" >> $GITHUB_ENV


The workflow sets BASE_URL (line 63: echo "BASE_URL=https://$IP" >> $GITHUB_ENV), which is what playwright.config.ts uses for the Playwright baseURL configuration. However, the test fixtures (e2e/fixtures/harbor.ts) and many tests in common.spec.ts read from process.env.HARBOR_BASE_URL to construct the Harbor IP address used for Docker commands (e.g., docker login, docker push, docker pull).

Since HARBOR_BASE_URL is never set in the workflow, all those environment variable reads will return undefined, and the Docker commands will fall back to 'localhost' instead of the actual Harbor IP ($IP). This means all tests that push or pull Docker images will fail in CI because Docker commands target localhost instead of the running Harbor instance.

Either rename BASE_URL to HARBOR_BASE_URL in the workflow (and update playwright.config.ts accordingly), or add a separate step to also set HARBOR_BASE_URL=https://$IP.

Suggested change

echo "BASE_URL=https://$IP" >> $GITHUB_ENV

echo "BASE_URL=https://$IP" >> $GITHUB_ENV

echo "HARBOR_BASE_URL=https://$IP" >> $GITHUB_ENV

Copilot · 2026-03-04T14:09:08Z

src/portal/e2e/login-logout.spec.ts

+    // login
+    await page.goto('/');
+    await page.getByRole('textbox', { name: 'Username' }).click();
+    await page.getByRole('textbox', { name: 'Username' }).fill('admin');
+    await page.getByRole('textbox', { name: 'Password' }).click();
+    await page.getByRole('textbox', { name: 'Password' }).fill('Harbor12345');
+    await page.getByRole('button', { name: 'LOG IN' }).click();
+
+    // logout
+    await page.getByRole('button', { name: 'admin', exact: true }).waitFor();
+    await page.getByRole('button', { name: 'admin', exact: true }).click();


The login-logout.spec.ts test has the admin credentials ('admin' and 'Harbor12345') hardcoded directly in the test. The same credentials are configured via environment variables (HARBOR_USERNAME, HARBOR_PASSWORD, HARBOR_BASE_URL) in the fixture. This test should use the fixture's approach (reading from environment variables) or use the harborPage / harborUser fixture for consistency, rather than hardcoding values that may differ across environments.

Suggested change

// login

await page.goto('/');

await page.getByRole('textbox', { name: 'Username' }).click();

await page.getByRole('textbox', { name: 'Username' }).fill('admin');

await page.getByRole('textbox', { name: 'Password' }).click();

await page.getByRole('textbox', { name: 'Password' }).fill('Harbor12345');

await page.getByRole('button', { name: 'LOG IN' }).click();

// logout

await page.getByRole('button', { name: 'admin', exact: true }).waitFor();

await page.getByRole('button', { name: 'admin', exact: true }).click();

const username = process.env.HARBOR_USERNAME;

const password = process.env.HARBOR_PASSWORD;

const baseUrl = process.env.HARBOR_BASE_URL ?? '/';

if (!username || !password) {

throw new Error('HARBOR_USERNAME and HARBOR_PASSWORD must be set for login-logout test.');

}

// login

await page.goto(baseUrl);

await page.getByRole('textbox', { name: 'Username' }).click();

await page.getByRole('textbox', { name: 'Username' }).fill(username);

await page.getByRole('textbox', { name: 'Password' }).click();

await page.getByRole('textbox', { name: 'Password' }).fill(password);

await page.getByRole('button', { name: 'LOG IN' }).click();

// logout

await page.getByRole('button', { name: username, exact: true }).waitFor();

await page.getByRole('button', { name: username, exact: true }).click();

Copilot · 2026-03-04T14:09:08Z

src/portal/e2e/group1-nightly/common.spec.ts

+test('read only mode', async ({ harborPage, harborUser }) => {
+  const d = Date.now();
+  const projectName = `project${d}`;
+  const image = 'busybox';
+  const tag = 'latest';
+
+  // Create a new project
+  await createProject(harborPage, projectName);
+
+  // Enable Read Only Mode
+  await harborPage.getByRole('link', { name: 'Configuration' }).click();
+  await harborPage.getByRole('button', { name: 'System Settings' }).click();
+  await harborPage.getByRole('group').filter({ hasText: 'Repository Read Only' }).locator('clr-checkbox-wrapper label').click();
+  await harborPage.getByRole('button', { name: 'SAVE' }).click();
+
+  // Wait for save to complete
+  await harborPage.waitForTimeout(1000);
+
+  // Try to push image - should fail in read-only mode
+  const harborIp = process.env.HARBOR_BASE_URL?.replace(/^https?:\/\//, '') || 'localhost';
+  await cannotPushImage({
+    ip: harborIp,
+    user: harborUser.username,
+    pwd: harborUser.password,
+    project: projectName,
+    image: `${image}:${tag}`,
+    expectedError: 'denied: The system is in read only mode. Any modification is prohibited.',
+    localRegistry: process.env.LOCAL_REGISTRY || 'docker.io',
+    localRegistryNamespace: process.env.LOCAL_REGISTRY_NAMESPACE || 'library',
+  });
+
+  // Disable Read Only Mode
+  await harborPage.getByRole('link', { name: 'Configuration' }).click();
+  await harborPage.getByRole('button', { name: 'System Settings' }).click();
+  await harborPage.getByRole('group').filter({ hasText: 'Repository Read Only' }).locator('clr-checkbox-wrapper label').click();
+  await harborPage.getByRole('button', { name: 'SAVE' }).click();
+
+  // Wait for save to complete
+  await harborPage.waitForTimeout(1000);
+
+  // Now push should succeed
+  await pushImage({
+    ip: harborIp,
+    user: harborUser.username,
+    pwd: harborUser.password,
+    project: projectName,
+    imageWithOrWithoutTag: `${image}:${tag}`,
+    needPullFirst: true,
+    localRegistry: process.env.LOCAL_REGISTRY || 'docker.io',
+    localRegistryNamespace: process.env.LOCAL_REGISTRY_NAMESPACE || 'library',
+  });
+
+  // Verify image was pushed successfully
+  await harborPage.getByRole('link', { name: 'Projects' }).click();
+  await waitForProjectInList(harborPage, projectName, 15000, true);
+  await expect(harborPage.getByRole('link', { name: new RegExp(`${projectName}/${image}`) })).toBeVisible({ timeout: 10000 });
+});


The read only mode test enables the Harbor system-wide "Repository Read Only" setting but has no guaranteed cleanup if the test fails midway. If the test fails after enabling read-only mode (e.g., at cannotPushImage, pushImage, or the navigation steps), the system will remain in read-only mode, which will cause all subsequent tests that push images to fail.

Similarly for cannot copy image in readonly mode - if it fails after enabling read-only mode (line 1401-1406) but before disabling it (line 1432-1436), subsequent tests will be broken.

Consider using Playwright's test.afterEach hook or a try/finally block to always disable read-only mode, even if the test fails.

bupd and others added 6 commits December 6, 2025 08:39

feat: add playwright config

9c1f9b2

Signed-off-by: bupd <bupdprasanth@gmail.com>

feat: add login logout playwright test

546bdb4

Signed-off-by: bupd <bupdprasanth@gmail.com>

feat(deps): Update playwright version and Add dotenv package

1317cb6

Signed-off-by: vg006 <devvg006@gmail.com>

feat(env): Add access to environmental variables in playwright tests

490f414

Signed-off-by: vg006 <devvg006@gmail.com>

feat(test): Add few basic test cases and fixtures

d113454

Signed-off-by: vg006 <devvg006@gmail.com>

vg006 requested a review from a team as a code owner December 9, 2025 05:27

github-actions bot assigned chlins, stonezdj and Vad1mo Dec 9, 2025

feat(test): Add tests to update and delete labels

1d0a09d

Signed-off-by: vg006 <devvg006@gmail.com>

Merge branch 'goharbor:main' into pwtest-common

ce73295

Vad1mo added the release-note/enhancement Label to mark PR to be added under release notes as enhancement label Dec 9, 2025

bupd reviewed Dec 10, 2025

View reviewed changes

vg006 and others added 13 commits December 10, 2025 13:36

feat(e2e): Add create project test cases

01d7ac0

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add delete project test case

1ed0161

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add user view projects via logs test case

c3e9544

Signed-off-by: vg006 <devvg006@gmail.com>

Merge branch 'goharbor:main' into pwtest-common

708893d

feat(e2e): Add push image test case with utilities

bc913a0

Signed-off-by: vg006 <devvg006@gmail.com>

fix(e2e): Add util to traverse pagination of projects

546d254

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add project level public policy test

b91cea5

Signed-off-by: vg006 <devvg006@gmail.com>

refac: Update functions to be exported

60cc463

Signed-off-by: vg006 <devvg006@gmail.com>

refac(e2e): Modularize the tests using appropriate utils

964bdf7

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add harbor api docs page test

c2abc3f

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add test to view repo size

b2bdaa6

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add token expiration modification test

fb41beb

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add statistics test case

d4a900b

Signed-off-by: vg006 <devvg006@gmail.com>

vg006 marked this pull request as draft December 16, 2025 08:00

vg006 added 14 commits December 19, 2025 09:58

feat(e2e): Add delete multi project test case

b2eff68

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add delete multi repos test

73d9b6c

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add delete project in card view test

99c3e88

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add delete multi artifacts test

d7bd80f

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add delete multiple users test

80b6df4

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add project admin operate labels test

d1c58fb

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add project admin add repo labels test

46f96b6

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add copy an image test

c96fc01

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add user view logs test

a672e95

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add manage project members test

16061d9

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add manage project publicity test

c63869a

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add assign sys admin test

39676b7

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add edit project creation test

d958b89

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add edit repo info test

d579c63

Signed-off-by: vg006 <devvg006@gmail.com>

vg006 mentioned this pull request Jan 7, 2026

Migrate Harbor UI E2E tests from Robot + Selenium to Playwright goharbor/community#268

Open

vg006 added 4 commits January 7, 2026 10:37

feat(e2e): Add few utilities for testing

b91f1a0

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add read only mode test

e6d6b88

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add cannot copy image test and fix locator

20d2975

Signed-off-by: vg006 <devvg006@gmail.com>

feat(e2e): Add banner message test

4a20920

Signed-off-by: vg006 <devvg006@gmail.com>

Vad1mo requested a review from Copilot March 4, 2026 13:56

Copilot started reviewing on behalf of Vad1mo March 4, 2026 13:56 View session

Copilot AI reviewed Mar 4, 2026

View reviewed changes

+test.afterEach(async ({ harborPage }) => {
+  // Ensure Repository Read Only mode is disabled after each test
+  await harborPage.getByRole('link', { name: 'Configuration' }).click();
+  await harborPage.getByRole('button', { name: 'System Settings' }).click();
+  const readOnlyGroup = harborPage
+    .getByRole('group')
+    .filter({ hasText: 'Repository Read Only' });
+  const readOnlyCheckbox = readOnlyGroup.locator('input[type="checkbox"]');
+  if (await readOnlyCheckbox.isChecked()) {
+    await readOnlyGroup.locator('clr-checkbox-wrapper label').click();
+    await harborPage.getByRole('button', { name: 'SAVE' }).click();
+    await expect(harborPage.getByText(/system is in read only mode/i)).not.toBeVisible({ timeout: 5000 });
+  }
+});

		// Wait for and verify the repo size is displayed (alpine 2.6 is approximately 3.68MiB)
		await expect(harborPage.getByText(/3\.6[0-9]MiB/)).toBeVisible({ timeout: 10000 });

	echo "BASE_URL=https://$IP" >> $GITHUB_ENV
	echo "BASE_URL=https://$IP" >> $GITHUB_ENV
	echo "HARBOR_BASE_URL=https://$IP" >> $GITHUB_ENV

Conversation

vg006 commented Dec 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Comprehensive Summary of your change

Issue being fixed

Summary

Uh oh!

codecov bot commented Dec 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

Vad1mo commented Dec 9, 2025

Uh oh!

bupd Dec 10, 2025

Choose a reason for hiding this comment

Uh oh!

vg006 Dec 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

vg006 commented Dec 15, 2025

Uh oh!

bupd commented Dec 17, 2025

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Mar 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 4, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Mar 4, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

vg006 commented Dec 9, 2025 •

edited

Loading

codecov bot commented Dec 9, 2025 •

edited

Loading

vg006 Dec 10, 2025 •

edited

Loading