Skip to content

[4.2] Improving parallelization of Drone jobs #37865

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 22 commits into from
May 23, 2022
Merged

[4.2] Improving parallelization of Drone jobs #37865

Changes from all commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
fbdaf9b
Adding PHP8.2 to drone setup and enforcing PHP 8.1 compliance
Hackwar May 23, 2022
410b540
Executing all system tests in parallel
Hackwar May 23, 2022
e19b33c
Extending wait time for selenium to 10 seconds
Hackwar May 23, 2022
28aa047
Wait for selenium to be ready
Hackwar May 23, 2022
27168fa
Merge branch '4.2-drone2' of github.com:Hackwar/joomla-cms into 4.2-d…
Hackwar May 23, 2022
11618d9
Update tests/Codeception/drone-api-run.sh
HLeithner May 23, 2022
b87c83d
Update tests/Codeception/drone-api-run.sh
HLeithner May 23, 2022
92bd62f
Update tests/Codeception/drone-system-run.sh
HLeithner May 23, 2022
2486422
Update tests/Codeception/drone-system-run.sh
HLeithner May 23, 2022
d11b229
Reducing parallel load on Drone
Hackwar May 23, 2022
738ff51
Merge branch '4.2-drone2' of github.com:Hackwar/joomla-cms into 4.2-d…
Hackwar May 23, 2022
e068518
Cludge to change output path
Hackwar May 23, 2022
15ea09c
Signing drone.yml
Hackwar May 23, 2022
5fde35d
Why doesn't sed work with this?
Hackwar May 23, 2022
fa3de08
Another attempt with sed
Hackwar May 23, 2022
0371b0b
More fixes
Hackwar May 23, 2022
5d414be
Reducing load further
Hackwar May 23, 2022
e4abd30
Merge branch '4.2-dev' of https://github.com/joomla/joomla-cms into 4…
Hackwar May 23, 2022
74f49f8
Execute all System tests after the API tests
Hackwar May 23, 2022
20b22cc
Don't execute more than 4 system tests at a time
Hackwar May 23, 2022
76cd462
Commenting out the PHP8.2 tests for now
Hackwar May 23, 2022
a647b82
Fixing dependencies
Hackwar May 23, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
103 changes: 49 additions & 54 deletions .drone.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -167,6 +167,7 @@ steps:
- npm
image: joomlaprojects/docker-images:systemtests
commands:
- sed -i 's/tests\\/Codeception\\/_output/\\/drone\\/src\\/tests\\/Codeception\\/_output/' codeception.yml
- php libraries/vendor/bin/codecept build

- name: phpmin-api-mysql
Expand All @@ -180,17 +181,16 @@ steps:

- name: phpmax-api-mysql
depends_on:
- phpmin-api-mysql
- prepare_codeception_tests
image: joomlaprojects/docker-images:systemtests8.1
failure: ignore
environment:
JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
commands:
- bash tests/Codeception/drone-api-run.sh "$(pwd)" mysql
- bash tests/Codeception/drone-api-run.sh "$(pwd)" mysqlphpmax

# - name: phpnext-api-mysql
# depends_on:
# - phpmin-api-mysql
# - phpmax-api-mysql
# image: joomlaprojects/docker-images:systemtests8.2
# failure: ignore
# environment:
Expand All @@ -202,12 +202,20 @@ steps:
depends_on:
- prepare_codeception_tests
image: joomlaprojects/docker-images:systemtests
failure: ignore
environment:
JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
commands:
- bash tests/Codeception/drone-api-run.sh "$(pwd)" postgres

- name: phpmax-api-postgres
depends_on:
- prepare_codeception_tests
image: joomlaprojects/docker-images:systemtests8.1
environment:
JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
commands:
- bash tests/Codeception/drone-api-run.sh "$(pwd)" postgresphpmax

# - name: phpnext-api-postgres
# depends_on:
# - phpmin-api-postgres
Expand All @@ -218,48 +226,35 @@ steps:
# commands:
# - bash tests/Codeception/drone-api-run.sh "$(pwd)" postgresphpnext

- name: phpmax-api-postgres
depends_on:
# - phpnext-api-postgres
- phpmin-api-postgres
image: joomlaprojects/docker-images:systemtests8.1
failure: ignore
environment:
JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
commands:
- bash tests/Codeception/drone-api-run.sh "$(pwd)" postgres

- name: phpmin-system-mysql
depends_on:
- phpmax-api-mysql
- phpmax-api-postgres
image: joomlaprojects/docker-images:systemtests
failure: ignore
environment:
JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
commands:
- bash tests/Codeception/drone-system-run.sh "$(pwd)" mysql

- name: phpmax-system-mysql
depends_on:
# - phpnext-system-mysql
- phpmin-system-mysql
- phpmax-api-mysql
- phpmax-api-postgres
image: joomlaprojects/docker-images:systemtests8.1
failure: ignore
environment:
JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
commands:
- bash tests/Codeception/drone-system-run.sh "$(pwd)" mysqlphpmax

# - name: phpnext-system-mysql
# depends_on:
# - phpmin-system-mysql
# image: joomlaprojects/docker-images:systemtests8.2
# failure: ignore
# environment:
# JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
# commands:
# - bash tests/Codeception/drone-system-run.sh "$(pwd)" mysqlphpnext
# - name: phpnext-system-mysql
# depends_on:
# - phpmax-system-mysql
# image: joomlaprojects/docker-images:systemtests8.2
# failure: ignore
# environment:
# JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
# commands:
# - bash tests/Codeception/drone-system-run.sh "$(pwd)" mysqlphpnext

- name: phpmin-system-postgres
depends_on:
Expand All @@ -273,28 +268,28 @@ steps:

- name: phpmax-system-postgres
depends_on:
- phpmin-system-postgres
- phpmax-api-mysql
- phpmax-api-postgres
image: joomlaprojects/docker-images:systemtests8.1
failure: ignore
environment:
JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
commands:
- bash tests/Codeception/drone-system-run.sh "$(pwd)" postgresphpmax

# - name: phpnext-system-postgres
# depends_on:
# - phpmax-system-mysql8
# image: joomlaprojects/docker-images:systemtests8.2
# failure: ignore
# environment:
# JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
# commands:
# - bash tests/Codeception/drone-system-run.sh "$(pwd)" postgresphpnext
# - name: phpnext-system-postgres
# depends_on:
# - phpmax-system-postgres
# image: joomlaprojects/docker-images:systemtests8.2
# failure: ignore
# environment:
# JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
# commands:
# - bash tests/Codeception/drone-system-run.sh "$(pwd)" postgresphpnext

- name: phpmin-system-mysql8
depends_on:
- phpmax-api-mysql
- phpmax-api-postgres
- phpmax-system-mysql
- phpmax-system-postgres
image: joomlaprojects/docker-images:systemtests
environment:
JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
Expand All @@ -303,23 +298,23 @@ steps:

- name: phpmax-system-mysql8
depends_on:
- phpmin-system-mysql8
- phpmax-system-mysql
- phpmax-system-postgres
image: joomlaprojects/docker-images:systemtests8.1
failure: ignore
environment:
JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
commands:
- bash tests/Codeception/drone-system-run.sh "$(pwd)" mysql8phpmax

# - name: phpnext-system-mysql8
# depends_on:
# - phpmax-system-mysql
# image: joomlaprojects/docker-images:systemtests8.2
# failure: ignore
# environment:
# JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
# commands:
# - bash tests/Codeception/drone-system-run.sh "$(pwd)" mysql8phpnext
# - name: phpnext-system-mysql8
# depends_on:
# - phpmax-system-mysql8
# image: joomlaprojects/docker-images:systemtests8.2
# failure: ignore
# environment:
# JOOMLA_INSTALLATION_DISABLE_LOCALHOST_CHECK: 1
# commands:
# - bash tests/Codeception/drone-system-run.sh "$(pwd)" mysql8phpnext

- name: artifacts-system-tests
image: cschlosser/drone-ftps
Expand Down Expand Up @@ -424,6 +419,6 @@ steps:

---
kind: signature
hmac: a97a38d569f1f6ee9edf79060905561e9017e73ff781d62d152cfe2a6887c046
hmac: 59798bd419b13fc9291f29c74c49857f8d0be5081f872930ef96513d05689b6a

...