Skip to content

Force install dependencies in old Debian with expired keys#34922

Closed
rdner wants to merge 2 commits intoelastic:7.17from
rdner:force-install-old-debian
Closed

Force install dependencies in old Debian with expired keys#34922
rdner wants to merge 2 commits intoelastic:7.17from
rdner:force-install-old-debian

Conversation

@rdner
Copy link
Copy Markdown
Member

@rdner rdner commented Mar 24, 2023 •
edited
Loading

What does this PR do?

This change is the same as #33915 but for the rest of the Beats.

Why is it important?

We cannot build snapshots right now:

06:29:52 Status: Downloaded newer image for docker.elastic.co/beats-dev/golang-crossbuild:1.18.10-main-debian8
06:29:58 >> Building using: cmd='build/mage-linux-amd64 golangCrossBuild', env=[CC=gcc, CXX=g++, GOARCH=386, GOARM=, GOOS=linux, PLATFORM_ID=linux-386]
06:29:58 >> Building using: cmd='build/mage-linux-amd64 golangCrossBuild', env=[CC=gcc, CXX=g++, GOARCH=amd64, GOARM=, GOOS=linux, PLATFORM_ID=linux-amd64]
06:30:05 W: GPG error: http://archive.debian.org/ jessie Release: The following signatures were invalid: KEYEXPIRED 1587841717
06:30:05 W: Failed to fetch http://security.debian.org/debian-security/dists/jessie/updates/main/binary-amd64/Packages  404  Not Found [IP: 151.101.194.132 80]
06:30:05 
06:30:05 W: Failed to fetch http://security.debian.org/debian-security/dists/jessie/updates/main/binary-i386/Packages  404  Not Found [IP: 151.101.194.132 80]
06:30:05 
06:30:05 E: Some index files failed to download. They have been ignored, or old ones used instead.
06:30:05 Error: running "apt-get update" failed with exit code 100
06:30:05 Error: failed building for linux/386: exit status 100
06:30:05 failed building for linux/386: exit status 100
06:30:05 W: GPG error: http://archive.debian.org/ jessie Release: The following signatures were invalid: KEYEXPIRED 1587841717
06:30:05 W: Failed to fetch http://security.debian.org/debian-security/dists/jessie/updates/main/binary-amd64/Packages  404  Not Found [IP: 151.101.66.132 80]
06:30:05 
06:30:05 W: Failed to fetch http://security.debian.org/debian-security/dists/jessie/updates/main/binary-i386/Packages  404  Not Found [IP: 151.101.66.132 80]
06:30:05 
06:30:05 E: Some index files failed to download. They have been ignored, or old ones used instead.
06:30:05 Error: running "apt-get update" failed with exit code 100
06:30:05 Error: failed building for linux/amd64: exit status 100
06:30:05 failed building for linux/amd64: exit status 100

https://internal-ci.elastic.co/job/elastic+unified-release+master+snapshot-multijob-7.17/361/display/redirect

How to test locally

mage package

@rdner rdner added Team:Elastic-Agent-Data-Plane Label for the Agent Data Plane team backport-7.17 Automated backport to the 7.17 branch with mergify backport-v8.7.0 Automated backport with mergify labels Mar 24, 2023
@rdner rdner requested a review from a team as a code owner March 24, 2023 12:56
@rdner rdner self-assigned this Mar 24, 2023
@rdner rdner requested review from cmacknz and leehinman and removed request for a team March 24, 2023 12:56
@botelastic botelastic Bot added the needs_team Indicates that the issue/PR needs a Team:* label label Mar 24, 2023
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Mar 24, 2023

Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane)

@botelastic botelastic Bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Mar 24, 2023
@rdner rdner mentioned this pull request Mar 24, 2023
Merged
@rdner
Copy link
Copy Markdown
Member Author

rdner commented Mar 24, 2023

elasticsearch-ci/docs failure is a known issue related to https://github.blog/2023-03-23-we-updated-our-rsa-ssh-host-key/

@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Mar 24, 2023 •
edited by jenkins-beats-ci Bot
Loading

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2023-03-27T07:33:00.365+0000

  • Duration: 92 min 56 sec

Test stats 🧪

Test Results
Failed 0
Passed 22266
Skipped 1572
Total 23838

💚 Flaky test report

Tests succeeded.

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

  • /package : Generate the packages and run the E2E tests.

  • /beats-tester : Run the installation tests with beats-tester.

  • run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

@rdner rdner marked this pull request as draft March 24, 2023 16:34
@rdner
Copy link
Copy Markdown
Member Author

rdner commented Mar 24, 2023

It's broken, I'm trying out more options.

@rdner
Copy link
Copy Markdown
Member Author

rdner commented Mar 24, 2023 •
edited
Loading

I have these errors when I just run apt update on raw Debian Jessie (8):

root@3b6c3be95753:/etc/apt# apt update
Ign http://security.debian.org jessie/updates InRelease
Ign http://security.debian.org jessie/updates Release.gpg
Ign http://security.debian.org jessie/updates Release 
Ign http://ftp.us.debian.org jessie InRelease
Ign http://ftp.us.debian.org jessie Release.gpg
Ign http://ftp.us.debian.org jessie Release
Err http://security.debian.org jessie/updates/main armhf Packages
  404  Not Found [IP: 151.101.2.132 80]
Err http://security.debian.org jessie/updates/contrib armhf Packages
  404  Not Found [IP: 151.101.2.132 80]
Err http://security.debian.org jessie/updates/non-free armhf Packages
  404  Not Found [IP: 151.101.2.132 80]
Err http://ftp.us.debian.org jessie/main armhf Packages
  404  Not Found [IP: 208.80.154.139 80]
Err http://ftp.us.debian.org jessie/contrib armhf Packages
  404  Not Found [IP: 208.80.154.139 80]
Err http://ftp.us.debian.org jessie/non-free armhf Packages
  404  Not Found [IP: 208.80.154.139 80]
W: Failed to fetch http://security.debian.org/dists/jessie/updates/main/binary-armhf/Packages  404  Not Found [IP: 151.101.2.132 80]

W: Failed to fetch http://security.debian.org/dists/jessie/updates/contrib/binary-armhf/Packages  404  Not Found [IP: 151.101.2.132 80]

W: Failed to fetch http://security.debian.org/dists/jessie/updates/non-free/binary-armhf/Packages  404  Not Found [IP: 151.101.2.132 80]

W: Failed to fetch http://ftp.us.debian.org/debian/dists/jessie/main/binary-armhf/Packages  404  Not Found [IP: 208.80.154.139 80]

W: Failed to fetch http://ftp.us.debian.org/debian/dists/jessie/contrib/binary-armhf/Packages  404  Not Found [IP: 208.80.154.139 80]

W: Failed to fetch http://ftp.us.debian.org/debian/dists/jessie/non-free/binary-armhf/Packages  404  Not Found [IP: 208.80.154.139 80]

E: Some index files failed to download. They have been ignored, or old ones used instead.

Looks like the official repositories are not available anymore.

I used this to get a shell on Mac M1:

docker run --platform "linux/arm/v7" --rm -it --entrypoint /bin/bash debian:jessie

@rdner rdner force-pushed the force-install-old-debian branch from d762a69 to da0b8ae Compare March 24, 2023 16:51
@rdner rdner changed the base branch from main to 7.17 March 24, 2023 16:53
@rdner rdner removed backport-7.17 Automated backport to the 7.17 branch with mergify backport-v8.7.0 Automated backport with mergify labels Mar 24, 2023
@rdner
Force install dependencies in old Debian with expired keys
e407fc1 
This change is the same as elastic#33915
but for the rest of the Beats.
@rdner rdner force-pushed the force-install-old-debian branch from da0b8ae to e407fc1 Compare March 24, 2023 17:06
@rdner
Copy link
Copy Markdown
Member Author

rdner commented Mar 24, 2023

I fixed the source.list (kind of) but I still have this problem to solve:

The following packages have unmet dependencies:
 libgcrypt20:i386 : Depends: libc6:i386 (>= 2.15) but it is not installable
                    Depends: libgpg-error0:i386 (>= 1.14) but it is not going to be installed
 libsystemd0:i386 : PreDepends: libc6:i386 (>= 2.17) but it is not installable
                    PreDepends: libgcc1:i386 (>= 1:4.1.1) but it is not installable
                    PreDepends: liblzma5:i386 (>= 5.1.1alpha+20120614) but it is not installable
                    PreDepends: libselinux1:i386 (>= 1.32) but it is not installable
E: Unable to correct problems, you have held broken packages.

faec
faec reviewed Mar 24, 2023
View reviewed changes
Comment thread dev-tools/mage/pkgdeps.go Outdated
@rdner rdner force-pushed the force-install-old-debian branch from dd39118 to dbf0c3a Compare March 27, 2023 07:32
@rdner
Copy link
Copy Markdown
Member Author

rdner commented Mar 27, 2023 •
edited
Loading

Even after fixing the repositories our crossbuild cannot install packages, the dependencies cannot be resolved in the new archive repository:

Screenshot 2023-03-27 at 09 36 42

@rdner
Copy link
Copy Markdown
Member Author

rdner commented Mar 28, 2023 •
edited
Loading

This should be fixed by backporting #34939 to 7.17

@rdner rdner closed this Mar 28, 2023
@rdner rdner mentioned this pull request Apr 18, 2023
Merged
@v1v v1v mentioned this pull request Apr 18, 2023
Closed
@rdner rdner deleted the force-install-old-debian branch November 1, 2024 19:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@cmacknz cmacknz cmacknz approved these changes

@leehinman leehinman Awaiting requested review from leehinman leehinman is a code owner automatically assigned from elastic/elastic-agent-data-plane

+1 more reviewer

@faec faec faec left review comments

Reviewers whose approvals may not affect merge requirements

Assignees

@rdner rdner

Labels

Team:Elastic-Agent-Data-Plane Label for the Agent Data Plane team

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@rdner @elasticmachine @cmacknz @faec