Skip to content

Conversation

@squeed
Copy link
Contributor

@squeed squeed commented Oct 31, 2019

The recent os bump includes the OVS plugin for NetworkManager, causing it to manage interfaces that were previously left unmanaged.

This functionality will be used, so we can't tell it to ignore all interfaces of type openvswitch. So, add the interfaces created by openshift-sdn and ovn-kubernetes to the Unmanaged list.

@squeed
Copy link
Contributor Author

squeed commented Oct 31, 2019

FYI @dcbw

@openshift-ci-robot openshift-ci-robot added the size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. label Oct 31, 2019
@openshift-ci-robot
Copy link
Contributor

@squeed: This pull request references Bugzilla bug 1766356, which is valid. The bug has been moved to the POST state. The bug has been updated to refer to the pull request using the external bug tracker.

Details

In response to this:

Bug 1766356: templates: tell NetworkManager to ignore interfaces

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci-robot openshift-ci-robot added the bugzilla/valid-bug Indicates that a referenced Bugzilla bug is valid for the branch this PR is targeting. label Oct 31, 2019
@cgwalters
Copy link
Member

Ohh exciting.

FWIW, in theory this could (and possibly should) go directly in RHCOS too, but...we don't have a nice convenient ci-gated place for that.

Sadly the RHCOS bits are internal (xref openshift/os#388) - but here's where this changed https://gitlab.cee.redhat.com/coreos/redhat-coreos/merge_requests/638

/approve
at a high level though.

@openshift-ci-robot openshift-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Oct 31, 2019
@cgwalters
Copy link
Member

cgwalters commented Oct 31, 2019

I think longer term rather than that inline matching which is somehow reminiscent of modem commands we should do something like have a way to attach metadata about an "owner" to network interfaces, so that not-NetworkManager processes could signal to NM directly about this.

A somewhat related situation for example is the default podman/docker veth devices, which at one point NM saw and said "oh hey, an ethernet device, let me DHCP on it".

Maybe in udev somehow? Or maybe patch the kernel to add xattrs on sysfs?

@squeed
Copy link
Contributor Author

squeed commented Oct 31, 2019

FWIW, in theory this could (and possibly should) go directly in RHCOS too, but...we don't have a nice convenient ci-gated place for that.

I don't have a good intuition for where that line should fall. Since third-party network providers could theoretically have to mirror this (using the correct CRs), keeping it open seems like being a good citizen.

Maybe in udev somehow?

That might work. Honestly, any networking device created by ip link add should probably be unmanaged by default. I wonder if NetworkManager lets you override another selector for the case where this rule doesn't hold.

For something as complicated as an ovs bridge, I really can't think of a specific rule. We, as an SDN provider, want full control of our interface. The CNV people, who also create ovs bridges, want those interfaces to be managed normally. At this point, branching on the name is the only thing I can think of.

In my days as CNI maintainer, I've definitely wanted the ability to set arbitrary metadata on an interface...

@dcbw
Copy link
Contributor

dcbw commented Oct 31, 2019

/lgtm

@openshift-ci-robot openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Oct 31, 2019
@kikisdeliveryservice
Copy link
Contributor

/skip

@squeed
Copy link
Contributor Author

squeed commented Nov 1, 2019

/retest

1 similar comment
@squeed
Copy link
Contributor Author

squeed commented Nov 1, 2019

/retest

@squeed
Copy link
Contributor Author

squeed commented Nov 1, 2019

any hints on how to debug this?

@cgwalters
Copy link
Member

It's not this PR, same symptom here #1232 (comment)
Something broke here recently elsewhere, will ping the network-edge folks.

@squeed
Copy link
Contributor Author

squeed commented Nov 1, 2019

Gotcha. If there's anything I can do to speed this along, let me know.

@openshift-bot
Copy link
Contributor

/retest

Please review the full test history for this PR and help us cut down flakes.

The recent os bump includes the OVS plugin for NetworkManager, causing
it to manage interfaces that were previously left unmanaged.

This functionality will be used, so we can't tell it to ignore all
interfaces of type openvswitch. So, add the interfaces created by
openshift-sdn and ovn-kubernetes to the Unmanaged list.
@openshift-ci-robot openshift-ci-robot removed the lgtm Indicates that a PR is ready to be merged. label Nov 4, 2019
@squeed
Copy link
Contributor Author

squeed commented Nov 4, 2019

Rebased on master, added driver:veth to the list of ignores.
@dcbw please review

@kikisdeliveryservice
Copy link
Contributor

/skip

@dcbw
Copy link
Contributor

dcbw commented Nov 4, 2019

/lgtm

@openshift-ci-robot openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Nov 4, 2019
@dcbw
Copy link
Contributor

dcbw commented Nov 4, 2019

/retest

@openshift-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: cgwalters, dcbw, squeed

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-bot
Copy link
Contributor

/retest

Please review the full test history for this PR and help us cut down flakes.

1 similar comment
@openshift-bot
Copy link
Contributor

/retest

Please review the full test history for this PR and help us cut down flakes.

@kikisdeliveryservice
Copy link
Contributor

/skip

@openshift-ci-robot
Copy link
Contributor

openshift-ci-robot commented Nov 5, 2019

@squeed: The following test failed, say /retest to rerun them all:

Test name Commit Details Rerun command
ci/prow/e2e-aws-scaleup-rhel7 2dd5516 link /test e2e-aws-scaleup-rhel7

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@kikisdeliveryservice
Copy link
Contributor

/skip

@kikisdeliveryservice
Copy link
Contributor

level=error msg="Error: Error waiting for instance (i-02e9b659694cad6cf) to become ready: Failed to reach target state. Reason: Server.InternalError: Internal error on launch"
level=error
level=error msg=" on ../tmp/openshift-install-395096181/master/main.tf line 93, in resource "aws_instance" "master":"
level=error msg=" 93: resource "aws_instance" "master" {"

/test e2e-aws

@openshift-merge-robot openshift-merge-robot merged commit a2bcae1 into openshift:master Nov 6, 2019
@openshift-ci-robot
Copy link
Contributor

@squeed: All pull requests linked via external trackers have merged. Bugzilla bug 1766356 has been moved to the MODIFIED state.

Details

In response to this:

Bug 1766356: templates: tell NetworkManager to ignore interfaces

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. bugzilla/valid-bug Indicates that a referenced Bugzilla bug is valid for the branch this PR is targeting. lgtm Indicates that a PR is ready to be merged. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants