Flaky test: TestSetupDirectoryWatcher

[jingyuanliang]

Running into unexpected failure: https://github.com/GoogleCloudPlatform/netd/actions/runs/3295187810/attempts/1

2022-10-21T06:14:45.3348645Z === RUN   TestSetupDirectoryWatcher
2022-10-21T06:14:45.3349043Z     pod_ip_metrics_test.go:260: reused ip: bucket with le==10. want: 1, got 2
2022-10-21T06:14:45.3349548Z --- FAIL: TestSetupDirectoryWatcher (4.00s)

Log files: logs_47.zip

jingyuanliang@jingyuanliang:~/github/netd$ go test ./pkg/metrics/collector -count=100 -failfast
ERROR: logging before flag.Parse: I1022 05:17:25.468190  644158 netlink_metrics.go:88] Initializing netlink metrics
E1022 05:17:25.469162  644158 pod_ip_metrics.go:165] Error opening directory bogus, open bogus: no such file or directory
E1022 05:17:29.473553  644158 pod_ip_metrics.go:193] Error reading file /tmp/dir12465032197/10.0.0.2: open /tmp/dir12465032197/10.0.0.2: no such file or directory
E1022 05:17:29.473628  644158 pod_ip_metrics.go:165] Error opening directory /tmp/dir12465032197, open /tmp/dir12465032197: no such file or directory
E1022 05:17:29.474611  644158 pod_ip_metrics.go:165] Error opening directory bogus, open bogus: no such file or directory
E1022 05:17:33.476707  644158 pod_ip_metrics.go:170] Error while reading files in directory readdirent /tmp/dir11139402894: no such file or directory
E1022 05:17:33.477804  644158 pod_ip_metrics.go:165] Error opening directory bogus, open bogus: no such file or directory
E1022 05:17:37.481421  644158 pod_ip_metrics.go:170] Error while reading files in directory readdirent /tmp/dir1135520947: no such file or directory
E1022 05:17:37.482317  644158 pod_ip_metrics.go:165] Error opening directory bogus, open bogus: no such file or directory
E1022 05:17:41.485502  644158 pod_ip_metrics.go:170] Error while reading files in directory readdirent /tmp/dir13223256129: no such file or directory
E1022 05:17:41.486548  644158 pod_ip_metrics.go:165] Error opening directory bogus, open bogus: no such file or directory
E1022 05:17:45.489237  644158 pod_ip_metrics.go:165] Error opening directory /tmp/dir1477826396, open /tmp/dir1477826396: no such file or directory
E1022 05:17:45.490625  644158 pod_ip_metrics.go:165] Error opening directory bogus, open bogus: no such file or directory
E1022 05:17:49.492819  644158 pod_ip_metrics.go:193] Error reading file /tmp/dir11082800460/10.0.0.2: open /tmp/dir11082800460/10.0.0.2: no such file or directory
E1022 05:17:49.492885  644158 pod_ip_metrics.go:165] Error opening directory /tmp/dir11082800460, open /tmp/dir11082800460: no such file or directory
E1022 05:17:49.493562  644158 pod_ip_metrics.go:165] Error opening directory bogus, open bogus: no such file or directory
E1022 05:17:53.495644  644158 pod_ip_metrics.go:170] Error while reading files in directory readdirent /tmp/dir11123781404: no such file or directory
E1022 05:17:53.496633  644158 pod_ip_metrics.go:165] Error opening directory bogus, open bogus: no such file or directory
E1022 05:17:57.499495  644158 pod_ip_metrics.go:170] Error while reading files in directory readdirent /tmp/dir1841723154: no such file or directory
E1022 05:17:57.500709  644158 pod_ip_metrics.go:165] Error opening directory bogus, open bogus: no such file or directory
E1022 05:18:01.503820  644158 pod_ip_metrics.go:165] Error opening directory /tmp/dir1463044104, open /tmp/dir1463044104: no such file or directory
E1022 05:18:01.504641  644158 pod_ip_metrics.go:165] Error opening directory bogus, open bogus: no such file or directory
E1022 05:18:05.507622  644158 pod_ip_metrics.go:170] Error while reading files in directory readdirent /tmp/dir14280622433: no such file or directory
E1022 05:18:05.508696  644158 pod_ip_metrics.go:165] Error opening directory bogus, open bogus: no such file or directory
--- FAIL: TestSetupDirectoryWatcher (4.00s)
    pod_ip_metrics_test.go:258: reused ip: bucket with le==10. want: 1, got 2
E1022 05:18:09.511190  644158 pod_ip_metrics.go:165] Error opening directory /tmp/dir11029283220, open /tmp/dir11029283220: no such file or directory
FAIL
FAIL	github.com/GoogleCloudPlatform/netd/pkg/metrics/collector	44.100s
FAIL

[jingyuanliang]

@yvetteli0314 @MrHohn