rm: fails to remove unreadable directory with -d flag

[jfinkels]

Environment: Ubuntu 24.04, uutils main branch (git commit 00d1866), GNU coreutils v9.4

Steps to reproduce:

mkdir -m a-r dir
rm -d dir

What happens now: uutils rm terminates with an error message and leaves dir intact:

rm: cannot remove 'dir': Directory not empty

What I expected to happen: GNU rm terminates successfully and removes the directory.

Notes: this is causing a failure in GNU test file tests/rm/empty-inacc.sh. Related to #7033.