Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New lint [manual_try_fold] #11012

Merged
merged 5 commits into from
Jul 1, 2023
Merged

New lint [manual_try_fold] #11012

merged 5 commits into from
Jul 1, 2023

Conversation

Centri3
Copy link
Member

@Centri3 Centri3 commented Jun 23, 2023

Closes #10208


changelog: New lint [manual_try_fold]
#11012

@rustbot
Copy link
Collaborator

rustbot commented Jun 23, 2023

r? @xFrednet

(rustbot has picked a reviewer for you, use r? to override)

@rustbot rustbot added the S-waiting-on-review Status: Awaiting review from the assignee but also interested parties label Jun 23, 2023
@xFrednet
Copy link
Member

@blyxyas would you mind reviewing this PR? :)

@blyxyas
Copy link
Member

blyxyas commented Jun 25, 2023

Yeah, will review it 🐉

Copy link
Member

@blyxyas blyxyas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just too small nits, I couldn't see anything else wrong. Thanks! ❤️

clippy_lints/src/methods/manual_try_fold.rs Show resolved Hide resolved
clippy_lints/src/methods/manual_try_fold.rs Outdated Show resolved Hide resolved
Copy link
Member

@blyxyas blyxyas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a minor documentation change and I think this is done!

clippy_lints/src/methods/mod.rs Outdated Show resolved Hide resolved
@Centri3 Centri3 force-pushed the manual_try_fold branch 2 times, most recently from 44a2d61 to 80447ad Compare June 26, 2023 19:42
Copy link
Member

@xFrednet xFrednet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TIL about try_fold ^^

I have a few tiny NITs and a question. Then it should be ready for master :)

clippy_lints/src/methods/mod.rs Outdated Show resolved Hide resolved
/// ```
#[clippy::version = "1.72.0"]
pub MANUAL_TRY_FOLD,
perf,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IDK, if perf is too strict, if the lint already has a know problem. Or do you mean with doesn't take into account whether a function the implementation of Try?

If not, I think we should do some tests on more creates or start in pedantic first

Copy link
Member Author

@Centri3 Centri3 Jun 29, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The "known problem" isn't really an issue, imo. The known problem is referring to something like

x.iter().fold(Some(1), |mut acc, i| if let Some(acc) = acc { acc.checked_add(i) } else { println!("it's none!"); Some(1) });

(pseudocode)

This code is not really possible with try_fold.

But something like

x.iter().fold(Some(1), |mut acc, i| acc?.checked_add(i));

(pseudocode again)

Can be changed to try_fold just fine, as it does nothing in the None case.

There are very few cases where that's the desired behavior, as it doesn't change the outcome at all. You can short-circuit there and it changes nothing. Unless the programmer explicitly handles the None case, doing something with it, it's just a performance gain

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I also agree that, if this behaviour is well-documented (as I think it is, as it appears in the std documentation and in the lint's documentation) it doesn't really represent an issue.

Also, I don't think I've ever seen a fold that handles a None case, but I'll make a Github regex search to confirm how many times does this happen

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, I'm just a more cautious when it comes to warn-by-default lints. I would really like nightly lints at some point, but first I finally want to stabilize lint reasons.

I believe it should be fine :)

Copy link

@dralley dralley Sep 1, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Centri3

Can be changed to try_fold just fine, as it does nothing in the None case.

There are very few cases where that's the desired behavior, as it doesn't change the outcome at all. You can short-circuit there and it changes nothing. Unless the programmer explicitly handles the None case, doing something with it, it's just a performance gain

In that specific case, sure. But sometimes fold is used for things that are fallible, but you don't want it to short-circuit.

Example:

            self.public_key
                .public_subkeys
                .iter()
                .filter(|sub_key| {
                    if sub_key.key_id().as_ref() == key_id.as_ref() {
                        log::trace!(
                            "Found a matching key id {:?} == {:?}",
                            sub_key.key_id(),
                            key_id
                        );
                        true
                    } else {
                        log::trace!("Not the one we want: {:?}", sub_key);
                        false
                    }
                })
                .fold(
                    Err(Error::KeyNotFoundError {
                        key_ref: format!("{:?}", key_id),
                    }),
                    |previous_res, sub_key| {
                        if previous_res.is_err() {
                            log::trace!("Test next candidate subkey");
                            signature.verify(sub_key, &mut data).map_err(|e| {
                                Error::VerificationError {
                                    source: Box::new(e),
                                    key_ref: format!("{:?}", sub_key.key_id()),
                                }
                            })
                        } else {
                            log::trace!("Signature already verified, nop");
                            Ok(())
                        }
                    },
                )

This code initializes with an error of "KeyNotFoundError", and replaces it with an error of "VerificationError" after a subkey has been tried unsuccessfully, but still tries all of the subkeys before returning an error. If there's a successful result it short-circuits, but in the Ok case rather than the error case. So the suggestion to use try_fold would never work.

This might be rare enough to not be worth worrying about - I'm not suggesting that the lint should be reverted necessarily. But the try_fold suggestion was misleading, and I'm going to need to mark the lint ignored or rewrite the code.

clippy_lints/src/methods/manual_try_fold.rs Show resolved Hide resolved
clippy_lints/src/methods/manual_try_fold.rs Outdated Show resolved Hide resolved
@bors
Copy link
Contributor

bors commented Jun 29, 2023

☔ The latest upstream changes (presumably #11030) made this pull request unmergeable. Please resolve the merge conflicts.

@bors
Copy link
Contributor

bors commented Jul 1, 2023

☔ The latest upstream changes (presumably #11020) made this pull request unmergeable. Please resolve the merge conflicts.

@Centri3 Centri3 force-pushed the manual_try_fold branch from 5f4b796 to cb5d7e3 Compare July 1, 2023 17:37
@xFrednet
Copy link
Member

xFrednet commented Jul 1, 2023

LGTM, thank you for the new lint

And review @blyxyas

@bors r=blyxyas,xFrednet

@bors
Copy link
Contributor

bors commented Jul 1, 2023

📌 Commit cb5d7e3 has been approved by blyxyas,xFrednet

It is now in the queue for this repository.

@bors
Copy link
Contributor

bors commented Jul 1, 2023

⌛ Testing commit cb5d7e3 with merge 37f4c17...

@bors
Copy link
Contributor

bors commented Jul 1, 2023

☀️ Test successful - checks-action_dev_test, checks-action_remark_test, checks-action_test
Approved by: blyxyas,xFrednet
Pushing 37f4c17 to master...

1 similar comment
@bors
Copy link
Contributor

bors commented Jul 1, 2023

☀️ Test successful - checks-action_dev_test, checks-action_remark_test, checks-action_test
Approved by: blyxyas,xFrednet
Pushing 37f4c17 to master...

@bors bors merged commit 37f4c17 into rust-lang:master Jul 1, 2023
@bors bors mentioned this pull request Jul 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
S-waiting-on-review Status: Awaiting review from the assignee but also interested parties
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Suggest replacing Iterator::fold with Iterator::try_fold when appropriate
6 participants