apache-kafka: Fix, update and adjust JRE/JVM

[srhb]

Most Kafka versions were broken by the recent jdk/jre changes in #89731 but it needed some cleanup work anyway. 😄

I've enriched the package versions with relevant JRE compatibility, and passed it through so that the module can take advantage of it to set a jre by default (new option) that corresponds in the service.

Also remove the default jvmOptions to avoid having to pass these through in version-compatible permutations. Users should adjust them according to the version they use, so add a release note that warns about this.

Also adds the latest kafka 2.6, sets it to the default apacheKafka and adjust the Scala version used for 2.5.X according to upstream recommendations.

Motivation for this change

Things done

• Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
• Built on platform(s)
  • NixOS
  • macOS
  • other Linux distributions
• Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
• Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
• Tested execution of all binary files (usually in ./result/bin/)
• Determined the impact on package closure size (by running nix path-info -S before and after)
• Ensured that relevant documentation is up to date
• Fits CONTRIBUTING.md.

[srhb]

Force pushed to use the headless variants, the default ones pull in a ton of X deps.

[GTrunSec]

@srhb, please resolve the conflict. furthermore, about the JVM option. #100115 thanks @NeQuissimus are you maintainter here?

[srhb]

Conflicts resolved. 🙂

[NeQuissimus]

@srhb LGTM but can you add 2.6 to the test suite, please? :)

[srhb]

Thought I did already in a912e93276835b377dd0ad02fcfebf9e5e5f8cfe - did I miss another place?

[NeQuissimus]

Oh wow, I must be blind :D

[bbigras]

Any progress on this?

[NeQuissimus]

This should be good to go after a rebase

[srhb]

I'm sorry, I forgot all about this. I'll fix it up now.

[bbigras]

I'm sorry, I forgot all about this. I'll fix it up now.

Hey no worries :) Thank you very much for the PR and the quick rebase.

[nixos-discourse]

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:

https://discourse.nixos.org/t/prs-already-reviewed/2617/356

[srhb]

I'm going to go ahead and merge once ofborg passes since there's some approval at least, and I don't want to play whack-a-mole with the release note merge conflicts. :-)