feat(server-ng): port consumer group

[numinnex]

This PR ports the consumer group mechanism to server-ng, maintaining the cooperative rebalancing mechanism and extending it to accommodate for the fact that the server is distributed.

[codecov]

Codecov Report

❌ Patch coverage is 35.52271% with 1178 lines in your changes missing coverage. Please review.
✅ Project coverage is 74.00%. Comparing base (d5461a1) to head (7173af9).

Files with missing lines	Patch %	Lines
core/metadata/src/stm/stream.rs	22.56%	246 Missing and 8 partials ⚠️
core/metadata/src/stm/consumer_group.rs	45.41%	229 Missing and 15 partials ⚠️
core/server-ng/src/dispatch.rs	0.00%	209 Missing ⚠️
core/server-ng/src/responses.rs	0.00%	147 Missing ⚠️
core/server-ng/src/consumer_group.rs	0.00%	124 Missing ⚠️
core/metadata/src/impls/metadata.rs	0.00%	90 Missing ⚠️
core/server-ng/src/partition_reconciler.rs	82.67%	43 Missing and 1 partial ⚠️
core/server-ng/src/bootstrap.rs	0.00%	27 Missing ⚠️
core/partitions/src/iggy_partition.rs	45.45%	17 Missing and 1 partial ⚠️
core/server-ng/src/session_manager.rs	43.33%	17 Missing ⚠️
... and 1 more

❌ Your patch check has failed because the patch coverage (35.52%) is below the target coverage (50.00%). You can increase the patch coverage or adjust the target coverage.

Additional details and impacted files

@@             Coverage Diff              @@
##             master    #3527      +/-   ##
============================================
- Coverage     74.44%   74.00%   -0.45%     
  Complexity      937      937              
============================================
  Files          1243     1247       +4     
  Lines        125987   127567    +1580     
  Branches     101856   103480    +1624     
============================================
+ Hits          93795    94402     +607     
- Misses        29180    30077     +897     
- Partials       3012     3088      +76     

Components	Coverage Δ
Rust Core	74.67% <35.52%> (-0.53%)	⬇️
Java SDK	62.44% <ø> (ø)
C# SDK	71.40% <ø> (-0.71%)	⬇️
Python SDK	88.88% <ø> (ø)
PHP SDK	84.29% <ø> (ø)
Node SDK	91.35% <ø> (ø)
Go SDK	40.14% <ø> (ø)

Files with missing lines	Coverage Δ
core/binary_protocol/src/codes.rs	100.00% <ø> (ø)
core/binary_protocol/src/consensus/header.rs	80.35% <100.00%> (+0.03%)	⬆️
core/binary_protocol/src/consensus/operation.rs	96.42% <100.00%> (+0.06%)	⬆️
core/binary_protocol/src/dispatch.rs	91.63% <100.00%> (+0.17%)	⬆️
core/binary_protocol/src/primitives/consumer.rs	100.00% <ø> (ø)
...rc/requests/consumer_groups/sync_consumer_group.rs	100.00% <100.00%> (ø)
...c/responses/consumer_groups/sync_consumer_group.rs	100.00% <100.00%> (ø)
core/common/src/error/iggy_error.rs	100.00% <ø> (ø)
.../common/src/traits/binary_impls/consumer_groups.rs	100.00% <ø> (ø)
core/common/src/traits/binary_impls/messages.rs	100.00% <ø> (ø)
... and 23 more

... and 36 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[hubcio]

one finding lands on code outside this PR's diff so it can't be a line comment:

in core/binary_protocol/src/consensus/operation.rs, the command_code_roundtrip test's ops array skips from DeletePersonalAccessToken straight to SendMessages, omitting Operation::JoinConsumerGroup/LeaveConsumerGroup. this PR flips both from non-replicated to replicated-with-code, so their op<->code mapping in to_command_code/from_command_code is now live but unexercised by that test. add both variants (the lookup_by_operation_roundtrips_with_lookup_command array has the same omission).

[numinnex]

/ready

[numinnex]

I cannot enable the hot/cold consumer group creation tests under vsr feature flag, as it relies on error messages being propagated from the server which are introduced in #3553, after it's merged I will create another PR that enables those + some other tests that are blocked by it.

[numinnex]

/ready