Skip to content

[cudf] Route dictionary encode and gather temps through memory_resources - #23642

Draft
nirandaperera wants to merge 25 commits into
NVIDIA:mainfrom
nirandaperera:dictionary-encode-memory-resources
Draft

[cudf] Route dictionary encode and gather temps through memory_resources#23642
nirandaperera wants to merge 25 commits into
NVIDIA:mainfrom
nirandaperera:dictionary-encode-memory-resources

Conversation

@nirandaperera

Copy link
Copy Markdown
Contributor

Description

Depends on #23581 #23617

A part of #20780.

dictionary::encode and the detail gather path still allocated scratch from the current device resource, so dictionary row-hasher tests needed harness escape hatches. They now take cudf::memory_resources and split output vs temporary allocations, which lets those tests run under BaseFixtureWithHarness without enable_current_device_resource_use().

  • Migrate dictionary::encode (and dictionary_column_wrapper) to cudf::memory_resources
  • Plumb memory_resources through detail gather / string gather / gather_bitmask
  • Route sizes_to_offsets and make_offsets_child_column scratch through an explicit temp MR
  • Drop the two dictionary row-hasher current-MR escape hatches

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

nirandaperera and others added 24 commits August 7, 2026 14:35
Adds defaulted stream and memory_resources parameters to cudftestutil
column wrappers and helpers so tests can control allocation and stream
routing. Includes MR tests for wrappers and timestamp generators.

Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Co-authored-by: Bradley Dice <bdice@bradleydice.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
@nirandaperera nirandaperera added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Aug 12, 2026
@copy-pr-bot

copy-pr-bot Bot commented Aug 12, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@github-actions github-actions Bot added the libcudf Affects libcudf (C++/CUDA) code. label Aug 12, 2026
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

improvement Improvement / enhancement to an existing function libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant