Skip to main content

Module memory

Module memory 

Source
Expand description

CUDA memory management

This module provides GPU memory management with budget enforcement. It wraps cudarc’s allocation functions and tracks total allocated memory.

Structs§

ArrowDeviceColumn
CudaBuffer
Column-oriented GPU buffer
DlpackColumn
GpuMemoryManager
GPU memory manager with budget enforcement
RuntimeAllocBlock
Owned handle for a raw allocation routed through GpuMemoryManager::alloc_raw / the v0.6 device runtime.
TrackedCudaSlice
A CudaSlice that automatically updates GpuMemoryManager allocation tracking on drop. Inner slice is wrapped in ManuallyDrop so the [Backing] enum can choose between cudarc-side free (legacy) and runtime-side deallocate (migrated) without producing a double-free.

Enums§

CudaColumn
Column data stored in device memory.

Functions§

validate_logical_row_count