default_memmgr
- cubie.memory.default_memmgr = MemoryManager(totalmem=8589934592, registry={}, stream_groups=StreamGroups(groups={}, streams={}), _mode='passive', _allocator=<class 'cubie.cuda_simsafe.FakeNumbaCUDAMemoryManager'>, _auto_pool=[], _manual_pool=[], _queued_allocations={})
Singleton interface coordinating GPU memory allocation and stream usage.
- Parameters:
totalmem – Total GPU memory in bytes. Determined automatically when omitted.
registry – Registry mapping instance identifiers to their memory settings.
stream_groups – Manager for organising instances into stream groups.
Notes
The manager accepts
ArrayRequestobjects and returnsArrayResponseinstances that reference allocated arrays and chunking information. Active mode enforces per-instance VRAM proportions while passive mode mirrors standard allocation behaviour using chunking only when necessary.See also
ArrayRequestDescribes a single allocation request.
ArrayResponseReports allocation outcomes.
StreamGroupsManages CUDA stream groups.