Skip to main content

Module dtype

Module dtype 

Source
Expand description

GgmlType — the GGUF tensor element-type alphabet, a total mapping from the GGML ggml_type integer IDs to the [prism::tensor::dtype] shapes.

The mapping is the single source of truth for GGUF tensor-type validation: every ggml_type ID admitted at the typed-input boundary resolves to a prism::tensor::dtype shape carrying that dtype’s BLOCK_BYTES (block size in bytes) and BLOCK_ELEMS (elements per block). The per-tensor byte count derives mechanically as (num_elements / BLOCK_ELEMS) * BLOCK_BYTES.

IDs 4 and 5 (deprecated GGML_TYPE_Q4_2 / GGML_TYPE_Q4_3) are rejected at the typed-input boundary — they carry no prism::tensor::dtype counterpart.

Authoritative source: the ggml_type enum in https://github.com/ggml-org/ggml/blob/master/include/ggml.h.

Enums§

GgmlType
A GGUF tensor element type, identified by its ggml_type integer ID. Each variant maps 1:1 to a [prism::tensor::dtype] shape.