AI Engine-ML Intrinsics User Guide (v2024.1)
|
Vector data-types pack multiple scalar data elements into a wider vector. There are vector data-types with standard sized elements (4-bit, 8-bit, 16-bit, 32-bit).
The general naming convention for these data-types is shown below.
v{NumLanes}[cu]int{SizeofElement} v{NumLanes}bfloat16
Disambiguation :
For example, v32uint4
, v16int8
, v8int16
, v128int4
, v32bfloat16
The total data-width of the vector data-types can be 8-bits, 16-bits, 32-bits, 64-bits, 128-bits, 256-bits, 512-bits, or 1024-bits.
Scalar type | Supported vector lanes |
---|---|
int4/uint4 | 32/64/128/256 |
int8/uint8 | 16/32/64/128 |
int16/uint16 | 8/16/32/64 |
int32/uint32 | 4/8/16/32 |
cint16 | 2/4/8/16/32 |
cint32 | 2/4/8/16 |
bfloat16 | 8/16/32/64 |
float | 4/8/16/32 |
cfloat | 2/4/8/16 |