AI Engine API User Guide (AIE-API) 2024.1
|
bfloat16 | float | |||||
---|---|---|---|---|---|---|
Output bits | Type | Arch. | Implementation | Notes | Implementation | Notes |
4b | Scalar | AIE | ||||
AIE-ML | Runs on vector unit | Runs on vector unit | ||||
Vector | AIE | |||||
AIE-ML | Emulated | Uses aie::rounding_mode::symmetric_zero | Emulated | Uses aie::rounding_mode::symmetric_zero | ||
8b | Scalar | AIE | Native to 32b + cast | |||
AIE-ML | Runs on vector unit | Runs on vector unit | ||||
Vector | AIE | Element-wise scalar | ||||
AIE-ML | Emulated | Uses aie::rounding_mode::symmetric_zero | Emulated | Uses aie::rounding_mode::symmetric_zero | ||
16b | Scalar | AIE | Native to 32b + cast | |||
AIE-ML | Runs on vector unit | Runs on vector unit | ||||
Vector | AIE | Vectorized emulated impl | ||||
AIE-ML | Native to 32b + extract lower 16b1 | Uses aie::rounding_mode::floor | Emulated | Uses aie::rounding_mode::symmetric_zero | ||
32b | Scalar | AIE | Native | |||
AIE-ML | Runs on vector unit | Runs on vector unit | ||||
Vector | AIE | Vectorized emulated impl | ||||
AIE-ML | Native | Uses aie::rounding_mode::floor | Emulated | Uses aie::rounding_mode::symmetric_zero |
Output type | Type | Arch. | int4 | int8 | int16 | int32 |
---|---|---|---|---|---|---|
bfloat16 | Scalar | AIE | ||||
AIE-ML | Runs on vector unit | Runs on vector unit | Runs on vector unit | Runs on vector unit | ||
Vector | AIE | |||||
AIE-ML | Emulated | Emulated | Emulated | Emulated | ||
float | Scalar | AIE | Cast to int32 + native | Cast to int32 + native | Native | |
AIE-ML | Runs on vector unit | Runs on vector unit | Runs on vector unit | Runs on vector unit | ||
Vector | AIE | Element-wise scalar | Emulated | Element-wise scalar | ||
AIE-ML | Emulated | Emulated | Emulated | Emulated |
Functions | |
template<typename TR = cint32> requires (arch::is(arch::AIE, arch::AIE_ML) && Utils::is_one_of_v<TR, cint16, cint32>) | |
auto | aie::to_fixed (cfloat a, int shift=0) |
Convert a floating point value into a fixed-point value. | |
template<typename TR = int32, unsigned Elems> requires (arch::is(arch::AIE_ML)) | |
auto | aie::to_fixed (const vector< bfloat16, Elems > &v, int shift=0) -> vector< TR, Elems > |
Convert the elements in a bfloat16 vector into fixed-point values. | |
template<typename TR = cint32, unsigned Elems> requires ((arch::is(arch::AIE) || (arch::is(arch::AIE_ML) && __AIE_API_COMPLEX_FP32_EMULATION__ == 1)) && Utils::is_one_of_v<TR, cint16, cint32>) | |
auto | aie::to_fixed (const vector< cfloat, Elems > &v, int shift=0) -> vector< TR, Elems > |
Convert the elements in a floating point vector into fixed-point values. | |
template<typename TR = int32, unsigned Elems> requires (Utils::is_one_of_v<TR, int16, int32>) | |
auto | aie::to_fixed (const vector< float, Elems > &v, int shift=0) -> vector< TR, Elems > |
Convert the elements in a floating point vector into fixed-point values. | |
template<typename TR = int32> requires (Utils::is_one_of_v<TR, int8, int16, int32>) | |
auto | aie::to_fixed (float a, int shift=0) |
Convert a floating point value into a fixed-point value. | |
template<typename TR = float, typename T , unsigned Elems> requires (Utils::is_one_of_v<T, int16, int32>) | |
auto | aie::to_float (const vector< T, Elems > &v, int shift=0) -> vector< TR, Elems > |
Convert the elements in a real fixed-point vector into floating point values. | |
template<typename TR = float> | |
auto | aie::to_float (int a, int shift=0) |
Convert a fixed-point value into a floating point value. | |
template<typename TR = cfloat, typename T > requires (Utils::is_one_of_v<T, cint16, cint32>) | |
auto | aie::to_float (T a, int shift=0) |
Convert a complex fixed-point value into a floating point value. | |
auto aie::to_fixed | ( | cfloat | a, |
int | shift = 0 |
||
) |
Convert a floating point value into a fixed-point value.
a | Input value. |
shift | Position of the point in the output value. |
TR | Type of the returned fixed-point value. |
Convert the elements in a bfloat16 vector into fixed-point values.
v | Input vector. |
shift | Position of the point in the output values. |
TR | Type of the returned fixed-point values. |
auto aie::to_fixed | ( | const vector< cfloat, Elems > & | v, |
int | shift = 0 |
||
) | -> vector<TR, Elems> |
Convert the elements in a floating point vector into fixed-point values.
v | Input vector. |
shift | Position of the point in the output values. |
TR | Type of the returned fixed-point values. |
Convert the elements in a floating point vector into fixed-point values.
v | Input vector. |
shift | Position of the point in the output values. |
TR | Type of the returned fixed-point values. |
auto aie::to_fixed | ( | float | a, |
int | shift = 0 |
||
) |
Convert a floating point value into a fixed-point value.
a | Input value. |
shift | Position of the point in the output value. |
TR | Type of the returned fixed-point value. |
auto aie::to_float | ( | const vector< T, Elems > & | v, |
int | shift = 0 |
||
) | -> vector<TR, Elems> |
Convert the elements in a real fixed-point vector into floating point values.
v | Input vector. |
shift | Position of the point in the input values. |
auto aie::to_float | ( | int | a, |
int | shift = 0 |
||
) |
Convert a fixed-point value into a floating point value.
a | Input value. |
shift | Position of the point in the input value. |
auto aie::to_float | ( | T | a, |
int | shift = 0 |
||
) |
Convert a complex fixed-point value into a floating point value.
a | Input value. |
shift | Position of the point in the input value. |