Skip to content

gemm_lowbit_kernel expect 2d or 3d activation? #79

@tanvoontao

Description

@tanvoontao

Since its transformer model, the activation is in 3d. but the kernel seems like only support 2d matmul. Am I missing anything or misunderstand?

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions