decoding attention kernel benchmark

[bjmsong]

Motivation

relate to this issue

Modifications

Checklist

• Format your code according to the Contributor Guide.
• Add unit tests as outlined in the Contributor Guide.
• Update documentation as needed, including docstrings or example tutorials.

[merrymercy]

Let me merge this first. @zhyncs and @bjmsong you can follow up and do more testing.