Test results are not as expected

[LzhinFdu]

After running the provided test script I got the following results：

Judging from the test results, the speed becomes slower after using ckpt, and the results have diff.
I use:
transformers==4.40.1
flash-attn==2.5.6