Solution:

The DMA starts after the first half-full of the FIFO is achieved. And if the data size is too small to achieve half-full, the DMA would start automatically after 2 ms.