If the SD card is brand new and you have put nothing on it, it won't hurt a thing to remove it/format it. I always format a new SD card before use.
I have the Xiaomi FIMI X8 SE drone. Most of the time, the drone software wants to format a new card anyway.