There is nothing wrong with wearing gloves during the prayer; where it’s not required for the hand to touch the ground directly while performing sujūd (prostration).
Ibn Qudāmah, in his book “Al-Mughnī”, said, “The worshipper does not have to touch the ground directly with any part of his body.”
Al-Qāḍī said, “If he (the worshipper) prostrates on the end of his turban, or on his sleeve or hem, his prayer is valid according to one report.”