Of course. Google doesn't exactly own your device — you do. You're free to disable all preinstalled Google apps, including Play Store. I prefer to not have my devices backdoored by manufacturer.