The goal (as I understood it) is to separate back-end and front-end. That is, you could have a CLI front-end with just text interface, or a GUI front-end with all the fancy features.
Maybe I didn't get the point of neovim but I don't really see how a GUI could be a useful addition for vim.
I only use gvim because colorschemes have nicer colors.