There is now the possibility to add consumer grade nvidia gpu to the list of vgpus'. Attached is a github repository (not mine) with what might be needed. I hope all the work is done here... I don't know anything about hooks yet. Honestly I just hope that this could work.
This would be great for virtual hosts as well as many other applications.