First GPU I bought in 1996 was a Diamond Stealth 3D 3000, which was S3 Virge based. It was ok at the time, but lacked OGL support.
I remember upgrading, maybe a year or so later, to an ATi Rage Pro, just to play Quake. Was running it on a Pentium Pro 166. I got stupid lucky by finding that PC...