Trouble Installing RT2000 - HELP!!

[Dennis the Menace]

I am having some trouble getting by page 49 in the manual. I followed the instructions exactly, and everything went fine right through item #10 on page 49. After I was prompted to install the Matrox video tools, I recieved the the message "This program has performed an illegal operation and will be shut down". Matrox warns about this, and says that if this happens to close the dialog box and run the installation program mvtsetup.exe directly from windows explorer. When I try to do this my sytem locks up. Also, I get messages saying that I must change my display to 1024x768 and change color palette to high or true color. But this is because the directions told me to enable the standard VGA driver - which on my computer prevents me from going above 16 colors or 640x480. After getting nowhere I thought I would try disabling the standard VGA driver and installing the G400 driver directly from the disk, which I did. Then I adjusted the settings to 256 colors and the res to 1024x768. Then I tried to run the mvtsetup.exe program again from WE but again I got locked up.
My system is a Dell Dimension XPS R450 PII with 256 MB RAM. On IDE channel 1 I have 2 Maxtor HD's and on ch. 2 I have a Toshiba DVD player as master and a CD-RW as slave. My DVD seems to work fine as it is playing a music CD. My RT2000 is currently in PCI slot 4. PCI 3 is empty, PCI 2 has a Turtle Beach Montego Sound Card and PCI 1 is empty. (I originally had the RT2000 in PCI 1 but I switched to 4 to see if it would correct the problem, but it didn't. I have Windows 98, but not the SE edition. I am at a loss, and I would appreciate any feedback. Thanks!