Are the PCs and the router all plugged into a switch?
Some ISPs use DHCP and give you two or more dynamically allocated IP addresses.
If this is the case for you it should work fine.
Otherwise you could, depending on your OS, use one as a gateway for the other. I think it's called 'Internet sharing' in Windows 2000.
You could also get a router like this one.


