Go to Start>Run. Type in ipconfig and press enter. The enter the IP that looks something like:
192.168.1.3
or something like that. Default Gateway it might be called. Anyway type that number into your address bar (Like a website) and that should take you to the router.