64 or 32 bit SQL/Windows?
how much physical ram on the server?
what are the memory settings for SQL? sql properties/memory - min/max, dynamic, fixed, etc.
after a restart, set up a profiler trace and perfmon to monitor the memory. find the time of the start of the memory grab, and see what is running in profiler.