Are you using linked servers. it could be that third party drivers (oracle etc.) use memory from the sql server proces. you can fix using following:

"HKLM\Software\Microsoft\Mssqlserver\providers\MSDAORA" and set...