It could also be a problem with a bad execution plan so check what that is when the query is running slowly and do more tuning as need be.

Another useful...

Look up 'parameter sniffing' on Google - that might help explain what you are seeing ...