latching can come from a variety of things. If you have an I/O bottleneck you could see some page latching. If you have high contention for the same data you could see high latch times from that.
DBCC SQLPerf(waitstats) will tell you what you're latching on I would run that and see what the problem is first. The values are cumulative so run DBCC SQLPerf(waitstats,clear) first then I would run this every 30 seconds or so for awhile and see what numbers are the highest.