This guy's blog had the answer:

http://sqlns.blogspot.com/2007/04/finding-ssns-instances-using-t-sql.html

NS Instances are stored in msdb, deleting the record for my rogue instance did the trick:

SELECT * FROM msdb.NS90.NSInstanceInfo

Hopefully this might help un-confuse...