I'm using a push subscription so I'm guessing this won't work without changing it to be a pull

right, but if there is a default and an alternate location. How does the subscriber know which one to pull from?

figured it out. Deleted every reference to it in the distribution db

MSsnapshot_agents was the table.