You will need to uninstall SP4 and then install SP2. Make sure you backup all databases inc system databases before doing this and have a very large downtime window incase it all goes wrong.
Service Packs are cumulative, so if you have installed SP4, you have also installed SP1,SP2,SP3 as well.