It doesn't have any effect on the server. It's code that might be using this account to connect that would break. If it does, it shouldn't be using this account to work anyway.
Create a new account, assign it the rights it needs (not sysadmin) and then change the applications as you find them.
FYI, you should change SA regularly in case it gets compromised.