Because the transaction has been cryptographically signed... once they alter anything (addresses, amounts etc.) inside that transaction, it'll break the signature and the transaction will no longer be considered valid and will be rejected by pretty much everyone. This would then render the entire block invalid.
Can you please provide me some source, from where I can get to know on what are all the fields the signature is computed and verified.