Yes, ALL settings are reversible.
If you Deactivate the plugin first (instead of deleting via FTP), then ALL settings will revert (everything will go back to how things were), and when you delete the plugin, it will be like it was never there in the first place.
Kinda like a Ghost. 🙂
Read More: Preventing 404 Errors After Deactivating WP Ghost