Can I remove packages from all servers in a DP Group?

So I've tried removing a package from a Distribution Point Group (which contains 15 servers). I've went into the package, and tried to remove from the DPG, however it doesn't remove it from the actual servers that make up the DPG.

Should it?

I know there is a powershell script that we can use, but I'm just curious if it's supposed to work this way.

Thanks!