Remove Unnecessary Submodules
Most python submodules don't need patching from our side and could be replaced by installed packages. Keeping those submodules has the benefit to inspect or edit them easily. Since we still need to keep the loopy submodule for patches, removing the other submodule doesn't change the workflow significantly, therefore the current decision is to keep these submodules.
See also !382 (closed).