apkbuild-cpan: fix empty directories left over

I think that most perl modules don't package empty directories (intentionally) so it should be fine to remove all empty directories so there are no leftovers from the deleted files.

(best way to fix a test: retry)