armhf and aarch64 apparently does not expose the cpu cache size via
sysfs. It set it to -1 and that confuses haveged. Make it fallback to
default cache size when sysfs reports -1.