Oh, by the way like Arturo said it was building for all architectures that was making the build times go through the roof. I changed config.android.default.mk
from this:
ABIS_TO_COMPILE_RELEASE armv5 armv7 neon x86
to this:
ABIS_TO_COMPILE_RELEASE armv7
Debug builds were set up to make just one architecture but our project settings were such that we were testing with release builds.