[frobtads] Use the build flags only for ix86 and arm (will fix x86_64)