Can I use multiple BitBox with the same BitBoxApp?

Yes, that's no issue at all. One BitBoxApp can be used with multiple BitBox02. The different BitBox02 devices can contain different wallets.