Always build xtensor
The current way of using ExternalProject_Add is quite fragile tries to install the libraries in system directories. Using either the system or the local build may lead to build errors for users. Since the two flavours aren't tested in the CI remove the usage of the system version.
Additionally switch from FetchContent_Declare to ExternalProject_Add since it requires less boiler plate.