I had the same problem when trying to delete "External Configuration Tenant" from the resource group in Azure portal. You have to first select "Microsoft Entra ID" and then select "Manage tenants" option in the upper tab. This will show you all tenats under your MS account with option to delete. Pick up your tenant you want to delete, select delete and new window "Delete tenant 'YourTenant'?" will open, where all the validation required for deletion are shown (with direct link how to fix the problem). When validation is OK, Delete button in the bottom left corner is available to delete your tenant.
Hovewer, in my case, aftere successful delete, tenant is still visible in Azure portal resource group, and therefore I am unable to delete this resource group.