What Caller ID is set on the account you are using to make calls with Skype Dial Pad?
In the Dial Pad page select Settings -> Calling.
In some countries restrictions might apply on calls without Caller ID or calls with Caller ID from selected countries.