Outlook Skype for Business “Contacts” folder doesn’t sync with Skype for Business contacts
Summarizes the issues that you may experience with the Outlook Skype for Business

https://support.microsoft.com/en-us/kb/3193240