Clear S4B Cache
Exit Skype for Business (S4B) by clicking File > Exit.
Open File Explorer using the yellow folder icon on your taskbar.
Navigate to C:\Users\username\AppData\Local\Microsoft\Office\16.0\Lync where username needs to be replaced with your 8-character UW user ID (e.g., vcozzari).
Delete all folders in C:\Users\username\AppData\Local\Microsoft\Office\16.0\Lync except the one named Tracing.
Restart your computer.
After the restart, log back into your computer and S4B. It should be working much better.
NOTE: You will need to repeat this on each computer you use as it is both user-specific and computer-specific.