I have spacing issues on panels too, but I'm reluctant to file issues because my distro packages aren't the newest and I don't want to waste anyone's time.

But anyway for your case you might benefit from widening your vertical panel just enough to bump up the icon size, and/or forcing the task manager to use a certain number of columns.