With softboxes you need to be careful since they're enclosed. Heat build-up and the distance from fabric to lamp can be an issue.
Chimera, for example, makes a line of video softboxes expressly for hot lights.
With umbrellas, as long as you're careful during setup, you should be fine.