Yes corrosion will cause them to get hot. I've used a small cotton Q-tip with vinegar to clean them and dissolve the corrosion.
While you have the cleaning supplies going, it's a good time to pull each fuse, one at a time, in the fuse box and clean each tab.