The mercury is set to climb to the mid to high 40s across Victoria tomorrow, coupled with a gusty wind change late in the afternoon.