Construction workers on Victoria's Big Build sites will get an Anzac Day long weekend, even though it hasn't been declared a public holiday.