A Victorian man has been arrested less than 24 hours after a regional church was set alight in a brazen attack.