That's why the discourse needs to be about why it's changing. And if we are serious we aren't changing the date until our constitution includes indigenous people.The change would be to move it away from January 26th, where the public holiday goes from there is inconsequential.
If the issue is with the date, move it.
I don't really give a sh*t about Australia Day, for me it's just another day off. I suspect that's the case for a large % of the population. Most people care more about the public holiday than they do for what it means.