It comes from those Golliwog dolls that are now pretty much banned. Golliwogs were created by the author Enid Blyton in her Noddy books and are essentially dolls that look like blackface. Never understood why aussies adopted the term for slang about Asians.
We were made to read so many Enid Blyton books in primary school. Not sure if it was the norm at other schools, but growing up here it seemed that almost every teacher I had in primary school was a huge fan and her books were constantly being revered and mandatory reading.
Some classic books which I recall enjoying to read at the time. Learning more about her though as an adult, she certainly was an interesting character.