Prime Minister Anthony Albanese has apologised for an “unkind and hurtful” remark in which he referenced Tourette syndrome to mock the opposition in Parliament.

He reacted with the comment after facing interjections from Coalition MPs while being quizzed during question time on Tuesday about negative gearing.

“This nonsense that they carry on with … Have you got Tourette’s or something?” he said, directing his words to shadow treasurer Angus Taylor and Opposition Leader Peter Dutton.

“You know, you know, you just sit there, babble, babble, babble.”

Albanese’s remarks drew some laughter, groans and gasps in the chamber, while some Labor frontbenchers behind him looked less than impressed.

Albanese quickly realised his mistake and apologised saying: “I withdraw. I withdraw. I withdraw and apologise.”

However, his political opponents called for a more complete apology, and his comments drew anger from people living with the neurological disorder.

Tourette syndrome is a type of tic disorder and neurological condition that involves repetitive movements or unwanted sounds that cannot be easily controlled.

Opposition health spokeswoman Anne Ruston accused Albanese of “mocking a disability” and said it was “not a laughing matter”. She slammed him for “absolutely despicable behaviour”.

“The Prime Minister must immediately apologise to the entire Tourette’s community,” she said.

“Australians living with Tourette’s deserve the PM’s respect, not his ridicule.”

Greens Senator Jordon Steele-John, a disability advocate, said disabled people deserved better.

“If our PM could stop using disability as the butt of his jokes that would be great. Casual ableism is still ableism,” he said.

PM: ‘I apologise’

Late on Tuesday, Albanese returned to the House to expand on his initial apology.

“Today, in question time, I made comments that were unkind and hurtful,” he said.

“I knew it was wrong. As soon as I made the comment, I apologised and I withdrew as soon as I said it. But it shouldn’t have happened.

“I also want to apologise to all Australians who suffer from this disability. I regret saying it. It was wrong. It was insensitive. And I apologise.”

Australia’s Tourette’s Syndrome Association president Mandy Maysey, who has three children with the disorder, told Daily Mail Australia that Albanese’s gibe was “an insult” and “horrible”.

“I am horrified and disgusted that anyone would use it as a put down — as Prime Minister, he should be ashamed of himself,” she said.

The association also issued a statement, saying it was “incredibly disappointed and frustrated by Albanese’s flippant attitude in using Tourette syndrome as a put down.

“Using Tourette syndrome in a derogatory manner is offensive to the one in 100 Australians living with Tourette syndrome and highlights the daily struggle with prejudice and ridicule that people with TS live with,” it said.

Housing Minister Clare O’Neil and Liberal senator Jane Hume were asked about Albanese’s remarks during their segment on Sunrise on Wednesday morning.

“He’s a human being … and he made a mistake,” O’Neil said.

“What matters is that immediately after he said these words, he apologised. And then as you point out, he later came back into the Parliament and gave a more extensive apology.”

Hume said people with Tourette syndrome deserved respect, not ridicule.

“This has really been an insight into the Prime Minister’s character, I think,” she said.

“Ironically, in a week when this Parliament is going to be voting on adopting a code of conduct for our own behaviour in Parliament and I hope that the Prime Minister reflects on that when he votes on that motion.”