It was a line so inflammatory that even Prime Minister Malcolm Turnbull weighed in, calling it "a shocking insult to the memory" of those killed by the Nazis.
But how can he speak for us when he's made it clear a large portion of our community would never have been allowed in the country if he had his way?
Mr Katter said he discussed the speech with Mr Anning before he delivered it. "This will create more university places for Australians, whose parents have actually paid for the universities with their taxes in the first place", Anning said.
"Good men died for our right to say whatever we want to say and use whatever words we want to use", Senator Anning went on.
He claimed to be simply referring to the "ultimate solution" to a political problem and said people who were offended took the two words out of context. "I just want to know when it's going to change for our future generation", she said.
"I felt like I was trapped in a Ku Klux Klan rally".".
He later told the Senate he deeply regretted shaking Mr Anning's hand after he gave the speech last night. On reflection he described the remarks as "vomitous poison" and "one of the most disgraceful, racist, homophobic, divisive, misogynist, spiteful, hateful speeches I've ever heard".
Hanson joined the condemnation, telling the Senate she was appalled by Anning's speech.
MICHAEL MASTERS GETTY IMAGES Prime Minister Malcolm Turnbull said senator Fraser Anning's speech was"appalling
"Because you may have your grievances with what Fraser Anning has said, don't direct them at me - it's got nothing to do with me".
"How gutless are members in this Parliament?"
More than 20 senators, including senior government ministers, shook hands with Senator Anning after his speech on Tuesday.
Anning's speech largely focused on his calls to limit Muslim immigration.
Other political leaders spoke out, including Anne Aly, Australia's first Muslim MP. Turnbull said in his own speech, "Those who try to demonize Muslims because of the crimes of a tiny minority are only helping the terrorists".
"Be very clear about this".
"It is ironic that those on the left such as the Greens and some Labor who seek to criticize me are the same people who refused to support my efforts to stop Australia funding the Palestinian Authority who finance terrorist attacks against innocent Israeli women and children", the statement read. "We reject and condemn racism in any form", he said on Twitter.
Shorten said parliament couldn't remain silent when it comes to racism.
Mathias Cormann, an immigrant from Belgium, said: "This chamber in many ways is a true reflection of what a great migrant nation we are".
"Those of us that are already here are responsible for behaving in a manner that encourages people to make the same journey as us, no matter where they come from, their economic capacity, social standing, the colour of their skin, their religion, sexuality or gender identity".