Al Jazeera's Mariana Sanchez, reporting from Tegucigalpa, said: "An eyewitness told us that, between five and six in the morning local time, about 100 to 200 soldiers surrounded his home in the centre of the capital and three vans drove up to his home and took him.
"A neighbour said that [Zelaya] came out and the army shot at him, about five shots."
The non-binding referendum, which was due to take place on Sunday, would have asked Hondurans whether they approved of holding a poll on constitutional change alongside general elections in November.
Zelaya fired the armed forces chief of staff last week after he refused to help him organise the vote.
Streets empty
The streets of Tegucigalpa on Sunday were largely empty of traffic, other than the tanks and lorries of the army, after reports on local radio urged the city's residents to stay inside.
"We're talking about a coup d'etat," Rafael Alegria, a union leader and ally of Zelaya, told Honduras' radio Cadena de Noticias.
"This is regrettable."
A large group of Zelaya's supporters gathered outside the presidential palace, shouting insults at the soldiers that were surrounding the building and setting fires in the streets.
"They kidnapped him like cowards," Melissa Gaitan, an employee of the official government television station, said, referring to Zelaya.
"We have to rally the people to defend our president."
The supreme court and the attorney-general have said that the vote was is illegal because the constitution bars changes to some of its clauses, such as the ban on a president serving more than one term.
Their decision has been backed by the military and congress.
Zelaya was elected for a non-renewable four-year term in 2006 as a member of one of Honduras's established conservative political parties.
However, since taking power Zelaya has moved to the left, aligning himself with Hugo Chavez, Venezuela's president.
Colin Harding, an expert in Latin American politics, told Al Jazeera that Zelaya had apparently overestimated his own power in pushing for the referendum.
"He has no support in within his own party, he is opposed by congress, he is opposed by the judiciary and the military, who are not the power they used to be but have lined up against Zelaya ostensibily in defence of legality," he said.
'Fundamental rights'
Many union, labour and farm movements support the referendum, which Zelaya says is aimed at improving the lives for the nearly three-quarters of Hondurans who live in poverty.
Oscar Hendrix, a youth movement leader in the northwestern city of San Pedro Sula, said that the military had burned the ballot papers that had been distributed in defiance of the supreme court ruling.
"This is inconceivable. This is one of the fundamental rights of the people," he told Al Jazeera.
Hendrix said that there would be protests against the military's actions.
"We are analysing right now whether we are going to do something here or whether we are all going to mobilise to the capital city," he said.
"We will stand up for our rights."