Lazaro Mambosasa, the Dar es Salaam police chief, told a press conference the kidnappers had "shot into the air" before bundling Dewji into a auto.
Environment Minister January Makamba, a friend of Mr Dewji, tweeted that he had spoken to Mr Dewji's father and the family confirmed that he had been kidnapped.
The armed men were foreigners, the Swahili Times reported on Twitter, citing Police Commander Lazaro Mambosasa.
The motive for the kidnapping is still unknown, although police expect this to be a "ransom" kidnapping. "This kind of incident is new here".
Dewji is the owner and president of the multi-billion dollar revenue Mohammed Enterprises Tanzania Ltd (METL Group) and a former member of parliament for the ruling CCM party.
Mr Dewji was born in Tanzania and studied at Georgetown University in the United States.
"Three people have already been arrested but we can't divulge their identity for the moment", he said.
Twitter Reacts to Channing Tatum & Jessie J Dating
Amid reports that Channing Tatum and Jessie J are dating, Jenna Dewan fans are not happy about the new blossoming relationship. In what might be the most random couple you'll hear shacking up today, Jessie J and Channing Tatum are going steady.
Verne Troyer’s Cause of Death Revealed
At the time, Troyer's team released a statement asking fans to "keep Verne in your thoughts and prayers". According to TMZ , the police were informed that the actor was suicidal before he was hospitalised.
Samsung launches A9 smartphone with four cameras for the 'Instagram generation'
Samsung is yet to announce whether it plans to launch the Galaxy A9 in other markets including India, but it is highly possible. Samsung on Thursday added another new Galaxy A phone to its portfolio, and it is by far the company's most unique one to date.
"They (the four were masked individuals) fired one bullet in the air and all the hotel security guards ran away", he said.
Dewji was elected to parliament on the CCM ticket but did not seek re-election to his seat in the 2015 election.
In 2013, he became the first Tanzanian to grace the cover of Forbes magazine and was named Forbes Africa Person of the Year in 2015.
Dar es Salaam regional commissioner Paul Makonda cautioned the public against speculation.
Dewji, 43, has a net worth of $1.5 billion and is Tanzania's only billionaire, according to Forbes.
He is also the main shareholder in Tanzania's Simba FC football club.