Lazaro Mambosasa, the Dar es Salaam police chief, told a press conference the kidnappers had "shot into the air" before bundling Dewji into a auto.
Environment Minister January Makamba, a friend of Mr Dewji, tweeted that he had spoken to Mr Dewji's father and the family confirmed that he had been kidnapped.
The armed men were foreigners, the Swahili Times reported on Twitter, citing Police Commander Lazaro Mambosasa.
The motive for the kidnapping is still unknown, although police expect this to be a "ransom" kidnapping. "This kind of incident is new here".
Dewji is the owner and president of the multi-billion dollar revenue Mohammed Enterprises Tanzania Ltd (METL Group) and a former member of parliament for the ruling CCM party.
Mr Dewji was born in Tanzania and studied at Georgetown University in the United States.
"Three people have already been arrested but we can't divulge their identity for the moment", he said.
Wall Street plunges as investors seek safety
US stocks are plunging toward their worst loss in six months on Wednesday as technology companies continue to take sharp losses. Amazon ($AMZN) was the biggest loser in the sector, losing more than $56 billion in market cap on Wednesday alone.
Samsung Galaxy A9 with quad cameras, 3,800mAh battery launched
The Samsung Galaxy A9 is set to go on sale in November this year starting at £549 - retailing over £200 less than the Galaxy S9 . Dubbed as the Samsung Galaxy A9 (2018 ), it comes with a total of five cameras- four on the rear side and one on the front side.
U.S. ramps up pressure on Saudis over missing journalist
Turkey on Monday conveyed its expectation of "full cooperation" from Saudi Arabia in the search for the missing journalist. I do look at it certainly has a shot across the bow at Saudi Arabia and these are very serious steps", he said.
"They (the four were masked individuals) fired one bullet in the air and all the hotel security guards ran away", he said.
Dewji was elected to parliament on the CCM ticket but did not seek re-election to his seat in the 2015 election.
In 2013, he became the first Tanzanian to grace the cover of Forbes magazine and was named Forbes Africa Person of the Year in 2015.
Dar es Salaam regional commissioner Paul Makonda cautioned the public against speculation.
Dewji, 43, has a net worth of $1.5 billion and is Tanzania's only billionaire, according to Forbes.
He is also the main shareholder in Tanzania's Simba FC football club.