Attahullah Khogyani, the spokesman for the provincial governor, said the attackers killed at least four victims and that at least 20 other people were wounded.
At least four attackers armed with rocket-propelled grenades and machine guns were fighting police, he said.
Following the explosion, several gunmen opened fire and engaged in clashes with the security forces near the government facility.
Last year, United States stepped up its support to struggling Afghan forces, announcing plans for thousands of additional advisers and increasing air strikes in a bid to force the Taliban to enter peace negotiations.
Earlier, an explosion at a mosque in the eastern Afghan province of Khost killed at least 13 people and wounded 31 and the casualty total may rise.
Khogyani further added that the attack was carried out a by group of eight militants with at least two of them detonating their explosives near the Customs Department at around 12:30 pm local time.
In Australia, there was the most bloody murder in 22 years
Police have revealed few details about the recent killings, and it is not clear whether there was more than one shooter. Police investigate the death of seven people in a suspected murder-suicide in Osmington , near Perth, Australia .
Ex-Castlevania boss launches 8-bit Bloodstained precursor
Bloodstained: Curse of the Moon will launch for PlayStation 4, PlayStation Vita , 3DS, Switch and PC on May 24th. Bloodstained: Curse of the Moon has been inspired by a legendary 2D action games from the 80s.
Iran leaders on diplomatic push to salvage nuke deal, demand European Union guarantees
Mohammad Javad Zarif and senior Chinese officials hailed the "strategic partnership" between their countries. Trump hit back on Saturday evening, tweeted that the accord had failed to contain Iran's militarism.
Jalalabad is the capital of restive Nangarhar, which borders Pakistan.
Daesh has claimed responsibility for an attack on a government building in Afghanistan on Sunday, the militant group's Amaq news agency said without providing any evidence. Some areas of the province are a stronghold of the Islamic State group, while Taliban fighters are also active there.
Dozens of people have been killed in voter registration centres in recent weeks.
The Taliban recently launched their annual spring offensive, in an apparent rejection of a peace overture by the Afghan government.
Heavy security forces arrived at the spot of the attack.