The Balkan country opened their Group G campaign with an emphatic 8-1 defeat of Liechtenstein.
Hopes will now be high they can consolidate top spot as they take on a Latvian side 64 places below their 30th position in the world rankings.
Manchester City striker Edin Dzeko and Stuttgart forward Vedad Ibisevic will again be the chief threats after both plundered hat-tricks last Friday.
Zvjezdan Misimovic was also on target and Latvia, who lost their opener 2-1 at home to Greece, are sure to have their work cut out.
Despite that, coach Safet Susic is warning against complacency and told reporters: "The match in Vaduz should not be the starting point for Latvia - in Zenica on Tuesday we play a new game with a completely different opponent and we have to be very careful.
"We struggled against Liechtenstein in a certain way in the first 20 minutes, although after we broke the ice it became easy."
Latvia put up a good performance against the Greeks, who reached the quarter-finals at Euro 2012, and led through an Aleksandrs Cauna penalty before Nikos Spyropoulos and Theofanis Gekas replied in the second half.
Greece return to action as they take on Lithuania in Piraeus.
Lithuania, ranked 116 in the world, made a creditable start to their programme as they held Slovakia, 71 places above them, to a 1-1 draw in Vilnius.
In a match in which both sides had a man sent off, Hearts captain Marius Zaliukas opened the scoring for Lithuania before Marek Sapara levelled.
But Lithuania have now gone nine games without a win and face a tough task to turn that around against a Greek side unbeaten in 12 at home.
They will also have to make do without Tadas Labukas after his dismissal for a second bookable offence last Friday.
The other match in the latest round of fixtures sees Slovakia host Liechtenstein in Bratislava.
Liechtenstein will be hoping to salvage pride after their hammering last weekend but face a daunting challenge.
At 149, the principality are 104 places below Slovakia in the world rankings and the hosts should still be strong enough even without Viktor Pecovsky, the striker who saw a straight red card in Lithuania.