The charismatic German coach looked agitated on the sidelines as Norwich leveled the scores at 4-4 going into injury time through a long-range effort from defender Sebastien Bassong.
But Adam Lallana's 95th-minute strike put Liverpool back in front and ensured the points would be heading back to Merseyside.
Cue the exuberant celebrations that saw Klopp's glasses knocked from his face as joyous Liverpool players piled on top of their boss.
"I usually have a second pair of glasses, but I can't find them because it's hard to find glasses without glasses" Klopp joked with reporters afterwards.
"Of course we were lucky," Klopp added of the nature of the victory. "But we were not too lucky when they equalized in overtime."
"In the middle of chaos"
Roberto Firmino had put Liverpool ahead early on before a slick backheel finish from Dieumerci Mbokani, a debut goal from new signing Steven Naismith and a coolly taken penalty from Wes Hoolahan at the start of the second period put Norwich firmly in command.
But Liverpool fought back and another strike from Firmino, sandwiched in between tidy finishes from Jordan Henderson and James Milner, put the Reds back in control as 90 minutes approached.
"It is very emotional. We are in the middle of the chaos and react. Sometimes we know what we are doing, sometimes we don't," Klopp said of the crazy final few moments and his side's celebrations.
"The game (itself) is enough of a story," he added
Norwich manager Alex Neil was understandably experiencing emotions at the other end of the scale.
"It is really frustrating. We worked really hard this week and we put in a good performance, but made it a bit of a rabble with our defending," Neil said.
The result means Norwich remained just two points above the relegation zone.
For Liverpool it was the perfect fillip after defeat to arch-rival Manchester United last weekend and moves it into seventh position in the EPL table.
United, meanwhile, lost 1-0 at Southampton to be five points behind fourth-placed Tottenham, which won 3-1 at Crystal Palace as teenage midfielder Dele Alli scored a stunning volley.
Leicester moved three points clear at the top with a 3-0 win over Stoke, but Arsenal can reclaim the lead with victory at home to Chelsea on Sunday.
Manchester City went second on goal difference after a 2-2 draw at West Ham, saved by Sergio Aguero's late second goal of the match.