The away win moved the Gunners back to within a point of Premier League defending champions, Manchester City.
After winning 2-0 against Newcastle United, Mikel Arteta said Arsenal came to St James Park for revenge.
Last year, the Gunners' season came crashing down at St James Park when they were beaten 2-0, and that loss meant a top four finish was out of their hands.
To Arteta, that defeat motivated his players ahead of the match, and they scored two goals through Martin Odegaard and an own goal by Fabian Schar to claim a victory that gave their title dreams new impetus.
"My players had revenge on their minds after last year," Arteta said, as quoted by Sky Sports.
20:35 - 07.05.2023
PREMIER LEAGUE Arsenal down Newcastle to keep title race alive
Given the Magpies’ recent run, this fixture was seen as a tricky one for the Gunners, but the London side has managed a win and a clean sheet.
The Spaniard made one change from the squad that defeated Chelsea on Tuesday, as Gabriel Martinelli replaced Leandro Trossard. In midfield, he preferred Jorginho again in place of Thomas Partey, and the Gunners’ boss lauded how the Italian fared against the Magpies.
"Jorginho was exceptional; he was the man of the match," he added.
"There were question marks because it was going to be really physical, but if you want to go physicality against physicality, you have no chance to win the game, so we had to try something different.
"He understood the game really well, he's a really intelligent player. He gives a lot of security to the team and dominated the game in many moments."
22:14 - 05.05.2023
PREMIER LEAGUE Beware Arsenal! Guardiola delivers warning as title race tightens
City have a chance to widen the gap if they win Saturday’s match against Leeds.
The fixture was deemed one of the toughest for the Gunners, but the London side showed resilience to beat the Magpies, who had won eight of their last nine games. Their performance, attracted Arteta’s praise.
"They showed what it takes to come here, in this environment, against a great team, and what it takes to win," explained the manager.
"The desire to keep digging, to keep believing, with a reward that is so big. We had to do it today [on Sunday], and we did everything we had to do to win the game.
"Sport always gives you another opportunity, and then you have to take it, learn from those moments, see how you felt in those moments, overcome it, and act in a different way. The team did that really well."
Arsenal will play host to Brighton on May 14 in another tricky duel.