Parise scored his 20th and 21st goals of the season after netting only one in five games.
"That's what Zach does," Devils coach Brent Sutter said. "That third goal was a hardworking goal. He brings that every night for us."
New Jersey took a 1-0 lead on its first shot just 1:02 in when Parise skated in alone on the left wing and beat goalie Manny Legace through the pads. It was Parise's first goal in three career games against St. Louis.
The Blues tied it when Brad Boyes jammed in a rebound off Jeff Woywitka's shot at 4:19 for his team-leading 18th goal. St. Louis grabbed the lead at 7:41 when David Backes beat Scott Clemmensen for his 11th goal.
Despite the Blues' effort, coach Andy Murray was disappointed.
"We're at the bottom of the standings because we lose games like this," Murray said. We need to find a way to win or get a point out of it.
"To sit where we're sitting right now and not find a way continuously (to get results) doesn't sit well."
Clemmensen, who grew up just outside St. Louis, faced the Blues for the first time in his career.
"It was fun and it's close to my hometown," Clemmensen said. "I had a lot of friends and family here."
The Devils goalie, playing in place of the injured Martin Brodeur, recognized how important it is to stay focused on the road.
"It's tough to come into other people's buildings and stay true to your game and not get caught up with what they're doing," Clemmensen said.
Brian Rolston tied it early in the second period for the Devils with his fifth goal. Rolston, who missed 18 games earlier in the season because of an ankle injury, slipped a rebound past Legace at 17:23 to make it 2-2.
Parise scored his second of the game with just 5:41 remaining, fighting off Backes for a loose puck in front of the net to give New Jersey a 3-2 lead.
"I just found the rebound," Parise said. "I don't remember, I just looked down and saw it there, swatted it and it went in."
The Blues lost for the ninth time in 11 games.
"We're in every game. We're playing great hockey," Legace said. "We're playing good. It's just really weird. Can't figure it out."
Jay Pandolfo scored with 3:27 left to give New Jersey a 4-2 lead, and Alex Steen brought the Blues within a goal with 27.3 seconds remaining.
Notes: St. Louis C T.J. Oshie returned to the lineup after missing 11 games due to a high-ankle sprain. ... New Jersey D Bryce Salvador, formerly of the Blues, played after sitting out five games because of an ear infection. Salvador earned an assist on the Devils' winning goal. It was Salvador's first game in St. Louis since being traded for Cam Janssen on Feb. 26. ... New Jersey D Colin White sat out due to an upper body injury.
