Hereford earned all three points with a 1-2 win away to Banbury.
Andy Williams took the lead in the 45th minute before converting a penalty not long after.
Ken Charles also scored from the spot to give the hosts hope.
Two red cards for the Bulls led to a nervy end to the game but they held on for the victory.
The win moves Hereford into 10th, two points off the play-offs whilst Banbury remain in 22nd.
Paul Caddis made four changes to the side that drew to Buxton with Aurio Teixeira, Jason Cowley, Williams and Dominic McHale replacing Jordan Lyden, Tope Obadeyi, Kieran Phillips and Lawson D’Ath.
Kevin Wilson made just the one alteration to the team that lost 3-1 to Bishop’s Stortford with Jack Davies coming in for Rudi Pache.
After a quiet start to the game with just a few half chances for either side, in the 29th minute, Luca Woodhouse thought he had taken the lead for the hosts with a superb strike from range but it was disallowed as a player in an offside position was deemed to be interfering with play.
Hereford’s number nine then forced a fantastic save out of James Dadge in the 41st minute when he worked some space to curl an effort from range towards the top right with the Northampton Town loanee diving to stop it.
On the cusp of half-time Caddis’ side took the lead when Cowley slipped Aaron Skinner in down the right side of the box, the full-back then played it across to Williams who was at the back post to score his third goal in two games.
That was the final action of the first half meaning that Hereford went into the break a goal to the good.
Early on in the second 45, the Bulls were awarded a penalty for a handball on DJ Sturridge which was rifled into the top right corner by Williams to secure his second brace in as many games.
In the 59th minute, Ward attempted a superb curling effort from range that looked destined to nestle into the top corner if it wasn’t for a great save by Curtis Pond who had got across to tip it over the bar.
Banbury were then also awarded a spot kick 12 minutes later for a similar handball by Kyle Howkins which Charles converted to pull one back.
Cameron was then sent off for a foul just outside the box meaning that Hereford had to play the last quarter of an hour with 10 men.
Just nine minutes later things went from bad to worse for Caddis’ side when Aaron Skinner was shown a second yellow to send the away side down to nine players.
The hosts pushed hard for an equaliser and came close on a few occasions but could not take advantage of their two man advantage meaning that the game finished 1-2.
Hereford FC XI- C. Pond, A. Skinner, K. Howkins, N. Cameron, L. Hudson, A. Teixeira, A. Babos (A. Rooney 90+2’), D. McHale (J. Lyden 65’), J. Okeke, A. Williams, J. Cowley (Y. Ceesay 65’)
Banbury United XI- J. Dadge, J. Davies, C. Ward, L. Woodhouse, T. Fleming, DJ. Sturridge, K. Charles, C. Hewitt, E. Light, B. Beresford, M. Maja