Anderson and Finn shared three wickets apiece for England, while Duminy scored a fifty for South Africa.
London: South Africa made a recovery after a disastrous beginning to their first innings of the third and final Test at Lord's on Thursday.
JP Duminy made an 61, while Jacques Rudolph too contributed with 42 as the visitors reached 262 for 7 before bad light stopped play, with 2.2 overs still to be bowled in the day.
Steven Finn and James Anderson shared three wickets apiece to flatten South Africa's top-order.
Having won the toss and decided to bat first, South Africa lost four of their five top-order batsmen in the first session of play. The second session was a little better though, as AB de Villiers (27) was the only batsman who got out.
Graeme Smith was the first to go as he fiddled at a ball from Anderson, which was wide outside the off-stump, and got a thin edge to the wicketkeeper. Umpire Kumar Dharamsena declined the appeal but England went for the review and result went in their favour. Smith only scored 14 runs.
Finn snared Alviro Petersen (22) and Hashim Amla (13) in quick succession to leave South Africa reeling at 50 for 3. Petersen could not fend off a short ball as it caressed his gloves and Matt Prior took a tumbling catch behind the stumps. Amla was cleaned up by the ball which nipped back after pitching. He went for the drive but the ball went through his bat and pad to rattle the stumps.
Finn struck again in the next over to nip out Jacques Kallis. A short ball from Finn lifted off the pitch and seemingly brushed Kallis' gloves. The umpire gave him not out but England went for the review and the third umpire Rod Tucker adjudged Kallis out.
The decision seemed completely wrong as Kallis had removed his hand from the handle of the bat when the ball brushed his gloves and according to the rules, he couldn't be given out but the Tucker thought otherwise.
His decision was ridiculed by the commentators, and shocked Kallis as well as his team-mates in the dressing room.
At lunch, South Africa were 65 for 4, with de Villiers and Rudolph are holding the fort.
Anderson troubled de Villiers at a couple of occasions and finally dismissed him for 27. De Villiers went for a drive on a good length delivery which moved away slightly after pitching. He got an edge and was caught in the slip by Alastair Cook.
Rudolph played some fine shots and looked comfortable in the middle against fast bowlers as well as against offspinner Graeme Swann. He and Duminy are the last recognised batting pair and have the responsibility of taking South Africa to a respectable total.
The result of the Test will decide whether England retain their No. 1 status in Test cricket or if South Africa replace them at the the top. England need to win in order to retain the Test mace while South Africa just need a draw to become the new Test No. 1.