The party retained power overall, but Mayor Allan Garbutt lost his Ackworth, North Elmsall and Upton seat to Conservative Richard Molloy in a close-run battle.
Council leader Peter Box held onto Altofts by a clear majority, but Trevor Izon, cabinet member for children and young people, lost Pontefract South to Tory Mark Crowther.
Albert Manifield, deputy cabinet member for regeneration, lost out to another Tory, Susan Lodge, by 53 votes in the Crofton, Ryhill and Walton ward.
Allan Garbutt said on Friday: "I'm obviously disappointed to get voted out.
"I've had four lovely years of serving the people of ward one and will always remember the good times I have had.
"It's a democracy and the electors have chosen someone else. I wish him well and hope he does justice to the people of the ward I have served."
The Liberal Democrats lost their grip on Ossett, with Tory Terry Brown taking the seat formerly held by retiring long-serving councillor and former Ossett mayor Alec Metcalfe by just 15 votes.
He beat new Liberal Democrat candidate Mark Goodair into second place, with Labour's David Watts coming third.
Horbury lost its only Labour councillor, with Tory Graham Jesty beating Janet Holmes in the same seat where her husband, Brian Holmes, was voted out last year.
For a full election round-up, buy this week's edition of the Wakefield Express