Louis Walsh 'is being lined up to return to X Factor as a fifth judge'... as executive producer admits the show would benefit from being 'rested' for a few years

The X Factor has been suffering a ratings slump this series.

And ITV bosses are reportedly planning a major shake-up before the live shows begin, with reports suggesting veteran judge Louis Walsh could be making a comeback as a 'fifth judge' in a bid to lure back viewers, who have been largely left uninspired by the Irish star's replacement Nick Grimshaw.

The claims come as long-term executive producer, Richard Holloway, suggested the show would benefit from being 'rested' for a few years.

Scroll down for video

Comeback king: Louis Walsh is rumoured to be returning to The X Factor as a fifth judge, who would offer unbiased opinions on the conestants

Comeback king: Louis Walsh is rumoured to be returning to The X Factor as a fifth judge, who would offer unbiased opinions on the conestants

Louis is alleged to be returning as a neutral fifth judge, sitting alongside Nick, Simon Cowell, Rita Ora and Cheryl-Fernandez Versini and providing unbiased comments on the contestants with a pinch of his trademark good humour.

A show source told The Sun: 'It hasn’t felt the same for Simon without Louis - and viewers feel the same.

'Louis could annoy a lot of people, but he was brilliant at creating the drama required to make a show like X Factor worked.'

Latest X Factor news and pictures on judge Louis Walsh and contestants

Shaking things up: The new judging line-up (L-R) Nick Grimshaw, Rita Ora, Cheryl Fernandez-Versini and Simon Cowell has led one million viewers to switch off since last year 

Shaking things up: The new judging line-up (L-R) Nick Grimshaw, Rita Ora, Cheryl Fernandez-Versini and Simon Cowell has led one million viewers to switch off since last year 

An X Factor spokesperson told MailOnline: 'The live shows do not start until the end of next month and any talk of plans at this stage is speculation.' 

The paper claims that while BBC Radio 1 judge is proving popular backstage, his presence has been labelled 'dull and uninspired' by viewers, with one million switching off since last year.

The revelation comes as Cowell's right hand man Richard Holloway addressed the declining ratings during a Royal Television Society event in London.

'[X Factor] will have a finite life span. But I think you then rest it, then you bring it back,' Billboard quotes The X Factor producer as saying.

Time for a change? Cowell's right hand man Richard Holloway addressed the declining ratings during a Royal Television Society event in London

Time for a change? Cowell's right hand man Richard Holloway addressed the declining ratings during a Royal Television Society event in London

'Viewing habits have changed enormously, especially in the last couple of years... we all got to appreciate that and kind of consider it more', he added.

The view has also been echoed by Little Mix, who revealed they were starting to find the singing contest - which they won in 2011 - 'predictable'.

'I think The X Factor is a brilliant show, but it has [been on] every year and maybe people will appreciate it more,' Jade Thirlwall told Digital Spy.

'Predictable': Little Mix (L-R) Jade Thirlwall, Perrie Edwards, Jesy Nelson and Leigh-Anne Pinnock - who won the show in 2011 - have confessed they think the ITV contest needs a break 

'Predictable': Little Mix (L-R) Jade Thirlwall, Perrie Edwards, Jesy Nelson and Leigh-Anne Pinnock - who won the show in 2011 - have confessed they think the ITV contest needs a break 

Her bandmate Jesy Nelson added: 'I feel like I literally know what's going to happen next. It's like watching a film you've seen 10 times.'

In 2013, music mogul Simon signed a three-year deal to broadcast both The X Factor and Britain's Got Talent until 2016. 

All new line-up: As well as new additions Nick and Rita, Simon replaced popular host Dermot O'Leary with Olly Murs (L) and Caroline Flack (C) 

All new line-up: As well as new additions Nick and Rita, Simon replaced popular host Dermot O'Leary with Olly Murs (L) and Caroline Flack (C) 

The comments below have not been moderated.

The views expressed in the contents above are those of our users and do not necessarily reflect the views of MailOnline.

By posting your comment you agree to our house rules.

Who is this week's top commenter? Find out now