The politics of polling: the report of the Committee on Polling and Digital Media

IMG_3616On 17 April, the House of Lords’ ad hoc Committee on Political Polling and Digital Media published a report, following its inquiry into the effects of political polling and digital media on politics. At an event organised by The Constitution Unit, Lord Lipsey, who chaired the Committee, discussed the report with a panel that consisted of Baroness Jay of Paddington, a Labour peer who served on the Committee; Will Jennings, of the University of Southampton; and Martin Boon, a professional pollster. Dave Busfield-Birch offers a summary of their comments.

Following an inquiry that took evidence from a variety of experts, industry professionals, and ministers, the Committee on Political Polling and Digital Media published its report on the subject on 17 April. The Constitution Unit organised an event to publicise the release of the report, which consisted of a panel discussion (summarised below) and a lively and interesting Q&A session. Committee Room 2 in the Palace of Westminster was full when Jennifer Hudson, Senior Lecturer in Political Behaviour at the UCL Constitution Unit, introduced the panel, on which she served as Chair. Lord Lipsey and Baroness Jay of Paddington introduced the report on behalf of the Committee. They were then followed by Will Jennings, Professor of Political Science at the University of Southampton, and Martin Boon, who provided the perspective of a professional pollster.

Lord Lipsey

As chair of the Committee, Lord Lipsey noted that he had enjoyed working on the inquiry that produced it, although he did acknowledge that the report was ‘slightly unusual’ in one key respect. Normally, parliamentary inquiries examine government policy, and the recommendations in their reports are aimed at influencing it. This report, however, had focused its attention on the workings of the polling and digital media industries and it is they who are the targets of most of its recommendations. One recommendation that was intended to influence government policy called for the Electoral Commission to have a wider statutory role in regulating and monitoring polling during election periods.

Lord Lipsey then went on to offer some background to the report, saying that it had partially been prompted by the existence of three big polling ‘bloopers’ in recent British political history. In 2015, polls had widely predicted a hung parliament; instead, the Conservatives secured a parliamentary majority. At the next general election in 2017, the Conservatives experienced an unexpected result in the opposite direction: where polls had predicted an increased majority for Theresa May, the voters delivered a hung parliament and a government that now relies on DUP support for its parliamentary majority. Finally, the referendum on leaving the European Union produced a vote for Brexit that the polls had largely failed to predict. Lord Lipsey was careful, however, to point out that despite these three unexpected results, people should be careful of jumping to conclusions about the state of the polling industry. The Committee found no statistical evidence that polls are getting worse internationally. However, he did warn that the failure of polls to predict three otherwise unexpected results in succession would mean that pollsters should expect ‘not to get much sleep’ during the next general election campaign. Continue reading

How online quizzes could improve information during election campaigns: lessons from Germany

m.paleseOngoing Constitution Unit research is exploring how quality of information and public discussion during election and referendum campaigns can be improved. In recent years, voting advice applications have been promoted as a way of providing impartial, good-quality information on salient issues and parties’ positions thereon. Michela Palese outlines the debate on this topic and relates early thoughts from a research trip to Germany, where the state-sponsored Wahl-O-Mat was used 15.7 million times during the 2017 federal election campaign.

Since last May, Dr Alan Renwick and I have been working on a project to understand how the quality of information and public discussion during election and referendum campaigns could be improved. In this context, I have been examining ‘voting advice applications’ (VAAs): online tools that aim to assist users in their voting decision.

In this post, I briefly contextualise the emergence of VAAs and consider the debate on the role of such tools in the UK. I then report initial findings from a research trip to Germany, where the Federal Agency for Civic Education (Bundeszentrale für politische Bildung; hereafter BPB) develops and promotes a voting advice application – the Wahl-O-Mat – for all federal and most state elections.

The origins of voting advice applications

The first VAA, the Stemwijzer, was developed in the Netherlands in 1989. Available on paper or on a diskette, it aimed to increase secondary school students’ knowledge of the differences and similarities among parties, and to aid the formation of party political choices. VAAs became available online in the mid-1990s in Finland and the Netherlands.

VAAs have spread particularly since the early 2000s, and almost all European countries now have at least one. While they take varied forms, all VAAs present users with statements to agree or disagree with and then match these responses to the positions of political parties. Developers generally use party manifestos or prior statements as a starting point, and often engage parties directly in the development process. Continue reading

Voter ID at British polling stations: learning the right lessons from Northern Ireland

7sdwzdrq.1368719121Asking voters to produce a form of identification before voting will be piloted in five English council areas this May. The move represents part of the government’s response to a series of recent recommendations for measures to safeguard the electoral process from fraud. While the pilots will provide important opportunities for policy-learning, Stuart Wilks-Heeg argues that much can already be gleaned from the experience of Northern Ireland, where voter ID requirements were first introduced in 1985.

On 3 May 2018, voters at polling stations in five English council districts (Bromley, Gosport, Slough, Watford, and Woking) will be asked for proof of identity. These voter ID pilots are central to the current UK government’s commitment to follow through on recommendations made in electoral fraud reviews carried out by both the UK Electoral Commission and by Eric Pickles in his role as Anti-Corruption Champion.

A solution in search of a problem?

Official concern about the security of the ballot has been driven by a small number of high-profile cases of fraud, most recently in Tower Hamlets in 2014. There is no evidence of widespread voter impersonation at polling stations. In fact, cases of ‘personation’, as the offence is termed in UK electoral law, are exceptionally rare. A total of 146 allegations of personation at polling stations were reported to UK police forces from 2010–16, a period that included two general elections and the EU referendum, each of which saw some 30 million votes cast. All but a handful of these 146 allegations resulted in no further action, generally because there was no evidence that an offence had been committed. Over the same time period, only seven people were convicted as a result of investigations of personation at polling stations, five of whom were involved in a single case in Derby.

Given such evidence, academics have expressed concern that voter ID is a solution in search of a problem. Some opposition politicians and political campaigners have gone further, seeing it as a consciously partisan measure. Critics argue that lower-income voters are less likely to have valid ID and will be turned away from polling stations in large numbers, or simply deterred from going to vote at all. In this view, the real purpose of voter ID at polling stations is not to restore public confidence in the electoral process, but to emulate the ‘voter suppression’ methods long practised by Republican states against likely Democrat supporters in the USA. Continue reading

Harassment and abuse of parliamentary candidates at the 2017 general election: findings from the Representative Audit of Britain

The Committee on Standards in Public Life published a report into harassment and abuse of parliamentary candidates on Wednesday. The report was informed by evidence from the 2017 Representative Audit of Britain survey, which is being administered by researchers from the Constitution Unit, Strathclyde and Birkbeck. Sofia Collignon Delmar and Jennifer Hudson summarise the evidence.

On Wednesday the Committee on Standards in Public Life published its report into harassment and abuse of parliamentary candidates, in response to claims of a frequently toxic and intimidating campaign environment during the 2017 general election. Claims of harassment have important consequences for democratic life in the UK and for the representativeness of parliament. Drawing on recent data from the Representative Audit of Britain’s survey of 2017 candidates, researchers from the UCL Constitution Unit, Strathclyde and Birkbeck provided evidence to the committee that shows the scale of the problem and the importance of the issue. They also put forward a host of potential recommendations to tackle intimidation and abuse.

In this blog post, we summarise the key findings which informed our evidence to the committee. Drawing on survey responses from Conservative, Labour, Liberal Democrat, SNP, Plaid Cymru, UKIP and Green candidates, we show who is more likely to suffer abuse, the most common forms of harassment, who candidates think is responsible for abuse and what can be done to prevent harassment and inappropriate behaviour during elections in the future. The total sample size is 964. This a response rate of 34% and can be considered representative of the party composition of the true population of candidates. The survey is still ongoing, but we do not expect the trends to change significantly.

Results show that 32% of the candidates who answered the survey suffered from some form of inappropriate behaviour during the 2017 general election campaign. The survey revealed significant differences between parties, with Conservative candidates statistically more likely to report having experienced abuse. Female candidates of all ages are also significantly more likely to report having experienced abuse than male candidates.

Continue reading

British politics and what we’ve learned after the 2017 general election

Last month’s general election delivered the latest in a series of political surprises, with the Conservatives falling short of a majority when many had anticipated they would win a landslide. On 21 June the Constitution Unit hosted a panel of election experts consisting of YouGov’s Joe Twyman and academics Justin Fisher, Jennifer Hudson, Philip Cowley and Alan Renwick to reflect on what happened. Fionnuala Ní Mhuilleoir reports.

Although we have become used to political upsets in recent years the outcome of the 8 June election nonetheless came as a surprise to many, including the Prime Minister, who saw her majority disappear when she had hoped to increase it substantially. How did this happen? How did the Conservatives manage to lose the massive lead they held at the start of the campaign, and Labour out-perform all expectations? How did the pollsters do after they had failed to call the 2015 election correctly? And what does the result mean for the government’s position in the new parliament, and for Brexit and beyond? These questions were all discussed at a Constitution Unit seminar held on 21 June, chaired by the Unit’s Director Professor Meg Russell. The panel included YouGov’s Joe Twyman, Professor Justin Fisher from Brunel University and Professor Philip Cowley from Queen Mary University of London. Dr Jennifer Hudson and Dr Alan Renwick from the Constitution Unit completed the line-up.

Joe Twyman

Joe Twyman opened the seminar with a brief post mortem on YouGov’s 2015 general election polling, which had predicted that the Conservatives would be the largest party in a hung parliament. The Conservatives went on to win 330 seats, securing a small but workable majority. YouGov subsequently identified three problems in the 2015 polling process: the samples used by YouGov and other polling companies to measure voting intention were not representative; figuring out whether people will turn out to vote is challenging; seat estimation across 650 constituencies is inherently very difficult.

Twyman then described how YouGov has responded to these issues. First, it has invested heavily in targeted recruitment, spending more than £100,000 in the last year to identify and recruit the types of people who were underrepresented in YouGov samples between 2010 and 2015, particularly those who were not interested in politics. Second, YouGov has updated how it analyses turnout. Thirdly, it has also developed a new seat estimation model.

This seat model, as is now well known, correctly predicted a hung parliament. In the run up to June 8 YouGov faced trenchant criticism, both from established commentators and on social media. Twyman reflected on Paul Krugman’s statement after the US election results that economists and commentators ‘truly didn’t understand the country we live in’. Through the efforts of YouGov, according to Twyman, we do now understand the country we live in a little better.

Justin Fisher

Justin Fisher began his contribution by drawing the audience’s attention to how important lead time ahead of an election is for party campaigns. The national and constituency campaigns have merged, with national campaigns now supporting the constituency effort. Lead time gives parties more time to plan targeting, information distribution, spending and fundraising. In a normal election campaign the critical period is the six-to-nine months before the poll.

The snap election left no opportunity for such advance campaigning. One implication is that this is likely to have been a much less expensive campaign than usual. Another is a shift in emphasis in campaigning techniques from direct mail (which requires lead time) to face-to-face campaigning and e-campaigning, which require much less preparation time. Fisher stressed that the evidence needed to confirm these expectations is still being collected.

Though the 2017 election may have accelerated the shift to e-campaigning, Fisher argued that campaigning techniques were partly heading that direction regardless. He also warned of what he called e-campaigning myths. He debunked the myth that micro-targeting of voters had only just been invented: parties have gathered data from phone calls and indirect mail for years. E-campaigning, therefore, represents evolution rather than a revolution. A further myth is the claim that because parties are using e-campaigning it must be effective. In 2015, research found it to be electorally effective, but less so than face-to-face campaigning. This has yet to be examined for the 2017 election.

Continue reading

Monitor 66: The most unexpected election

The latest issue of Monitor, the Constitution Unit’s regular newsletter, has been published today. The issue covers all of the major UK constitutional developments over the past five months, a period that has included the unexpected general election result, the confidence and supply agreement between the Conservatives and DUP that followed, Nicola Sturgeon’s announcement of plans for a second referendum (later ‘reset’) and the beginning of Brexit negotiations, plus much else besides. The front page article is reproduced here. You can read the full issue at this link

Current British politics is rarely dull. Added to the unexpected result in the 2016 Brexit referendum and the subsequent Miller case regarding parliament’s role in the process (not to mention the Conservatives’ unexpected outright majority in 2015), we now have our second hung parliament in seven years, a resurgent Corbyn-led Labour Party, and a previously popular Prime Minister who appears to be on the ropes. All this following a general election that few expected, and that some even thought pretty much impossible under the 2011 Fixed-term Parliaments Act.

Following the successful passage of the European Union (Notification of Withdrawal) Act, authorising the trigger of Article 50 (see page 4), Theresa May surprised almost everybody on 18 April by proposing a general election for 8 June. Having started with what looked like an unassailable lead in the polls, in an election where she sought to strengthen her hand in parliament during the Brexit negotiations, she managed instead to lose her slender Commons majority and was forced into a confidence and supply arrangement with Northern Ireland’s Democratic Unionist Party (DUP) (see page 6). Her authority within her own government is much diminished, and ministers have openly squabbled with each other over Brexit priorities. Meanwhile, Labour’s unexpected gains leave its previously fractious parliamentary party appearing suddenly united behind Jeremy Corbyn.

The results were also a blow to Nicola Sturgeon, whose Scottish National Party (SNP) lost twelve seats to the Conservatives, six to Labour and three to the Liberal Democrats. Conservative leader Ruth Davidson (who spoke at a packed Constitution Unit event during the campaign) in contrast made a strong case for the Union and gained further stature and negotiating power. Sturgeon acknowledged on 27 June that she would have to put the campaign for a second Scottish independence referendum on hold for the time being (see page 11).

Continue reading

The EU referendum, one year on: public debate

Today is the first anniversary of the EU referendum. To mark this the UK in a Changing Europe Initiative and Political Studies Association have published a collection of essays titled EU Referendum: One Year OnAlan Renwick‘s contribution, focusing on the continuing weakness of public debate around Brexit and how it might be strengthened, is re-produced here. 

This month’s general election was supposed to be about Brexit. In her Downing Street statement on 18 April announcing her intention to seek the dissolution of parliament, Theresa May spoke of little else. She suggested that, without an early election, her opponents would have both the will and the ability to disrupt her efforts to negotiate the best possible Brexit deal. The vote, she hoped, would deliver a secure majority for her favoured Brexit plan.

Brexit’s low profile

In the end, however, Brexit did not dominate. It was mentioned on average 580 times a day in the main UK-wide newspapers in the week following May’s statement. But that fell below 500 for the following two weeks, then below 400 for the four and a half weeks between then and polling day – dipping to just 155 a day in the sixth week of the campaign, immediately following the Manchester bombing. When the BBC’s Andrew Neil interviewed the Prime Minister on 22 May, his questions turned to Brexit only in the last few minutes. Interviewing Jeremy Corbyn four days later, he asked nothing directly about Brexit itself, though he did enquire towards the end about immigration. The other main television debates and interviews gave Brexit more attention, but still it did not dominate.

There were at least three reasons for this. One, as just suggested, was the unforeseen and tragic eruption of terror into the campaign caused by the attacks in Manchester and London. This inevitably shifted the agenda towards the terrorist threat. It raised deep questions about both Theresa May’s record on police funding and Jeremy Corbyn’s record of opposition to counter-terrorism legislation and seeming friendship with certain terrorist organisations.

A second reason was the spectacular misfiring of the Tory campaign. Conservative strategists intended to focus on one core message: that Theresa May, not Jeremy Corbyn, was the person to provide the ‘strong and stable leadership’ needed for successful Brexit. But the Conservative manifesto introduced controversial policies – most notably on social care – that distracted attention away from that core message. The Prime Minister’s forced u-turn on social care undermined the credibility of the message. Veteran election watcher Sir David Butler tweeted (sic) that ‘In the 20 general election campaigns I’ve followed, I can’t remember a U-turn on this scale’.

Continue reading