Yes, Prime Minister

Any political discussion should go here. This subforum will be moderated differently than other forums.
Forum rules
1.) No personal threats.
2.) No doxxing/revealing personal information.
3.) No spam.
4.) No circumventing press restrictions.
5.) No racism, sexism, homophobia, or derogatory posts.
Post Reply
Message
Author
Octavious
Posts: 4028
Joined: Fri Sep 29, 2017 4:16 pm
Location: The Five Valleys, Gloucestershire
Contact:

Yes, Prime Minister

#1 Post by Octavious » Sun Feb 25, 2024 7:29 pm

Some of you may remember the Yes, Prime Minister episode in which it was argued that the wording and ordering of of opinion poll questions can be manipulated to achieve desired outcomes.

https://youtu.be/ahgjEjJkZks?si=Je0kDKbFAgF4NcLZ

Well, Ipsos have only gone and done it!

Results below :-D

https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc548f657-0c77-45ae-baf6-2bcab076fe69_1220x1128.png?utm_source=substack&utm_medium=email
I eat cookies to improve my snacking experience

Octavious
Posts: 4028
Joined: Fri Sep 29, 2017 4:16 pm
Location: The Five Valleys, Gloucestershire
Contact:

Re: Yes, Prime Minister

#2 Post by Octavious » Sun Feb 25, 2024 7:34 pm

Image
I eat cookies to improve my snacking experience

User avatar
Jamiet99uk
Posts: 32404
Joined: Sat Dec 30, 2017 11:42 pm
Location: Durham, UK
Contact:

Re: Yes, Prime Minister

#3 Post by Jamiet99uk » Sun Feb 25, 2024 8:14 pm

That's fantastic, highly amusing, well done to them.

I am a big fan of Yes, Minister and Yes, Prime Minister.
The only person you're truly competing against, Wesley, is yourself.

learnedSloth
Posts: 206
Joined: Mon Sep 12, 2022 10:20 pm
Contact:

Re: Yes, Prime Minister

#4 Post by learnedSloth » Sun Feb 25, 2024 10:46 pm

Yes, you can ask leading questions to get the desired outcome... in spite of public opinion. The sum of the matter is that you should take poll results with a grain of salt.
¶ Keep thy heart with all diligence; for out of it are the issues of life.
-- Proverbs of Solomon, chapter 4, verse 23

User avatar
orathaic
Bronze Donator
Bronze Donator
Posts: 1563
Joined: Fri Sep 29, 2017 3:20 pm
Contact:

Re: Yes, Prime Minister

#5 Post by orathaic » Fri Mar 01, 2024 11:34 am

Enjoyable, very small difference though.

How big do you think the error bara are?

Can we compare the same question to just asking 5 unrelated questions in advance of the final ones?

Octavious
Posts: 4028
Joined: Fri Sep 29, 2017 4:16 pm
Location: The Five Valleys, Gloucestershire
Contact:

Re: Yes, Prime Minister

#6 Post by Octavious » Fri Mar 01, 2024 4:54 pm

Small difference? It went from a clear majority (45 to 38) in favour of national service to an even clearer majority (48 to 34) against. A 21 point swing is pretty significant in any context, and if error bars are big enough to hide it then it's pointless doing any polling at all. Elections are typically decided by somewhat smaller margins.
I eat cookies to improve my snacking experience

User avatar
Esquire Bertissimmo
Posts: 567
Joined: Fri May 05, 2023 11:44 pm
Contact:

Re: Yes, Prime Minister

#7 Post by Esquire Bertissimmo » Mon Mar 04, 2024 8:13 pm

I feel this thread is really missing the other side of the story.

These issues with polling are well understood and sophisticated pollsters have fairly reliable methods to reduce these errors. For example, the question-order bias can be minimized by pre-testing the questions, randomizing / rotating the question order, inserting neutral / buffer questions, etc.

It's true that a survey can be cynically manipulated to produce the "intended" results. But it's also true that a serious pollster with a reputation to defend can't constantly release biased polls, especially when the poll's bias can be tested against real data (e.g., an election outcome).

So when an interest group releases a one-off poll about something unverifiable, it makes sense to be very skeptical. But when 538 does a careful meta-poll about some real world event (e.g., who is going to be the Governor of California), it makes sense to assume it has some predictive power.

learnedSloth
Posts: 206
Joined: Mon Sep 12, 2022 10:20 pm
Contact:

Re: Yes, Prime Minister

#8 Post by learnedSloth » Tue Mar 05, 2024 11:37 am

Esquire Bertissimmo wrote:
Mon Mar 04, 2024 8:13 pm
But it's also true that a serious pollster with a reputation to defend can't constantly release biased polls, especially when the poll's bias can be tested against real data (e.g., an election outcome).
A Machiavellian nitpick: Polls are usually made every few weeks in the run-up to the election, so only the last polls need to be accurate. You can always explain the apparent shift by campaigning.
¶ Keep thy heart with all diligence; for out of it are the issues of life.
-- Proverbs of Solomon, chapter 4, verse 23

User avatar
Esquire Bertissimmo
Posts: 567
Joined: Fri May 05, 2023 11:44 pm
Contact:

Re: Yes, Prime Minister

#9 Post by Esquire Bertissimmo » Tue Mar 05, 2024 2:51 pm

learnedSloth wrote:
Tue Mar 05, 2024 11:37 am
Esquire Bertissimmo wrote:
Mon Mar 04, 2024 8:13 pm
But it's also true that a serious pollster with a reputation to defend can't constantly release biased polls, especially when the poll's bias can be tested against real data (e.g., an election outcome).
A Machiavellian nitpick: Polls are usually made every few weeks in the run-up to the election, so only the last polls need to be accurate. You can always explain the apparent shift by campaigning.
I'm still reading into this a desire to say polls are mostly phoney, which isn't necessarily the case.

A well done poll does actually reflect public opinion at the time it's conducted. It doesn't exist in a vacuum — it can be tested against other polls, other sources of opinion research (e.g., betting markets, focus groups, etc.), and strange results get huge public scrutiny, so there are strong incventives to not fabricate nor bias one's results. Polls should change in response to events, but in the absence of big events, professional pollsters prize poll stability as a sign of good methodology. There are good reasons to think that the polls that best predict the final outcome (e..g., big well-conducted meta-polls) were accurately tracking opinion along the way.

learnedSloth
Posts: 206
Joined: Mon Sep 12, 2022 10:20 pm
Contact:

Re: Yes, Prime Minister

#10 Post by learnedSloth » Tue Mar 05, 2024 4:14 pm

Betting shops have obvious monetary incentives to get their odds right. I think that even Machiavelli would have hard time sketching ways to skew them. It would definitely require deep pockets because of said incentives. 🤔
¶ Keep thy heart with all diligence; for out of it are the issues of life.
-- Proverbs of Solomon, chapter 4, verse 23

User avatar
orathaic
Bronze Donator
Bronze Donator
Posts: 1563
Joined: Fri Sep 29, 2017 3:20 pm
Contact:

Re: Yes, Prime Minister

#11 Post by orathaic » Fri Mar 08, 2024 9:50 am

Octavious wrote:
Fri Mar 01, 2024 4:54 pm
Small difference? It went from a clear majority (45 to 38) in favour of national service to an even clearer majority (48 to 34) against. A 21 point swing is pretty significant in any context, and if error bars are big enough to hide it then it's pointless doing any polling at all. Elections are typically decided by somewhat smaller margins.
I was misreading the result as a 3% shift, 45 -> 48 %, barely outside the realm of error bara.

MajorMitchell
Posts: 1506
Joined: Sun Dec 31, 2017 4:05 am
Location: Now Performing Comedic Artist Dusty Balzac Bush Philosopher from Flyblown Gully by the Sea
Contact:

Re: Yes, Prime Minister

#12 Post by MajorMitchell » Wed Apr 03, 2024 9:01 am

Brilliant series. The elevation to Prime Minister episodes were fantastic

Post Reply

Who is online

Users browsing this forum: No registered users