Yes, Prime Minister
Forum rules
1.) No personal threats.
2.) No doxxing/revealing personal information.
3.) No spam.
4.) No circumventing press restrictions.
5.) No racism, sexism, homophobia, or derogatory posts.
1.) No personal threats.
2.) No doxxing/revealing personal information.
3.) No spam.
4.) No circumventing press restrictions.
5.) No racism, sexism, homophobia, or derogatory posts.
-
- Posts: 4028
- Joined: Fri Sep 29, 2017 4:16 pm
- Location: The Five Valleys, Gloucestershire
- Contact:
Yes, Prime Minister
Some of you may remember the Yes, Prime Minister episode in which it was argued that the wording and ordering of of opinion poll questions can be manipulated to achieve desired outcomes.
https://youtu.be/ahgjEjJkZks?si=Je0kDKbFAgF4NcLZ
Well, Ipsos have only gone and done it!
Results below
https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc548f657-0c77-45ae-baf6-2bcab076fe69_1220x1128.png?utm_source=substack&utm_medium=email
https://youtu.be/ahgjEjJkZks?si=Je0kDKbFAgF4NcLZ
Well, Ipsos have only gone and done it!
Results below
https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc548f657-0c77-45ae-baf6-2bcab076fe69_1220x1128.png?utm_source=substack&utm_medium=email
I eat cookies to improve my snacking experience
- Jamiet99uk
- Posts: 32404
- Joined: Sat Dec 30, 2017 11:42 pm
- Location: Durham, UK
- Contact:
Re: Yes, Prime Minister
That's fantastic, highly amusing, well done to them.
I am a big fan of Yes, Minister and Yes, Prime Minister.
I am a big fan of Yes, Minister and Yes, Prime Minister.
The only person you're truly competing against, Wesley, is yourself.
-
- Posts: 206
- Joined: Mon Sep 12, 2022 10:20 pm
- Contact:
Re: Yes, Prime Minister
Yes, you can ask leading questions to get the desired outcome... in spite of public opinion. The sum of the matter is that you should take poll results with a grain of salt.
¶ Keep thy heart with all diligence; for out of it are the issues of life.
-- Proverbs of Solomon, chapter 4, verse 23
-- Proverbs of Solomon, chapter 4, verse 23
Re: Yes, Prime Minister
Enjoyable, very small difference though.
How big do you think the error bara are?
Can we compare the same question to just asking 5 unrelated questions in advance of the final ones?
How big do you think the error bara are?
Can we compare the same question to just asking 5 unrelated questions in advance of the final ones?
-
- Posts: 4028
- Joined: Fri Sep 29, 2017 4:16 pm
- Location: The Five Valleys, Gloucestershire
- Contact:
Re: Yes, Prime Minister
Small difference? It went from a clear majority (45 to 38) in favour of national service to an even clearer majority (48 to 34) against. A 21 point swing is pretty significant in any context, and if error bars are big enough to hide it then it's pointless doing any polling at all. Elections are typically decided by somewhat smaller margins.
I eat cookies to improve my snacking experience
- Esquire Bertissimmo
- Posts: 567
- Joined: Fri May 05, 2023 11:44 pm
- Contact:
Re: Yes, Prime Minister
I feel this thread is really missing the other side of the story.
These issues with polling are well understood and sophisticated pollsters have fairly reliable methods to reduce these errors. For example, the question-order bias can be minimized by pre-testing the questions, randomizing / rotating the question order, inserting neutral / buffer questions, etc.
It's true that a survey can be cynically manipulated to produce the "intended" results. But it's also true that a serious pollster with a reputation to defend can't constantly release biased polls, especially when the poll's bias can be tested against real data (e.g., an election outcome).
So when an interest group releases a one-off poll about something unverifiable, it makes sense to be very skeptical. But when 538 does a careful meta-poll about some real world event (e.g., who is going to be the Governor of California), it makes sense to assume it has some predictive power.
These issues with polling are well understood and sophisticated pollsters have fairly reliable methods to reduce these errors. For example, the question-order bias can be minimized by pre-testing the questions, randomizing / rotating the question order, inserting neutral / buffer questions, etc.
It's true that a survey can be cynically manipulated to produce the "intended" results. But it's also true that a serious pollster with a reputation to defend can't constantly release biased polls, especially when the poll's bias can be tested against real data (e.g., an election outcome).
So when an interest group releases a one-off poll about something unverifiable, it makes sense to be very skeptical. But when 538 does a careful meta-poll about some real world event (e.g., who is going to be the Governor of California), it makes sense to assume it has some predictive power.
-
- Posts: 206
- Joined: Mon Sep 12, 2022 10:20 pm
- Contact:
Re: Yes, Prime Minister
A Machiavellian nitpick: Polls are usually made every few weeks in the run-up to the election, so only the last polls need to be accurate. You can always explain the apparent shift by campaigning.Esquire Bertissimmo wrote: ↑Mon Mar 04, 2024 8:13 pmBut it's also true that a serious pollster with a reputation to defend can't constantly release biased polls, especially when the poll's bias can be tested against real data (e.g., an election outcome).
¶ Keep thy heart with all diligence; for out of it are the issues of life.
-- Proverbs of Solomon, chapter 4, verse 23
-- Proverbs of Solomon, chapter 4, verse 23
- Esquire Bertissimmo
- Posts: 567
- Joined: Fri May 05, 2023 11:44 pm
- Contact:
Re: Yes, Prime Minister
I'm still reading into this a desire to say polls are mostly phoney, which isn't necessarily the case.learnedSloth wrote: ↑Tue Mar 05, 2024 11:37 amA Machiavellian nitpick: Polls are usually made every few weeks in the run-up to the election, so only the last polls need to be accurate. You can always explain the apparent shift by campaigning.Esquire Bertissimmo wrote: ↑Mon Mar 04, 2024 8:13 pmBut it's also true that a serious pollster with a reputation to defend can't constantly release biased polls, especially when the poll's bias can be tested against real data (e.g., an election outcome).
A well done poll does actually reflect public opinion at the time it's conducted. It doesn't exist in a vacuum — it can be tested against other polls, other sources of opinion research (e.g., betting markets, focus groups, etc.), and strange results get huge public scrutiny, so there are strong incventives to not fabricate nor bias one's results. Polls should change in response to events, but in the absence of big events, professional pollsters prize poll stability as a sign of good methodology. There are good reasons to think that the polls that best predict the final outcome (e..g., big well-conducted meta-polls) were accurately tracking opinion along the way.
-
- Posts: 206
- Joined: Mon Sep 12, 2022 10:20 pm
- Contact:
Re: Yes, Prime Minister
Betting shops have obvious monetary incentives to get their odds right. I think that even Machiavelli would have hard time sketching ways to skew them. It would definitely require deep pockets because of said incentives.
¶ Keep thy heart with all diligence; for out of it are the issues of life.
-- Proverbs of Solomon, chapter 4, verse 23
-- Proverbs of Solomon, chapter 4, verse 23
Re: Yes, Prime Minister
I was misreading the result as a 3% shift, 45 -> 48 %, barely outside the realm of error bara.Octavious wrote: ↑Fri Mar 01, 2024 4:54 pmSmall difference? It went from a clear majority (45 to 38) in favour of national service to an even clearer majority (48 to 34) against. A 21 point swing is pretty significant in any context, and if error bars are big enough to hide it then it's pointless doing any polling at all. Elections are typically decided by somewhat smaller margins.
-
- Posts: 1506
- Joined: Sun Dec 31, 2017 4:05 am
- Location: Now Performing Comedic Artist Dusty Balzac Bush Philosopher from Flyblown Gully by the Sea
- Contact:
Who is online
Users browsing this forum: No registered users