Capitol Fax.com - Your Illinois News Radar » Please, stop doing this nonsense
SUBSCRIBE to Capitol Fax      Advertise Here      About     Exclusive Subscriber Content     Updated Posts    Contact Rich Miller
CapitolFax.com
To subscribe to Capitol Fax, click here.
Please, stop doing this nonsense

Friday, Jan 6, 2023 - Posted by Rich Miller

* Crain’s

This report has been corrected to indicate the Polco research is a survey, not a poll.

* Block Club Chicago

Editor’s note: This story has been updated to reflect the results were from a survey rather than a poll.

Right off the bat you know we got heaps of trouble.

* Daily Line

The Chicago Index, a collaboration between The Daily Line and Crain’s Chicago Business, conducted its second administration of the 2023 Race for Mayor survey from November 29 through December 14, 2022. A total of 1,757 Chicago residents were surveyed from a variety of sources, including subscribers to The Chicago Index’s panel, members of The Daily Line Chicago, subscribers to Crain’s Chicago Business, and via digital engagement on social media platforms

Results were weighted on age, region, housing tenure, race, ethnicity, and gender, so the sample was consistent with the demographics of Chicago. The margin of error was +/- 3%.

I mean, that’s basically just one step above the little online “polls” I run here. The difference is, I don’t claim that my little polls are scientific and they rightfully don’t generate news headlines or create talk show fodder. They’re for fun, not info. If a reporter tried to do a story on one of those silly polls, I’d laugh in their face.

If you want to see the results, by all means click those links, but they’re worthless and the media outlets need to stop publishing this silly nonsense.

* The pushback has been justifiably fierce

[Chicago mayoral candidate Willie Wilson] is criticizing the survey and Crain’s decision to publish it, and says that as a result he will not participate in Crain’s mayoral forum scheduled for Feb. 1.

“Crain’s published a poll that seeks to mislead the voters of Chicago,” Wilson said. “The poll Crain’s published has me at 3%. This is an insult to my supporters and Crain’s has zero journalistic integrity. I will not be a pawn in their charade; thus, I will not participate in their upcoming mayoral candidate forum.”

He added, “The news media has an obligation to demonstrate integrity and thoughtfulness when deciding which polls to publish. If they know it is misleading or inaccurate it should not be published.”

Lightfoot spokeswoman Christina Freundlich also is ripping the survey: “This is about as scientific and reliable as an Elon Musk poll,” she said. “No amount of weighting can save a survey of Chicagoans where 74% of the respondents are white. Any media organization that gives this poll any air time needs to examine their standard for poll credibility.”

One quibble: The survey sample was 53 percent white. But that’s still way, way out of line with reality.

* What Bowen said…


* But don’t take our word for it. Jason McGrath with GBAO Strategies and Brian Stryker at ALG Research both took strong exception to this goofy survey way back in April of 2021

Good public opinion research should be as representative as possible. A representative sample attempts to provide every potential respondent with the same chance of entering the sample. A representative poll of Chicago-area residents must give people in every community the same opportunity to take the survey. 

But the data collection method in the Crain’s/TDL/ABC survey fails to meet that standard. The survey’s sponsors reached out to their personal networks—especially political operatives and insiders—and those reading their stories directly. That gave some well-connected people (like us) a higher likelihood of entering the sample than millions of others. This meant their disproportionately white and male network of political insiders and business executives were more likely to take the poll.

There are certainly deficiencies in modern polling. The areas where pollsters are working to address problems, including achieving full coverage of the electorate, declining response rates, omitted variables and the incorporation of multiple modes of data collection, have been discussed in detail elsewhere. But the Crain’s/TDL/ABC survey fails to correct for any of the problems present in public opinion research today—if anything, it makes them worse and creates new ones.

The massive design flaws in the survey are only part of the problem. The widespread media coverage of the index treated this instrument with the same seriousness as it would one from Pew, Gallup or another academic institution with a long record of measuring public opinion.

And now they’re doing it again.

       

16 Comments
  1. - Candy Dogood - Friday, Jan 6, 23 @ 11:53 am:

    Science is expensive.

    Expertise is expensive.

    Refusing to pay for those expenses can be even more expensive.


  2. - Teve Demotte - Friday, Jan 6, 23 @ 11:55 am:

    I have seen four polls, all showing Lightfoot in trouble. Granted, polling has become less accurate, but maybe instead of attacking people for reporting the Daily Line poll, Lightfoot should make public her internal polling.


  3. - Rich Miller - Friday, Jan 6, 23 @ 11:57 am:

    === but maybe instead of attacking people for reporting the Daily Line poll===

    Stop.

    The poll isn’t a poll. It’s complete garbage data and it’s been irresponsibly flung into the discourse. And if you want to call for that, fine. Get your own blog.


  4. - Oswego Willy - Friday, Jan 6, 23 @ 12:04 pm:

    Still “recogning” it as a poll, that’s peddling in alternative facts predicated on calling a phony measure the same as a measure that has scientific givens and measures.

    It’s been a tiring few years standing and pushing down the phony propping up of “stats”


  5. - Jerry - Friday, Jan 6, 23 @ 12:07 pm:

    Just a reminder: 4 out of 5 dentists surveyed recommend sugarless gum for those patients who chew gum. This is scientific fact and not some marketing slogan for gum (or a poll for that matter!)


  6. - Back to the Future - Friday, Jan 6, 23 @ 12:13 pm:

    Actually participated in this survey.
    Not certain how I got on the list, but clearly this should not be viewed as a poll as “poll” is generally currently defined.
    I subscribe to the Crain’s Business publication so maybe that is how they contacted me.


  7. - Michelle Flaherty - Friday, Jan 6, 23 @ 12:19 pm:

    – If you are a journalism outfit and you are covering this poll, you are engaging in misinformation. –

    Has anyone checked to see if Paddock Publication is printing and distributing this poll/survey?


  8. - Three Dimensional Checkers - Friday, Jan 6, 23 @ 12:33 pm:

    Total selection bias in addition to not representing the actual electorate.

    It might represent Chicago government insiders who read the Daily Line and Crain’s. Unsurprisingly, this population does not seem to like Mayor Lightfoot. /snark.


  9. - Rich Miller - Friday, Jan 6, 23 @ 12:38 pm:

    ===Unsurprisingly, this population does not seem to like Mayor Lightfoot===

    Real polling shows that the rest of the city isn’t all that high on her either. That’s beside the point. The data is garbage.


  10. - TheInvisibleMan - Friday, Jan 6, 23 @ 12:39 pm:

    The definitions of words have been horribly blurred in media, and it does seem to be getting worse.

    Here, the problem is treating a survey as if it was a poll, and then calling it a poll because that’s what the story demanded after it was written based on the output of the survey.

    The other popular blurring is population, and estimated population. The same process takes place where a story is written based on the estimates and then taking that conclusion as the reasoning to declare what actual population numbers are.

    It’s terrible journalism, and I question even calling it journalism. How badly does someone need to do the very basic tenants of their supposed job, before we stop calling them by that title?


  11. - Left of what - Friday, Jan 6, 23 @ 12:47 pm:

    ==variety of sources, including subscribers to The Chicago Index’s panel, members of The Daily Line Chicago, subscribers to Crain’s Chicago Business, and via digital engagement on social media platforms==

    Sounds like someone needs a history lesson about this type of sampling. Maybe the 1936 presidential election is a good place to start.


  12. - H-W - Friday, Jan 6, 23 @ 1:23 pm:

    == The survey’s sponsors reached out to their personal networks—especially political operatives and insiders—and those reading their stories directly. ==

    I suppose you could call if Facebook on steroids sampling. But to infer the respondents thoughts and beliefs represent the thoughts and beliefs of even some segment of the Illinois population is foolishness.

    Survey Methodology 101: Sampling frames matter. Representativeness matters. Margins of error. Generalizability matters. Interpretation of results matter.

    Unless you are selling something.


  13. - Moe Berg - Friday, Jan 6, 23 @ 1:28 pm:

    This is a fine follow up to Rich’s fisking, aided by Rep. Krishnamoorthi’s letter, yesterday of all the sensationalist Census reporting about Illinois population loss.

    In a different vein, also brings to mind the transparently bogus Bailey poll that Fox 32 promoted back in September that showed Bailey 7 points behind Pritzker and the Libertarian getting 8%. Also debunked by Rich.

    “No lessons learned” seems to be the operating principle for a lot of our media outlets. They don’t hold themselves accountable to doing anything besides feeding the beast and getting clicks. Everything goes down the memory hole each day and the world is born anew the next.


  14. - Rich Miller - Friday, Jan 6, 23 @ 1:35 pm:

    ===and the world is born anew the next===

    I am constantly amazed that so many people can’t seem to use the Google machine.


  15. - Anon 1:50 - Friday, Jan 6, 23 @ 1:50 pm:

    Regarding Brandon Johnson’s incredible 25% showing, clearly this “survey” had an over-sample of Oak Park residents, you know, the 51st Ward.


  16. - Pundent - Friday, Jan 6, 23 @ 3:29 pm:

    =people can’t seem to use the Google machine.=

    Laziness abounds. I’m amazed by the number of stories that attach significance to what someone has tweeted. But yet these “opinions” continue to get amplified as if they are reflective of how the majority of us feel.


Sorry, comments for this post are now closed.


* Reader comments closed for the weekend
* Isabel’s afternoon roundup
* Feds to provide more migrant funding... Just $19.3 million for Illinois
* Question of the day
* It’s just a bill
* Bill to expand IVF/infertility insurance coverage overwhelmingly passes Senate
* Open thread
* Isabel’s morning briefing
* SUBSCRIBERS ONLY - Today's edition of Capitol Fax (use all CAPS in password)
* Yesterday's stories

Support CapitolFax.com
Visit our advertisers...

...............

...............

...............

...............

...............


Loading


Main Menu
Home
Illinois
YouTube
Pundit rankings
Obama
Subscriber Content
Durbin
Burris
Blagojevich Trial
Advertising
Updated Posts
Polls

Archives
April 2024
March 2024
February 2024
January 2024
December 2023
November 2023
October 2023
September 2023
August 2023
July 2023
June 2023
May 2023
April 2023
March 2023
February 2023
January 2023
December 2022
November 2022
October 2022
September 2022
August 2022
July 2022
June 2022
May 2022
April 2022
March 2022
February 2022
January 2022
December 2021
November 2021
October 2021
September 2021
August 2021
July 2021
June 2021
May 2021
April 2021
March 2021
February 2021
January 2021
December 2020
November 2020
October 2020
September 2020
August 2020
July 2020
June 2020
May 2020
April 2020
March 2020
February 2020
January 2020
December 2019
November 2019
October 2019
September 2019
August 2019
July 2019
June 2019
May 2019
April 2019
March 2019
February 2019
January 2019
December 2018
November 2018
October 2018
September 2018
August 2018
July 2018
June 2018
May 2018
April 2018
March 2018
February 2018
January 2018
December 2017
November 2017
October 2017
September 2017
August 2017
July 2017
June 2017
May 2017
April 2017
March 2017
February 2017
January 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012
November 2012
October 2012
September 2012
August 2012
July 2012
June 2012
May 2012
April 2012
March 2012
February 2012
January 2012
December 2011
November 2011
October 2011
September 2011
August 2011
July 2011
June 2011
May 2011
April 2011
March 2011
February 2011
January 2011
December 2010
November 2010
October 2010
September 2010
August 2010
July 2010
June 2010
May 2010
April 2010
March 2010
February 2010
January 2010
December 2009
November 2009
October 2009
September 2009
August 2009
July 2009
June 2009
May 2009
April 2009
March 2009
February 2009
January 2009
December 2008
November 2008
October 2008
September 2008
August 2008
July 2008
June 2008
May 2008
April 2008
March 2008
February 2008
January 2008
December 2007
November 2007
October 2007
September 2007
August 2007
July 2007
June 2007
May 2007
April 2007
March 2007
February 2007
January 2007
December 2006
November 2006
October 2006
September 2006
August 2006
July 2006
June 2006
May 2006
April 2006
March 2006
February 2006
January 2006
December 2005
April 2005
March 2005
February 2005
January 2005
December 2004
November 2004
October 2004

Blog*Spot Archives
November 2005
October 2005
September 2005
August 2005
July 2005
June 2005
May 2005

Syndication

RSS Feed 2.0
Comments RSS 2.0




Hosted by MCS SUBSCRIBE to Capitol Fax Advertise Here Mobile Version Contact Rich Miller