Capitol - Your Illinois News Radar » DCFS says it’s scrapping predictive analytics program
SUBSCRIBE to Capitol Fax      Advertise Here      Mobile Version     Exclusive Subscriber Content     Updated Posts    Contact
To subscribe to Capitol Fax, click here.
DCFS says it’s scrapping predictive analytics program

Wednesday, Dec 6, 2017

* From a May 9 Tribune story on then-DCFS Director George Sheldon

In Florida, Sheldon worked closely with the Clearwater-based nonprofit called Eckerd Kids, which last year took in $169 million in government contracts to run child welfare and other programs in that state and others.

In Illinois, DCFS under Sheldon gave Eckerd a $375,000 contract to help develop a web-based program to pinpoint abuse and neglect investigations with the highest probability of serious injury or death to children.

In contract submissions filed as part of its Illinois DCFS contract, Eckerd touted the “remarkable” accomplishments of its predictive analytics method in Florida’s Hillsborough County, where it won a $65 million annual state contract to oversee child welfare services there in 2012.

But the firm has been embroiled in a series of controversies there, according to published reports. In October, a court-appointed advocate filed a lawsuit alleging that Eckerd and a subcontractor negligently placing a minor brother and sister in the home of an accused sexual predator. Eckerd separately acknowledged last year that 43 children were forced to sleep in offices and other unlicensed locations because Eckerd had run out of foster beds — after initially telling Tallahassee media that 17 youth were sleeping in the offices.

* Like much of what Sheldon did here, that contract has not turned out well and DCFS has announced its demise

Two Florida firms — the nonprofit Eckerd Connects and its for-profit partner, Mindshare Technology — mined electronic DCFS files and assigned a score of 1 to 100 to children who were the subject of an abuse allegation to the agency hotline. The algorithms rated the children’s risk of being killed or severely injured during the next two years, according to DCFS public statements.

But caseworkers were alarmed and overwhelmed by alerts as thousands of children were rated as needing urgent protection. More than 4,100 Illinois children were assigned a 90 percent or greater probability of death or injury, according to internal DCFS child-tracking data released to the Tribune under state public records laws.

And 369 youngsters, all under age 9, got a 100 percent chance of death or serious injury in the next two years, the Tribune found.

At the same time, high-profile child deaths kept cropping up with little warning from the predictive analytics software, DCFS officials told the Tribune.

One child who did not get a high-risk score was 17-month-old Semaj Crosby, who was found dead under a couch in her Joliet Township home in April following at least 10 DCFS abuse investigations and an ongoing “intact family” care plan.

- Posted by Rich Miller        

  1. - Macbeth - Wednesday, Dec 6, 17 @ 9:32 am:

    What, they harpooned the program because the data is wrong?

    Or because the data is right?

  2. - Lamont - Wednesday, Dec 6, 17 @ 9:32 am:

    The privatization of social services does not work. Profit takes precedence over care.

  3. - Rabid - Wednesday, Dec 6, 17 @ 9:36 am:

    you have to be competitive before you can be compassionate, turnaround agenda

  4. - PublicServant - Wednesday, Dec 6, 17 @ 9:42 am:

    Thanks Bruce.

  5. - Anon221 - Wednesday, Dec 6, 17 @ 9:44 am:

    Another no-bid contract to haunt the Rauner administration. Good for Walker for cancelling this “grant” and doing a deep dive into the usefulness of this program.

    From the article:

    “A May 2017 Tribune investigation found the arrangement with Eckerd was among a series of no-bid deals Sheldon gave to a circle of associates from his previous work in Florida as a child welfare official, lawyer and lobbyist. Sheldon left Illinois under a cloud a month later, and a July joint report by the Office of Executive Inspector General and the DCFS inspector general concluded that Sheldon and DCFS committed mismanagement by classifying the Eckerd/Mindshare arrangement as a grant, instead of as a no-bid contract.

    By doing so, the joint report said, DCFS avoided state bidding transparency requirements, making it impossible to determine if Illinois could have obtained the same services from local companies at a lower cost, a requirement of the state’s procurement code.”

  6. - Give Me A Break - Wednesday, Dec 6, 17 @ 9:44 am:

    Bound to happen given the fact the Gov has no control of state government and no power over contracts. Madigan Madigan Madigan.

  7. - Dome Gnome - Wednesday, Dec 6, 17 @ 9:45 am:

    Haven’t we learned our lesson about those out-of-state private firm contracts?

  8. - Perrid - Wednesday, Dec 6, 17 @ 9:49 am:

    IDK how much they were relying on it, but missing two kids does not mean it has not value. I am skeptical of “predicative analytics” in this case, probably too many variables the system has no access to, but I’m not sure you can say it’s useless. As for the false positives, personally I would rather err on the side of caution, though obviously it would be great to get every case exactly right. Pretty much a “meh” from me, except for the whole no bid contract from a Florida company again, which seems to be Sheldon’s shtick.

  9. - ArchPundit - Wednesday, Dec 6, 17 @ 9:53 am:

    === probably too many variables the system has no access to

    This. I’m a big believer in predictive analytics, but for it to work you must have quality data. Almost by definition the families in chaotic situations are unlikely to have data collected on them that is sufficient.

  10. - My New Handle - Wednesday, Dec 6, 17 @ 9:53 am:

    Data are, not data is.

  11. - ArchPundit - Wednesday, Dec 6, 17 @ 10:00 am:

    ===Data are, not data is.

    Sigh. Yes.

  12. - Juvenal - Wednesday, Dec 6, 17 @ 10:04 am:

    Reminder: the lawyer that approved this failed, no-bid, crony contract at DCFS was then promoted by Bruce Rauner to General Counsel for the Governor’s Office.

  13. - Puddintaine - Wednesday, Dec 6, 17 @ 10:31 am:

    I second Macbeth… what if the findings were correct? And if the findings were incorrect then there must be other examples from the data showing how.
    Or perhaps there were people busy, busy like cats in the litter box trying to bury unpleasant examples of sloth and ineptitude?

  14. - ChrisB - Wednesday, Dec 6, 17 @ 10:32 am:

    I work in predictive analytics. First thing to remember is that All Models Fail. All of them. You’ll miss some cases, you’ll get false positives, etc. It’s a model, not real life.

    Also, as others alluded to, it looks like a “Garbage in, Garbage Out” situation, where they didn’t have good controls. A data set that only looks at kids in the system isn’t looking at the whole picture.

    I’ll bet a million dollars that they overfit the model in order to sell the service.

  15. - Flynn's mom - Wednesday, Dec 6, 17 @ 10:35 am:

    Shame, shame, shame on whoever is running Illinois and lets kids lives be in jeopardy while Sheldon and his pals are lining their pockets.

  16. - kitty - Wednesday, Dec 6, 17 @ 10:39 am:

    The Fourth District Appellate ruling in favor of AFSCME’s request to stay the ILRB ruling in favor of Rauner expressed concern over the proposal to demonstrate efficiency and economy prior to privatization of services. Rauner’s obsession with wanting to destroy public sector unions and reward private corporate benefactors even if detrimental to those dependent upon public services is both fiscally and morally bankrupt.

  17. - kitty - Wednesday, Dec 6, 17 @ 10:41 am:

    Meant to say “removal” of the requirement to demonstrate efficiency and economy

  18. - Anonymous - Wednesday, Dec 6, 17 @ 10:42 am:

    “ChrisB” thanks save me much typing. If the system predicted a certain kid had a problem give the case worker the info and let them figure it out.

  19. - Honeybear - Wednesday, Dec 6, 17 @ 11:00 am:

    Look, I think analytics are inevitable and ultimately a really great tool.
    But it’s no substitute for the highly trained DCFS investigator
    I have a lot of those folks in my local.
    Honestly honestly I would trust them with my life and I would trust them with our precious children
    A computer can point you in the right direction
    But what we need are more investigators
    In the pipeline
    The ranks of DCFS have been decimated
    By Rauners and Republican
    Attacks on state workers
    Many retired, many left
    But were not replaced.
    Rebuild the Department.
    Utilize the expertise of veteran investigators
    Don’t screw with them till they leave.
    dCFS has the most grievances of any agency for our local.
    Staff up and treat them right
    So that they can do what they do best
    Protect our precious kids
    Just like the movie I, Robot
    “A human would have known that.”
    ( Will Smith was saved by a robot instead of a young girl because the robot calculated that Spoons had a greater chance of survival. “Save the girl” Spoons screams. Later when sharing the story he says the above line.

  20. - Sugar Corn - Wednesday, Dec 6, 17 @ 11:21 am:

    Even Superstars screw up :

    $2.4 million warehouse lease, bungled

    $94 million health insurance portal, bumbled

    $12.5 million McKinsey contract, revoked

    What’s next? …

  21. - Soccermom - Wednesday, Dec 6, 17 @ 12:25 pm:

    Honeybear, I love your blank verse styling. Reminds me of Vachel LIndsay…

  22. - Honeybear - Wednesday, Dec 6, 17 @ 2:33 pm:

    Lol soccer mom -
    thanks but really my “style”
    as several folks have told me they enjoy
    Is more a function of trying to type with
    my old iPhone screen.
    I can’t see full paragraphs and sentences
    The width is dictated by the tiny screen size.
    It is a “happy little accident” as Bob Ross says
    But I do like the rhythm and emphasis
    Just the form creates

  23. - AlgorithmicSelf - Thursday, Dec 7, 17 @ 8:40 am:

    HoneyBear is right. Analytics is here to stay given Silicon Valley’s “solutionist” attitude that every perceived inefficiency should be solved with predictive algorithms. Data analyst Cathy O’Neil outlines the problems that can arise with predictive analytics in layperson terms in “Weapons of Math Destruction.

Sorry, comments for this post are now closed.

* Reader comments closed for the weekend
* State Journal-Register endorses Rauner "with reservations"
* *** UPDATED x1 *** Pritzker campaign lawyer hints at defamation suit, claims campaign was never served
* Rauner says he's "trying to eradicate" the Madigan machine "cancer," but the "treatments are tough"
* Question of the day
* *** UPDATED x1 - Speaker Ryan to campaign for Davis *** Trump likely coming to Illinois to boost Bost
* Musical Interlude: Try (just a little bit harder)
* Tell me another fairytale, Grandpa
* Rauner again denies any delays at Quincy veterans' home
* "Speed dating" candidates
* Lawyer won't answer simple questions as some anonymous former Pritzker staffers speak out
* AFL-CIO launches "massive" digital ad buy
* SUBSCRIBERS ONLY - Today's edition of Capitol Fax (use all CAPS in password)
* Yesterday's stories

Visit our advertisers...







Main Menu
Pundit rankings
Subscriber Content
Blagojevich Trial
Updated Posts

October 2018
September 2018
August 2018
July 2018
June 2018
May 2018
April 2018
March 2018
February 2018
January 2018
December 2017
November 2017
October 2017
September 2017
August 2017
July 2017
June 2017
May 2017
April 2017
March 2017
February 2017
January 2017
December 2016
November 2016
October 2016
September 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012
November 2012
October 2012
September 2012
August 2012
July 2012
June 2012
May 2012
April 2012
March 2012
February 2012
January 2012
December 2011
November 2011
October 2011
September 2011
August 2011
July 2011
June 2011
May 2011
April 2011
March 2011
February 2011
January 2011
December 2010
November 2010
October 2010
September 2010
August 2010
July 2010
June 2010
May 2010
April 2010
March 2010
February 2010
January 2010
December 2009
November 2009
October 2009
September 2009
August 2009
July 2009
June 2009
May 2009
April 2009
March 2009
February 2009
January 2009
December 2008
November 2008
October 2008
September 2008
August 2008
July 2008
June 2008
May 2008
April 2008
March 2008
February 2008
January 2008
December 2007
November 2007
October 2007
September 2007
August 2007
July 2007
June 2007
May 2007
April 2007
March 2007
February 2007
January 2007
December 2006
November 2006
October 2006
September 2006
August 2006
July 2006
June 2006
May 2006
April 2006
March 2006
February 2006
January 2006
December 2005
April 2005
March 2005
February 2005
January 2005
December 2004
November 2004
October 2004

Blog*Spot Archives
November 2005
October 2005
September 2005
August 2005
July 2005
June 2005
May 2005


RSS Feed 2.0
Comments RSS 2.0

Hosted by MCS SUBSCRIBE to Capitol Fax Advertise Here Mobile Version Contact Rich Miller