SHRM26 Debrief · AI, Data & Tech · #2680

Beyond the Gut Feel: How AI-Powered Structured Interviews Are Transforming Hiring Outcomes

with Craig della Penna

▶ Watch on the SHRM portal ~85 min, distilled

structured interviewingAI in hiringjob scorecards / CIPHER framework

"It's not about AI. It's about using AI with human intelligence, and that's what's going to drive the ROI in our talent acquisition plans."

What it was about

Most hiring fails because interviews are unstructured and gut-feel driven. AI can dramatically improve outcomes when used to enable structured interviewing (defining the role, collecting consistent data, and supporting decisions) rather than to replace human judgment or conduct interviews itself.

By the numbers

49%

of 16,000 hires studied were gone within 18 months (2016 Leadership IQ study)

15x

total hidden + hard-dollar cost multiplier of a bad hire relative to salary

attrition dropped from mid-20s% to ~11%

first-year attrition after the SaaS company's structured interviewing rollout

Key notes

Replace vague, aspirational job descriptions with a 'CIPHER' (Charge, Outcome, Deliverables, Efforts) that gets specific about 5-7 prioritized deliverables and the honest cultural/team-management realities of the role.
Use AI to synthesize a first-draft CIPHER from the job description plus a hiring-manager interview transcript, then iteratively refine it and ask AI to suggest deliverables you may have missed by benchmarking similar roles at other companies.
Standardize interview questions so every candidate is asked the same questions the same way, and base those questions on the CIPHER, not on the candidate's resume, to preserve structure and reduce bias.

The contrarian takeThe speaker pushes back on the popular 'culture add' framing, arguing that new hires must first be able to fit and succeed within the culture a company actually has today, not the aspirational culture it wants: "I can't hire someone for the culture I want to have... I need to hire them for the culture I do have." He also disputes widely-cited market stats claiming 70-80% of companies lack the right talent, saying he doesn't believe that figure reflects reality and that the real fix is training existing teams rather than assuming talent is fundamentally missing.

Take this back Monday

Do this for your team

Rewrite one open job's description into a CIPHER: 5-7 prioritized deliverables plus your team's honest cultural realities.

Say this in your next leadership meeting

82% of new hires don't succeed because we interview on gut feel instead of structured, CIPHER-based questions everyone gets asked the same way.

Watch out for

Letting a chatbot or AI agent conduct candidate interviews instead of a human, which sends the message that talent doesn't matter enough to warrant a human conversation.
Writing interview questions based on a candidate's resume rather than the role's CIPHER, which destroys the standardization that makes structured interviewing valid.
Trusting AI outputs as decisions rather than data: treating an AI-generated strength or score as truth instead of pressure-testing it for confirming and disconfirming evidence.

Fun fact · Craig della Penna

He has assessed over 175 organizations, run 400+ executive assessments, and coached 50+ C-Suite execs, and still finds time for his ferocious standard poodle, Sherlock.

If this landed, see these

↳ Go deeperRight Hire, Right Growth: A Practitioner's Unfiltered Look at AI Across Hiring and RetentionExtends the gut-feel-is-broken argument into what happens after the structured hire: skills-based development.⇄ The counterpointBuilding an AI-Enabled Recruiting TeamFocuses on turning on existing AI screening tools already in the ATS rather than building a new CIPHER process.✦ The unexpected oneThe Benefit That Quietly Shapes How Work Gets DoneBoth sessions argue a commoditized, overlooked thing (vision benefits, gut-feel interviews) is quietly costing more than anyone tracks.