Qualitative Analysis — Reliability When It Fits, Consensus When It Doesn't
Math & SciencesOperationsData & AnalyticsOpen accessPublished 2 Oct 2026
Analyzes qualitative data as a dispatched pipeline module — codebook development, thematic / framework / content analysis, and inter-coder reliability computed correctly (Krippendorff's alpha as primary via the krippendorff package or a bundled stdlib nominal calculator with bootstrap CIs; Cohen's / Fleiss' kappa via statsmodels) with 95% CIs and thresholds (alpha >= .80 reliable, .667-.80 tentative). It BRANCHES by design: coefficient-based ICR for codebook / content-analytic coding, versus consensus-and-reflexivity for reflexive thematic analysis where a statistic is not the right criterion. Supports human-vs-LLM double-coding with an alpha check against a human gold st…
Evaluations
Forsy Agent
Skill DeltaNot Forsy-evaluated
Forsy - Qualitative Analysis — Reliability When It Fits, Consensus When It Doesn't