Post-publication Comment · Critical AI
Comment on “Beyond disruption and invisibility: Interactional continuity in everyday AI use in India”
Critical AI · published 2026-06-30 · v2.0 · CRIT-GEN-beyond-disruption-and-in
Concerning: Emilia Edwards, Dhiraj Murthy · New Media & Society · 2026-05-26
Why this paper was selected
Selected via the production queue; critique generated by the AGISS engine.
AI/AGI centrality 1/5 · societal relevance 3/5 · source-journal note: Tier B per the determination; ingested from an AGISS critique artifact.
Summary
This is an honest, modest qualitative study (28 interviews in one Bangalore office) about how people fold AI into everyday tasks. The full text fixes most concerns a reviewer might raise from the abstract alone, because the authors repeatedly admit the sample is tiny, from one site, and not generalizable. The real remaining problems are small numbers issues. The most clear-cut: the paper's key statistic — that embedded AI is heavily used but almost never called "AI" — is reported as "9% (n = 2) of respondents," but 2 out of 28 respondents is 7.1%, not 9%; the 9% only works if you divide by 23 (the subset of users), so the stated base ("respondents") doesn't match the number. A related percentage for embedded GenAI use is also computed against 28 while the paper's own table says only 23 people used it. There's also a proposition phrased as a statistical "correlates more strongly than" claim that the descriptive design can't actually test, and a "saturation" claim that sounds stronger than a 2-day, take-whoever-is-available sample warrants. None of this breaks the main argument; they are reporting slips around an otherwise carefully limited study.
Central claims & evidence map
| Claim | Type | Evidence offered | Support | Overclaiming | Main weakness |
|---|---|---|---|---|---|
| The central naming statistic is internally inconsistent: 'explicit naming occurred in 9% (n = 2) of respondents,' but with 28 respondents 2/28 = 7.1%, not 9% | Descriptive | labeled as AI, explicit naming occurred in 9% (n = 2) of respondents. By contrast, when | Weak | Moderate | The central naming statistic is internally inconsistent: 'explicit naming occurred in 9% (n = 2) of respondents,' but with 28 respondents 2/28 = 7.1%, not 9% |
| Embedded-GenAI usage percentages are computed against all 28 respondents (67.9% = 19/28, 60.7% = 17/28, 39.3% = 11/28), yet Table 1 reports 'Embedded GenAI Users (n = 23).' If only 23 respondents used | Descriptive | 67.9% (n = 19), content creation at 60.7% (n = 17), and text assistance at 39.3% (n = 11), | Weak | Moderate | Embedded-GenAI usage percentages are computed against all 28 respondents (67.9% = 19/28, 60.7% = 17/28, 39.3% = 11/28), yet Table 1 reports 'Embedded GenAI Users (n = 23).' If only 23 respondents used |
| Proposition 1 is phrased as a comparative correlational claim ('will correlate more strongly than'), implying an inferential test of association, but the design — 28 single-site self-reports, single-c | Predictive | Proposition 1: Naming AI will correlate more strongly with chat-style interface pack- | Moderate | Minor | Proposition 1 is phrased as a comparative correlational claim ('will correlate more strongly than'), implying an inferential test of association, but the design — 28 single-site self-reports, single-c |
| The paper invokes thematic 'saturation' ('additional sessions yielded no new themes') to justify stopping at 28, but interviews were a single workplace over 2 days with recruitment that 'reflected ava | Methodological | Austin). We concluded the interviews once they reached saturation | Moderate | Minor | The paper invokes thematic 'saturation' ('additional sessions yielded no new themes') to justify stopping at 28, but interviews were a single workplace over 2 days with recruitment that 'reflected ava |
Per-claim assessment
C1. The central naming statistic is internally inconsistent: 'explicit naming occurred in 9% (n = 2) of respondents,' but with 28 respondents 2/28 = 7.1%, not 9%
The central naming statistic is internally inconsistent: 'explicit naming occurred in 9% (n = 2) of respondents,' but with 28 respondents 2/28 = 7.1%, not 9%. The figure 9% is only reproducible against a base of 23 (embedded-AI users in Table 1), so the denominator silently shifts from 'respondents' (28) to 'users' (23) inside the paper's flagship evidence for naming–use decoupling. The percentage and its stated population are mutually contradictory.
C2. Embedded-GenAI usage percentages are computed against all 28 respondents (67.9% = 19/28, 60.7% = 17/28, 39.3% = 11/28), yet Table 1 reports 'Embedded GenAI Users (n = 23).' If only 23 respondents used
Embedded-GenAI usage percentages are computed against all 28 respondents (67.9% = 19/28, 60.7% = 17/28, 39.3% = 11/28), yet Table 1 reports 'Embedded GenAI Users (n = 23).' If only 23 respondents used embedded GenAI, the purpose percentages should be based on 23 (e.g., 19/23 = 82.6%), not 28. The prose denominator and the table's own user count are inconsistent, making the reported uptake rates ambiguous.
C3. Proposition 1 is phrased as a comparative correlational claim ('will correlate more strongly than'), implying an inferential test of association, but the design — 28 single-site self-reports, single-c
Proposition 1 is phrased as a comparative correlational claim ('will correlate more strongly than'), implying an inferential test of association, but the design — 28 single-site self-reports, single-coder coding, no inter-coder reliability, no correlation statistic computed — cannot support a 'more strongly than' inference. The proposition's quantitative form outruns what a small descriptive qualitative corpus can establish.
C4. The paper invokes thematic 'saturation' ('additional sessions yielded no new themes') to justify stopping at 28, but interviews were a single workplace over 2 days with recruitment that 'reflected ava
The paper invokes thematic 'saturation' ('additional sessions yielded no new themes') to justify stopping at 28, but interviews were a single workplace over 2 days with recruitment that 'reflected availability.' Saturation language implies theoretical sufficiency, which a short, convenience/availability-based single-site sample cannot credibly establish; the claim overstates the evidentiary basis for the stopping rule.
Scorecard
Sub-scores are 0–5 editorial judgements on fixed scales (higher is better, except methodological risk and overclaiming where higher is worse). They are contestable and open to a severity challenge from authors.
Strongest critique — statistical inference / internal consistency
The central naming statistic is internally inconsistent: 'explicit naming occurred in 9% (n = 2) of respondents,' but with 28 respondents 2/28 = 7.1%, not 9%. The figure 9% is only reproducible against a base of 23 (embedded-AI users in Table 1), so the denominator silently shifts from 'respondents' (28) to 'users' (23) inside the paper's flagship evidence for naming–use decoupling. The percentage and its stated population are mutually contradictory.
measurement / internal consistency
Embedded-GenAI usage percentages are computed against all 28 respondents (67.9% = 19/28, 60.7% = 17/28, 39.3% = 11/28), yet Table 1 reports 'Embedded GenAI Users (n = 23).' If only 23 respondents used embedded GenAI, the purpose percentages should be based on 23 (e.g., 19/23 = 82.6%), not 28. The prose denominator and the table's own user count are inconsistent, making the reported uptake rates ambiguous.
statistical inference
Proposition 1 is phrased as a comparative correlational claim ('will correlate more strongly than'), implying an inferential test of association, but the design — 28 single-site self-reports, single-coder coding, no inter-coder reliability, no correlation statistic computed — cannot support a 'more strongly than' inference. The proposition's quantitative form outruns what a small descriptive qualitative corpus can establish.
sample / data
The paper invokes thematic 'saturation' ('additional sessions yielded no new themes') to justify stopping at 28, but interviews were a single workplace over 2 days with recruitment that 'reflected availability.' Saturation language implies theoretical sufficiency, which a short, convenience/availability-based single-site sample cannot credibly establish; the claim overstates the evidentiary basis for the stopping rule.
What the paper does well
The paper is unusually candid about its own limits and does not pretend to statistical generalizability. It explicitly frames results as 'tendencies and not robust subgroup claims,' states findings 'are not generalizable,' discloses single-coder coding with no inter-coder statistics and no precision/recall metrics (with reasons), and presents its propositions as analytic guides rather than statistical hypotheses. Most reported percentages are arithmetically correct against a 28-respondent base, and the central contribution is a conceptual mechanism illustrated through rich episode-level interview accounts, appropriately scoped to what 28 interviews can support.
Strongest critique
The headline recognition statistic is internally inconsistent on its face: the paper states "explicit naming occurred in 9% (n = 2) of respondents," but there are 28 respondents (17 men + 11 women), and 2/28 = 7.1%, not 9%. The figure "9%" is only reproducible against a base of 23 (the embedded-AI *users* in Table 1: 2/23 = 8.7% ≈ 9%). So the sentence's denominator silently switches from "respondents" (28) to "users" (23) inside the load-bearing claim that embedded AI is "heavily used, yet... almost never labeled as AI." Either the percentage is wrong (should be 7.1%) or the base label "of respondents" is wrong (should be "of embedded users") — the number and its stated population cannot both be correct. Because this is the central quantitative evidence for the naming–use decoupling thesis, the error is not cosmetic: it inflates and mis-frames the very statistic the conclusion rests on.
Strongest fair defence
The paper is unusually candid about its own limits and does not pretend to statistical generalizability. It explicitly frames results as 'tendencies and not robust subgroup claims,' states findings 'are not generalizable,' discloses single-coder coding with no inter-coder statistics and no precision/recall metrics (with reasons), and presents its propositions as analytic guides rather than statistical hypotheses. Most reported percentages are arithmetically correct against a 28-respondent base, and the central contribution is a conceptual mechanism illustrated through rich episode-level interview accounts, appropriately scoped to what 28 interviews can support.
Conclusion
A methodologically careful, well-hedged qualitative study whose conclusions ("interactional continuity") are supported by its design as descriptive, tendency-level claims. The full text resolves most abstract-era worries: it openly states the sample is small, single-site, non-generalizable, reported as "tendencies and not robust subgroup claims," with no inter-coder reliability and no precision/recall claimed. The genuine residual over-reaches are narrow and quantitative: a span-exact denominator error (a "9% (n = 2)" figure that is internally inconsistent with the stated base of 28 "respondents"), a parallel embedded-GenAI percentage base that conflicts with the study's own Table 1 user count, an inferential "correlate more strongly than" proposition the descriptive design cannot test, and a "saturation" claim that overstates what a 2-day availability-based convenience sample establishes. None of these undermine the central qualitative argument; they are localized reporting/measurement over-reaches. Overall severity is moderate-to-low.
Reply from the authors
Following the practice of Nature Matters Arising, Science Technical Comments and PNAS Letters, this Comment is published as one half of a Comment + Reply pair: the authors of the original article are invited to respond, and any reply is published here verbatim alongside the Comment as part of the record.
Reply: not yet invited. No reply has been received for publication.
The authors have a right of reply and no veto. A reply may request a factual correction, a methodological rebuttal, a clarification, a data/code update, or a severity challenge, and is published unedited. See the right-of-reply policy.
References
Every external source this Comment cites, each with a verified link. 0 fabricated.
Source-grounding attestation
- ✓Verbatim source spans present in the critique — 4/4 provenance spans re-derived in the critique prose
- ✓Passes the publication validator — no errors
- ✓Zero fabricated citations — 0 fabricated
- ✓Severity within the access-basis cap — severity "moderate" ≤ cap "high" for user_supplied
Every verbatim span the critique relies on is re-derived in the prose in-app; span-in-source is re-verifiable offline (the abstract is re-fetched, not stored, per the no-reproduce policy).
Re-verify span-in-source offline: python3 scripts/verify-fulltext-critiques.py
Independent faithfulness review
A refute-by-default adversarial panel (two independent reviewers — an overreach lens and a mischaracterization lens — that fetched the real source) tried to prove this critique misread the paper. This is an AI adversarial review recorded with its reasoning, not a deterministic check.
All six claims quote the abstract verbatim and restate its assertions accurately. Every evaluative or skeptical move is explicitly hedged ("on the critic's reading") or framed as a genre-appropriate reservation, so none crosses into asserting something beyond the abstract or treating an inference as the paper's own statement. Specifically: c1 flags the disruption/invisibility binary as possibly authorial scaffolding but credits the "often organized around" hedge; c2 and c3 fairly contrast the verbs "explains"/"stabilizes" (both verbatim in the abstract) with an illustrative single-site base, without claiming the paper proved more than it does; c4 is careful to note the abstract's verb "examine... in" is "more modest than a claim to represent" rather than accusing the authors of claiming Global South representativeness — the transferability concern is the critic's own judgment, properly owned; c5 frames the AI-coding reflexivity point as "a transparency gap rather than a demonstrated flaw"; c6 correctly credits the "illustrating... can emerge" hedging. The strongest-critique and final-judgment sections rest on verb pairs actually present in the abstract and cap severity at moderate given abstract-only access. No substantiated overreach or mischaracterization found.
Version & correction history
| Version | Date | Change |
|---|---|---|
| v1.0 | 2026-06-21 | |
| v2.0 | 2026-06-30 | Upgraded from abstract-only to FULL-TEXT grounding (the operator-provided licensed New Media & Society PDF; accessBasis user_supplied). Re-critiqued against the verbatim full text and re-cleared the hardened convergence gate; abstract-era flaws the full text resolves were withdrawn. |
No silent substantive corrections — every change is versioned and visible.
How to cite this Comment
Critical AI. Comment on “Beyond disruption and invisibility: Interactional continuity in everyday AI use in India” (Emilia Edwards et al., New Media & Society, 2026). Critical AI; 2026. https://policywindow.org/critique/c/beyond-disruption-and-invisibility-interactional-c
A registered DOI will replace the URL once minted; until then the canonical URL is the persistent identifier. Highwire/Dublin-Core citation tags and a schema.org Review record are embedded in this page for Google Scholar and reference managers.
Verify this Comment. Its checkable facts (target DOI, access-basis severity cap, zero fabricated citations) are served — as the app’s self-report — at /critique/api/critiques/beyond-disruption-and-invisibility-interactional-c/verify; to confirm them independently of this site, re-derive the same checks (and resolve the target DOI) with npx tsx scripts/verify-critical-ai.ts --critique beyond-disruption-and-invisibility-interactional-c --live.
Content fingerprint fbb2caf10318bf1e (v2.0) — this Comment’s substantive content is content-addressed; a silent post-publication edit would change it.