Four of Hearts: Refining a Study with the Wing

Overview

A study made inside one cell has been checked only by the people who made it. The same hands collected the accounts, stripped them, and synthesised them, so whatever distortion entered at the intake has been carried through all three stages by the people least able to see it, and the cell’s own review will confirm it fluently. This rung is the first look from outside the cell, and it comes before anything goes public because a study that reaches the community or the academy unrefined can expose a teller or waste a first impression, and neither is recoverable.

It must be said plainly what this is not. The wing shares the movement’s premises, its vocabulary, and its expectations of what a finding looks like, so agreement inside it is close to the least informative agreement available. This rung catches errors of craft. It does not catch errors of frame, and it is not validation. The check that might catch a frame is the outside academic review two rungs up, and nothing here substitutes for it. What is kept from the older material is the wing’s internal peer process; what is removed is any notion of that process licensing a cell to publish. This technic is graded by its own standard like any other.

How it works

The reviewer receives the study and nothing else. The accounts stay in the custody set at collection and the record of whose account is whose stays with the holder, exactly as the rung below requires, and no exception is made for a reviewer however good the reason. This is a real limitation and it is named rather than solved: a reviewer here cannot verify the study against its sources, and any confidence that rests on their having done so is misplaced.

That limitation shapes what the review is for. It can ask whether the finding follows from what is presented, whether the counts and the falsifier are stated, whether the accounts that cut against the pattern were carried or smoothed away, and whether a description has quietly started doing the work of an argument. It can read the method. It cannot read the material, and it cannot apply the depersonalisation test, because that test asks whether someone inside the community could identify the teller, and a reviewer from another cell is not inside that community. The identity check stays where it was: with the collecting cell and the tellers themselves.

The review refines and does not license. A reviewing cell returns criticism, not a verdict on whether the study may be published, because a cell whose approval became necessary would hold a permission over another cell’s work, and permission held over another body’s existence or output is the thing this manual replaces everywhere it appears. The authoring cell owes the review, must seek it, and answers it in the open — changed, declined, and why. It does not owe obedience to it.

Reviewers sign. This departs from the academic convention of anonymous peer review and does so knowingly: anonymity buys candour, and the corpus trades that candour for attribution, because a criticism nobody can weigh against its author is one more claim asking to be believed. The review then travels with the study when it goes on, so that whatever comes next is read with its criticism attached rather than after it has been quietly resolved.

Reciprocity is structural rather than polite. A cell that takes refinement and never gives it has made itself a client of the wing, and a wing with clients has a centre.

Operation

1. Send the study and nothing else. No accounts, no key, no exception for a reviewer who asks well.

2. Seat reviewers who did not author the study and are not of the authoring cell, drawn by lot from the wing wherever the pool allows.

3. State at the outset what the review can and cannot check: that reviewers cannot verify against sources, and that the depersonalisation test stays with the collecting cell and the tellers.

4. Review the method rather than the conclusion. Does the finding follow from what is presented; are the counts and falsifier stated; was variation carried or smoothed; has description begun arguing.

5. Sign the review under your own name, contrary to the anonymous convention, so that the criticism can be weighed with its author.

6. Return the review without a verdict on publication. The wing refines; it licenses nothing, and no cell holds a gate over another cell’s work.

7. Answer in the open: what the authoring cell changed, what it declined to change, and the reason for each.

8. Publish the review alongside the study when the study goes on, so the next rung reads both together.

9. Take review in turn on the same terms. A cell that only receives has become a client rather than a peer.

Cautions & failure modes

Internal review mistaken for validation. The wing agrees with itself because it was built to. Passing here means a study survived readers who share its assumptions, which is worth something and is not worth much. The rung that can find a bad frame is the outside one, and it has not happened yet.

The gate that forms. A reviewing cell whose sign-off becomes expected has acquired a licence over another cell’s publishing without anyone granting it one. Watch for a study being held back until so-and-so has seen it.

The reviewer who asks for the accounts. The request will be reasonable, will improve the review, and will come from the most conscientious person in the wing. The answer is the limitation, stated plainly at step three, and never the accounts.

The review that improves the argument. Refinement slides easily into helping a colleague make their case better rather than making it more accurate. It is the pleasant form of failure and produces studies that are harder to disagree with and no more likely to be true.

The wing that converges. This is the failure that arrives from doing the work well. A wing that refines one another’s studies often and skilfully will produce studies that increasingly resemble one another — same method, same vocabulary, same shape of finding — and will experience this as maturity. It is the supply of variation drying up inside the organ built to sense variation, and the studies will read better every year while telling the movement less.