# Venue Norms for Consciousness and Anomalous-Cognition Peer Review

_Last updated: 2026-08-05_

Operational reference for seating and calibrating a simulated reviewer panel. Every
venue profile below is drawn from the venue's own published policy pages, its
published record, or peer-reviewed meta-research. Claims that could not be verified
against a primary source are marked **[UNVERIFIED]** and must not be presented to a
user as settled fact.

## How to use this file

1. Pick the target venue. If the user has not named one, infer it from the submission
   type (abstract, target article, empirical report, protocol) and ask.
2. Seat reviewers from the venue's actual reviewer pool profile (see each venue's
   "Who is actually reviewing" line). A TSC screener and an RSOS Stage 1 reviewer are
   not interchangeable people and should not produce the same critique.
3. Run the submission against DESK-REJECT TRIGGERS first. If any fire, the panel
   should say so before doing line-level review -- an experienced reviewer stops there.
4. Apply the field-specific demands in the section "What this field demands that
   mainstream psychology does not." These are the items where a generically competent
   psychology reviewer misses what a specialist catches.
5. Score with the per-venue 1/3/5 rubric at the end.

Confidence labels used throughout: **[V]** verified against a primary source;
**[W]** partly verified, caveat stated; **[UNVERIFIED]** could not be confirmed.

---

## 1. Venue comparison table

| Venue | Gate type | Review style | Length cap | Tolerance for anomalous work | What the reviewer is really screening for |
|---|---|---|---|---|---|
| TSC (Tucson) | Abstract screen | Committee/organizer discretion; no published rubric | 500 words [W] | Very high -- has a named Parapsychology subcategory | Topical fit and non-embarrassment; talk-vs-poster tiering |
| Journal of Consciousness Studies | Full peer review | Anonymized/blind; target-article + commentary format | 9,000 words [V] | High, but adversarially framed | Conceptual contribution legible to a multidisciplinary reader |
| Psychology of Consciousness (APA) | Full peer review | APA-standard | 10,000 / 5,000 brief [W] | Moderate -- anomalous *experience*, not anomalous *causation* | Methodological competence plus institutional defensibility |
| Journal of Scientific Exploration | Full peer review | Blinded (stated for Brief Reports) [V] | ~11,000 words [V] | Highest of any venue here | Data availability, scope fit, internal-critique literacy |
| Frontiers in Psychology (Consciousness Research) | Full peer review | Two-phase interactive; endorsers named [V] | 12,000 words [V] | Moderate-high | Soundness, integrity screening, reputational risk |
| Royal Society Open Science / Registered Reports | Two-stage, pre-data | Stage 1 IPA then Stage 2 adherence check [V] | Varies | Neutral -- format is topic-agnostic | Whether flexibility was actually closed off before data |

---

## 2. The Science of Consciousness (TSC / Tucson)

**Status flag -- read this first.** The 32nd annual TSC, planned for 6-11 April 2026 at
Loews Ventana Canyon, Tucson, was **cancelled in February 2026** after Stuart Hameroff
and other organizers/speakers were named in released Epstein files; the University of
Arizona withdrew support **[V -- corroborated by The College Fix (Feb 12 2026), Inside
Higher Ed, and Hameroff's own Feb 6 2026 statement]**. The conference has relocated:
tsc2026.org now advertises The Science of Consciousness 2026 for **11-16 October 2026,
Paradise Point Resort, San Diego** **[V -- confirmed on tsc2026.org]**. Treat all
Tucson-specific logistics below as describing how TSC normally runs, and verify current
submission mechanics before advising a user on a live deadline.

### Submission mechanics
- **Word limit: 500 words** for text abstracts **[W -- confirmed on the Arizona
  taxonomy/abstract pages, but the live page serves copy labeled "TSC-2020"]**.
- **Six major categories** **[W -- from the document `TAXONOMYTSC2020_000_0.pdf`, which
  the current abstracts page links as *Archived*; there is no evidence of a distinct
  2026 taxonomy revision]**:
  1. Philosophy
  2. Neuroscience
  3. Cognitive Science and Psychology
  4. Physical and Biological Sciences
  5. Experiential Approaches
  6. Culture and Humanities
- **Parapsychology is a named subcategory: `[05.09] Parapsychology`, sitting under
  Experiential Approaches [W -- verbatim in the same archived taxonomy PDF]**. This is
  the single most important operational fact about TSC: anomalous-cognition work is not
  smuggled in under another heading, it has its own numbered slot.
- **Formats:** Plenary (invited), Concurrent talk (20 min + 5 min Q&A, five speakers per
  session), Poster/Exhibit/Demo, Workshop (4-hour block) **[V for the 2026 call]**.
- **One abstract per first author**; presenting author submits. Submission through an
  Oxford Abstracts portal. No abstract submission fee found; registration ran $450
  student / $550 standard for the cancelled Tucson event **[V]**.
- Abstract books are archived publicly at `archive.consciousness.arizona.edu` as
  year-by-year PDFs **[V]**.

### Who is actually reviewing
A program committee exists and is named (for the cancelled 2026 event: Hameroff and
Dante Lauretta as co-chairs, plus Thomas Brophy of IONS, Jeffery Martin, and a
conference manager) **[V]**, but **no published rubric, blind-review procedure,
reviewer count, or acceptance rate exists** **[V -- searched, not found]**. The best
documented account of how selection actually works is journalistic: Tom Bartlett
(Guardian, 19 June 2018) reported the event was "more or less the Stuart Show. He
decides who will and who will not present," and quoted George Mashour, the 2018
co-chair, describing his own gatekeeping fights -- "That was me putting my fist down and
saying we cannot accept this craziness" -- objecting to submissions that were "mostly
conjecture mixed with spirituality and a dash of the quantum" **[V]**.

**Simulate a TSC screener as:** a sympathetic but reputation-anxious organizer who will
accept almost anything topically on-target, and whose real decision is *talk or poster*,
not *accept or reject*. Posters are the overflow tier.

### What actually gets an abstract downgraded or rejected here
- Off-taxonomy topic with no plausible category.
- Over 500 words, or no presenting author.
- Content that reads as promotional, devotional, or product-pitching rather than
  research -- the Mashour-style objection.
- "Quantum" invoked as a rhetorical intensifier with no mechanism.
- Nothing else reliably. **Do not simulate TSC as a high-rejection venue.** Its critics'
  central complaint is precisely that it does not gatekeep: the New York Times called it
  "carnivalesque," and David Chalmers, an early co-organizer, reportedly stepped back as
  the event drifted from the scientific mainstream **[W -- via Wikipedia's summary, not
  cross-checked to a primary source]**.

### Audience
Philosophers, neuroscientists, physicists, clinicians, contemplatives, and artists in
one room. No quantified demographic breakdown exists **[UNVERIFIED]**. Practical
consequence: an abstract must be legible to someone outside its own discipline, and
jargon-dense submissions land badly regardless of quality.

---

## 3. Journal of Consciousness Studies (JCS)

- **Publisher/history:** Imprint Academic, founded 1994 **[V]**. Current Editor-in-Chief
  **Valerie Gray Hardcastle** **[V]**; Managing Editor Graham Horswell.
- **Scope, verbatim:** "How does the mind relate to the brain? Can computers ever be
  conscious? What do we mean by subjectivity and the self?" -- described as "a
  multidisciplinary peer-reviewed journal which examines these issues in plain English,"
  for "an educated multidisciplinary readership" **[V]**.
- **Length: maximum 9,000 words including abstract, footnotes and references.** Most
  published papers run 5,000-9,000 words. **JCS does not publish short research notes or
  letters to the editor** **[V]**.
- **A 150-word summary at the front of the submission is required** **[V]**.
- **Review is blind and anonymization is mandatory:** "Anonymised submissions are now
  mandatory so please fully blind your papers before submitting" **[V -- the "double"
  in double-blind could not be independently confirmed [W]]**.
- **Indexing:** Scopus, Web of Science (AHCI/SSCI), Philosopher's Index, PsycINFO **[V]**.
  It is a genuinely indexed journal, not a self-published outlet.
- Submissions must confirm compliance with the journal's authorship policy regarding
  machine-assisted writing **[V]**.

### The format that matters
JCS runs a **target article plus peer commentary plus author response** structure, in
the tradition of *Behavioral and Brain Sciences*. The canonical anomalous-cognition
instance: **Vol. 12, No. 6 (2005)**, on Rupert Sheldrake's "sense of being stared at,"
presenting Sheldrake's case in two parts plus a response, "scrutinised by fourteen
critics," including a preliminary meta-analysis by Dean Radin and a piece by Marilyn
Schlitz on the discourse of controversial science; republished commercially as
*Sheldrake and His Critics: The Sense of Being Glared At* **[V]**.

**Operational read:** JCS's mechanism for handling a contested empirical claim is not
quiet acceptance -- it is publication surrounded by organized adversarial commentary.
A submission that has not anticipated hostile critique will be steamrolled, or accepted
only as a commentary slot rather than a target article.

### Theoretical vs empirical survival
- **A theoretical submission survives** when it makes a conceptual move that a
  philosopher and a neuroscientist can both follow, engages the standing positions it
  displaces by name, and does not rest on an empirical claim it cannot support.
- **An empirical submission survives** when it is framed as bearing on a conceptual
  question. JCS is not a data-reporting venue; a results paper with no theoretical
  payload has no home here, and the no-short-notes rule blocks the obvious workaround.

### Desk-reject triggers specific to JCS
- Short note, letter, or brief-report format -- structurally not published, regardless
  of quality.
- Unblinded manuscript.
- Over 9,000 words inclusive.
- Specialist jargon with no bridge for a multidisciplinary reader.

---

## 4. Psychology of Consciousness: Theory, Research, and Practice (APA)

- **Publisher:** APA, on behalf of **APA Division 30 (Society of Psychological
  Hypnosis)**; quarterly; ISSN 2326-5523 **[V]**. Launched 2014 **[W]**.
- **Current editor: Etzel A. Cardeña** (Lund University), director of CERCAP, past
  president of the Parapsychological Association (2008-2009) **[V]**. He edited the
  *Journal of Parapsychology* from roughly 2017 to 2020; **he does not currently edit
  it -- the current JP editor is John G. Kruth** **[V -- this corrects a common error]**.
- **Editorial stance, near-verbatim:** Cardeña states he aims to "emphasize a more
  integrated view of alterations of consciousness, so areas that do not 'talk' to each
  other begin doing so," explicitly welcoming submissions "whether fashionable or not"
  **[V]**.
- **Scope explicitly names anomalous experience.** Verbatim: the journal covers
  "anomalous experiences such as NDEs, mystical experiences, etc." **[V]**.
- **Length:** regular papers max 10,000 words; brief reports max 5,000 words; limits
  include the title page and exclude supplemental materials **[W -- APA pages were
  partly unreachable on re-check]**.
- **Style:** APA Publication Manual, 7th edition **[V]**.
- **Data policy, verbatim:** "Authors must indicate whether the data and code for each
  previously unpublished study in the manuscript will be made available, or they must
  provide a reason for not sharing the data" **[V]**.
- **Registered Reports are routed through PCI RR** (Peer Community In Registered
  Reports) -- Stage 1/Stage 2 review happens externally, before journal submission. This
  is the journal's preregistration mechanism, not a blanket preregistration mandate
  **[V]**.

### The framing rule
The journal's scope language consistently treats these topics as **anomalous
*experiences*** -- a category of psychological phenomenon -- rather than as validated
paranormal events. The operationally useful inference: **the topic is not the landmine,
the causal claim is.** A phenomenological, clinical, or experience-report framing is
in-scope; a submission asserting paranormal *causation* runs against the institutional
posture of an APA-published journal. *This is inference from the verbatim scope
language, not a stated editorial rule* **[UNVERIFIED as explicit policy]**.

### Who is actually reviewing
An APA-journal reviewer pool: hypnosis and altered-states researchers, clinical
psychologists, and consciousness researchers who expect JARS-grade reporting, effect
sizes with intervals, and a data-availability statement. Cardeña's own presence means
anomalous topics will not be dismissed on topic alone -- but they will be held to
ordinary APA methodological standards, which is a higher bar than JSE applies.

---

## 5. Journal of Scientific Exploration (JSE)

- **Publisher:** Society for Scientific Exploration, founded 1982 by Peter A. Sturrock;
  journal launched 1987, quarterly **[V]**.
- **Current Editor-in-Chief: James Houran** **[V -- note that Wikipedia's infobox still
  lists Stephen E. Braude / Henry Bauer; the journal's own page is authoritative]**.
  Editorial board includes Roger D. Nelson (Princeton), Harald Walach, Mark Rodeghier
  (Center for UFO Studies), and Paul H. Smith (Remote Viewing Instructional Services).
- **Scope, verbatim:** "to provide a professional forum for critical discussion of topics
  that are for various reasons ignored or studied inadequately within mainstream
  science," covering "apparent anomalies in well-established disciplines to rogue
  phenomena that seem to belong to no established discipline" **[V]**.
- **Length caps:** Regular Articles ~11,000 words; Systematic/Narrative/Scoping Reviews
  ~12,000; Essays ~8,000; Brief Reports ~2,000; Book/Multimedia Reviews ~2,000; Letters
  ~1,000. APA 7th edition; footnotes converted to endnotes **[V]**.
- **Fee contradiction, documented:** the About page describes the journal as Platinum
  Open Access with "no fees for readers and no fees for authors," while the submissions
  page lists an Article Processing Charge of **$250 (non-member) / $150 (SSE member)**
  payable on acceptance **[V -- both statements confirmed live; this is a real, publicly
  visible policy contradiction on the journal's own site, not an allegation]**.
- **Review:** Brief Reports "are subject to blinded peer review in the same manner as
  research articles" **[V]**. **No further procedural detail is published** -- no
  reviewer count, no single-vs-double blinding for full articles, no turnaround, no
  acceptance rate **[V -- searched, absent]**. The opacity is itself a finding.
- **Data availability is a hard requirement:** raw data, confidentiality-redacted, must
  be deposited in an accessible repository with a Data Availability statement **[V]**.
- **Machine-assistance disclosure is an explicit checklist item:** submissions "must not
  use generative artificial intelligence to substitute original thought," with
  proofreading-only use permitted **[V]**. This is enforced more visibly here than at
  most mainstream venues.
- **Indexing:** **not indexed in PubMed/MEDLINE** **[V -- NLM Catalog states "Not
  currently indexed for MEDLINE"]**. Reported to have been in Scopus with coverage
  discontinued around 2018 **[UNVERIFIED -- Scimago and Elsevier both returned 403;
  sourced only via Wikipedia]**. Web of Science status **[UNVERIFIED]**.

### Actual breadth
A single sampled issue (Vol. 39 No. 1, 2025) contained psi/ESP work, biofield research,
vapor-phase electrochemistry, after-death communication, haunting research, precognition
theory, anthropology of spirit possession, and a paper on the origin of modern bread
wheat **[V]**. Calibrate accordingly: scope fit at JSE is extremely wide, which means
"this doesn't belong here" is almost never a valid rejection.

### What critics say
- Kendrick Frazier (*Skeptical Inquirer*): JSE "appears to hold a hidden agenda...
  publish 'scholarly' articles promoting... dowsing, ESP, and psychokinesis."
- Noretta Koertge: "an attempt to institutionalize pseudoscience."
- A 1998 SSE-organized UFO review panel was criticized for seating advocates but no
  skeptics.
**[V that these criticisms exist and are attributed as stated; the original
*Skeptical Inquirer* text could not be fetched directly, so exact wording rests on
Wikipedia's rendering -- W]**.

### What a *friendly* JSE reviewer will still reject you for
- Missing or inaccessible raw data. This is a concrete, checked submission requirement.
- Undisclosed machine-assisted writing.
- A confirmatory claim with no preregistration or registry link.
- Ignoring the field's own internal methodological critique literature (Kennedy, Watt,
  Wiseman on QRPs, fraud controls, and the problems with retrospective meta-analysis).
  A submission that cites only supportive work reads as naive, not rigorous.
- Wrong article type or tone for the venue.

---

## 6. Comparison venues in parapsychology proper

- **Journal of Parapsychology** (Rhine Research Center / Parapsychology Press). Editor
  **John G. Kruth**. Review verbatim: "Manuscripts will be refereed anonymously and the
  authors must mask their identities in the manuscript." Limit verbatim: "Articles must
  not exceed 10,000 words, including references, unless previously authorized by the
  editor." APA 7th **[V]**.
  **Preregistration is recommended, not mandatory.** Verbatim: "Although not mandatory,
  it is strongly recommended that all research, exploratory and even more so
  confirmatory, be preregistered, for instance through
  https://koestlerunit.wordpress.com/study-registry or a similar data registry" **[V]**.
  Do not tell a user that JP requires registered reports -- it does not.
- **KPU Study Registry** (Koestler Parapsychology Unit, University of Edinburgh), run by
  Caroline Watt with Jim Kennedy. Public and timestamped; each submission gets an ID and
  date-received before posting as a PDF. Minimum fields: title; lead researcher and
  contact; purpose/design; hypotheses **explicitly labeled confirmatory or exploratory**;
  planned participant/trial numbers; a statement that data collection has not begun (or
  how many participants are already tested). Confirmatory studies additionally require:
  statistical test per hypothesis with one- or two-sidedness, evidence criteria, data
  transformation and exclusion rules, multiple-comparison correction, a power analysis
  justifying sample size, randomization method, and full procedure. Revisions after data
  collection begins retain both versions publicly **[V]**.
- **Parapsychological Association**: founded 1957; **affiliated with AAAS since 1969**,
  confirmed as still holding "as of 2019" **[V for the history; W for currency -- AAAS's
  own current affiliate list could not be reached]**. John Archibald Wheeler's 1979
  attempt to have the PA expelled included a false claim that J.B. Rhine had committed
  fraud as a student, which Wheeler later retracted in a letter to *Science* **[V]**.
- **Zeitschrift für Anomalistik / Journal of Anomalistics**: German-language,
  peer-reviewed, mission of "informed and respectful dialogue between proponents and
  opponents of controversial scientific claims" **[V for scope; editor, founding date,
  and indexing UNVERIFIED]**.
- **Explore: The Journal of Science and Healing** (Elsevier) -- **[UNVERIFIED; every
  ScienceDirect fetch returned 403]**.

### The field's own strongest reform evidence
**Wiseman, Watt & Kornbrot (2019), "Registered reports: an early example and analysis,"
*PeerJ* 7:e6232** **[V]**. The *European Journal of Parapsychology* ran a
registered-reports prototype from 1976, publishing **25 registered and 35 non-registered
reports**. **Only 8.4% (11/131) of statistical tests in registered reports were
significant, versus 28.4% (66/232) in non-registered reports** **[V -- figures confirmed
against the paper]**. Caveat: the paper frames the span as both "1976 to 1992" (policy
statement) and "1976 to 1993" (publication history) in different places **[W]**.

This is the single most useful citation for a reform-minded reviewer in this field: it
is the field's *own* internal demonstration that removing outcome-contingent publication
collapses the significant-result rate by a factor of roughly three.

---

## 7. Frontiers in Psychology -- Consciousness Research and Mindfulness

- **Field Chief Editor (journal): Axel Cleeremans** (Université libre de Bruxelles).
  **Specialty Chief Editor (section): Antonino Raffone** (Sapienza University of Rome)
  **[V]**. The section's verbatim scope statement could not be extracted -- it renders
  client-side **[UNVERIFIED]**.
- **22 article types**, Original Research capped at **12,000 words**, down to General
  Commentary at 1,000 **[V]**.
- **APC for Original Research: CHF 3,150** **[V -- Frontiers publishes fees only in CHF;
  do not quote a USD figure as though Frontiers stated one]**.

### The review model, and why it changes reviewer behavior
Two phases **[V, verbatim from Frontiers reviewer guidelines]**:
1. **Independent Review** -- reviewers submit an initial assessment with no author
   contact. Structured questionnaire, varying by article type. *The literal numbered
   checklist items could not be retrieved* **[UNVERIFIED]**.
2. **Interactive Review** -- "an ongoing discussion between reviewers, authors, and the
   handling editor. Once activated, reviewer reports and editor comments become visible
   to participants in the review forum." Authors "respond point by point."

**The load-bearing structural fact.** Verbatim from the Frontiers editor guidelines:
> "If a reviewer recommends the rejection of a manuscript, or withdraws from the review
> process, their name will not be made available to the authors and is not published
> alongside the manuscript."
**[V -- quote confirmed live]**

And from the reviewer guidelines: "If you do not consent to being named, you should
withdraw from the process" **[V]**. Reviewer identities are anonymous *during* review;
**"Endorsing reviewers are named on the final published article"** **[V]**.

**Consequence a simulated Frontiers reviewer must reflect:** the published
"Reviewed by:" line is *necessarily a list of endorsers*. Dissenters are structurally
invisible. A reviewer who wants a paper rejected either becomes anonymous or exits.
This asymmetry pushes the visible record toward approval independent of review rigor,
and it means a Frontiers reviewer negotiating in the forum is a *collaborator* on
getting the paper acceptable, not a gatekeeper deciding whether it should exist.

- **Timelines:** initial review report within 10 days **[UNVERIFIED on re-check -- the
  original fetch found it, the verifier could not reconfirm]**; author revision windows
  of 7, 10, or 14 days depending on revision level **[V]**; "Our average review time is
  under 90 days" **[V, verbatim]**.
- **Integrity screening:** AIRA, an automated tool running "40+ checks before peer
  review" **[V]**.
- **Editorial hierarchy** (Field Chief Editor / Specialty Chief Editor / Associate
  Editor / Review Editor) exists by title, but **no Frontiers policy page states who can
  override whom** **[UNVERIFIED -- do not assert an override chain]**.

### Criticism, stated accurately
- **Acceptance rate:** Frontiers does not publish one on its About, publishing-model, or
  review-system pages **[V -- searched, absent]**. The widely circulated "~90%" figure
  comes from a December 2017 Retraction Watch report, cited via Wikipedia -- **a
  third-party, dated figure, not a Frontiers self-disclosure** **[W]**.
- **Beall:** Jeffrey Beall listed Frontiers as a potential predatory publisher in October
  2015; Frontiers pressed his university in September 2016; Beall deleted his list in
  January 2017, with a *Chronicle of Higher Education* account holding that Frontiers'
  pressure was a large factor **[W -- the causal link is reported, not settled]**.
- **2015 editor removals:** Frontiers removed the entire editorial boards of *Frontiers
  in Medicine* and *Frontiers in Cardiovascular Medicine* -- 31 editors -- in May 2015
  after editors alleged staff interference with editorial decisions. Nature Publishing
  Group then ended its collaboration **[V]**. Note this was **not** Frontiers in
  Psychology.
- **"Recursive Fury":** Frontiers in Psychology retracted Lewandowsky et al.'s 2013
  conspiracy-belief paper; the stated rationale shifted from legal concerns to the
  article categorizing "the behaviour of identifiable individuals within the context of
  psychopathological characteristics" **[V]**. COPE and OASPA are both on record as
  having no concerns with Frontiers' membership **[V]**.
- **Clarivate 2023:** Frontiers in Psychology was placed **"on hold"** on the Web of
  Science Master Journal List around late March 2023, with the hold removed on or about
  29 March 2023. **This is "on hold," a re-review flag -- not a confirmed
  delisting-then-relisting cycle.** Sourced only to Chinese-language posts describing
  direct Master Journal List lookups; no Clarivate or English-language primary
  confirmation obtained **[UNVERIFIED -- state the uncertainty, do not assert either
  version]**.
- Norway's Norwegian Scientific Index moved the journal to its "X list" (doubtful
  channels) in 2023 **[W -- via Wikipedia's citation, registry not independently
  checked]**.

### Meta-research on signed/open review
- **van Rooyen, Godlee, Evans, Black & Smith (1999), "Effect of open peer review on
  quality of reviews and on reviewers' recommendations: a randomised trial," *BMJ*
  318:23-27, DOI 10.1136/bmj.318.7175.23** **[V citation; the specific quantitative
  findings could not be re-verified -- do not quote numbers from it]**.
- **Bravo, Grimaldo, López-Iñesta, Mehmani & Squazzoni (2019), "The effect of publishing
  peer review reports on referee behavior in five scholarly journals," *Nature
  Communications* 10:322, DOI 10.1038/s41467-018-08250-2** **[V]**. Across 9,000+
  submissions and 18,000+ reviews (2010-2017), publishing reports **did not**
  significantly compromise referees' willingness to review, their recommendations, or
  turnaround times **[W -- paraphrase, full text behind an auth redirect]**.

**Do not overclaim here.** The intuition that signing makes reviewers softer is
plausible and structurally supported at Frontiers by the endorsers-only naming rule, but
Bravo et al. is the largest direct test and found no significant effect on
recommendations. Present the structural argument, not a false empirical consensus.

### Anomalous work at Frontiers
Psi-adjacent work does appear in the Consciousness Research section -- e.g. Pehlivanova,
Weiler & Greyson (2024), "Cognitive styles and psi: psi researchers are more similar to
skeptics than to lay believers," within the "Insights in Consciousness Research, volume
II" Research Topic **[V]**. There is **no evidence of a dedicated, separately branded
parapsychology Research Topic with its own topic editors** **[UNVERIFIED as stated]**.

---

## 8. Royal Society Open Science and Registered Reports

### RSOS
- Launched September 2014; reviews for **scientific soundness, leaving judgement of
  impact to the reader** **[W -- this "objective peer review" criterion is quoted at one
  remove via Wikipedia's rendering of the RSOS About page; royalsocietypublishing.org
  returned 403 to every direct fetch]**.
- Offers Registered Reports across all subject disciplines; a formal Replications
  article type exists in Psychology and Cognitive Neuroscience **[W]**.
- **RSOS's publication of review histories for a given article could not be confirmed**
  **[UNVERIFIED -- no Review History PDF was found in the Kekecs et al. supplementary
  materials]**. Do not tell a user RSOS definitely publishes reviewer reports without
  checking the specific article.

### Registered Reports: the two-stage contract
All quotes below are verbatim from the **COS generic Registered Reports author/reviewer
guidelines template** (`RegisteredReportsGuidelines_GENERIC_v2.docx`, obtained from
osf.io/pukzy) **[V -- the document was downloaded and read directly; individual journals
adapt this template, so confirm a specific journal's variant before quoting it as that
journal's policy]**.

**Stage 1 reviewers assess:**
1. "The importance of the research question(s)."
2. "The logic, rationale, and plausibility of the proposed hypotheses."
3. "The soundness and feasibility of the methodology and analysis pipeline (including
   statistical power analysis where appropriate)."
4. "Whether the clarity and degree of methodological detail is sufficient to exactly
   replicate the proposed experimental procedures and analysis pipeline."
5. "Whether the authors have pre-specified sufficient outcome-neutral tests for ensuring
   that the results obtained can test the stated hypotheses, including positive controls
   and quality checks."

**Stage 2 reviewers appraise:**
1. "Whether the data are able to test the authors' proposed hypotheses by satisfying the
   approved outcome-neutral conditions (such as quality checks, positive controls)"
2. "Whether the Introduction, rationale and stated hypotheses are the same as the
   approved Stage 1 submission (required)"
3. "Whether the authors adhered precisely to the registered experimental procedures"
4. "Whether any unregistered post hoc analyses added by the authors are justified,
   methodologically sound, and informative"
5. "Whether the authors' conclusions are justified given the data"

And critically: **"editorial decisions will not be based on the perceived importance,
novelty, or clarity of the results."** **[V from the template; note that cos.io's
public-facing page phrases the same principle as decisions not hinging on results being
"surprising, counterintuitive, or unappealing" -- W on which wording a given journal
uses]**.

**In-principle acceptance (IPA), verbatim:** "Manuscripts that pass peer review will be
issued an in principle acceptance (IPA) indicating that the article will be published
pending successful completion of the study according to the exact methods and analytic
procedures outlined, as well as a defensible and evidence-bound interpretation of the
results." Stage 1 protocols are not published by the journal after IPA -- authors
register them in a recognized repository, and they are integrated into the single
completed article at Stage 2 **[V]**.

**What threatens or voids an IPA [V]:**
- "any deviation from the stated experimental procedures, regardless of how minor it may
  seem to the authors, could lead to rejection of the manuscript at Stage 2."
- Substantial post-IPA changes require full withdrawal and resubmission as a new Stage 1.
- Missing the agreed Stage 2 deadline means the paper is treated as withdrawn and logged
  publicly as a Withdrawn Registration, including the original Stage 1 abstract.
- "Partial withdrawals are not possible... Such cases must lead to withdrawal of the
  entire paper."
- **Results never void an IPA.** Only failures of quality assurance, protocol adherence,
  or unresolvable reporting problems can.

**Thresholds [V from the COS template and FAQ documents, W on whether a given journal
adopts them unchanged]:**
- NHST-based RRs: "a priori power of ≥90% for all tests of the proposed hypotheses."
- Bayes factor inference: "authors must be able to guarantee data collection until the
  Bayes factor is at least 6 times in favour of the experimental hypothesis over the
  null hypothesis (or vice versa)."
- **"Over 300 journals use the Registered Reports publishing format"** **[V -- no
  as-of date printed on the source page; observed August 2026]**.

**COS's own top Stage 1 desk-rejection reasons [V, condensed from the template]:**
cover letter missing required statements; insufficient methodological or
exclusion-criteria detail; hypotheses that do not map cleanly onto pre-registered
statistical tests; power below the journal minimum; over-optimistic or under-justified
power analysis; intending to claim support for the null from non-significant NHST
results without Bayes factors or equivalence testing; exploratory analyses included in
the Stage 1 analysis plan; failure to distinguish completed pilot work (past tense) from
proposed work (future tense); no pre-specified positive controls or quality checks; no
power analysis within the proposed positive controls.

---

## 9. Worked case study: the Transparent Psi Project

**Kekecs, Palfi, Szaszi, Szecsi, Zrubka, Kovacs et al. (29 authors) (2023), "Raising the
value of research studies in psychological science by increasing the credibility of
research reports: the Transparent Psi Project," *Royal Society Open Science* 10(2),
article 191375, DOI 10.1098/rsos.191375, PMCID PMC9890107.** The Stage 1 protocol was
deposited as a PsyArXiv preprint, 1 August 2019, DOI 10.31234/osf.io/uwk7y **[V]**.

This is the highest-water-mark example of what adversarial-collaboration-grade review
demands in this field. Use it as the benchmark a panel measures ambitious submissions
against.

**Design and result -- every figure below verified against the PMC full text [V]:**
- A Registered Report replication of Bem's Experiment 1, retroactive facilitation of
  recall.
- **10 labs** completed data collection.
- **N = 2,115** participants contributing valid data; **37,836 critical trials**.
- Observed hit rate **49.89%** against Bem's original **53.07%** (chance = 50%).
- **99.75% CI = [49.11%, 50.67%]**.
- **BF01 > 25** in favor of the null across all three specified priors -- "strong
  evidence in support of M0."
- Authors' conclusion, verbatim from the abstract: **"Bem's findings were not replicated
  in our study."**

**The adversarial element, verbatim:** "The panel of this consensus design process
included 29 experts (15 proponents and 14 opponents of the ESP interpretation of the
original results)" **[V]**.

**Stopping rule [V]:** the design tested whether the true success rate was ≥51% versus
≤50%, using BF01 > 25 (null) or BF01 < 0.04 (alternative) as stopping criteria, with a
claimed >95% probability of correct inference at the specified boundaries and <0.0002
probability of falsely supporting the alternative. Collection continued until all four
primary analysis tests supported the same model. Note this is **far stricter than the
COS generic minimum of BF ≥ 6**.

**Transparency mechanisms it actually used [V -- confirmed in the paper's own text]:**
- Real-time research reports via a continuously updated dashboard.
- Multi-lab consortium design.
- Born-open data with **encrypted timestamps**, deposited in batches of 200 rows to
  preserve participant anonymity.
- Direct deposition to a version-controlled third party (GitHub), with tamper-evidence
  resting on **GitHub's audit trail** -- verbatim, "any manipulation of the data... would
  have been clear and could be traced back at any time because of the audit trail kept by
  GitHub."
- **External research auditors** with an audit-reports folder and auditor CVs on OSF.
- Laboratory, session, and server logs.
- **Video-recorded experimenter training** evaluated against a standardized checklist.

**Mechanisms it did NOT use, despite common assumption -- correct users who assert
these:**
- **Not** cryptographic hash-chaining of data files. The mechanism was timestamp
  encryption plus GitHub's audit log **[V -- searched the full text]**.
- **No** webcam recording of live participant sessions was found; the video was of
  training **[V]**.
- **Randomization source is not specified beyond "determined randomly by computer after
  guess."** Whether a certified hardware RNG or a software PRNG was used is
  **[UNVERIFIED]**. Do not claim the project used a hardware RNG.

**The Bem literature this sits in -- all Crossref-verified [V]:**
- Bem (2011), "Feeling the future," *JPSP* 100(3), 407-425, DOI 10.1037/a0021524.
- Wagenmakers, Wetzels, Borsboom & van der Maas (2011), "Why psychologists must change
  the way they analyze their data: the case of psi," *JPSP* 100(3), 426-432,
  DOI 10.1037/a0022790.
- Bem, Utts & Johnson (2011), "Must psychologists change the way they analyze their
  data?" *JPSP* 101(4), 716-719, DOI 10.1037/a0024777.
- Ritchie, Wiseman & French (2012), "Failing the Future: Three Unsuccessful Attempts to
  Replicate Bem's 'Retroactive Facilitation of Recall' Effect," *PLoS ONE* 7(3).
  *The widely repeated story that they struggled to publish the null is not verified
  from a primary source here* **[UNVERIFIED]**.
- Galak, LeBoeuf, Nelson & Simmons (2012), "Correcting the past: failures to replicate
  psi," *JPSP* 103(6), 933-948, DOI 10.1037/a0029709.
- Bem, Tressoldi, Rabeyron & Duggan (2015), *F1000Research* 4:1188,
  DOI 10.12688/f1000research.7177.1 -- meta-analysis of 90 experiments, reported overall
  effect ~0.09.

No post-2023 rebuttal to the Transparent Psi null was located **[UNVERIFIED -- absence
of evidence; a dedicated search was not possible]**.

---

## 10. DESK-REJECT TRIGGERS

Checkable conditions. If any fire, an experienced reviewer stops and says so.

**Universal**
- [ ] Exceeds the venue's word cap (JCS 9,000 incl. refs; JSE ~11,000; Frontiers OR
      12,000; Psych of Consciousness 10,000 / 5,000 brief; TSC abstract 500).
- [ ] Wrong article type for the venue (a short empirical note to JCS; a pure theory
      essay to a Registered Report track).
- [ ] Manuscript not anonymized where blinding is mandatory (JCS, Journal of
      Parapsychology).
- [ ] No data availability statement where required (JSE, PLOS, Psych of Consciousness,
      RSOS).
- [ ] Undisclosed machine-assisted writing where the venue requires a declaration (JSE
      explicitly; JCS via its authorship policy).
- [ ] Statistical claims with no effect size and no interval.
- [ ] A causal or influence claim resting on a correlational or selection-permissive
      design.

**Field-specific, fires immediately**
- [ ] Calls an avalanche-diode or thermal-noise device a "quantum RNG."
- [ ] "Quantum" used as an intensifier with no stated mechanism.
- [ ] A confirmatory claim with no preregistration, no registry entry, and no timestamp.
- [ ] Cites PEAR or GCP-era RNG results while omitting the field's own major nulls
      (Jahn et al. 2000; Kekecs et al. 2023).
- [ ] Presents Bösch et al. (2006) as a clean win for either side without the published
      exchange in the same issue.
- [ ] Optional stopping with no pre-specified stopping rule.
- [ ] "Demonstrates" or "proves" attached to an exploratory analysis.

**Registered Report Stage 1, fires immediately**
- [ ] Power below the journal's floor (COS generic template: ≥90% for NHST).
- [ ] Exploratory analyses inside the Stage 1 confirmatory plan.
- [ ] Hypotheses that do not map one-to-one onto named statistical tests.
- [ ] No outcome-neutral tests, positive controls, or quality checks.
- [ ] Completed pilot work written in the future tense as though proposed.
- [ ] Claiming null support from non-significant NHST with no Bayes factor or
      equivalence test.

---

## 11. MAJOR-REVISION TRIGGERS

- Preregistration exists but is too vague to constrain analysis -- no locked test per
  hypothesis, no exclusion rule, no stopping rule, no multiplicity correction.
- Deviations from the registered plan occurred and are present but under-justified.
  (Undisclosed deviations are a desk-reject, not a major revision.)
- Randomness source named but not validated: no test-suite results, no calibration or
  baseline runs, no entropy-source description.
- Multiplicity uncontrolled: multiple outcomes, windows, subgroups, or analysis variants
  reported with no correction and no family-wise accounting.
- An influence interpretation asserted without ruling out a selection interpretation
  (see DAT, below).
- Effect sizes reported without uncertainty intervals, or Bayes factors reported without
  stated priors and a sensitivity check.
- The relevant counter-literature is absent -- the meta-analytic exchange, the field's
  own failed replications, or the standard methodological critiques.
- Data or code promised but not deposited, or deposited without a usable README,
  codebook, or provenance record.
- Exploratory and confirmatory analyses are interleaved without labels.
- Sample size unjustified: no power analysis, or one whose assumptions come from a
  small, biased prior literature.

---

## 12. MINOR-REVISION TRIGGERS

- Hedging calibration: "suggests" where the design supports it, "demonstrates" where it
  does not; a handful of over-strong verbs.
- Effect sizes present but reported in a nonstandard or unconvertible metric.
- Missing exact test statistics, degrees of freedom, or exact p-values.
- Terminology slips that do not change the conclusion (TRNG/PRNG/CSPRNG used loosely in
  one passage but correctly elsewhere).
- Incomplete reporting of exclusions, dropouts, or missing data at the participant level.
- Repository link present but not versioned, or a DOI missing from a deposited dataset.
- Figures that omit uncertainty.
- Citation formatting, style edition, endnote conversion, abstract length.

---

## 13. What this field demands that mainstream psychology does not

Each item below states what **satisfied** and **unsatisfied** look like in a submission.
These are the checks where a generically competent psychology reviewer misses what a
specialist catches.

### 13.1 Preregistration, and what counts as "locked"

**Why it bites harder here.** Claesen, Gomes, Tuerlinckx & Vanpaemel (2021), "Comparing
dream to reality: an assessment of adherence of the first generation of preregistered
studies," *Royal Society Open Science* 8(10), DOI 10.1098/rsos.211037 **[V]**, assessed
**23 articles / 38 preregistration plans from *Psychological Science* (Feb 2015 - Nov
2017)** and found **deviations in all studies, undisclosed in 22 of 23 (~96%)** **[V --
these are the actual figures; do not substitute a remembered number]**. Bakker et al.
(2020), "Ensuring the quality and specificity of preregistrations," *PLOS Biology*,
DOI 10.1371/journal.pbio.3000937 **[V]**, found a structured preregistration format
restricted opportunistic use of researcher degrees of freedom better than an open-ended
one (Cliff's Delta = 0.49).

Consequence: **the existence of a preregistration proves nothing.** A reviewer here
reads the prereg for whether it could have constrained anything.

- **Satisfied:** a public, timestamped plan naming, per hypothesis, the exact statistical
  test and its sidedness, the evidence threshold, exclusion and outlier rules, the
  multiplicity correction, the stopping rule, the randomization method, and a power
  justification. Every deviation is listed with its reason and its direction of likely
  bias. Better: a Registered Report with Stage 1 IPA, which removes the incentive to spin
  whatever result appeared.
- **Unsatisfied:** "We preregistered this study on OSF" with a link to a plan that names
  hypotheses but not tests; a plan revised after data collection began with no version
  history; deviations visible in the results but absent from the text.
- **Stronger than required, and used in this field precisely because reviewers are
  hostile:** hash-committing the analysis plan, and third-party auditing. The Transparent
  Psi Project used encrypted timestamps plus a GitHub audit trail and external auditors.
  **No journal is known to require cryptographic hash-commitment as policy** **[this is
  absence of found evidence, not confirmed absence]**.
- **Registry to know:** the KPU Registry (Section 6) -- public, timestamped, retains both
  versions on revision.
- Preregistration vs Registered Report: a preregistration is a timestamped plan with no
  peer-review gate. A Registered Report is peer-reviewed *before* data collection and
  carries in-principle acceptance. Do not let a user call the first the second.

### 13.2 Multiplicity and the garden of forking paths

Gelman & Loken (2014), "The Statistical Crisis in Science," *American Scientist* 102(6),
460, DOI 10.1511/2014.111.460 **[V]**. Simmons, Nelson & Simonsohn (2011),
"False-Positive Psychology," *Psychological Science* 22(11), 1359-1366,
DOI 10.1177/0956797611417632 **[V]**.

The forking-paths problem is sharper in RNG and field-monitoring work than in ordinary
psychology because the analyst chooses the window, the epoch, the statistic (mean shift
vs variance vs runs), the aggregation level, and the event set -- often after seeing data.

- **Satisfied:** one pre-specified primary outcome with its window and statistic fixed in
  advance; everything else labeled secondary or exploratory; a stated correction with its
  family defined; a multiverse or specification-curve analysis if many defensible
  analytic paths exist.
- **Unsatisfied:** a significant result at one window length among several tried, with
  the others unreported or reported without correction; an "event" defined after the
  data were inspected; a runs test, a variance test, and a mean test all reported with
  only the winner emphasized.

### 13.3 Randomness-source validation and terminology precision

This is the most common place a submission in this subfield is killed by a specialist,
and the place a mainstream reviewer will not catch the error.

**Standards and suites [all V unless noted]:**
- **NIST SP 800-22 Rev 1a**, "A Statistical Test Suite for Random and Pseudorandom Number
  Generators for Cryptographic Applications," April 2010. **NIST's Crypto Publication
  Review Project marked it for REVISION on 19 April 2022** -- it is still operative but
  formally flagged as due for replacement. Cite it with that status, not as settled.
- **NIST SP 800-90B**, "Recommendation for the Entropy Sources Used for Random Bit
  Generation," January 2018 (errata May 2025). The entropy-source validation standard:
  min-entropy estimation plus continuous health testing. *The exact mechanics of the
  Repetition Count Test and Adaptive Proportion Test were not confirmed from the primary
  text* **[UNVERIFIED at that level of detail]**.
- **NIST SP 800-90A Rev. 1**, June 2015 -- DRBG constructions.
- **NIST SP 800-90C** reached **Final status September 2025** -- RBG constructions
  combining 90A DRBGs with 90B entropy sources. This is recent; do not describe it as
  still in draft.
- **TestU01**: L'Ecuyer & Simard (2007), *ACM TOMS* 33(4), 1-40,
  DOI 10.1145/1268776.1268777. Batteries SmallCrush / Crush / BigCrush *(exact per-battery
  test counts not re-verified* **[UNVERIFIED]**).
- **Dieharder** (Robert G. Brown, Duke) -- explicitly a superset of Marsaglia's Diehard
  plus NIST STS tests plus original tests.
- **PractRand** -- exists, tests very large data volumes. Its reputation for catching
  what TestU01 misses is community lore, not peer-reviewed **[W]**.

**Terminology, stated precisely.** Manufacturers themselves draw this line: TrueRNG
(ubld.it) describes its source as **avalanche effect in a semiconductor junction** and
markets it as a hardware RNG, **not** a quantum RNG; OneRNG uses an avalanche diode plus
optional RF entropy and likewise makes no quantum claim **[V]**. Genuine QRNGs ground
randomness in a quantum-optical process: the ANU Quantum Random Numbers Server uses
**quantum vacuum fluctuations** **[V]**; ID Quantique Quantis is engineered around "an
elementary quantum optics process" **[V -- the specific beam-splitter mechanism was not
confirmed from the vendor page]**.

**Be precise rather than sloganeering.** Shot noise in a junction *is* quantum in origin,
so the defensible objection is not "diodes aren't quantum." It is that (a) the vendor
does not make the claim, (b) avalanche/thermal devices mix thermal and quantum
contributions and the paper cannot separate them, and (c) nothing in the experimental
argument turns on the distinction unless the author has made it turn on it. A reviewer
should press on **which claim the author needs**, not perform a physics lecture.

- **Satisfied:** device named with model and vendor; entropy source described physically;
  post-processing/whitening/XOR-balancing disclosed; a named test suite run **on the
  actual data stream used in the experiment** with results reported; substantial
  unattended baseline/calibration runs from the same device reported alongside the
  experimental runs; terminology used consistently (TRNG / PRNG / CSPRNG / QRNG) and
  matched to what the vendor actually claims.
- **Unsatisfied:** "a quantum random number generator was used" with no model; a test
  suite cited as having been passed by the manufacturer rather than run on the collected
  data; whitening applied without noting that XOR-balancing suppresses exactly the
  first-order bias the experiment is looking for; no control data; PRNG and TRNG used
  interchangeably.

### 13.4 Experimenter effects and Decision Augmentation Theory

**The citation [V]:** May, Utts & Spottiswoode (1995), "Decision Augmentation Theory:
Toward a Model of Anomalous Mental Phenomena," *Journal of Parapsychology* 59(3),
195-220. May's own retrospective, "A Random Number Generator Experiment: The Origin of
Decision Augmentation Theory," *Journal of Parapsychology* 85(1), 75-107 (2021),
DOI 10.30891/jopar.2021.01.08, states the results appear to arise "because of
informational psi on part of the participant" rather than direct PK **[V]**.

**DAT's core claim:** what looks like influence on a physical system is better modeled as
**informational selection** -- of a favorable moment to begin, or of a favorable labeling
after the fact -- operating on an unmodified random stream. This matters enormously
because **selection is also exactly what a control failure looks like.**

> **[UNVERIFIED -- HANDLE WITH CARE]** DAT is widely described as discriminating
> selection from influence by how effect size scales with sample size: under selection,
> effect size falls as 1/√n so the z-score stays roughly constant across run lengths,
> whereas under a genuine force model effect size is constant so z grows as √n. **The
> direction of this relation could not be confirmed against the primary 1995 text in this
> pass** (the LFR library pages and the JP article body were both unreachable). A panel
> may raise the scaling question as a live issue, but **must not assert the direction as
> established** without checking the source. Getting it backwards is a
> field-recognizable error.

**A discriminator that IS verified.** Dobyns (1996), "Selection Versus Influence
Revisited: New Method and Conclusions," *Journal of Scientific Exploration* 10(2),
253-267, tests selection against influence using **rank frequencies of tripolar sets**
(each session comprising high / baseline / low intention runs), across **490 tripolar
sets**, normalizing the data to the empirical rather than theoretical distribution
"to avoid improper prejudice against the selection model." Conclusion, verbatim: "the
selection hypothesis gives a poor fit to the data structure, while the influence
hypothesis gives about as good a fit as can be expected," at **p ≈ 0.03** **[V -- read
directly from the paper]**. The paper also shows that under a plausible constraint,
**timing selection makes the same predictions as intentional selection**, so the same
test covers both **[V]**.

**A model erratum, worth holding up as a norm.** Dobyns (1996) exists to correct Dobyns
(1993), *JSE* 7, 259, which had failed to account for nonindependence between intentions
and thereby inflated significance to p = 0.0095. The error was privately flagged by
**Jessica Utts -- a co-author of DAT, i.e. the position Dobyns was arguing against** --
and Dobyns published the correction with the acknowledgement "I am indebted to Jessica
Utts for her detection and communication of the error in the earlier analysis," reporting
the weaker result rather than the original **[V -- read directly from the paper]**. This
is the standard a panel should hold up when discussing erratum norms in this field.

See also Dobyns & Nelson (1998), "Empirical Evidence Against Decision Augmentation
Theory," *JSE* 12(2), 231-257, also issued as PEAR Technical Note 97005 **[W -- citation
located via multiple secondary listings; the full text was not read]**.

**Experimenter effects.** Schlitz, Wiseman, Watt & Radin (2006), "Of two minds:
sceptic-proponent collaboration within parapsychology," *British Journal of Psychology*,
DOI 10.1348/000712605X80704 **[V]** -- the joint skeptic-proponent replication in which
experimenter identity is the variable of interest. Wiseman & Schlitz (1999),
"Experimenter Effects and the Remote Detection of Staring: A Replication," and Watt,
Schlitz, Wiseman & Radin (2005), "Experimenter differences in a remote staring study,"
both confirmed to exist **[V]**; the original 1997 journal citation was not pinned down
**[UNVERIFIED -- do not assert page numbers]**.

- **Satisfied (for an influence interpretation):** run lengths deliberately varied and
  the scaling relation tested and reported; start times pre-specified or
  automatically/externally triggered rather than operator-chosen; the operator blind to
  device state; a rank-frequency or equivalent distributional test where the design
  permits; the selection interpretation named, tested, and reported even when it is not
  favored; experimenter identity recorded and modeled where more than one person ran
  sessions.
- **Unsatisfied:** operator chooses when to start; a single run length throughout, so the
  scaling discriminator cannot be computed at all; DAT never mentioned; "influence,"
  "effect on," or "PK" used as the default description of a correlation; a single
  experimenter with a stake in the outcome running every session and no discussion of it.

### 13.5 Effect sizes with intervals, Bayes factors, and the meta-analytic record

**Reporting baseline [V]:** Wilkinson & the Task Force on Statistical Inference (1999),
"Statistical methods in psychology journals: Guidelines and explanations," *American
Psychologist* 54(8), 594-604, DOI 10.1037/0003-066x.54.8.594, plus APA JARS.

**The RNG-PK meta-analytic record -- the citations a reviewer expects, all
Crossref-verified [V]:**
- **Radin & Nelson (1989)**, "Evidence for consciousness-related anomalies in random
  physical systems," *Foundations of Physics* 19(12), 1499-1514, DOI 10.1007/BF00732509.
  *Its specific reported effect size and study count were not re-pulled* **[UNVERIFIED --
  do not quote numbers]**.
- **Bösch, Steinkamp & Boller (2006)**, "Examining psychokinesis: The interaction of human
  intention with random number generators -- a meta-analysis," *Psychological Bulletin*
  132(4), 497-523, DOI 10.1037/0033-2909.132.4.497. Found a very small overall effect that
  they read as consistent with publication bias and small-study effects. *Their exact
  study count and effect size were not independently pulled in this pass* **[UNVERIFIED --
  verify before quoting a number]**.
- **The published exchange in the same issue** -- all three DOIs and page ranges verified:
  - Wilson & Shadish (2006), "On blowing trumpets to the tulips: To prove or not to prove
    the null hypothesis," pp. 524-528, DOI 10.1037/0033-2909.132.4.524.
  - Radin, Nelson, Dobyns & Houtkooper (2006), "Reexamining psychokinesis: Comment on
    Bösch, Steinkamp, and Boller (2006)," pp. 529-532,
    DOI 10.1037/0033-2909.132.4.529.
  - Bösch, Steinkamp & Boller (2006), "In the eye of the beholder: Reply to Wilson and
    Shadish (2006) and Radin, Nelson, Dobyns, and Houtkooper (2006)," pp. 533-537,
    DOI 10.1037/0033-2909.132.4.533.
- **Jahn, Dunne, Nelson, Dobyns et al. (2000)**, "Mind/Machine Interaction Consortium:
  PortREG Replication Experiments," *JSE* 14(4), 499-555 -- the three-lab consortium
  (PEAR/Princeton, Freiburg, Giessen) that **failed to replicate PEAR's own original
  effect** **[V]**. This is the field's largest internal null and citing around it is
  treated as cherry-picking.
- **Bierman, Spottiswoode & Bijl (2016)**, "Testing for Questionable Research Practices in
  a Meta-Analysis: An Example from Experimental Parapsychology," *PLOS ONE* 11(5),
  e0153049, DOI 10.1371/journal.pone.0153049 **[V]**.
- **Scargle (2000)**, "Publication Bias (The 'File-Drawer Problem') in Scientific
  Inference," *JSE* 14(1), 91-106 **[V -- two independent secondary sources agree on
  volume/issue/pages; pre-DOI era]**.
- **May & Spottiswoode (2001)**, an independent analysis of the Global Consciousness
  Project's 11 September 2001 result, concluding the deviations were attributable to an
  experimenter effect rather than a global-consciousness signal. **Whether this was
  formally journal-published or circulated as an LFR technical report is
  [UNVERIFIED]** -- the PDF was unreadable and no volume/pages were confirmed.

- **Satisfied:** every primary result carries an effect size with an interval; Bayes
  factors, where used, state their priors and include a sensitivity analysis across
  plausible alternatives; the meta-analytic exchange is engaged on both sides rather than
  cited one-way; heterogeneity and small-study effects are addressed, not waved at.
- **Unsatisfied:** bare p-values; a Bayes factor with no stated prior; Radin & Nelson
  (1989) cited as though Bösch et al. (2006) had not happened, or Bösch et al. cited as a
  clean refutation as though the replies had not been published; PEAR results presented
  without Jahn et al. (2000).

### 13.6 Data, code, provenance, and erratum norms

- **TOP Guidelines:** Nosek et al. (2015), "Promoting an open research culture,"
  *Science* 348(6242), 1422-1425, DOI 10.1126/science.aab2374 **[V]**. Originally 8
  standards at 3 levels: **Level 1 Disclosed**, **Level 2 Shared and Cited**, **Level 3
  Certified**. **Note:** cos.io now describes a revised framework of 7 research practices
  plus verification practices and verification study types **[V]** -- cite the 2015 paper
  for the original scheme and note it has evolved.
- **FAIR:** Wilkinson et al. (2016), *Scientific Data* 3, DOI 10.1038/sdata.2016.18 --
  Findable, Accessible, Interoperable, Reusable **[V]**.
- **Born-open data:** Rouder (2016), "The what, why, and how of born-open data,"
  *Behavior Research Methods* 48(3), 1062-1069, DOI 10.3758/s13428-015-0630-z **[V]** --
  data made open automatically as created, rather than by a later release decision.
- **PLOS data policy, verbatim [V]:** "PLOS journals require authors to make all data
  necessary to replicate their study's findings publicly available without restriction at
  the time of publication," and where legal or ethical restrictions apply, "authors must
  indicate how others may obtain access to the data."
- **COPE Retraction Guidelines, Version 2 (November 2019)**, DOI 10.24318/cope.2019.1.4
  **[V that the document and version exist; the verbatim criteria text could not be
  fetched -- publicationethics.org returned 403. Do not quote COPE's specific triggers as
  verbatim without a successful fetch.]**
- **Forensics reviewers may apply uninvited [both V]:** Simonsohn (2013), "Just Post It:
  The Lesson From Two Cases of Fabricated Data Detected by Statistics Alone,"
  *Psychological Science* 24(10), 1875-1888, DOI 10.1177/0956797613480366; Brown &
  Heathers (2017), "The GRIM Test," *Social Psychological and Personality Science* 8(4),
  363-369, DOI 10.1177/1948550616673876 -- checks whether reported means are
  mathematically possible given sample size and integer response scales.

- **Satisfied:** data and code deposited at a versioned repository with a DOI; a codebook
  and README; raw instrument output preserved alongside derived files; a provenance chain
  (timestamps, logs, checksums) that a third party could audit; corrections issued
  promptly and visibly when an error is found, with the corrected result reported even
  when weaker (the Dobyns 1996 standard).
- **Unsatisfied:** "data available on reasonable request" with no repository; only
  processed summaries deposited; raw output silently trimmed or re-parsed with no
  disclosure; an error acknowledged in correspondence but never corrected in the record.

### 13.7 Claim calibration -- exploratory vs confirmatory, "suggests" vs "demonstrates"

- Wagenmakers, Wetzels, Borsboom, van der Maas & Kievit (2012), "An Agenda for Purely
  Confirmatory Research," *Perspectives on Psychological Science* 7(6), 632-638,
  DOI 10.1177/1745691612463078 **[V]**.
- Kimmelman, Mogil & Dirnagl (2014), "Distinguishing between exploratory and confirmatory
  preclinical research will improve translation," *PLOS Biology* 12(5),
  DOI 10.1371/journal.pbio.1001863 **[V]**.
- Haber, Smith, Moscoe, Andrews, Audy, Bell, Brennan, Breskin, Kane, Karra, McClure &
  Suarez (2018), "Causal language and strength of inference in academic and media articles
  shared in social media (CLAIMS): A systematic review," *PLOS ONE* 13(5),
  DOI 10.1371/journal.pone.0196346 **[V -- note the author list; a commonly circulated
  version of this citation names the wrong co-authors]**.

**"Extraordinary claims" -- get the attribution right.** Marcello Truzzi wrote **"An
extraordinary claim requires extraordinary proof"** (singular "claim," and "proof," not
"evidence") in *Zetetic Scholar* No. 1 (1978), "On the Extraordinary: An Attempt at
Clarification," beginning p. 11 **[V; end page 22 not confirmed -- W]**. Carl Sagan
popularized the "extraordinary evidence" phrasing. Laplace's formulation -- the weight of
evidence for an extraordinary claim must be proportioned to its strangeness -- predates
both, and Hume's 1748 "Of Miracles" is the philosophical root **[W -- established as
commonly cited precursors, exact wording/date less precisely sourced]**. Invoking the
slogan while misattributing it is itself a tell in a field where its history is
well-worn.

**Calibration ladder, strongest to weakest claim:**

| Language | What it commits you to |
|---|---|
| "demonstrates" / "proves" / "shows that X causes Y" | A confirmatory, adequately powered, preregistered test with a manipulated cause and alternatives excluded |
| "provides evidence that" | A confirmatory test with a stated evidence threshold met |
| "is consistent with" | The data do not rule the hypothesis out -- and do not rule out its rivals either |
| "suggests" / "is compatible with" | Exploratory; hypothesis-generating only |
| "we observed" | A description, no inference |

- **Satisfied:** every inferential verb is matched to the design; exploratory findings are
  labeled exploratory in the abstract, not only in a limitations paragraph; the abstract's
  strength matches the results section's; alternative explanations (selection, experimenter
  effect, device artifact, multiplicity) are named in the discussion.
- **Unsatisfied:** an exploratory subgroup finding described as a demonstration; an
  abstract stronger than the paper; "significant" doing the work of "important";
  limitations quarantined in a final paragraph that the conclusion then ignores.

---

## 14. How to score against these norms

A 1 is a reject, a 3 is major revision, a 5 is accept or in-principle accept. Score what
the venue actually cares about, not a generic quality impression.

### TSC (abstract screen)
- **1** -- Off-taxonomy, over 500 words, or reads as promotional/devotional. No plausible
  category.
- **3** -- On-topic and correctly categorized, but thin: a claim with no method, or
  "quantum" as an intensifier. **Poster.**
- **5** -- Clear question, stated method, a specific result or a specific well-posed
  argument, legible to a non-specialist, correctly categorized. **Concurrent talk.**

### Journal of Consciousness Studies
- **1** -- Wrong format (short note/letter), unblinded, over 9,000 words, or a data report
  with no conceptual payload.
- **3** -- A real conceptual contribution that does not engage the positions it displaces,
  or is written for specialists only. Revise, or accept as a commentary rather than a
  target article.
- **5** -- A conceptual move a philosopher and a neuroscientist can both follow, engaging
  named opposing positions, robust enough to survive an organized commentary round.

### Psychology of Consciousness (APA)
- **1** -- No data-availability statement; not APA 7th; a paranormal-causation claim
  presented as established; effect sizes absent.
- **3** -- Sound method and appropriate framing, but bare p-values, uncontrolled
  multiplicity, or exploratory results described confirmatorily.
- **5** -- JARS-grade reporting; effect sizes with intervals; preregistered or honestly
  labeled exploratory; anomalous material framed as experience/phenomenology with causal
  language calibrated to the design.

### Journal of Scientific Exploration
- **1** -- No raw data deposited; no Data Availability statement; undisclosed
  machine-assisted writing; a confirmatory claim with no registry entry; ignores the
  field's own critique literature.
- **3** -- Data available and scope-appropriate, but the randomness source is unvalidated,
  the selection interpretation is unaddressed, or the field's major nulls go uncited.
- **5** -- Registered, data and code deposited, RNG validated on the collected stream with
  baselines, selection and experimenter-effect alternatives explicitly tested, claims
  calibrated, the internal critique literature engaged on both sides. Note that a 5 here is
  a *higher* methodological bar than a 5 at TSC, despite JSE's reputation -- the topic
  latitude is wide but the documentation requirements are concrete and checked.

### Frontiers in Psychology (Consciousness Research)
- **1** -- Fails integrity screening; characterizes identifiable individuals in
  psychopathological terms (the "Recursive Fury" line); unsound method.
- **3** -- Sound but underspecified; the interactive forum is where this gets fixed, and a
  Frontiers reviewer at a 3 should be writing negotiable, itemized requests rather than a
  verdict.
- **5** -- Sound, transparent, well-reported. Remember the structural fact: a reviewer who
  would score this a 1 and hold the line is a reviewer who withdraws and vanishes from the
  record. **When simulating a Frontiers panel, model the exit as well as the critique** --
  it is the venue's most distinctive dynamic.

### Royal Society Open Science / Registered Reports
- **Stage 1 -- 1:** Power below the floor; exploratory analyses in the confirmatory plan;
  hypotheses not mapped to named tests; no outcome-neutral tests or positive controls;
  pilot work written as though proposed.
- **Stage 1 -- 3:** Important question and sound design, but the analysis pipeline leaves
  undisclosed flexibility: exclusion rules unstated, a stopping rule missing, multiplicity
  unaddressed. Revisable to IPA.
- **Stage 1 -- 5:** IPA. Detailed enough to replicate exactly; every hypothesis maps to a
  pre-specified test; power ≥90% or a stated Bayes-factor stopping rule; positive controls
  and quality checks specified; exploratory work fenced off.
- **Stage 2 -- 1:** Undisclosed protocol deviation, or the introduction/hypotheses changed
  from the approved Stage 1.
- **Stage 2 -- 3:** Adherence good, but post hoc analyses are insufficiently distinguished
  or the conclusions overreach the data.
- **Stage 2 -- 5:** Protocol adhered to precisely, outcome-neutral conditions met, post hoc
  analyses clearly labeled and justified, conclusions matched to the data. **Score this
  without reference to whether the result was positive or null** -- that is the entire
  point of the format, and the Transparent Psi Project is the worked example of a null
  earning a 5.

---

## 15. Known gaps in this file

Do not fill these from memory. Verify before relying on them.
- The DAT effect-size scaling direction (Section 13.4) -- **hard-blocked**.
- TSC's current submission mechanics after the October 2026 San Diego relocation.
- Whether TSC's taxonomy has been revised since the archived TSC-2020 scheme.
- JSE's Scopus and Web of Science indexing status.
- Whether RSOS publishes review histories, and whether one exists for Kekecs et al. (2023).
- Frontiers' reviewer-side deadlines, the literal review questionnaire items, the editorial
  override chain, and the Clarivate 2023 status episode.
- COPE's verbatim retraction-versus-correction criteria.
- Bösch et al. (2006) and Radin & Nelson (1989) study counts and effect sizes.
- Whether the Journal of Parapsychology or JSE has moved preregistration from recommended
  to mandatory since these pages were read.
- *Explore: The Journal of Science and Healing* -- not reached at all.
