Development and Validation of the Transcranial Magnetic Stimulation Reporting Assessment Tool (TMS-RAT)

Background: A standardised tool for comprehensive reporting can improve transparency, support consistent documentation, and enable comparison across transcranial magnetic stimulation (TMS) studies. The most used reporting checklist lacks clear definitions of full reporting and was not initially evaluated for usability or inter-rater reliability. A scoping review of studies using this checklist shows that its items are reported only 50% of the time, suggesting that method descriptions are often incomplete.

Methods: We developed the TMS Reporting Assessment Tool (TMS-RAT), a comprehensive reporting framework that provides clear definitions and examples for its items, covering a wide range of TMS protocols. We tested the usability and reliability of the TMS-RAT by rating all studies published between 1991 and 2025 using afferent conditioning (n = 333), a protocol encompassing many reporting categories identified during tool development. Seventeen independent raters contributed across three development phases, a validation phase, and a retest phase, with naïve raters introduced in each phase. Iterative refinements of the tool were informed by inter-rater reliability, qualitative rater feedback, and consultation with external TMS experts.

Results: We present two versions of the tool: the 72-item TMS-RAT v1.0, designed to guide comprehensive reporting, and the TMS-RAT v1.1, a subset of 50 items with the highest inter-rater (overall AC1 = 0.78, range = [0.60–0.99]) and test-retest reliability (overall AC1 = 0.82, range = [0.65–1.0]), intended for retrospective evaluation of reporting in systematic reviews, meta-analyses.

Conclusion: The TMS-RAT is a comprehensive, reliable tool that seeks to improve transparency and reproducibility in TMS research.