Under review · WACV 2027 · Applications track

Seeing Seizures

A Large-Scale Empirical Study of Video and EEG Deep Learning for Automated Rodent Seizure Detection and Severity Grading

Anonymous Authors1

1 Institution withheld for double-blind review

📄 Paper 💻 Code 🧠 Models 📊 Bands ❞ BibTeX
pre-ictal
onset

What the camera sees

Twelve seconds around one seizure, cropped to the animal's cage with the box the trainer used.

What the electrode records

The same twelve seconds on the paired biopotential channel, onset marked. The cursor tracks the video frame by frame — drag anywhere on the trace to scrub both together. The discharge reaches 2.97× this channel's baseline amplitude from thirty minutes earlier.

One event, both instruments, one wall clock. The study asks how far the camera alone can go.

Abstract

Video and EEG are widely used to study seizures in animals. However, manual scoring remains a huge bottleneck. Making this automatic is a big challenge that few have solved for animal models. This study tackles the problem using data from twenty rats, analyzing about 24000 paired clips from 601 sessions. Experts graded the seizures from a mild Stage 2 to a severe Stage 5. Ten video models and seven EEG models were tested under strict rules to see how well they could spot seizures and grade their exact severity. For basic detection, both tools did well, while EEG was slightly better, scoring 0.974 compared to video's 0.968. Both tools also worked well on unseen rats. The gap grew when grading the exact seizure levels. In the five-level test, video scored 0.657, easily beating EEG's 0.560. The two methods also made different types of mistakes. Video usually just confused stages that were next to each other. EEG was more likely to miss seizures entirely or mix up very different stages. The size of the video model did not matter much. A tiny model did almost as well as a huge one. Instead, tracking motion over time was the real key. An additional test on the outside RodEpil dataset confirmed these results, with the model score reaching 0.979. Overall, we demonstrate that cameras offer a great, pain-free way to track animal seizures and work very well alongside typical EEG tools.

At a glance

Camera against electrode, five metrics at a time

video · R(2+1)D-18 EEG reference · GRU
Session-disjoint, five seeds. Radial axes span 0.30–1.00 — the polygons nearly coincide at detection and pull apart as grading gets finer, video ahead everywhere except 5-class AUROC.

Task suite

Three granularities over the Racine scale

Detection asks seizure or not. Grading asks how severe — 3-class folds the scale into none / mild (2–3) / severe (4–5); 5-class keeps every stage. These are the stages, as the camera sees them:

Stage 2

Head nodding and facial clonus. The mildest graded class, and the one models most often confuse with baseline.

Stage 3

Forelimb clonus. Motion becomes unambiguous — this is where the camera starts to have a clear advantage.

Stage 4

Rearing with sustained forelimb clonus. Whole-body posture changes.

Stage 5

Rearing and falling, loss of postural control. The rarest class, and it carries most of the remaining error.

Six seconds from each graded class, onset marked, with the paired ECG for the same window beneath each clip — every trace scaled to its own pre-ictal second, cursor locked to its clip, draggable to scrub. The discharge grows with stage: 1.6× pre-ictal amplitude at Stage 2, rising to 7.6× at Stage 5. Severity grading is where the modalities separate — and the open problem.

Why it works

Matched negatives, and where the model looks

pre-ictal
onset

Stage 3 seizure

Rearing and forelimb clonus — the behavioral signature a camera can score.

no event
matched control · no annotated event

Matched non-seizure

Same animal, same cage, same length, drawn from a window overlapping no event — so appearance alone cannot separate the classes.

severe evidence · p=1.000

Where the evidence is · Stage 5 seizure

Class-evidence map (HiResCAM) from X3D-M, the grading champion above, for the class it predicts: severe, at p=1.000. The red core ignites on the convulsing animal through the clonic burst, tracks it, and fades as the animal recovers — evidence localized in space and in time.

severe evidence · p=0.000

And where it is not · matched control

The same map, same class, same model, on the duration-matched control from the same animal and session — rendered on one shared color scale. Its severe-evidence peaks at 6% of the seizure's reference, so the clip plays essentially unheated: nothing in the calm cage reads as seizure evidence. Maps are temporally smoothed for display.

Leaderboard

Ten video backbones, seven EEG models

Matched 12-epoch budget, identical cohort and split. Macro-F1 as mean ± sd over five seeds. Click a column to sort.

Video backbones
BackboneDetection3-class5-class
SlowFast-R500.973 ± .0030.789 ± .0090.675 ± .008
MViTv2-S0.972 ± .0010.786 ± .0050.660 ± .016
R(2+1)D-180.971 ± .0010.783 ± .0020.667 ± .010
X3D-M0.969 ± .0020.794 ± .0050.586 ± .003
MViTv1-B0.969 ± .0020.779 ± .0110.653 ± .008
S3D0.967 ± .0020.764 ± .0040.636 ± .009
Video Swin-S0.966 ± .0030.771 ± .0090.645 ± .011
Video Swin-T0.963 ± .0010.766 ± .0080.632 ± .002
VideoMAE-B0.958 ± .0040.729 ± .0300.636 ± .017
TimeSformer0.945 ± .0010.735 ± .0130.601 ± .009
EEG models
ModelDetection3-class5-class
TCN0.978 ± .0010.767 ± .0070.563 ± .012
GRU (reference)0.974 ± .0030.750 ± .0100.560 ± .005
EEG Conformer0.972 ± .0010.729 ± .0100.523 ± .005
LSTM0.971 ± .0080.698 ± .0530.468 ± .052
EEGNet0.923 ± .0120.620 ± .0150.409 ± .039
XGBoost0.914 ± .0000.642 ± .0000.466 ± .000
Random Forest0.852 ± .0010.529 ± .0010.332 ± .002
SlowFast-R50
best video · 0.973 detection, 0.675 at 5-class
TCN
best EEG · 0.978 detection, 0.563 at 5-class
0.03
macro-F1 band across ten backbones — detection is backbone-agnostic
4M ≈ 33M
X3D-M ties R(2+1)D — capacity is not the constraint

External validation

RodEpil — and a confound worth knowing about

On the public RodEpil benchmark the same backbone reaches 0.979 subject-wise F1. Getting there required finding something first.

The raw release leaks its labels

Trained on the raw clips, the model scores 0.9996 — essentially perfect, across every fold. That is not skill: the class label is encoded into low-level clip encoding, so the network can read it without watching the animal. Re-encoding removes the shortcut; the honest score is 0.979. Anyone using that benchmark should re-encode first.

The cohort

525 hours of paired recording

525.1
hours, paired
24,572
clips
20
subjects
601
sessions

12,228 seizure clips and 12,344 duration-matched non-seizure clips, mean 77.0 s — each event plus a 10 s buffer either side. Training uses 19,208 clips against 5,289 held out, split so no session appears on both sides; the generalization tables additionally hold out whole animals.

A caveat that bounds every EEG number: 19 of the 20 subjects carry a single ECG lead rather than EEG. The electrode arm is a strong biopotential reference, not multichannel electroencephalography.

BibTeX

@article{anonymous2026seeingseizures,
  title   = {Seeing Seizures: A Large-Scale Empirical Study of Video and EEG
             Deep Learning for Automated Rodent Seizure Detection and
             Severity Grading},
  author  = {Anonymous},
  note    = {Under review, WACV 2027. Citation updated on de-anonymization.},
  year    = {2026}
}