Thanks for your inputs Rohan. (My first name is Freedom btw!)

S5 is any model that is a selective structured state space model. An S4 is just a structured state space model. Typically this is what we call the classification of models as S5.

There was also a S5 "layer" (Not a model) which was a simplified state space layers for sequence modeling that is MIMO.

Freedom Preetham
Freedom Preetham

Written by Freedom Preetham

AI Research | Math | Genomics | Quantum Physics

Responses (1)