May 14, 2024
Thanks for your inputs Rohan. (My first name is Freedom btw!)
S5 is any model that is a selective structured state space model. An S4 is just a structured state space model. Typically this is what we call the classification of models as S5.
There was also a S5 "layer" (Not a model) which was a simplified state space layers for sequence modeling that is MIMO.