본문으로 건너뛰기
Juhyeon's Blog
Search
검색
다크 모드
라이트 모드
탐색기
태그: Architecture
5건의 항목
2026년 4월 13일
Attention Residuals
paper
Architecture
ResidualConnection
DepthAttention
AttnRes
PreNorm
KimiLinear
ScalingLaw
MoE
2026년 4월 13일
Efficiently Modeling Long Sequences with Structured State Spaces
paper
SSM
StateSpaceModel
S4
HiPPO
LongRangeDependencies
NPLR
CauchyKernel
ICLR2022
Architecture
FoundationalPaper
2026년 4월 13일
Hyena Hierarchy - Towards Larger Convolutional Language Models
paper
Architecture
SubQuadratic
LongConvolution
HyenaOperator
AttentionFree
SSM
ICML2023
DataControlledGating
2026년 4월 13일
Mamba - Linear-Time Sequence Modeling with Selective State Spaces
paper
SSM
SelectiveSSM
Mamba
Architecture
LinearTime
SelectionMechanism
HardwareAware
ParallelScan
StateSpaceModel
HiPPO
2026년 4월 13일
StripedHyena - Moving Beyond Transformers with Hybrid Signal Processing Models
paper
Architecture
HybridModel
StripedHyena
Hyena
Attention
LongContext
SubQuadratic
TogetherAI
BeyondTransformer
ModelGrafting