@Banaxi-Tech look, I might be 15, but I personally read about 4-6 research papers every week, and I still have a hard time coming up with original research and original hypothesis'.
No saying you didn't put effort into this, but its really surprising that you didn't come across NSA when you are making a vaguely similar system.
You really cannot say anything about it, because this contains a LOT of math which you probably never heard about. We are just saying, your work is extremely unoriginal, and according to you, you told an AI model to come up with everything.
It's Really Unfair for Two Reasons:
- The DeepSeek team probably spent weeks, or months otherwise trying to build NSA
- You just prompted an AI to make an attention mechanism. not just a code block or anything. you told it to do the entire thing, and you didnt even cite DeepSeek ONCE.
I hope you understand our point.
what I am trying to say is, its really hard to not come across the NSA paper if you are making an attention mechanism.
its like trying to make a vehicle but never knowing about the existence of a wheel.