Deploy OpenLLM to one A100
导言
Practice is the best teacher in learning.
Excellent Video Resource
We're still on the lookout for an exceptional blog or overview paper to complement our understanding of this topic. Stay tuned for updates!
Outstanding Blog or Overview Paper
The key words are "rethink", "perspective"
Step 1 : find a suitable one in Leaderboard¶
Find the best OpenLLM and can be deployed on one single A100. Ranking. 排行榜
Step 2 ：download and get¶
Step 3 : several tranning ways? LoRa?¶
我LLM 的训练的目的是培养一个我的代理人。文本其实很少，就我正在写的博客的思考的部分是自己写的。关于LLM的训练的原理有几个问题：
- 如何让LLM意识到他是代理人，就是它是我。
- 为什么LLM能理解概念，和产生思维(当然这个问题太复杂了，仅仅从训练的角度出发，当然还有transformer模型的角度。)
https://cloud.tencent.com/developer/article/2331992 https://zhuanlan.zhihu.com/p/646811859
Step 4 : nvsight the tranning bottleneck?¶
占比最多的元操作是什么？