Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

增量预训练时，加载chat模型的问题 #430

Open
luckmoon opened this issue Dec 17, 2024 · 1 comment
Open

增量预训练时，加载chat模型的问题 #430

luckmoon opened this issue Dec 17, 2024 · 1 comment
Labels
question Further information is requested

Comments

@luckmoon
Copy link

看之前的issue，增量预训练时，可以加载chat模型，比如采用数据集tianlongbabu.txt，无法构造成问答的形式，怎么解决呢？用非问答形式的数据，会不会与chat模型的问答的使用方式有所冲突？
@luckmoon luckmoon added the question Further information is requested label Dec 17, 2024
@shibing624
Copy link
Owner

预训练不用问答，只用文本训练。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@shibing624 @luckmoon