Search results

AssertionError: Rank 2 has different values for step: 49996.0 Other ranks: 49991.0

bugSomething isn't workingSomething isn't working

waiting on author

Status: Open.

#2032 In Lightning-AI/litgpt;

· VJJJJJJ1 opened on May 12, 2025

Add Multi-head Latent Attention (DeepSeekv2)

enhancementNew feature or requestNew feature or request

waiting on author

Status: Draft (not ready).

Lightning-AI/litgptnumber 1945

#1945 In Lightning-AI/litgpt;

· simoneangarano opened on Feb 25, 2025

OpenCoder series

enhancementNew feature or requestNew feature or request

waiting on author

Status: Draft (not ready).

Lightning-AI/litgptnumber 1880

#1880 In Lightning-AI/litgpt;

· ysjprojects opened on Dec 21, 2024

Llama3 finetuning and generation: Double begin_of_text, no eot_id

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

waiting on author

Status: Open.

#1682 In Lightning-AI/litgpt;

· sanderland opened on Aug 20, 2024

Continue pre-training got RuntimeError: Failed processing /tmp/data

3rd party

bugSomething isn't workingSomething isn't working

pre-training

waiting on author

Status: Open.

#1413 In Lightning-AI/litgpt;

· BestJiayi opened on May 13, 2024

LoRA model tokenizer configuration fails to load

bugSomething isn't workingSomething isn't working

waiting on author

Status: Open.

#1226 In Lightning-AI/litgpt;

· michaelmior opened on Apr 1, 2024

Evaluation with triviaqa

bugSomething isn't workingSomething isn't working

evaluation

waiting on author

Status: Open.

#424 In Lightning-AI/litgpt;

· sanyalsunny111 opened on Aug 16, 2023

Error with self dataset falcon 7b: RuntimeError: expected mat1 and mat2 to have the same dtype, but got: c10::BFloat16 != signed char

bugSomething isn't workingSomething isn't working

quantization

waiting on author

Status: Open.

#223 In Lightning-AI/litgpt;

· FedericoMontana opened on Jul 1, 2023