Search results

AttributeError: Can't pickle local object 'main.<locals>.optimizer_hook

Status: Open.

#11 In VITA-Group/Q-GaLore;

· radhacr opened on Feb 11, 2025

"Missing or incorrect absmax2 handling in q_galore_adamw8bit.py

Status: Open.

#10 In VITA-Group/Q-GaLore;

· chrystalli opened on Jan 13, 2025

pretrain script uses torchrun and distributed/nccl when you are running on single GPU

Status: Open.

#9 In VITA-Group/Q-GaLore;

· huu4ontocord opened on Oct 19, 2024

HF Transformers

Status: Open.

#8 In VITA-Group/Q-GaLore;

· GeraudBourdin opened on Sep 13, 2024

Finetuning Code Samples

Status: Open.

#7 In VITA-Group/Q-GaLore;

· lucasmgomez opened on Sep 2, 2024

iam encountering error saving model checkpoints

Status: Open.

#6 In VITA-Group/Q-GaLore;

· Khaledbouza opened on Jul 18, 2024

[suggestion] how about training using q5_k or q6_k quantization?

Status: Open.

#3 In VITA-Group/Q-GaLore;

· 0wwafa opened on Jul 15, 2024

Questions and Suggestions for Enhancing Galore v2

Status: Open.

#2 In VITA-Group/Q-GaLore;

· kostum123 opened on Jul 12, 2024

Distributed Training?

Status: Open.

#1 In VITA-Group/Q-GaLore;

· philschmid opened on Jul 12, 2024