Flatten 1_raw_dataset submodules into plain tracked files
FocalLoRA, Should-It-Be-Executed-Or-Processed, and topicattack were nested git repos (with an inner FocalLoRA/data/FocalLoRA/.git as well). Drop their .git history and track the contents directly in this repo instead of as submodules/gitlinks. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
This commit is contained in:
22
Codes/1_raw_dataset/FocalLoRA/train.sh
Normal file
22
Codes/1_raw_dataset/FocalLoRA/train.sh
Normal file
@ -0,0 +1,22 @@
|
||||
#!/bin/bash
|
||||
eval "$(conda shell.bash hook)"
|
||||
conda activate focallora
|
||||
export CUDA_VISIBLE_DEVICES="0"
|
||||
export PROJDIR="/data/local/hujk/FocalLoRA"
|
||||
cd code
|
||||
|
||||
# Use the new dataset format
|
||||
|
||||
python _tuning.modified.py \
|
||||
--model_path "$PROJDIR/models/Llama-3.1-8B-Instruct/" \
|
||||
--json_path "$PROJDIR/data/all_combined.json" \
|
||||
--tune_path "$PROJDIR/data/focal_lora_dataset_train" \
|
||||
--output_dir "$PROJDIR/LoraAdapter/Llama-3.1-8B-Instruct_m_t10p_sink_orig3/" \
|
||||
--topk 10p \
|
||||
--epochs 10 \
|
||||
--batch_size 6 \
|
||||
--lr 5e-6 \
|
||||
--lambda_focus 0.1 \
|
||||
# --lora_path "$PROJDIR/LoraAdapter/Llama-3.1-8B-Instruct_modified_0.85/batch_0" \
|
||||
# --head_path "$PROJDIR/LoraAdapter/Llama-3.1-8B-Instruct/heads.py"
|
||||
|
||||
Reference in New Issue
Block a user