Unsloth on DGX Spark

Run the validation test

Execute the test script to verify Unsloth is working correctly.

Bash

python test_unsloth.py

Expected output in the terminal window:

"Unsloth: Will patch your computer to enable 2x faster free finetuning"

Training progress bars showing loss decreasing over 60 steps

Final training metrics showing completion

Next steps

Test with your own model and dataset by updating the test_unsloth.py file:

Python

# Replace line 32 with your model choice
model_name = "unsloth/Meta-Llama-3.1-8B-bnb-4bit"

# Load your custom dataset in line 8
dataset = load_dataset("your_dataset_name")

# Adjust training parameter args at line 61
per_device_train_batch_size = 4
max_steps = 1000

Unsloth on DGX Spark

Step 1
Verify prerequisites

Step 2
Get the container image

Step 3
Launch Docker

Step 4
Install dependencies inside Docker

Step 5
Create Python test script

Step 6
Run the validation test

Step 7
Next steps

Resources

Unsloth on DGX Spark

Step 1Verify prerequisites

Step 2Get the container image

Step 3Launch Docker

Step 4Install dependencies inside Docker

Step 5Create Python test script

Step 6Run the validation test

Step 7Next steps

Resources

Step 1
Verify prerequisites

Step 2
Get the container image

Step 3
Launch Docker

Step 4
Install dependencies inside Docker

Step 5
Create Python test script

Step 6
Run the validation test

Step 7
Next steps