Pretrain¶
Use client.pretrain() to train a detector, CNN, or transformer. Create the job, then
call job.run().
Image classification (CNN)¶
job = client.pretrain(
architecture="cnn",
kind="resnet18",
init="pretrained",
data="./images/",
config={"n_epoch": 5, "num_classes": 2, "batch_size": 32, "seed": 42},
gpus=1,
time_limit="02:00:00",
)
result = job.run(wait=True)
job.export_metrics("./run.csv")
Object detection¶
job = client.pretrain(
architecture="detector",
kind="detect", # or "segment", "pose"
init="pretrained",
weights="yolo11n.pt",
data="./dataset/",
data_config="data.yaml",
config={"n_epoch": 100, "imgsz": 640, "batch_size": 16, "seed": 42},
)
Detector runs report training loss.
Language model from scratch¶
job = client.pretrain(
architecture="transformer",
kind="gpt-decoder-tiny",
init="scratch",
tokenizer="gpt2",
data="roneneldan/TinyStories", # or a local folder such as "./corpus/"
config={"max_steps": 200, "n_epoch": 1, "batch_size": 2, "seed": 42},
)
print(job.estimate())
Architectures and kinds¶
architecture |
kind |
|---|---|
detector |
detect, segment, pose |
cnn |
resnet18, resnet50 |
transformer |
gpt-decoder-tiny, qwen-decoder-tiny, llama-3-decoder-tiny, vit-tiny |
Download results¶
For more depth, run dataspires.docs("pretrain").