DataSpiresClient¶
The recommended entry point. Create one client, authenticate, then create jobs.
Methods¶
| Method | Description |
|---|---|
authenticate(api_key=None) |
Authenticate with your API key |
pretrain(architecture, kind, init, config, gpu_type, ...) |
Create a pretraining job |
finetune(model, training_mode, data, config, gpu_type, ...) |
Create a fine-tuning job |
generate(model, data, outputs, gpu_type, ...) |
Create an inference job |
evaluate(model, source_job_id, tasks, data, ...) |
Score a text model. See Evaluate |
gpus(show=True) |
GPUs you can use now, with memory, RAM, vCPUs and live prices. See Choosing a GPU |
estimate_model(model, training_mode, gpus) |
Estimate memory and fit |
inspect_source(ref) |
Check how a source resolves and whether it is accessible |
connect_google_drive() / disconnect_google_drive() |
Sign in to or out of Google Drive |
download_model(job_id, local_dir, include=("final",)) |
Download job outputs |
list_checkpoints(job_id) |
List saved checkpoints |
upload_dataset(local_path, dataset_name=None) |
Upload a dataset ahead of time |
list_available_models() / list_available_datasets() |
Browse the registry |
get_model_requirements(model, training_mode) |
Recommended GPUs and memory |
cancel_job(job_id) |
Cancel a job |
list_jobs(include_completed=False) |
List your jobs |
get_job_status(job_id) |
Get the status of a job |
Every job method takes gpu_type= or offering= to choose a GPU; with neither, the job
runs on DataSpires' own V100 32GB.
See the task guides for worked examples: Pretrain, Finetune, Generate, Evaluate.