Skip to content

Add CPU option for transformer models#94

Draft
Mirochill wants to merge 1 commit into
freedmand:mainfrom
Mirochill:fix-57-cpu-transformer-option
Draft

Add CPU option for transformer models#94
Mirochill wants to merge 1 commit into
freedmand:mainfrom
Mirochill:fix-57-cpu-transformer-option

Conversation

@Mirochill

Copy link
Copy Markdown

Summary

  • Add a --cpu option that keeps local transformers models off CUDA even when PyTorch detects a GPU.
  • Thread the CPU/CUDA choice through preset and custom transformer model construction.
  • Document the option for incompatible CUDA/PyTorch environments.

Fixes #57.

Validation

  • git diff --check HEAD~1..HEAD

Tests not run locally.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

PyTorch no longer supports GPU because it is too old

1 participant