this post was submitted on 11 Jun 2023
6 points (100.0% liked)

Machine Learning

1788 readers
11 users here now

founded 4 years ago
MODERATORS
[email protected]
6
Dear ML users/researchers, what hardware do you use? (lemmy.ml)
submitted 1 year ago by [email protected] to c/[email protected]
14 comments fedilink hide all child comments
 

I am looking to replace my old PC, and wondering what other people use.

Do you use your own hardware? If so, what do you have? What do you think gives you the most bang for your buck at the moment?

Do you use the cloud instead? If so, why? Which service(s) do you use?

Thank you!

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 1 year ago* (last edited 1 year ago)

I second that. Being able to test medium sized models locally can make debugging much easier.

I have a 3070 with 8GB VRAM, which can train e.g. a GPT2 with a batch-size of 1 with full precision.