this post was submitted on 12 Jun 2023
4 points (100.0% liked)

Machine Learning

1784 readers
11 users here now

founded 4 years ago
MODERATORS
[email protected]
4
What research area currently excites you? (self.machinelearning)
submitted 1 year ago by radical_action to c/[email protected]
12 comments fedilink hide all child comments
 

This is an effort to get some discussion going.

I remember starting grad school and coming across reddit posts with themes like, "What research area will be hot in the next 10 years?", etc. In retrospect, the comments there were not very informed (talk of graphical models and bayesian non-parametrics). But, the heart of these posts is talking about a research area that you find exciting.

So, tell us what research area is currently exciting to you. Are you starting a new job, project, or graduate program to work on it?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 2 points 1 year ago* (last edited 1 year ago) (1 children)

I had the pleasure of conducting research into self-supervised learning (SSL) for computer vision.

What stood out to me was the simplicity of the SSL algorithms combined with the astonishing performance of the self-supervisedly trained models after supervised fine-tuning.

Also the fact that SSL works across tasks and domains, e.g., text generation, image generation, semantic segmentation...

[โ€“] MachinaDoctrina 1 points 1 year ago

I too believe that SSL (and to some extent Unsupervised Learning) is by far the best way to frame learning problems in DL, it has shown to avoid the pesky mode collapse and improves out of distribution inference performance.