this post was submitted on 15 Dec 2023
1 points (66.7% liked)

Hacker News

1770 readers
1 users here now

This community serves to share top posts on Hacker News with the wider fediverse.

Rules0. Keep it legal

  1. Keep it civil and SFW
  2. Keep it safe for members of marginalised groups

founded 1 year ago
MODERATORS
[email protected]
1
Ask HN: AI/ML papers to catch up with current state of AI? (derp.foo)
submitted 7 months ago by [email protected] to c/[email protected]
1 comments fedilink hide all child comments
 

I used to be into ML back in the R-CNN, GAN, ResNet era and would read papers/blogs.

Seems like ML is taking off recently and I want to get back into it! So far on my list I have attention is all you need, qlora, llama’s and q learning. Suggestions?

There is a discussion on Hacker News, but feel free to comment here as well.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 7 months ago

I can't speak for the current state of the art, like the ANN's used by LLM's like ChatGPT, but I have some ideas about the future of neural networks. I think there's a future in networks based on Predictive Coding, which are more versatile, and also in SNN's implemented on neuromorphic hardware.

"Opportunities for neuromorphic computing algorithms and applications" by Schuman et al. provides a good overview of neuromorphic computing.

For an overview of Predictive Coding see "Predictive Coding: a Theoretical and Experimental Review" by Millidge et al.