cll7793

I wanted to make this post so we can share all the resources we have with each other on anything machine learning related.

Please feel free to add all of your resources as well even if they are duplicates.

PS: The best way to grow our lemmy community is to produce high quality posts.

Some ideas of things you could share:

• What people do you follow for AI? Such as on YT, Twitter, etc.
• What other social media forums provide great information?
• What GUI do you use for local LLMs?
• What parameters are "best"?
• Is there a Wiki you use?
• Where do you go to learn about LLMs/AI/Machine Learning?
• How do you find quality models?
• What Awesome github repositories do you know?
• What do you think would be useful to share?

General Information - Awesome

• Awesome-LLM: https://github.com/Hannibal046/Awesome-LLM
• Awesome Jailbreaks: https://github.com/0xk1h0/ChatGPT_DAN
• Awesome Prompts: https://github.com/f/awesome-chatgpt-prompts
• Prompt-Engineering-Guide: https://github.com/dair-ai/Prompt-Engineering-Guide
• AI Explained (Great channel for AI news): https://piped.video/channel/UCNJ1Ymd5yFuUPtn21xtRbbw
• Lex Fridman (In depth podcasts): https://piped.video/channel/UCSHZKyawb77ixDdsGog4iWA

LLM Leaderboards:

• LLM Logic Tests: https://docs.google.com/spreadsheets/d/1NgHDxbVWJFolq8bLvLkuPWKC7i_R6I6W/edit#gid=2011456595
• llm-leaderboard: https://github.com/LudwigStumpp/llm-leaderboard
• Chat leaderboard: https://chat.lmsys.org/?leaderboard
• Gotzmann LLM Score v2.4: https://docs.google.com/spreadsheets/d/1ikqqIaptv2P4_15Ytzro46YysCldKY7Ub2wcX5H1jCQ/edit#gid=0
• LLM Worksheet: https://docs.google.com/spreadsheets/d/1kT4or6b0Fedd-W_jMwYpb63e1ZR3aePczz3zlbJW-Y4/edit#gid=0
• CanAiCode Leaderboard: https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
• AlpacaEval Leaderboard https://tatsu-lab.github.io/alpaca_eval/
• Measuring Massive Multitask Language Understanding: https://github.com/hendrycks/test
• Awesome-LLM-Benchmark: https://github.com/SihyeongPark/Awesome-LLM-Benchmark

Places to Find Models

• Discovery the LLMs: https://llm.extractum.io/
• Open LLM Models List: https://github.com/underlines/awesome-marketing-datascience/blob/master/llm-model-list.md
• OSS_LLMs: https://docs.google.com/spreadsheets/d/1PtrPwDV8Wcdhzh-N_Siaofc2R6TImebnFvv0GuCCzdo/edit#gid=0
• OpenLLaMA: An Open Reproduction of LLaMA: https://github.com/openlm-research/open_llama
• open-llms: https://github.com/eugeneyan/open-llms

Training & Datasets

• Uncensored Models: https://erichartford.com/uncensored-models
• LLMsPracticalGuide: https://github.com/Mooler0410/LLMsPracticalGuide
• awesome-chatgpt-dataset: https://github.com/voidful/awesome-chatgpt-dataset
• awesome-instruction-dataset: https://github.com/yaodongC/awesome-instruction-dataset

There are still many more resources out there I'm sure. Please share what you use to try to keep up with the fast pace of AI development.

I hope some of my resources have helped you! I'm eager to hear what other resources are out there!

What concepts or facts do you know from math that is mind blowing, awesome, or simply fascinating?

Here are some I would like to share:

• Gödel's incompleteness theorems: There are some problems in math so difficult that it can never be solved no matter how much time you put into it.
• Halting problem: It is impossible to write a program that can figure out whether or not any input program loops forever or finishes running. (Undecidablity)

The Busy Beaver function

Now this is the mind blowing one. What is the largest non-infinite number you know? Graham's Number? TREE(3)? TREE(TREE(3))? This one will beat it easily.

• The Busy Beaver function produces the fastest growing number that is theoretically possible. These numbers are so large we don't even know if you can compute the function to get the value even with an infinitely powerful PC.
• In fact, just the mere act of being able to compute the value would mean solving the hardest problems in mathematics.
• Σ(1) = 1
• Σ(4) = 13
• Σ(6) > 10^10^10^10^10^10^10^10^10^10^10^10^10^10^10 (10s are stacked on each other)
• Σ(17) > Graham's Number
• Σ(27) If you can compute this function the Goldbach conjecture is false.
• Σ(744) If you can compute this function the Riemann hypothesis is false.

Sources:

• YouTube - The Busy Beaver function by Mutual Information
• YouTube - Gödel's incompleteness Theorem by Veritasium
• YouTube - Halting Problem by Computerphile
• YouTube - Graham's Number by Numberphile
• YouTube - TREE(3) by Numberphile
• Wikipedia - Gödel's incompleteness theorems
• Wikipedia - Halting Problem
• Wikipedia - Busy Beaver
• Wikipedia - Riemann hypothesis
• Wikipedia - Goldbach's conjecture
• Wikipedia - Millennium Prize Problems - $1,000,000 Reward for a solution

An Internet Portal is an information hub connecting you a much wider portion of the internet.

For example:

• Wikipedia's Content Portal: https://en.wikipedia.org/wiki/Wikipedia:Contents/Portals
• Github's List of Awesome: https://github.com/topics/awesome
• Wikipedia's List of list of lists: https://en.wikipedia.org/wiki/List_of_lists_of_lists
• Wikipedia Internet Forums List: https://en.wikipedia.org/wiki/List_of_Internet_forums

What Internet Portals do you know of that you would like to share?

Search engines have been dropping in quality significantly within the past decade, and especially within this past year. The noise to signal ratio has been frankly painful.

Can you please share some resources you use when trying to find answers to technical questions?

For example, STEM, academia, engineering, programming, etc.

What social media platforms do you use and want to recommend to others? Front ends could also be a suggestion, along with lists of great communities.

For example: https://sub.rehab/

Which is a collection of communities from different platforms.

The quality of search engines has gone down so much for technical questions.

I'm looking for a way to index sites like stack exchanges, reddit, quora, and research papers. Would this be possible to do this locally with metadata?

Leaderboard scores often can be a bit misleading since there are other factors to consider.

• Censorship: Is the model censored?
• Verbosity: How concise is the output?
• Intelligence: Does the model know what it is talking about?
• Hallucination: How much does the model makes up facts?
• Domain Knowledge: What specialization a model has.
• Size: Best models for 70b, 30b, 7b respectively.

And much more! What models do you use and would recommend to everyone?

The model that has caught my attention the most personally is the original 65b Llama. It seems genuine and truly has a personality. Everyone should chat with the original non-fine tuned version if they can get a chance. It's an experience that is quite unique within the sea of "As an AI language model" openai tunes.

SEO has made it incredibly hard to find answers without getting spammed by news and blog sites. Places like ask Lemmy help democratize answers through upvotes and downvotes so the quality is higher.

Do you know of any hidden gems for search engines or Q&A sites that contain highly relevant answers without much noise?

Feel free to list a few video games from different genres. Best is definitely subjective and I'm sure there are many "Best" games for various categories.

Half Life: Alyx for example is widely considered the "Best" VR game. Many would agree it's the best Action VR game, but it wouldn't be the "Best" for puzzles.

To make it easier I'll list the types of Genres for Video Games from Wikipedia. Please do give suggestions for some of the highest quality games you've played from various categories:

• Action: Platform games, shooter, fighting, survival, etc
• Action-Adventure: Survival horror
• Adventure: Interactive, real time, 3d, text adventures, etc
• Puzzle: Exploration, trial and error, breakout, logical games, etc
• Role-playing: Action RPG, MMORPG, tactical, sandbox, etc
• Simulation: Management, life simulation, vehicle simulation, etc
• Strategy: Real time, turn based, wargame, grand strategy, etc
• Sports: Racing, competitive, sports games, etc
• MMO: Massively multiplayer online game
• Openworld: Sandbox, creative, open world, etc

Note: Non-exhaustive category list. There are more such as card games, board games, etc. Please check the wiki link above for more categories to get ideas for the "best" games.

I personally would recommend Subnautica (Open World), Half Life: Alyx (VR Action-Adventure), The Witcher 3 (Role-playing), Black Mesa (Action), Titanfall 2 (Action), Portal 2 (Puzzle), Battlebit (MMO/Action), and Half Life 3 (Fictional Game).

As an alternative if you have suggestions for documentary sources please do share them.

Mine would be United States of Secrets by PBS Frontline.

LEMMiNO is also great! One of the best documentary makers ever!

As an alternative if you know any good list of RSS feeds please do share them!

I'll start with one of the most useful singular list of lists on the internet.

https://github.com/topics/awesome

"An awesome list is a list of awesome things curated by the community. There are awesome lists about everything from CLI applications to fantasy books. The main repository serves as a curated list of awesome lists."

Just about anything you can think of is within this list. Enjoy!

PS: Thank you mods for your work moderating submissions. The quality and relevance of posts here is refreshing. This has to be my favorite community on Lemmy.