Sun. 17 November 2024

Fav resources at the moment:

Fav podcasts:

• Sarah Guo is a brilliant person. She has a fund, called Conviction, where with Elad Gil she takes early bets on early stage companies and founders.
  • https://www.youtube.com/@NoPriorsPodcast
• Harry Stebbings, brilliant hustler.
  • https://www.youtube.com/@20VC

Twitter:

• Follow OpenAI / Anthropic folks / smart VC investors. Start by following AI people, then follow who they follow. Sooner than you know, your whole X feed will be highly optimized for AI technical posts.
  • Good place to start: https://x.com/hughbzhang/status/1838288923656941860

Evals:

• Monitor what the guys at Artificial Analysis post / look into
  • https://artificialanalysis.ai/

What I currently think is under-hyped:

Here you go:

• small language models

  • https://arxiv.org/pdf/2410.20011
  • see Arcee, and recent NVIDIA slm

• proper end-to-end rag with gradients flowing back to the representation of the input documents

  • https://medium.com/@researchgraph/rag-2-0-is-coming-9dd3a5b1986a
  • see Contextual AI