README

AI Notes

notes on AI state of the art, with a focus on generative and large language models. These are the "raw materials" for the https://lspace.swyx.io/ newsletter.

 This repo used to be called https://github.com/sw-yx/prompt-eng, but was renamed because Prompt Engineering is Overhyped. This is now an AI Engineering notes repo.

This Readme is just the high level overview of the space; you should see the most updates in the OTHER markdown files in this repo:

- TEXT.md - text generation, mostly with GPT-4
	- TEXT_CHAT.md - information on ChatGPT and competitors, as well as derivative products
	- TEXT_SEARCH.md - information on GPT-4 enabled semantic search and other info
	- TEXT_PROMPTS.md - a small swipe file of good GPT3 prompts
- INFRA.md - raw notes on AI Infrastructure, Hardware and Scaling
- AUDIO.md - tracking audio/music/voice transcription + generation
- CODE.md - codegen models, like Copilot
- IMAGE_GEN.md - the most developed file, with the heaviest emphasis notes on Stable Diffusion, and some on midjourney and dalle.
	- IMAGE_PROMPTS.md - a small swipe file of good image prompts
- Resources: standing, cleaned up resources that are meant to be permalinked to
- stub notes - very small/lightweight proto pages of future coverage areas
		  - AGENTS.md - tracking "agentic AI"
- blog ideas- potential blog post ideas derived from these notes bc




Table of Contents

- Motivational Use Cases
- Top AI Reads
- Communities
- People
- Misc
- Quotes, Reality & Demotivation
- Legal, Ethics, and Privacy




 Motivational Use Cases

- images
  - https://mpost.io/best-100-stable-diffusion-prompts-the-most-beautiful-ai-text-to-image-prompts
  - 3D MRI synthetic brain images - positive reception from neuroimaging statistician
  - multiplayer stable diffusion
- video
  - img2img of famous movie scenes (lalaland)
    - img2img transforming actor with ebsynth + koe_recast
    - how ebsynth works https://twitter.com/TomLikesRobots/status/1612047103806545923?s=20
  - virtual fashion (karenxcheng)
  - seamless tiling images
  - evolution of scenes (xander)
  - outpainting https://twitter.com/orbamsterdam/status/1568200010747068417?s=21&t=rliacnWOIjJMiS37s8qCCw
  - webUI img2img collaboration https://twitter.com/_akhaliq/status/1563582621757898752
  - image to video with rotation https://twitter.com/TomLikesRobots/status/1571096804539912192
  - "prompt paint" https://twitter.com/1littlecoder/status/1572573152974372864
  - audio2video animation of your face https://twitter.com/siavashg/status/1597588865665363969
  - physical toys to 3d model + animation https://twitter.com/sergeyglkn/status/1587430510988611584
  - music videos 
    - video killed the radio star, colab This uses OpenAI's Whisper speech-to-text, allowing you to take a YouTube video & create a Stable Diffusion animation prompted by the lyrics in the YouTube video
    - Stable Diffusion Videos generates videos by interpolating between prompts and audio
  - direct text2video project
    - https: