> For the complete documentation index, see [llms.txt](https://til.aldrinjenson.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://til.aldrinjenson.com/ai-and-llms.md).

# AI & LLMs

- [Different options for doing LLM inference](https://til.aldrinjenson.com/ai-and-llms/different-options-for-doing-llm-inference.md): Note formatted by Claude after from my voicenote transcription. About different options I've explored for hosting gen-ai models
- [Running parallel Ollama inference](https://til.aldrinjenson.com/ai-and-llms/running-parallel-ollama-inference.md): Easy way to parallely infer with multiple ollama instances all running in the same machine
- [Generate subtitles locally using Whisper](https://til.aldrinjenson.com/ai-and-llms/generate-subtitles-locally-using-whisper.md): Easy script to take in an audio or video file and generate srt files using whisper cpp