Pinned to Ideas

• 13 You must be logged in to vote

  💡

  GPU optimization across different cards

  performance Speed related topics hardware Hardware related

  JohannesGaessler started May 13, 2023 in Ideas

  16

Discussions

• 2 You must be logged in to vote

  💡

  Using both Qwen Instruct + Qwen infill via LoRA

  ngxson started Dec 13, 2024 in Ideas

  

  

  9
• 1 You must be logged in to vote

  💡

  Sublime Text Plugin

  jorgegarciadev started Mar 9, 2025 in Ideas

  

  

  2
• 2 You must be logged in to vote

  💡

  Request: a build option to disable the web UI embedded into the llama-server executable

  SamuelTallet started Dec 26, 2024 in Ideas

  

  

  

  

  2
• 1 You must be logged in to vote

  💡

  Include models/templates/*.jinja files in the Docker image to make tool calling easier

  edmcman started Mar 6, 2025 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  16KB Memory Paging

  danemadsen started Mar 4, 2025 in Ideas

  

  

  0
• 3 You must be logged in to vote

  💡

  StyleTTS2 - Text to speech comparable to Eleven Labs quality.

  logikstate started Nov 19, 2023 in Ideas

  

  

  

  

  12
• 1 You must be logged in to vote

  💡

  AI-assisted programming in llama.cpp relative dev activity with the help from the powerful and incredible Grok3

  jeffzhou2000 started Mar 2, 2025 in Ideas

  

  

  0
• 44 You must be logged in to vote

  💡

  Neural Engine Support

  BrianSemiglia started Mar 20, 2023 in Ideas

  

  

  

  

  37
• 1 You must be logged in to vote

  💡

  Quiero aprender c++

  Yohainer started Feb 14, 2025 in Ideas · Closed

  

  

  1
• 2 You must be logged in to vote

  💡

  Force All Computations to Run on GPU during Partial Offloading

  TheAiSandbox started Jan 27, 2025 in Ideas

  

  

  2
• 1 You must be logged in to vote

  💡

  speculative decoding by algorithmic repetition detection

  Bainainai started Feb 25, 2025 in Ideas

  

  

  2
• 4 You must be logged in to vote

  💡

  GGUF Support for Latent Reasoning Models

  Helldez started Feb 17, 2025 in Ideas

  

  

  

  

  2
• 1 You must be logged in to vote

  💡

  Does the iqk_mul_mat.cpp support 1.58-bit quantization model?

  godrosev started Feb 19, 2025 in Ideas · Closed

  

  

  0
• 9 You must be logged in to vote

  💡

  Proposal: Support for InternVLChatModel in llama.cpp

  manwallet started Feb 9, 2025 in Ideas

  

  

  1
• 7 You must be logged in to vote

  💡

  Multiple GPU Support

  ThioJoe started May 31, 2023 in Ideas

  

  

  

  

  3
• 3 You must be logged in to vote

  💡

  Feature Request: Integrate HiP Attention for Extended Context Length

  MubarakHAlketbi started Feb 16, 2025 in Ideas

  

  

  0
• 6 You must be logged in to vote

  💡

  Using LQER to improve low-bit quants

  compilade started Aug 2, 2024 in Ideas

  

  

  

  

  14
• 2 You must be logged in to vote

  💡

  Throttling GPU usage

  wbruna started Feb 10, 2025 in Ideas

  

  

  1
• 2 You must be logged in to vote

  💡

  llama.server: is it possible to add search engine binding with LLAM ?

  simonchen started Feb 11, 2025 in Ideas

  

  

  0
• 10 You must be logged in to vote

  💡

  Feature Request: Universal Assisted Generation (Speculative Decoding with any smaller model)

  Dango233 started Feb 9, 2025 in Ideas

  

  

  0
• 2 You must be logged in to vote

  💡

  Feature request for GGUF: store offset to tensor_data in the header

  certik started Feb 7, 2025 in Ideas

  

  

  

  

  3
• 1 You must be logged in to vote

  💡

  Suggest deprecation of "summary" tag in README / markdown.

  ghchris2021 started Dec 29, 2024 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  Model Card Metadata generation from GGUF KV store

  mofosyne started Nov 15, 2024 in Ideas

  

  

  3
• 2 You must be logged in to vote

  💡

  I found a way to speed up CPU inference using a HNSW index on the output embeddings

  martinloretzzz started Feb 5, 2025 in Ideas

  

  

  2
• 1 You must be logged in to vote

  💡

  Multithreading Offloading (thread on device)

  lexasub started Feb 3, 2025 in Ideas

  

  

  2