HubAI Asia

Tag: LLM optimization

  • How Semble Cuts AI Code Search Tokens by 98%

    How Semble Cuts AI Code Search Tokens by 98%

    —

    by

    in

    Grep wastes 98% of your AI’s context window. Every time a coding agent like Claude Code, Cursor, or Codex searches a codebase, it fires off a grep command, finds the matching files, and dumps the entire contents into the LLM prompt. That brute-force approach works — but it’s catastrophically expensive. A new open-source tool called…

  • How Prompt Caching Cuts AI Costs by 90%

    How Prompt Caching Cuts AI Costs by 90%

    —

    by

    in

    The 90% Discount Most API Users Never Claim Anthropic’s cache cuts API costs by 90% — yet most developers sending requests to Claude, GPT, or Gemini have never configured it. Prompt caching, which Anthropic launched in July 2024, reduces input token costs from $3 per million to $0.30 per million for cached portions on Claude…

📺 YouTube📘 Facebook✕