Context Engineering

  • https://huggingface.co/learn/context-course
  • It is about structuring knowledge so an agent can efficiently find what it needs, when it needs it to improve its generated outputs
  • Code agents are only as good as the context you give them

Coding Tools

  • Claude Code by Anthropic
  • Codex by OpenAI
  • GitHub Copilot by Microsoft
  • OpenCode

Context Window Reduction

  • Context Window Reduction is the process of shrinking the amount of information placed in an LLM’s context window, by summarizing, compressing, deduplicating, or filtering content, while preserving the signals needed for the current task

Context Summarization

  • Taking whole context and use LLM to summarize the context
    • Retain task-relevant facts
    • Preserve meaning and key relationships
    • Remove redundancy, low-value detail and noise
  • It is a lossy technique

Context Compaction

  • Transfer context into a DB
    • Have a context ID and summary of different context
    • If needed LLM can load whole context