About the job
About Klue
Klue builds competitive intelligence solutions for businesses. The Toronto-based engineering team is growing and looking for a Senior Software Engineer, AI, to help shape the next generation of LLM-powered agents and search systems.
Role Overview
This position focuses on designing and optimizing backend systems that support advanced agentic workflows. The work centers on retrieval-augmented generation (RAG), dense retrieval, query understanding, and agentic reasoning, all aimed at delivering fast, accurate, and reliable search experiences for Klue's clients.
What You Will Do
- Develop and deploy backend systems for agentic workflows. This includes building retrieval pipelines, orchestration layers, and multi-step agent architectures that turn large volumes of competitive data, such as news, press releases, web updates, Slack, email, reviews, and CRM information, into actionable intelligence.
- Lead large-scale evaluation of agentic systems. Create and maintain evaluation frameworks (automated, offline, and human-in-the-loop) to measure relevance, quality, latency, and task success. Define success metrics and build infrastructure for continuous measurement.
- Design and refine retrieval and ranking systems. Work across hybrid retrieval, re-ranking, query rewriting, and post-retrieval synthesis. Balance trade-offs between BM25, dense retrieval, and hybrid methods to ensure agents deliver timely, relevant information.
- Enhance LLM-powered workflows. Improve prompt design, retrieval strategies, caching, and latency to make agent responses faster, more accurate, and reliable in production.
- Prioritize customer-centric development. Connect technical decisions to customer outcomes. Use insights from customer interactions to guide feature prioritization and improvements. Adopt an iterative approach, measure impact, and adjust as needed.
Location
This role is based in Toronto, Ontario.
Learn More
For more about Klue, visit klue.com.

