About the job
About Klue
Klue builds tools for competitive intelligence. The team focuses on helping organizations turn information into actionable insights.
Role Overview: AI Software Engineer (Toronto, Ontario)
Klue is growing its Engineering team in Toronto. The AI Software Engineer will focus on developing and refining LLM-powered agents that support reasoning, planning, and workflow automation. This role centers on practical applications of large language models as Klue evolves its insight generation systems. Candidates with strong backend and machine learning backgrounds will find opportunities to work hands-on with modern AI systems.
Key Responsibilities
- Design retrieval-augmented generation (RAG) systems to improve query understanding, document retrieval, and response synthesis using agentic workflows.
- Build and optimize retrieval pipelines with approaches like BM25, dense retrieval, hybrid retrieval, and re-ranking.
- Create evaluation frameworks for retrieval and generation, focusing on offline metrics such as recall, MRR, nDCG, and human-in-the-loop assessments.
- Experiment with query rewriting, expansion, and classification techniques to improve retrieval relevance.
- Work closely with Product teams to launch machine learning-powered search agents in production environments.
- Monitor, debug, and optimize latency, accuracy, and scalability for retrieval and generation components.
- Help design and implement data pipelines for training retrieval and ranking models, including dataset curation, augmentation, and labeling workflows.
- Keep up with new developments in LLMs, retrieval strategies, and agent architectures, and assess their fit for Klue’s systems.
What Klue Looks For
- Proven experience in software engineering.
- Familiarity with information retrieval systems, search relevance, and ranking models.
- Strong foundation in machine learning and backend technologies.
- Ability to collaborate well within a team setting.

