About the job
At HeyMilo, we are revolutionizing the hiring process with our innovative AI interviewers that engage candidates in authentic conversations. Our mission is to empower companies to enhance their recruitment speed and improve hiring decisions through advanced conversational AI technology.
We collaborate closely with our clients to seamlessly integrate AI into their hiring workflows, ensuring that it yields measurable and impactful results.
The Role
We are seeking a proactive Technical Customer Success Manager (AI Tuning) to take charge of the performance and efficacy of our AI agents post-deployment.
This position bridges engineering, product development, and customer success, allowing you to work hand-in-hand with clients to maximize the effectiveness of their AI agents, fostering continuous improvement.
Responsibilities
Engage closely with clients and customer success teams to establish and monitor key success metrics.
Analyze the performance of deployed AI agents and pinpoint areas for enhancement.
Optimize prompts, workflows, and agent behaviors to achieve superior outcomes.
Iterate on agent logic, tool utilization, and context management.
Troubleshoot issues across prompts, integrations, and system functionalities.
Transform real-world applications into actionable product and system enhancements.
Qualifications
Solid technical foundation with programming skills as needed.
Extensive experience in prompt engineering and understanding LLM behavior.
In-depth knowledge of agent systems, including tool invocation, context management, and orchestration.
Frequent user of AI tools such as Cursor, Claude, Codex, etc.
Skilled at debugging complex issues across AI and system layers.
Strong ownership mentality and exceptional communication abilities.
Adaptable to high-pressure situations and tight deadlines.
Focused on achieving outcomes rather than merely completing tasks.
Experience in implementing agent-based workflows or AI agents within enterprise settings is preferred.
Familiarity with programming fundamentals, particularly in Python and JavaScript, is a significant advantage.
Bonus Skills
Experience with conversational AI in various formats, including voice, SMS, or chatbots.

