companyagencywithin logo

AI Engineer at agencywithin | Long Island City

agencywithinLong Island City, New York
On-site Full-time $145.1K/yr - $296.1K/yr

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Experience

Qualifications

Requirements: Proficient programming skills in Python with substantial experience in developing production systems. Experience in building applications powered by LLM APIs (OpenAI, Anthropic, etc.).

About the job

About the Role We are on the lookout for a talented AI Engineer to become a vital part of our expanding team, playing a pivotal role in the development and enhancement of our internal AI-powered agent platform utilized throughout the organization.

In this position, you will be responsible for the design, development, and refinement of AI-driven applications that integrate large language models (LLMs) with internal systems, SQL databases, advertising APIs (such as Google Ads and Meta), and dynamic code execution environments. Your contributions will be essential in enhancing reliability, orchestrating context, elevating evaluation maturity, and broadening Rai’s capabilities to encompass document and workflow automation.

Your work will substantially impact 200-500 employees and potentially our clients, positioning AI as a key productivity enhancer within the organization.

Key Responsibilities:

  • LLM Application Development: Design, build, and maintain AI-powered applications utilizing LLM APIs, tool integration, and structured outputs.
  • Agent & Tool Orchestration: Develop and enhance agent architectures by integrating tools like SQL execution, Python coding, and marketing platform APIs through MCP-style integrations.
  • Context & Memory Management: Design and refine multi-turn context management, session memory strategies, and prompt designs to enhance response reliability and mitigate hallucinations.
  • Reliability & Guardrails: Implement safeguards for tool execution, SQL queries, and code execution, along with improving retry logic, structured validation, and hallucination mitigation techniques.
  • Evaluation & Quality Assurance: Contribute to the creation of structured evaluation frameworks for LLM-powered systems, encompassing multi-turn testing, regression testing, and task-based success metrics.
  • Product Expansion: Assist in the expansion of Rai into document generation, tables, slide decks, and potential integrations with Google Workspace.
  • Collaboration: Partner closely with Machine Learning Engineers, Product Managers, and Full-Stack Engineers to ensure robust, maintainable, and business-aligned AI systems.
  • Continuous Innovation: Remain up-to-date with advancements in LLM systems, agent architectures, and applied AI tools to consistently enhance Rai’s functionalities.

About agencywithin

Agencywithin is a forward-thinking organization committed to leveraging artificial intelligence to drive innovation and efficiency across various sectors. We prioritize a collaborative culture where creativity and technology converge to redefine productivity and deliver exceptional value to our clients.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.