companyiCapital Network logo

Vice President - Python Automation Engineer

iCapital NetworkSalt Lake City, Utah, United States
On-site Full-time $130K/yr - $160K/yr

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

Qualifications Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field, or equivalent professional experience. Over 10 years of experience in Python development, with a significant emphasis on automation and data extraction. Demonstrated expertise in web scraping using tools such as Playwright, Selenium, Scrapy, BeautifulSoup, and Requests. Extensive experience managing multi-step authentication flows, including multi-factor authentication (MFA), CAPTCHA solving, and session or cookie management. Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager. Familiarity with asynchronous programming, headless browsers, and JavaScript-rendered content. Strong understanding of web protocols (i.e., HTTP, HTTPS, cookies, headers), with the ability to reverse-engineer network calls and authentication mechanisms. Comfortable working with APIs, JSON/XML, and data transformation. Experience with CI/CD pipelines, Docker, and infrastructure as code (e.g., CloudFormation, Terraform). Familiarity with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions. Prior experience scraping from secure or enterprise-level applications is a plus.

About the job

About the Role

At iCapital Network, we are seeking a skilled Python Automation Engineer with a proven background in web scraping, automated portal interactions, and cloud-native deployment in AWS. The successful candidate will possess extensive hands-on experience with Playwright for browser automation, adeptly managing multi-factor authentication (MFA) flows, and deploying scalable scraping tasks using AWS Lambda and associated services. Your role will involve architecting and developing robust, secure, and scalable scraping solutions that effectively interact with complex web applications and secure portals.

Responsibilities

  • Collaborate in the design and implementation of sophisticated scraping solutions utilizing Python, Playwright, and AWS services.
  • Automate interactions with JavaScript-dense and authentication-secured websites, effectively handling MFA, CAPTCHAs, and session or token-based login flows.
  • Architect scraping pipelines employing serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.
  • Develop systems capable of scaling to support high volumes of data extraction with fault tolerance, retries, and advanced logging mechanisms.
  • Integrate and manage intricate workflows across multiple portals, APIs, and data sources.
  • Contribute to architectural decisions, tooling, and best practices.

About iCapital Network

iCapital Network is a leading financial technology firm dedicated to democratizing access to alternative investments for financial advisors and their clients. Our innovative platform offers tools and resources that empower wealth management professionals to enhance their client service and investment strategies.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.