Apply for job

Lead Web Scraper

Our client in NYC, a premier global asset management firm is looking for a Lead Web Scraper to join their growing team focused on advanced data analytics. If you are looking to work in a highly collaborative environment that values the opinions of all this could be an ideal role for you. The web has enabled us to have access to endless data points that could have a direct correlation to market trends. Working closely with the compliance team you will own the process of scraping the web for this data, ensuring data accuracy, while always learning new and innovative practices.


  • Experience running large scale web scrapes
  • Ability to lead a small team and own projects
  • Strong Python skills
  • Understanding of Linux/UNIX, HTTP, HTML, Javascript and Networking
  • Experience with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, pandas, mapreduce, SQL, BeautifulSoup, etc).
  • Experience with system monitoring tools
  • Experience with version control, open source practices, and code review
  • Experience with applications designed to display archived web content
  • Excellent communication skills (written and verbal)
  • Bachelor's Degree in Computer Science or a related field or the equivalent demonstrated experience
  • 4+ years experience 

Job ID: 4070

  • Accepted file types: docx, doc, pdf, rtf, wps, txt, html.