Author Topic: Scraping websites of any size  (Read 1596 times)

0 Members and 1 Guest are viewing this topic.

Offline lorienTopic starter

  • Newbie
  • Joined: May 2015
  • Posts: 1
  • Karma: +0/-0
    • View Profile
Scraping websites of any size
« on: May 22, 2015, 10:11:22 AM »

your ads here

Hello. I am experienced web developer (10 years). My area of expertise is web scraping. I have done more than 300 web scraping projects.

My experience:
 * Scraping large websites, millions of pages
 * Using proxy lists to bypass website scraping protection
 * Scraping captcha-protected websites
 * Scraping javascript-driven (AJAX) websites
 * Extracting data from API endpoints
 * Processing XML, JSON, CSV documents
 * Storing and processing data in Redis, MongoDB, MySQL and Postgresql databases
 * Building web interface to control crawlers
 * Building complex systems to process data from multiple sources

Examples of projects I've done: sorry, can't post link to my website :(

I am author of open source web scraping framework (here should be another link =)) I use that framework in most of my web scraping projects.

I'll be happy to work on any interesting project related to web scraping and data processing. Feel free to contact me to discuss your project and get free quote and estimated time to complete the project.

My contacts:
 * email:  support @
 * skype: skype:


BitcoinPeepShow - Access to Adult websites for Bitcoin

Started by bitcoinpeepshow

Replies: 0
Views: 3754
Last post December 01, 2013, 11:52:35 PM
by bitcoinpeepshow
Web Hosting from $1.15/mo - Host Unlimited Websites - Free Domain

Started by ServStrong

Replies: 0
Views: 2095
Last post June 15, 2014, 10:34:41 PM
by ServStrong
Website Automation / Scraping

Started by antfuentes87

Replies: 0
Views: 2073
Last post May 03, 2017, 06:25:21 PM
by antfuentes87
Adult and mainstream websites design ★ Logos ★ Banners ★ Social media graphics

Started by Komissariat

Replies: 0
Views: 4284
Last post October 22, 2017, 10:17:37 AM
by Komissariat
Smart contracts, websites, custom bots

Started by Brendon

Replies: 0
Views: 1227
Last post September 24, 2018, 12:00:25 PM
by Brendon