dockerfiles/selenium/README.md

selenium

Selenium is an umbrella project for a range of tools and libraries that enable and support the automation of web browsers.

Watch this video to get started.

Server

docker-compose.yml

firefox:
  image: selenium/standalone-firefox-debug
  ports:
    - "4444:4444"
    - "5900:5900"
  environment:
    - JAVA_OPTS=-Xmx512m
  restart: always

docker-compose-grid.yml

hub:
  image: selenium/hub
  container_name: hub
  ports:
    - "4444:4444"
  environment:
    - GRID_TIMEOUT=60
    - GRID_BROWSER_TIMEOUT=30
  restart: always

chrome:
  image: selenium/node-chrome
  container_name: chrome
  ports:
    - "5555"
  links:
    - hub
  restart: always

firefox:
  image: selenium/node-firefox
  container_name: firefox
  ports:
    - "5555"
  links:
    - hub
  restart: always

Access grid console at http://127.0.0.1:4444/grid/console

docker-compose-node.yml

firefox:
  image: selenium/node-firefox
  ports:
    - "5555:5555"
    - "5900:5900"
  environment:
    - JAVA_OPTS=-Xmx512m
    - NODE_MAX_INSTANCES=2
    - NODE_MAX_SESSION=2
    - SE_OPTS=-host 5.6.7.8 -port 5555
    - HUB_PORT_4444_TCP_ADDR=1.2.3.4
    - HUB_PORT_4444_TCP_PORT=4444
  restart: always

$ docker-compose up -d

Another way to start selenium server:

$ npm install -g selenium-standalone
$ selenium-standalone install
$ selenium-standalone start

Client

baidu-search.py

from selenium import webdriver
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities
from selenium.webdriver.common.proxy import Proxy, ProxyType
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

proxy = Proxy({
    'proxyType': 'MANUAL',
    'httpProxy': '1.2.3.4:8080',
    'sslProxy': '1.2.3.4:8080',
})

capabilities = DesiredCapabilities.CHROME
proxy.add_to_capabilities(capabilities)

driver = webdriver.Remote(
    command_executor='http://127.0.0.1:4444/wd/hub',
    desired_capabilities=capabilities
)

driver.get('http://www.baidu.com/')
driver.find_element_by_id('kw').send_keys('ip')
driver.find_element_by_id('su').click()

WebDriverWait(driver, 10).until(
    EC.presence_of_element_located((By.CLASS_NAME, 'nums_text'))
)

driver.save_screenshot('baidu.png')
driver.close()

search-baidu.js

var webdriver = require('selenium-webdriver'),
    By = require('selenium-webdriver').By,
    until = require('selenium-webdriver').until,
    fs = require('fs');

webdriver.WebDriver.prototype.saveScreenshot = function(filename) {
    return driver.takeScreenshot().then(function(data) {
        fs.writeFile(filename, data.replace(/^data:image\/png;base64,/,''), 'base64', function(err) {
            if(err) throw err;
        });
    })
};

var driver = new webdriver.Builder()
    .forBrowser('firefox')
    .usingServer('http://127.0.0.1:4444/wd/hub')
    .build();

driver.get('http://www.baidu.com/');
driver.findElement(By.id('kw')).sendKeys('webdriver');
driver.findElement(By.id('su')).click();
driver.wait(until.titleIs('webdriver_百度搜索'), 1000);
driver.saveScreenshot('baidu.png');
driver.quit();

# VNC
$ open vnc://:secret@127.0.0.1:5900
$ open http://127.0.0.1:7900

# PYTHON
$ pip3 install selenium
$ python3 baidu-search.py

# NODEJS
$ npm install -g selenium-webdriver
$ node search-baidu.js