About Sublist3r

Sublist3r is a python tool designed to enumerate subdomains of websites using OSINT. It helps penetration testers and bug hunters collect and gather subdomains for the domain they are targeting. Sublist3r enumerates subdomains using many search engines such as Google, Yahoo, Bing, Baidu, and Ask. Sublist3r also enumerates subdomains using Netcraft, Virustotal, ThreatCrowd, DNSdumpster, and ReverseDNS.

subbrute was integrated with Sublist3r to increase the possibility of finding more subdomains using bruteforce with an improved wordlist. The credit goes to TheRook who is the author of subbrute.

此工具主要依赖各个搜索平台的结果，优势在于肯定是历史上他人访问过的目标网址，准确率高；劣势在于无法探测较隐蔽的资产。

Screenshots

Modification

• 根据请求的引擎不同，使用/不使用代理。
• 增加根据初步扫描结果，探测网站直接访问情况的能力，并将结果以ods文件存储。

Installation

git clone https://github.com/aboul3la/Sublist3r.git

Recommended Python Version:

Sublist3r currently supports Python 2 and Python 3.

• The recommended version for Python 2 is 2.7.x
• The recommened version for Python 3 is 3.4.x

Dependencies:

Sublist3r depends on the requests, dnspython, beautifulsoup4, pyexcel_ods and argparse python modules.

These dependencies can be installed using the requirements file:

• Installation on Windows:

c:\python27\python.exe -m pip install -r requirements.txt

• Installation on Linux

sudo pip install -r requirements.txt

Alternatively, each module can be installed independently as shown below.

Requests Module (http://docs.python-requests.org/en/latest/)

• Install for Windows:

c:\python27\python.exe -m pip install requests

• Install for Ubuntu/Debian:

sudo apt-get install python-requests

• Install for Centos/Redhat:

sudo yum install python-requests

• Install using pip on Linux:

sudo pip install requests

dnspython Module (http://www.dnspython.org/)

• Install for Windows:

c:\python27\python.exe -m pip install dnspython

• Install for Ubuntu/Debian:

sudo apt-get install python-dnspython

• Install using pip:

sudo pip install dnspython

argparse Module

• Install for Ubuntu/Debian:

sudo apt-get install python-argparse

• Install for Centos/Redhat:

sudo yum install python-argparse

• Install using pip:

sudo pip install argparse

for coloring in windows install the following libraries

c:\python27\python.exe -m pip install win_unicode_console colorama

Usage

Short Form	Long Form	Description
-d	--domain	Domain name to enumerate subdomains of
-b	--bruteforce	Enable the subbrute bruteforce module
-p	--ports	Scan the found subdomains against specific tcp ports
-v	--verbose	Enable the verbose mode and display results in realtime
-t	--threads	Number of threads to use for subbrute bruteforce
-e	--engines	Specify a comma-separated list of search engines
-o	--output	Save the results to text file
-h	--help	show the help message and exit
-dt	--detect	detect webservers existence by result list
-od	--outods	define ods path to store results with more information

Examples

• To list all the basic options and switches use -h switch:

python sublist3r.py -h

• To enumerate subdomains of specific domain:

python sublist3r.py -d example.com

• To enumerate subdomains of specific domain and show only subdomains which have open ports 80 and 443 ,
• -p port scan use tcp connection to detect port opens or not :

python sublist3r.py -d example.com -p 80,443

• To enumerate subdomains of specific domain and show the results in realtime:

python sublist3r.py -v -d example.com

• To enumerate subdomains and enable the bruteforce module:

python sublist3r.py -b -d example.com

• To enumerate subdomains and use specific engines such Google, Yahoo and Virustotal engines

python sublist3r.py -e google,yahoo,virustotal -d example.com

• To generate an ods file with ip, domains, can be visited without vpn, html title information.

python sublist3r.py -dt results.txt -od inform.ods

Using Sublist3r as a module in your python scripts

Example

import sublist3r 
subdomains = sublist3r.main(domain, no_threads, savefile, ports, silent, verbose, enable_bruteforce, engines)

The main function will return a set of unique subdomains found by Sublist3r

Function Usage:

• domain: The domain you want to enumerate subdomains of.
• savefile: save the output into text file.
• ports: specify a comma-sperated list of the tcp ports to scan.
• silent: set sublist3r to work in silent mode during the execution (helpful when you don't need a lot of noise).
• verbose: display the found subdomains in real time.
• enable_bruteforce: enable the bruteforce module.
• engines: (Optional) to choose specific engines.

Example to enumerate subdomains of Yahoo.com:

import sublist3r 
subdomains = sublist3r.main('yahoo.com', 40, 'yahoo_subdomains.txt', ports= None, silent=False, verbose= False, enable_bruteforce= False, engines=None)

License

Sublist3r is licensed under the GNU GPL license. take a look at the LICENSE for more information.

Credits

• TheRook - The bruteforce module was based on his script subbrute.
• Bitquark - The Subbrute's wordlist was based on his research dnspop.

Thanks

• Special Thanks to Ibrahim Mosaad for his great contributions that helped in improving the tool.

Version

Current version is 1.0