opengapps/apkcrawler

Name: apkcrawler

Owner: Open GApps

Description: APK Crawler is a tool to automatically retrieve APKs from various internet sources

Created: 2015-08-05 20:03:25.0

Updated: 2018-05-22 18:36:15.0

Pushed: 2018-05-08 20:08:23.0

Homepage: null

Size: 1191

Language: Python

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

APK Crawler

APK Crawler is a tool to automatically retrieve APKs from various internet sources

License

Take note that APKCrawler's GNU Affero General Public License v3.0 is strict concerning application service providers. If you use apkcrawler for a (web)service you need to open source your changes!

Usage

Fetch all Open GApps supported APKs from a given source

port_sources.sh nosig | ./apkcrawler.py

or

port_sources.sh nosig | ./apkbeastcrawler.py
port_sources.sh nosig | ./apkdlcrawler.py
port_sources.sh nosig | ./apkmirrorcrawler.py
port_sources.sh nosig | ./apkpurecrawler.py
port_sources.sh nosig | ./aptoidecrawler.py
port_sources.sh nosig | ./mobogeniecrawler.py
port_sources.sh nosig | ./playstorecrawler.py
port_sources.sh nosig | ./plazzacrawler.py
port_sources.sh nosig | ./uptodowncrawler.py

Inline

APK Crawlers emits the downloaded filename(s) so it can be used inline with Open GApps' add_sourceapp.sh

d_sourceapp.sh $(./apkcrawler.py        report.txt)

or

d_sourceapp.sh $(./apkbeastcrawler.py   report.txt)
d_sourceapp.sh $(./apkdlcrawler.py      report.txt)
d_sourceapp.sh $(./apkmirrorcrawler.py  report.txt)
d_sourceapp.sh $(./apkpurecrawler.py    report.txt)
d_sourceapp.sh $(./aptoidecrawler.py    report.txt)
d_sourceapp.sh $(./mobogeniecrawler.py  report.txt)
d_sourceapp.sh $(./playstorecrawler.py  report.txt)
d_sourceapp.sh $(./plazzacrawler.py     report.txt)
d_sourceapp.sh $(./uptodowncrawler.py   report.txt)

Supported Sites

• APK Beast
• APK Mirror
• APK Pure
• Aptoide
• APK Downloader
• Google Play Store
• Mobogenie
• Plazza.ir
• UpToDown

Requirements

• python3
• beautifulsoup4
• html5lib
• protobuf >=3
• requests

Installation

You can use mfonville's protobuf PPA for python3-protobuf

 apt install python3-bs4 python3-html5lib python3-protobuf python3-requests python3-tz

or

 install beautifulsoup4 html5lib protobuf requests pytz

Known Issues

• There needs to be a way to grab an older version of an application as the current version (e.g. Current WebView on APK Mirror is the beta version)