This tool lets you download ebooks and videos from packtpub.com even if you don't have a full paid subscription.

Last update: Dec 4, 2022

Overview

Packtpub Scrapper

TL;DR

This tool lets you download ebooks and videos from https://www.packtpub.com/ even if you don't have a full paid subscription.

System Requirement

Docker
Yeh That's all you need 😂

Steps to run

Get a trial account at https://www.packtpub.com/
It requires a simple visa or a mastercard, and 1 USD will be charged and refunded in a day.
Clone this repo locally.
Create a .env file which contains the following variables.
- user
- pass
- bookid
- TOKEN (optional)

A sample env file looks like

[email protected]
pass=/i6X#G345g@Ji5
bookid=9781789132779
TOKEN="Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJ1c2VySWQ..

bookid can be found from the URL such as :
https://www.packtpub.com/product/aws-security-cookbook/9781838826253
Run docker-compose build
Run docker-compose up
Now sit back a grab a cup of Chai ☕

Technical Details

System Requirement for Development

Java 11
Intellij IDEA (or any idea with awesome Kotlin Support)
Webstorm (or any idea with awesome Nodejs support)
Nodejs
Docker

Dependencies

JVM
- Jetbrains Exposed for easily handling sql Queries
- Sqlite an embedded db
- Ktor-client for making network requests
- Gson for Json parsing
Nodejs
- epub-gen
- Express

You might also like...

Android Asynchronous Networking and Image Loading

Android Asynchronous Networking and Image Loading Download Maven Git Features Kotlin coroutine/suspend support Asynchronously download: Images into Im

6.3k Dec 27, 2022

Square’s meticulous HTTP client for the JVM, Android, and GraalVM.

OkHttp See the project website for documentation and APIs. HTTP is the way modern applications network. It’s how we exchange data & media. Doing HTTP

43.4k Jan 5, 2023

A type-safe HTTP client for Android and the JVM

Retrofit A type-safe HTTP client for Android and Java. For more information please see the website. Download Download the latest JAR or grab from Mave

41k Jan 5, 2023

Repo of the Open Source Android library : RoboSpice. RoboSpice is a modular android library that makes writing asynchronous long running tasks easy. It is specialized in network requests, supports caching and offers REST requests out-of-the box using extension modules.

Overview We froze RS last week, the library is not maintained anymore. Personnally, I now always use a mix of retrofit and Rx instead, RS has sailed a

3k Dec 30, 2022

Easily upload files (Multipart/Binary/FTP out of the box) in the background with progress notification. Support for persistent upload requests, customizations and custom plugins.

ℹ️ 🆕 Get started with 4.x 👉 Try it out Get the demo APK Still using 3.x ? It's not maintained or supported. You may have security issues and problem

2.7k Jan 3, 2023

Comments

Exception in thread "main" java.lang.UnsupportedOperationException: JsonObject

Hey, first of all this software is a great Idea, but i somehow have issues using it.

When i follow the instructions and run the container i get the following error, see console output:

[...] packtpubscrapper-scrapper-1 | Starting loading Other Books You May Enjoy 17 packtpubscrapper-scrapper-1 | Starting loading Index 18 packtpubscrapper-scrapper-1 | Exception in thread "main" java.lang.UnsupportedOperationException: JsonObject packtpubscrapper-scrapper-1 | at com.google.gson.JsonElement.getAsString(JsonElement.java:179) packtpubscrapper-scrapper-1 | at Scrapper$loadBookPageContent$1.invokeSuspend(Scrapper.kt:115) packtpubscrapper-scrapper-1 | at kotlin.coroutines.jvm.internal.BaseContinuationImpl.resumeWith(ContinuationImpl.kt:33) packtpubscrapper-scrapper-1 | at kotlinx.coroutines.DispatchedTask.run(DispatchedTask.kt:106) packtpubscrapper-scrapper-1 | at kotlinx.coroutines.EventLoopImplBase.processNextEvent(EventLoop.common.kt:279) packtpubscrapper-scrapper-1 | at kotlinx.coroutines.BlockingCoroutine.joinBlocking(Builders.kt:85) packtpubscrapper-scrapper-1 | at kotlinx.coroutines.BuildersKt__BuildersKt.runBlocking(Builders.kt:59) packtpubscrapper-scrapper-1 | at kotlinx.coroutines.BuildersKt.runBlocking(Unknown Source) packtpubscrapper-scrapper-1 | at kotlinx.coroutines.BuildersKt__BuildersKt.runBlocking$default(Builders.kt:38) packtpubscrapper-scrapper-1 | at kotlinx.coroutines.BuildersKt.runBlocking$default(Unknown Source) packtpubscrapper-scrapper-1 | at Scrapper.loadBookPageContent(Scrapper.kt:92) packtpubscrapper-scrapper-1 | at Scrapper.loadContent(Scrapper.kt:48) packtpubscrapper-scrapper-1 | at Scrapper.loadChapterSequential(Scrapper.kt:221) packtpubscrapper-scrapper-1 | at Scrapper.access$loadChapterSequential(Scrapper.kt:24) packtpubscrapper-scrapper-1 | at Scrapper$main$1$1$1.invokeSuspend(Scrapper.kt:200) packtpubscrapper-scrapper-1 | at kotlin.coroutines.jvm.internal.BaseContinuationImpl.resumeWith(ContinuationImpl.kt:33) packtpubscrapper-scrapper-1 | at kotlinx.coroutines.DispatchedTask.run(DispatchedTask.kt:106) packtpubscrapper-scrapper-1 | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) packtpubscrapper-scrapper-1 | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) packtpubscrapper-scrapper-1 | at java.base/java.lang.Thread.run(Unknown Source)

I am using WSL2 to execute docker-compose, but this shouldn't matter as far as i think. Also authentification works, as you can see when it says "Start loading (...)".

Can you might help me? I would also reward your effort with some donation.

opened by fabian-schmitt 3

This tool lets you download ebooks and videos from packtpub.com even if you don't have a full paid subscription.

Related tags

Overview

Packtpub Scrapper

TL;DR

System Requirement

Steps to run

Technical Details

System Requirement for Development

You might also like...

Android Asynchronous Networking and Image Loading

Square’s meticulous HTTP client for the JVM, Android, and GraalVM.

A type-safe HTTP client for Android and the JVM

Repo of the Open Source Android library : RoboSpice. RoboSpice is a modular android library that makes writing asynchronous long running tasks easy. It is specialized in network requests, supports caching and offers REST requests out-of-the box using extension modules.

IceNet - Fast, Simple and Easy Networking for Android

HttpMocker is a simple HTTP mocking library written in Kotlin to quickly and easily handle offline modes in your apps

Asynchronous socket, http(s) (client+server) and websocket library for android. Based on nio, not threads.

Compact and easy to use, 'all-in-one' android network solution

Easily upload files (Multipart/Binary/FTP out of the box) in the background with progress notification. Support for persistent upload requests, customizations and custom plugins.

Comments

Exception in thread "main" java.lang.UnsupportedOperationException: JsonObject

Owner

Meghdut Mandal

Utilizes the Range HTTP header to download a file with multiple connections in parallel, bypassing cheap bandwidth throttling

An App to download a file from Internet by clicking on a custom-built button

A tiny tool for syncing times between a local computer and android devices

LiteHttp is a simple, intelligent and flexible HTTP framework for Android. With LiteHttp you can make HTTP request with only one line of code! It could convert a java model to the parameter and rander the response JSON as a java model intelligently.

Android network client based on Cronet. This library let you easily use QUIC protocol in your Android projects

Monitoring water tanker level using NodeMCU ESP8266 and HC-SR04P Ultrasonic Sensor and broadcasting it using a simple HTTP server inside NodeMCU ESP8266 and show data in an Android App

Pluto is a on-device debugger for Android applications, which helps in inspection of HTTP requests/responses, capture Crashes and ANRs and manipulating application data on-the-go.

A gRPC Kotlin based server and client starter that builds with Gradle and runs on the JVM

A product registration service using the Kotlin language and the Micronaut and Grpc framework

Asynchronous Http and WebSocket Client library for Java