Mediux Poster Scraper

This script automates the process of scraping movie and TV show poster data from the Mediux website using IMDb IDs to find corresponding TMDB IDs. It logs in to Mediux, fetches YAML data containing poster URLs, and extracts unique set URLs to a separate file.

Features

• Automatic login to Mediux.
• Data scraping from the Mediux website based on TMDB IDs retrieved via IMDb IDs.
• Caching to avoid redundant API calls.
• Extracts and saves unique Mediux set URLs to a text file.
• Handles early termination and ensures all processed data is saved.
• Outputs files for kometa and plex-poster-set-helper
  • You can use the ppsh-bulk.txt content together with bbrown430 script plex-poster-set-helper to automatically download the posters to your plex library.
  • Or, you can use the *_data.txt content together with the kometa script to automatically download the posters to your plex library, if you are interested check this kometa wiki page for more information.

Requirements

• Python 3.x

Follow the Recommended naming scheme from TRaSH Guides, use the following naming scheme for your folders:

• Movies
• TV Shows

By default, it will only process the folders with Plex naming scheme (open a feature request if you wish to add a new type).

Installation

1. Clone the repository:

   git clone https://github.com/zhyph/scrape-mediux.git
   cd scrape-mediux

2. Install the required Python packages:

   python -m venv venv
   source venv/bin/activate  # On Windows use `venv\Scripts\activate`
   pip install -r requirements.txt

Configuration

Create a config.json file in the root directory of the project. You can use the config.example.json as a template. The configuration file should include the following fields:

{
  "root_folder": "/path/to/root_folder",
  "api_key": "your_tmdb_api_key", // THIS NEEDS TO BE YOUR "API Read Access Token" FROM https://www.themoviedb.org/settings/api
  "username": "your_mediux_username",
  "password": "your_mediux_password",
  "nickname": "your_mediux_nickname",
  "folders": ["folder1", "folder2"], // USED TO SINGLE OUT FOLDERS
  "headless": true, // ONLY DISABLE THIS TO DEBUG, WHEN USING AVOID MINIMIZING/CLOSING THE BROWSER, OTHERWISE KEEP THIS TRUE
  "sonarr_endpoint": "your_sonarr_endpoint",
  "sonarr_api_key": "your_sonarr_api_key",
  "output_dir": "/path/to/output_dir",
  "profile_path": "/path/to/chrome_profile", // CAN BE OMITTED, WILL USE THE DEFAULT BROWSER PROFILE
  "cron": "cron_expression", // CAN BE OMITTED
  "process_all": false, // USE IF YOU WANT TO PROCESS ALL ITEMS, IGNORING PREVIOUSLY PROCESSED/CACHED ITEMS
  "TZ": "your_timezone", // CAN BE PASSED AS ENV VARIABLE, MOSTLY USED FOR CRON
  "chromedriver_path": "/path/to/chromedriver" // CAN BE OMITTED, WILL USE webdriver-manager INSTEAD
}

Usage

Run the script using the following command:

python main.py --config_path /path/to/config

Command-line Arguments (Optional)

When running the script, you can ignore all the arguments, the only argument that may be used is --config_path, which is the path to the configuration file. The script will look for a config.json file in the specified directory.

All arguments are optional, and if not provided, the script will use the default values from the config.json file.

If any arguments are provided, they will override the corresponding values in the config.json file.

• --config_path: Directory to the configuration file, defaults to /config.
• --root_folder: Root folder containing subfolders with IMDb IDs.
• --api_key: TMDB API Read Access Token (not API Key).
• --username: Mediux username.
• --password: Mediux password.
• --nickname: Mediux nickname.
• --profile_path: Path to Chrome user profile.
• --sonarr_api_key: Sonarr API key.
• --sonarr_endpoint: Sonarr API endpoint.
• --folders: Specific folders to search for IMDb IDs (optional).
• --headless: Run Selenium in headless mode.
• --cron: Cron expression for scheduling the script.
• --output_dir: Directory to copy the output files to.
• --process_all: Process all items regardless of whether they have been processed before.
• --chromedriver_path: Path to the ChromeDriver executable.

License

none :D