FitGirl-Scrap-Web

Fitgirl Scrap Web

FitGirl Web Application with Svelte for Frontend, Rust for Scrapping and Redis for DB

FitGirl-Scrap-Web

Preview

Future addtions

Dev:

  • Pagination(Very bad use of memory for the moment) πŸ“–
  • Search bar πŸ”Ž
  • Use redis cachΓ© for optimize navigation, query's...
  • Pagination
  • Automate Scrapping Process πŸ•·οΈπŸ•ΈοΈ
  • Connection to a VideogameDB API πŸ–₯️ This is for add fuctionality like
    • Advanced Filtering βœ”οΈβœ–οΈ
      • Order, filter, by compression ratio
      • Online, Coop, Single player features
      • Genre
      • Stats(Times Viewed, Downloaded, Game Scores)
    • Like, Dislike πŸ‘
  • Add native comments πŸ’­

Production:

  • Unofficial Fitgirl Repacks API

Build

1. Docker compose (Redis DB)

docker compose up -d

2. Rustcrap(Web Scrapper)

Needs a redis server running Crawls every page of the official website and saves to the redis DB

cd rustcrap/
cargo build
cargo run
  • By the moment it needs to be launched manually

Debugging Web App

Frontend developed with SvelteKit

  • Gets all the data from DedisDB with the package ioredis
cd web/
npm i
npm run dev

⚑⚑ DISCLAIMER⚑⚑

This is for only for educational purposes. :books:

Top categories

Loading Svelte Themes