OpenLake/Student_Database_COSA

[FOSSOVERFLOW-25] feat: Automatic Scraping & Parsing of Academic Calendar

Open

#199 ouverte le 3 nov. 2025

Voir sur GitHub
 (1 commentaire) (0 réactions) (0 assignés)JavaScript (56 forks)auto 404
Contributors neededFoss OverFlowenhancementhardhelp wanted

Métriques du dépôt

Stars
 (13 stars)
Métriques de merge PR
 (Métriques PR en attente)

Description

Feature Request: Automatic Scraping & Parsing of Academic Calendar


Problem Statement

Current Issue: The academic calendar is uploaded on the IIT Bhilai website as a PDF/HTML table, and currently admins must manually copy dates into our Calendar component. This is time-consuming, error-prone, and requires updates every semester/year.


Proposed Solution

✅ Automatic Academic Calendar Scraping

✅ Integration with Existing Calendar UI

  • New events should automatically appear in the existing Calendar component with category-appropriate icons and color coding.
  • Admins should have ability to review/edit scraped data before publishing (optional improvement).

Technical Notes

Layer Requirement
Scraper A cron-triggered script
Data Parsing Match patterns like: "holiday", "exam", "commencement", "registration"
Database Add relevant fields to calendar events table
Retry & Fail-Safe If scraping fails, continue using last known data
Optional Cache PDF locally with versioning for historical comparison

Possible Libraries

  • BeautifulSoup4 / lxml (for HTML scraping)
  • PyMuPDF or pdfplumber if format changes back to PDF

Alternatives Considered

  1. Manual Upload of Events ❌ Still requires regular admin effort
  2. Direct API Feed from Institute Website ❌ No such API currently exists

Mockups & Visual Examples

  • Checkout the figma design mockups in README

Guide contributeur