Python Setup & IDE Guide

Short, clear, Pythonfocused.


Requirements

  • Python 3.10+
    Uses pattern matching, modern type hints, async improvements.
python --version

IDE Setup (PyCharm / IntelliJ)

  1. Set interpreter:
    File → Settings → Project → Python Interpreter → Select Python 3.10+

  2. Fix syntax warnings:
    Editor → Inspections → Python → Set language level to 3.10+

  3. Ensure correct SDK:
    Project Structure → Project SDK → Python 3.10+


Installation

# Activate venv
~\venvs\scaev\Scripts\Activate.ps1

# Install deps
pip install -r requirements.txt

# Playwright browsers
playwright install chromium

Database Configuration (PostgreSQL)

The scraper now uses PostgreSQL (no more SQLite files). Configure via DATABASE_URL:

  • Default (baked in): postgresql://auction:heel-goed-wachtwoord@192.168.1.159:5432/auctiondb
  • Override for your environment:
# Windows PowerShell
$env:DATABASE_URL = "postgresql://user:pass@host:5432/dbname"

# Linux/macOS
export DATABASE_URL="postgresql://user:pass@host:5432/dbname"

Packages used:

  • Driver: psycopg[binary]

Nothing is written to local .db files anymore.


Verify

python -c "import sys; print(sys.version)"
python main.py --help

Common fixes:

pip install playwright
playwright install chromium

AutoStart (Monitor)

cd ~/scaev
chmod +x install_service.sh
./install_service.sh

Service features:

  • Autostart
  • Autorestart
  • Logs: ~/scaev/logs/monitor.log
sudo systemctl status scaev-monitor
journalctl -u scaev-monitor -f

Windows (Task Scheduler)

cd C:\vibe\scaev
.\setup_windows_task.ps1

Manage:

Start-ScheduledTask "ScaevAuctionMonitor"

Cron Alternative (Linux)

crontab -e
@reboot cd ~/scaev && python3 src/monitor.py 30 >> logs/monitor.log 2>&1
0 * * * * pgrep -f monitor.py || (cd ~/scaev && python3 src/monitor.py 30 >> logs/monitor.log 2>&1 &)

Status Checks

ps aux | grep monitor.py
tasklist | findstr python

Troubleshooting

  • Wrong interpreter → Set Python 3.10+
  • Multiple monitors running → kill extra processes
  • PostgreSQL connectivity → verify DATABASE_URL, network/firewall, and credentials
  • Service fails → check journalctl -u scaev-monitor

Java Extractor (Short Version)

Prereqs: Java 21, Maven

Install:

mvn clean install
mvn exec:java -Dexec.mainClass=com.microsoft.playwright.CLI -Dexec.args="install"

Run:

mvn exec:java -Dexec.args="--max-visits 3"

Enable native access (IntelliJ → VM Options):

--enable-native-access=ALL-UNNAMED


This file keeps everything compact, Pythonfocused, and ready for onboarding.

Description
No description provided
Readme 579 KiB
Languages
Python 98.4%
Shell 0.9%
Dockerfile 0.7%