feat: Implement Walmart scraper and integrate with existing architecture

- Added Walmart scraper to scrape product data from Walmart.com, including category pages and product details.
- Introduced a stealth browser module to handle bot protection and improve scraping reliability.
- Created a SQLite database for tracking product history, price changes, stock events, and user favorites.
- Developed a Discord bot for user interaction, allowing location setting and stock checking at local stores.
- Implemented a favorites system to manage priority products and categories with custom notification settings.
- Added news aggregation module to fetch and analyze Pokemon TCG news from various sources.
- Created tools for API discovery and monitoring, including a backend monitor for detecting new products.
- Added unit tests for database operations, product filtering, and API endpoints to ensure functionality.
- Enhanced existing modules with improved error handling and logging for better maintainability.
This commit is contained in:
2026-03-27 23:08:09 -04:00
parent cddae24e34
commit 8d382e723f
64 changed files with 15433 additions and 443 deletions
+14
View File
@@ -242,10 +242,24 @@
<span class="slider"></span>
</label>
</div>
<div class="toggle-row">
<span>Sync to Dashboard</span>
<label class="toggle" for="syncDashboard">
<input type="checkbox" id="syncDashboard" checked>
<span class="slider"></span>
</label>
</div>
</div>
<div class="section">
<label>Dashboard URL</label>
<input type="text" id="dashboardUrl" placeholder="http://localhost:5000">
<small>Local dashboard for viewing data</small>
</div>
<button class="btn-primary" id="saveBtn">Save Settings</button>
<button class="btn-secondary" id="checkNowBtn">Check Now</button>
<button class="btn-secondary" id="syncBtn">Sync to Dashboard</button>
<button class="btn-danger" id="clearBtn">Clear Product History</button>
<div class="saved-msg" id="savedMsg">Settings saved!</div>