25 Commits

Author SHA1 Message Date
c1f7022d7e increase screenshot height 2025-03-15 22:03:28 +03:00
73fbeaa77a removed waiting for 1st post (on some sites "1 post is fully rendered" != "whole page loaded") 2025-03-12 12:02:44 +03:00
d4150578e1 unit tests... 2025-02-19 15:29:01 +03:00
48e5d7b3a2 block local ips and service worker; util function to resolve arbitrary 'host-like' string, unit testing 2025-02-19 12:41:08 +03:00
cd4b160b4d block local ips and service worker; util function to resolve arbitrary 'host-like' string, unit testing 2025-02-19 12:10:35 +03:00
e13f05ea8a prevent webrtc leak through proxy 2025-02-18 11:59:05 +03:00
6b8952f63f log visit time to "info" instead of "debug" 2025-02-15 11:08:14 +03:00
a3c016fc84 opt-in to "new headless" 2025-02-15 11:05:04 +03:00
400b6ca60d by domain rate limiter 2025-02-14 12:40:53 +03:00
8437f89bfa extractor rewrite (use custom wrappers over playwright locator) 2025-02-09 10:42:42 +03:00
b1d28b62e5 fix: skip posts with empty date 2025-02-02 15:33:49 +03:00
45b86ad5e4 log cookie header 2025-01-31 15:52:04 +03:00
a8144b0914 change timeouts 2025-01-31 15:13:26 +03:00
3e3fad6d52 cookie manager 2025-01-31 15:07:15 +03:00
728792da26 compare revs (for testing)
Support mocking dates

Support mocking dates

Support mocking dates

Support mocking dates
2025-01-27 18:28:07 +03:00
d54e464816 date parsing enhancements 2025-01-26 16:14:45 +03:00
e73515bec3 allow empty description or content 2025-01-25 18:28:19 +03:00
cded4c1b00 cookies fix 2025-01-24 18:17:58 +03:00
5ff8b7e6d0 headers and cookies support 2025-01-23 14:37:50 +03:00
ab4966052b screenshots; some refactoring 2025-01-22 17:15:38 +03:00
6913733ad5 change consumer to durable 2025-01-21 19:44:33 +03:00
97731f4c37 speed up loading by waiting for EITHER locator OR networkIdle 2025-01-21 11:04:36 +03:00
9bfe51f9c8 proxy support; config validation 2025-01-18 12:45:04 +03:00
27e269b76a extractor (refactoring and enhancements) 2025-01-17 13:22:49 +03:00
5416f8bc0a initial commit 2025-01-15 18:46:16 +03:00