Skip to content

Conversation

aivus
Copy link
Member

@aivus aivus commented Jul 18, 2025

Problem

All released versions of the website-scraper-puppeteer module adhere to a specific major version of Puppeteer. Puppeteer releases versions quickly, and the current version of the module(v1.1.0) uses puppeteer 20.2.* which is deprecated and unsupported

Solutions

To handle this problem, 2 possible solutions were proposed

Solution 1

Release a new version of website-scraper-puppeteer every time puppeteer is released.

Solution 2

Introduce a separate wrapper module that will cover dependency updates on its own, without requiring releases of this module.

Decision

Solution 2 was chosen to solve the problem.

It's done by introducing the separate wrapper module (@website-scraper/puppeteer-version-wrapper), which automatically releases a new minor version with updated puppeteer dependency after the tests pass.

Details

website-scraper-puppeteer will depend on @website-scraper/puppeteer-version-wrapper@^1.0.

@website-scraper/puppeteer-version-wrapper will automatically check for the new versions of puppeteer using the Dependabot. PR is automatically merged after the tests are green.
Merging to the main will trigger the publishing of the new version of the wrapper module on NPM.
It allows us to be sure that the module works properly with the latest versions of puppeteer

What if tests fail?

In case tests fail and the BC-compatible fix could be implemented, it will be done within 1.x versions of the wrapper module.
In case a BC-compatible fix cannot be released, the next major version of the wrapper module will be released, and the requirement will be bumped in this module.

@aivus aivus marked this pull request as ready for review October 7, 2025 18:59
@aivus aivus requested a review from s0ph1e October 7, 2025 19:01
@aivus aivus enabled auto-merge (squash) October 7, 2025 19:34
@aivus aivus merged commit 827ce11 into master Oct 7, 2025
10 of 11 checks passed
@aivus aivus deleted the add-compatibility-bridge branch October 7, 2025 19:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant