Skip to content

Commit b3aa03e

Browse files
authored
Merge pull request #884 from ScrapeGraphAI/829-languagecountry-selection
Merge pull request #883 from ScrapeGraphAI/main
2 parents 3108793 + 37c07c8 commit b3aa03e

File tree

145 files changed

+1006
-706
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

145 files changed

+1006
-706
lines changed

.github/FUNDING.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,4 +12,4 @@ lfx_crowdfunding: # Replace with a single LFX Crowdfunding project-name e.g., cl
1212
polar: # Replace with a single Polar username
1313
buy_me_a_coffee: # Replace with a single Buy Me a Coffee username
1414
thanks_dev: # Replace with a single thanks.dev username
15-
custom:
15+
custom:

.github/ISSUE_TEMPLATE/custom.md

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,5 +6,3 @@ labels: ''
66
assignees: ''
77

88
---
9-
10-

.github/workflows/release.yml

Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -19,21 +19,21 @@ jobs:
1919
uses: actions/setup-python@v5
2020
with:
2121
python-version: '3.10'
22-
22+
2323
- name: Install uv
2424
uses: astral-sh/setup-uv@v3
25-
25+
2626
- name: Install Node Env
2727
uses: actions/setup-node@v4
2828
with:
2929
node-version: 20
30-
30+
3131
- name: Checkout
3232
uses: actions/checkout@v4.1.1
3333
with:
3434
fetch-depth: 0
3535
persist-credentials: false
36-
36+
3737
- name: Build and validate package
3838
run: |
3939
uv venv
@@ -44,10 +44,10 @@ jobs:
4444
uv build
4545
uv pip install --upgrade pkginfo==1.12.0 twine==6.0.1 # Upgrade pkginfo and install twine
4646
python -m twine check dist/*
47-
47+
4848
- name: Debug Dist Directory
4949
run: ls -al dist
50-
50+
5151
- name: Cache build
5252
uses: actions/cache@v3
5353
with:
@@ -59,7 +59,7 @@ jobs:
5959
runs-on: ubuntu-latest
6060
needs: build
6161
environment: development
62-
if: >
62+
if: >
6363
github.event_name == 'push' && (github.ref == 'refs/heads/main' || github.ref == 'refs/heads/pre/beta') ||
6464
(github.event_name == 'pull_request' && github.event.action == 'closed' && github.event.pull_request.merged &&
6565
(github.event.pull_request.base.ref == 'main' || github.event.pull_request.base.ref == 'pre/beta'))
@@ -74,23 +74,23 @@ jobs:
7474
with:
7575
fetch-depth: 0
7676
persist-credentials: false
77-
77+
7878
- name: Restore build artifacts
7979
uses: actions/cache@v3
8080
with:
8181
path: ./dist
8282
key: ${{ runner.os }}-build-${{ github.sha }}
83-
83+
8484
- name: Semantic Release
8585
uses: cycjimmy/semantic-release-action@v4.1.0
8686
with:
8787
semantic_version: 23
8888
extra_plugins: |
8989
semantic-release-pypi@3
90-
@semantic-release/git
91-
@semantic-release/commit-analyzer@12
92-
@semantic-release/release-notes-generator@13
93-
@semantic-release/github@10
90+
@semantic-release/git
91+
@semantic-release/commit-analyzer@12
92+
@semantic-release/release-notes-generator@13
93+
@semantic-release/github@10
9494
@semantic-release/changelog@6
9595
conventional-changelog-conventionalcommits@7
9696
env:

.readthedocs.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,4 @@
1+
12
# Read the Docs configuration file for Sphinx projects
23
# See https://docs.readthedocs.io/en/stable/config-file/v2.html for details
34

@@ -32,4 +33,4 @@ sphinx:
3233
# See https://docs.readthedocs.io/en/stable/guides/reproducible-builds.html
3334
# python:
3435
# install:
35-
# - requirements: docs/requirements.txt
36+
# - requirements: docs/requirements.txt

.releaserc.yml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -53,4 +53,3 @@ branches:
5353
channel: "dev"
5454
prerelease: "beta"
5555
debug: true
56-

Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,4 +6,4 @@ RUN pip install --no-cache-dir scrapegraphai
66
RUN pip install --no-cache-dir scrapegraphai[burr]
77

88
RUN python3 -m playwright install-deps
9-
RUN python3 -m playwright install
9+
RUN python3 -m playwright install

LICENSE

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,4 +4,4 @@ Permission is hereby granted, free of charge, to any person obtaining a copy of
44

55
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
66

7-
THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
7+
THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -182,7 +182,7 @@ The Official API Documentation can be found [here](https://docs.scrapegraphai.co
182182
</a>
183183
</div>
184184

185-
## 📈 Telemetry
185+
## 📈 Telemetry
186186
We collect anonymous usage metrics to enhance our package's quality and user experience. The data helps us prioritize improvements and ensure compatibility. If you wish to opt-out, set the environment variable SCRAPEGRAPHAI_TELEMETRY_ENABLED=false. For more information, please refer to the documentation [here](https://scrapegraph-ai.readthedocs.io/en/latest/scrapers/telemetry.html).
187187

188188

SECURITY.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,4 +3,3 @@
33
## Reporting a Vulnerability
44

55
For reporting a vulnerability contact directly mvincig11@gmail.com
6-

docs/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,7 @@ markmap:
5555
- Use Selenium or Playwright to take screenshots
5656
- Use LLM to asses if it is a block-like page, paragraph-like page, etc.
5757
- [Issue #88](https://github.com/VinciGit00/Scrapegraph-ai/issues/88)
58-
58+
5959
## **Long-Term Goals**
6060

6161
- Automatic generation of scraping pipelines from a given prompt

0 commit comments

Comments
 (0)