Release v1.7.0b

Also:
- Support changes:
    * Drop support for macOS >=10.14, <12
    * Clarify that all Windows versions >= 7 are supported
- Release Notes: Highlight the new major version of the .crystalproj format

Author: davidfstr

README.md

@@ -17,9 +17,9 @@ Additional documentation will be available once Crystal is no longer **in beta**
 Download ⬇︎
 --------
 
-* [macOS 10.14 and later](https://github.com/davidfstr/Crystal-Web-Archiver/releases/download/v1.6.0b/crystal-mac-1.6.0b.dmg)
+* [macOS 12 and later](https://github.com/davidfstr/Crystal-Web-Archiver/releases/download/v1.7.0b/crystal-mac-1.7.0b.dmg)
     * You will need to [right-click or Control-click on the application and select "Open" to open it for the first time](https://github.com/davidfstr/Crystal-Web-Archiver/issues/20).
-* [Windows 7, 8, 10](https://github.com/davidfstr/Crystal-Web-Archiver/releases/download/v1.6.0b/crystal-win-1.6.0b.exe)
+* [Windows 7 and later](https://github.com/davidfstr/Crystal-Web-Archiver/releases/download/v1.7.0b/crystal-win-1.7.0b.exe)
 * Linux
     * Install Python >=3.8,<3.12 and pip from your package manager
         * Ubuntu/Kubuntu 22.04+: `apt-get update; apt-get install -y python3 python3-pip python3-venv`

RELEASE_NOTES.md

@@ -10,7 +10,7 @@ Release Notes ⋮
 [high-priority issues]: https://github.com/davidfstr/Crystal-Web-Archiver/issues?q=is%3Aopen+is%3Aissue+label%3Apriority-high
 [medium-priority issues]: https://github.com/davidfstr/Crystal-Web-Archiver/issues?q=is%3Aopen+is%3Aissue+label%3Apriority-medium
 
-### main
+### v1.7.0b (December 18, 2023)
 
 This release features further improvements to downloading large websites
 (up to 10 million URLs). Projects open in constant time. Memory usage
@@ -19,6 +19,10 @@ while downloading large groups remains constant.
 Additionally .crystalproj documents now have an appropriate icon and can be 
 easily opened by double-clicking that icon on all supported operating systems.
 
+There has also been a major change to the .crystalproj format: Revisions are
+now stored in a hierarchy of directories rather than as a single flat directory.
+Crystal continues to be able to read and write projects of all major versions.
+
 * First-time-run experience improvements
     * App name, logo, and icon fixes
         * macOS: Fix application menu title and title of its menuitems
@@ -39,19 +43,25 @@ easily opened by double-clicking that icon on all supported operating systems.
       are now loaded on demand rather than upfront.
     * Large groups now start downloading faster because member
       download tasks are now created on demand rather than upfront.
-    * .crystalproj format now stores revisions in a hierarchy of nested
-      directories rather than all of them inside a single directory.
-    * .crystalproj format now stores revisions in lexicographic order
-      in the filesystem so that when a project is copied to a new location,
-      the order of revisions on disk is preserved in the new copy.
+    * The .crystalproj format has a new major change:
+        * .crystalproj format now stores revisions in a hierarchy of nested
+          directories rather than all of them inside a single directory,
+          to provide faster performance on filesystems which behave poorly
+          when a single directory has very many files.
+        * .crystalproj format now stores revisions in lexicographic order
+          in the filesystem so that when a project is copied to a new location,
+          the order of revisions on disk is preserved in the new copy.
+        * Projects using this new format have a `major_version` of `2`
+          in the `project_property` table.
     * Projects whose database is on a solid state drive (SSD)
       will use less memory because such projects will now prefer to
       load group members via a database query rather than loading
       *all* project URLs into memory.
 
-* Support improvements
+* Support changes
     * Add Kubuntu as a supported Linux distribution
     * Add KDE as a supported desktop environment, in addition to GNOME
+    * Drop support for macOS 10.14. macOS 12+ remains supported.
 
 * Parsing improvements
     * Can identify `<link rel="preload">` references as embedded.

pyproject.toml

@@ -1,6 +1,6 @@
 [tool.poetry]
 name = "crystal-web"
-version = "1.6.0b"
+version = "1.7.0b"
 description = "Downloads websites for long-term archival."
 authors = ["David Foster <david@dafoster.net>"]
 readme = "README.md"

setup/win-installer.iss

@@ -1,13 +1,13 @@
 [Setup]
 AppName=Crystal Web Archiver
-AppVersion=1.6.0b
+AppVersion=1.7.0b
 AppCopyright=Copyright (C) 2011-2023 David Foster. All Rights Reserved
 DefaultDirName={pf}\Crystal Web Archiver
 DefaultGroupName=Crystal Web Archiver
 UninstallDisplayIcon={app}\Crystal Web Archiver.exe
 Compression=lzma2
 SolidCompression=yes
-OutputBaseFilename=crystal-win-1.6.0b
+OutputBaseFilename=crystal-win-1.7.0b
 OutputDir=dist-win
 DisableProgramGroupPage=yes
 ; Tell Explorer to refresh file extension information after (un)install,
@@ -79,6 +79,7 @@ Source: "dist\_sqlite3.pyd"; DestDir: "{app}"
 Source: "dist\_ssl.pyd"; DestDir: "{app}"
 Source: "dist\_testcapi.pyd"; DestDir: "{app}"
 Source: "dist\_tkinter.pyd"; DestDir: "{app}"
+Source: "dist\_win32sysloader.pyd"; DestDir: "{app}"
 Source: "dist\backports.zoneinfo._czoneinfo.pyd"; DestDir: "{app}"
 Source: "dist\cacert.pem"; DestDir: "{app}"
 Source: "dist\concrt140.dll"; DestDir: "{app}"
@@ -90,6 +91,7 @@ Source: "dist\libopenblas_v0.3.21-gcc_8_3_0.dll"; DestDir: "{app}"
 Source: "dist\libssl-1_1.dll"; DestDir: "{app}"
 Source: "dist\lxml._elementpath.pyd"; DestDir: "{app}"
 Source: "dist\lxml.etree.pyd"; DestDir: "{app}"
+Source: "dist\mfc140u.dll"; DestDir: "{app}"
 Source: "dist\msvcp140_1.dll"; DestDir: "{app}"
 Source: "dist\msvcp140_2.dll"; DestDir: "{app}"
 Source: "dist\msvcp140_atomic_wait.dll"; DestDir: "{app}"
@@ -115,6 +117,8 @@ Source: "dist\numpy.random.bit_generator.pyd"; DestDir: "{app}"
 Source: "dist\numpy.random.mtrand.pyd"; DestDir: "{app}"
 Source: "dist\pyexpat.pyd"; DestDir: "{app}"
 Source: "dist\python38.dll"; DestDir: "{app}"
+Source: "dist\pythoncom38.dll"; DestDir: "{app}"
+Source: "dist\pywintypes38.dll"; DestDir: "{app}"
 Source: "dist\select.pyd"; DestDir: "{app}"
 Source: "dist\sqlite3.dll"; DestDir: "{app}"
 Source: "dist\tcl86t.dll"; DestDir: "{app}"
@@ -124,6 +128,13 @@ Source: "dist\vcamp140.dll"; DestDir: "{app}"
 Source: "dist\vccorlib140.dll"; DestDir: "{app}"
 Source: "dist\vcomp140.dll"; DestDir: "{app}"
 Source: "dist\vcruntime140.dll"; DestDir: "{app}"
+Source: "dist\win32api.pyd"; DestDir: "{app}"
+Source: "dist\win32com.shell.shell.pyd"; DestDir: "{app}"
+Source: "dist\win32evtlog.pyd"; DestDir: "{app}"
+Source: "dist\win32file.pyd"; DestDir: "{app}"
+Source: "dist\win32pdh.pyd"; DestDir: "{app}"
+Source: "dist\win32ui.pyd"; DestDir: "{app}"
+Source: "dist\win32wnet.pyd"; DestDir: "{app}"
 Source: "dist\wx._adv.pyd"; DestDir: "{app}"
 Source: "dist\wx._core.pyd"; DestDir: "{app}"
 Source: "dist\wx._html.pyd"; DestDir: "{app}"

src/crystal/__init__.py

@@ -1,4 +1,4 @@
-__version__ = '1.6.0b'
+__version__ = '1.7.0b'
 
 APP_NAME = 'Crystal Web Archiver'
 APP_AUTHOR = 'DaFoster'