List view

add deduplication index to a repeated crawl with same job config

Status: Open.

#696 In webrecorder/browsertrix;

· tuehlarsen opened on Mar 12, 2023

[Feature]: Deduplicate crawls

back endRequires back end dev workRequires back end dev work

feature designThis issue tracks smaller sub issues that compose a featureThis issue tracks smaller sub issues that compose a feature

front endRequires front end dev workRequires front end dev work

ui/uxThis issue requires UI/UX workThis issue requires UI/UX work

Status: Open.

Feature

#2860 In webrecorder/browsertrix;

· SuaYoo opened on Sep 29, 2025

[Task]: Backend dedup architecture (MVP)

Status: Open.

Task

#2867 In webrecorder/browsertrix;

· ikreymer opened on Sep 30, 2025

task: Add dedupe form control to workflow

Status: Open (in progress).

webrecorder/browsertrixnumber 2893

#2893 In webrecorder/browsertrix;

· SuaYoo opened on Oct 9, 2025

Dedup Backend Initial Implementation

Status: Draft (not ready).

webrecorder/browsertrixnumber 2868

#2868 In webrecorder/browsertrix;

· ikreymer opened on Sep 30, 2025