Local directory clean up after index delete

**Describe the bug**
The `/indexing` directory not properly cleaned up after deleting an index, even when waiting ~100s.

**Steps to reproduce (if applicable)**
Integration test `ingest_test::test_indexing_directory_cleanup`

**Expected behavior**
The working files of the index should be deleted within a few seconds.

**Configuration:**
Integration tests on current main.
