How to speed up sync

[Seekawan]

Hi there,

I wanted to know if there were some parameters that can speed up that process :

Generating a /delta response from the OneDrive API for this Drive ID: xxxxxx and Item ID: xxxxxx
...........................................................................................................................................................................................................................................................................................................................................................................................................................

As I add more files, not necessarily heavy ones, the time needed for that is increasing pretty strongly

Thank you in advance for answers

[abraunegg]

@Seekawan
Each of those processing dots (.) represent a change set bundle on Microsoft OneDrive as presented by the Microsoft Graph API.

There is zero tuning that can be done when fetching your online data for the first time or in a --resync scenario.

Microsoft sends all your data (files and folders) in those change sets - usually ~200-210 items at a time. Due to how the Microsoft Graph API works, these items must be fetched in order (no parallel processing).

If you add --verbose you can see this occurring.

The client will then process those as they come in to determine applicability based on your configuration, then finally batch them up into larger 500 bundles for final handling.

The only way to speed this up this initial processing:

• Ensure you have adequate CPU resources allocated
• Ensure you have adequate system memory allocated - approx 1GB memory per 100K objects online.
• Have adequate Internet access / speed

Once the initial processing is done, and the client has fully synced, the client will start using the /delta reference that tells the client what changes have been done online since the last full sync - this is where the dramatic speed up occurs.

[abraunegg]

@Seekawan
To help you also understand how the client operates, please read: https://github.com/abraunegg/onedrive/blob/master/docs/client-architecture.md

Specifically:

• https://github.com/abraunegg/onedrive/blob/master/docs/client-architecture.md#understanding-how-the-client-processes-online-state
• https://github.com/abraunegg/onedrive/blob/master/docs/client-architecture.md#delta-response-vs-generated-delta-response

[Seekawan]

@Seekawan To help you also understand how the client operates, please read: https://github.com/abraunegg/onedrive/blob/master/docs/client-architecture.md

Specifically:

• https://github.com/abraunegg/onedrive/blob/master/docs/client-architecture.md#understanding-how-the-client-processes-online-state
• https://github.com/abraunegg/onedrive/blob/master/docs/client-architecture.md#delta-response-vs-generated-delta-response

Thanks I will read it