Skip to content

DocValuesConsumerUtil tweak #132586

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Aug 11, 2025

Conversation

martijnvg
Copy link
Member

@martijnvg martijnvg commented Aug 8, 2025

Be more strict about not finding a metadata entry based on field info number.
If this were to happen, then this can cause issues in doc value consumer later.
An example of such a failure is what is fixed via #132597, here with shrinking
the local segment and merged field numbers were not aligned causing serious
merge errors in the tsdb doc value consumer. Currently such an issue shouldn't
occur anymore.

Be more strict about not finding a metadata entry based on field info number.

If this were to happen, then this can cause issues in doc value consumer. However as far as I understand it, the field info number should stay consistent.
Copy link
Contributor

@jordan-powers jordan-powers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense to me, thanks Martijn!

@martijnvg martijnvg marked this pull request as ready for review August 11, 2025 01:29
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-storage-engine (Team:StorageEngine)

@martijnvg
Copy link
Member Author

Thanks @jordan-powers and @dnhatn for the reviews!

@martijnvg martijnvg merged commit 25e4a06 into elastic:main Aug 11, 2025
33 checks passed
martijnvg added a commit to martijnvg/elasticsearch that referenced this pull request Aug 14, 2025
Be more strict about not finding a metadata entry based on field info number.
If this were to happen, then this can cause issues in doc value consumer later.
An example of such a failure is what is fixed via elastic#132597, here with shrinking
the local segment and merged field numbers were not aligned causing serious
merge errors in the tsdb doc value consumer. Currently such an issue shouldn't
occur anymore.
martijnvg added a commit to martijnvg/elasticsearch that referenced this pull request Aug 14, 2025
Be more strict about not finding a metadata entry based on field info number.
If this were to happen, then this can cause issues in doc value consumer later.
An example of such a failure is what is fixed via elastic#132597, here with shrinking
the local segment and merged field numbers were not aligned causing serious
merge errors in the tsdb doc value consumer. Currently such an issue shouldn't
occur anymore.
elasticsearchmachine pushed a commit that referenced this pull request Aug 14, 2025
Be more strict about not finding a metadata entry based on field info number.
If this were to happen, then this can cause issues in doc value consumer later.
An example of such a failure is what is fixed via #132597, here with shrinking
the local segment and merged field numbers were not aligned causing serious
merge errors in the tsdb doc value consumer. Currently such an issue shouldn't
occur anymore.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants