-
Notifications
You must be signed in to change notification settings - Fork 483
Add Zarr reader for Crash #1228
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Zarr reader for Crash #1228
Conversation
Greptile OverviewGreptile SummaryAdds a Zarr reader for crash simulation data to complement existing d3plot and VTP readers. The reader loads pre-processed Zarr stores created by PhysicsNeMo-Curator, where computational work (node filtering, edge building) has already been done during ETL. Key changes:
All previously flagged issues with the validation logic have been resolved. The code now correctly handles both 1D and 2D feature arrays as documented. Confidence Score: 5/5
Important Files ChangedFile Analysis
Sequence DiagramsequenceDiagram
participant User
participant Reader
participant process_zarr_data
participant find_zarr_stores
participant load_zarr_store
participant zarr as Zarr Store
User->>Reader: __call__(data_dir, num_samples)
Reader->>process_zarr_data: process_zarr_data(data_dir, num_samples, logger)
process_zarr_data->>find_zarr_stores: find_zarr_stores(data_dir)
find_zarr_stores->>find_zarr_stores: List *.zarr directories
find_zarr_stores->>find_zarr_stores: Natural sort by name
find_zarr_stores-->>process_zarr_data: List of zarr_paths
loop For each zarr_path (up to num_samples)
process_zarr_data->>load_zarr_store: load_zarr_store(zarr_path)
load_zarr_store->>zarr: Open Zarr store
load_zarr_store->>zarr: Read mesh_pos [T,N,3]
load_zarr_store->>zarr: Read edges [E,2]
load_zarr_store->>zarr: Read point data fields (thickness, etc.)
zarr-->>load_zarr_store: mesh_pos, edges, point_data_dict
load_zarr_store-->>process_zarr_data: mesh_pos, edges, point_data_dict
process_zarr_data->>process_zarr_data: Validate mesh_pos shape [T,N,3]
process_zarr_data->>process_zarr_data: Validate edges shape [E,2]
process_zarr_data->>process_zarr_data: Validate point data (1D [N] or 2D [N,K])
process_zarr_data->>process_zarr_data: Validate edge indices in bounds
process_zarr_data->>process_zarr_data: Extract src, dst from edges
process_zarr_data->>process_zarr_data: Build record with coords + features
end
process_zarr_data-->>Reader: srcs, dsts, point_data_all
Reader-->>User: srcs, dsts, point_data
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
5 files reviewed, 1 comment
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
5 files reviewed, 1 comment
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
5 files reviewed, no comments
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
5 files reviewed, 1 comment
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
5 files reviewed, no comments
|
/blossom-ci |
mnabian
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks!
|
/blossom-ci |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
5 files reviewed, no comments
PhysicsNeMo Pull Request
Description
This PR adds a Zarr reader for Crash. A corresponding Zarr preprocessor/writer has been merged to
PhysicsNeMo-Curatoralready.Checklist
Dependencies
Review Process
All PRs are reviewed by the PhysicsNeMo team before merging.
Depending on which files are changed, GitHub may automatically assign a maintainer for review.
We are also testing AI-based code review tools (e.g., Greptile), which may add automated comments with a confidence score.
This score reflects the AI’s assessment of merge readiness and is not a qualitative judgment of your work, nor is
it an indication that the PR will be accepted / rejected.
AI-generated feedback should be reviewed critically for usefulness.
You are not required to respond to every AI comment, but they are intended to help both authors and reviewers.
Please react to Greptile comments with 👍 or 👎 to provide feedback on their accuracy.