Skip to content

Support NVIDIA Nim models for inference #8

@IgnacioHeredia

Description

@IgnacioHeredia

Hi @vykozlov @falibabaei ,

I recently came accross NVIDIA Nims. It is a catalog of AI models optimized for running on NVIDIA cards. And there are models relevant to science (healthcare, biology, climate). For example:

https://build.nvidia.com/nvidia/fourcastnet

They are serving the models with Gradio and models seem to have an API, so it will be maybe possible to integrate them in AI4EOSC.

Anyway, the number of models is still fairly small, so I think Hugginface integration has a much higher priority. But I'm creating the issue to keep it in the backlog.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions