Is there learn2learn support for this https://github.com/learnables/learn2learn/issues/286 I am happy to help add it. What would be a good starting point?