Setup an interactive inference script on Colab to see how the new MAGMA checkpoints perform

[kshitijkg]

1. Convert Robin Model to HF checkpoint. For this you need to extend the GPT-NeoX class in HF and add CLIP encoder, and adapter to it and adapt the conversion script by including clip and adapter weights
2. Load hf checkpoint in google colab
3. write boilerplate code for interacting with it

[Alexis-BX]

You say you want it on Jupyter, but how?
To my knowledge we can't run jupyters on Summit. So where and how do you want to run this?

[kshitijkg]

#27