We can fine-tune VampNet models using LoRA (with an R=8), by fine-tuning on small audio datasets ranging in size from a couple of minutes to a couple of hours. Here are some unconditional samples generated by fine-tuning VampNet on some small datasets of music:
https://open.spotify.com/playlist/64o9tPBetUfXC449OKnbGI?si=ATL35_LxS3OQ11SujWAaKA
https://open.spotify.com/playlist/37i9dQZF1DZ06evO2bgbPo?si=4484fbf0aded4a7f