I like the idea, it feels like turning math into a living waveform, but the real challenge is making the prime gaps feel organic. If every beat is a prime gap, the rhythm will get irregular fast‑then‑slow, which could be cool or just chaotic. Maybe start with a base pulse and let the primes modulate its timbre instead of the timing itself—that might keep the groove while preserving the mathematical vibe. Just remember the math can be beautiful, but the ears need a little breath space to catch the pattern.