Debugging a lot led me to this: just add
options snd_sof_intel_hda_common dmic_num=4
to the kernel options, and reboot.