I am assuming here that both the devices are paired. You can confirm that by going to Settings > Devices > Bluetooth. You can then follow the tips mentioned below if the Bluetooth speaker is connected ...
I have had so many weird problems with Win11 and Bluetooth... Unpair, reboot, repair. If that doesn't work, check Windows update / additional updates to see if there's a driver update. If that doesn't ...