How to Dynamically Simulate Microphone Input Using Puppeteer and Virtual Audio Devices

Question

I'm currently working on a script utilizing Puppeteer, aiming to simulate audio as microphone input. My approach involves creating an element and attempting to capture its stream for use as microphone input. However, the solution doesn't seem to recognize the audio as coming from the microphone.

Here's a snippet of the code I've tried:

await page.evaluate(() => {
    const audio = document.createElement("audio");
    audio.setAttribute("src", "https://example.com/audio_file.mp3");
    audio.setAttribute("crossorigin", "anonymous");
    audio.setAttribute("controls", "");
    audio.onplay = function() {
        const stream = audio.captureStream();
        navigator.mediaDevices.getUserMedia = async function() {
            return stream;
        }
    }
    document.querySelector("body").appendChild(audio);
    // audio.play();
});

Unfortunately, this approach isn't working as expected. When I attempt to play the audio, it doesn't register as microphone input.

I'm aware of options like --use-fake-ui-for-media-stream, --use-fake-device-for-media-stream, and --use-file-for-fake-audio-capture= that allow adding fake input for media streams. However, I want this input to be dynamic, which these options don't seem to support.

Is there a method or workaround that allows me to dynamically simulate microphone input by playing an audio file from a webpage using Puppeteer? Perhaps there's a way to create a virtual microphone or another approach that achieves the desired result? Any insights or alternative solutions would be greatly appreciated.