Modprobe v4l2loopback failed docker build

Question

Trying to build a docker image with v4l2loopback installed but am not able to modprobe it after installing it.

getting this error after trying to build using buildx

FATAL: Module v4l2loopback not found in directory /lib/modules/5.4.0-1038-aws

FROM arm64v8/ubuntu:bionic
RUN apt install -y v4l2loopback-dkms
RUN apt install -y v4l2loopback-utils
RUN modprobe v4l2loopback 

I also tried building from source

RUN git clone https://github.com/umlaeute/v4l2loopback.git
WORKDIR /home/v4l2loopback
RUN make && make install
RUN depmod -a
RUN modprobe v4l2loopback

but was unable to build it make[1]: *** /lib/modules/5.4.0-1038-aws/build: No such file or directory.