Hi @urshobhit ,
WP Offload Media Support Team here. Thanks for reaching out with your query, we would be happy to assist!
At the moment this isn’t possible. Plugins with their own CDN feature (like Jetpack) are known to cause conflict with WP Offload Media, so when you use our plugin, we recommend turning off their CDN.
https://deliciousbrains.com/wp-offload-media/doc/compatibility-with-other-plugins/#caching-plugins
However, you should be able to use other CDN providers like StackPath or KeyCDN. We have a couple of documentation below which you can use as a guide for setting up a CDN to point to your bucket.
https://deliciousbrains.com/wp-offload-media/doc/stackpath-setup/
https://deliciousbrains.com/wp-offload-media/doc/how-to-set-up-a-custom-domain-for-digitalocean-spaces-with-keycdn/
Let us know if you have any other questions.