Put as much of your testing in shell scripts, or even better, Ansible playbooks, so that you can run them locally. That way your CI system just does ansible-playbook
There's a very good Ansible collection for podman, so you can orchestrate the unit tests to run inside a container for full isolation