The test is putting server.p12 / replica.p12 in the test_dir directory, and the error message is printing the file name with its full path. Related to https://pagure.io/freeipa/issue/5378 Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>