IntenseWebs/freeipa
3
0
Fork 0
mirror of https://salsa.debian.org/freeipa-team/freeipa.git synced 2024-12-25 08:21:05 -06:00
Code Issues Packages Projects Releases Wiki Activity
53c5c0ad7b
freeipa/.travis.yml

126 lines
5.0 KiB
YAML
Raw Normal View History

travis: mark FreeIPA as python project Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2016-12-20 08:47:31 -06:00
language: python
Use Travis-CI for basic sanity checks This patch adds the config file for Travis CI. The config file instructs the CI to: * check pep8 errors in PR * build RPMs in pulled in Fedora builder container (docker.io/martbab/freeipa-fedora-builder) These basic checks should eliminate basic errors that can break the build itself (formatting errors, Syntax errors/undeclared variables, missing BuildRequires, broken API.txt, etc.). It does not run any of our integration/unit tests. Reviewed-By: Martin Basti <mbasti@redhat.com>
2016-09-05 03:19:40 -05:00
services:
- docker
Travis CI: use specific Python version during build This is a preparatory work for the future requirement of running Python2/3 jobs simultaneously. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2016-12-21 03:16:47 -06:00
python:
- "2.7"
introduce install step to .travis.yml and cache pip installs Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2016-12-21 03:30:49 -06:00
cache: pip
Use ipa-docker-test-runner to run tests in Travis CI https://github.com/martbab/ipa-docker-test-runner is now used to run the following tasks in Travis CI: * pull in a FreeIPA test runner Docker image * configure/make lint/make rpms * install rpms * install FreeIPA server and KRA * run out-of-tree tests For performance reasons (last two steps are very time-consuming) the available tests were split roughly in half and are run as two separate jobs to speed up the process. AD trust is not installed as part of tests since the enabled compat plugin causes false negative errors. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Christian Heimes <cheimes@redhat.com>
2016-11-30 03:37:46 -06:00
env:
global:
- TEST_RUNNER_IMAGE="martbab/freeipa-fedora-test-runner:master-latest"
split out lint to a separate Travis job In order to speed our Travis CI gating even further, the lint step has been split to a separate job that can be run in parallel with the test runs. The test runs are in turn launched in developer mode to speed them up. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2016-12-20 09:04:02 -06:00
PEP8_ERROR_LOG="pep8_errors.log"
CI_RESULTS_LOG="ci_results_${TRAVIS_BRANCH}.log"
Trim the test runner log to show only pytest failures/errors If we get to the `run-tests` phase, we no longer care about messages from previous steps so we can truncate the log output to only show pytest failures/errors, reducing log size. As a fallback, the previous behaviour to print last 5000 log lines was kept in the case the CI tests fail during setup. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2017-01-05 03:10:06 -06:00
CI_BACKLOG_SIZE=5000
Travis CI: Upload the logs from failed jobs to transfer.sh When a non-lint job fails, all the relevant logs from the test runner will be gzipped and uploaded to https://transfer.sh file sharing service. The download link will then be displayed at the very end of the Travis build log. Reviewed-By: Jan Cholasta <jcholast@redhat.com>
2017-02-08 03:38:57 -06:00
CI_RUNNER_LOGS_DIR="/tmp/test-runner-logs"
CI_RUNNER_LOG_ARCHIVE="freeipa-ci-pr-${TRAVIS_PULL_REQUEST}-job-${TRAVIS_JOB_NUMBER}.tar.gz"
Use ipa-docker-test-runner to run tests in Travis CI https://github.com/martbab/ipa-docker-test-runner is now used to run the following tasks in Travis CI: * pull in a FreeIPA test runner Docker image * configure/make lint/make rpms * install rpms * install FreeIPA server and KRA * run out-of-tree tests For performance reasons (last two steps are very time-consuming) the available tests were split roughly in half and are run as two separate jobs to speed up the process. AD trust is not installed as part of tests since the enabled compat plugin causes false negative errors. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Christian Heimes <cheimes@redhat.com>
2016-11-30 03:37:46 -06:00
matrix:
split out lint to a separate Travis job In order to speed our Travis CI gating even further, the lint step has been split to a separate job that can be run in parallel with the test runs. The test runs are in turn launched in developer mode to speed them up. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2016-12-20 09:04:02 -06:00
- TASK_TO_RUN="lint"
Travis: enable temporary Py3 testing This testconfig is temporary until all plugins are migrated into py3. After that this temporal config file will be removed and used only the previous one again Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-02-07 11:29:08 -06:00
TEST_RUNNER_CONFIG=".test_runner_config.yaml"
split out lint to a separate Travis job In order to speed our Travis CI gating even further, the lint step has been split to a separate job that can be run in parallel with the test runs. The test runs are in turn launched in developer mode to speed them up. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2016-12-20 09:04:02 -06:00
- TASK_TO_RUN="run-tests"
Travis: build only py2 packages for py2 testing We will testing both py2 and py3 packages, first step is use only py2 builds for testing py2 packages Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-02-07 10:23:54 -06:00
PYTHON=/usr/bin/python2
Travis: enable temporary Py3 testing This testconfig is temporary until all plugins are migrated into py3. After that this temporal config file will be removed and used only the previous one again Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-02-07 11:29:08 -06:00
TEST_RUNNER_CONFIG=".test_runner_config.yaml"
split out lint to a separate Travis job In order to speed our Travis CI gating even further, the lint step has been split to a separate job that can be run in parallel with the test runs. The test runs are in turn launched in developer mode to speed them up. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2016-12-20 09:04:02 -06:00
TESTS_TO_RUN="test_xmlrpc/test_[a-k]*.py"
- TASK_TO_RUN="run-tests"
Travis: build only py2 packages for py2 testing We will testing both py2 and py3 packages, first step is use only py2 builds for testing py2 packages Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-02-07 10:23:54 -06:00
PYTHON=/usr/bin/python2
Travis: enable temporary Py3 testing This testconfig is temporary until all plugins are migrated into py3. After that this temporal config file will be removed and used only the previous one again Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-02-07 11:29:08 -06:00
TEST_RUNNER_CONFIG=".test_runner_config.yaml"
split out lint to a separate Travis job In order to speed our Travis CI gating even further, the lint step has been split to a separate job that can be run in parallel with the test runs. The test runs are in turn launched in developer mode to speed them up. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2016-12-20 09:04:02 -06:00
TESTS_TO_RUN="test_cmdline
Use ipa-docker-test-runner to run tests in Travis CI https://github.com/martbab/ipa-docker-test-runner is now used to run the following tasks in Travis CI: * pull in a FreeIPA test runner Docker image * configure/make lint/make rpms * install rpms * install FreeIPA server and KRA * run out-of-tree tests For performance reasons (last two steps are very time-consuming) the available tests were split roughly in half and are run as two separate jobs to speed up the process. AD trust is not installed as part of tests since the enabled compat plugin causes false negative errors. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Christian Heimes <cheimes@redhat.com>
2016-11-30 03:37:46 -06:00
test_install
Run test_ipaclient test suite Signed-off-by: Christian Heimes <cheimes@redhat.com> Reviewed-By: Tomas Krizek <tkrizek@redhat.com>
2017-03-03 05:57:21 -06:00
test_ipaclient
Use ipa-docker-test-runner to run tests in Travis CI https://github.com/martbab/ipa-docker-test-runner is now used to run the following tasks in Travis CI: * pull in a FreeIPA test runner Docker image * configure/make lint/make rpms * install rpms * install FreeIPA server and KRA * run out-of-tree tests For performance reasons (last two steps are very time-consuming) the available tests were split roughly in half and are run as two separate jobs to speed up the process. AD trust is not installed as part of tests since the enabled compat plugin causes false negative errors. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Christian Heimes <cheimes@redhat.com>
2016-11-30 03:37:46 -06:00
test_ipalib
test_ipapython
test_ipaserver
test_pkcs10
test_xmlrpc/test_[l-z]*.py"
Travis: enable temporary Py3 testing This testconfig is temporary until all plugins are migrated into py3. After that this temporal config file will be removed and used only the previous one again Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-02-07 11:29:08 -06:00
- TASK_TO_RUN="run-tests"
PYTHON=/usr/bin/python3
TEST_RUNNER_CONFIG=".test_runner_config_py3_temp.yaml"
py3: dogtag.py: fix bytes warnings /usr/lib/python3.5/site-packages/ipaserver/plugins/dogtag.py:1438: BytesWarning: str() on a bytes instance "parse_result:\\n%s" % (parse_func.__name__, xml_text, result)) https://pagure.io/freeipa/issue/4985 Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-06-22 04:03:33 -05:00
TESTS_TO_RUN="test_xmlrpc/test_add_remove_cert_cmd.py
test_xmlrpc/test_attr.py
py3: travis: enable tests for plugins that are aleready working These tests just works now https://pagure.io/freeipa/issue/4985 Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-06-22 03:57:52 -05:00
test_xmlrpc/test_automember_plugin.py
test_xmlrpc/test_automount_plugin.py
test_xmlrpc/test_baseldap_plugin.py
test_xmlrpc/test_batch_plugin.py
test_xmlrpc/test_cert_plugin.py
test_xmlrpc/test_certprofile_plugin.py
test_xmlrpc/test_config_plugin.py
test_xmlrpc/test_delegation_plugin.py
test_xmlrpc/test_group_plugin.py
test_xmlrpc/test_hbac_plugin.py
test_xmlrpc/test_hbacsvcgroup_plugin.py
test_xmlrpc/test_hbactest_plugin.py
test_xmlrpc/test_host_plugin.py
test_xmlrpc/test_hostgroup_plugin.py
py3: test_kerberos_principal_aliases: fix code scope In py3 the variable is valid only in the block where it is defined. We must move test definition to global scope. https://pagure.io/freeipa/issue/4985 Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-06-22 05:10:25 -05:00
test_xmlrpc/test_krbtpolicy.py
test_xmlrpc/test_kerberos_principal_aliases.py"
Travis: enable temporary Py3 testing This testconfig is temporary until all plugins are migrated into py3. After that this temporal config file will be removed and used only the previous one again Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-02-07 11:29:08 -06:00
### Tests which haven't been ported to py3 yet ###
## test_xmlrpc/test_[a-k]*.py
# test_xmlrpc/test_ca_plugin.py
# test_xmlrpc/test_caacl_plugin.py
# test_xmlrpc/test_caacl_profile_enforcement.py
# test_xmlrpc/test_dns_plugin.py
# test_xmlrpc/test_dns_realmdomains_integration.py
# test_xmlrpc/test_external_members.py
# test_xmlrpc/test_idviews_plugin.py
- TASK_TO_RUN="run-tests"
PYTHON=/usr/bin/python3
TEST_RUNNER_CONFIG=".test_runner_config_py3_temp.yaml"
TESTS_TO_RUN="test_cmdline
test_ipalib
py3: Remove comparison >=2 of debnug log level We have only one debug log level and it causes issues with py3. ... File "/usr/lib/python3.5/site-packages/ipaserver/rpcserver.py", line 490, in marshal response, version, pretty_print=self.api.env.debug >= 2 TypeError: unorderable types: str() >= int() https://pagure.io/freeipa/issue/4985 Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-06-19 12:11:10 -05:00
test_ipapython
py3: test_otptoken_import: fix bytes usage https://pagure.io/freeipa/issue/4985 Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-06-20 03:41:28 -05:00
test_ipaserver
Travis: enable temporary Py3 testing This testconfig is temporary until all plugins are migrated into py3. After that this temporal config file will be removed and used only the previous one again Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-02-07 11:29:08 -06:00
test_pkcs10
py3: test_location_plugin: fix iteration over changed dict In py3 dict.items() doesn't return list so we must create a list to avoid changing dictionary over iteration. https://pagure.io/freeipa/issue/4985 Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-06-22 06:40:38 -05:00
test_xmlrpc/test_location_plugin.py
py3: travis: enable tests for plugins that are aleready working These tests just works now https://pagure.io/freeipa/issue/4985 Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-06-22 03:57:52 -05:00
test_xmlrpc/test_nesting.py
test_xmlrpc/test_netgroup_plugin.py
test_xmlrpc/test_old_permission_plugin.py
test_xmlrpc/test_passwd_plugin.py
test_xmlrpc/test_permission_plugin.py
test_xmlrpc/test_ping_plugin.py
test_xmlrpc/test_privilege_plugin.py
test_xmlrpc/test_pwpolicy_plugin.py
test_xmlrpc/test_radiusproxy_plugin.py
test_xmlrpc/test_realmdomains_plugin.py
test_xmlrpc/test_replace.py
test_xmlrpc/test_role_plugin.py
test_xmlrpc/test_selfservice_plugin.py
test_xmlrpc/test_selinuxusermap_plugin.py
test_xmlrpc/test_service_plugin.py
test_xmlrpc/test_servicedelegation_plugin.py
test_xmlrpc/test_stageuser_plugin.py
test_xmlrpc/test_sudocmd_plugin.py
test_xmlrpc/test_sudocmdgroup_plugin.py
test_xmlrpc/test_sudorule_plugin.py"
Travis: enable temporary Py3 testing This testconfig is temporary until all plugins are migrated into py3. After that this temporal config file will be removed and used only the previous one again Reviewed-By: Stanislav Laznicka <slaznick@redhat.com>
2017-02-07 11:29:08 -06:00
### Tests which haven't been ported to py3 yet ###
## test_xmlrpc/test_[l-z]*.py
# test_xmlrpc/test_range_plugin.py
# test_xmlrpc/test_trust_plugin.py
# test_xmlrpc/test_vault_plugin.py
introduce install step to .travis.yml and cache pip installs Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2016-12-21 03:30:49 -06:00
install:
Travis CI: explicitly update pip before running the builds This is to workaround around https://github.com/travis-ci/travis-ci/issues/7733 and issues with implicit requirement of python-requests on newer pip. Reviewed-By: Christian Heimes <cheimes@redhat.com>
2017-05-09 11:36:51 -05:00
- pip install --upgrade pip
- pip3 install --upgrade pip
Use Travis-CI for basic sanity checks This patch adds the config file for Travis CI. The config file instructs the CI to: * check pep8 errors in PR * build RPMs in pulled in Fedora builder container (docker.io/martbab/freeipa-fedora-builder) These basic checks should eliminate basic errors that can break the build itself (formatting errors, Syntax errors/undeclared variables, missing BuildRequires, broken API.txt, etc.). It does not run any of our integration/unit tests. Reviewed-By: Martin Basti <mbasti@redhat.com>
2016-09-05 03:19:40 -05:00
- pip install pep8
Use ipa-docker-test-runner to run tests in Travis CI https://github.com/martbab/ipa-docker-test-runner is now used to run the following tasks in Travis CI: * pull in a FreeIPA test runner Docker image * configure/make lint/make rpms * install rpms * install FreeIPA server and KRA * run out-of-tree tests For performance reasons (last two steps are very time-consuming) the available tests were split roughly in half and are run as two separate jobs to speed up the process. AD trust is not installed as part of tests since the enabled compat plugin causes false negative errors. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Christian Heimes <cheimes@redhat.com>
2016-11-30 03:37:46 -06:00
- >
pip3 install
Bump up ipa-docker-test-runner version Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2016-12-20 03:11:20 -06:00
git+https://github.com/freeipa/ipa-docker-test-runner@release-0-2-1
Use Travis-CI for basic sanity checks This patch adds the config file for Travis CI. The config file instructs the CI to: * check pep8 errors in PR * build RPMs in pulled in Fedora builder container (docker.io/martbab/freeipa-fedora-builder) These basic checks should eliminate basic errors that can break the build itself (formatting errors, Syntax errors/undeclared variables, missing BuildRequires, broken API.txt, etc.). It does not run any of our integration/unit tests. Reviewed-By: Martin Basti <mbasti@redhat.com>
2016-09-05 03:19:40 -05:00
script:
Travis CI: Upload the logs from failed jobs to transfer.sh When a non-lint job fails, all the relevant logs from the test runner will be gzipped and uploaded to https://transfer.sh file sharing service. The download link will then be displayed at the very end of the Travis build log. Reviewed-By: Jan Cholasta <jcholast@redhat.com>
2017-02-08 03:38:57 -06:00
- mkdir -p $CI_RUNNER_LOGS_DIR
Travis: offload test execution to a separate script Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2016-12-20 09:03:25 -06:00
- travis_wait 50 ./.travis_run_task.sh
Use ipa-docker-test-runner to run tests in Travis CI https://github.com/martbab/ipa-docker-test-runner is now used to run the following tasks in Travis CI: * pull in a FreeIPA test runner Docker image * configure/make lint/make rpms * install rpms * install FreeIPA server and KRA * run out-of-tree tests For performance reasons (last two steps are very time-consuming) the available tests were split roughly in half and are run as two separate jobs to speed up the process. AD trust is not installed as part of tests since the enabled compat plugin causes false negative errors. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Christian Heimes <cheimes@redhat.com>
2016-11-30 03:37:46 -06:00
after_failure:
Trim the test runner log to show only pytest failures/errors If we get to the `run-tests` phase, we no longer care about messages from previous steps so we can truncate the log output to only show pytest failures/errors, reducing log size. As a fallback, the previous behaviour to print last 5000 log lines was kept in the case the CI tests fail during setup. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2017-01-05 03:10:06 -06:00
- echo "Test runner output:"; tail -n $CI_BACKLOG_SIZE $CI_RESULTS_LOG
split out lint to a separate Travis job In order to speed our Travis CI gating even further, the lint step has been split to a separate job that can be run in parallel with the test runs. The test runs are in turn launched in developer mode to speed them up. Reviewed-By: Stanislav Laznicka <slaznick@redhat.com> Reviewed-By: Fraser Tweedale <ftweedal@redhat.com>
2016-12-20 09:04:02 -06:00
- echo "PEP-8 errors:"; cat $PEP8_ERROR_LOG
Travis CI: Upload the logs from failed jobs to transfer.sh When a non-lint job fails, all the relevant logs from the test runner will be gzipped and uploaded to https://transfer.sh file sharing service. The download link will then be displayed at the very end of the Travis build log. Reviewed-By: Jan Cholasta <jcholast@redhat.com>
2017-02-08 03:38:57 -06:00
- >
echo "Archiving CI logs";
if [[ "$TASK_TO_RUN" != "lint" ]]; then
tar --ignore-failed-read -uvf var_log.tar $CI_RESULTS_LOG $PEP8_ERROR_LOG;
gzip var_log.tar;
mv var_log.tar.gz $CI_RUNNER_LOG_ARCHIVE;
transfer_url=$(
curl --upload-file \
./$CI_RUNNER_LOG_ARCHIVE \
https://transfer.sh/${CI_RUNNER_LOG_ARCHIVE}) &&
echo "Download log archive from ${transfer_url}" ||
echo "Failed to upload log archive!";
fi
Reference in New Issue Copy Permalink