---
tiers:
  - name: smoke
    description: >-
      A set of conformance tests integrated from kubernetes project.
    testcases:
      - case_name: xrally_kubernetes
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          All in one tasks for checking basic functionality of
          Kubernetes cluster.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: xrally_kubernetes
      - case_name: k8s_io
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs k8s.io testing excluding the label Conformance (part of
          k8s_conformance) and all sigs.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[k8s.io\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|\\[sig-.+\\]|
                \\[Feature:TTLAfterFinished\\]"
      - case_name: k8s_conformance
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          Conformance Tests are expect to pass on any Kubernetes
          cluster, this tests are necessary demonstrate conformance
          of the Kubernetes deployment.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[Conformance\]
              skip: \[Serial\]|\[Disruptive\]|NoExecuteTaintManager
      - case_name: k8s_conformance_serial
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          Conformance Tests are expect to pass on any Kubernetes
          cluster, this tests are necessary demonstrate conformance
          of the Kubernetes deployment.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            ginkgo:
              focus: \[Serial\].*\[Conformance\]
              skip: \[Disruptive\]|NoExecuteTaintManager
      - case_name: sig_api_machinery
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-api-machinery testing excluding
          the label Conformance (part of k8s_conformance) and
          StorageVersionAPI.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-api-machinery\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|\
                \\[Feature:StorageVersionAPI\\]"
      - case_name: sig_api_machinery_serial
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-api-machinery testing excluding
          the label Conformance (part of k8s_conformance) and
          StorageVersionAPI.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            ginkgo:
              focus: \[sig-api-machinery\].*\[Serial\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Conformance\\]|\
                \\[Feature:StorageVersionAPI\\]"
      - case_name: sig_apps
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-apps testing excluding the
          following labels: Conformance (part of k8s_conformance) and
          both StatefulUpgrade and StatefulSet features.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-apps]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|\
                \\[Feature:StatefulUpgrade\\]|\
                \\[Feature:StatefulSet\\]"
      - case_name: sig_apps_serial
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-apps testing excluding the
          following labels: Conformance (part of k8s_conformance) and
          both StatefulUpgrade and StatefulSet features.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            ginkgo:
              focus: \[sig-apps].*\[Serial\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Conformance\\]|\
                \\[Feature:StatefulUpgrade\\]|\
                \\[Feature:StatefulSet\\]"
      - case_name: sig_auth
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-auth testing excluding the
          following labels: Conformance (part of k8s_conformance) and
          all PodSecurityPolicy, BoundServiceAccountTokenVolume,
          TokenRequestProjection and ServiceAccountIssuerDiscovery features.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-auth\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|\
                \\[Feature:PodSecurityPolicy\\]|\
                \\[Feature:BoundServiceAccountTokenVolume\\]|\
                \\[Feature:TokenRequestProjection\\]|\
                \\[Feature:ServiceAccountIssuerDiscovery\\]"
      - case_name: sig_cli
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-cli testing excluding Conformance
          (part of k8s_conformance).
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-cli]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]"
      - case_name: sig_cli_serial
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-cli testing excluding Conformance
          (part of k8s_conformance).
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            ginkgo:
              focus: \[sig-cli].*\[Serial\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Conformance\\]"
      - case_name: sig_cluster_lifecycle
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-cluster-lifecycle testing
          excluding Conformance (part of k8s_conformance).
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-cluster-lifecycle\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]"
      - case_name: sig_instrumentation
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-instrumentation testing excluding
          Conformance (part of k8s_conformance) and StackdriverLogging
          feature.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-instrumentation\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|\
                \\[Feature:StackdriverLogging\\]"
      - case_name: sig_network
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-network testing excluding the
          following labels: Conformance (part of k8s_conformance),
          load.balancer, NetworkPolicy, Networking-IPv6,
          IPv6DualStackAlphaFeature, SCTP and Example. A couple of features may
          be automatically skipped like NEG and kubemci.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-network\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|load.balancer|\
                LoadBalancer|\\[Feature:NetworkPolicy\\]|\
                \\[Feature:Networking-IPv6\\]|\
                \\[Feature:IPv6DualStackAlphaFeature\\]|\
                \\[Feature:SCTP\\]|\\[Feature:Example\\]|\
                Network.should.set.TCP.CLOSE_WAIT.timeout"
      - case_name: sig_network_serial
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-network testing excluding the
          following labels: Conformance (part of k8s_conformance),
          load.balancer, NetworkPolicy, Networking-IPv6,
          IPv6DualStackAlphaFeature, SCTP and Example. A couple of features may
          be automatically skipped like NEG and kubemci.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            ginkgo:
              focus: \[sig-network\].*\[Serial\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Conformance\\]|load.balancer|\
                LoadBalancer|\\[Feature:NetworkPolicy\\]|\
                \\[Feature:Networking-IPv6\\]|\
                \\[Feature:IPv6DualStackAlphaFeature\\]|\
                \\[Feature:SCTP\\]|\\[Feature:Example\\]"
      - case_name: sig_node
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-node testing excluding the
          following labels: Conformance (part of k8s_conformance),
          RuntimeClass, all RuntimeHandler, PodGarbageCollector,
          RegularResourceUsageTrackingfeatures,
          ExperimentalResourceUsageTracking and SetHostnameAsFQDN features.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-node]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|\
                \\[NodeFeature:RuntimeHandler\\]|\
                \\[Feature:PodGarbageCollector\\]|\
                \\[Feature:RegularResourceUsageTracking\\]|\
                \\[Feature:ExperimentalResourceUsageTracking\\]|\
                \\[Feature:SetHostnameAsFQDN\\]|\
                RuntimeClass"
      - case_name: sig_scheduling_serial
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-network testing excluding the
          next labels: Conformance (part of k8s_conformance) and the
          GPUDevicePlugin feature.
        dependencies:
          - DEPLOY_SCENARIO: 'k8-*'
        run:
          name: e2e_testing
          args:
            ginkgo:
              focus: \[sig-scheduling\].*\[Serial\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Conformance\\]|\
                \\[Feature:GPUDevicePlugin\\]"
      - case_name: sig_storage
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-storage testing excluding the
          following labels: Conformance (part of k8s_conformance),
          all features, all drivers, PersistentVolumes.NFS and Slow.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-storage\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|\
                \\[Feature:.+\\]|\\[Driver:.+\\]|\
                PersistentVolumes.NFS|\\[Slow\\]"
      - case_name: sig_storage_serial
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-storage testing excluding the
          following labels: Conformance (part of k8s_conformance),
          all features, all drivers, PersistentVolumes.NFS and Slow.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            ginkgo:
              focus: \[sig-storage\].*\[Serial\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Conformance\\]|\
                \\[Feature:.+\\]|\\[Driver:.+\\]|\
                PersistentVolumes.NFS|\\[Slow\\]"