Add Tolerations and node selector to KFP pods

[revit13]

Why are these changes needed?

Add Tolerations and node selector to KFP pods

To apply kuberenetes Tolerations or nodeSelector to KFP pods, you need to set KFP_TOLERATIONS or KFP_NODE_SELECTOR environment variables respectively before compiling the pipeline. Here's an example:

export KFP_TOLERATIONS='[{"key": "key","operator": "Equal", "value1": "value", "effect": "NoSchedule"}]'

export KFP_NODE_SELECTOR='{"label_key":"cloud.google.com/gke-accelerator","label_value":"nvidia-tesla-p4"}'

Related issue number (if any).

Relates to #620

[roytman]

Can you please combine Tolerance settings with PR #627 , so users will not have to update several parts.

[revit13]

Can you please combine Tolerance settings with PR #627 , so users will not have to update several parts.

Done for kfp v1, I'll open an issue as you request for kfp v2.

[roytman]

LGTM