Added Focus on Spark-based scaling of transforms (medium priority)

[shahrokhDaijavad]

Search before asking

• I searched the issues and found no similar issues.

Component

Transforms/Other

Feature

Though DPK has a few Spark-scaled transforms, the scaling focus has been largely Ray-based. Apart from a few transforms, such as dedupe or fdedup, for which the Spark implementation is very specific, we need to create fast/consumable methods to scale other transforms from pure Python to Spark-scaled versions.

Are you willing to submit a PR?

• Yes I am willing to submit a PR!