add option to select all streams/columns by default

[djdevin]

This would be helpful as it won't require post-processing of the JSON to set all fields as included.

Useful for when there are database views of normalized data, since the tables and columns are typically defined beforehand and should all be included in a replication job.

[nick-mccoy]

Hey @djdevin, I think the best solution here would be to support for a replicate-all config file flag. This flag could then be read during the sync used as a condition to determine whether fields should be replicated or not.

We encourage you to submit a pull request with the changes. Otherwise, we will make note of the feature request, but will likely not implement it unless we see more demand for it.

[djdevin]

Since the catalog is JSON, this is easy enough to do with jq too:

tap-mysql -c db.json --discover | jq '.streams[].metadata[0].metadata.selected = true | .streams[].metadata[0].metadata["replication-method"] = "FULL_TABLE"' > catalog.json