Document lightblue-migrator

[dcrissman]

This is a task to document the lightblue-migrator, and also a place to drop notes on to ensure it gets documented.

[dcrissman]

Setting the job configuration field threadCount < 1 will result in no jobs being executed.

lightblue-platform/lightblue-migrator#103

[jewzaam]

Setting the job configuration field threadCount > 1 will result in no jobs being executed.
I assume you mean threadCount < 1

[jewzaam]

Some useful queries, for those with access to the mongo cli:

---

What jobs are running right now:

db.migrationJob.find(
{
    "jobExecutions#": {
        "$gt": 0
    },
    "jobExecutions.completedFlag": false
},
{_id:1}
).sort({_id:1})

---

Assuming you have a field to track when a record was migrated (migratedDate) for your entity (myEntity)...
How many records were migrated per minute:

db.myEntity.aggregate(
[
    {
        "$match": {
            "migratedDate": {
                "$exists": 1
            }
        }
    },
    {
        "$project": {
            "migratedDate": 1
        }
    },
    {
        "$group": {
            "_id": {
                "year": {
                    "$year": "$migratedDate"
                },
                "month": {
                    "$month": "$migratedDate"
                },
                "day": {
                    "$dayOfMonth": "$migratedDate"
                },
                "hour": {
                    "$hour": "$migratedDate"
                },
                "minute": {
                    "$minute": "$migratedDate"
                }
            },
            "count": {
                "$sum": 1
            }
        }
    },
    {
        "$sort": {"_id":-1}
    }
]
)

[dcrissman]

Setting the job configuration field threadCount > 1 will result in no jobs being executed.

I assume you mean threadCount < 1

You are correct. I updated my earlier post to ensure no confusion later.

[dcrissman]

Document how to configure GRAPHITE or STATSD

lightblue::application::migrator::serviceJvmOptions:
    - DSTATSD_PREFIX=myprefix
    - DSTATSD_HOSTNAME=localhost
    - DSTATSD_PORT=1234

lightblue-platform/lightblue-puppet#120

[dcrissman]

Document how to set custom log4.properties

lightblue::application::migrator::serviceJvmOptions:
    - Dlog4j.configuration=file:/path/to/log4j.properties

lightblue-platform/lightblue-puppet#121