Improve error handling

[gmaclennan]

We need to review this code to figure out where errors can occur and what should happen in response to an error. Should indexing be left in a permanently broken state or is there a way to ignore the error and continue?

We likely need to support an error state for the indexer, so that we can provide clear UX feedback for client implementations.

Marking this as post-MVP.