Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

JSON Store #1666

Closed
kaplun opened this issue Oct 24, 2016 · 2 comments
Closed

JSON Store #1666

kaplun opened this issue Oct 24, 2016 · 2 comments
Assignees
@ammirate
Milestone
Inspire Json Merger

Comments

@kaplun
Copy link
Contributor

kaplun commented Oct 24, 2016

In order to support the needs of the three-ways merging of JSON-Merger we need to implement a JSON-store.

Such store would need to store the last JSON version of a record as it came from a given source. E.g. one entry for the JSON from arXiv, one for the JSON from e.g. Elsevier. The stored JSON is the one right before it's being merged into the record.

Such store could be implemented as:

object_uuid, data, source, version/timestamp.

API could be:

def store_json(object_uuid, json_data, source):
    pass

def get_last_json(object_uuid, source):
    pass

def garbage_collect():
    remove any previous version of a given source
@kaplun
Copy link
Contributor Author

kaplun commented Oct 24, 2016

@david-caro this is what we discussed today at the round-the-table.

kaplun added a commit to kaplun/inspire-next that referenced this issue May 26, 2017
@kaplun
workflows: support storage of original source
afd4ea5 
* Implements easy API functions:
  store_original_record_for_source() and
  retrieve_original_record_for_source() allowing to preserve and
  later retrieve the original JSON source corresponding to a given
  publisher. (closes inspirehep#1666)

Signed-off-by: Samuele Kaplun <[email protected]>
@kaplun kaplun mentioned this issue May 26, 2017
Closed
@ghost ghost assigned kaplun May 26, 2017
@ghost ghost added the Status: WIP label May 26, 2017
kaplun added a commit to kaplun/inspire-next that referenced this issue May 26, 2017
@kaplun
workflows: support storage of original source
d7b746b 
* Implements easy API functions:
  store_root_json() and retrieve_root_json() allowing to preserve and
  later retrieve the original JSON source corresponding to a given
  publisher. (closes inspirehep#1666)

Signed-off-by: Samuele Kaplun <[email protected]>
kaplun added a commit to kaplun/inspire-next that referenced this issue May 26, 2017
@kaplun
workflows: support storage of original source
9f7e88a 
* Implements easy API functions:
  store_root_json() and retrieve_root_json() allowing to preserve and
  later retrieve the original JSON source corresponding to a given
  publisher. (closes inspirehep#1666)

Signed-off-by: Samuele Kaplun <[email protected]>
rikirenz pushed a commit to rikirenz/inspire-next that referenced this issue Jun 12, 2017
@kaplun @rikirenz
workflows: support storage of original source
b5b7246 
* Implements easy API functions:
  store_root_json() and retrieve_root_json() allowing to preserve and
  later retrieve the original JSON source corresponding to a given
  publisher. (closes inspirehep#1666)

Signed-off-by: Samuele Kaplun <[email protected]>
rikirenz pushed a commit to rikirenz/inspire-next that referenced this issue Jun 19, 2017
@kaplun @rikirenz
workflows: support storage of original source
b9c7bb5 
* Implements easy API functions:
  store_root_json() and retrieve_root_json() allowing to preserve and
  later retrieve the original JSON source corresponding to a given
  publisher. (closes inspirehep#1666)

Signed-off-by: Samuele Kaplun <[email protected]>
rikirenz pushed a commit to rikirenz/inspire-next that referenced this issue Jun 21, 2017
@kaplun @rikirenz
workflows: support storage of original source
a8683ca 
* Implements easy API functions:
  store_root_json() and retrieve_root_json() allowing to preserve and
  later retrieve the original JSON source corresponding to a given
  publisher. (closes inspirehep#1666)

Signed-off-by: Samuele Kaplun <[email protected]>
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 15, 2017
@ammirate
tasks: added merging functions. Closes inspirehep#1666 inspirehep#2322
199b14b 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 15, 2017
@ammirate
tasks: added merging functions. Closes inspirehep#1666 inspirehep#2322
6641be1 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 15, 2017
@ammirate
tasks: added merging functions. Closes inspirehep#1666 inspirehep#2322
c9ed0b2 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 20, 2017
@ammirate
tasks: added merging functions. Closes inspirehep#1666 inspirehep#2322
ec5cdd3 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 21, 2017
@ammirate
tasks: added merging functions. Closes inspirehep#1666 inspirehep#2322
9f69a8c 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 21, 2017
@ammirate
tasks: added merging functions. Closes inspirehep#1666 inspirehep#2322
cc30aec 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 21, 2017
@ammirate
tasks: added merging task. Closes inspirehep#1666 inspirehep#2322
b06b2b5 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 21, 2017
@ammirate
tasks: added merging task. Closes inspirehep#1666 inspirehep#2322
a6e2611 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 21, 2017
@ammirate
tasks: added merging task. Closes inspirehep#1666 inspirehep#2322
000d15c 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 21, 2017
@ammirate
tasks: added merging task. Closes inspirehep#1666 inspirehep#2322
8409395 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 21, 2017
@ammirate
tasks: added merging task. Closes inspirehep#1666 inspirehep#2322
d1f0a9d 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 21, 2017
@ammirate
tasks: added merging task. Closes inspirehep#1666 inspirehep#2322
28530a2 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 21, 2017
@ammirate
tasks: added merging task. Closes inspirehep#1666 inspirehep#2322
ba2a783 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 25, 2017
@ammirate
tasks: added merging task.
e2db022 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 25, 2017
@ammirate
tasks: added merging task.
6184cb3 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 26, 2017
@ammirate
tasks: added merging task.
f1b04ee 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 26, 2017
@ammirate
tasks: added merging task.
4cf8e86 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 26, 2017
@ammirate
tasks: added merging task.
382a6d3 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 28, 2017
@ammirate
tasks: added merging task
e780c3b 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 28, 2017
@ammirate
tasks: added merging task
a3993ba 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 29, 2017
@ammirate
tasks: added merging task
2e83b85 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 29, 2017
@ammirate
tasks: added merging task
b7e37dd 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 29, 2017
@ammirate
tasks: added merging task
db92f88 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Sep 29, 2017
@ammirate
tasks: added merging task
ac2c3ad 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 2, 2017
@ammirate
tasks: added merging task
5232925 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 2, 2017
@ammirate
tasks: added merging task
fcdedc7 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 3, 2017
@ammirate
tasks: added merging task
93cc0e4 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 4, 2017
@ammirate
tasks: added merging task
eeccd62 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 4, 2017
@ammirate
tasks: added merging task
8798f39 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 4, 2017
@ammirate
tasks: added merging task
8fee59b 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 4, 2017
@ammirate
tasks: added merging task
7bf53d6 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit that referenced this issue Oct 4, 2017
@ammirate
tasks: added merging task
7c856fe 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close #1666 and also close #2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 5, 2017
@ammirate
tasks: added merging task
f5d0e73 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
david-caro pushed a commit that referenced this issue Oct 10, 2017
@ammirate @david-caro
tasks: added merging task
38d06fd 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close #1666 and also close #2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 11, 2017
@ammirate
tasks: added merging task
9f8ab94 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 13, 2017
@ammirate
tasks: added merging task
ef180ab 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 13, 2017
@ammirate
tasks: added merging task
9a3504f 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 13, 2017
@ammirate
tasks: added merging task
e6d48c8 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 18, 2017
@ammirate
tasks: added merging task
805fcb8 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 20, 2017
@ammirate
tasks: added merging task
9bc2926 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 23, 2017
@ammirate
tasks: added merging task
0df84bf 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
kaplun pushed a commit that referenced this issue Oct 23, 2017
@ammirate @kaplun
tasks: added merging task
4fcdd9d 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close #1666 and also close #2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 24, 2017
@ammirate
tasks: added merging task
3b55807 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
ammirate added a commit to ammirate/inspire-next that referenced this issue Oct 24, 2017
@ammirate
tasks: added merging task
fe3d811 
Signed-off-by: Antonio Cesarano <[email protected]>
Signed-off-by: Riccardo Candido <[email protected]>

* new task including all merging utils needed in the workflow
* unit and integration tests for those functions

This close inspirehep#1666 and also close inspirehep#2322.
@kaplun kaplun assigned ammirate and unassigned kaplun Nov 21, 2017
@kaplun kaplun added this to the Inspire Json Merger milestone Nov 21, 2017
@jacquerie
Copy link
Contributor

This happened in #3005.

@ghost ghost removed the Status: WIP label Nov 29, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ammirate ammirate

Labels
None yet
Projects
None yet
Milestone
Inspire Json Merger
Development

Successfully merging a pull request may close this issue.

workflows: support storage of original source kaplun/inspire-next
3 participants
@kaplun @jacquerie @ammirate