Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About page #30

Merged
merged 9 commits into from
May 27, 2021
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 9 additions & 1 deletion docs/about.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,12 @@
title: About
---

TBD
# About
## Local First
Ichnion is a project led by [Georepublic](https://georepublic.info/), [Tokyo University](https://shiba.iis.u-tokyo.ac.jp/) and [Code4Japan](https://www.code4japan.org/). Its purpose is to allow you to analyze your own data collected from services like Google Takeout, Facebook Export or Twitter Export, whitout uploading it to a 3rd party service. It ensures your data stays with you.

## Personal data
Ichnion aims to make it easy for everyone to obtain, inspect, analyze and control their personal data.

## Digital privacy
With Ichnion everyone can gain insight in the data that is stored about us, fostering transparency in a digital society.
62 changes: 61 additions & 1 deletion docs/quickstart.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,65 @@
---
title: Quickstart

---

TBD
# Quickstart
Excavator extracts and stores data from your personal data exports.

## Installing Excavator
### Compiling from source
You need to have a [package manager](https://doc.rust-lang.org/cargo/appendix/glossary.html#package-manager) called [cargo](https://doc.rust-lang.org/cargo/) in your local.

If you already have got `rustc` installed in your local, you also have `cargo` installed locally.

And then you can install with this command.

```sh
$ cargo install --git https://github.com/ichnion/excavator --branch develop
```

### Install from crates.io
You can also install from package registry.

```sh
$ cargo install excavator
```

### Install from Homebrew
```sh
$ brew tap ichnion/tap
$ brew install excavator
```

## How to use Excavator
### Prerequisite
Currently, we support *part of* `Google Takeout` and `Facebook` data.

You need to prepare the applicable data from [Google Takeout](https://takeout.google.com/settings/takeout) or [Facebook](https://www.facebook.com/help/972879969525875).

Supported files are below.

- Google Takout
- `MyActivity.json`
- `search-history.json`
- `watch-history.json`
- `Location History.json`
- `Saved Place.json`
- `Semantic Location History.json`
- `All the .json files from Google Fit "All Sessions".`

- Facebook
- `device_location.json`
- `primary_location.json`
- `primary_public_location.json`

### Basic usage
Below is the basic example to use excavator. Which will recusively find the applicable file from *directory* and extract the data.

`$ excavator read TakeOut`

Or you can specify the single file

`$ excavator read Location History.json`

Then it will store the data into database.
2 changes: 2 additions & 0 deletions docs/user/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,3 +5,5 @@ slug: "/user"
---

To help you get a hold of your personal data, we developed a tool called Excavator. Excavator extracts, stores and visualizes your personal data exports.

In this part, you will learn how to safely collect and analyze your own data locally.
7 changes: 7 additions & 0 deletions docs/user/takeout/facebook.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,3 +22,10 @@ The following datasets of Google Takeout are currently supported by Ichnion:
| Device Location | yes |
| Primary Location | yes |
| Primary Public Location | yes |
| Last location | ? |

:::tip

After downloading location data from Facebook, you may have empty files. If yes, you should check in your device's settings if Facebook is allowed to use your location. [To turn it on](https://www.facebook.com/help/275925085769221).

:::
8 changes: 7 additions & 1 deletion docs/user/takeout/google.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ The following datasets of Google Takeout are currently supported by Ichnion:
| Currents Stream | ? |
| Data Shared for Research | ? |
| Drive | ? |
| Fit | ? |
| Fit | yes |
| Google Account | ? |
| Google Cloud Search | ? |
| Google Help Communities | ? |
Expand Down Expand Up @@ -71,3 +71,9 @@ The following datasets of Google Takeout are currently supported by Ichnion:
| Tasks | ? |
| Voice | ? |
| YouTube and YouTube Music | ? |

:::tip

After downloading data from Google Takeout, you may have empty files. If yes, you should check in your Google account's settings if Google is allowed to collect your data. To check it : Click on your Google account > Manage your Google account > Data & personalization > turn on activity controls.

:::
7 changes: 7 additions & 0 deletions docs/user/visualize/jupyter.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,3 +3,10 @@ title: Jupyter Notebook
---

Visualization empowers you to inspect your digital footprints including potential values and possible risks. And it enables you to understand what data is collected about us.

# How to use Jupyter Notebook with Ichnion ?

If you are not familiar with Jupyter Notebook, you can follow [this tutorial](https://www.dataquest.io/blog/jupyter-notebook-tutorial/), or look at [the other visualization](https://ichnion.github.io/website/docs/user/visualize/other).

Otherwise, [download the Jupyter example](https://github.com/ichnion/jupyter-examples) we made and follow the same steps as in the google-location-history.ipynb file to visualize your data.

2 changes: 1 addition & 1 deletion sidebars.js
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
module.exports = {
docs: {
'Ichnion': [
'overview', 'about', 'quickstart', 'join',
'about', 'quickstart', 'join',
],
'User Guide': [
'user/index', 'user/install',
Expand Down