.github/workflows/main.yml

@@ -0,0 +1,19 @@
+name: CI
+
+on: [push]
+
+jobs:
+  build:
+
+    runs-on: ubuntu-latest
+    strategy:
+      matrix:
+        python-version: [3.6, 3.7, 3.8]
+
+    steps:
+    - uses: actions/checkout@v1
+    - name: Set up and test with Python ${{ matrix.python-version }}
+      run: |
+        sudo apt-get install python3-pip bats
+        pip3 install numpy pandas openpyxl
+        ./test

EXAMPLES.md

@@ -78,15 +78,6 @@ $ opy 'B:[1+1]'
 2
 ```
 
-### import of modules
-
-```
-$ seq 1 3 | opy -m math '[ F1*math.pi, math.sin(F1) ]' 
-3.141592653589793 0.8414709848078965
-6.283185307179586 0.9092974268256817
-9.42477796076938 0.1411200080598672
-```
-
 ### dynamic load of modules 
 
 ```
@@ -137,20 +128,6 @@ $ seq 10 | opy 'r_("[24680]", F1)'
 10
 ```
 
-* field selection
-
-```
-$ echo {1..10} | opy '[join(F,[2,3,4,6,7,8])]'
-2 3 4 6 7 8
-```
-
-* field drop
-
-```
-$ echo {1..10} | opy '[dropjoin(F0,[2,3,5])]'
-1 4 6 7 8 9 10
-```
-
 ### input from file
 
 ```
@@ -174,33 +151,91 @@ $ seq 10 | opy 'NR%2:{L.append(F1)};E:[L]'
 [1, 3, 5, 7, 9]
 ```
 
+## use of scipy
+
+* integrate
+
+```
+opy 'B:{from scipy import integrate};B:{def f(x): return 2*x};B:[integrate.quad(f,0,5)]'
+(25.0, 2.7755575615628914e-13)
+```
+
 ## options
 
-* `--help`: show help
-* `-m <modules>`: load modules
-* `-s`: string mode
-    * prohibit automatic number conversions.
-* `-i, -o`: input/output field separator
+
+* `-c`: read data as CSVs
 
 ```
-$ echo '1,2,3,4,5' | opy -i , '[F2]'
-2
-$ echo '1,2,3,4,5' | opy -i , -o x '[Fs(2,4)]'
-2x3x4
+$ echo 'a,"b,","c"""' | opy -c '[F1,F2,F3]'
+a b, c"
+```
+
+* `-C`: output data with a CSV format
+
+```
+$ echo '1 2 3' | opy -C True
+"1","2","3"
+$ echo '1 "2,3" 3 "' | opy -C True
+"1","""2,3""","3",""""
+```
+
+* `-s`: treat numbers from input data as strings
+
+
+
+* `-i`: separators change input field separators
+
+```
+$ echo 100 JPY | opy '[F1+F2]'
+(error!!)
+$ echo 100 JPY | opy -s '[F1+F2]'
+100JPY
 ```
 
-* `-I`: regex input field separator
+* `-I`: separators change input field separators with a regular expression
+
 
 ```
-$ echo a33b313c | tr ' ' , | opy -I '\d+' '[Fs(1,3)]'
+$ echo a,b@c | opy -I '[,@]' '[F1,F2,F3]'
 a b c
 ```
 
-## use of scipy
+* `-m`: modules import modules
+
+```
+$ opy -m numpy 'E:{print(numpy.pi)}'
+3.141592653589793
+$ opy -m math,numpy 'B:[math.e,numpy.e]'
+2.718281828459045 2.718281828459045
+```
+
+
+* `-o`: separators change output field separators
 
-* integrate
 
 ```
-opy 'B:{from scipy import integrate};B:{def f(x): return 2*x};B:[integrate.quad(f,0,5)]'
-(25.0, 2.7755575615628914e-13)
+$ echo a,b@c | opy -I '[,@]' -o '=' '[F1,F2,F3]'
+a=b=c
+```
+
+* `-v`: `<variable>=<string>` define a variable from a string on the shell
+
+```
+$ a=abc
+$ opy -v "b=$a" 'B:[b*2]'
+abcabc
 ```
+
+* `-t <json/yaml/xml>`: read a json/yaml/xml file and set the data to an object "T".
+
+```
+$ echo '{"hoge":["a","b"]}' | opy -t json '[*T["hoge"]]'
+a
+b
+$ echo -e 'aho:\n  boke: ["a","b"]' | opy -t yaml '[*T["aho"]["boke"]]'
+a
+b
+$ echo -e '<?xml version="1.0" encoding="utf-8"?>\n<foo>bar</foo>' | opy -t xml '[e.text for e in T.iter("foo")]'
+bar
+```
+

README.md

@@ -2,8 +2,6 @@
 
  a Python wrapper that works like AWK or rb command
 
-[![Build Status](https://travis-ci.org/ryuichiueda/opy.svg?branch=master)](https://travis-ci.org/ryuichiueda/opy)
-
 ## example of use
 
 ```
@@ -17,6 +15,17 @@ $ seq 3 | opy '[math.sin(F1)]'
 
 ## install
 
+### the simplest way
+
+You can install `opy` with 
+
+```
+$ chmod +x opy
+$ sudo cp opy /usr/local/bin/     # Please check PATH.
+```
+
+since `opy` is an independent script file.
+
 ### make
 
 The `opy` file and its manual are copied to `/usr/local/bin/` and `/usr/local/share/man/man1/` respectively with the following command.
@@ -25,31 +34,30 @@ The `opy` file and its manual are copied to `/usr/local/bin/` and `/usr/local/sh
 $ sudo make install
 ```
 
+
 ### homebrew
 
+The version remains old because I don't have a Mac PC anymore...
+
 ```
 $ brew tap ryuichiueda/oneliner-python
 $ brew install oneliner-python
 ```
 
 ## options
 
+See [EXAMPLES.md](./EXAMPLES.md)
+
+* `-b`: buffer the standard output
+* `-c`: read each line as CSV data
+* `-C`: output data with a CSV format
+* `-s`: treat numbers from input data as strings
+* `-i <separator>`: separators change input field separators
+* `-I <separator>`: separators change input field separators with a regular expression
+* `-m <module>`: modules import modules
+* `-o <separator>`: separators change output field separators
+* `-v <variable>=<string>`: define a variable from a string on the shell
+* `-t <json/yaml/xml/csv/xslx>`: tree mode (read a json/yaml/xml/csv/xslx file entirely and set the data to an object "T".)
 * `--help`: show help
-* `-m <modules>`: load modules
-* `-s`: string mode
-    * prohibit automatic number conversions.
-* `-i, -o`: input/output field separator
 
-```
-$ echo '1,2,3,4,5' | opy -i , '[F2]'
-2
-$ echo '1,2,3,4,5' | opy -i , -o x '[F2,F3,F4]'
-2x3x4
-```
 
-* `-I`: regex input field separator
-
-```
-$ echo a33b313c | tr ' ' , | opy -I '\d+' '[*F[1:]]'
-a b c
-```