Skip to content

Commit

Permalink
test(tpch): add warmup (IGinX-THU#547)
Browse files Browse the repository at this point in the history
为 tpch 添加warmup步骤
重构相关 action
tpch 测试中查询语句使用 19a 替代 19,以启用 iotdb12 在下推情况下的测试
使用 19a 代替 19后, 无下推情况下 influxdb 的tpch测试卡死,故将查询并发限制为2
  • Loading branch information
aqni authored Jan 10, 2025
1 parent 80e7dce commit ae379f6
Show file tree
Hide file tree
Showing 37 changed files with 1,044 additions and 1,426 deletions.
324 changes: 142 additions & 182 deletions .github/actions/confWriter/action.yml

Large diffs are not rendered by default.

111 changes: 0 additions & 111 deletions .github/actions/dbConfWriter/action.yml

This file was deleted.

71 changes: 0 additions & 71 deletions .github/actions/dbRunner/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,15 +33,6 @@ inputs:
runs:
using: "composite" # Mandatory parameter
steps:
- id: project
uses: ./.github/actions/project

- name: Modify IGinX Config
uses: ./.github/actions/edit
with:
paths: conf/config.properties
statements: s/^storageEngineList=/#storageEngineList=/g

- if: inputs.DB-name=='InfluxDB' || inputs.DB-name=='Mix-IoTDB12-InfluxDB'
name: Setup DB
uses: ./.github/actions/setup/influxdb
Expand Down Expand Up @@ -86,19 +77,6 @@ runs:
exit 1
fi
- if: inputs.DB-name=='Mix-IoTDB12-InfluxDB'
name: Modify IGinX Config
uses: ./.github/actions/edit
with:
paths: conf/config.properties
statements: s/storageEngineList/#storageEngineList/g

- if: inputs.DB-name=='Mix-IoTDB12-InfluxDB'
name: Run DB
shell: bash
run: |
echo "storageEngineList=127.0.0.1#6667#iotdb12#username=root#password=root#sessionPoolSize=50#has_data=false#is_read_only=false,127.0.0.1#8086#influxdb#url=http://localhost:8086/#token=testToken#organization=testOrg#has_data=false" >> conf/config.properties
- if: inputs.DB-name=='MongoDB'
name: Setup DB
uses: ./.github/actions/setup/mongodb
Expand All @@ -112,13 +90,6 @@ runs:
start: true
ports: ${{ inputs.MongoDB-ports }}

- if: inputs.DB-name=='MongoDB'
name: Modify IGinX Config
uses: ./.github/actions/edit
with:
paths: conf/config.properties
statements: s/^#storageEngineList=127.0.0.1#27017/storageEngineList=127.0.0.1#27017/g

- if: inputs.DB-name=='Redis'
name: Setup DB
uses: ./.github/actions/setup/redis
Expand All @@ -132,13 +103,6 @@ runs:
start: true
ports: ${{ inputs.Redis-ports }}

- if: inputs.DB-name=='Redis'
name: Modify IGinX Config
uses: ./.github/actions/edit
with:
paths: conf/config.properties
statements: s/^#storageEngineList=127.0.0.1#6379/storageEngineList=127.0.0.1#6379/g

- if: inputs.DB-name=='PostgreSQL'
name: Setup DB
uses: ./.github/actions/setup/postgresql
Expand All @@ -152,13 +116,6 @@ runs:
start: true
ports: ${{ inputs.PostgreSQL-ports }}

- if: inputs.DB-name=='PostgreSQL'
name: Modify IGinX Config
uses: ./.github/actions/edit
with:
paths: conf/config.properties
statements: s/^#storageEngineList=127.0.0.1#5432#relational#engine=postgresql/storageEngineList=127.0.0.1#5432#relational#engine=postgresql/g

- if: inputs.DB-name=='MySQL'
name: Setup DB
uses: ./.github/actions/setup/mysql
Expand All @@ -168,31 +125,3 @@ runs:
uses: ./.github/actions/service/mysql
with:
ports: ${{ inputs.MySQL-ports }}

- if: inputs.DB-name == 'MySQL'
name: Modify IGinX Config
uses: ./.github/actions/edit
with:
paths: conf/config.properties
statements: s|^#storageEngineList=127.0.0.1#3306#relational#engine=mysql#username=root#password=mysql#has_data=false#meta_properties_path=your-meta-properties-path|storageEngineList=127.0.0.1#3306#relational#engine=mysql#username=root#has_data=false|g

- if: inputs.DB-name=='FileSystem'
name: Run DB
shell: bash
run: |
cp -f "${GITHUB_WORKSPACE}/conf/config.properties" "${GITHUB_WORKSPACE}/conf/config.properties.bak"
- if: inputs.DB-name == 'FileSystem'
name: Modify IGinX Config
uses: ./.github/actions/edit
with:
paths: conf/config.properties
statements: |
s/^#storageEngineList=127.0.0.1#[0-9]*#filesystem/storageEngineList=127.0.0.1#6668#filesystem/g
s#dir=data#dir=${{ steps.project.outputs.workspace }}/test/iginx_mn#g
s#dummy_dir=dummy#dummy_dir=${{ steps.project.outputs.workspace }}/test/mn#g
s/data.config.write.buffer.size=104857600/data.config.write.buffer.size=1048576/g
s/dummy.struct=LegacyFilesystem/dummy.struct=LegacyParquet/g
s/chunk_size_in_bytes=1048576/chunk_size_in_bytes=8/g
s/write.buffer.size=104857600/write.buffer.size=1048576/g
s/client.connectPool.maxTotal=100/client.connectPool.maxTotal=2/g
66 changes: 0 additions & 66 deletions .github/actions/service/portMapper/action.yml

This file was deleted.

57 changes: 0 additions & 57 deletions .github/actions/tpchDataWriter/action.yml

This file was deleted.

Loading

0 comments on commit ae379f6

Please sign in to comment.