Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hydra framework changes to have .. #947

Open
wants to merge 61 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
61 commits
Select commit Hold shift + click to select a range
b568896
- Refactoring of ct.bt
sonalsagarwal Jul 10, 2017
5eb8cca
Merge branch 'master' into SNAP-1786
sonalsagarwal Jul 11, 2017
9e5fd71
- Scala formating changes
sonalsagarwal Jul 12, 2017
1ed4f82
Merge branch 'master' into SNAP-1786
sonalsagarwal Jul 20, 2017
67e3d74
Merge branch 'master' into SNAP-1786
sonalsagarwal Aug 14, 2017
6d028d1
- Test changes in ct.bt
sonalsagarwal Aug 14, 2017
18cb157
Merge branch 'master' into SNAP-1786
sonalsagarwal Feb 2, 2018
37b5d93
Merge branch 'master' into SNAP-1786
sonalsagarwal Feb 5, 2018
14e6275
- Code formating changes in northWind.bt
sonalsagarwal Feb 5, 2018
83e7732
- Futher refactoring changes to northwind and ct bts.
sonalsagarwal Feb 7, 2018
4a2ea6a
- Some chanegs in log messages.
sonalsagarwal Feb 7, 2018
2fbf22c
- Fixing minor test issue.
sonalsagarwal Feb 9, 2018
26fa3dc
- Changes related to SNAP-2208 : Use --conf to set snappy.connection …
sonalsagarwal Feb 9, 2018
676fbe2
- Changes for SNAP-2210 : Changing the test configuration to have 2 l…
sonalsagarwal Feb 9, 2018
653db9e
- Support for having user specified connection properties
sonalsagarwal Apr 3, 2018
27cfdf6
Merge branch 'master' into SNAP-1786
sonalsagarwal Apr 3, 2018
3d3622a
- Fixing a test issue.
sonalsagarwal Apr 11, 2018
875d599
Merge branch 'master' into SNAP-1786
sonalsagarwal Sep 3, 2018
7a8d1c1
Merge branch 'master' into SNAP-1786
Sep 3, 2018
e81fa9b
- Missed in the previous merge.
sonalsagarwal Sep 3, 2018
b5955fb
- Fixing compilation issues.
sonalsagarwal Sep 3, 2018
e9d04df
- Adding changes for stack dump at the end of the test.
Sep 12, 2018
4908e5f
Merge branch 'master' into SNAP-1786
sonalsagarwal Sep 25, 2018
1cde168
- Minor fixes in the validation code.
sonalsagarwal Sep 26, 2018
4689d45
Merge branch 'master' into SNAP-1786
Oct 29, 2018
9c5374d
Merge branch 'master' into SNAP-1786
Oct 29, 2018
fe2f2b2
- test changes to have thread dump only on test failure or hang.
sonalsagarwal Oct 29, 2018
57e82fb
- Adding test flag to avoid hydra to stop the snappy and spark clusters.
sonalsagarwal Oct 30, 2018
6215825
- Fixing issue with return for grep command process output.
sonalsagarwal Nov 2, 2018
70bdf12
Merge branch 'master' into SNAP-1786
sonalsagarwal Nov 2, 2018
704340f
Merge branch 'master' into SNAP-1786
sonalsagarwal Nov 11, 2018
151f872
- Changes to make hydra TPCH test working after changes in the perf f…
sonalsagarwal Nov 13, 2018
05c3987
- Adding local conf for snapshotIsolation test.
sonalsagarwal Nov 13, 2018
fc794f7
Merge branch 'master' into SNAP-1786
sonalsagarwal Nov 13, 2018
d532c5b
- Fix in the suspect string code.
sonalsagarwal Nov 15, 2018
05d1d44
- Adding timestamp to the logs printed in the sprak app or snappy job…
sonalsagarwal Nov 16, 2018
d70044a
Merge branch 'master' into SNAP-1786
sonalsagarwal Nov 18, 2018
e13d0a9
Merge branch 'master' into SNAP-1786
sonalsagarwal Nov 18, 2018
9e24809
Merge branch 'master' into SNAP-1786
sonalsagarwal Nov 26, 2018
e01ce13
Merge branch 'master' into SNAP-1786
sonalsagarwal Nov 26, 2018
a92a9ad
Merge branch 'master' into SNAP-1786
sonalsagarwal Dec 3, 2018
a5ac251
- Fixing minor issue in northwind test with eviction.
sonalsagarwal Dec 5, 2018
e696164
Merge branch 'master' into SNAP-1786
sonalsagarwal Dec 5, 2018
b2aca95
- Some formating and code refactoring.
sonalsagarwal Dec 31, 2018
c0d47c5
Merge branch 'master' into SNAP-1786
sonalsagarwal Dec 31, 2018
32cb9ec
- Adding test cases for snappyJob and spark App failure and hang.
sonalsagarwal Jan 17, 2019
156867c
Merge branch 'master' into SNAP-1786
sonalsagarwal Jan 17, 2019
278e161
Merge branch 'master' into SNAP-1786
sonalsagarwal Feb 6, 2019
54baa7e
- Adding method for changing log level at runtime. In case of failure…
sonalsagarwal Feb 7, 2019
280af3d
Merge branch 'master' into SNAP-1786
May 22, 2019
2024c3a
- Some formating changes.
Jun 3, 2019
19f880d
Merge branch 'master' into SNAP-1786
Jun 3, 2019
0eda14d
- Adding changes for throwing exception of job failure (for end-to-en…
Jun 6, 2019
570952b
Merge branch 'master' into SNAP-1786
Aug 28, 2019
bd2f336
- Missed changes while resolving conflict.
Aug 30, 2019
5d5593a
Merge branch 'SNAP-1786' of https://github.com/SnappyDataInc/snappyda…
sonalsagarwal Aug 30, 2019
40ffba5
- Some changes in the validation for dataframes, using dataframe APIs…
Sep 6, 2019
cd9ab83
Merge branch 'master' into SNAP-1786
Sep 6, 2019
6a12a57
- Fixing compilation errors.
Sep 6, 2019
609714d
- Changing the way we compare dataframes, use dataframe apis.
Sep 27, 2019
8b178eb
- Minor fix
Oct 10, 2019
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
45 changes: 1 addition & 44 deletions cluster/src/test/scala/org/apache/spark/sql/NWQueries.scala
Original file line number Diff line number Diff line change
Expand Up @@ -787,80 +787,37 @@ object NWQueries extends SnappyFunSuite {
"Q23" -> Q23,
"Q24" -> Q24,
"Q25" -> Q25,
"Q25_1" -> Q25_1,
"Q25_2" -> Q25_2,
"Q26" -> Q26,
"Q26_1" -> Q26_1,
"Q26_2" -> Q26_2,
"Q27" -> Q27,
"Q27_1" -> Q27_1,
"Q27_2" -> Q27_2,
"Q27_3" -> Q27_3,
"Q27_4" -> Q27_4,
"Q28" -> Q28,
"Q28_1" -> Q28_1,
"Q28_2" -> Q28_2,
"Q29" -> Q29,
"Q29_1" -> Q29_1,
"Q29_2" -> Q29_2,
"Q30" -> Q30,
"Q30_1" -> Q30_1,
"Q30_2" -> Q30_2,
"Q31" -> Q31,
"Q31_1" -> Q31_1,
"Q31_2" -> Q31_2,
"Q31_3" -> Q31_3,
"Q31_4" -> Q31_4,
"Q32" -> Q32,
"Q32_1" -> Q32_1,
"Q33" -> Q33,
"Q33_1" -> Q33_1,
"Q34" -> Q34,
"Q34_1" -> Q34_1,
"Q34_2" -> Q34_2,
"Q35" -> Q35,
"Q35_1" -> Q35_1,
"Q35_2" -> Q35_2,
"Q36" -> Q36,
"Q36_1" -> Q36_1,
"Q36_2" -> Q36_2,
"Q37" -> Q37,
"Q38" -> Q38,
"Q38_1" -> Q38_1,
"Q38_2" -> Q38_2,
"Q39" -> Q39,
"Q40" -> Q40,
"Q40_1" -> Q40_1,
"Q40_2" -> Q40_2,
"Q41" -> Q41,
"Q42" -> Q42,
"Q42_1" -> Q42_1,
"Q42_2" -> Q42_2,
"Q43" -> Q43,
"Q43_1" -> Q43_1,
"Q43_2" -> Q43_2,
"Q44" -> Q44,
"Q45" -> Q45,
"Q46" -> Q46,
"Q47" -> Q47,
"Q48" -> Q48,
"Q49" -> Q49,
"Q49_1" -> Q49_1,
"Q49_2" -> Q49_2,
"Q50" -> Q50,
"Q51" -> Q51,
"Q51_1" -> Q51_1,
"Q51_2" -> Q51_2,
"Q52" -> Q52,
"Q53" -> Q53,
"Q54" -> Q54,
"Q55" -> Q55,
"Q55_1" -> Q55_1,
"Q55_2" -> Q55_2,
"Q56" -> Q56,
"Q56_1" -> Q56_1,
"Q56_2" -> Q56_2,
"Q56_3" -> Q56_3
"Q56" -> Q56
)

def regions(sqlContext: SQLContext): DataFrame =
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,105 @@
-- DROP TABLE IF ALREADY EXISTS --
DROP TABLE IF EXISTS ORDERS_DETAILS;
DROP TABLE IF EXISTS staging_orders_details;

-- CREATE PARTITIONED ROW TABLE ORDERS_DETAILS --
CREATE EXTERNAL TABLE staging_orders_details USING com.databricks.spark.csv
OPTIONS (path ':dataLocation/ORDERS_DETAILS.dat', header 'true', inferSchema 'false',
nullValue 'NULL');

CREATE TABLE ORDERS_DETAILS
(SINGLE_ORDER_DID BIGINT ,SYS_ORDER_ID VARCHAR(64) ,SYS_ORDER_VER INTEGER ,DATA_SNDG_SYS_NM VARCHAR(128) ,
SRC_SYS VARCHAR(20) ,SYS_PARENT_ORDER_ID VARCHAR(64) ,SYS_PARENT_ORDER_VER SMALLINT ,PARENT_ORDER_TRD_DATE VARCHAR(20),
PARENT_ORDER_SYS_NM VARCHAR(128) ,SYS_ALT_ORDER_ID VARCHAR(64) ,TRD_DATE VARCHAR(20),GIVE_UP_BROKER VARCHAR(20) ,
EVENT_RCV_TS TIMESTAMP ,SYS_ROOT_ORDER_ID VARCHAR(64) ,GLB_ROOT_ORDER_ID VARCHAR(64) ,GLB_ROOT_ORDER_SYS_NM VARCHAR(128) ,
GLB_ROOT_ORDER_RCV_TS TIMESTAMP ,SYS_ORDER_STAT_CD VARCHAR(20) ,SYS_ORDER_STAT_DESC_TXT VARCHAR(120) ,DW_STAT_CD VARCHAR(20) ,
EVENT_TS TIMESTAMP,ORDER_OWNER_FIRM_ID VARCHAR(20),RCVD_ORDER_ID VARCHAR(64) ,EVENT_INITIATOR_ID VARCHAR(64),
TRDR_SYS_LOGON_ID VARCHAR(64),SOLICITED_FG VARCHAR(1),RCVD_FROM_FIRMID_CD VARCHAR(20),RCV_DESK VARCHAR(20),
SYS_ACCT_ID_SRC VARCHAR(64) ,CUST_ACCT_MNEMONIC VARCHAR(128),CUST_SLANG VARCHAR(20) ,SYS_ACCT_TYPE VARCHAR(20) ,
CUST_EXCH_ACCT_ID VARCHAR(64) ,SYS_SECURITY_ALT_ID VARCHAR(64) ,TICKER_SYMBOL VARCHAR(32) ,TICKER_SYMBOL_SUFFIX VARCHAR(20) ,
PRODUCT_CAT_CD VARCHAR(20) ,SIDE VARCHAR(20) ,LIMIT_PRICE DECIMAL(38, 18),STOP_PRICE DECIMAL(38, 18),ORDER_QTY DECIMAL(18, 4) ,
TOTAL_EXECUTED_QTY DECIMAL(18, 4) ,AVG_PRICE DECIMAL(38, 18) ,DAY_EXECUTED_QTY DECIMAL(18, 4) ,DAY_AVG_PRICE DECIMAL(38, 18) ,
REMNG_QTY DECIMAL(18, 4) ,CNCL_QTY DECIMAL(18, 4) ,CNCL_BY_FG VARCHAR(1) ,EXPIRE_TS TIMESTAMP ,EXEC_INSTR VARCHAR(64) ,
TIME_IN_FORCE VARCHAR(20) ,RULE80AF VARCHAR(1) ,DEST_FIRMID_CD VARCHAR(20) ,SENT_TO_CONDUIT VARCHAR(20) ,SENT_TO_MPID VARCHAR(20) ,
RCV_METHOD_CD VARCHAR(20) ,LIMIT_ORDER_DISP_IND VARCHAR(1) ,MERGED_ORDER_FG VARCHAR(1) ,MERGED_TO_ORDER_ID VARCHAR(64) ,
RCV_DEPT_ID VARCHAR(20) ,ROUTE_METHOD_CD VARCHAR(20) ,LOCATE_ID VARCHAR(256) ,LOCATE_TS TIMESTAMP ,LOCATE_OVERRIDE_REASON VARCHAR(2000) ,
LOCATE_BROKER VARCHAR(256) ,ORDER_BRCH_SEQ_TXT VARCHAR(20) ,IGNORE_CD VARCHAR(20) ,CLIENT_ORDER_REFID VARCHAR(64) ,
CLIENT_ORDER_ORIG_REFID VARCHAR(64) ,ORDER_TYPE_CD VARCHAR(20) ,SENT_TO_ORDER_ID VARCHAR(64) ,ASK_PRICE DECIMAL(38, 18) ,
ASK_QTY DECIMAL(18, 4) ,BID_PRICE DECIMAL(38, 18) ,BID_QTY DECIMAL(18, 4) ,REG_NMS_EXCEP_CD VARCHAR(20) ,REG_NMS_EXCEP_TXT VARCHAR(2000) ,
REG_NMS_LINK_ID VARCHAR(64) ,REG_NMS_PRINTS VARCHAR(1) ,REG_NMS_STOP_TIME TIMESTAMP ,SENT_TS TIMESTAMP ,RULE92 VARCHAR(1) ,
RULE92_OVERRIDE_TXT VARCHAR(2000) ,RULE92_RATIO DECIMAL(25, 10) ,EXMPT_STGY_BEGIN_TIME TIMESTAMP ,EXMPT_STGY_END_TIME TIMESTAMP ,
EXMPT_STGY_PRICE_INST VARCHAR(2000) ,EXMPT_STGY_QTY DECIMAL(18, 4) ,CAPACITY VARCHAR(20) ,DISCRETION_QTY DECIMAL(18, 4) ,
DISCRETION_PRICE VARCHAR(64) ,BRCHID_CD VARCHAR(20) ,BASKET_ORDER_ID VARCHAR(64) ,PT_STRTGY_CD VARCHAR(20) ,
SETL_DATE VARCHAR(20),SETL_TYPE VARCHAR(20) ,SETL_CURR_CD VARCHAR(20) ,SETL_INSTRS VARCHAR(2000) ,COMMENT_TXT VARCHAR(2000) ,
CHANNEL_NM VARCHAR(128) ,FLOW_CAT VARCHAR(20) ,FLOW_CLASS VARCHAR(20) ,FLOW_TGT VARCHAR(20) ,ORDER_FLOW_ENTRY VARCHAR(20) ,
ORDER_FLOW_CHANNEL VARCHAR(20) ,ORDER_FLOW_DESK VARCHAR(20) ,FLOW_SUB_CAT VARCHAR(20) ,STRTGY_CD VARCHAR(20) ,RCVD_FROM_VENDOR VARCHAR(20) ,
RCVD_FROM_CONDUIT VARCHAR(20) ,SLS_PERSON_ID VARCHAR(64) ,SYNTHETIC_FG VARCHAR(1) ,SYNTHETIC_TYPE VARCHAR(20) ,FXRT DECIMAL(25, 8) ,
PARENT_CLREFID VARCHAR(64) ,REF_TIME_ID INTEGER ,OPT_CONTRACT_QTY DECIMAL(18, 4) ,OCEAN_PRODUCT_ID BIGINT ,CREATED_BY VARCHAR(64) ,
CREATED_DATE TIMESTAMP ,FIRM_ACCT_ID BIGINT ,DEST VARCHAR(20) ,CNTRY_CD VARCHAR(20) ,DW_SINGLE_ORDER_CAT VARCHAR(20) ,CLIENT_ACCT_ID BIGINT ,
EXTERNAL_TRDR_ID VARCHAR(64) ,ANONYMOUS_ORDER_FG VARCHAR(1) ,SYS_SECURITY_ALT_SRC VARCHAR(20) ,CURR_CD VARCHAR(20) ,
EVENT_TYPE_CD VARCHAR(20) ,SYS_CLIENT_ACCT_ID VARCHAR(64) ,SYS_FIRM_ACCT_ID VARCHAR(20) ,SYS_TRDR_ID VARCHAR(64) ,DEST_ID INTEGER ,
OPT_PUT_OR_CALL VARCHAR(20) ,SRC_FEED_REF_CD VARCHAR(64) ,DIGEST_KEY VARCHAR(128) ,EFF_TS TIMESTAMP ,ENTRY_TS TIMESTAMP ,
OPT_STRIKE_PRICE DECIMAL(38, 18) ,OPT_MATURITY_DATE VARCHAR(20) ,ORDER_RESTR VARCHAR(4) ,SHORT_SELL_EXEMPT_CD VARCHAR(4) ,
QUOTE_TIME TIMESTAMP ,SLS_CREDIT VARCHAR(20) ,SYS_SECURITY_ID VARCHAR(64) ,SYS_SECURITY_ID_SRC VARCHAR(20) ,SYS_SRC_SYS_ID VARCHAR(20) ,
SYS_ORDER_ID_UNIQUE_SUFFIX VARCHAR(20) ,DEST_ID_SRC VARCHAR(4) ,GLB_ROOT_SRC_SYS_ID VARCHAR(20) ,GLB_ROOT_ORDER_ID_SUFFIX VARCHAR(64) ,
SYS_ROOT_ORDER_ID_SUFFIX VARCHAR(20) ,SYS_PARENT_ORDER_ID_SUFFIX VARCHAR(20) ,CREDIT_BREACH_PERCENT DECIMAL(25, 10) ,
CREDIT_BREACH_OVERRIDE VARCHAR(256) ,INFO_BARRIER_ID VARCHAR(256) ,EXCH_PARTICIPANT_ID VARCHAR(64) ,REJECT_REASON_CD VARCHAR(4) ,
DIRECTED_DEST VARCHAR(20) ,REG_NMS_LINK_TYPE VARCHAR(20) ,CONVER_RATIO DECIMAL(18, 9) ,STOCK_REF_PRICE DECIMAL(38, 18) ,
CB_SWAP_ORDER_FG VARCHAR(1) ,EV DECIMAL(38, 18) ,SYS_DATA_MODIFIED_TS TIMESTAMP ,CMSN_TYPE VARCHAR(20) ,SYS_CREDIT_TRDR_ID VARCHAR(20) ,
SYS_ENTRY_USER_ID VARCHAR(20) ,OPEN_CLOSE_CD VARCHAR(20) ,AS_OF_TRD_FG VARCHAR(1) ,HANDLING_INSTR VARCHAR(20) ,SECURITY_DESC VARCHAR(512) ,
MINIMUM_QTY DECIMAL(21, 6) ,CUST_OR_FIRM VARCHAR(20) ,MAXIMUM_SHOW DECIMAL(21, 6) ,SECURITY_SUB_TYPE VARCHAR(20) ,MULTILEG_RPT_TYPE VARCHAR(4) ,
ORDER_ACTION_TYPE VARCHAR(4) ,BARRIER_STYLE VARCHAR(4) ,AUTO_IOI_REF_TYPE VARCHAR(4) ,PEG_OFFSET_VAL DECIMAL(10, 2) ,AUTO_IOI_OFFSET DECIMAL(28, 12) ,
IOI_PRICE DECIMAL(28, 12) ,TGT_PRICE DECIMAL(28, 12) ,IOI_QTY VARCHAR(64) ,IOI_ORDER_QTY DECIMAL(18, 4) ,CMSN VARCHAR(64) ,SYS_LEG_REF_ID VARCHAR(64) ,
TRADING_TYPE VARCHAR(4) ,EXCH_ORDER_ID VARCHAR(64) ,DEAL_ID VARCHAR(64) ,ORDER_TRD_TYPE VARCHAR(4) ,CXL_REASON VARCHAR(64))
USING ROW OPTIONS (partition_by 'SINGLE_ORDER_DID', buckets '11',redundancy ':redundancy', EVICTION_BY ':evictionByOption', OVERFLOW 'true');

INSERT INTO ORDERS_DETAILS SELECT * FROM staging_orders_details;

-- DROP TABLE IF ALREADY EXISTS --
DROP TABLE IF EXISTS EXEC_DETAILS;
DROP TABLE IF EXISTS staging_exec_details;

-- CREATE PARTITONED ROW TABLE EXEC_DETAILS --
CREATE EXTERNAL TABLE staging_exec_details USING com.databricks.spark.csv
OPTIONS (path ':dataLocation/EXEC_DETAILS.dat', header 'true', inferSchema 'false', nullValue 'NULL');

CREATE TABLE EXEC_DETAILS
(EXEC_DID BIGINT,SYS_EXEC_VER INTEGER,SYS_EXEC_ID VARCHAR(64),TRD_DATE VARCHAR(20),ALT_EXEC_ID VARCHAR(64),SYS_EXEC_STAT VARCHAR(20),
DW_EXEC_STAT VARCHAR(20),ORDER_OWNER_FIRM_ID VARCHAR(20),TRDR_SYS_LOGON_ID VARCHAR(64),CONTRA_BROKER_MNEMONIC VARCHAR(20),SIDE VARCHAR(20),
TICKER_SYMBOL VARCHAR(32),SYS_SECURITY_ALT_ID VARCHAR(64),PRODUCT_CAT_CD VARCHAR(20),LAST_MKT VARCHAR(20),EXECUTED_QTY DECIMAL(18, 4),
EXEC_PRICE DECIMAL( 38, 18),EXEC_PRICE_CURR_CD VARCHAR(20),EXEC_CAPACITY VARCHAR(20),CLIENT_ACCT_ID BIGINT,FIRM_ACCT_ID BIGINT,
AVG_PRICE_ACCT_ID BIGINT,OCEAN_ACCT_ID BIGINT,EXEC_CNTRY_CD VARCHAR(20),CMSN VARCHAR(20),COMMENT_TXT VARCHAR(2000),
ACT_BRCH_SEQ_TXT VARCHAR(20),IGNORE_CD VARCHAR(20),SRC_SYS VARCHAR(20),EXEC_TYPE_CD VARCHAR(20),LIQUIDITY_CD VARCHAR(20),
ASK_PRICE DECIMAL( 38, 18),ASK_QTY DECIMAL(18, 4),TRD_REPORT_ASOF_DATE VARCHAR(20),BID_PRICE DECIMAL( 38, 18),BID_QTY DECIMAL(18, 4),
CROSS_ID VARCHAR(64),NYSE_SUBREPORT_TYPE VARCHAR(20),QUOTE_COORDINATOR VARCHAR(20),QUOTE_TIME TIMESTAMP,REG_NMS_EXCEPT_CD VARCHAR(20),
REG_NMS_EXCEPT_TXT VARCHAR(2000),REG_NMS_LINK_ID VARCHAR(64),REG_NMS_MKT_CENTER_ID VARCHAR(64),REG_NMS_OVERRIDE VARCHAR(20),REG_NMS_PRINTS VARCHAR(1),
EXECUTED_BY VARCHAR(20),TICKER_SYMBOL_SUFFIX VARCHAR(20),PREREGNMS_TRD_MOD1 VARCHAR(1),PREREGNMS_TRD_MOD2 VARCHAR(1),PREREGNMS_TRD_MOD3 VARCHAR(1),
PREREGNMS_TRD_MOD4 VARCHAR(1),NMS_FG VARCHAR(1),GIVEUP_BROKER VARCHAR(20),CHANNEL_NM VARCHAR(128),ORDER_FLOW_ENTRY VARCHAR(20),FLOW_CAT VARCHAR(20),
FLOW_CLASS VARCHAR(20),FLOW_TGT VARCHAR(20),ORDER_FLOW_CHANNEL VARCHAR(20),FLOW_SUBCAT VARCHAR(20),SYS_ACCT_ID_SRC VARCHAR(64),STRTGY_CD VARCHAR(20),
EXECUTING_BROKER_CD VARCHAR(20),LEAF_EXEC_FG VARCHAR(1),RCVD_EXEC_ID VARCHAR(64),RCVD_EXEC_VER INTEGER,ORDER_FLOW_DESK VARCHAR(20),
SYS_ROOT_ORDER_ID VARCHAR(64),SYS_ROOT_ORDER_VER INTEGER,GLB_ROOT_ORDER_ID VARCHAR(64),TOTAL_EXECUTED_QTY DECIMAL(18, 4),AVG_PRICE DECIMAL( 38, 18),
DEST_CD VARCHAR(20),CLIENT_ORDER_REFID VARCHAR(64),CLIENT_ORDER_ORIG_REFID VARCHAR(64),CROSS_EXEC_FG VARCHAR(1),OCEAN_PRODUCT_ID BIGINT,
TRDR_ID BIGINT,REF_TIME_ID INTEGER,CREATED_BY VARCHAR(64),CREATED_DATE TIMESTAMP,FIX_EXEC_ID VARCHAR(64),FIX_ORIGINAL_EXEC_ID VARCHAR(64),
RELATED_MKT_CENTER VARCHAR(20),TRANS_TS TIMESTAMP,SYS_SECURITY_ALT_SRC VARCHAR(20),EVENT_TYPE_CD VARCHAR(20),SYS_CLIENT_ACCT_ID VARCHAR(64),
SYS_FIRM_ACCT_ID VARCHAR(20),SYS_AVG_PRICE_ACCT_ID VARCHAR(20),SYS_TRDR_ID VARCHAR(64),ACT_BRCH_SEQ VARCHAR(20),SYS_ORDER_ID VARCHAR(64),
SYS_ORDER_VER INTEGER,SRC_FEED_REF_CD VARCHAR(64),DIGEST_KEY VARCHAR(128),TRUE_LAST_MKT VARCHAR(20),ENTRY_TS TIMESTAMP,OPT_STRIKE_PRICE DECIMAL( 38, 18),
OPT_MATURITY_DATE VARCHAR(20),EXPIRE_TS TIMESTAMP,OPT_PUT_OR_CALL VARCHAR(20),SYS_ORDER_STAT_CD VARCHAR(20),CONTRA_ACCT VARCHAR(64),CONTRA_ACCT_SRC VARCHAR(20),
CONTRA_BROKER_SRC VARCHAR(20),SYS_SECURITY_ID VARCHAR(64),SYS_SECURITY_ID_SRC VARCHAR(20),SYS_SRC_SYS_ID VARCHAR(20),SYS_ORDER_ID_UNIQUE_SUFFIX VARCHAR(20),
DEST VARCHAR(20),DEST_ID_SRC VARCHAR(4),CONVER_RATIO DECIMAL(18, 9),STOCK_REF_PRICE DECIMAL( 38, 18),AS_OF_TRD_FG VARCHAR(1),MULTILEG_RPT_TYPE VARCHAR(4),
REG_NMS_LINK_TYPE VARCHAR(20),EXEC_SUB_TYPE VARCHAR(4),CMSN_TYPE VARCHAR(20),QUOTE_CONDITION_IND VARCHAR(20),TRD_THROUGH_FG VARCHAR(1),
REGNMS_ORDER_LINK_ID VARCHAR(64),REGNMS_ORDER_LINK_TYPE VARCHAR(20),DK_IND VARCHAR(20),NBBO_QUOTE_TIME VARCHAR(20),GLB_ROOT_SRC_SYS_ID VARCHAR(20),
TRD_REPORT_TYPE VARCHAR(20),REPORT_TO_EXCH_FG VARCHAR(1),CMPLN_COMMENT VARCHAR(256),DEAL_TYPE VARCHAR(4),EXEC_COMMENTS VARCHAR(256),
OPTAL_FIELDS VARCHAR(120),SPOT_REF_PRICE VARCHAR(20),DELTA_OVERRIDE VARCHAR(20),UNDERLYING_PRICE VARCHAR(20),PRICE_DELTA VARCHAR(20),
NORMALIZED_LIQUIDITY_IND VARCHAR(4),USER_AVG_PRICE VARCHAR(20),LAST_EXEC_TS TIMESTAMP,LULD_LOWER_PRICE_BAND VARCHAR(20),LULD_UPPER_PRICE_BAND VARCHAR(20),
LULD_PRICE_BAND_TS TIMESTAMP,REMNG_QTY DECIMAL(18, 4),ORDER_QTY DECIMAL(18, 4),AMD_TS TIMESTAMP,SETL_CODE VARCHAR(50),SETL_DATE VARCHAR(20),
CUST_NM VARCHAR(50),EXEC_TYPE VARCHAR(50),TRDR_KEY VARCHAR(50),TRDR_NM VARCHAR(50),FX_RATE VARCHAR(50),CUST_FX_RATE VARCHAR(50),
PARENT_ORDER_SYS_NM VARCHAR(10),CNC_TYPE VARCHAR(50),FEE_AMT DECIMAL(20, 2),FEE_CCY VARCHAR(10),BRKG_AMT DECIMAL(20, 2),BRKG_CCY VARCHAR(10),
CLEAR VARCHAR(50),PMT_FIX_DATE VARCHAR(20),FOLLOW_ON_FG VARCHAR(1),FX_RATE_CCY_TO VARCHAR(10),FX_RATE_CCY_FROM VARCHAR(10),CUST_FX_RATE_CCY_TO VARCHAR(10),
CUST_FX_RATE_CCY_FROM VARCHAR(10),SYS_GFCID VARCHAR(20),CONTRA_SIDE VARCHAR(20),OPT_CONTRACT_MULTIPLIER DECIMAL(10, 2),PRIOR_REF_PRICE_TS TIMESTAMP,
SECURITY_SUB_TYPE VARCHAR(20),MSG_DIRECTION VARCHAR(20),LEAF_SYS_EXEC_ID VARCHAR(64),LEAF_SRC_SYS VARCHAR(20),FIX_LAST_MKT VARCHAR(20),
FIX_CONTRA_BROKER_MNEMONIC VARCHAR(20),RIO_MSG_SRC VARCHAR(64),SNAPSHOT_TS TIMESTAMP,EXTERNAL_TRANS_TS TIMESTAMP,PRICE_CATEGORY VARCHAR(32),
UNDERLYING_FX_RATE DECIMAL(36, 8),CONVERSION_RATE DECIMAL(36, 8),TRANS_COMMENT VARCHAR(256),AGGRESSOR_FLAG VARCHAR(1))
USING ROW OPTIONS (partition_by 'EXEC_DID', buckets '11', redundancy ':redundancy', EVICTION_BY ':evictionByOption', OVERFLOW 'true') ;

INSERT INTO EXEC_DETAILS SELECT * FROM staging_exec_details;

Loading