Hi, can you help me see why my writeTxn always lags behind sequencerTxn so far? I am writing hundreds rows to each table at every 10 seconds. But the data can only be queried after about 1 minute.
Here is the screenshot of max(timestamp) delay of one table.
Here is my wal_tables() results, writeTxn is always lagging behind sequencerTxn a lot.
I have tried decreasing the maxUncommiterRows and o3MaxLag of one of the test tables, but it didn’t make any difference. Here below is tables() result.
I have tried changing cairo.commit.mode to sync and now to async, but it didn’t make any difference.
Tables starting with test is created like this:
CREATE TABLE test_binance10s_future (
idxcode SYMBOL CAPACITY 8192,
exchange SYMBOL CAPACITY 256,
feedcode SYMBOL CAPACITY 8192,
first_trade_id STRING,
last_trade_id STRING,
first_trade_price DOUBLE,
last_trade_price DOUBLE,
first_trade_time TIMESTAMP,
last_trade_time TIMESTAMP,
high_price DOUBLE,
low_price DOUBLE,
avg_price DOUBLE,
total_trades INT,
total_quantity DOUBLE,
total_turnover DOUBLE,
buy_quantity DOUBLE,
buy_turnover DOUBLE,
sell_quantity DOUBLE,
sell_turnover DOUBLE,
update_time TIMESTAMP,
timestamp TIMESTAMP
) TIMESTAMP(timestamp)
PARTITION BY HOUR
TTL 15 DAY
DEDUP UPSERT KEYS (timestamp, feedcode);
Tables starting with kline is created like this:
CREATE TABLE kline10s_future (
idxcode SYMBOL INDEX,
exchange SYMBOL INDEX,
feedcode SYMBOL INDEX,
first_trade_id STRING,
last_trade_id STRING,
first_trade_price DOUBLE,
last_trade_price DOUBLE,
first_trade_time TIMESTAMP,
last_trade_time TIMESTAMP,
high_price DOUBLE,
low_price DOUBLE,
avg_price DOUBLE,
total_trades INT,
total_quantity DOUBLE,
total_turnover DOUBLE,
buy_quantity DOUBLE,
buy_turnover DOUBLE,
sell_quantity DOUBLE,
sell_turnover DOUBLE,
update_time TIMESTAMP,
timestamp TIMESTAMP
) TIMESTAMP(timestamp)
PARTITION BY HOUR
TTL 15 DAY
DEDUP UPSERT KEYS (timestamp, feedcode, exchange);
Please help. Thanks.