Behavior change and compatibility

Features

1. feat: taosX add KingHistorian data-in
2. feat: taosX add new datasource: pulsar & tuya

Enhancements

1. enh: active-active support enable WAL marker to lock WAL
2. enh: C WebSocket connector performance optimized
3. enh: improve startup speed of stream with historical data
4. enh: support caching filter results of tag equality conditions in stream
5. enh: c/rust websocket connection support conn_timeout
6. enh: clarified error messages for white noise check failures in the data completion algorithm
7. enh: enhanced error messages for unresolvable or unreachable hostnames to indicate the root cause more clearly
8. enh: TDgpt's imputation function supports arbitrary sampling intervals
9. enh: taosX data migration supports conn_timeout
10. enh: Add debug commands like vi, ps, etc. to Docker
11. enh: improve corner case memory usage to avoid oom
12. enh: taosX improve mem usage and speedup for flat stream
13. enh: Explorer extracted columns can be extracted in chain
14. enh: add maxSQLLength to set the maximum length of SQL statements
15. enh: Rust websocket connection support read timeout
16. enh: taosX archive file size and count limit
17. enh: simplified the retry logic in the query process, and uniformly used maxRetryWaitTimes to control the maximum retry time
18. enh: remove info log for points in opcda
19. enh: OpenTSDB data-in support customized table name
20. enh: speedup perf when table not exist for tmq to td
21. enh: taosX import csv in batches
22. enh: improve recovery speed after restart in clusters with multiple vnodes requiring data synchronization
23. enh: allow TMQ subscription to TSDB v3.1.x
24. enh: taosX support migration with additional WHERE condition
25. enh: taosX support reclaim memory by interval or sighup

Fixes

1. fix: event window of stream does not create output table when no data output.
2. fix: taosX data synchronization included extra non-qualifying table structures.
3. fix: fix a mem-leak issue of taosBenchmark
4. fix: stream trigger incorrectly handles NULL values during DELETE-triggered recalculation
5. fix: historical data triggering of stream state window does not support the extend parameter
6. fix: stream compatibility issues when upgrading from version 3.3.7 to 3.3.8
7. fix: incorrect calculation result of the state window when the data block boundary is a null value
8. fix: incorrect window splitting in RSMA function when the timestamp is negative
9. fix: leader switchover failure of dual-replica mnode.
10. fix: election during snapshot transmission in the synchronization module causes a deadlock
11. fix: stream sliding windows for virtual super tables lacked sub-table names in message notifications
12. fix: resolve the issue where virtual super tables do not support SELECT DISTINCT TAGS queries
13. fix: resolve the issue where a UNION query returns incorrect results if one of its subqueries contains only constant conditions in the WHERE clause
14. fix: memory leak when MQTT subscription exits
15. fix: resolve the memory leak issue when referencing virtual tables in stream
16. fix: resolve the issue where virtual super tables do not support SELECT COUNT(1) queries
17. fix: resolve the issue where the DERIVATIVE function returns an extra row in the result set when the query includes the tbname column
18. fix: Resolved Docker image upgrade start-up failure after changing the taosd password, affecting versions 3.3.8.0–3.3.8.4
19. fix: virtual table stream does not trigger computing as expected
20. fix: time resolution processing error in TDgpt's Prophet algorithm model
21. fix: query result error when the state window's extend value is 1 and the end of the window is all empty data
22. fix: explorer input eroro when extract or filter preview
23. fix: taosX fix mem increase and panic in archive in case of taosd errors
24. fix: fix schema only backup restore error
25. fix: crash caused by memory cleanup when sync message sending fails
26. fix: TSDB Lite Explorer loading is slow
27. fix: fix description attribute error in some special OPC-UA servers
28. fix: multiple selections of namespaces cause error
29. fix: fix unexpected taosX filtered metrics
30. fix: query does not return the correct error code when it is killed
31. fix: precision error in decimal constant conversion
32. fix: stream cannot restart after adding new column mappings to the virtual table
33. fix: failed to restore vnode when there are a large number of null values
34. fix: resolved issue where virtual table queries failed after adding or removing Schema in their corresponding sub-tables.
35. fix: time precision error in the last_compact column of the ins_filesets system table
36. fix: stream repeatedly reports window opening events after restart
37. fix: upgrade arrow dependencies for jdk21
38. fix: reduce OpenTSDB log file size for taosX
39. fix: InfluxDB data source table name inconsistent with disorder tags
40. fix: error writing BLOB data type via super table auto-creation statements

What's Changed

• enh(stream): merge from main by @wangmm0220 in #33284
• enh(test): insert data in parallel by @kailixu in #33429
• test: support multi vm run CI by @SallyHuo-TAOS in #33436
• fix(docker): remove openjdk-17-jre-headless entry from Dockerfile.base by @tomchon in #33445
• Enh/stream/only createtable supported main2 by @facetosea in #33420
• fix explore-sys metric's sub table name by @sheyanjie-qq in #33441
• fix: Fix Docker command port mapping in documentation by @tomchon in #33449
• docs: update release note for 3.3.8.4 in office web by @feici02 in #33456
• enh/TD-38474-modify-sdb-data by @cadem in #33457
• ci: update branch configuration for taoskeeper build workflow by @qevolg in #33443
• feat(csv): docs update #TS-7450 by @zyyang90 in #33461
• enh: use TAOS_FQDN to start taosd by @tomchon in #33462
• feat: optimize the usage instructions of taosdump by @YamingPei in #33460
• enh: Remove macOS 13 from build matrix because of image Deprecated by @tomchon in #33466
• avoid cpu occupied by @yihaoDeng in #33465
• Fix/TS-7588 by @yihaoDeng in #33468
• merge: from 3.3.6 to main branch by @guanshengliang in #33474
• feat(taos): add connector info for perf_connections by @wangmm0220 in #33458
• fix: state window handle all-null datablock error by @Tony2h in #33439
• fix/TD-38490-reset-heartbeat-after-mnode-leader-restart by @cadem in #33473
• fix(rsma): window split for negative ts by @kailixu in #33467
• feat: write results of the super table query to a json file by @YamingPei in #33470
• case: tidy up cases (10.31) Migrate system-test by @DuanKuanJun in #33444
• merge: from 3.3.6 to main branch by @guanshengliang in #33486
• docs: update network by @guanshengliang in #33488
• fix[TD-38515]: fix ci return value check issue by @localvar in #33489
• docs: add window interval description by @dapan1121 in #33493
• fix/TS-7542-double-free by @cadem in #33494
• docs: update network by @guanshengliang in #33492
• feat:auth server by @Pengrongkun in #33469
• fix/TD-38495-snapshot-start-receiver-writer-error by @cadem in #33477
• merge: from 3.3.6 to main branch by @guanshengliang in #33503
• refactor(query): refactor failed task retry control procedure. by @hjxilinx in #33498
• refactor(query): refactor query task redirect process. by @hjxilinx in #33502
• merge: from 3.3.6 to main branch by @guanshengliang in #33504
• docs: update the Python documentation and upgrade taos-ws-py by @qevolg in #33496
• test: enhance the debugging information and exception handlingcapabilities by @YamingPei in #33497
• fix:stmt2 ut by @Pengrongkun in #33505
• Enh/add stream latency marks by @wangmm0220 in #33518
• Enh/add stream latency marks by @wangmm0220 in #33527
• fix: possible snapshot message size error and log info by @hzcheng in #33526
• Fix/336/csv-parse-error by @xiao-77 in #33500
• fix: possible snapshot message size error and log info by @hzcheng in #33525
• Enh/add stream latency marks by @wangmm0220 in https://github.com...

Behavior change and compatibility

Features

1. feat: taosX support OPC failover endpoint

Enhancements

1. enh: taosX allow sync from higher precision to lower eg. ns to ms
2. enh: Adapter support connection management and request limit
3. enh: improve performance for last_row + composite queries
4. enh: taosws taos_stmt_num_params support selects
5. enh: improve log and error code display during mnode startup
6. enh: refine document for error codes
7. enh: reduced CPU usage for stream when reading data
8. enh: speedup small queries in C/Rust websocket connection
9. enh: REST API response will use null for nan/inf instead of error
10. enh: no longer retry timed-out RPC messages
11. enh: improve performance for last_row + tags queries
12. enh: Improved query performance for virtual super tables
13. enh: Explorer Grid canvas suppot plotting with DECIMAL
14. enh: OpenTSDB data-in support timestamp/value field rename
15. enh: unify login-register process in enterprise & community
16. enh: add configuration parameter rpcRecvLogThreshold to set the threshold for warning logs in the rpc module
17. en: Explorer Dashboard node table now is sortable

Fixes

1. fix: tmq_get_json_meta behaves unexpectedly when the tags of subscribed meta messages contain empty strings.
2. fix: decode overflow interior page returns wrong pgno
3. fix: free() invalid pointer in taos-connector-rust
4. fix: the retention task does not exit when drop and recreate database with the same name while RSMA exists
5. fix: clearing user_ip in taos_options_connection does not take effect
6. fix: slow leader election when a single node in a dual-replica setup loses network connectivity
7. fix: crash occurred when querying a virtual supertable without including the timestamp primary key
8. fix: fixed the rare issue of inconsistent config parameter values across dnodes after modifying dnode parameters.
9. fix: incorrect result issue when the stream statement contains tag=%%1.
10. fix: state window fails to properly handle data with NULL states
11. fix: crash when concurrent writes and last queries are performed simultaneously.
12. fix: new values cannot be immediately queried after updating server configuration parameters
13. fix: fix C WebSocket stmt2 automatic reconnection
14. fix: subscription failure when the WAL version number exceeds the maximum value of int32
15. fix: startup failure on CPUs with 200 cores or more
16. fix: explorer query NaN as null
17. fix: show create table command execute error when the tag value is an empty string
18. fix: crash caused by memory cleanup when sync message sending fails
19. fix: incorrect _wduration result in time window queries with sliding.
20. fix: invalid sttblockreader initialization actions in window queries.
21. fix: resolved incorrect end_point information in perf_connections

What's Changed

• enh: optimize stable event window plan by @dapan1121 in #33195
• fix: TD-38212 by @cadem in #33186
• docs: update release note for 3.3.8.1 in office web by @feici02 in #33216
• fix: type conversion error by @menshibin in #32844
• feat: complete version number character copying by @menshibin in #33206
• docs: update python ws version history by @qevolg in #33222
• fix: fix tdgpt timemoe model directory by @SallyHuo-TAOS in #33213
• enh(last): enable reading cache when select last and tags by @Tony2h in #33204
• enh: TD-38163-mnode-open-log by @guanshengliang in #33160
• fix: clearing user_ip in taos_options_connection does not take effect by @yihaoDeng in #33229
• fix: clearing user_ip in taos_options_connection does not take effect by @yihaoDeng in #33228
• enh: rsma docs and task monitor by @kailixu in #33219
• fix: TS-7219-handle-status-req-timeout by @cadem in #33210
• merge: from 3.3.6 to main branch by @guanshengliang in #33235
• fix: get stream tasks list crash issue by @dapan1121 in #33238
• feat: unique getBuildPath invoke and ignore .git branch name contain … by @SallyHuo-TAOS in #33233
• enh: TD-38278-print-error-code by @cadem in #33231
• enh(last): enable using cache when select last and composite key by @Tony2h in #33234
• Fix/test case/err desc main by @facetosea in #33246
• enh: add and apply trigger latency config by @dapan1121 in #33245
• fix(stream): fix memory leak in vtable data merge by @JinqingKuang in #33194
• enh(last): enable reading cache when select last and tags by @Tony2h in #33236
• Docs for error codes Prefix Categories by @DuanKuanJun in #33250
• merge: from 3.3.6 to main by @guanshengliang in #33255
• fix: TD-37490 ci case by @facetosea in #33187
• docs: update conntector and error code page, remove rest connect type by @sheyanjie-qq in #33266
• fix: add thread create debug log by @dapan1121 in #33262
• Wrapper Library Add Hint Message by @DuanKuanJun in #33257
• fix(stream): fix trigger waking for available runner by @JinqingKuang in #33264
• docs: update c native stmt2 example by @qevolg in #33272
• fix[TD-38121]: fix two tdb bugs for 3.3.6 by @localvar in #33274
• fix[TD-38121]: fix two tdb bugs by @localvar in #33260
• enh(stream): reset table scan in reader by @wangmm0220 in #33247
• alter cron time by @happyguoxy in #33286
• fix(tref): increase TSDB_REF_OBJECTS from 100 to 2000 for improved reference handling by @yihaoDeng in #33281
• fix(tref): increase TSDB_REF_OBJECTS from 100 to 2000 for improved reference handling by @yihaoDeng in #33282
• feat: add rpcRecvLogThreshold configuration for logging threshold by @yihaoDeng in #33277
• feat: add rpcRecvLogThreshold configuration for logging threshold by @yihaoDeng in #33241
• fix: memleak by @facetosea in #33280
• fix: adjust rocksdb log by @yihaoDeng in #33013
• enh: optimize vtable scan by @Simon9997 in #33232
• enh: Wrapper Library Add Hint Message(3.3.6 branch) by @DuanKuanJun in #33270
• docs: add libtaosws.so and libtaosnative.so load failed resolution by @DuanKuanJun in #33276
• docs: jdbc release 3.7.6 by @sheyanjie-qq in #33293
• merge: from 3.3.6 to main branch by @guanshengliang in #33290
• docs: update roadmap by @guanshengliang in #33307
• tidy up CI case for link function by @DuanKuanJun in #33253
• Update to the nvl2 function description by @liuyq-617 in #33314
• fix(stream): tsdbReader is null by @wangmm0220 in #33306
• enh: Modify maximum TSMA num from 3 to 10. by @Simon9997 in #33145
• fix(stream): cases error in sometimes by @wangmm0220 in #33243
• enh: optimize log in vnodeQuery.c for better debug info by @hzcheng in #33267
• Fix/fixMemleak336 by @yihaoDeng in #33261
• enh: Add error logging when scan meta entry fails to decode by @hzcheng in #33279
• docs: add taos_print_row desc by @qevolg in #33310
• test: tidy up cases on main branch by @DuanKuanJun in #33317
• fix: Support external window for subquery. by @Simon9997 in #33320
• fix(tmq): [TS-7468] position is negative because overflow by @wangmm0220 in #33304
• fix(tmq): [TS-7468] position is negative because overflow by @wangmm0220 in #33305
• enh(stream): fix trim block error by @wangmm0220 in #33299
• fix: [TD-38315] Fix virtual supertable scan wrong tsSlotId. by @Simon9997 in #33288
• enh:remove obsolete test case files for long-running and TD-GPT tests from the parallel_test directory by @tomchon in #33327
• change log level of http by @yihaoDeng in https://github.com/taosda...

Behavior change and compatibility

Features

Enhancements

1. enh: support for alter RSMA

Fixes

1. fix: incorrect results were returned when executing first and last functions on the timestamp column simultaneously
2. fix: precision loss when taosX synchronizes decimal data
3. fix: incorrect first window calculation results after taosd restart when stream is triggered periodically.
4. fix: show local variables like 'timezone' displayed incorrectly on the Windows platform
5. fix: resolved issue where no error was reported after specifying the DELETE_RECALC option for count window in stream
6. fix: fix some Explorer typos
7. fix: move_to failed since cross-dev
8. fix: crash occurs while WebSocket reconnects when using STMT
9. fix: the disk flush thread may deadlock during heavy write and query operations
10. fix: resolved incorrect end_point information in perf_connections
11. fix: tag filtering did not take effect when subscribing to a topic with tag selection conditions

What's Changed

• test: remove check for period recalc. by @xiao-77 in #33146
• feat: add status check on compatibility cases. by @xiao-77 in #33065
• fix: order by errors by @Tony2h in #33058
• fix: correct log message formatting in taosd startup by @tomchon in #33157
• docs: update release note for 3.3.8.0 in office web by @feici02 in #33155
• fix: resolved incorrect end_point information in perf_connections by @yihaoDeng in #33159
• docs: update pkg to 3.3.8.0 and use pkgType to get version url by @tomchon in #33162
• docs: update pkg to 3.3.8.0 by @tomchon in #33163
• fix: last error by @facetosea in #33151
• docs: update TDengine package version to 3.3.8.0 by @tomchon in #33164
• fix: [TD-38160] Disable delete_recalc when trigger window is count wi… by @Simon9997 in #33132
• Docs/ipv6Update by @yihaoDeng in #33167
• test:move docs tests and unit tests to new framework by @tomchon in #33148
• fix: remove unsupported branches from pull request triggers in workflow by @tomchon in #33169
• fix: last ERROR by @facetosea in #33166
• enh(stream): remove synchronous wait for runner by @JinqingKuang in #33154
• fix: dead lock caused by pthread_cond_destroy by @kailixu in #33168
• merge: from 3.3.6 to main branch by @guanshengliang in #33171
• fix: remove unnecessary jsonPath attribute and add tdgpt download url by @tomchon in #33175
• docs: support rollup sma by @kailixu in #33176
• Uncatalog 1-insert/2-query case migrate to catalog by @DuanKuanJun in #32977
• fix: update links to issue references in release notes for clarity by @tomchon in #33179
• refactor(gpt): update doc and error msg. by @hjxilinx in #33156
• fix: replace DocCardList with SortedDocCardList in release notes by @tomchon in #33183
• fix(tz): timezone display error in windows by @wangmm0220 in #33170
• fix(tz): timezone display error in windows by @wangmm0220 in #33190
• fix(tmq): [ts7402]tag filter do not work if topic is stable with filter by @wangmm0220 in #33191
• fix(tmq): [ts7402]tag filter do not work if topic is stable with filter by @wangmm0220 in #33143
• fix(stream): [TD35698]decimal data error if snapshot is true by @wangmm0220 in #33189
• fix(stream): [TD35698]decimal data error if snapshot is true by @wangmm0220 in #33149
• enh(rsma): support alter/decimal/composite key by @kailixu in #33177
• docs: fix desc errors in taosgen's document by @YamingPei in #33172
• fix:stmt core by @Pengrongkun in #33196
• merge: from 3.3.6 to main by @guanshengliang in #33200
• docs: fix python examples error by @menshibin in #33199
• fix: conditionally copy scripts and update configuration instructions for non-lite package mode by @tomchon in #33188

Full Changelog: ver-3.3.8.0...ver-3.3.8.1

Behavior change and compatibility

Features

1. feat: taosX performance report
2. feat: support for TLS certificate-based authentication and transmission
3. feat: add 'timezone' option in rust websocket connection
4. feat: stream now supports the delete_output_table option
5. feat: state_window in stream now supports performing operations on the state column
6. feat: stream supports the recognition of virtual table changes
7. feat: partition by tag now supports string operations
8. feat: JDBC WebSocket support multiple endpoints for load balance
9. feat: re-implement TSMA using the refactored stream
10. feat: stream computing now supports notification filtering mechanism
11. feat: support PROPHET algorithm in TDgpt
12. feat: support Pearson correlation coefficient function
13. feat: taosX support parsing key like value in kafka
14. feat: support for the date function
15. feat: support for functions: IF, ISNULL, ISNOTNULL, NVL, COALESCE, NULLIF, IFNULL
16. feat: support for functions: std variance stddev_samp var_samp group_concat
17. feat: support Rollup SMA.
18. feat: support scanning the integrity of time-series data files using the scan command
19. feat: add C connector performance benchmark
20. feat: support for find_in_set, like_in_set, regexp_in_set functions
21. feat: JDBC reduce query times for high-efficient validation
22. feat: TDgpt support imputation function
23. feat: explorer report metrics to taoskeeper

Enhancements

1. enh: support configuration of state window start and end points
2. enh: keep agent online by default even if taosX disconnected
3. enh: improve C WebSocket STMT2 performance
4. enh: add show ssmigrate command to show the progress of shared storage migration
5. enh: optimize the performance of stream computing.
6. enh: add perf parameters for influxdb in Explorer-DataIn
7. enh: taos shell supports argument values immediately following names on Windows
8. enh: optimize db size & query speed in taosX start up
9. enh: cache validation result to reduce license query times
10. enh: notify statement in stream supports using column aliases
11. enh: add cpu usage percentage of taosAdapter metric
12. enh: taosgen add support for write TDengine with individual queues
13. enh: explorer support contains_bad parameter in OPCDA
14. enh: enhance error handling for subscribe error in Adapter
15. enh: STMT2 support decimal type
16. enh​​: support for ​​BSS (Byte-Stream-Split) encoding​​ on floating-point data
17. enh: optimized the "Balance Vgroup Leader" command to achieve a more uniform distribution of VGroup leader
18. enh: separate data query and metadata query processing threads
19. enh: change default database params to vgroups=4, duration=10 in Explorer
20. enh: support for REDISTRIBUTE command on dual-replica databases
21. enh: update standard deviation calculation to prevent potential numeric overflow
22. enh: show field names even though all values are null in UDT
23. enh: allow explorer create database with replica
24. enh: adapter recording sql csv add appName and srcPort
25. enh: improve the efficiency of event_window queries grouped by tbname
26. enh: alert udt error when running with rhai udt scripts in taosX

Fixes

1. fix: out-of-bounds error in table name/Tag calculation during stream processing
2. fix: data subscription cannot obtain the creation events of normal tables generated by stream
3. fix: resolved issue where calling the forecast function on super virtual tables failed
4. fix: taosX special params(sparse/realtime/stables) cause 'No valid epSet' error
5. fix: taosX-influxdb process not exit when task done
6. fix: unexpected agent activities in explorer
7. fix: write part column is not work
8. fix: incorrect watermark judgment when the ignore_disorder option is enabled in stream
9. fix: RAND function returns different values even seed is same on windows
10. fix: the output of 'leastsquares' is inconsistent across compilers
11. fix: taosd crash when triggered by virtual table with tbname used as a prefilter
12. fix: inconsistent data and log directories on windows
13. fix: websocket connection not closed after taos_close
14. fix: fix the same filename for log to c native
15. fix: memory leak caused by STMT query errors
16. fix: taosAdapter json serialization contains unexpected escapes
17. fix: create taosX task for pi error via Explorer
18. fix: incorrect calculation in the first window when the FILL_HISTORY option is enabled in stream computing
19. fix: resolved manual recalculation logic errors in stream
20. fix: incorrect calculation results in stream when data is out-of-order or deleted
21. fix: consumer.recv_timeout block runtime in rust connector
22. fix: STMT2 reports error when binding empty nchar type
23. fix: cloud taosX license validation issue
24. fix: crash issue caused by commit thread suspending queries on composite primary keys of Varchar type
25. fix: fix taosX/explorer too many open files in linux
26. fix: fix poll deadline elapsed issue when timeout=never in rust taos-ws
27. fix: taosd crash when executing a large number of concurrent last queries
28. fix: the cols function returns incorrect results when fetching multiple timestamps
29. fix: remove stream creation wizard in explorer, use sql directly
30. fix: TDgpt may fail during concurrent forecast
31. fix: the issue that ss_keeplocal cannot be set to 1440m
32. fix: fix cases in explorer permission management
33. fix: no need to alert when taosX_sys not exist in TDLite
34. fix: fix influxdb stopping stuck in taosX
35. fix: explicitly show the database name is case-sensitive
36. fix: Explorer favorite SQL should be case-sensitive
37. fix: influxdb multi tags with same ts would cause data lost
38. fix: Explorer should use COMPOSITE KEY instead of PRIMARY KEY
39. fix: taosAdapter did not report metrics continuously
40. fix: ODBC timestamp precision error in ADB UPDATE with ms or ns ts
41. fix: Kafka data source validation error after upgrading with SASL config
42. fix: fix deadlock issue in concurrent influxdb migration tasks
43. fix: preview table contains old fields after payload schema changed in Explorer
44. fix: crash in ss-migration when fileset does not exist
45. fix: taosBenchmark interlace_rows param not work if non_stop_mode=yes
46. fix: consumer recv_timeout cause tmq2local file not completed
47. fix: cancel restore task not work

What's Changed

• mereg: from main to 3.0 branch by @guanshengliang in #32343
• enh: grant support for data source ORC by @kailixu in #32377
• fix: modify the execution order of compatibility test cases. by @xiao-77 in #32386
• merge: from main to 3.0 branch by @guanshengliang in #32399
• fix: update dnode state from offline to online by @kailixu in #32422
• feat(stmt):add more cases by @Pengrongkun in #32453
• fix: correct regex pattern for Python case detection and update allure path by @tomchon in #32490
• case: test_idmp_meters.py stream8 fixed (3.0) by @DuanKuanJun in #32513
• fix: merge sort in column insert mode by @kailixu in #32502
• enh[ts-6869]: support using file system as shared storage by @localvar in #32483
• merge: from main to 3.0 branch by @guanshengliang in #32542
• feat(stream): opti thread mode of stream reader by @wangmm0220 in #32546
• support stmt2 test cases by @minhuinie in #32533
• merge: from main to 3.0 branch by @guanshengliang in #32624
• fix: add maxRetryWaitTime to configuration dictionary by @tomchon in #32630
• fix: increase pytest timeout from 1000 to 1200 seconds by @tomchon in #32663
• enh​​: support for ​​BSS (Byte-Stream-Split) encoding​​ on floating-point data by @hzcheng in #32447
• feat[TD-37210]: trigger scan plan optimize by @Simon9997 in #32633
• enh[TS-6867]: support for REDISTRIBUTE command on dual-replica databases by @cadem in #32468
• fix(agg/stddev): variance overflow by @stephenkgu in #32456
• fix: use new url to download tdengine in compatibility case. by @xiao-77 in #32668
• fix testcases on windows by @minhuinie in #32683
• feat: support for the date function by @Tony2h in #32545
• enh: clarify the return value format of the date function by @Tony2h in #32690
• enh[TD-37432]: add variable 'syncApplyQueueSize' by @localvar in #32562
• merge: from main to 3.0 branch by @guanshengliang in #32686
• feat(stmt2): support insert decimal type by @Pengrongkun in #32563
• Fix win cases by @minhuinie in #32728
• merge: from main to 3.0 branch by @guanshengliang in #32722
• enh: change float/double default encoding to byte_stream_split by @hzcheng in https://github.com/taosdata/TDengin...

Behavior change and compatibility

Features

1. feat: taosX support importing ORC format
2. feat: C WebSocket connection-level timezone
3. feat: [TD-37437]: incorrect database targeting when creating streams containing virtual table queries
4. feat: support ADO interface in ODBC
5. feat: taosAdapter support recording sql to csv

Enhancements

1. enh: set EXPLORER_SKIP_REGISTER=true to skip register in Explorer
2. enh: reduce taosX binary size for nearly ~60M(plain, 15M compressed)
3. enh: explorer will trim spaces in user name
4. enh: C WebSocket support configuration options for auto reconnect
5. enh: support for formatting time using DDD on Windows.
6. enh: disable alert in dashboard on explorer oss
7. enh: add verifyPeer parameter to allow users to skip certificate verification during S3 data upload.
8. enh: enhance the state control mechanism for S3 data migration to improve precision and efficiency
9. enh: explorer can config requret timeout in opcua
10. enh: Show Create Table does not output compression information.
11. enh: shared storage supports NAS
12. enh: support retries in taosBenchmark via ws
13. enh: improve kafka datain performance
14. enh: taosX not started cause ui undefined error

Fixes

1. fix: speedup influxdb 1.x querying and fix oom in taosX influxdb datasource
2. fix: create data replication error in explorer with non-default password
3. fix: crash caused by race conditions during memory reclamation in long-running queries
4. fix: non-exist file cause unstopped failed to open file error in restore
5. fix: intermittent “stream task lost” error when creating stream tasks in batches.
6. fix: delete stream cause 'Database not specified' in explorer
7. fix: varbinary database mapping in explorer transform
8. fix: panic in case of decimal converting from oracle
9. fix: trigger table tags being null causes crash
10. fix: mqtt get sample data timeout if frequency too low
11. fix: taosdump export by time range error in case of us/ns precision
12. fix: crash issue when using CALC_NOTIFY_ONLY option in stream computing
13. fix: taoskeeper audit log error with value too long for column/tag: client_address in taoskeeper
14. fix: import csv with value field in explorer cause error
15. fix: explorer cascading tag table list error in case of same values in multi tag fields
16. fix: taosX got unexpected null values in case of different types in single field
17. fix: nginx service restart cause explorer error

What's Changed

• Feat/ts 6100 3.0 by @wangmm0220 in #32326
• merge: from main to stream by @guanshengliang in #32342
• test: verify bug4 merge case to vehicle.py by @DuanKuanJun in #32328
• feat: rename docker image by @feici02 in #32346
• test: modify recalc ci cases. by @xiao-77 in #32318
• test: update tese case of blob by @yihaoDeng in #32330
• test: modify case test_recalc_manual_with_options.py. by @xiao-77 in #32348
• fix invalide read epset by @yihaoDeng in #32344
• docs: count_window by @facetosea in #32349
• enh: update show creata table by @yihaoDeng in #32320
• test: modify case by @plum-lihui in #32290
• enh: set queryUseMemoryPool to 0 by @jiajingbin in #32351
• fix(stream): fix recalculation range by @JinqingKuang in #32332
• test: add recalc manual to ci. by @xiao-77 in #32361
• fix: split dead loop issue by @dapan1121 in #32354
• fix(stream): fix memory leak of stream notify content by @JinqingKuang in #32364
• fix: [TD-37133] Forbid use %%trows multi times in union query. by @Simon9997 in #32366
• Feat/ts 6100 3.0 ming by @wangmm0220 in #32362
• docs: update release note for 3.3.7.0 in office web by @feici02 in #32359
• test: create vtable stable from 150100 by @DuanKuanJun in #32360
• docs: update stream doc by @guanshengliang in #32374
• docs: add example cases for datatype tests in cases.task by @tomchon in #32379
• docs: update zh introduction with new name by @danielclow in #32382
• merge: from stream branch to main by @guanshengliang in #32375
• enh: grant support for data source ORC by @kailixu in #32370
• enh: grant support for data source ORC by @kailixu in #32378
• fix: wrong col_id in ins_columns by @Tony2h in #32358
• fix: modify the execution order of compatibility test cases. by @xiao-77 in #32385
• test: remove un checked case by @guanshengliang in #32388
• fix: failed to write blob data using STMT2 in inefficient mode by @yihaoDeng in #32365
• fix(parser): subquery use last_row can't found the colname by @hongzhenliu335 in #32353
• test: [TS-6100] Reopen UTs by @Simon9997 in #32363
• docs: explanation of timezone by @wangmm0220 in #32390
• feat(entrypoint): add wait for serverPort and create snode on dnode by @tomchon in #32345
• feat(stmt):add update syntax support for stmt1 by @Pengrongkun in #32367
• docs:update download link in 01-tdengine.md by @tomchon in #32373
• test: [TS-6100] Reopen stream ut by @Simon9997 in #32396
• enh(TD-36909: adjust sync timer routine log by @cadem in #32309
• enh(TD-36909: adjust sync timer routine log by @cadem in #32098
• fix: wrong table number statistics by @hzcheng in #32391
• Fix/hzcheng/3.3.6/TD-37201 by @hzcheng in #32392
• chore: trigger doc build by @feici02 in #32411
• docs: stream upgrade by @guanshengliang in #32408
• fix(gpt): support scalar function in forecast function. by @hjxilinx in #32409
• test: reproduce bug by @guanshengliang in #32414
• chore: trigger doc build by @feici02 in #32416
• docs: add blank line for better readability in product classificationsection by @tomchon in #32417
• docs: escape_character parameter in document classification error by @menshibin in #32421
• test: mute recalc manual case. by @xiao-77 in #32413
• merge: from 3.3.6 to main branch by @guanshengliang in #32389
• docs: update WebSocket connection API support status and usage restrictions by @qevolg in #32393
• fix: fix taoskeeper version by @qevolg in #32425
• fix: fix taoskeeper version by @qevolg in #32429
• fix: enhance removal logic to check for non-empty install directory before deletion by @tomchon in #32430
• fix: update dnode state from offline to online by @kailixu in #32423
• fix: update dnode state from offline to online by @kailixu in #32424
• feat: add taosmqtt support in packaging scripts and cleanup routines by @tomchon in #32431
• doc: simplify get started for docker by @feici02 in #32434
• fix: enhance removal script to handle empty service names and add directory cleanup by @tomchon in #32435
• docs(taosx): update Data-In tasks name to TDengine Subscription and T… by @acerDebugman in #32433
• merge: from 3.3.6 to main branch by @guanshengliang in #32439
• test: reproduce bugs by @guanshengliang in #32446
• fix(tmq): [TD-37063] array capacity is too large in sometimes by @wangmm0220 in #32445
• fix: [TD-37190] Disable ignore_nodata_trigger when window type is not interval/sliding or period. by @Simon9997 in #32405
• docs: add odbc connector support ado by @menshibin in #32460
• fix: Datainserter supports concurrent writing to the same group by @facetosea in #32384
• fix: wildcards pattern match bug in like clause by @Tony2h in #32404
  ...

Behavior change and compatibility

Features

1. feat: new version of stream computing
2. feat: supports BLOB data type
3. feat: multi-level storage supports the adoption of shared storage
4. feat: data subscription supports the MQTT protocol.
5. feat: support for data mounting
6. feat: support audo reconnect in rust websocket and libtaosws
7. feat: go connector support blob data type
8. feat: support BLOB data type in taos-ws-py
9. feat: rust connector support new blob data type
10. feat: Go WebSocket connections support IPv6
11. feat: support IPv6 connection in C#
12. feat: support version compatible check
13. feat: libtaosws support adapterList for failover
14. feat: table name in transform support expression calc
15. feat: taosAdapter support new BLOB data type
16. feat: C WebSocket connector support BLOB data type
17. feat: taosX all data sources support decimal now
18. feat: C# connector support decimal type
19. feat: C websocket connector auto-reconnect and failover
20. feat: subscribe from TDengine to MQTT in taosX
21. feat: support MQTT sparkplug B datain in taosX
22. feat: support OpenMetrics collection endpoints
23. feat: new go connector benchmark tool
24. feat: refactor artifact of taosBenchmark with better perf and functionality: tsgen
25. feat: support writing query results to super tables.
26. feat: generate unique timestamp using now in taosX
27. feat: new plugin for ontop system
28. feat: C websocket connector support multi-address failover
29. feat: allow specify columns in count window

Enhancements

1. enh: added grant items such as storage capacity and number of vnodes.
2. enh: taosBenchmark support reading tbname/tags in csv
3. enh: taosX support more datetime format in between_time_range
4. enh: STMT2 supports setting fixed values for specified columns
5. enh: websocket poll enhancement
6. enh: Python WebSocket connections support automatic reconnection.
7. enh: support multiple target frameworks in C#
8. enh: downgrade gcc to 7.x for Hisoon database adapter
9. enh: OPC CSV points config can add tags values with template
10. enh: signed taosExplorer cannot start on mac
11. enh: c websocket ws/wss protocol detection
12. enh: support sml to get affected rows in rust connector
13. enh: reduce info logs
14. enh: support more write performance monitoring metrics
15. enh: support encrypting user passwords using the SM4 algorithm
16. enh: enables automatic detection and repair of WAL file corruption during startup
17. enh: STMT2 supports duplicate table name binding
18. enh: support varbinary data type in taosX
19. enh: taosBenchmark output perf metrics into json file
20. enh: raise exception in case of data convertion error
21. enh: taosX transform plugin included in release
22. enh: taosX restore from local dir support 'watch' parameter for watching file changes
23. enh: disable external usage of :6060/rest/sql in Explorer

Fixes

1. fix: memory leak occurs when subscribing to time-series data without metadata in Database topic
2. fix: taosd fails to start after modifying a single mount point in multi-level storage
3. fix: smallint type could not return query results when using the in ('1') condition for filtering.
4. fix: incorrect authentication cause taosAdapter mem leak
5. fix: single mount point failure in a multi-replica database cannot be recovered
6. fix: vrtual table write requests did not report errors
7. fix: support show tags on virtual table
8. fix: taosBenchmark REST never support vgroup bindings
9. fix: set timezone as same as JVM default does not work in websocket connection
10. fix: csv to decimal cause taosX panic
11. fix: fix decimal to double error when replicating with tmq
12. fix: fix opcua error in cli mode of taosX
13. fix: fix fetch_rows_a error in libtaows
14. fix: superset name typo in english of explorer tools docs
15. fix: OSS Explorer drop database error
16. fix: taosX consume messages with formatted json cause error
17. fix: ipv6 with zone info cause taosAdapter error on windows
18. fix: agent sometimes panic on ipc ack reader
19. fix: crash may occur when executing the show db.disk_info command
20. fix: taos -h reports an error when entering an IPv6 address.
21. fix: explorer sql query error should be visible
22. fix: TDB file corruption caused by concurrent data subscription scenarios.
23. fix: fFailed to query virtual tables in BI mode​​
24. fix: nchar tag index is not taking effect
25. fix: fix JDK caused panic on Kylin customized JDK for InfluxDB
26. fix: transform invalid column name error
27. fix: sorting fields of type double may cause the program to crash.
28. fix: configuration parameter update failure during system upgrade
29. fix: taosX tmq to td too many 'show subscriptions' queries cause taosd stuck
30. fix: datain page disappear in explorer
31. fix: taosX kafka datain will drop and logging non-utf8 input
32. fix: explorer table display error
33. fix: taosX support self-signed cert to adapter
34. fix: kafka udt support nested array like [{"data":[{"k":"v"}]}]
35. fix: sysinfo 0.33.1 cause slab mem increament on Kylin V10 os
36. fix: taosBenchmark connection number increases when check sql not set
37. fix: explorer slowsql query condition of timerange
38. fix: provide tool to manually rebuild the last cache quietly
39. fix: S3 upload failure caused by an abnormal compact operation.
40. fix: SQL error detail should display in Explorer logs
41. fix: drop topic will affect other consumers' subscriptions
42. fix: error occurs when the parameter string length of forecast exceeds 512
43. fix: resolved the time precision issue in the timediff function.
44. fix: incorrect results when using to_char function in a nanosecond-precision database
45. fix: error when reading composite primary key data from memory and STT, causing duplicate IDs.#31509
46. fix: client crashes when use STMT2 to the newly added column
47. fix: extremely rare race-condition crash when printing logs.#31688

What's Changed

• feat: [TS-6100] Support ast create for create stream. by @Simon9997 in #30815
• fix: [TS-6100] Fix compile on mac and add toJson/jsonTo func. by @Simon9997 in #30872
• Feat/new stream cache sink by @facetosea in #30868
• fix: [TS-6100] Remove useless code and fix bugs by @Simon9997 in #30883
• feat: [TS-6100] Fix compile error. by @Simon9997 in #30902
• feat: [TS-6100] Process SCMCreateStreamReq by @Simon9997 in #30918
• feat: [TS-6100] Process SCMCreateStreamReq by @Simon9997 in #30924
• feat: [TS-6100] Process SCMCreateStreamReq ver-3 by @Simon9997 in #30930
• feat(stream): add logic of stream reader by @wangmm0220 in #30932
• Feat/ts 6100 3.0 by @wangmm0220 in #30936
• feat: [TS-6100] Process SCMCreateStreamReq by @Simon9997 in #30940
• Feat/ts 6100 3.0 by @wangmm0220 in #30945
• Feat/ts 6100 marks new by @wangmm0220 in #30946
• feat(stream): add thread worker for stream reader by @wangmm0220 in #30954
• feat: [TS-6100] Process SCMCreateStreamReq ver-5 by @Simon9997 in #30964
• feat: [TS-6100] Process SCMCreateStreamReq ver-6 by @Simon9997 in #30982
• feat: [TS-6100] Process SCMCreateStreamReq : Add unit test and fix bugs. by @Simon9997 in #30986
• feat: [TS-6100] Process SCMCreateStreamReq : Fix subplan to string. by @Simon9997 in #30990
• feat: [TS-6100] Parse create stream sql: Fix syntax error when using … by @Simon9997 in #31001
• feat: [TS-6100] Parse create stream sql: Add out stb sversion. by @Simon9997 in #31014
• feat: [TS-6100] Parse create stream sql: change out stb version's dat… by @Simon9997 in #31017
• feat: [TS-6100] Parse create stream sql: Fix bugs and add create check. by @Simon9997 in #31030
• feat: [TS-6100] Parse create stream sql: Fix wrong readFromCache value by @Simon9997 in #31035
• feat: [TS-6100] Parse create stream sql: Collect placeholder function… by @Simon9997 in #31038
• feat: [TS-6100] Parse create stream sql: Fix out table wrong column n… by @Simon9997 in #31040
• feat: [TS-6100] Parse create stream sql: Fix out table wrong column n… by @Simon9997 in #31043
• feat: [TS-6100] Parse create stream sql: Add Unit Test. by @Simon9997 in #31047
• feat: [TS-6100] Fix mac cmake error. by @Simon9997 in #31057
• feat: [TS-6100] Parse create stream sql: Add unit test. by @Simon9997 in #31063
• feat: [TS-6100] Parse create stream sql: Fix partition by tbname error. by @Simon9997 in #31066
• feat: [TS-6100] Parse create stream sql: Fix wrong subplan num...

Behavior change and compatibility

Features

1. feat: taoskeeper support IPv6 listen and connect
2. feat: database engine supports IPv6.
3. feat: support IPv6 in taosX/explorer
4. feat: taosadaupter support IPv6
5. feat: connectors support ipv6
6. feat: taosX support log level change in runtime
7. feat: python websocket support ipv6
8. feat: support ipv6 for rust
9. feat: support IPv6 connection in node.js websocket connection
10. feat: taoskeeper support IPv6 listen and connect
11. feat: add metrics for skiped messages
12. feat: new Node-RED pluginf for query/write/subscribe
13. feat: taosX add telmetry report

Enhancements

1. enh: go WebSocket connector poll data integrity enhancement
2. enh: speedup TDengine Build CI
3. enh: improve the performance of node recovery and replica changes.
4. enh: enable monitor each vnode's actual memory usage and allocation
5. enh: support importing CSV files containing newline characters.
6. enh: improve performance for small batches of dataset in JDBC ws connector
7. enh: support backfill from interrrupted checkpointed in query datain
8. enh: support gen:order on tags in taosBenchmark
9. enh: allow user login to explorer without sysinfo

Fixes

1. fix: schemaless write mode cannot modify string length in dual-active mode
2. fix: when maxRetryWaitTime is set too high, the client will perform unlimited retries when connecting to the server.
3. fix: the error message is not clear when the super table and sub table have the same name during auto-creation of tables.
4. fix: replicaiton support convertion from double/float to decimal in taosX
5. fix: when there are offline dnodes, "show dnode * variables" does not return any output.
6. fix: the REPLICA parameter supports plural forms when used to create and alter a database
7. fix: fix unknown error 65534 when connecting to cloud
8. fix: taosc does not retry when encountering the "Out of memory in queue" error during write failure
9. fix: tables with composite primary keys cannot use the forcast function.
10. fix: fix read file error when replicatting by a net guard
11. fix: influxdb datain cause "Unknown named curve" under Kylin V10
12. fix: nchar tag index is not taking effect
13. fix: allow non-select query result set export as csv
14. fix: inner join queries failing to retrieve data in a nanosecond-precision database.

What's Changed

• test:add coverage workflow by @happyguoxy in #30407
• merge: from main to 3.0 branch by @guanshengliang in #30430
• build(python): update python connector version to 2.7.23 by @YamingPei in #30419
• enh: TD-34203-keeping-restoring by @cadem in #30423
• feat(taosBenchmark): supports decimal data type by @YamingPei in #30456
• feat: cluster monitor page in explorer by @pigzhou in #30496
• fix: taosBenchmark firstEp not work in taos.cfg (3.0) by @DuanKuanJun in #30491
• merge: from main to 3.0 branch by @guanshengliang in #30492
• fix(tdb): disable page recycling by @stephenkgu in #30529
• test: add workflow add-pr-labels [ci skip] by @jiacy-jcy in #30575
• ci: update doc-build workflow to add option to check build chinese or… by @flyingangel2013 in #30550
• merge: from main to 3.0 branch by @guanshengliang in #30591
• add pull_request_target for label-pr-by-team.yml by @jiacy-jcy in #30628
• merge: from main to 3.0 branch by @guanshengliang in #30626
• fix(stream): remove continuous query test cases by @wangjiaming0909 in #30543
• merge: from main to 3.0 branch by @guanshengliang in #30643
• merge: from main to 3.0 branch by @guanshengliang in #30644
• merge: from main to 3.0 branch by @tomchon in #30653
• enh: test coverage for tlog.c by @kailixu in #30631
• merge: from main to 3.0 branch by @guanshengliang in #30665
• merge: from main to 3.0 branch by @guanshengliang in #30679
• fix test: fix fill2 test case by @wangjiaming0909 in #30669
• enh: wait checkpoint ready before pause stream by @jiajingbin in #30666
• fix: add tag data type check when create child table by @hzcheng in #30695
• fix: clear cache when meta abort by @hzcheng in #30674
• fix: [TD-34274] add-monitor-case by @cadem in #30677
• fix: fix possible test case failure by @hzcheng in #30714
• merge: from main to 3.0 branch by @guanshengliang in #30728
• fix: [TD-34459] add-waiting-leader by @cadem in #30707
• Fix: [td 34460] add more log output by @cadem in #30702
• merge: from main to 3.0 branch by @guanshengliang in #30742
• fix: the REPLICA parameter supports plural forms when used to create and alter a database by @guanshengliang in #30732
• fxi: docker run privileged by @facetosea in #30704
• Fix/ts 6244/show dnodes3.0 by @facetosea in #30667
• merge: from main to 3.0 branch by @guanshengliang in #30758
• docs(mqtt): add documetation for cached data configuration by @bitcapybara in #30047
• fix(dataformat): fix single column row copying by @stephenkgu in #30788
• remove tmq attribute enable.heartbeat.background by @DuanKuanJun in #30778
• taosBenchmark restore RESTFUL (3.0) by @DuanKuanJun in #30699
• enh(stream): add groupId in stream notification by @JinqingKuang in #30801
• merge: from main to 3.0 branch by @guanshengliang in #30808
• feat: added base64 SQL function by @aestriplex in #30625
• fix/TD-34460-create-tb-in-thread by @cadem in #30804
• docs(opc): add perssit data support by @bitcapybara in #30783
• merge: from main to 3.0 branch by @guanshengliang in #30834
• ci: modify branch in tdengine-test.yml by @tomchon in #30848
• fix(taosws-rs): modify the git tag of taosws-rs [TD-34624] by @qevolg in #30849
• docs(datain): add missing health status types by @bitcapybara in #30828
• fix: TS-6371-improve-snapshot-log by @cadem in #30857
• fix(tdb/flush): malloc from os when no pages flushed by @stephenkgu in #30866
• docs: jdbc tmq supports database subscription. [TS-6222] by @sheyanjie-qq in #30819
• docs: add description of the special characters supported by password in ODBC connector by @YamingPei in #30842
• merge: from main to 3.0 branch by @guanshengliang in #30916
• fix: mnode-status-case by @cadem in #30871
• enh: improve code coverage of taos-tools by @menshibin in #30915
• merge: from main to 3.0 branch by @guanshengliang in #30943
• fix: taosd cmd args by @facetosea in #30938
• modify workflow,change, pull_request to pull_request_target by @jiacy-jcy in #31013
• merge: from main to 3.0 branch by @guanshengliang in #31025
• enh: update database fetch functions to include status in JSON output by @cadem in #31005
• merge: from main to 3.0 branch by @guanshengliang in #31053
• merge: from main to 3.0 branch by @guanshengliang in #31060
• fix: double close wal meta file. by @xiao-77 in #31059
• update test doc format by @minhuinie in #31074
• merge: from main to 3.0 branch by @guanshengliang in #31115
• docs(datain): add topic meta options docs in tmq by @bitcapybara in #31147
• merge: from main to 3.0 branch by @guanshengliang in #31161
• Update new-framework-test.yml by @SallyHuo-TAOS in #31162
• fix doc format by @minhuinie in #31185
• test: migr...

Behavior change and compatibility

Features

1. feat: support persisent cache in agent of opc
2. feat: support Spark retrieving data from TDengine
3. feat: add support for SSRS (SQL Server Reporting Services)

Enhancements

1. enh: optimize the update logic for data subscription offsets.
2. enh: update the method for generating driver version numbers
3. enh: Explorer support \n in JSON payload
4. enh: Kafka/MQTT support keep original payload/value
5. enh: kafka group and client_id should be editable after imported
6. enh: optimize the config parameter's persistence behavior
7. enh: Explorer support normal table and virutal tables
8. enh: support for cancelling compact tasks in progress.
9. enh: optimize the processing of backtick (`) character in database table names

Fixes

1. fix: fix tmq data loss via rust websocket connector
2. fix: fix doc link target
3. fix: memory leak in taos client when querying heartbeats fails.
4. fix: memory leak during stmt2's high-efficiency writing while auto-creating tables.
5. fix: some config are not displayed when using the taosd -C command
6. fix: do not reset metrics after task stopped to view in explorer
7. fix: subscription fails when the consumer group name contains colon
8. fix: fix oom when restore with many files
9. fix: the error message and error code for stmt2 are inconsistent.
10. fix: fix explorer sql limit detection in backend
11. fix: using stmt2 in non-insert and non-select statements causes crash
12. fix: massive writes of duplicate data may cause taosd to restart.
13. fix: taosX persist queue not work for read in windows
14. fix: aarch64 taos shell input chinese chars error
15. fix: time range parsing error in the compact command caused the corresponding data file groups to fail to reorganize.
16. fix: when enabling the whitelist, drop dnode operations may fail.

What's Changed

• fix: delete the default database creation parameter vgroup by @menshibin in #31064
• docs: submit spark doc by @DuanKuanJun in #30927
• doc: update a figure. by @hjxilinx in #31072
• fix(stream): extends the node update check interval. by @hjxilinx in #31048
• feat: persist local configs' stypes. by @xiao-77 in #30925
• test: add more versions while exec compatibility.py. by @xiao-77 in #30856
• fix: concurrent execution compatibility test cases. by @xiao-77 in #31087
• fix: double close wal meta file. by @xiao-77 in #31083
• docs: update release note for 3.3.6.6 in office web by @feici02 in #31091
• fix(ipWhiteList): Refresh user IP white list when drop-dnode finished by @yihaoDeng in #31089
• opti(tmq): save tmq offset in vnode commit time & change log level by @wangmm0220 in #30993
• fix(parser):core by @Pengrongkun in #31080
• fix: table schema is too old while upgrade taosd version from 3358 to 3360. by @xiao-77 in #31036
• doc: add description of configuration parameters that can only be mod… by @xiao-77 in #31093
• refactor(stream): print some logs. by @hjxilinx in #31095
• reorganized catalog by @minhuinie in #31099
• enh: update the method for generating driver version numbers by @guanshengliang in #31098
• test: support caselist and env clean by @SallyHuo-TAOS in #31067
• fix: update symbolic links for libtaosws to support versioned files by @tomchon in #31107
• test: migrate cases by @guanshengliang in #31037
• chinese characters cannot be entered in the aarch64 version of taos by @menshibin in #31103
• fix: update symbolic links for libtaosws to support versioned files by @tomchon in #31111
• test: add batch test description in README by @SallyHuo-TAOS in #31112
• test: rename tdsql functions by @guanshengliang in #31065
• Cd/fix/libtaos version by @tomchon in #31118
• fix: update library file paths in makepkg.sh for consistency across platforms by @tomchon in #31122
• fix: update APR version to 1.7.6 and adjust URL_HASH by @tomchon in #31121
• fix: update library file paths in makepkg.sh for consistency by @tomchon in #31124
• fix: null rpc handler issue by @dapan1121 in #31104
• fix(stmt2):memleak insert into stb by @Pengrongkun in #31127
• fix: update library file paths in makeclient.sh to remove version suffixes for consistency by @tomchon in #31128
• docs: jdbc release 3.6.3 version by @sheyanjie-qq in #31132
• docs: superset with Other item to config by @DuanKuanJun in #31100
• fix: invalid time parse in compact database command by @hzcheng in #31135
• doc: Update index.md by @hjxilinx in #31144
• docs: add timezone handling information for query results in Go documentation by @huskar-t in #31146
• update flink connector version by @menshibin in #31148
• ci: change the exec frequency of the release build by @feici02 in #31153
• fix: ci compatibility test while alter tag size. by @xiao-77 in #31154
• fix(gpt): limite the covariate input for moirai. by @hjxilinx in #31119
• fix(stream): reset the sched status if sched failed. by @hjxilinx in #31163
• fix: some variables lost while excute taosd -C. by @xiao-77 in #31160
• fix: 修正变量DATA_DIR的大小写使用问题。 by @cockroach888 in #31157
• fix: 修正LD_LIBRARY_PATH定义时存在空路径问题。 by @cockroach888 in #31156
• chore: remove grafana gui installation by @sheyanjie-qq in #31168
• docs: add support for SSRS (SQL Server Reporting Services) by @DuanKuanJun in #31152
• enh(stmt2):add stmt2 log by @Pengrongkun in #31171
• enh: add error code for alter minReservedMemorySize. by @xiao-77 in #31125
• refactor(stream): check for write queue size for sink tasks. by @hjxilinx in #31172
• fix doc format by @minhuinie in #31186
• test: fix ci test compatibility. by @xiao-77 in #31181
• Update 01-taosd.md 修改错别字“checkponit”为“checkpoint” by @JuLongZhiLu in #31197
• fix(stmt2):errcode not match by @Pengrongkun in #31196
• append case link by @minhuinie in #31210
• add python stmt2 websocket docs by @menshibin in #31193
• fix: naming rule with quotation char by @kailixu in #31180
• Test/td 35047 by @SallyHuo-TAOS in #31218
• TD-35056 keep env alive by @minhuinie in #31229
• fix: add duplicate tolerance by @hzcheng in #31217
• fix(stmt): wrong sql type core by @Pengrongkun in #31226
• fix(stmt2):async exec reprepare by @Pengrongkun in #31242
• fix: avoid using : in consumer group by @wangmm0220 in #31225
• fix(stmt2): null sql core by @Pengrongkun in #31243
• doc: Update index.md by @hjxilinx in #31247
• add grafana windows installation by @sheyanjie-qq in #31249

New Contributors

• @JuLongZhiLu made their first contribution in #31197

Full Changelog: ver-3.3.6.6...ver-3.3.6.9

Behavior change and compatibility

Features

1. feat: taosAdapter add process/connection-pools metrics etc.
2. feat: support initialization scripts in docker image
3. feat: subscribe database/stable in jdbc
4. feat: TDgpt support covariate forecasting
5. feat: add mqtt received bytes metric

Enhancements

1. enh: connectors support special chars in password
2. enh: increasing backup support interval < 60s
3. enh: use consist error style in c websocket connection
4. enh: adjust the authorization strategy for dual-node, dual-replica scenarios
5. enh: upgrade JDBC connection in DBeaver
6. enh: refine the timeout parameter in taosX backup
7. enh: improve taosX backup performance
8. enh: config parameter minReservedMemorySize supports hot updates.
9. enh: taosX rename 2.x to TDengine Query, 3.x to Data Subscription
10. enh: adjust the alter logic of the KEEP property for the super table
11. enh: improve initialization performance in taosBenchmark

Fixes

1. fix: when data contains a mix of null, none, and value entries, synchronizing data via TMQ may cause taosAdapter to crash
2. fix: creating streams on virtual sub-tables with a NOTIFY statement produces no data in the super table
3. fix: deadlock when websocket writes data using stmt2.
4. fix: when using STMT write mode, failed SQL parsing can lead to memory leaks.
5. fix: memory leaks when writing with STMT2 in multi-threaded mode
6. fix: support chinese chars in taos shell with ws connection
7. fix: timezone in taos.cfg not work in taosc websocket connection
8. fix: multiple prepare operations on the same STMT statement can cause the program to crash.
9. fix: multiple prepare operations on an STMT statement may report error.
10. fix: allow spaces between \G and ;
11. fix: taosBenchmark -s parameer parse error in
12. fix: ensure uid/pwd are passed during ws_connect in ODBC
13. fix: taosBenchmark create table with tag values cause core dump
14. fix: when the time unit of timetruncate is set to y, it causes taosd to crash.
15. fix: the reference to the zlib repository had the CVE-2023-45853 vulnerability
16. fix: fix CVE-2024-56337 in JDBC example code
17. fix: when querying a virtual table, an error "Table Schema is old" occurs if the query column order doesn't match the physical table's column order.
18. fix: fix possible panic in exec of rust connector
19. fix: support double-quote in opcua node id
20. fix: stuck on stopping status when stop after connection failed
21. fix: fix data lost in case of taosAdapter interrupted under sparse mode
22. fix: when synchronizing data snapshots between multiple replicas, network failures that cause duplicate data transmission can lead to query errors
23. fix: when user privlilege are updated, restarting taosd may cause client subscriptions to occasionally fail.
24. fix: taosBenchmark json cfgdir not work
25. fix: fix authentication failure in case of speciall chars in Explorer
26. fix: when a DB contain a virtual table, setting snapshot=true in the subscription parameters causes taosd to coredump during subscription.
27. fix: show create table and desc table statements return composite key instead of primary key
28. fix: incorrect measurement point calculation when using virtual tables
29. fix: stream compute on virtual tables was not triggered correctly.
30. fix: taosX mem leak with native connection
31. fix: fix copy-and-paste error in case of sql containing spaces in explorer
32. fix: schema is old when origin table's column has same prefix during virtual supertable query
33. fix: virtual tables can not detecting table schema changes
34. fix: dedup timestamp in transformer now generator
35. fix: stream computing result table not being fully created in certain situations
36. fix: taosd fails to start after upgrading from 3.3.6.2 to 3.3.6.3.
37. fix: taosd fails to start after modifying the timezone configuration parameter.
38. fix: When subscribing, if the consumer's held WAL version has been deleted due to WAL file rolling, the subscription will fail.
39. fix: Driver was not loaded error when using native connection on Mac platform
40. fix: the number of windows in an Interval query is incorrect in the nanosecond database.
41. fix: tables with decimal types may crash when filtering with tag conditions.
42. fix: when the forecast function is provided with exactly the same data, some algorithms will report an error.
43. fix: error when executing "DROP VTABLE IF EXISTS" on a non-existent virtual table.
44. fix: error alert in explorer
45. fix: migration cause error when rename table and schema mismatch

What's Changed

• fix: TD-34514-log-level by @cadem in #30756
• fix(stmt2):refactor stmt2 prepare cache reset by @Pengrongkun in #30769
• fix: add ThrottleInterval key(600s) to plist for taosd in macOS by @tomchon in #30771
• cmake.define /MT -> /MD windows by @DuanKuanJun in #30773
• fix: add conditional execution for ReviewDog reporting in CI workflow by @tomchon in #30776
• taoskeeper support new adapter metrics: connection pool and status by @sheyanjie-qq in #30760
• update doc for taosinstall tool by @zk66214 in #30777
• update dosc of inspect tools by @zk66214 in #30781
• feat: [TS-6333] Fix decimal attempting free on address which was not malloc()-ed. by @Simon9997 in #30764
• feat: change taosadapter log dir and log level by @SallyHuo-TAOS in #30763
• enh: add default log dir when examples case failed by @tomchon in #30795
• fix(tmq): update privilege for tmq if privilege change by @wangmm0220 in #30782
• fix(dataformat): fix single column row copying by @stephenkgu in #30787
• fix: TS-6336-get-epset by @cadem in #30770
• fix: memcpy with snprintf to fix build error by @DuanKuanJun in #30790
• fix(stmt2):non-interlace multi-prepare problem by @Pengrongkun in #30793
• docs: [TS-6094] Modify docs of virtual table. by @Simon9997 in #30799
• fix: make duplicate version acceptable by @hzcheng in #30794
• enh: reduce the amount of logs printed when the apply queue is full. by @xiao-77 in #30796
• fix fill range check for natural units by @wangjiaming0909 in #30789
• fix: json configuration not effective by @menshibin in #30785
• docs: update release note for 3.3.6.3 in office web by @feici02 in #30775
• docs: jdbc release 3.6.1, and update some comments by @sheyanjie-qq in #30809
• merge: taos-tools and case 3.0 to main branch by @DuanKuanJun in #30802
• enh(cfg): modify config behavior. by @xiao-77 in #30812
• fix(stmt2):fixed tag multi-prepare core by @Pengrongkun in #30813
• enh: disable the 'show scores' command by @guanshengliang in #30759
• add support of data types for composite primary key columns by @zk66214 in #30816
• feat(gpt): support covariate forecasting by @hjxilinx in #30806
• modify the taosBenchmark parameter issue in the Mac environment by @menshibin in #30818
• fix: set lcn = 0 while lastcompact = lastcommit. by @xiao-77 in #30774
• doc: update user manual. by @hjxilinx in #30825
• docs: update window pic by @guanshengliang in #30823
• fix(stream): parName is null by @wangmm0220 in #30592
• doc:pdate en pics by @guanshengliang in #30829
• fix: wrapper load so from /usr/local/lib/ on mac by @DuanKuanJun in #30822
• fix: [TS-6383] Fix drop vtable error. by @Simon9997 in #30820
• fix: show create table and desc table statements return composite key… by @guanshengliang in #30830
• doc: add description of DURATION. by @xiao-77 in #30833
• Freemine.cmake.3.0 by @freemine in #30663
• feat(gpt): add tdtsfm server by @hjxilinx in #30831
• fix: (TS-6376)jump virtual table if snapshot is true in tmq by @wangmm0220 in #30835
• ci: modify branch in tdengine-test.yml by @tomchon in #30847
• fix(taosws-rs): modify the git tag of taosws-rs [TD-34624] by @qevolg in #30845
• doc: Update 04-machine-learning.md by @hjxilinx in #30852
• doc: Update index.md by @hjxilinx in #30836
• test: migrate datatype cases by @guanshengliang in https://github.com/taosdata/...

Behavior change and compatibility

Features

1. feat: taosBenchmark should suppport decimal datatype
2. feat: add dnode information and components status
3. feat: support auto commit in websocket subscription
4. feat: add suggestions in case of large-throughput queries

Enhancements

1. enh: taosBenchmark ctrl-c fast exit
2. enh: reduce taosX db size
3. enh: allow users without sysinfo privileges to execute the show anodes command.
4. enh: stream computing supports the cols function.
5. enh: support '/' in python taosrest connector
6. enh: changed the keyword for composite primary keys from "primary key" to "composite key"
7. enh: taosdump restore backups in case of cols del/add

Fixes

1. fix: explorer support signup email with dot .
2. fix: user registration page not exist in oss explorer3
3. fix: writing out-of-order data via stm2 may fail
4. fix: when performing interval fill(prev) and sorting by _wstart, if there are null values encountered, the results may be incorrect.
5. fix: the follower vnode sometimes remains in the restore=false state for a long time after restart
6. fix: firstEp setting in taos.cfg not work in taosBenchmark
7. fix: in STMT2 high-efficiency write mode, the write operation will fail when the value of the geometry field is NULL.
8. fix: the createdb option does not work when creating user
9. fix: support migration with sysinfo=0 in taosX
10. fix: the deadlock issue caused by the failure of regex release during the taosd exit process
11. fix: frequent creation and deletion of TOPIC causes TDB's disk space usage to keep growing.
12. fix: windows compile error
13. fix: call stmt_set_tags again after stmt_set_tbname_tags may cause memory leak.
14. fix: taosX allow deleting tasks in "created" status
15. fix: fix data lost in case of taosAdapter interrupted under sparse mode
16. fix: leader election failure in a two-replica database under high throughput.
17. fix: false alarm when update the database parameter s3_compact
18. fix: SQL statements do not return when deleting a database with offline vnodes
19. fix: explorer database name now case-sensitive
20. fix: when rolling back a failed change from a single replica to three replicas, data cleanup errors during the rollback process can lead to the failure of the change.
21. fix: when the length of the condition field in the system table information_schema.ins_user_privileges exceeds 32 characters, the displayed content is incomplete.
22. fix: allow regular users to execute the show disk_info command
23. fix: tables error in case of taosBenchmark input with csv
24. fix: explorer max password length should be 255
25. fix: excel odbc loading data error via websocket
26. fix: stream computing result table not being fully created in certain situations
27. fix: when the transaction to create a database fails, repeatedly sending messages can cause high CPU usage.
28. fix: the number of file groups displayed by the “show compacts” command does not match the actual number.
29. fix: stream task fails to start after the rolling upgrade.
30. fix: the checkpointBackupDir being too large in the stream task.
31. fix: when using Websocket parameter binding to batch write data, Chinese characters in subtable names will cause garbled text#29998
32. fix: TDgpt may yield abnormal results when running on the ARM64 platform.
33. fix: ftmt binding failure followed by re-binding causes a crash.

What's Changed

• test case checking workflow by @minhuinie in #30274
• refactor: test dir by @feici02 in #30280
• update jdbc highvolume example and efficient wiring docs by @sheyanjie-qq in #30422
• docs: en doc for tdgpt by @danielclow in #30397
• merge: from 3.0 to main branch by @guanshengliang in #30427
• docs: update installation instructions for Anode by @tjuzyp in #30425
• fix:remove stmt2_get_fields binfo cache by @Pengrongkun in #30420
• doc: update title by @hjxilinx in #30424
• test:add coverage workflow by @happyguoxy in #30435
• doc: update gpt doc. by @hjxilinx in #30428
• fix: coverage scripts by @guanshengliang in #30438
• docs: [TS-4897] Use markdown table instead of pics. by @Simon9997 in #30436
• enh: [TD-34190] remove-wrong-log by @cadem in #30408
• fix(gpt): add host into script by @hjxilinx in #30440
• docs: adjust tdgpt img size by @danielclow in #30439
• Update 01-introduction.md by @leemingjun in #30441
• feat: change package tar file name by @SallyHuo-TAOS in #30442
• fix(gpt): configure the host address by @hjxilinx in #30443
• ci: fix build error on macOS [skip ci] by @feici02 in #30445
• chore: update taos.cfg by @feici02 in #30448
• fix(gpt): update the host port by default. by @hjxilinx in #30447
• doc: update doc by @hjxilinx in #30449
• ci: add two more triggers by @feici02 in #30451
• fix: update product names in release script for TDgpt by @tomchon in #30452
• doc: update doc. by @hjxilinx in #30453
• doc: update the doc. by @hjxilinx in #30455
• docs: update release note for 3.3.6.0 in office web by @feici02 in #30454
• Update 3.3.6.0.md by @tomchon in #30458
• docs: Update 02-tutorial.md by @jiajingbin in #30460
• enh: add Dockerfile for TDgpt and modify dockerbuild.sh for cloud-tdgpt by @jiajingbin in #30446
• enh: allow ordinary users to execute the “show anodes” command. by @guanshengliang in #30464
• docs:fix install.sh with a non-root user and add denpendencies in 02-tutorial.md by @tomchon in #30459
• fix: rollback error release note by @guanshengliang in #30465
• fix(gpt): add training script. by @hjxilinx in #30466
• enh: allow users to see all fields in "show anodes" by @guanshengliang in #30467
• docs: Update 02-tutorial.md for tdengine-tdgpt-full by @jiajingbin in #30471
• doc: update docs. by @hjxilinx in #30468
• fix: show anodes by @guanshengliang in #30474
• docs: revise the document directory structure by @guanshengliang in #30472
• doc: update doc. by @hjxilinx in #30475
• docs: update tdgpt installation steps by @jtao1735 in #30478
• doc: update doc for timegpt by @hjxilinx in #30477
• docs/ optimize the description regarding taosAdapter by @yu285 in #30481
• docs/ correct the "variable" to "variables" by @yu285 in #30482
• docs: minor changes by @guanshengliang in #30484
• fix: the follower vnode sometimes remains in the restore=false state for a long time after restart by @guanshengliang in #30490
• doc: Update 02-tutorial.md by @hjxilinx in #30486
• Update 30-python.md for taospy official name by @DuanKuanJun in #30487
• Update 04-machine-learning.md by @hjxilinx in #30497
• docs: jdbc 3.6.0 and fix grafana compose cfg issue by @sheyanjie-qq in #30499
• fix(csv): fix lost some ctbs while create table using csv file. by @xiao-77 in #30483
• improve highvolume pic by @sheyanjie-qq in #30505
• ci: add cloud docs to tdengine-doc-build.yml by @tomchon in #30502
• docs: add installation doc for TDengine Enterprise by @zitsen in #30509
• doc: update docs. by @hjxilinx in #30510
• TDengine case docs by @minhuinie in #30495
• feat(taosBenchmark): supports decimal data type on main branch by @YamingPei in #30504
• docs: remove the relevant content of Flink Source CDC from the offici… by @menshibin in #30462
• docs: correct pip by @feici02 in #30517
• Update 01-introduction.md by @tomchon in #30511
• docs: fix link to taosd reference manual in node configuration sect...