Behavior change and compatibility

Features

Enhancements

1. enh: support for alter RSMA

Fixes

1. fix: incorrect results were returned when executing first and last functions on the timestamp column simultaneously
2. fix: precision loss when taosX synchronizes decimal data
3. fix: incorrect first window calculation results after taosd restart when stream is triggered periodically.
4. fix: show local variables like 'timezone' displayed incorrectly on the Windows platform
5. fix: resolved issue where no error was reported after specifying the DELETE_RECALC option for count window in stream
6. fix: fix some Explorer typos
7. fix: move_to failed since cross-dev
8. fix: crash occurs while WebSocket reconnects when using STMT
9. fix: the disk flush thread may deadlock during heavy write and query operations
10. fix: resolved incorrect end_point information in perf_connections
11. fix: tag filtering did not take effect when subscribing to a topic with tag selection conditions

What's Changed

• test: remove check for period recalc. by @xiao-77 in #33146
• feat: add status check on compatibility cases. by @xiao-77 in #33065
• fix: order by errors by @Tony2h in #33058
• fix: correct log message formatting in taosd startup by @tomchon in #33157
• docs: update release note for 3.3.8.0 in office web by @feici02 in #33155
• fix: resolved incorrect end_point information in perf_connections by @yihaoDeng in #33159
• docs: update pkg to 3.3.8.0 and use pkgType to get version url by @tomchon in #33162
• docs: update pkg to 3.3.8.0 by @tomchon in #33163
• fix: last error by @facetosea in #33151
• docs: update TDengine package version to 3.3.8.0 by @tomchon in #33164
• fix: [TD-38160] Disable delete_recalc when trigger window is count wi… by @Simon9997 in #33132
• Docs/ipv6Update by @yihaoDeng in #33167
• test:move docs tests and unit tests to new framework by @tomchon in #33148
• fix: remove unsupported branches from pull request triggers in workflow by @tomchon in #33169
• fix: last ERROR by @facetosea in #33166
• enh(stream): remove synchronous wait for runner by @JinqingKuang in #33154
• fix: dead lock caused by pthread_cond_destroy by @kailixu in #33168
• merge: from 3.3.6 to main branch by @guanshengliang in #33171
• fix: remove unnecessary jsonPath attribute and add tdgpt download url by @tomchon in #33175
• docs: support rollup sma by @kailixu in #33176
• Uncatalog 1-insert/2-query case migrate to catalog by @DuanKuanJun in #32977
• fix: update links to issue references in release notes for clarity by @tomchon in #33179
• refactor(gpt): update doc and error msg. by @hjxilinx in #33156
• fix: replace DocCardList with SortedDocCardList in release notes by @tomchon in #33183
• fix(tz): timezone display error in windows by @wangmm0220 in #33170
• fix(tz): timezone display error in windows by @wangmm0220 in #33190
• fix(tmq): [ts7402]tag filter do not work if topic is stable with filter by @wangmm0220 in #33191
• fix(tmq): [ts7402]tag filter do not work if topic is stable with filter by @wangmm0220 in #33143
• fix(stream): [TD35698]decimal data error if snapshot is true by @wangmm0220 in #33189
• fix(stream): [TD35698]decimal data error if snapshot is true by @wangmm0220 in #33149
• enh(rsma): support alter/decimal/composite key by @kailixu in #33177
• docs: fix desc errors in taosgen's document by @YamingPei in #33172
• fix:stmt core by @Pengrongkun in #33196
• merge: from 3.3.6 to main by @guanshengliang in #33200
• docs: fix python examples error by @menshibin in #33199
• fix: conditionally copy scripts and update configuration instructions for non-lite package mode by @tomchon in #33188

Full Changelog: ver-3.3.8.0...ver-3.3.8.1

Behavior change and compatibility

Features

1. feat: taosX performance report
2. feat: support for TLS certificate-based authentication and transmission
3. feat: add 'timezone' option in rust websocket connection
4. feat: stream now supports the delete_output_table option
5. feat: state_window in stream now supports performing operations on the state column
6. feat: stream supports the recognition of virtual table changes
7. feat: partition by tag now supports string operations
8. feat: JDBC WebSocket support multiple endpoints for load balance
9. feat: re-implement TSMA using the refactored stream
10. feat: stream computing now supports notification filtering mechanism
11. feat: support PROPHET algorithm in TDgpt
12. feat: support Pearson correlation coefficient function
13. feat: taosX support parsing key like value in kafka
14. feat: support for the date function
15. feat: support for functions: IF, ISNULL, ISNOTNULL, NVL, COALESCE, NULLIF, IFNULL
16. feat: support for functions: std variance stddev_samp var_samp group_concat
17. feat: support Rollup SMA.
18. feat: support scanning the integrity of time-series data files using the scan command
19. feat: add C connector performance benchmark
20. feat: support for find_in_set, like_in_set, regexp_in_set functions
21. feat: JDBC reduce query times for high-efficient validation
22. feat: TDgpt support imputation function
23. feat: explorer report metrics to taoskeeper

Enhancements

1. enh: support configuration of state window start and end points
2. enh: keep agent online by default even if taosX disconnected
3. enh: improve C WebSocket STMT2 performance
4. enh: add show ssmigrate command to show the progress of shared storage migration
5. enh: optimize the performance of stream computing.
6. enh: add perf parameters for influxdb in Explorer-DataIn
7. enh: taos shell supports argument values immediately following names on Windows
8. enh: optimize db size & query speed in taosX start up
9. enh: cache validation result to reduce license query times
10. enh: notify statement in stream supports using column aliases
11. enh: add cpu usage percentage of taosAdapter metric
12. enh: taosgen add support for write TDengine with individual queues
13. enh: explorer support contains_bad parameter in OPCDA
14. enh: enhance error handling for subscribe error in Adapter
15. enh: STMT2 support decimal type
16. enh​​: support for ​​BSS (Byte-Stream-Split) encoding​​ on floating-point data
17. enh: optimized the "Balance Vgroup Leader" command to achieve a more uniform distribution of VGroup leader
18. enh: separate data query and metadata query processing threads
19. enh: change default database params to vgroups=4, duration=10 in Explorer
20. enh: support for REDISTRIBUTE command on dual-replica databases
21. enh: update standard deviation calculation to prevent potential numeric overflow
22. enh: show field names even though all values are null in UDT
23. enh: allow explorer create database with replica
24. enh: adapter recording sql csv add appName and srcPort
25. enh: improve the efficiency of event_window queries grouped by tbname
26. enh: alert udt error when running with rhai udt scripts in taosX

Fixes

1. fix: out-of-bounds error in table name/Tag calculation during stream processing
2. fix: data subscription cannot obtain the creation events of normal tables generated by stream
3. fix: resolved issue where calling the forecast function on super virtual tables failed
4. fix: taosX special params(sparse/realtime/stables) cause 'No valid epSet' error
5. fix: taosX-influxdb process not exit when task done
6. fix: unexpected agent activities in explorer
7. fix: write part column is not work
8. fix: incorrect watermark judgment when the ignore_disorder option is enabled in stream
9. fix: RAND function returns different values even seed is same on windows
10. fix: the output of 'leastsquares' is inconsistent across compilers
11. fix: taosd crash when triggered by virtual table with tbname used as a prefilter
12. fix: inconsistent data and log directories on windows
13. fix: websocket connection not closed after taos_close
14. fix: fix the same filename for log to c native
15. fix: memory leak caused by STMT query errors
16. fix: taosAdapter json serialization contains unexpected escapes
17. fix: create taosX task for pi error via Explorer
18. fix: incorrect calculation in the first window when the FILL_HISTORY option is enabled in stream computing
19. fix: resolved manual recalculation logic errors in stream
20. fix: incorrect calculation results in stream when data is out-of-order or deleted
21. fix: consumer.recv_timeout block runtime in rust connector
22. fix: STMT2 reports error when binding empty nchar type
23. fix: cloud taosX license validation issue
24. fix: crash issue caused by commit thread suspending queries on composite primary keys of Varchar type
25. fix: fix taosX/explorer too many open files in linux
26. fix: fix poll deadline elapsed issue when timeout=never in rust taos-ws
27. fix: taosd crash when executing a large number of concurrent last queries
28. fix: the cols function returns incorrect results when fetching multiple timestamps
29. fix: remove stream creation wizard in explorer, use sql directly
30. fix: TDgpt may fail during concurrent forecast
31. fix: the issue that ss_keeplocal cannot be set to 1440m
32. fix: fix cases in explorer permission management
33. fix: no need to alert when taosX_sys not exist in TDLite
34. fix: fix influxdb stopping stuck in taosX
35. fix: explicitly show the database name is case-sensitive
36. fix: Explorer favorite SQL should be case-sensitive
37. fix: influxdb multi tags with same ts would cause data lost
38. fix: Explorer should use COMPOSITE KEY instead of PRIMARY KEY
39. fix: taosAdapter did not report metrics continuously
40. fix: ODBC timestamp precision error in ADB UPDATE with ms or ns ts
41. fix: Kafka data source validation error after upgrading with SASL config
42. fix: fix deadlock issue in concurrent influxdb migration tasks
43. fix: preview table contains old fields after payload schema changed in Explorer
44. fix: crash in ss-migration when fileset does not exist
45. fix: taosBenchmark interlace_rows param not work if non_stop_mode=yes
46. fix: consumer recv_timeout cause tmq2local file not completed
47. fix: cancel restore task not work

What's Changed

• mereg: from main to 3.0 branch by @guanshengliang in #32343
• enh: grant support for data source ORC by @kailixu in #32377
• fix: modify the execution order of compatibility test cases. by @xiao-77 in #32386
• merge: from main to 3.0 branch by @guanshengliang in #32399
• fix: update dnode state from offline to online by @kailixu in #32422
• feat(stmt):add more cases by @Pengrongkun in #32453
• fix: correct regex pattern for Python case detection and update allure path by @tomchon in #32490
• case: test_idmp_meters.py stream8 fixed (3.0) by @DuanKuanJun in #32513
• fix: merge sort in column insert mode by @kailixu in #32502
• enh[ts-6869]: support using file system as shared storage by @localvar in #32483
• merge: from main to 3.0 branch by @guanshengliang in #32542
• feat(stream): opti thread mode of stream reader by @wangmm0220 in #32546
• support stmt2 test cases by @minhuinie in #32533
• merge: from main to 3.0 branch by @guanshengliang in #32624
• fix: add maxRetryWaitTime to configuration dictionary by @tomchon in #32630
• fix: increase pytest timeout from 1000 to 1200 seconds by @tomchon in #32663
• enh​​: support for ​​BSS (Byte-Stream-Split) encoding​​ on floating-point data by @hzcheng in #32447
• feat[TD-37210]: trigger scan plan optimize by @Simon9997 in #32633
• enh[TS-6867]: support for REDISTRIBUTE command on dual-replica databases by @cadem in #32468
• fix(agg/stddev): variance overflow by @stephenkgu in #32456
• fix: use new url to download tdengine in compatibility case. by @xiao-77 in #32668
• fix testcases on windows by @minhuinie in #32683
• feat: support for the date function by @Tony2h in #32545
• enh: clarify the return value format of the date function by @Tony2h in #32690
• enh[TD-37432]: add variable 'syncApplyQueueSize' by @localvar in #32562
• merge: from main to 3.0 branch by @guanshengliang in #32686
• feat(stmt2): support insert decimal type by @Pengrongkun in #32563
• Fix win cases by @minhuinie in #32728
• merge: from main to 3.0 branch by @guanshengliang in #32722
• enh: change float/double default encoding to byte_stream_split by @hzcheng in https://github.com/taosdata/TDengin...

Behavior change and compatibility

Features

1. feat: taosX support importing ORC format
2. feat: C WebSocket connection-level timezone
3. feat: [TD-37437]: incorrect database targeting when creating streams containing virtual table queries
4. feat: support ADO interface in ODBC
5. feat: taosAdapter support recording sql to csv

Enhancements

1. enh: set EXPLORER_SKIP_REGISTER=true to skip register in Explorer
2. enh: reduce taosX binary size for nearly ~60M(plain, 15M compressed)
3. enh: explorer will trim spaces in user name
4. enh: C WebSocket support configuration options for auto reconnect
5. enh: support for formatting time using DDD on Windows.
6. enh: disable alert in dashboard on explorer oss
7. enh: add verifyPeer parameter to allow users to skip certificate verification during S3 data upload.
8. enh: enhance the state control mechanism for S3 data migration to improve precision and efficiency
9. enh: explorer can config requret timeout in opcua
10. enh: Show Create Table does not output compression information.
11. enh: shared storage supports NAS
12. enh: support retries in taosBenchmark via ws
13. enh: improve kafka datain performance
14. enh: taosX not started cause ui undefined error

Fixes

1. fix: speedup influxdb 1.x querying and fix oom in taosX influxdb datasource
2. fix: create data replication error in explorer with non-default password
3. fix: crash caused by race conditions during memory reclamation in long-running queries
4. fix: non-exist file cause unstopped failed to open file error in restore
5. fix: intermittent “stream task lost” error when creating stream tasks in batches.
6. fix: delete stream cause 'Database not specified' in explorer
7. fix: varbinary database mapping in explorer transform
8. fix: panic in case of decimal converting from oracle
9. fix: trigger table tags being null causes crash
10. fix: mqtt get sample data timeout if frequency too low
11. fix: taosdump export by time range error in case of us/ns precision
12. fix: crash issue when using CALC_NOTIFY_ONLY option in stream computing
13. fix: taoskeeper audit log error with value too long for column/tag: client_address in taoskeeper
14. fix: import csv with value field in explorer cause error
15. fix: explorer cascading tag table list error in case of same values in multi tag fields
16. fix: taosX got unexpected null values in case of different types in single field
17. fix: nginx service restart cause explorer error

What's Changed

• Feat/ts 6100 3.0 by @wangmm0220 in #32326
• merge: from main to stream by @guanshengliang in #32342
• test: verify bug4 merge case to vehicle.py by @DuanKuanJun in #32328
• feat: rename docker image by @feici02 in #32346
• test: modify recalc ci cases. by @xiao-77 in #32318
• test: update tese case of blob by @yihaoDeng in #32330
• test: modify case test_recalc_manual_with_options.py. by @xiao-77 in #32348
• fix invalide read epset by @yihaoDeng in #32344
• docs: count_window by @facetosea in #32349
• enh: update show creata table by @yihaoDeng in #32320
• test: modify case by @plum-lihui in #32290
• enh: set queryUseMemoryPool to 0 by @jiajingbin in #32351
• fix(stream): fix recalculation range by @JinqingKuang in #32332
• test: add recalc manual to ci. by @xiao-77 in #32361
• fix: split dead loop issue by @dapan1121 in #32354
• fix(stream): fix memory leak of stream notify content by @JinqingKuang in #32364
• fix: [TD-37133] Forbid use %%trows multi times in union query. by @Simon9997 in #32366
• Feat/ts 6100 3.0 ming by @wangmm0220 in #32362
• docs: update release note for 3.3.7.0 in office web by @feici02 in #32359
• test: create vtable stable from 150100 by @DuanKuanJun in #32360
• docs: update stream doc by @guanshengliang in #32374
• docs: add example cases for datatype tests in cases.task by @tomchon in #32379
• docs: update zh introduction with new name by @danielclow in #32382
• merge: from stream branch to main by @guanshengliang in #32375
• enh: grant support for data source ORC by @kailixu in #32370
• enh: grant support for data source ORC by @kailixu in #32378
• fix: wrong col_id in ins_columns by @Tony2h in #32358
• fix: modify the execution order of compatibility test cases. by @xiao-77 in #32385
• test: remove un checked case by @guanshengliang in #32388
• fix: failed to write blob data using STMT2 in inefficient mode by @yihaoDeng in #32365
• fix(parser): subquery use last_row can't found the colname by @hongzhenliu335 in #32353
• test: [TS-6100] Reopen UTs by @Simon9997 in #32363
• docs: explanation of timezone by @wangmm0220 in #32390
• feat(entrypoint): add wait for serverPort and create snode on dnode by @tomchon in #32345
• feat(stmt):add update syntax support for stmt1 by @Pengrongkun in #32367
• docs:update download link in 01-tdengine.md by @tomchon in #32373
• test: [TS-6100] Reopen stream ut by @Simon9997 in #32396
• enh(TD-36909: adjust sync timer routine log by @cadem in #32309
• enh(TD-36909: adjust sync timer routine log by @cadem in #32098
• fix: wrong table number statistics by @hzcheng in #32391
• Fix/hzcheng/3.3.6/TD-37201 by @hzcheng in #32392
• chore: trigger doc build by @feici02 in #32411
• docs: stream upgrade by @guanshengliang in #32408
• fix(gpt): support scalar function in forecast function. by @hjxilinx in #32409
• test: reproduce bug by @guanshengliang in #32414
• chore: trigger doc build by @feici02 in #32416
• docs: add blank line for better readability in product classificationsection by @tomchon in #32417
• docs: escape_character parameter in document classification error by @menshibin in #32421
• test: mute recalc manual case. by @xiao-77 in #32413
• merge: from 3.3.6 to main branch by @guanshengliang in #32389
• docs: update WebSocket connection API support status and usage restrictions by @qevolg in #32393
• fix: fix taoskeeper version by @qevolg in #32425
• fix: fix taoskeeper version by @qevolg in #32429
• fix: enhance removal logic to check for non-empty install directory before deletion by @tomchon in #32430
• fix: update dnode state from offline to online by @kailixu in #32423
• fix: update dnode state from offline to online by @kailixu in #32424
• feat: add taosmqtt support in packaging scripts and cleanup routines by @tomchon in #32431
• doc: simplify get started for docker by @feici02 in #32434
• fix: enhance removal script to handle empty service names and add directory cleanup by @tomchon in #32435
• docs(taosx): update Data-In tasks name to TDengine Subscription and T… by @acerDebugman in #32433
• merge: from 3.3.6 to main branch by @guanshengliang in #32439
• test: reproduce bugs by @guanshengliang in #32446
• fix(tmq): [TD-37063] array capacity is too large in sometimes by @wangmm0220 in #32445
• fix: [TD-37190] Disable ignore_nodata_trigger when window type is not interval/sliding or period. by @Simon9997 in #32405
• docs: add odbc connector support ado by @menshibin in #32460
• fix: Datainserter supports concurrent writing to the same group by @facetosea in #32384
• fix: wildcards pattern match bug in like clause by @Tony2h in #32404
  ...

Behavior change and compatibility

Features

1. feat: new version of stream computing
2. feat: supports BLOB data type
3. feat: multi-level storage supports the adoption of shared storage
4. feat: data subscription supports the MQTT protocol.
5. feat: support for data mounting
6. feat: support audo reconnect in rust websocket and libtaosws
7. feat: go connector support blob data type
8. feat: support BLOB data type in taos-ws-py
9. feat: rust connector support new blob data type
10. feat: Go WebSocket connections support IPv6
11. feat: support IPv6 connection in C#
12. feat: support version compatible check
13. feat: libtaosws support adapterList for failover
14. feat: table name in transform support expression calc
15. feat: taosAdapter support new BLOB data type
16. feat: C WebSocket connector support BLOB data type
17. feat: taosX all data sources support decimal now
18. feat: C# connector support decimal type
19. feat: C websocket connector auto-reconnect and failover
20. feat: subscribe from TDengine to MQTT in taosX
21. feat: support MQTT sparkplug B datain in taosX
22. feat: support OpenMetrics collection endpoints
23. feat: new go connector benchmark tool
24. feat: refactor artifact of taosBenchmark with better perf and functionality: tsgen
25. feat: support writing query results to super tables.
26. feat: generate unique timestamp using now in taosX
27. feat: new plugin for ontop system
28. feat: C websocket connector support multi-address failover
29. feat: allow specify columns in count window

Enhancements

1. enh: added grant items such as storage capacity and number of vnodes.
2. enh: taosBenchmark support reading tbname/tags in csv
3. enh: taosX support more datetime format in between_time_range
4. enh: STMT2 supports setting fixed values for specified columns
5. enh: websocket poll enhancement
6. enh: Python WebSocket connections support automatic reconnection.
7. enh: support multiple target frameworks in C#
8. enh: downgrade gcc to 7.x for Hisoon database adapter
9. enh: OPC CSV points config can add tags values with template
10. enh: signed taosExplorer cannot start on mac
11. enh: c websocket ws/wss protocol detection
12. enh: support sml to get affected rows in rust connector
13. enh: reduce info logs
14. enh: support more write performance monitoring metrics
15. enh: support encrypting user passwords using the SM4 algorithm
16. enh: enables automatic detection and repair of WAL file corruption during startup
17. enh: STMT2 supports duplicate table name binding
18. enh: support varbinary data type in taosX
19. enh: taosBenchmark output perf metrics into json file
20. enh: raise exception in case of data convertion error
21. enh: taosX transform plugin included in release
22. enh: taosX restore from local dir support 'watch' parameter for watching file changes
23. enh: disable external usage of :6060/rest/sql in Explorer

Fixes

1. fix: memory leak occurs when subscribing to time-series data without metadata in Database topic
2. fix: taosd fails to start after modifying a single mount point in multi-level storage
3. fix: smallint type could not return query results when using the in ('1') condition for filtering.
4. fix: incorrect authentication cause taosAdapter mem leak
5. fix: single mount point failure in a multi-replica database cannot be recovered
6. fix: vrtual table write requests did not report errors
7. fix: support show tags on virtual table
8. fix: taosBenchmark REST never support vgroup bindings
9. fix: set timezone as same as JVM default does not work in websocket connection
10. fix: csv to decimal cause taosX panic
11. fix: fix decimal to double error when replicating with tmq
12. fix: fix opcua error in cli mode of taosX
13. fix: fix fetch_rows_a error in libtaows
14. fix: superset name typo in english of explorer tools docs
15. fix: OSS Explorer drop database error
16. fix: taosX consume messages with formatted json cause error
17. fix: ipv6 with zone info cause taosAdapter error on windows
18. fix: agent sometimes panic on ipc ack reader
19. fix: crash may occur when executing the show db.disk_info command
20. fix: taos -h reports an error when entering an IPv6 address.
21. fix: explorer sql query error should be visible
22. fix: TDB file corruption caused by concurrent data subscription scenarios.
23. fix: fFailed to query virtual tables in BI mode​​
24. fix: nchar tag index is not taking effect
25. fix: fix JDK caused panic on Kylin customized JDK for InfluxDB
26. fix: transform invalid column name error
27. fix: sorting fields of type double may cause the program to crash.
28. fix: configuration parameter update failure during system upgrade
29. fix: taosX tmq to td too many 'show subscriptions' queries cause taosd stuck
30. fix: datain page disappear in explorer
31. fix: taosX kafka datain will drop and logging non-utf8 input
32. fix: explorer table display error
33. fix: taosX support self-signed cert to adapter
34. fix: kafka udt support nested array like [{"data":[{"k":"v"}]}]
35. fix: sysinfo 0.33.1 cause slab mem increament on Kylin V10 os
36. fix: taosBenchmark connection number increases when check sql not set
37. fix: explorer slowsql query condition of timerange
38. fix: provide tool to manually rebuild the last cache quietly
39. fix: S3 upload failure caused by an abnormal compact operation.
40. fix: SQL error detail should display in Explorer logs
41. fix: drop topic will affect other consumers' subscriptions
42. fix: error occurs when the parameter string length of forecast exceeds 512
43. fix: resolved the time precision issue in the timediff function.
44. fix: incorrect results when using to_char function in a nanosecond-precision database
45. fix: error when reading composite primary key data from memory and STT, causing duplicate IDs.#31509
46. fix: client crashes when use STMT2 to the newly added column
47. fix: extremely rare race-condition crash when printing logs.#31688

What's Changed

• feat: [TS-6100] Support ast create for create stream. by @Simon9997 in #30815
• fix: [TS-6100] Fix compile on mac and add toJson/jsonTo func. by @Simon9997 in #30872
• Feat/new stream cache sink by @facetosea in #30868
• fix: [TS-6100] Remove useless code and fix bugs by @Simon9997 in #30883
• feat: [TS-6100] Fix compile error. by @Simon9997 in #30902
• feat: [TS-6100] Process SCMCreateStreamReq by @Simon9997 in #30918
• feat: [TS-6100] Process SCMCreateStreamReq by @Simon9997 in #30924
• feat: [TS-6100] Process SCMCreateStreamReq ver-3 by @Simon9997 in #30930
• feat(stream): add logic of stream reader by @wangmm0220 in #30932
• Feat/ts 6100 3.0 by @wangmm0220 in #30936
• feat: [TS-6100] Process SCMCreateStreamReq by @Simon9997 in #30940
• Feat/ts 6100 3.0 by @wangmm0220 in #30945
• Feat/ts 6100 marks new by @wangmm0220 in #30946
• feat(stream): add thread worker for stream reader by @wangmm0220 in #30954
• feat: [TS-6100] Process SCMCreateStreamReq ver-5 by @Simon9997 in #30964
• feat: [TS-6100] Process SCMCreateStreamReq ver-6 by @Simon9997 in #30982
• feat: [TS-6100] Process SCMCreateStreamReq : Add unit test and fix bugs. by @Simon9997 in #30986
• feat: [TS-6100] Process SCMCreateStreamReq : Fix subplan to string. by @Simon9997 in #30990
• feat: [TS-6100] Parse create stream sql: Fix syntax error when using … by @Simon9997 in #31001
• feat: [TS-6100] Parse create stream sql: Add out stb sversion. by @Simon9997 in #31014
• feat: [TS-6100] Parse create stream sql: change out stb version's dat… by @Simon9997 in #31017
• feat: [TS-6100] Parse create stream sql: Fix bugs and add create check. by @Simon9997 in #31030
• feat: [TS-6100] Parse create stream sql: Fix wrong readFromCache value by @Simon9997 in #31035
• feat: [TS-6100] Parse create stream sql: Collect placeholder function… by @Simon9997 in #31038
• feat: [TS-6100] Parse create stream sql: Fix out table wrong column n… by @Simon9997 in #31040
• feat: [TS-6100] Parse create stream sql: Fix out table wrong column n… by @Simon9997 in #31043
• feat: [TS-6100] Parse create stream sql: Add Unit Test. by @Simon9997 in #31047
• feat: [TS-6100] Fix mac cmake error. by @Simon9997 in #31057
• feat: [TS-6100] Parse create stream sql: Add unit test. by @Simon9997 in #31063
• feat: [TS-6100] Parse create stream sql: Fix partition by tbname error. by @Simon9997 in #31066
• feat: [TS-6100] Parse create stream sql: Fix wrong subplan num...

Behavior change and compatibility

Features

1. feat: taoskeeper support IPv6 listen and connect
2. feat: database engine supports IPv6.
3. feat: support IPv6 in taosX/explorer
4. feat: taosadaupter support IPv6
5. feat: connectors support ipv6
6. feat: taosX support log level change in runtime
7. feat: python websocket support ipv6
8. feat: support ipv6 for rust
9. feat: support IPv6 connection in node.js websocket connection
10. feat: taoskeeper support IPv6 listen and connect
11. feat: add metrics for skiped messages
12. feat: new Node-RED pluginf for query/write/subscribe
13. feat: taosX add telmetry report

Enhancements

1. enh: go WebSocket connector poll data integrity enhancement
2. enh: speedup TDengine Build CI
3. enh: improve the performance of node recovery and replica changes.
4. enh: enable monitor each vnode's actual memory usage and allocation
5. enh: support importing CSV files containing newline characters.
6. enh: improve performance for small batches of dataset in JDBC ws connector
7. enh: support backfill from interrrupted checkpointed in query datain
8. enh: support gen:order on tags in taosBenchmark
9. enh: allow user login to explorer without sysinfo

Fixes

1. fix: schemaless write mode cannot modify string length in dual-active mode
2. fix: when maxRetryWaitTime is set too high, the client will perform unlimited retries when connecting to the server.
3. fix: the error message is not clear when the super table and sub table have the same name during auto-creation of tables.
4. fix: replicaiton support convertion from double/float to decimal in taosX
5. fix: when there are offline dnodes, "show dnode * variables" does not return any output.
6. fix: the REPLICA parameter supports plural forms when used to create and alter a database
7. fix: fix unknown error 65534 when connecting to cloud
8. fix: taosc does not retry when encountering the "Out of memory in queue" error during write failure
9. fix: tables with composite primary keys cannot use the forcast function.
10. fix: fix read file error when replicatting by a net guard
11. fix: influxdb datain cause "Unknown named curve" under Kylin V10
12. fix: nchar tag index is not taking effect
13. fix: allow non-select query result set export as csv
14. fix: inner join queries failing to retrieve data in a nanosecond-precision database.

What's Changed

• test:add coverage workflow by @happyguoxy in #30407
• merge: from main to 3.0 branch by @guanshengliang in #30430
• build(python): update python connector version to 2.7.23 by @YamingPei in #30419
• enh: TD-34203-keeping-restoring by @cadem in #30423
• feat(taosBenchmark): supports decimal data type by @YamingPei in #30456
• feat: cluster monitor page in explorer by @pigzhou in #30496
• fix: taosBenchmark firstEp not work in taos.cfg (3.0) by @DuanKuanJun in #30491
• merge: from main to 3.0 branch by @guanshengliang in #30492
• fix(tdb): disable page recycling by @stephenkgu in #30529
• test: add workflow add-pr-labels [ci skip] by @jiacy-jcy in #30575
• ci: update doc-build workflow to add option to check build chinese or… by @flyingangel2013 in #30550
• merge: from main to 3.0 branch by @guanshengliang in #30591
• add pull_request_target for label-pr-by-team.yml by @jiacy-jcy in #30628
• merge: from main to 3.0 branch by @guanshengliang in #30626
• fix(stream): remove continuous query test cases by @wangjiaming0909 in #30543
• merge: from main to 3.0 branch by @guanshengliang in #30643
• merge: from main to 3.0 branch by @guanshengliang in #30644
• merge: from main to 3.0 branch by @tomchon in #30653
• enh: test coverage for tlog.c by @kailixu in #30631
• merge: from main to 3.0 branch by @guanshengliang in #30665
• merge: from main to 3.0 branch by @guanshengliang in #30679
• fix test: fix fill2 test case by @wangjiaming0909 in #30669
• enh: wait checkpoint ready before pause stream by @jiajingbin in #30666
• fix: add tag data type check when create child table by @hzcheng in #30695
• fix: clear cache when meta abort by @hzcheng in #30674
• fix: [TD-34274] add-monitor-case by @cadem in #30677
• fix: fix possible test case failure by @hzcheng in #30714
• merge: from main to 3.0 branch by @guanshengliang in #30728
• fix: [TD-34459] add-waiting-leader by @cadem in #30707
• Fix: [td 34460] add more log output by @cadem in #30702
• merge: from main to 3.0 branch by @guanshengliang in #30742
• fix: the REPLICA parameter supports plural forms when used to create and alter a database by @guanshengliang in #30732
• fxi: docker run privileged by @facetosea in #30704
• Fix/ts 6244/show dnodes3.0 by @facetosea in #30667
• merge: from main to 3.0 branch by @guanshengliang in #30758
• docs(mqtt): add documetation for cached data configuration by @bitcapybara in #30047
• fix(dataformat): fix single column row copying by @stephenkgu in #30788
• remove tmq attribute enable.heartbeat.background by @DuanKuanJun in #30778
• taosBenchmark restore RESTFUL (3.0) by @DuanKuanJun in #30699
• enh(stream): add groupId in stream notification by @JinqingKuang in #30801
• merge: from main to 3.0 branch by @guanshengliang in #30808
• feat: added base64 SQL function by @aestriplex in #30625
• fix/TD-34460-create-tb-in-thread by @cadem in #30804
• docs(opc): add perssit data support by @bitcapybara in #30783
• merge: from main to 3.0 branch by @guanshengliang in #30834
• ci: modify branch in tdengine-test.yml by @tomchon in #30848
• fix(taosws-rs): modify the git tag of taosws-rs [TD-34624] by @qevolg in #30849
• docs(datain): add missing health status types by @bitcapybara in #30828
• fix: TS-6371-improve-snapshot-log by @cadem in #30857
• fix(tdb/flush): malloc from os when no pages flushed by @stephenkgu in #30866
• docs: jdbc tmq supports database subscription. [TS-6222] by @sheyanjie-qq in #30819
• docs: add description of the special characters supported by password in ODBC connector by @YamingPei in #30842
• merge: from main to 3.0 branch by @guanshengliang in #30916
• fix: mnode-status-case by @cadem in #30871
• enh: improve code coverage of taos-tools by @menshibin in #30915
• merge: from main to 3.0 branch by @guanshengliang in #30943
• fix: taosd cmd args by @facetosea in #30938
• modify workflow,change, pull_request to pull_request_target by @jiacy-jcy in #31013
• merge: from main to 3.0 branch by @guanshengliang in #31025
• enh: update database fetch functions to include status in JSON output by @cadem in #31005
• merge: from main to 3.0 branch by @guanshengliang in #31053
• merge: from main to 3.0 branch by @guanshengliang in #31060
• fix: double close wal meta file. by @xiao-77 in #31059
• update test doc format by @minhuinie in #31074
• merge: from main to 3.0 branch by @guanshengliang in #31115
• docs(datain): add topic meta options docs in tmq by @bitcapybara in #31147
• merge: from main to 3.0 branch by @guanshengliang in #31161
• Update new-framework-test.yml by @SallyHuo-TAOS in #31162
• fix doc format by @minhuinie in #31185
• test: migr...

Behavior change and compatibility

Features

1. feat: support persisent cache in agent of opc
2. feat: support Spark retrieving data from TDengine
3. feat: add support for SSRS (SQL Server Reporting Services)

Enhancements

1. enh: optimize the update logic for data subscription offsets.
2. enh: update the method for generating driver version numbers
3. enh: Explorer support \n in JSON payload
4. enh: Kafka/MQTT support keep original payload/value
5. enh: kafka group and client_id should be editable after imported
6. enh: optimize the config parameter's persistence behavior
7. enh: Explorer support normal table and virutal tables
8. enh: support for cancelling compact tasks in progress.
9. enh: optimize the processing of backtick (`) character in database table names

Fixes

1. fix: fix tmq data loss via rust websocket connector
2. fix: fix doc link target
3. fix: memory leak in taos client when querying heartbeats fails.
4. fix: memory leak during stmt2's high-efficiency writing while auto-creating tables.
5. fix: some config are not displayed when using the taosd -C command
6. fix: do not reset metrics after task stopped to view in explorer
7. fix: subscription fails when the consumer group name contains colon
8. fix: fix oom when restore with many files
9. fix: the error message and error code for stmt2 are inconsistent.
10. fix: fix explorer sql limit detection in backend
11. fix: using stmt2 in non-insert and non-select statements causes crash
12. fix: massive writes of duplicate data may cause taosd to restart.
13. fix: taosX persist queue not work for read in windows
14. fix: aarch64 taos shell input chinese chars error
15. fix: time range parsing error in the compact command caused the corresponding data file groups to fail to reorganize.
16. fix: when enabling the whitelist, drop dnode operations may fail.

What's Changed

• fix: delete the default database creation parameter vgroup by @menshibin in #31064
• docs: submit spark doc by @DuanKuanJun in #30927
• doc: update a figure. by @hjxilinx in #31072
• fix(stream): extends the node update check interval. by @hjxilinx in #31048
• feat: persist local configs' stypes. by @xiao-77 in #30925
• test: add more versions while exec compatibility.py. by @xiao-77 in #30856
• fix: concurrent execution compatibility test cases. by @xiao-77 in #31087
• fix: double close wal meta file. by @xiao-77 in #31083
• docs: update release note for 3.3.6.6 in office web by @feici02 in #31091
• fix(ipWhiteList): Refresh user IP white list when drop-dnode finished by @yihaoDeng in #31089
• opti(tmq): save tmq offset in vnode commit time & change log level by @wangmm0220 in #30993
• fix(parser):core by @Pengrongkun in #31080
• fix: table schema is too old while upgrade taosd version from 3358 to 3360. by @xiao-77 in #31036
• doc: add description of configuration parameters that can only be mod… by @xiao-77 in #31093
• refactor(stream): print some logs. by @hjxilinx in #31095
• reorganized catalog by @minhuinie in #31099
• enh: update the method for generating driver version numbers by @guanshengliang in #31098
• test: support caselist and env clean by @SallyHuo-TAOS in #31067
• fix: update symbolic links for libtaosws to support versioned files by @tomchon in #31107
• test: migrate cases by @guanshengliang in #31037
• chinese characters cannot be entered in the aarch64 version of taos by @menshibin in #31103
• fix: update symbolic links for libtaosws to support versioned files by @tomchon in #31111
• test: add batch test description in README by @SallyHuo-TAOS in #31112
• test: rename tdsql functions by @guanshengliang in #31065
• Cd/fix/libtaos version by @tomchon in #31118
• fix: update library file paths in makepkg.sh for consistency across platforms by @tomchon in #31122
• fix: update APR version to 1.7.6 and adjust URL_HASH by @tomchon in #31121
• fix: update library file paths in makepkg.sh for consistency by @tomchon in #31124
• fix: null rpc handler issue by @dapan1121 in #31104
• fix(stmt2):memleak insert into stb by @Pengrongkun in #31127
• fix: update library file paths in makeclient.sh to remove version suffixes for consistency by @tomchon in #31128
• docs: jdbc release 3.6.3 version by @sheyanjie-qq in #31132
• docs: superset with Other item to config by @DuanKuanJun in #31100
• fix: invalid time parse in compact database command by @hzcheng in #31135
• doc: Update index.md by @hjxilinx in #31144
• docs: add timezone handling information for query results in Go documentation by @huskar-t in #31146
• update flink connector version by @menshibin in #31148
• ci: change the exec frequency of the release build by @feici02 in #31153
• fix: ci compatibility test while alter tag size. by @xiao-77 in #31154
• fix(gpt): limite the covariate input for moirai. by @hjxilinx in #31119
• fix(stream): reset the sched status if sched failed. by @hjxilinx in #31163
• fix: some variables lost while excute taosd -C. by @xiao-77 in #31160
• fix: 修正变量DATA_DIR的大小写使用问题。 by @cockroach888 in #31157
• fix: 修正LD_LIBRARY_PATH定义时存在空路径问题。 by @cockroach888 in #31156
• chore: remove grafana gui installation by @sheyanjie-qq in #31168
• docs: add support for SSRS (SQL Server Reporting Services) by @DuanKuanJun in #31152
• enh(stmt2):add stmt2 log by @Pengrongkun in #31171
• enh: add error code for alter minReservedMemorySize. by @xiao-77 in #31125
• refactor(stream): check for write queue size for sink tasks. by @hjxilinx in #31172
• fix doc format by @minhuinie in #31186
• test: fix ci test compatibility. by @xiao-77 in #31181
• Update 01-taosd.md 修改错别字“checkponit”为“checkpoint” by @JuLongZhiLu in #31197
• fix(stmt2):errcode not match by @Pengrongkun in #31196
• append case link by @minhuinie in #31210
• add python stmt2 websocket docs by @menshibin in #31193
• fix: naming rule with quotation char by @kailixu in #31180
• Test/td 35047 by @SallyHuo-TAOS in #31218
• TD-35056 keep env alive by @minhuinie in #31229
• fix: add duplicate tolerance by @hzcheng in #31217
• fix(stmt): wrong sql type core by @Pengrongkun in #31226
• fix(stmt2):async exec reprepare by @Pengrongkun in #31242
• fix: avoid using : in consumer group by @wangmm0220 in #31225
• fix(stmt2): null sql core by @Pengrongkun in #31243
• doc: Update index.md by @hjxilinx in #31247
• add grafana windows installation by @sheyanjie-qq in #31249

New Contributors

• @JuLongZhiLu made their first contribution in #31197

Full Changelog: ver-3.3.6.6...ver-3.3.6.9

Behavior change and compatibility

Features

1. feat: taosAdapter add process/connection-pools metrics etc.
2. feat: support initialization scripts in docker image
3. feat: subscribe database/stable in jdbc
4. feat: TDgpt support covariate forecasting
5. feat: add mqtt received bytes metric

Enhancements

1. enh: connectors support special chars in password
2. enh: increasing backup support interval < 60s
3. enh: use consist error style in c websocket connection
4. enh: adjust the authorization strategy for dual-node, dual-replica scenarios
5. enh: upgrade JDBC connection in DBeaver
6. enh: refine the timeout parameter in taosX backup
7. enh: improve taosX backup performance
8. enh: config parameter minReservedMemorySize supports hot updates.
9. enh: taosX rename 2.x to TDengine Query, 3.x to Data Subscription
10. enh: adjust the alter logic of the KEEP property for the super table
11. enh: improve initialization performance in taosBenchmark

Fixes

1. fix: when data contains a mix of null, none, and value entries, synchronizing data via TMQ may cause taosAdapter to crash
2. fix: creating streams on virtual sub-tables with a NOTIFY statement produces no data in the super table
3. fix: deadlock when websocket writes data using stmt2.
4. fix: when using STMT write mode, failed SQL parsing can lead to memory leaks.
5. fix: memory leaks when writing with STMT2 in multi-threaded mode
6. fix: support chinese chars in taos shell with ws connection
7. fix: timezone in taos.cfg not work in taosc websocket connection
8. fix: multiple prepare operations on the same STMT statement can cause the program to crash.
9. fix: multiple prepare operations on an STMT statement may report error.
10. fix: allow spaces between \G and ;
11. fix: taosBenchmark -s parameer parse error in
12. fix: ensure uid/pwd are passed during ws_connect in ODBC
13. fix: taosBenchmark create table with tag values cause core dump
14. fix: when the time unit of timetruncate is set to y, it causes taosd to crash.
15. fix: the reference to the zlib repository had the CVE-2023-45853 vulnerability
16. fix: fix CVE-2024-56337 in JDBC example code
17. fix: when querying a virtual table, an error "Table Schema is old" occurs if the query column order doesn't match the physical table's column order.
18. fix: fix possible panic in exec of rust connector
19. fix: support double-quote in opcua node id
20. fix: stuck on stopping status when stop after connection failed
21. fix: fix data lost in case of taosAdapter interrupted under sparse mode
22. fix: when synchronizing data snapshots between multiple replicas, network failures that cause duplicate data transmission can lead to query errors
23. fix: when user privlilege are updated, restarting taosd may cause client subscriptions to occasionally fail.
24. fix: taosBenchmark json cfgdir not work
25. fix: fix authentication failure in case of speciall chars in Explorer
26. fix: when a DB contain a virtual table, setting snapshot=true in the subscription parameters causes taosd to coredump during subscription.
27. fix: show create table and desc table statements return composite key instead of primary key
28. fix: incorrect measurement point calculation when using virtual tables
29. fix: stream compute on virtual tables was not triggered correctly.
30. fix: taosX mem leak with native connection
31. fix: fix copy-and-paste error in case of sql containing spaces in explorer
32. fix: schema is old when origin table's column has same prefix during virtual supertable query
33. fix: virtual tables can not detecting table schema changes
34. fix: dedup timestamp in transformer now generator
35. fix: stream computing result table not being fully created in certain situations
36. fix: taosd fails to start after upgrading from 3.3.6.2 to 3.3.6.3.
37. fix: taosd fails to start after modifying the timezone configuration parameter.
38. fix: When subscribing, if the consumer's held WAL version has been deleted due to WAL file rolling, the subscription will fail.
39. fix: Driver was not loaded error when using native connection on Mac platform
40. fix: the number of windows in an Interval query is incorrect in the nanosecond database.
41. fix: tables with decimal types may crash when filtering with tag conditions.
42. fix: when the forecast function is provided with exactly the same data, some algorithms will report an error.
43. fix: error when executing "DROP VTABLE IF EXISTS" on a non-existent virtual table.
44. fix: error alert in explorer
45. fix: migration cause error when rename table and schema mismatch

What's Changed

• fix: TD-34514-log-level by @cadem in #30756
• fix(stmt2):refactor stmt2 prepare cache reset by @Pengrongkun in #30769
• fix: add ThrottleInterval key(600s) to plist for taosd in macOS by @tomchon in #30771
• cmake.define /MT -> /MD windows by @DuanKuanJun in #30773
• fix: add conditional execution for ReviewDog reporting in CI workflow by @tomchon in #30776
• taoskeeper support new adapter metrics: connection pool and status by @sheyanjie-qq in #30760
• update doc for taosinstall tool by @zk66214 in #30777
• update dosc of inspect tools by @zk66214 in #30781
• feat: [TS-6333] Fix decimal attempting free on address which was not malloc()-ed. by @Simon9997 in #30764
• feat: change taosadapter log dir and log level by @SallyHuo-TAOS in #30763
• enh: add default log dir when examples case failed by @tomchon in #30795
• fix(tmq): update privilege for tmq if privilege change by @wangmm0220 in #30782
• fix(dataformat): fix single column row copying by @stephenkgu in #30787
• fix: TS-6336-get-epset by @cadem in #30770
• fix: memcpy with snprintf to fix build error by @DuanKuanJun in #30790
• fix(stmt2):non-interlace multi-prepare problem by @Pengrongkun in #30793
• docs: [TS-6094] Modify docs of virtual table. by @Simon9997 in #30799
• fix: make duplicate version acceptable by @hzcheng in #30794
• enh: reduce the amount of logs printed when the apply queue is full. by @xiao-77 in #30796
• fix fill range check for natural units by @wangjiaming0909 in #30789
• fix: json configuration not effective by @menshibin in #30785
• docs: update release note for 3.3.6.3 in office web by @feici02 in #30775
• docs: jdbc release 3.6.1, and update some comments by @sheyanjie-qq in #30809
• merge: taos-tools and case 3.0 to main branch by @DuanKuanJun in #30802
• enh(cfg): modify config behavior. by @xiao-77 in #30812
• fix(stmt2):fixed tag multi-prepare core by @Pengrongkun in #30813
• enh: disable the 'show scores' command by @guanshengliang in #30759
• add support of data types for composite primary key columns by @zk66214 in #30816
• feat(gpt): support covariate forecasting by @hjxilinx in #30806
• modify the taosBenchmark parameter issue in the Mac environment by @menshibin in #30818
• fix: set lcn = 0 while lastcompact = lastcommit. by @xiao-77 in #30774
• doc: update user manual. by @hjxilinx in #30825
• docs: update window pic by @guanshengliang in #30823
• fix(stream): parName is null by @wangmm0220 in #30592
• doc:pdate en pics by @guanshengliang in #30829
• fix: wrapper load so from /usr/local/lib/ on mac by @DuanKuanJun in #30822
• fix: [TS-6383] Fix drop vtable error. by @Simon9997 in #30820
• fix: show create table and desc table statements return composite key… by @guanshengliang in #30830
• doc: add description of DURATION. by @xiao-77 in #30833
• Freemine.cmake.3.0 by @freemine in #30663
• feat(gpt): add tdtsfm server by @hjxilinx in #30831
• fix: (TS-6376)jump virtual table if snapshot is true in tmq by @wangmm0220 in #30835
• ci: modify branch in tdengine-test.yml by @tomchon in #30847
• fix(taosws-rs): modify the git tag of taosws-rs [TD-34624] by @qevolg in #30845
• doc: Update 04-machine-learning.md by @hjxilinx in #30852
• doc: Update index.md by @hjxilinx in #30836
• test: migrate datatype cases by @guanshengliang in https://github.com/taosdata/...

Behavior change and compatibility

Features

1. feat: taosBenchmark should suppport decimal datatype
2. feat: add dnode information and components status
3. feat: support auto commit in websocket subscription
4. feat: add suggestions in case of large-throughput queries

Enhancements

1. enh: taosBenchmark ctrl-c fast exit
2. enh: reduce taosX db size
3. enh: allow users without sysinfo privileges to execute the show anodes command.
4. enh: stream computing supports the cols function.
5. enh: support '/' in python taosrest connector
6. enh: changed the keyword for composite primary keys from "primary key" to "composite key"
7. enh: taosdump restore backups in case of cols del/add

Fixes

1. fix: explorer support signup email with dot .
2. fix: user registration page not exist in oss explorer3
3. fix: writing out-of-order data via stm2 may fail
4. fix: when performing interval fill(prev) and sorting by _wstart, if there are null values encountered, the results may be incorrect.
5. fix: the follower vnode sometimes remains in the restore=false state for a long time after restart
6. fix: firstEp setting in taos.cfg not work in taosBenchmark
7. fix: in STMT2 high-efficiency write mode, the write operation will fail when the value of the geometry field is NULL.
8. fix: the createdb option does not work when creating user
9. fix: support migration with sysinfo=0 in taosX
10. fix: the deadlock issue caused by the failure of regex release during the taosd exit process
11. fix: frequent creation and deletion of TOPIC causes TDB's disk space usage to keep growing.
12. fix: windows compile error
13. fix: call stmt_set_tags again after stmt_set_tbname_tags may cause memory leak.
14. fix: taosX allow deleting tasks in "created" status
15. fix: fix data lost in case of taosAdapter interrupted under sparse mode
16. fix: leader election failure in a two-replica database under high throughput.
17. fix: false alarm when update the database parameter s3_compact
18. fix: SQL statements do not return when deleting a database with offline vnodes
19. fix: explorer database name now case-sensitive
20. fix: when rolling back a failed change from a single replica to three replicas, data cleanup errors during the rollback process can lead to the failure of the change.
21. fix: when the length of the condition field in the system table information_schema.ins_user_privileges exceeds 32 characters, the displayed content is incomplete.
22. fix: allow regular users to execute the show disk_info command
23. fix: tables error in case of taosBenchmark input with csv
24. fix: explorer max password length should be 255
25. fix: excel odbc loading data error via websocket
26. fix: stream computing result table not being fully created in certain situations
27. fix: when the transaction to create a database fails, repeatedly sending messages can cause high CPU usage.
28. fix: the number of file groups displayed by the “show compacts” command does not match the actual number.
29. fix: stream task fails to start after the rolling upgrade.
30. fix: the checkpointBackupDir being too large in the stream task.
31. fix: when using Websocket parameter binding to batch write data, Chinese characters in subtable names will cause garbled text#29998
32. fix: TDgpt may yield abnormal results when running on the ARM64 platform.
33. fix: ftmt binding failure followed by re-binding causes a crash.

What's Changed

• test case checking workflow by @minhuinie in #30274
• refactor: test dir by @feici02 in #30280
• update jdbc highvolume example and efficient wiring docs by @sheyanjie-qq in #30422
• docs: en doc for tdgpt by @danielclow in #30397
• merge: from 3.0 to main branch by @guanshengliang in #30427
• docs: update installation instructions for Anode by @tjuzyp in #30425
• fix:remove stmt2_get_fields binfo cache by @Pengrongkun in #30420
• doc: update title by @hjxilinx in #30424
• test:add coverage workflow by @happyguoxy in #30435
• doc: update gpt doc. by @hjxilinx in #30428
• fix: coverage scripts by @guanshengliang in #30438
• docs: [TS-4897] Use markdown table instead of pics. by @Simon9997 in #30436
• enh: [TD-34190] remove-wrong-log by @cadem in #30408
• fix(gpt): add host into script by @hjxilinx in #30440
• docs: adjust tdgpt img size by @danielclow in #30439
• Update 01-introduction.md by @leemingjun in #30441
• feat: change package tar file name by @SallyHuo-TAOS in #30442
• fix(gpt): configure the host address by @hjxilinx in #30443
• ci: fix build error on macOS [skip ci] by @feici02 in #30445
• chore: update taos.cfg by @feici02 in #30448
• fix(gpt): update the host port by default. by @hjxilinx in #30447
• doc: update doc by @hjxilinx in #30449
• ci: add two more triggers by @feici02 in #30451
• fix: update product names in release script for TDgpt by @tomchon in #30452
• doc: update doc. by @hjxilinx in #30453
• doc: update the doc. by @hjxilinx in #30455
• docs: update release note for 3.3.6.0 in office web by @feici02 in #30454
• Update 3.3.6.0.md by @tomchon in #30458
• docs: Update 02-tutorial.md by @jiajingbin in #30460
• enh: add Dockerfile for TDgpt and modify dockerbuild.sh for cloud-tdgpt by @jiajingbin in #30446
• enh: allow ordinary users to execute the “show anodes” command. by @guanshengliang in #30464
• docs:fix install.sh with a non-root user and add denpendencies in 02-tutorial.md by @tomchon in #30459
• fix: rollback error release note by @guanshengliang in #30465
• fix(gpt): add training script. by @hjxilinx in #30466
• enh: allow users to see all fields in "show anodes" by @guanshengliang in #30467
• docs: Update 02-tutorial.md for tdengine-tdgpt-full by @jiajingbin in #30471
• doc: update docs. by @hjxilinx in #30468
• fix: show anodes by @guanshengliang in #30474
• docs: revise the document directory structure by @guanshengliang in #30472
• doc: update doc. by @hjxilinx in #30475
• docs: update tdgpt installation steps by @jtao1735 in #30478
• doc: update doc for timegpt by @hjxilinx in #30477
• docs/ optimize the description regarding taosAdapter by @yu285 in #30481
• docs/ correct the "variable" to "variables" by @yu285 in #30482
• docs: minor changes by @guanshengliang in #30484
• fix: the follower vnode sometimes remains in the restore=false state for a long time after restart by @guanshengliang in #30490
• doc: Update 02-tutorial.md by @hjxilinx in #30486
• Update 30-python.md for taospy official name by @DuanKuanJun in #30487
• Update 04-machine-learning.md by @hjxilinx in #30497
• docs: jdbc 3.6.0 and fix grafana compose cfg issue by @sheyanjie-qq in #30499
• fix(csv): fix lost some ctbs while create table using csv file. by @xiao-77 in #30483
• improve highvolume pic by @sheyanjie-qq in #30505
• ci: add cloud docs to tdengine-doc-build.yml by @tomchon in #30502
• docs: add installation doc for TDengine Enterprise by @zitsen in #30509
• doc: update docs. by @hjxilinx in #30510
• TDengine case docs by @minhuinie in #30495
• feat(taosBenchmark): supports decimal data type on main branch by @YamingPei in #30504
• docs: remove the relevant content of Flink Source CDC from the offici… by @menshibin in #30462
• docs: correct pip by @feici02 in #30517
• Update 01-introduction.md by @tomchon in #30511
• docs: fix link to taosd reference manual in node configuration sect...

Behavior change and compatibility

Features

1. feat: supports Decimal data type
2. feat: improve compatibility of taosc
3. feat: support retrieving the values of other columns in the row returned by the single-row selection function through the cols keyword.
4. feat: integrate with haixun database api
5. feat: support constant as join primary key
6. feat: change the max value of minFreeDiskSize to 2TB
7. feat: supports control the retention period of time-series data in the supertable via the KEEP parameter.
8. feat: support backup to s3 storage in taosX
9. feat: effient data writing in JDBC
10. feat: improve error handling of taosX
11. feat: support persistent cache to guarantee data completement
12. feat: interate with perspective BI library
13. feat: support taos_validate_sql in websocket
14. feat: integrate Tableau with ODBC driver
15. feat: supports virtual table
16. feat: taosbechmark can generate csv files
17. feat: TDengine now integrate with FineBI
18. feat: supports the use of virtual tables in stream computing
19. feat: stream computing supports the continue_window_close trigger mode.
20. feat: stream computing supports window event notification
21. feat: stream computing support setting a minimum duration limit for event window and state window.
22. feat: support for greatest and least Functions
23. feat: provide an alias regexp for the operator match.
24. feat: experimental decimal data types support in explorer
25. feat: support decimal types in rust connector
26. feat: taosX/agent support https connection
27. feat: explorer add support for sql formatter
28. feat: taosX support export/import data-in tasks
29. feat: support request ts as primary key in opc-da

Enhancements

1. enh: when the topic enables the "only meta" option, the data subscription interface will no longer transmit time-series data.
2. enh: support compact TDB files.
3. enh: execute stream creation asynchronously to reduce response time.
4. enh: improve kafka performance in taosX
5. enh: support index creation for tag fields of nchar and varchar types.
6. enh: significantly enhance the data synchronization performance between clusters
7. enh: optimize the distribution of data files across multiple disks within the same tier in multi-level storage
8. enh: connectors support new subscription params
9. enh: improve the write performance of automatic table creation
10. enh: taosX should raise error when WAL retention period is 0
11. enh: improve error messages in explorer
12. enh: improve performance of mqtt fetching messages
13. enh: c# connector add async receiver for websocket connection
14. enh: filter timestamp by configuration for hebei power transform
15. enh: suppport stmt via websocket in taosBenchmark
16. enh: increase the error troubleshooting information for dual-replica databases
17. enh: improve consumer polling strategy in ws(taosAdapter)
18. enh: Interp function supports interpolation over a time range.
19. enh: support for monitoring vnode recovery progress through SQL
20. enh: tracking new database with replica cli
21. enh: support the use of conditional expressions in the CAST function
22. enh: supports using the LIKE keyword in the SHOW VARIABLES series commands to enable pattern matching for variable names.
23. enh: root can view/edit all tasks in explorer
24. enh: OPCDA datasource table template can use {/tagname}{id}{_id} extractor
25. enh: introduce the "assign leader" command for dual-replica clusters to address the issue of cluster recovery when a dnode with a higher WAL version fails to start.
26. enh: optimize the service recovery time of a dual-replica cluster after a single-node failure
27. enh: refactor the STMT code to significantly enhance query and write performance.
28. enh: improve benchmark writing robotics
29. enh: extend the maximum password length to 255 characters.
30. enh: when subscribe data, consumers can set the minimum rows and maximum waittime.
31. enh: respect to log.* settings in configuration for opc logs
32. enh: C taosws support session.timeout.ms
33. enh: support long passwords with special characters in all components
34. enh: support additional subscription parameters in JDBC
35. enh: Python consumer can subscribe topic using newly added parameters
36. enh: allow newly added subscription params without updating connectors
37. enh: MQTT fallback to ssl when tcp failed
38. enh: add a percentage sign (%) after the compression ratio value in the results displayed by show disk_info.
39. enh: includes inspection tools in the Enterprise Edition.
40. enh: stream computing supports sliding window in the force_window_close mode
41. enh: supports silent uninstallation of the tar package using the -e parameter.
42. enh: improve the efficiency of downsampling and group by tag queries
43. enh: taosX does not allow start repeatedly
44. enh: add DST(Daylight Saving Time) guideline
45. enh: improve cpu/mem performance in OPC data-in
46. enh: use fixed seconds format in explorer table view
47. enh: support deletion of topics with active consumers.

Fixes

1. fix: OOM may occur when dropping a super table containing a large number of child-tables.
2. fix: taosX util to read archived data
3. fix: explorer should raise error when password is not valid
4. fix: In stmt2 interlace mode, asynchronous execution returns incorrect affectrow count.
5. fix: explorer display error reason for backup tasks
6. fix: vnode may go offline when dnode is overloaded
7. fix: stream computing experiences a significant backlog of transactions during vgroup leader switch, resulting in computational delays.
8. fix: fix explorer oss --version error
9. fix: support special characters of password in Node.js
10. fix: random value out of range in taosBenchmark
11. fix: fix os error 10053 on windows for OPCUA
12. fix: taosX panic when adapter/nginx restarted in some cases
13. fix: the results of the show disk_info command are incorrect when configuring multi-level storage.
14. fix: typo in the execution result of show .disk_info
15. fix: when querying super table, using ORDER BY and LIMIT together may return an unexpected record.
16. fix: allow health params in 2.x data-in
17. fix: backup next execution time does allow past time
18. fix: fix compatibility of backup task upgrading to latest
19. fix: query error when performing a UNION operation on multiple nested queries.
20. fix: in state window queries, if the same expression exists in both the PARTITION BY and SELECT clauses, it will cause taosd to crash.
21. fix: when the subquery does not return any results but contains the LIMIT 1 clause, it may cause the result of the parent query to be abnormal or inaccurate.
22. fix: taosc crash when table names contain *
23. fix: on windows, closing a JDBC PreparedStatement while writing data may cause the JVM to crash.#30106
24. fix: when using Websocket parameter binding to batch write data, Chinese characters in subtable names will cause garbled text #29998

What's Changed

• Revert "Revert "Enh:[td 29974]improve trans"" by @guanshengliang in #29378
• enh: add more cases by @hzcheng in #29369
• merge: from main to 3.0 branch by @guanshengliang in #29389
• Revert "Revert "Revert "Enh:[td 29974]improve trans""" by @guanshengliang in #29392
• Revert "Revert "Revert "Revert "Enh:[td 29974]improve trans"""" by @guanshengliang in #29393
• test: add test case for auto compact by @kailixu in #29374
• Enh/stmt2-testcase by @Pengrongkun in #29363
• test case by @facetosea in #29398
• merge: from main to 3.0 branch by @guanshengliang in #29397
• enh/TD-29974-improve-trans-add-case by @cadem in #29371
• [TD-33393] fix(keeper): add gitinfo by @qevolg in #29414
• merge: from main to 3.0 branch by @guanshengliang in #29423
• test: add test cases and fix related bugs. by @hjxilinx in #29381
• fix(docs/s3): make OBS explicitly by @stephenkgu in #29428
• Enh(coverage):config&wal by @xiao-77 in #29417
• fix:[TD-33396]add log for tmq by @wangmm0220 in #29427
• Enh/hz-testcase by @hzcheng in #29352
• Fix(cover):fix some review errors in pr 29417. by @xiao-77 in #29434
• fix drop view caused crash by @wangjiaming0909 in #29432
• fix:[TS-5651]skip-sync-heartbeat by @cadem in #29450
• merge: from main to 3.0 branch by @guanshengliang in #29454
• fix(test/blob): not run UT of blob by @stephenkgu in #29459
• fix:[TD-32471]set error code to terrno if tmq_consumer_poll return NULL by @wangmm0220 in #29436
• fix: snapshot.py failed by @hzcheng in #29468
• fix: set parent sort error by @facetosea in #29482
• Freemine.lemon.warning.as.error.with.jointest by @freemine...

Behavior change and compatibility

Features

1. feat: suppport tmq subscription with ONLY META in JDBC
2. feat: support multiple-line SQL editor in Grafana
3. feat: add support for VARBINARY/GEOMETRY in ODBC
4. feat: support TDengine with ODBC dirver in Excel
5. feat: taosX agent use specific port range in local connection

Enhancements

1. enh: websocket handle consumer error when tmq polled nothing
2. enh: JDBC add support for unsigned integers
3. enh: expose global.written_concurrent configuration for kafka/mqtt/csv in Explorer
4. enh: support integration with TDgpt in community version
5. enh: support BinaryRowData type in flink
6. enh: in stmt2 SQL statements, the LIMIT clause supports the use of ? as a parameter placeholder
7. enh: enable compression via websocket in taosX backup
8. enh: ODBC support SQL_ROWSET_SIZE in SQLSetStmtAttr
9. enh: expose num.of.consumers/writters configurations in Explorer
10. enh: Add connector files to the macOS installation package.
11. enh: handle errors when poll result is null in rust connector
12. enh: tsbs support csv output format
13. enh: add Classified Connections Counts table in TDinsight
14. enh: use consist float precision in explorer and tao shell
15. enh: flink table support update/delete
16. enh: taosX agent will resume connection when taosX server disconnected for long time

Fixes

1. fix: explorer support signup email with dot .
2. fix: flock syscall error on aws cloud storage in taosAdapter
3. fix: modify boolean tag values in sub-tables results in erroneous metadata from data subscriptions.
4. fix: allow spaces in columns of csv in explorer datain
5. fix: resolved the issue of high CPU usage by the stmtbind thread when the system is in an idle state
6. fix: health state tick to idle when no data consumed
7. fix: fix security issues in JDBC sample code
8. fix: fix upgrade compaibility issue of taosX
9. fix: ODBC core when set SQL_ATTR_TXN_ISOLATION with SQLSetConnectAttr
10. fix: received/processed_messages should be reset when task rerun
11. fix: when restoring data using taosX, it may crash if the database is not specified
12. fix: when creating a database, the keep_time_offset options supports suffixes h (hours) and d (days) for time values
13. fix: potential deadlocks while drop stream
14. fix: failed to write data in a dual-replica database when a single dnode is disconnected from the network
15. fix: when querying the information_schema.ins_tables table, a "Sync leader is unreachable" error may be triggered if the Leader of the mnode changes.
16. fix: the time-filtering query results involving composite primary keys were incorrect after data compact
17. fix: when the join condition of the primary key column is not a simple equality condition, it may lead to incorrect JOIN results
18. fix: error caused by cursor.fetchmany with custom length in python taosws
19. fix: the issue where the "show grants" command returned an incorrect number of columns
20. fix: unexpected backup points before schedule executing
21. fix: taosX task does not restart after interrupted
22. fix: jdbc select server_version() caused mem high-usage
23. fix: when using the WHERE tbname IN () statement, executing LAST query may cause taosd crash if the subtables filtered out do not belong to the same super table
24. fix: after taosd exits abnormally and is restarted, if the WAL that has not been written to the data file is too large, it may cause an OOM error during startup
25. fix: when using interp interpolation, if the select list contains string constants or string tags, the returned string content may be incomplete.#29353
26. fix: when performing a JOIN query on a super table, using a subquery as the right table may lead to missing results
27. fix: syntax error while use DISTINCT and ORDER BY together.#29263
28. fix: when using the CAST function to convert a floating-point number to a binary and then performing a comparison, the result may be inaccurate due to loss of precision#29382
29. fix: after upgrading from version 3.3.4 to 3.3.5, the taosd service fails to start properly if the configured charset does not exist in the system
30. fix: websocket api timing field should not be negtive
31. fix: duplicates backup points in taosX
32. fix: configuration item s3BucketName was incorrectly set as a global variable, leading to failures while file uploads to S3.

What's Changed

• readme refactor by @feici02 in #29529
• update readme by @feici02 in #29547
• Merge latest codes from main branch by @flyingangel2013 in #29563
• docs: update the structure for testing readme by @feici02 in #29580
• docs: add note for tsbs test by @tomchon in #29581
• doc: fix error in doc. by @hjxilinx in #29583
• doc: add Chaos Test to README and update some functions by @jiajingbin in #29587
• enh: remove stt_trigger limitation of community version. by @hzcheng in #29582
• ci:modify test readme by @tomchon in #29588
• fix(query)[TS-5907]: skip some decompressTest sub-cases on machines without AVX2 support by @JinqingKuang in #29586
• Docs/chr1 readme by @tomchon in #29589
• ci:modify test readme by @tomchon in #29590
• ci:modify test readme by @tomchon in #29591
• jdbc update to 3.5.2 by @sheyanjie-qq in #29592
• docs/optimize the description in "BALANCE VGROUP LEADER".md by @yu285 in #29577
• update README structure for support linux/win/mac platforms by charles by @tomchon in #29469
• fix/insert-when-2-replicas by @cadem in #29595
• enh: merge contrib test by @guanshengliang in #29593
• conditionally bypass some specific unit tests by @freemine in #29443
• fix(stream): adjust the free stream meta position and check the close flag by @hjxilinx in #29598
• enh: elapsed sma by @facetosea in #29578
• Update release note for 3.3.5.2 in office web by @feici02 in #29606
• docs(flink): modify source name by @menshibin in #29607
• enh:[TD-32588]refactor stmt-async-bind loop usleep to Producer Consumer Model by @Pengrongkun in #29611
• doc:update flink connector version by @menshibin in #29619
• fix(rpc):use tsApplyMemoryAllowed to control memory alloc while apply msg. by @xiao-77 in #29618
• fix:[TD-33570]return same error code by @Pengrongkun in #29610
• Fix:[td-33582] stmt get dont add errcode by @Pengrongkun in #29614
• Update 01-taosd.md by @liuyq-617 in #29604
• Update 01-arch.md by @WhiteFirry in #29605
• Update 04-maintenance.md by @WhiteFirry in #29620
• docs: add Tableau usage documentation by @menshibin in #29624
• Fix merge errors from pr 29618. by @xiao-77 in #29627
• docs: modify ODBC data source configuration jump by @menshibin in #29628
• fix:[TD-33556] tmq close elegantly to avoid invalid read in TD-32585 by @wangmm0220 in #29613
• Update 09-backup.md by @JackDong66 in #29630
• test:alter branch build by @happyguoxy in #29631
• fix:[TS-5941] fix interpolate varchar/nchar data error by @Simon9997 in #29634
• test: check default expire time by @kailixu in #29621
• fix: invalid subtable in tbname list by @dapan1121 in #29626
• enh: support ? in limit clause by @dapan1121 in #29633
• jdbc add unsigned data types support by @sheyanjie-qq in #29636
• fix(stream): check the checkpoint-report transId and checkpointId by @hjxilinx in #29615
• add chinese README by charles by @flyingangel2013 in #29647
• enh: refactor telemetry scripts by @jiajingbin in #29617
• fix:[TD-33600] windows error if taos exist without connection by @wangmm0220 in #29646
• enh: accelerate tsdb snapshot when data are all in stt file by @hzcheng in #29645
• fix: add table meta validation error and debug log by @dapan1121 in #29651
• enh(analysis): enable community edition to support anodes. by @hjxilinx in https://github.com/taosdata/TDengine/pul...