v0.6.0-dev4

What's Changed

• Add order by wrong column check. by @small-turtle-1 in #2515
• Refactor txn inferface before refactoring META data engine by @JinHai-CN in #2490
• Unnest2 by @small-turtle-1 in #2514
• Support rank features query:part2 by @yingfeng in #2518
• Fix empty datablock array. by @small-turtle-1 in #2516
• Fix column mismatch by @small-turtle-1 in #2520
• Add CurrentDate, CurrentTime and CurrentTimestamp Functions Part2 by @kche0169 in #2524
• Fix current_date by @JinHai-CN in #2526
• Fix bug in scalar fuction by @MaYangrui6 in #2528
• MemIndexRecover batchlize by @dwxiayi in #2527
• Optimize current time fuction and add some http examples by @MaYangrui6 in #2531
• Fix parser error and add explain examples by @JinHai-CN in #2538
• Fix bmp bp reorder by @small-turtle-1 in #2543
• Implement explain analyze by @JinHai-CN in #2541
• Fix config error by @JinHai-CN in #2546
• Fix lsg build with cosine type. by @small-turtle-1 in #2551
• Update build_from_source.mdx by @joy-joy-joy-joy-joy-joy-joy in #2558
• Update logical_planner.cpp by @joy-joy-joy-joy-joy-joy-joy in #2559
• Fix build for Linux/aarch64 on MacOS Apple Silicon by @min-mwei in #2564
• Updated code examples by @writinwaters in #2570
• fix path construction in BaseUrl::BuildUrl() by @MikeIvanichev in #2572
• Update CI script by @JinHai-CN in #2576
• Add third_party rocksdb by @JinHai-CN in #2486
• Fix and add parallel test by @JinHai-CN in #2578
• Implement SHOW CATALOG and SHOW CATALOG TO FILE_PATH; Fix bug in meta_tree by @euvre in #2577
• Fix tranform_meta test by @euvre in #2583
• some cases in chaos by @joy-joy-joy-joy-joy-joy-joy in #2580
• Added sqllogictest CI by @yuzhichang in #2579
• Check confict for add column and drop column by @qinling0210 in #2582
• Fix memory leak and import by @JinHai-CN in #2586
• Remove lock/unlock table by @qinling0210 in #2588
• complete chaos_test except update by @joy-joy-joy-joy-joy-joy-joy in #2589
• Remove use_new_catalog in physical_show.cpp by @qinling0210 in #2590
• Remove use_new_catalog - 2 by @qinling0210 in #2591
• Remove use_new_catalog - 3 by @qinling0210 in #2592
• Remove use_new_catalog - 4 by @qinling0210 in #2593
• Restore catalog cache, part1 by @JinHai-CN in #2594
• Added BottomExecutor by @yuzhichang in #2598
• conflict check using txn store by @qinling0210 in #2602
• Refactor catalog cache by @JinHai-CN in #2599
• Implement check statement by @euvre in #2601
• Refactor : Enable conflict check using txn store by @qinling0210 in #2604
• Fix the conflict issues within the transaction by @euvre in #2606
• Implement catalog cache by @JinHai-CN in #2605
• Fix txn create index by @euvre in #2611
• Remove unused code by @JinHai-CN in #2608
• More conflict check by @qinling0210 in #2612
• Fix compact conflict by @JinHai-CN in #2614
• Remove rollback transaction from bottom executor by @euvre in #2610
• Fix rollbacked txn isn't removed from check txn structure by @JinHai-CN in #2616
• Wrap the AbstractHnsw type (implemented using variant) in the HNSW index. by @19-hanhan in #2615
• Add 'ApplyChunkID' interface by @JinHai-CN in #2618
• Use RocksDB to store clean information by @euvre in #2617
• Wrap the AbstractBMP type (implemented using variant) in the BMP index. by @19-hanhan in #2620
• Fix the database clean-up fails after checkpoint and restart by @euvre in #2626
• Fix txn and commit timestamp error after restart by @JinHai-CN in #2624
• Fix catalog cache restore by @JinHai-CN in #2627
• Fix HNSW index load failure during infinity restart by @19-hanhan in #2630
• Remove empty dir or pm meta data after clean by @euvre in #2631
• Fix index store path by @euvre in #2632
• Fix restart test case, part1 by @JinHai-CN in #2628
• Fix memory leak by @JinHai-CN in #2633
• Remove python embedded in python test by @euvre in #2634
• Restart test, part2 by @JinHai-CN in #2635
• Refactor code by @JinHai-CN in #2637
• Fix memory leak and output in kv_store by @euvre in #2639
• Clear embedded_infinity from CI script and CMakeLists.txt by @euvre in #2636
• Docs: Removed embedded mode by @writinwaters in #2644
• Docs: Fixed a Docusaurus display issue by @writinwaters in #2645
• Docs: Updated readme by @writinwaters in #2646
• Refactor TxnStore and Append by @yuzhichang in #2619
• Fix drop key construction by @JinHai-CN in #2650
• Fix the restart test by @euvre in #2651
• Fix python test run_parallel_test.py by @euvre in #2647
• Fix the issue where items that failed during this clean could never be deleted by @euvre in #2643
• Fix the restart test2 by @euvre in #2653
• Fix replay create table and create index by @JinHai-CN in #2652
• Remove delta checkpoint by @JinHai-CN in #2655
• Remove old compact process by @JinHai-CN in #2657
• Remove old compaction process, part2 by @JinHai-CN in #2658
• Refactor bg task by @JinHai-CN in #2659
• Refactor dump mem index by @qinling0210 in #2656
• Fix background tasks by @JinHai-CN in #2663
• Remove old txn by @JinHai-CN in #2667
• Solve deadlock of mem index mutex and table index reader cache mutex by @qinling0210 in #2665
• Refactor bottom executor by @JinHai-CN in #2666
• Remove SetMemIndexDump and check conflict between dump mem index commands in a table by @qinling0210 in #2669
• Fixed fulltext_index_scan by @yuzhichang in #2671
• Introduce mem index process by @JinHai-CN in #2670
• Tidy up test scripts by @yuzhichang in #2673
• Add dump index background processor by @JinHai-CN in #2674
• Remove AddChunkWal(), use Map in CompactTxnStore and ImportTxnStore by @qinling0210 in #2672
• Adapted realtime inverted index building by @JinHai-CN in #2675
• Dump mem index for sealed segments generated by Append in dump index processor by @qinling0210 in #2676
• Refactor code by @JinHai-CN in #2642
• Avoid rollback txn again on commit failure by @qinling0210 in #2679
• Remove unused code by @JinHai-CN in #2678
• Remove old catalog by @JinHai-CN in #2680
• Refactor code by @JinHai-CN in #2681
• Tidy up slow test scripts by @yuzhichang in #2684
• Add show tasks framework by @JinHai-CN in #2682
• Dump index in dump index processor by @qinling0210 in #2683
• Fix show tasks by @JinHai-CN in #2687
• Add dumping emvb index to dump index process by @qinling0210 in #2688
• Fix optimize index task info by @JinHai-CN in #2689
• Modify optimize index txn store by @qinling0210 in #2690
• Fixed test_fulltext.py, refactored GetFtInfo by @yuzhichang in #2692
• Show tasks for background activities by @qinling0210 in #2695
• Add clean data command by @JinHai-CN in #2691
• Make import and compact support rollback by @euvre in #2668
• Fix a bug where deleting a scheduled entity removed all entities with the same name by @euvre in #2697
• Remove old txn_manager instance in storage by @JinHai-CN in #2696
• Remove code by @JinHai-CN in #2699
• Remove multiple phase compact code by @JinHai-CN in #2701
• Optimize knn benchmark test. by @19-hanhan in #2662
• Remove create index do and finish by @JinHai-CN in #2702
• Remove more code on old txn by @JinHai-CN in #2703
• Fix select(*) when there is no data in the table by @qinling0210 in #2698
• Remove code by @JinHai-CN in #2706
• Remove src/storage/meta code in HNSW & BMP. by @19-hanhan in #2708
• Modify data collection script by @qinling0210 in #2705
• Add dump cmd by @qinling0210 in #2707
• Remove code by @JinHai-CN in #2709
• Rollback dump index by @qinling0210 in #2710
• Cleanup conflict check and avoid by @euvre in #2711
• Make optimize index support rollback by @euvre in #2716
• Remove code by @JinHai-CN in #2712
• Add & Optimize Knn Benchmark. by @19-hanhan in #2720
• Remove Entry Method from AbstractHnsw & AbstractBMP. by @19-hanhan in #2715
• Remove code by @JinHai-CN in #2721
• Removed TableEntry, SegmentEntry and etc. by @yuzhichang in #2722
• Remove unused third party lib by @JinHai-CN in #2725
• Update spdlog to v1.15.3 by @JinHai-CN in #2723
• Update thrift version to 0.22.0 by @JinHai-CN in #2724
• Remove unused code by @JinHai-CN in #2729
• Fix compile under Mac/X86 by @yingfeng in #2732
• Add simdjson for benchmark. by @19-hanhan in #2727
• Refactor cleanup by @euvre in #2731
• Fix a crash in VFS mode when MakeMetaTree is called between a write transaction and its checkpoint by @euvre in #2736
• Removed PersistenceManager::local_path_obj_ by @yuzhichang in #2734
• Refactor some code by @euvre in #2738
• Fixed ObjectStatAccessor race condition by @yuzhichang in #2743
• Fixed PersistenceManager::PutObjCache by @yuzhichang in #2746
• Fix an issue where Cleanup wasn't working correctly by @euvre in #2726
• MVCC Refactor: db, table, index, column, segment by @qinling0210 in #2745
• Update config: remove description of full checkpoint by @JinHai-CN in #2750
• Rollback create index by @qinling0210 in #2751
• Add to flush meta data by @JinHai-CN in #2752
• Introduced TableMeeta::InvalidateFtIndexCache by @yuzhichang in #2753
• Fix NewTxn::Import to request more than one segment when needed by @yuzhoumao in #2748
• Disable conditions for kEmbedding type in expression binder. by @19-hanhan in #2749
• export with deleted rows by @qinling0210 in #2754
• Implement check system for checking the diference between catalog and the data in file system by @euvre in #2747
• Add index examples by @qinling0210 in #2759
• Add testunit in new_txn_replay.cpp by @qinling0210 in #2760
• Introduced SegmentIndexMeta::PopMemIndex() by @yuzhichang in #2756
• Fix memoty leak in HnswHandler. by @19-hanhan in #2739
• Fix bug in GetTableSegments() and more testunit in new_txn_replay.cpp by @qinling0210 in #2763
• Avoid printing value of fast_rough_filter by @qinling0210 in #2764
• Enhance check system perfermance by @euvre in #2765
• Disallow drop-ops after latest checkpoint by @euvre in #2757
• Refactor replay by @JinHai-CN in #2733
• Replace json operation by simdjson by @19-hanhan in #2755
• Refactor secondary index by @yingfeng in #2771
• Fix test_index.py in slow test by @qinling0210 in #2768
• Ensure that module imports occur after module exports by @euvre in #2776
• Fix heap-buffer-overflow error during search using BMP index by @qinling0210 in #2775
• Implement secondary index with low cardinality by @yingfeng in #2779
• Trigger dump by memory or row count by @yuzhichang in #2769
• Replace #include with module imports by @euvre in #2778
• Improve performance for in memory secondary index using rcu map by @yingfeng in #2783
• Fix restart test_insert_import.py in slow test by @qinling0210 in #2785
• Fix restart test_insert.py in slow test by @qinling0210 in #2784
• Fix txn conflict check bug, which lead to drop db cache error by @JinHai-CN in #2780
• Refactor system cache by @JinHai-CN in #2781
• Use rcu map to improve concurrent accessing performance of full-text in-memory index by @yingfeng in #2787
• Modularize query_node and search_driver for full text search by @yingfeng in #2789
• Fix memory leak by @JinHai-CN in #2793
• Update sdk version by @JinHai-CN in #2796
• Fix data race in UT by @JinHai-CN in #2797
• Implement FDE algorithm for Tensor query by @yingfeng in #2801
• Refactor column vector by @JinHai-CN in #2792
• Fix slow_test test_alter_complex failure by @yuzhichang in #2788
• Fix flush type by @JinHai-CN in #2790
• Add fde function to select by @yingfeng in #2805
• Fix check system & slow_test.yml by @qinling0210 in #2803
• Add flush catalog interface on pysdk by @JinHai-CN in #2782
• Fix MemIndexTracer::DecreaseMemUsed and IVFIndexInMemT::BuildIndex by @yuzhichang in #2815
• Finalize object when dump mem index / optimize / compact / import by @JinHai-CN in #2814
• Fix dump index issue by @qinling0210 in #2809
• Refactored MemIndexTracer::DecreaseMemUsed by @yuzhichang in #2816
• Replace serialize by simdjson by @19-hanhan in #2807
• Refactor destructor of derived class by @JinHai-CN in #2817
• Fixed rwlock bugs found in slow test by @yuzhichang in #2821
• Update test tool by @JinHai-CN in #2813
• Remove unused code by @JinHai-CN in #2823
• Update CI workflow by @JinHai-CN in #2831
• Fix ref count issue in test_big_many_import.slt by @qinling0210 in #2825
• Fix clean data issue in show.slt by @qinling0210 in #2820
• Added cpptrace by @yuzhichang in #2806
• Add mutex protection for BlockVersion by @qinling0210 in #2833
• Add more mutex protection in NewTxnManager by @qinling0210 in #2834
• Fix sort issue in GetAllMemIndexes() by @qinling0210 in #2838
• Use the relevent commit_ts to perform the deletion by @euvre in #2837
• Fixed data race by @yuzhichang in #2839
• Feature/snapshot thrift support by @james-zhengql in #2795
• Fix the out-of-bound issue in column_inverter.cpp by @euvre in #2841
• Fix test_insert.py in restart by @qinling0210 in #2843
• Fix skipping replaying import command by @JinHai-CN in #2810
• Add PD in PickForCleanup by @qinling0210 in #2845
• Fix buffer object status error by @JinHai-CN in #2846
• Fix data race by @yuzhichang in #2844
• FIx test_insert_import.py in restart, modify slow_test.yml by @qinling0210 in #2849
• Fix check txn bug by @JinHai-CN in #2850
• Fix data race, avoid query retry on conflicts by @qinling0210 in #2852
• Fixed Dockerfile_infinity_builder_centos7 by @yuzhichang in #2853
• Fix error conflict range by @JinHai-CN in #2851
• Fix data race in PositionListEncoder and DocListEncoder by @qinling0210 in #2856
• Fix show segment idx by @qinling0210 in #2860
• Added test_rank_features.py by @yuzhichang in #2859
• Update SDK version by @JinHai-CN in #2822

New Contributors

• @dwxiayi made their first contribution in #2527
• @joy-joy-joy-joy-joy-joy-joy made their first contribution in #2558
• @min-mwei made their first contribution in #2564
• @MikeIvanichev made their first contribution in #2572
• @yuzhoumao made their first contribution in #2748
• @james-zhengql made their first contribution in #2795

Full Changelog: v0.6.0-dev3...v0.6.0-dev4