Expand object detection to include insects, birds, pests, domestic an…#2
Open
anhed0nic wants to merge 1 commit intoAnanthaRajuC:mainfrom
Open
Expand object detection to include insects, birds, pests, domestic an…#2anhed0nic wants to merge 1 commit intoAnanthaRajuC:mainfrom
anhed0nic wants to merge 1 commit intoAnanthaRajuC:mainfrom
Conversation
…imals, Hideo Kojima game characters, airplanes, cars, rocks/minerals, and game animals - Updated prompts to identify multiple object categories - Modified database schema to use category/object fields - Updated all code to handle new JSON structure - Fixed imports and search functionality - Updated documentation and README
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Expand Object Detection Capabilities
Description
This pull request expands the LLM-Vision-Capabilities project from crop detection to a comprehensive object detection system that can identify a wide range of objects including:
Changes Made
1. Prompt Updates
crop_detection.txtandcrop_analysis_20250614.txtto identify objects from the expanded categories2. Database Schema Changes
crop_analysis_results→object_analysis_resultscrop_detection_results→object_detection_resultscategoryandobjectfields instead of justcrop3. Code Modifications
config.pywith new table environment variablesclickhouse_client.pysave functions to handle new JSON structureCropSemanticSearch.py(now handles multiple categories)4. Search and Voice Integration
5. Documentation Updates
Technical Details
JSON Response Structure
{ "category": "crops|insects|birds|pests|domestic animals|Hideo Kojima game characters|airplanes|cars|rocks/minerals|game animals", "object": "specific object name", "alternate_names": ["..."], "color": ["..."], "confidence": 0.95, "overall_description": "...", // ... detailed analysis fields with N/A for irrelevant categories }Database Changes
Testing
Breaking Changes
Migration Notes
Users will need to:
CLICKHOUSE_OBJECT_*instead ofCLICKHOUSE_CROP_*This enhancement significantly expands the system's capabilities while maintaining the core vision-language model architecture and search functionality.