Adding Query Validation Workflow

.github/workflows/validate-queries.yml

@@ -0,0 +1,81 @@
+name: SQL Query Validation
+on:
+  pull_request:
+    paths:
+      - 'docs/**/*.md'
+      - 'blog-*/**/*.md'
+
+jobs:
+  validate-queries:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+        with:
+          fetch-depth: 0  # Required for git diff detection
+
+      - name: Check for SQL changes
+        id: check-sql
+        run: |
+          # Get the base commit for comparison
+          if [ "${{ github.event_name }}" = "pull_request" ]; then
+            BASE_COMMIT="${{ github.event.pull_request.base.sha }}"
+          else
+            # For push events, compare with previous commit
+            BASE_COMMIT="${{ github.event.before }}"
+          fi
+
+          echo "Base commit: $BASE_COMMIT"
+          echo "Current commit: ${{ github.sha }}"
+
+          # Get changed markdown files
+          git diff --name-only --diff-filter=AM $BASE_COMMIT...${{ github.sha }} -- '**/*.md' > changed_files.txt
+
+          if [ ! -s changed_files.txt ]; then
+            echo "No markdown files changed"
+            echo "sql_changed=false" >> $GITHUB_OUTPUT
+            exit 0
+          fi
+
+          echo "Changed markdown files:"
+          cat changed_files.txt
+
+          # Check if any of the changed files have SQL code block modifications
+          SQL_CHANGED=false
+          while IFS= read -r file; do
+            if [ -f "$file" ]; then
+              # Check if the file contains SQL code blocks AND has changes
+              if grep -q "\`\`\`sql\|\`\`\`sumo" "$file"; then
+                echo "File contains SQL blocks, validating: $file"
+                SQL_CHANGED=true
+              fi
+            fi
+          done < changed_files.txt
+
+          echo "sql_changed=$SQL_CHANGED" >> $GITHUB_OUTPUT
+          echo "SQL changes detected: $SQL_CHANGED"
+
+      - name: Set up Python
+        if: steps.check-sql.outputs.sql_changed == 'true'
+        uses: actions/setup-python@v4
+        with:
+          python-version: "3.10"
+
+      - name: Install dependencies
+        if: steps.check-sql.outputs.sql_changed == 'true'
+        run: pip install requests python-dotenv
+
+      - name: Validate queries
+        if: steps.check-sql.outputs.sql_changed == 'true'
+        working-directory: ./scripts
+        env:
+          SUMO_LOGIC_ACCESS_ID: ${{ secrets.SUMO_LOGIC_ACCESS_ID }}
+          SUMO_LOGIC_ACCESS_KEY: ${{ secrets.SUMO_LOGIC_ACCESS_KEY }}
+          BASE_COMMIT: ${{ github.event_name == 'pull_request' && github.event.pull_request.base.sha || github.event.before }}
+          CURRENT_COMMIT: ${{ github.sha }}
+        run: |
+          echo "Validating only changed SQL queries between $BASE_COMMIT and $CURRENT_COMMIT"
+          python validate_queries.py
+
+      - name: Skip validation
+        if: steps.check-sql.outputs.sql_changed == 'false'
+        run: echo "No SQL code block changes detected, skipping validation"

docs/metrics/metrics-operators/where.md

@@ -12,7 +12,6 @@ You can use the `where` operator to filter out either entire time series, or ind
 ```sql
 where [VALUE BOOLEAN EXPRESSION | REDUCER BOOLEAN EXPRESSION]
 ```
-
 Where:
 
 * `[VALUE BOOLEAN EXPRESSION]` is a value expression that operates on individual data points of a time series. For example,

docs/search/search-query-language/search-operators/isvalidip.md

@@ -53,6 +53,9 @@ The following returns `true`:
 ```sql
 | isValidIP("10.255.255.255") as isIP
 ```
+```sql
+| isValidIP("30.255.255.255") as isIP
+```
 
 The following returns `true`:
 

docs/search/search-query-language/search-operators/where.md

@@ -12,6 +12,13 @@ For example, using `where` with the boolean operator [`isValidIP`](/docs/searc
     ```sql
     | where isValidIP("192.168.0.10")
     ```
+* Checking my PR:
+    ```sql
+    _collector="ABC1" | where type="web"
+    ```
+    ```sql
+    _collector="ABC7" | where type="web"
+    ```   
 * Filters as false and will not return results:
     ```sql
     | where !isValidIP("192.168.0.10")