ES index mode & codec in metricbeat (#49237)

* Add `mode` and `codec` fields to the `elasticsearch.index` metricset in Metricbeat. Update index settings retrieval and mapping to include these new fields.

* Add new exported fields for Elasticsearch in Metricbeat documentation

* Make update

* Added fragment

(cherry picked from commit 7dc72ea)

# Conflicts:
#	CHANGELOG.asciidoc

Author: 3kt

CHANGELOG.asciidoc

@@ -3,9 +3,285 @@
 :issue: https://github.com/elastic/beats/issues/
 :pull: https://github.com/elastic/beats/pull/
 
+<<<<<<< HEAD
 [[release-notes-9.0.0]]
 === Beats version 9.0.0
 https://github.com/elastic/beats/compare/v9.0.0-rc1\...v9.0.0[View commits]
+=======
+// begin 8.19.12 relnotes
+
+[[release-notes-8.19.12]]
+=== Beats version 8.19.12
+
+https://github.com/elastic/beats/compare/v8.19.11\...v8.19.12[View commits]
+
+[discrete]
+[[security-updates-8.19.12]]
+==== Security updates
+
+**All**
+
+* Update `elastic-agent-autodiscover` to v0.10.2. https://github.com/elastic/beats/pull/48817[#48817]
+
+[discrete]
+[[features-enhancements-8.19.12]]
+==== New features and enhancements
+
+**Filebeat**
+
+* Add support for managed identity authentication to the `azure-eventhub` input. https://github.com/elastic/beats/pull/48655[#48655] https://github.com/elastic/beats/issues/48680[#48680]
+* Don't print warning about small files on each file system scan. https://github.com/elastic/beats/pull/48704[#48704] https://github.com/elastic/beats/issues/45642[#45642]
+
+[discrete]
+[[bug-fixes-8.19.12]]
+==== Bug fixes
+
+**Elastic Agent**
+
+* Fix a bug which could report an invalid number of active `otelconsumer` events. https://github.com/elastic/beats/pull/48720[#48720] https://github.com/elastic/elastic-agent/issues/12515[#12515]
+
+**Filebeat**
+
+* Enforce region configuration when `non_aws_bucket_name` is defined for the `awss3` input. https://github.com/elastic/beats/pull/48534[#48534] https://github.com/elastic/beats/issues/47847[#47847]
+* Fix an issue where the `azure-blob-storage` input was failing with the Storage Blob Data Reader RBAC role. https://github.com/elastic/beats/pull/48886[#48886] https://github.com/elastic/beats/issues/48890[#48890]
+
+**Heartbeat**
+
+* Add a missing dependency for Synthetics on Wolfi Docker image. https://github.com/elastic/beats/pull/48569[#48569]
+
+**Metricbeat**
+
+* Added `mode` and `codec` fields to the `elasticsearch.index` metricset.
+* Enforce configurable size limits on incoming requests for `remote_write` metricset (`max_compressed_body_bytes`, `max_decoded_body_bytes`). https://github.com/elastic/beats/pull/48218[#48218]
+
+**Osquerybeat**
+
+* Fix differential results using wrong data source for removed events. https://github.com/elastic/beats/pull/48438[#48438] https://github.com/elastic/beats/issues/48427[#48427]
+
+**Packetbeat**
+
+* Refactor the DHCPv4 parsers and fix parsing issues. The DHCP `router` field is now a list, as is specified in RFC2132. https://github.com/elastic/beats/pull/48414[#48414]
+* Clean up `int` overflows and array access issues in MySQL parsers. https://github.com/elastic/beats/pull/48543[#48543]
+* Add `int` overflow checks to the `http` parser. https://github.com/elastic/beats/pull/48563[#48563]
+
+// end 8.19.12 relnotes
+
+// begin 8.19.11 relnotes
+
+[[release-notes-8.19.11]]
+=== Beats version 8.19.11
+
+https://github.com/elastic/beats/compare/v8.19.10\...v8.19.11[View commits]
+
+[discrete]
+[[bug-fixes-8.19.11]]
+==== Bug fixes
+
+**All**
+
+* Fix Windows install script to properly migrate legacy state data. https://github.com/elastic/beats/pull/48293[#48293]
+* Remove use of github.com/elastic/elastic-agent-client from OSS Beats. https://github.com/elastic/beats/pull/48353[#48353] 
+
+**Filebeat**
+
+* Fix Active Directory Entity Analytics failing to fetch users when Base DN contains a group CN. https://github.com/elastic/beats/pull/48395[#48395] 
+* Fix Filebeat goroutine leak when using `harvester_limit`. https://github.com/elastic/beats/pull/48445[#48445]
+
+**Packetbeat**
+
+* Add check for incorrect length values in PostgreSQL DataRow parser. https://github.com/elastic/beats/pull/47872[#47872]
+* Fix procfs network parsers. https://github.com/elastic/beats/pull/48428[#48428]
+* Fix a panic in the Thrift struct parser triggered by malformed packets. https://github.com/elastic/beats/pull/48498[#48498]
+* Add array access checks to SIP parser. https://github.com/elastic/beats/pull/48514[#48514]
+* Fix potential array access panics and infinite loops in PostgreSQL parser. https://github.com/elastic/beats/pull/48528[#48528]
+
+// end 8.19.11 relnotes
+
+// begin 8.19.10 relnotes
+
+[[release-notes-8.19.10]]
+=== Beats version 8.19.10
+
+https://github.com/elastic/beats/compare/v8.19.9\...v8.19.10[View commits]
+
+[discrete]
+[[new-features-8.19.10]]
+==== New features
+
+The 8.19.10 release adds the following new and notable features.
+
+**Filebeat**
+
+* Add client secret authentication method for Azure Event Hub and storage in Filebeat. https://github.com/elastic/beats/pull/47256[#47256]
+* Improve input error reporting to Elastic Agent, especially when pipeline configurations are incorrect. https://github.com/elastic/beats/pull/47905[#47905] https://github.com/elastic/beats/issues/45649[#45649]
+* Support for AMQP-over-WebSocket transport in the azure-eventhub processor v2. https://github.com/elastic/beats/pull/47956[#47956] https://github.com/elastic/beats/issues/47823[#47823]
+
+[discrete]
+[[bug-fixes-8.19.10]]
+==== Bug fixes
+
+**All**
+
+* Add msync syscall to seccomp whitelist for BadgerDB persistent cache. https://github.com/elastic/beats/pull/48229[#48229]
+
+**Metricbeat**
+
+* Harden Prometheus metrics parser against panics caused by malformed input data. https://github.com/elastic/beats/pull/47914[#47914]
+* Add bounds checking to Zookeeper server module to prevent index-out-of-range panics. https://github.com/elastic/beats/pull/47915[#47915]
+* Fix panic in graphite server metricset when metric has fewer parts than template expects. https://github.com/elastic/beats/pull/47916[#47916]
+* Skip regions with no permission to query for AWS CloudWatch metrics. https://github.com/elastic/beats/pull/48135[#48135]
+
+**Packetbeat**
+
+* Fix bounds checking in MongoDB protocol parser to prevent panics. https://github.com/elastic/beats/pull/47925[#47925]
+
+// end 8.19.10 relnotes
+
+// begin 8.19.9 relnotes
+
+[[release-notes-8.19.9]]
+=== Beats version 8.19.9
+https://github.com/elastic/beats/compare/v8.19.8\...v8.19.9[View commits]
+
+[discrete]
+[[new-features-8.19.9]]
+==== New features
+
+The 8.19.9 release adds the following new and notable features.
+
+**All**
+
+* Make beats receivers emit status for their subcomponents. https://github.com/elastic/beats/pull/48015[#48015]
+
+**Metricbeat**
+
+* Update Kubernetes CPU and memory metrics to use allocatable values instead of capacity values. https://github.com/elastic/beats/pull/47815[#47815]
+
+**Packetbeat**
+
+* Rework IP fragmentation and make it bound. https://github.com/elastic/beats/pull/47970[#47970]
+
+[discrete]
+[[bug-fixes-8.19.9]]
+==== Bug fixes
+
+**Filebeat**
+
+* [Filestream] Ensure harvester always restarts if the file has not been fully ingested. https://github.com/elastic/beats/pull/47107[#47107] https://github.com/elastic/beats/issues/46923[#46923]
+* Prevent panic during startup if dissect processor has invalid field name in tokenizer. https://github.com/elastic/beats/pull/47839[#47839]
+
+**Metricbeat**
+
+* Improve defensive checks to prevent panics in Meraki module. https://github.com/elastic/beats/pull/47950[#47950]
+
+**Packetbeat**
+
+* Add bounds checking and ignore malformed RPC fragments. https://github.com/elastic/beats/pull/47803[#47803]
+* Verify and cap memcache UDP fragment counts. https://github.com/elastic/beats/pull/47874[#47874]
+
+// end 8.19.9 relnotes
+
+// begin 8.19.8 relnotes
+
+[[release-notes-8.19.8]]
+=== Beats version 8.19.8
+https://github.com/elastic/beats/compare/v8.19.7\...v8.19.8[View commits]
+
+[discrete]
+[[bug-fixes-8.19.8]]
+==== Bug fixes
+
+**All**
+
+* Fix a fatal startup error in Beats Receivers caused by truncation of long UTF-8 hostnames. https://github.com/elastic/beats/pull/47713[#47713]
+* Not being able to start the add_docker_metadata processor is now consistently a non-fatal error when Docker is not available. https://github.com/elastic/beats/pull/47760[#47760]
+
+**Filebeat**
+
+* Handle and remove BOM during JSON parsing in azureblobstorage and gcs inputs. https://github.com/elastic/beats/pull/47508[#47508]
+* Fixed an issue where filebeat could hang during shutdown when using the filestream input. https://github.com/elastic/beats/pull/47518[#47518]
+* Fix double locking in translate_ldap_attribute processor and improve logging. https://github.com/elastic/beats/pull/47585[#47585]
+* Fix possible data corruption in tcp, syslog and unix inputs. https://github.com/elastic/beats/pull/47618[#47618]
+* Skip s3 test events in filebeat s3 input. https://github.com/elastic/beats/pull/47635[#47635]
+
+// end 8.19.8 relnotes
+
+// begin 8.19.7 relnotes
+
+[[release-notes-8.19.7]]
+=== Beats version 8.19.7
+https://github.com/elastic/beats/compare/v8.19.6\...v8.19.7[View commits]
+
+[discrete]
+[[new-features-8.19.7]]
+==== New features
+
+The 8.19.7 release adds the following new and notable features.
+
+**Filebeat**
+
+* Add data stream identification to Fleet health status updates. https://github.com/elastic/beats/pull/47229[#47229]
+
+[discrete]
+[[bug-fixes-8.19.7]]
+==== Bug fixes
+
+**All**
+
+* Add `close` to conditional processors if underlying processors have `close` method. https://github.com/elastic/beats/pull/46653[#46653] https://github.com/elastic/beats/issues/46575[#46575]
+* Fix a bug where Kerberos authentication could be disabled when server supports multiple authentication types. https://github.com/elastic/beats/pull/47443[#47443] https://github.com/elastic/beats/issues/47110[#47110]
+
+
+**Filebeat**
+
+* Fix potential Filebeat panic during memory queue shutdown. https://github.com/elastic/beats/pull/47248[#47248]
+
+// end 8.19.7 relnotes
+
+[[release-notes-8.19.6]]
+=== Beats version 8.19.6
+https://github.com/elastic/beats/compare/v8.19.5\...v8.19.6[View commits]
+
+[discrete]
+[[enhancements-8.19.6]]
+==== Enhancements
+
+**Metricbeat**
+
+* Improve the Prometheus helper to handle multiple content types including blank and invalid headers.
+
+
+[discrete]
+[[bug-fixes-8.19.6]]
+==== Bug fixes
+
+
+**All**
+
+* Prevent panic in logstash output when trying to send events while shutting down. https://github.com/elastic/beats/pull/46960[#46960]
+* Prevent panic in replace processor for non-string values. https://github.com/elastic/beats/pull/47009[#47009]
+* Autodiscover now correctly updates Kubernetes metadata on node and pod label changes. https://github.com/elastic/beats/pull/47034[#47034]
+* Prevent 3s startup delay when add_cloud_metadata is used with debug logs.
+* Update elastic-agent-system-metrics to v0.13.3.
+* Allows users to customize their data stream namespace to `generic`.
+* Add support for Kafka 4.0 in the Kafka module. https://github.com/elastic/beats/pull/47284[#47284]
+
+**Filebeat**
+
+* Fix defer usage for stopped status reporting. https://github.com/elastic/beats/pull/46916[#46916]
+
+**Metricbeat**
+
+* Fix missing AWS cloudwatch metrics with linked accounts and same dimensions. https://github.com/elastic/beats/pull/46978[#46978]
+* Add a fix to handle blank content-type headers in HTTP responses for Prometheus. https://github.com/elastic/beats/pull/47027[#47027]
+* Add pagination support to the device health metricset in the meraki module. https://github.com/elastic/beats/pull/46938[#46938]
+
+// end 8.19.6 relnotes
+
+[[release-notes-8.19.5]]
+=== Beats version 8.19.5
+https://github.com/elastic/beats/compare/v8.19.4\...v8.19.5[View commits]
+>>>>>>> 7dc72eae2 (ES index mode & codec in metricbeat (#49237))
 
 ==== Breaking changes
 

changelog/fragments/1772635870-es-index-mode-&-codec-in-metricbeat.yaml

@@ -0,0 +1,45 @@
+# REQUIRED
+# Kind can be one of:
+# - breaking-change: a change to previously-documented behavior
+# - deprecation: functionality that is being removed in a later release
+# - bug-fix: fixes a problem in a previous version
+# - enhancement: extends functionality but does not break or fix existing behavior
+# - feature: new functionality
+# - known-issue: problems that we are aware of in a given version
+# - security: impacts on the security of a product or a user’s deployment.
+# - upgrade: important information for someone upgrading from a prior version
+# - other: does not fit into any of the other categories
+kind: feature
+
+# REQUIRED for all kinds
+# Change summary; a 80ish characters long description of the change.
+summary: Addition of Elasticsearch index mode and codec settings in Metricbeat index stats module.
+
+# REQUIRED for breaking-change, deprecation, known-issue
+# Long description; in case the summary is not enough to describe the change
+# this field accommodate a description without length limits.
+# description:
+
+# REQUIRED for breaking-change, deprecation, known-issue
+# impact:
+
+# REQUIRED for breaking-change, deprecation, known-issue
+# action:
+
+# REQUIRED for all kinds
+# Affected component; usually one of "elastic-agent", "fleet-server", "filebeat", "metricbeat", "auditbeat", "all", etc.
+component: metricbeat
+
+# AUTOMATED
+# OPTIONAL to manually add other PR URLs
+# PR URL: A link the PR that added the changeset.
+# If not present is automatically filled by the tooling finding the PR where this changelog fragment has been added.
+# NOTE: the tooling supports backports, so it's able to fill the original PR number instead of the backport PR number.
+# Please provide it if you are adding a fragment for a different PR.
+# pr: https://github.com/owner/repo/1234
+
+# AUTOMATED
+# OPTIONAL to manually add other issue URLs
+# Issue URL; optional; the GitHub issue related to this changeset (either closes or is part of).
+# If not present is automatically filled by the tooling with the issue linked to the PR number.
+# issue: https://github.com/owner/repo/1234

docs/reference/metricbeat/exported-fields-elasticsearch.md

@@ -1370,6 +1370,14 @@ index
 :   type: keyword
 
 
+**`elasticsearch.index.mode`**
+:   type: keyword
+
+
+**`elasticsearch.index.codec`**
+:   type: keyword
+
+
 **`elasticsearch.index.name`**
 :   Index name.
 

docs/reference/metricbeat/metricbeat-metricset-elasticsearch-index.md

@@ -170,6 +170,8 @@ Here is an example document generated by this metricset:
         "tier_preference": "data_content",
         "creation_date": 1731657995821,
         "version": "8505000",
+        "mode": "time_series",
+        "codec": "default",
         "hidden": true,
         "shards": {
           "total": 1,