Compilation results for cirrussearch2100.codfw.wmnet: System changes detected

You can retrieve this result from host.json.

Catalog differences

Summary

Total Resources:	3588
Resources added:	8
Resources removed:	4
Resources modified:	9
Change percentage:	0.59%

Resources only in the new catalog

Exec[install-opensearch]
File[/lib/systemd/system/opensearch_2@.service]
Exec[systemd daemon-reload for opensearch_2@.service (opensearch_2@-opensearch_2@)]
Exec[systemd daemon-reload for opensearch_2@.service (opensearch_2@.service)]
Service[opensearch_2@production-search-codfw]
File[/etc/systemd/system/opensearch_2@.service.d/opensearch_2@.conf]
Service[opensearch_2@production-search-omega-codfw]
File[/etc/systemd/system/opensearch_2@.service.d]

Resources only in the old catalog

Service[opensearch_1@production-search-omega-codfw]
Exec[systemd daemon-reload for opensearch_1@.service (opensearch_1@.service)]
File[/lib/systemd/system/opensearch_1@.service]
Service[opensearch_1@production-search-codfw]

Resources modified

File[/etc/opensearch/production-search-codfw/opensearch.yml]

Content differences:

--- /etc/opensearch/production-search-codfw/opensearch.yml.orig
+++ /etc/opensearch/production-search-codfw/opensearch.yml
@@ -90,18 +90,17 @@
 transport.tcp.port: 9300
 #
 # --------------------------------- Discovery ----------------------------------
+# See also: https://docs.opensearch.org/2.19/tuning-your-cluster#step-4-configure-discovery-hosts-and-initial-cluster-manager-nodes-for-a-cluster
 #
 # Pass an initial list of hosts to perform discovery when this node is started:
 # The default list of hosts is ["127.0.0.1", "[::1]"]
 #
 #discovery.seed_hosts: ["host1", "host2"]
-#
-# Bootstrap the cluster using an initial set of master-eligible nodes:
-#
-#cluster.initial_master_nodes: ["node-1", "node-2"]
-#
-discovery.zen.ping.unicast.hosts: ["cirrussearch2093.codfw.wmnet", "cirrussearch2061.codfw.wmnet", "cirrussearch2081.codfw.wmnet", "cirrussearch2084.codfw.wmnet", "cirrussearch2111.codfw.wmnet"]
-#
+discovery.seed_hosts: ["cirrussearch2093.codfw.wmnet", "cirrussearch2061.codfw.wmnet", "cirrussearch2081.codfw.wmnet", "cirrussearch2084.codfw.wmnet", "cirrussearch2111.codfw.wmnet"]
+
+# Bootstrap the cluster using an initial set of cluster-manager-eligible node names
+# Only set this during first cluster formation; remove it after the cluster forms
+# cluster.initial_cluster_manager_nodes: ["node-1", "node-2"]
 # For more information, consult the discovery and cluster formation module documentation.
 #
 # ---------------------------------- Gateway -----------------------------------
@@ -127,7 +126,7 @@
 #
 # If a plugin listed here is not installed for current node, the node will not start.
 #
-plugin.mandatory: analysis-hebrew,analysis-icu,analysis-smartcn,analysis-stempel,analysis-ukrainian,cirrus-highlighter,opensearch-analysis-stconvert,opensearch-extra,opensearch-extra-analysis-esperanto,opensearch-extra-analysis-serbian,opensearch-extra-analysis-slovak,ltr
+plugin.mandatory: analysis-hebrew,analysis-icu,analysis-smartcn,analysis-stempel,analysis-ukrainian,cirrus-highlighter,opensearch-analysis-stconvert,opensearch-extra,opensearch-extra-analysis-esperanto,opensearch-extra-analysis-serbian,opensearch-extra-analysis-slovak,ltr,analysis-nori,analysis-sudachi,opensearch-extra-analysis-homoglyph,opensearch-extra-analysis-khmer,opensearch-extra-analysis-textify,opensearch-extra-analysis-turkish,opensearch-extra-analysis-ukrainian,opensearch-ltr,repository-s3
 
 # Specify the pattern of index names allowed to be created automatically
 action.auto_create_index: +apifeatureusage-*,+glent_*,-*
@@ -140,14 +139,16 @@
 # 1k is too low to allow mwgrep to operate.
 action.search.shard_count.limit: 5000
 
+# https://www.elastic.co/guide/en/elasticsearch/reference/7.12/modules-cluster.html#disk-based-shard-allocation
 # Enable the disk space aware shard allocator
 cluster.routing.allocation.disk.threshold_enabled: true
-# Stop allocating new shards to nodes when this threshold is reached
+# Stop allocating shards to nodes (default 80%)
 cluster.routing.allocation.disk.watermark.low: 75%
-# Move shards off of nodes when this threshold is reached
+# Begin evicting shards off the node (default 90%)
 cluster.routing.allocation.disk.watermark.high: 80%
-# Set indexes read-only with allocated shards on affected node when this threshold is reached
+# Set indexes read-only with allocated shards on affected node (default 95%)
 cluster.routing.allocation.disk.watermark.flood_stage: 95%
+
 # Check disk utilization every 60 seconds
 cluster.info.update.interval: 60s
 
@@ -193,3 +194,4 @@
 ltr.caches.max_mem: 100mb
 
 
+

File[/etc/opensearch/production-search-omega-codfw/opensearch.yml]

Content differences:

--- /etc/opensearch/production-search-omega-codfw/opensearch.yml.orig
+++ /etc/opensearch/production-search-omega-codfw/opensearch.yml
@@ -90,18 +90,17 @@
 transport.tcp.port: 9500
 #
 # --------------------------------- Discovery ----------------------------------
+# See also: https://docs.opensearch.org/2.19/tuning-your-cluster#step-4-configure-discovery-hosts-and-initial-cluster-manager-nodes-for-a-cluster
 #
 # Pass an initial list of hosts to perform discovery when this node is started:
 # The default list of hosts is ["127.0.0.1", "[::1]"]
 #
 #discovery.seed_hosts: ["host1", "host2"]
-#
-# Bootstrap the cluster using an initial set of master-eligible nodes:
-#
-#cluster.initial_master_nodes: ["node-1", "node-2"]
-#
-discovery.zen.ping.unicast.hosts: ["cirrussearch2092.codfw.wmnet", "cirrussearch2100.codfw.wmnet", "cirrussearch2106.codfw.wmnet", "cirrussearch2073.codfw.wmnet", "cirrussearch2086.codfw.wmnet"]
-#
+discovery.seed_hosts: ["cirrussearch2092.codfw.wmnet", "cirrussearch2100.codfw.wmnet", "cirrussearch2106.codfw.wmnet", "cirrussearch2073.codfw.wmnet", "cirrussearch2086.codfw.wmnet"]
+
+# Bootstrap the cluster using an initial set of cluster-manager-eligible node names
+# Only set this during first cluster formation; remove it after the cluster forms
+# cluster.initial_cluster_manager_nodes: ["node-1", "node-2"]
 # For more information, consult the discovery and cluster formation module documentation.
 #
 # ---------------------------------- Gateway -----------------------------------
@@ -127,7 +126,7 @@
 #
 # If a plugin listed here is not installed for current node, the node will not start.
 #
-plugin.mandatory: analysis-hebrew,analysis-icu,analysis-smartcn,analysis-stempel,analysis-ukrainian,cirrus-highlighter,opensearch-analysis-stconvert,opensearch-extra,opensearch-extra-analysis-esperanto,opensearch-extra-analysis-serbian,opensearch-extra-analysis-slovak,ltr
+plugin.mandatory: analysis-hebrew,analysis-icu,analysis-smartcn,analysis-stempel,analysis-ukrainian,cirrus-highlighter,opensearch-analysis-stconvert,opensearch-extra,opensearch-extra-analysis-esperanto,opensearch-extra-analysis-serbian,opensearch-extra-analysis-slovak,ltr,analysis-nori,analysis-sudachi,opensearch-extra-analysis-homoglyph,opensearch-extra-analysis-khmer,opensearch-extra-analysis-textify,opensearch-extra-analysis-turkish,opensearch-extra-analysis-ukrainian,opensearch-ltr,repository-s3
 
 # Specify the pattern of index names allowed to be created automatically
 action.auto_create_index: +apifeatureusage-*,+glent_*,-*
@@ -140,14 +139,16 @@
 # 1k is too low to allow mwgrep to operate.
 action.search.shard_count.limit: 5000
 
+# https://www.elastic.co/guide/en/elasticsearch/reference/7.12/modules-cluster.html#disk-based-shard-allocation
 # Enable the disk space aware shard allocator
 cluster.routing.allocation.disk.threshold_enabled: true
-# Stop allocating new shards to nodes when this threshold is reached
+# Stop allocating shards to nodes (default 80%)
 cluster.routing.allocation.disk.watermark.low: 75%
-# Move shards off of nodes when this threshold is reached
+# Begin evicting shards off the node (default 90%)
 cluster.routing.allocation.disk.watermark.high: 80%
-# Set indexes read-only with allocated shards on affected node when this threshold is reached
+# Set indexes read-only with allocated shards on affected node (default 95%)
 cluster.routing.allocation.disk.watermark.flood_stage: 95%
+
 # Check disk utilization every 60 seconds
 cluster.info.update.interval: 60s
 
@@ -193,3 +194,4 @@
 ltr.caches.max_mem: 100mb
 
 
+

File[/etc/opensearch/instances]

Content differences:

--- /etc/opensearch/instances.orig
+++ /etc/opensearch/instances
@@ -1,2 +1,2 @@
-opensearch_1@production-search-codfw
-opensearch_1@production-search-omega-codfw
+opensearch_2@production-search-codfw
+opensearch_2@production-search-omega-codfw

File[/etc/opensearch/production-search-omega-codfw/log4j2.properties]

Content differences:

--- /etc/opensearch/production-search-omega-codfw/log4j2.properties.orig
+++ /etc/opensearch/production-search-omega-codfw/log4j2.properties
@@ -185,7 +185,6 @@
 rootLogger.appenderRef.ship_to_logstash.ref = ship_to_logstash
 logger.index_indexing_slowlog.appenderRef.ship_to_logstash.ref = ship_to_logstash
 logger.index_search_slowlog_rolling.appenderRef.ship_to_logstash.ref = ship_to_logstash
-logger.index_search_slowlog_rolling.appenderRef.ship_to_logstash.ref = ship_to_logstash
 
 # Define Logstash appender
 appender.ship_to_logstash.name=ship_to_logstash

File[/etc/apt/sources.list.d/wikimedia-opensearch-plugins.list]

Content differences:

--- /etc/apt/sources.list.d/wikimedia-opensearch-plugins.list.orig
+++ /etc/apt/sources.list.d/wikimedia-opensearch-plugins.list
@@ -1,2 +1,2 @@
-deb http://apt.wikimedia.org/wikimedia bullseye-wikimedia component/opensearch13
-deb-src http://apt.wikimedia.org/wikimedia bullseye-wikimedia component/opensearch13
+deb http://apt.wikimedia.org/wikimedia bullseye-wikimedia component/opensearch2
+deb-src http://apt.wikimedia.org/wikimedia bullseye-wikimedia component/opensearch2

Package[wmf-opensearch-search-plugins]

Parameters differences:

--- Package[wmf-opensearch-search-plugins].orig
+++ Package[wmf-opensearch-search-plugins]

@@
-    before => ['Service[opensearch_1@production-search-codfw]', 'Service[opensearch_1@production-search-omega-codfw]']
+    before => ['Service[opensearch_2@production-search-codfw]', 'Service[opensearch_2@production-search-omega-codfw]']

File[/etc/opensearch/production-search-codfw/log4j2.properties]

Content differences:

--- /etc/opensearch/production-search-codfw/log4j2.properties.orig
+++ /etc/opensearch/production-search-codfw/log4j2.properties
@@ -185,7 +185,6 @@
 rootLogger.appenderRef.ship_to_logstash.ref = ship_to_logstash
 logger.index_indexing_slowlog.appenderRef.ship_to_logstash.ref = ship_to_logstash
 logger.index_search_slowlog_rolling.appenderRef.ship_to_logstash.ref = ship_to_logstash
-logger.index_search_slowlog_rolling.appenderRef.ship_to_logstash.ref = ship_to_logstash
 
 # Define Logstash appender
 appender.ship_to_logstash.name=ship_to_logstash

File[/etc/apt/sources.list.d/wikimedia-opensearch.list]

Content differences:

--- /etc/apt/sources.list.d/wikimedia-opensearch.list.orig
+++ /etc/apt/sources.list.d/wikimedia-opensearch.list
@@ -1,2 +1,2 @@
-deb http://apt.wikimedia.org/wikimedia bullseye-wikimedia thirdparty/opensearch1
-deb-src http://apt.wikimedia.org/wikimedia bullseye-wikimedia thirdparty/opensearch1
+deb http://apt.wikimedia.org/wikimedia bullseye-wikimedia thirdparty/opensearch2
+deb-src http://apt.wikimedia.org/wikimedia bullseye-wikimedia thirdparty/opensearch2

Package[opensearch]

Parameters differences:

--- Package[opensearch].orig
+++ Package[opensearch]

@@
-    ensure => 1.3.20
+    ensure => 2.19.5

Compilation results for cirrussearch2100.codfw.wmnet: System changes detected

Catalog differences

Summary

Resources only in the new catalog

Resources only in the old catalog

Resources modified

Relevant files