Compilation results for cloudelastic1009.eqiad.wmnet: System changes detected

Catalog differences

Summary

Resources only in the new catalog

• File[/usr/local/bin/pool-opensearch_2@cloudelastic-chi-eqiad.service]
• File[/etc/systemd/system/opensearch_2@.service.d/opensearch_2@.conf]
• File[/usr/local/bin/depool-opensearch_2@cloudelastic-omega-eqiad.service]
• Service[opensearch_2@cloudelastic-omega-eqiad]
• Service[opensearch_2@cloudelastic-psi-eqiad]
• Exec[systemd daemon-reload for opensearch_2@.service (opensearch_2@-opensearch_2@)]
• File[/usr/local/bin/depool-opensearch_2@cloudelastic-psi-eqiad.service]
• File[/usr/local/sbin/restart-opensearch_2@cloudelastic-omega-eqiad.service]
• Exec[install-opensearch]
• File[/usr/local/bin/depool-opensearch_2@cloudelastic-chi-eqiad.service]
• File[/usr/local/bin/pool-opensearch_2@cloudelastic-omega-eqiad.service]
• File[/etc/systemd/system/opensearch_2@.service.d]
• File[/lib/systemd/system/opensearch_2@.service]
• File[/usr/local/sbin/restart-opensearch_2@cloudelastic-chi-eqiad.service]
• Service[opensearch_2@cloudelastic-chi-eqiad]
• File[/usr/local/sbin/restart-opensearch_2@cloudelastic-psi-eqiad.service]
• Exec[systemd daemon-reload for opensearch_2@.service (opensearch_2@.service)]
• File[/usr/local/bin/pool-opensearch_2@cloudelastic-psi-eqiad.service]

Resources only in the old catalog

• File[/lib/systemd/system/opensearch_1@.service]
• File[/usr/local/bin/depool-opensearch_1@cloudelastic-omega-eqiad.service]
• File[/usr/local/bin/depool-opensearch_1@cloudelastic-psi-eqiad.service]
• Service[opensearch_1@cloudelastic-omega-eqiad]
• Service[opensearch_1@cloudelastic-psi-eqiad]
• File[/usr/local/bin/pool-opensearch_1@cloudelastic-psi-eqiad.service]
• Exec[systemd daemon-reload for opensearch_1@.service (opensearch_1@.service)]
• File[/usr/local/bin/pool-opensearch_1@cloudelastic-omega-eqiad.service]
• File[/usr/local/bin/depool-opensearch_1@cloudelastic-chi-eqiad.service]
• File[/usr/local/sbin/restart-opensearch_1@cloudelastic-omega-eqiad.service]
• Service[opensearch_1@cloudelastic-chi-eqiad]
• File[/usr/local/sbin/restart-opensearch_1@cloudelastic-psi-eqiad.service]
• File[/usr/local/bin/pool-opensearch_1@cloudelastic-chi-eqiad.service]
• File[/usr/local/sbin/restart-opensearch_1@cloudelastic-chi-eqiad.service]

Resources modified

• File[/etc/opensearch/instances]

  Content differences:

  --- /etc/opensearch/instances.orig
  +++ /etc/opensearch/instances
  @@ -1,3 +1,3 @@
  -opensearch_1@cloudelastic-chi-eqiad
  -opensearch_1@cloudelastic-omega-eqiad
  -opensearch_1@cloudelastic-psi-eqiad
  +opensearch_2@cloudelastic-chi-eqiad
  +opensearch_2@cloudelastic-omega-eqiad
  +opensearch_2@cloudelastic-psi-eqiad

• File[/etc/opensearch/cloudelastic-omega-eqiad/log4j2.properties]

  Content differences:

  --- /etc/opensearch/cloudelastic-omega-eqiad/log4j2.properties.orig
  +++ /etc/opensearch/cloudelastic-omega-eqiad/log4j2.properties
  @@ -185,7 +185,6 @@
   rootLogger.appenderRef.ship_to_logstash.ref = ship_to_logstash
   logger.index_indexing_slowlog.appenderRef.ship_to_logstash.ref = ship_to_logstash
   logger.index_search_slowlog_rolling.appenderRef.ship_to_logstash.ref = ship_to_logstash
  -logger.index_search_slowlog_rolling.appenderRef.ship_to_logstash.ref = ship_to_logstash
   
   # Define Logstash appender
   appender.ship_to_logstash.name=ship_to_logstash

• File[/etc/opensearch/cloudelastic-psi-eqiad/opensearch.yml]

  Content differences:

  --- /etc/opensearch/cloudelastic-psi-eqiad/opensearch.yml.orig
  +++ /etc/opensearch/cloudelastic-psi-eqiad/opensearch.yml
  @@ -100,6 +100,10 @@
   #
   #cluster.initial_master_nodes: ["node-1", "node-2"]
   #
  +# Set to ensure a node sees N other master eligible nodes to be considered
  +# operational within the cluster. Its recommended to set it to a higher value
  +# than 1 when running more than 2 nodes in the cluster.
  +#
   discovery.zen.ping.unicast.hosts: ["cloudelastic1009.eqiad.wmnet", "cloudelastic1010.eqiad.wmnet", "cloudelastic1011.eqiad.wmnet"]
   #
   # For more information, consult the discovery and cluster formation module documentation.
  @@ -140,12 +144,16 @@
   # 1k is too low to allow mwgrep to operate.
   action.search.shard_count.limit: 5000
   
  +# https://www.elastic.co/guide/en/elasticsearch/reference/7.12/modules-cluster.html#disk-based-shard-allocation
   # Enable the disk space aware shard allocator
   cluster.routing.allocation.disk.threshold_enabled: true
  -# Stop allocating new shards to nodes with 75% disk utilization
  +# Stop allocating shards to nodes (default 80%)
   cluster.routing.allocation.disk.watermark.low: 0.75
  -# Move shards off of nodes with 80% disk utilization
  +# Begin evicting shards off the node (default 90%)
   cluster.routing.allocation.disk.watermark.high: 0.80
  +# Set indexes read-only with allocated shards on affected node (default 95%)
  +cluster.routing.allocation.disk.watermark.flood_stage: 0.95
  +
   # Check disk utilization every 60 seconds
   cluster.info.update.interval: 60s
   
  @@ -191,3 +199,4 @@
   ltr.caches.max_mem: 100mb
   
   
  +

• File[/etc/opensearch/cloudelastic-chi-eqiad/log4j2.properties]

  Content differences:

  --- /etc/opensearch/cloudelastic-chi-eqiad/log4j2.properties.orig
  +++ /etc/opensearch/cloudelastic-chi-eqiad/log4j2.properties
  @@ -185,7 +185,6 @@
   rootLogger.appenderRef.ship_to_logstash.ref = ship_to_logstash
   logger.index_indexing_slowlog.appenderRef.ship_to_logstash.ref = ship_to_logstash
   logger.index_search_slowlog_rolling.appenderRef.ship_to_logstash.ref = ship_to_logstash
  -logger.index_search_slowlog_rolling.appenderRef.ship_to_logstash.ref = ship_to_logstash
   
   # Define Logstash appender
   appender.ship_to_logstash.name=ship_to_logstash

• File[/etc/opensearch/cloudelastic-chi-eqiad/opensearch.yml]

  Content differences:

  --- /etc/opensearch/cloudelastic-chi-eqiad/opensearch.yml.orig
  +++ /etc/opensearch/cloudelastic-chi-eqiad/opensearch.yml
  @@ -100,6 +100,10 @@
   #
   #cluster.initial_master_nodes: ["node-1", "node-2"]
   #
  +# Set to ensure a node sees N other master eligible nodes to be considered
  +# operational within the cluster. Its recommended to set it to a higher value
  +# than 1 when running more than 2 nodes in the cluster.
  +#
   discovery.zen.ping.unicast.hosts: ["cloudelastic1009.eqiad.wmnet", "cloudelastic1010.eqiad.wmnet", "cloudelastic1011.eqiad.wmnet"]
   #
   # For more information, consult the discovery and cluster formation module documentation.
  @@ -140,12 +144,16 @@
   # 1k is too low to allow mwgrep to operate.
   action.search.shard_count.limit: 5000
   
  +# https://www.elastic.co/guide/en/elasticsearch/reference/7.12/modules-cluster.html#disk-based-shard-allocation
   # Enable the disk space aware shard allocator
   cluster.routing.allocation.disk.threshold_enabled: true
  -# Stop allocating new shards to nodes with 75% disk utilization
  +# Stop allocating shards to nodes (default 80%)
   cluster.routing.allocation.disk.watermark.low: 0.75
  -# Move shards off of nodes with 80% disk utilization
  +# Begin evicting shards off the node (default 90%)
   cluster.routing.allocation.disk.watermark.high: 0.80
  +# Set indexes read-only with allocated shards on affected node (default 95%)
  +cluster.routing.allocation.disk.watermark.flood_stage: 0.95
  +
   # Check disk utilization every 60 seconds
   cluster.info.update.interval: 60s
   
  @@ -191,3 +199,4 @@
   ltr.caches.max_mem: 100mb
   
   
  +

• File[/etc/apt/sources.list.d/wikimedia-opensearch.list]

  Content differences:

  --- /etc/apt/sources.list.d/wikimedia-opensearch.list.orig
  +++ /etc/apt/sources.list.d/wikimedia-opensearch.list
  @@ -1,2 +1,2 @@
  -deb http://apt.wikimedia.org/wikimedia bullseye-wikimedia thirdparty/opensearch1
  -deb-src http://apt.wikimedia.org/wikimedia bullseye-wikimedia thirdparty/opensearch1
  +deb http://apt.wikimedia.org/wikimedia bullseye-wikimedia thirdparty/opensearch2
  +deb-src http://apt.wikimedia.org/wikimedia bullseye-wikimedia thirdparty/opensearch2

• Package[wmf-opensearch-search-plugins]

  Parameters differences:

  --- Package[wmf-opensearch-search-plugins].orig
  +++ Package[wmf-opensearch-search-plugins]
  
  @@
  -    before => ['Service[opensearch_1@cloudelastic-chi-eqiad]', 'Service[opensearch_1@cloudelastic-omega-eqiad]', 'Service[opensearch_1@cloudelastic-psi-eqiad]']
  +    before => ['Service[opensearch_2@cloudelastic-chi-eqiad]', 'Service[opensearch_2@cloudelastic-omega-eqiad]', 'Service[opensearch_2@cloudelastic-psi-eqiad]']
  

• File[/etc/apt/sources.list.d/wikimedia-opensearch-plugins.list]

  Content differences:

  --- /etc/apt/sources.list.d/wikimedia-opensearch-plugins.list.orig
  +++ /etc/apt/sources.list.d/wikimedia-opensearch-plugins.list
  @@ -1,2 +1,2 @@
  -deb http://apt.wikimedia.org/wikimedia bullseye-wikimedia component/opensearch13
  -deb-src http://apt.wikimedia.org/wikimedia bullseye-wikimedia component/opensearch13
  +deb http://apt.wikimedia.org/wikimedia bullseye-wikimedia component/opensearch2
  +deb-src http://apt.wikimedia.org/wikimedia bullseye-wikimedia component/opensearch2

• File[/etc/opensearch/cloudelastic-omega-eqiad/opensearch.yml]

  Content differences:

  --- /etc/opensearch/cloudelastic-omega-eqiad/opensearch.yml.orig
  +++ /etc/opensearch/cloudelastic-omega-eqiad/opensearch.yml
  @@ -100,6 +100,10 @@
   #
   #cluster.initial_master_nodes: ["node-1", "node-2"]
   #
  +# Set to ensure a node sees N other master eligible nodes to be considered
  +# operational within the cluster. Its recommended to set it to a higher value
  +# than 1 when running more than 2 nodes in the cluster.
  +#
   discovery.zen.ping.unicast.hosts: ["cloudelastic1009.eqiad.wmnet", "cloudelastic1010.eqiad.wmnet", "cloudelastic1011.eqiad.wmnet"]
   #
   # For more information, consult the discovery and cluster formation module documentation.
  @@ -140,12 +144,16 @@
   # 1k is too low to allow mwgrep to operate.
   action.search.shard_count.limit: 5000
   
  +# https://www.elastic.co/guide/en/elasticsearch/reference/7.12/modules-cluster.html#disk-based-shard-allocation
   # Enable the disk space aware shard allocator
   cluster.routing.allocation.disk.threshold_enabled: true
  -# Stop allocating new shards to nodes with 75% disk utilization
  +# Stop allocating shards to nodes (default 80%)
   cluster.routing.allocation.disk.watermark.low: 0.75
  -# Move shards off of nodes with 80% disk utilization
  +# Begin evicting shards off the node (default 90%)
   cluster.routing.allocation.disk.watermark.high: 0.80
  +# Set indexes read-only with allocated shards on affected node (default 95%)
  +cluster.routing.allocation.disk.watermark.flood_stage: 0.95
  +
   # Check disk utilization every 60 seconds
   cluster.info.update.interval: 60s
   
  @@ -191,3 +199,4 @@
   ltr.caches.max_mem: 100mb
   
   
  +

• File[/etc/opensearch/cloudelastic-psi-eqiad/log4j2.properties]

  Content differences:

  --- /etc/opensearch/cloudelastic-psi-eqiad/log4j2.properties.orig
  +++ /etc/opensearch/cloudelastic-psi-eqiad/log4j2.properties
  @@ -185,7 +185,6 @@
   rootLogger.appenderRef.ship_to_logstash.ref = ship_to_logstash
   logger.index_indexing_slowlog.appenderRef.ship_to_logstash.ref = ship_to_logstash
   logger.index_search_slowlog_rolling.appenderRef.ship_to_logstash.ref = ship_to_logstash
  -logger.index_search_slowlog_rolling.appenderRef.ship_to_logstash.ref = ship_to_logstash
   
   # Define Logstash appender
   appender.ship_to_logstash.name=ship_to_logstash

• Package[opensearch]

  Parameters differences:

  --- Package[opensearch].orig
  +++ Package[opensearch]
  
  @@
  -    ensure => 1.3.20
  +    ensure => 2.19.5
  

Relevant files

• Production catalog
• Change catalog
• Production errors/warnings
• Change errors/warnings
• Standard Diff
• Full Diff