Compilation results for db2141.codfw.wmnet: System changes detected

Catalog differences

Summary

Resources only in the new catalog

• Motd::Message[insetup::data_persistence_ferm]
• File[/etc/update-motd.d/05-insetup--data-persistence-ferm]
• Motd::Script[insetup::data_persistence_ferm]
• Class[Role::Insetup::Data_persistence_ferm]

Resources only in the old catalog

• Class[Mariadb::Service]
• Package[prometheus-mysqld-exporter]
• File[/opt/wmf-mariadb1011/my.cnf]
• Class[Profile::Mariadb::Packages_wmf]
• Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_state_s1.timer]
• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_io_state_s1.service (nrpe2nodexp-mariadb_replica_io_state_s1.service)]
• File[/etc/mysql/my.cnf]
• Systemd::Service[wmf_auto_restart_prometheus-mysqld-exporter@s1]
• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_io_state_s1.timer (nrpe2nodexp-mariadb_replica_io_state_s1.timer)]
• Systemd::Timer[nrpe2nodexp-mariadb_memory]
• Systemd::Unit[wmf_auto_restart_prometheus-mysqld-exporter@s1.service]
• Systemd::Timer::Job[nrpe2nodexp-mariadb_replica_io_state_s1]
• File[/etc/update-motd.d/05-mariadb--backup-source]
• Systemd::Timer::Job[nrpe2nodexp-mariadb_read_only_s1]
• Class[Mariadb::Monitor_process]
• Package[grc]
• Rsyslog::Conf[nrpe2nodexp-mariadb_replica_sql_lag_s1]
• Systemd::Unit[prometheus-mysqld-exporter@]
• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_state_s1.timer (nrpe2nodexp-mariadb_replica_sql_state_s1.timer)]
• Prometheus::Alert::Rule[check_mariadb_disk_space_d2aae7bfec5549be1a8b9413215bd86c]
• File[/etc/logrotate.d/wmf_auto_restart_prometheus-mysqld-exporter_s1]
• Service[wmf_auto_restart_prometheus-mysqld-exporter@s1.timer]
• File[/var/lib/prometheus/node.d/check_mariadb_replica_sql_lag_s1.prom]
• Systemd::Timer::Job[nrpe2nodexp-mysqld]
• Class[Prometheus::Mysqld_exporter::Common]
• File[/etc/default/prometheus]
• File[/lib/systemd/system/prometheus-mysqld-exporter@.service]
• File[/etc/nagios/nrpe.d/check_mariadb_replica_sql_state_s1.cfg]
• Exec[systemctl try-restart prometheus-mysqld-exporter@s1]
• Nrpe::Check[check_mariadb_replica_io_state_s1]
• File[/etc/sudoers.d/nrpe-check_mariadb_memory]
• File[/etc/sudoers.d/nrpe-check_mariadb_read_only_s1]
• Systemd::Unit[nrpe2nodexp-mysqld.timer]
• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_disk_space.service (nrpe2nodexp-mariadb_disk_space.service)]
• Rsyslog::Conf[nrpe2nodexp-mysqld]
• Systemd::Service[nrpe2nodexp-mariadb_memory]
• File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-disk-space.conf]
• File[/usr/local/etc/my.cnf]
• File[/var/lib/prometheus/node.d/check_mariadb_memory.prom]
• Service[nrpe2nodexp-mariadb_replica_sql_lag_s1.timer]
• File[/var/lib/prometheus/node.d/check_mariadb_read_only_s1.prom]
• Concat::Fragment[/etc/mysql_puppet_agent_cert]
• Class[Passwords::Nagios::Mysql]
• File[/var/lib/prometheus/node.d/check_mariadb_disk_space.prom]
• Systemd::Timer[nrpe2nodexp-mysqld]
• Class[Mariadb::Config]
• Prometheus::Alert::Rule[check_mysqld_ca81db2c9e98d408f9f65c79817da116]
• Rsyslog::Conf[nrpe2nodexp-mariadb_replica_io_state_s1]
• File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_lag_s1.service]
• Monitoring::Exported_nagios_service[db2141 mariadb_replica_sql_state_s1]
• Service[nrpe2nodexp-mariadb_disk_space.timer]
• Package[wmf-mariadb1011]
• File[/lib/systemd/system/nrpe2nodexp-mariadb_memory.service]
• File[/etc/mysql/ssl/server-cert.pem]
• Systemd::Service[nrpe2nodexp-mariadb_read_only_s1]
• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_lag_s1.timer (nrpe2nodexp-mariadb_replica_sql_lag_s1.timer)]
• Exec[systemd daemon-reload for wmf_auto_restart_prometheus-mysqld-exporter@s1.service (wmf_auto_restart_prometheus-mysqld-exporter@s1.service)]
• Class[Profile::Mariadb::Mysql_role]
• Concat::Fragment[/etc/mysql_puppet_ca_chain]
• Ferm::Service[s1_orchestrator]
• Systemd::Timer[nrpe2nodexp-mariadb_disk_space]
• Package[percona-toolkit]
• File_line[auto_restart_file_presence_prometheus-mysqld-exporter@s1]
• Systemd::Unit[nrpe2nodexp-mysqld.service]
• File[/etc/sudoers.d/nrpe-check_mariadb_replica_io_state_s1]
• Sudo::User[nrpe-check_mariadb_replica_io_state_s1]
• Systemd::Timer::Job[nrpe2nodexp-mariadb_memory]
• File[/var/lib/prometheus/node.d/check_mariadb_replica_io_state_s1.prom]
• Group[mysql]
• File[/etc/nagios/nrpe.d/check_mariadb_disk_space.cfg]
• File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_io_state_s1.service]
• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_disk_space.timer (nrpe2nodexp-mariadb_disk_space.timer)]
• Systemd::Service[nrpe2nodexp-mysqld]
• Exec[systemd daemon-reload for wmf_auto_restart_prometheus-mysqld-exporter@s1.timer (wmf_auto_restart_prometheus-mysqld-exporter@s1.timer)]
• Monitoring::Service[mariadb_replica_io_state_s1]
• Monitoring::Service[mariadb_disk_space]
• Systemd::Timer[nrpe2nodexp-mariadb_replica_sql_lag_s1]
• File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_state_s1.service]
• Puppet::Expose_agent_certs[/etc/mysql]
• Nrpe::Monitor_service[mariadb_replica_io_state_s1]
• Monitoring::Exported_nagios_service[db2141 mariadb_replica_sql_lag_s1]
• Nrpe::Check[check_mariadb_replica_sql_lag_s1]
• Systemd::Unit[nrpe2nodexp-mariadb_replica_io_state_s1.timer]
• Nrpe::Monitor_service[mariadb_replica_sql_lag_s1]
• Motd::Script[db-section-s1]
• Class[Mariadb::Packages_wmf]
• Package[monitoring-plugins-contrib]
• Monitoring::Service[mariadb_replica_sql_lag_s1]
• File[/etc/mysql/mysqld.conf.d]
• File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-sql-lag-s1.conf]
• Concat[/etc/mysql/ssl/cert.pem]
• File[/lib/systemd/system/nrpe2nodexp-mariadb_memory.timer]
• File[/etc/mysql/ssl/server-keypair.pem]
• Service[nrpe2nodexp-mariadb_memory.timer]
• Nrpe::Monitor_service[mariadb_memory]
• Monitoring::Exported_nagios_service[db2141 mariadb_disk_space]
• Nrpe::Check[check_mariadb_replica_sql_state_s1]
• File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_io_state_s1.timer]
• File[/etc/systemd/system/mariadb.service.d/override.conf]
• File[/srv/tmp.s1]
• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_memory.service (nrpe2nodexp-mariadb_memory.service)]
• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_read_only_s1.service (nrpe2nodexp-mariadb_read_only_s1.service)]
• File[/etc/sudoers.d/nrpe-check_mysqld]
• Logrotate::Conf[wmf_auto_restart_prometheus-mysqld-exporter_s1]
• File[/etc/mysql/ssl/server.p12]
• Sudo::User[nrpe-check_mariadb_replica_sql_state_s1]
• File[/etc/ferm/conf.d/10_s1_mariadb_internal]
• User[mysql]
• File[/etc/mysql/ssl]
• Package[wmfmariadbpy-common]
• File[/etc/sudoers.d/nrpe-check_mariadb_disk_space]
• Prometheus::Mysqld_exporter::Instance[s1]
• Concat_file[/etc/mysql/ssl/cert.pem]
• Systemd::Unit[nrpe2nodexp-mariadb_disk_space.service]
• Service[nrpe2nodexp-mariadb_replica_io_state_s1.timer]
• Prometheus::Alert::Rule[check_mariadb_replica_sql_state_s1_3f927914a18db09399b7fff42858d634]
• Concat_fragment[/etc/mysql_puppet_ca_chain]
• Service[nrpe2nodexp-mariadb_read_only_s1.timer]
• Monitoring::Service[mariadb_replica_sql_state_s1]
• File[/etc/mysql/ssl/server.key]
• Systemd::Timer[wmf_auto_restart_prometheus-mysqld-exporter@s1]
• Systemd::Syslog[wmf_auto_restart_prometheus-mysqld-exporter_s1]
• Rsyslog::Conf[nrpe2nodexp-mariadb_disk_space]
• Monitoring::Exported_nagios_service[db2141 mysqld]
• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_read_only_s1.timer (nrpe2nodexp-mariadb_read_only_s1.timer)]
• Profile::Auto_restarts::Service[prometheus-mysqld-exporter@s1]
• File[/etc/mysql/ssl/cacert.pem]
• Profile::Prometheus::Mysqld_exporter_instance[s1]
• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_lag_s1.service (nrpe2nodexp-mariadb_replica_sql_lag_s1.service)]
• Monitoring::Exported_nagios_service[db2141 mariadb_replica_io_state_s1]
• Systemd::Unit[nrpe2nodexp-mariadb_read_only_s1.timer]
• Rsyslog::Conf[nrpe2nodexp-mariadb_replica_sql_state_s1]
• File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-sql-state-s1.conf]
• File[/lib/systemd/system/nrpe2nodexp-mysqld.timer]
• File[/etc/update-motd.d/06-db-section-s1]
• File[/etc/ferm/conf.d/10_s1_orchestrator]
• Package[python3-wmfmariadbpy]
• Monitoring::Service[mariadb_read_only_s1]
• Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_lag_s1.timer]
• File[/etc/default/prometheus-mysqld-exporter@s1]
• File[/etc/wmfmariadbpy/section_ports.csv]
• Nrpe::Monitor_service[mariadb_disk_space]
• File[/etc/mysql/ssl/client-cert.pem]
• File[/etc/nagios/nrpe.d/check_mysqld.cfg]
• Class[Role::Mariadb::Backup_source]
• Systemd::Unit[nrpe2nodexp-mariadb_memory.service]
• Motd::Message[mariadb::backup_source]
• Nrpe::Check[check_mysqld]
• File[/lib/systemd/system/nrpe2nodexp-mariadb_read_only_s1.service]
• Systemd::Timer::Job[nrpe2nodexp-mariadb_replica_sql_lag_s1]
• File[/etc/mysql]
• Systemd::Unit[nrpe2nodexp-mariadb_replica_io_state_s1.service]
• File[/etc/ferm/conf.d/10_s1_mariadb_dba]
• Systemd::Timer[nrpe2nodexp-mariadb_replica_io_state_s1]
• Exec[systemd daemon-reload for nrpe2nodexp-mysqld.service (nrpe2nodexp-mysqld.service)]
• Class[Wmfmariadbpy]
• Monitoring::Exported_nagios_service[db2141 mariadb_memory]
• Systemd::Service[nrpe2nodexp-mariadb_disk_space]
• Package[mariadb-backup]
• Profile::Mariadb::Section[s1]
• Concat_fragment[/etc/mysql_puppet_agent_cert]
• File[/lib/systemd/system/nrpe2nodexp-mariadb_disk_space.timer]
• Systemd::Service[nrpe2nodexp-mariadb_replica_sql_lag_s1]
• File[/var/lib/prometheus/node.d/check_mysqld.prom]
• Systemd::Service[nrpe2nodexp-mariadb_replica_io_state_s1]
• File[/etc/rsyslog.d/40-wmf-auto-restart-prometheus-mysqld-exporter-s1.conf]
• Systemd::Unit[nrpe2nodexp-mariadb_memory.timer]
• File[/etc/nagios/nrpe.d/check_mariadb_replica_sql_lag_s1.cfg]
• Systemd::Unit[nrpe2nodexp-mariadb_disk_space.timer]
• Prometheus::Alert::Rule[check_mariadb_replica_io_state_s1_0d5979f7abbb49256cfedd70a646784e]
• File[/etc/rsyslog.d/25-nrpe2nodexp-mysqld.conf]
• Class[Profile::Mariadb::Wmfmariadbpy]
• File[/usr/local/lib/nagios/plugins/check_mariadb]
• Prometheus::Alert::Rule[check_mariadb_read_only_s1_42baf529e0f3bfca391aca0a24c880e9]
• File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-io-state-s1.conf]
• Sudo::User[nrpe-check_mariadb_disk_space]
• Sudo::User[nrpe-check_mariadb_memory]
• File[/etc/sudoers.d/nrpe-check_mariadb_replica_sql_lag_s1]
• File[/etc/mysql/grcat.config]
• File[/etc/my.cnf]
• Nrpe::Monitor_service[mysqld]
• File[/var/lib/prometheus/.my.s1.cnf]
• File[/srv/sqldata.s1]
• Systemd::Timer::Job[nrpe2nodexp-mariadb_replica_sql_state_s1]
• Service[nrpe2nodexp-mariadb_replica_sql_state_s1.timer]
• File[/lib/systemd/system/wmf_auto_restart_prometheus-mysqld-exporter@s1.timer]
• Nrpe::Check[check_mariadb_read_only_s1]
• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_state_s1.service (nrpe2nodexp-mariadb_replica_sql_state_s1.service)]
• File[/etc/mysql/mysqld.conf.d/s1.cnf]
• File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-read-only-s1.conf]
• File[/etc/nagios/nrpe.d/check_mariadb_replica_io_state_s1.cfg]
• Prometheus::Alert::Rule[check_mariadb_replica_sql_lag_s1_8ec9d6c1155ae60699aaf9dfd1fa339b]
• Service[nrpe2nodexp-mysqld.timer]
• Mariadb::Instance[s1]
• File[/etc/nagios/nrpe.d/check_mariadb_read_only_s1.cfg]
• Ferm::Service[s1_mariadb_dba]
• File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_state_s1.timer]
• File[/var/lib/prometheus/node.d/check_mariadb_replica_sql_state_s1.prom]
• Sudo::User[nrpe-check_mysqld]
• File[/var/log/wmf_auto_restart_prometheus-mysqld-exporter_s1]
• Class[Mariadb::Monitor_memory]
• Nrpe::Monitor_service[mariadb_replica_sql_state_s1]
• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_memory.timer (nrpe2nodexp-mariadb_memory.timer)]
• Rsyslog::Conf[nrpe2nodexp-mariadb_memory]
• File[/etc/nagios/nrpe.d/check_mariadb_memory.cfg]
• File[/usr/lib/nagios/plugins/check_mariadb.pl]
• Mariadb::Monitor_replication[s1]
• Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_state_s1.service]
• Exec[systemd daemon-reload for prometheus-mysqld-exporter@.service (prometheus-mysqld-exporter@)]
• Nrpe::Monitor_service[mariadb_read_only_s1]
• File[/lib/systemd/system/nrpe2nodexp-mariadb_read_only_s1.timer]
• File[/etc/sudoers.d/nrpe-check_mariadb_replica_sql_state_s1]
• Ferm::Service[s1_mariadb_internal]
• File[/usr/local/bin/mysql.s1]
• Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_lag_s1.service]
• Rsyslog::Conf[wmf_auto_restart_prometheus-mysqld-exporter_s1]
• File[/lib/systemd/system/nrpe2nodexp-mysqld.service]
• Motd::Script[mariadb::backup_source]
• Profile::Mariadb::Ferm[s1]
• File[/etc/wmfmariadbpy]
• Exec[systemd daemon-reload for nrpe2nodexp-mysqld.timer (nrpe2nodexp-mysqld.timer)]
• File[/lib/systemd/system/wmf_auto_restart_prometheus-mysqld-exporter@s1.service]
• Sudo::User[nrpe-check_mariadb_replica_sql_lag_s1]
• Firewall::Service[s1_orchestrator]
• File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-memory.conf]
• Nrpe::Check[check_mariadb_memory]
• Exec[systemctl-daemon-reload]
• Prometheus::Alert::Rule[check_mariadb_memory_b5a92c72542d5f0c031014e7a8db014e]
• Sudo::User[nrpe-check_mariadb_read_only_s1]
• File[/etc/systemd/system/mariadb.service.d]
• File[/etc/mysql/ssl/client-key.pem]
• Systemd::Timer::Job[wmf_auto_restart_prometheus-mysqld-exporter@s1]
• Monitoring::Service[mariadb_memory]
• Monitoring::Service[mysqld]
• Class[Profile::Mariadb::Dbstore_multiinstance]
• Systemd::Unit[nrpe2nodexp-mariadb_read_only_s1.service]
• Nrpe::Check[check_mariadb_disk_space]
• Systemd::Service[nrpe2nodexp-mariadb_replica_sql_state_s1]
• Systemd::Timer[nrpe2nodexp-mariadb_read_only_s1]
• Nrpe::Plugin[check_mariadb]
• Class[Mariadb::Monitor_disk]
• File[/lib/systemd/system/nrpe2nodexp-mariadb_disk_space.service]
• Mariadb::Monitor_readonly[s1]
• Rsyslog::Conf[nrpe2nodexp-mariadb_read_only_s1]
• Sslcert::X509_to_pkcs12[puppet::expose_agent_cert: /etc/mysql]
• File[/usr/local/bin/mbstream]
• Systemd::Timer[nrpe2nodexp-mariadb_replica_sql_state_s1]
• Systemd::Unit[wmf_auto_restart_prometheus-mysqld-exporter@s1.timer]
• File[/etc/mysql/ssl/server-key.pem]
• File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_lag_s1.timer]
• Systemd::Timer::Job[nrpe2nodexp-mariadb_disk_space]
• Monitoring::Exported_nagios_service[db2141 mariadb_read_only_s1]

Resources modified

• Class[Mariadb::Packages_wmf]

  Parameters differences:

  --- Class[Mariadb::Packages_wmf].orig
  +++ Class[Mariadb::Packages_wmf]
  
  -    package => wmf-mariadb1011
  

• Concat[/etc/mysql/ssl/cert.pem]

  Parameters differences:

  --- Concat[/etc/mysql/ssl/cert.pem].orig
  +++ Concat[/etc/mysql/ssl/cert.pem]
  
  -    replace        => True
  -    warn           => False
  -    ensure_newline => False
  -    mode           => 0644
  -    backup         => puppet
  -    path           => /etc/mysql/ssl/cert.pem
  -    ensure         => present
  -    format         => plain
  -    show_diff      => True
  -    order          => alpha
  -    force          => False
  

• File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_io_state_s1.timer]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_io_state_s1.timer].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_io_state_s1.timer]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_io_state_s1.timer (nrpe2nodexp-mariadb_replica_io_state_s1.timer)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mariadb_replica_io_state_s1.timer.orig
  +++ /lib/systemd/system/nrpe2nodexp-mariadb_replica_io_state_s1.timer
  @@ -1,14 +0,0 @@
  -[Unit]
  -Description=Periodic execution of nrpe2nodexp-mariadb_replica_io_state_s1.service
  -
  -[Timer]
  -Unit=nrpe2nodexp-mariadb_replica_io_state_s1.service
  -# Accuracy sets the maximum time interval around the execution time we want to allow
  -AccuracySec=15sec
  -OnUnitInactiveSec=1min
  -OnActiveSec=1s
  -RandomizedDelaySec=60
  -FixedRandomDelay=true
  -
  -[Install]
  -WantedBy=multi-user.target

• Systemd::Unit[nrpe2nodexp-mariadb_read_only_s1.timer]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mariadb_read_only_s1.timer].orig
  +++ Systemd::Unit[nrpe2nodexp-mariadb_read_only_s1.timer]
  
  -    ensure            => absent
  -    restart           => False
  -    unit              => nrpe2nodexp-mariadb_read_only_s1.timer
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• Monitoring::Exported_nagios_service[db2141 ssh]

  Parameters differences:

  --- Monitoring::Exported_nagios_service[db2141 ssh].orig
  +++ Monitoring::Exported_nagios_service[db2141 ssh]
  
  @@
  -    notifications_enabled => 1
  +    notifications_enabled => 0
  

• File[/etc/logrotate.d/wmf_auto_restart_prometheus-mysqld-exporter_s1]

  Parameters differences:

  --- File[/etc/logrotate.d/wmf_auto_restart_prometheus-mysqld-exporter_s1].orig
  +++ File[/etc/logrotate.d/wmf_auto_restart_prometheus-mysqld-exporter_s1]
  
  -    owner  => root
  -    ensure => present
  -    mode   => 0444
  -    group  => root
  

  Content differences:

  --- /etc/logrotate.d/wmf_auto_restart_prometheus-mysqld-exporter_s1.orig
  +++ /etc/logrotate.d/wmf_auto_restart_prometheus-mysqld-exporter_s1
  @@ -1,12 +0,0 @@
  -# logrotate(8) config for wmf_auto_restart_prometheus-mysqld-exporter_s1
  -
  -/var/log/wmf_auto_restart_prometheus-mysqld-exporter_s1/*.log {
  -    daily
  -    copytruncate
  -    missingok
  -    compress
  -    delaycompress
  -    notifempty
  -    rotate 15
  -    size 256M
  -}

• File[/etc/sudoers.d/nrpe-check_mariadb_memory]

  Parameters differences:

  --- File[/etc/sudoers.d/nrpe-check_mariadb_memory].orig
  +++ File[/etc/sudoers.d/nrpe-check_mariadb_memory]
  
  -    owner   => root
  -    ensure  => absent
  -    group   => root
  -    require => Package[nagios-nrpe-server]
  

• Monitoring::Exported_nagios_service[db2141 ferm_active]

  Parameters differences:

  --- Monitoring::Exported_nagios_service[db2141 ferm_active].orig
  +++ Monitoring::Exported_nagios_service[db2141 ferm_active]
  
  @@
  -    notifications_enabled => 1
  +    notifications_enabled => 0
  

• Group[mysql]

  Parameters differences:

  --- Group[mysql].orig
  +++ Group[mysql]
  
  -    ensure => present
  -    system => True
  

• Monitoring::Service[mariadb_replica_io_state_s1]

  Parameters differences:

  --- Monitoring::Service[mariadb_replica_io_state_s1].orig
  +++ Monitoring::Service[mariadb_replica_io_state_s1]
  
  -    description    => MariaDB Replica IO: s1
  -    config_dir     => /etc/nagios
  -    migration_task => T315866
  -    critical       => False
  -    check_interval => 1
  -    contact_group  => admins
  -    freshness      => 36000
  -    ensure         => present
  -    retry_interval => 1
  -    passive        => False
  -    host           => db2141
  -    notes_url      => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica
  -    check_command  => nrpe_check!check_mariadb_replica_io_state_s1!10
  -    retries        => 3
  

• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_read_only_s1.service (nrpe2nodexp-mariadb_read_only_s1.service)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mariadb_read_only_s1.service (nrpe2nodexp-mariadb_read_only_s1.service)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mariadb_read_only_s1.service (nrpe2nodexp-mariadb_read_only_s1.service)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Rsyslog::Conf[nrpe2nodexp-mariadb_replica_sql_state_s1]

  Parameters differences:

  --- Rsyslog::Conf[nrpe2nodexp-mariadb_replica_sql_state_s1].orig
  +++ Rsyslog::Conf[nrpe2nodexp-mariadb_replica_sql_state_s1]
  
  -    mode     => 0444
  -    ensure   => absent
  -    priority => 25
  

• Monitoring::Exported_nagios_service[db2141 mariadb_memory]

  Parameters differences:

  --- Monitoring::Exported_nagios_service[db2141 mariadb_memory].orig
  +++ Monitoring::Exported_nagios_service[db2141 mariadb_memory]
  
  -    host_name              => db2141
  -    servicegroups          => mysql_codfw
  -    passive_checks_enabled => 1
  -    service_description    => MariaDB memory
  -    ensure                 => present
  -    active_checks_enabled  => 1
  -    max_check_attempts     => 3
  -    check_period           => 24x7
  -    notification_options   => c,r,f
  -    is_volatile            => 0
  -    notes_url              => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting
  -    check_command          => nrpe_check!check_mariadb_memory!10
  -    notifications_enabled  => 1
  -    contact_groups         => admins
  -    check_freshness        => 0
  -    check_interval         => 1
  -    notification_period    => 24x7
  -    retry_interval         => 1
  -    notification_interval  => 0
  

• Profile::Mariadb::Section[s1]

  Parameters differences:

  --- Profile::Mariadb::Section[s1].orig
  +++ Profile::Mariadb::Section[s1]
  
  -    mention_alias => True
  -    section       => s1
  

• Prometheus::Alert::Rule[check_mariadb_read_only_s1_42baf529e0f3bfca391aca0a24c880e9]

  Parameters differences:

  --- Prometheus::Alert::Rule[check_mariadb_read_only_s1_42baf529e0f3bfca391aca0a24c880e9].orig
  +++ Prometheus::Alert::Rule[check_mariadb_read_only_s1_42baf529e0f3bfca391aca0a24c880e9]
  
  -    logs               => https://logstash.wikimedia.org/app/dashboards#/view/2d343ac0-6df8-11f0-8e08-7fab0da52b33?_g=(filters:!((query:(match_phrase:(event.module:check_mariadb_read_only_s1))),(query:(match_phrase:(host.name:{{$labels.instance|stripPort}})))))
  -    description        => NRPE CHECK: MariaDB read only s1
  -    severity           => info
  -    runbook            => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Master_comes_back_in_read_only
  -    site               => codfw
  -    alert_name         => nrpe_MariaDB_read_only_s1
  -    for                => 3m
  -    team               => observability
  -    instance           => ops
  -    ensure             => absent
  -    expr               => (nagios_nrpe_check_result{alert_rule_hash="42baf529e0f3bfca391aca0a24c880e9",check_name="check_mariadb_read_only_s1", status=~"(WARNING|CRITICAL)", severity=~"(warning|critical)"} > 0) * on (instance) group_left (team) role_owner
  -    group              => nrpechecks
  -    summary            => NRPE CHECK: MariaDB read only s1
  -    def_label_whitelst => ['team', 'severity']
  -    dashboard          => TODO
  

• Class[Mariadb::Monitor_memory]

  Parameters differences:

  --- Class[Mariadb::Monitor_memory].orig
  +++ Class[Mariadb::Monitor_memory]
  
  -    critical      => 95
  -    warning       => 90
  -    is_critical   => False
  -    contact_group => admins
  

• Exec[systemd daemon-reload for prometheus-mysqld-exporter@.service (prometheus-mysqld-exporter@)]

  Parameters differences:

  --- Exec[systemd daemon-reload for prometheus-mysqld-exporter@.service (prometheus-mysqld-exporter@)].orig
  +++ Exec[systemd daemon-reload for prometheus-mysqld-exporter@.service (prometheus-mysqld-exporter@)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Systemd::Timer[nrpe2nodexp-mariadb_disk_space]

  Parameters differences:

  --- Systemd::Timer[nrpe2nodexp-mariadb_disk_space].orig
  +++ Systemd::Timer[nrpe2nodexp-mariadb_disk_space]
  
  -    ensure             => absent
  -    unit_name          => nrpe2nodexp-mariadb_disk_space.service
  -    timer_intervals    => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}, {'interval': '1s', 'start': 'OnActiveSec'}]
  -    accuracy           => 15sec
  -    splay              => 60
  -    fixed_random_delay => True
  

• Systemd::Timer::Job[nrpe2nodexp-mariadb_memory]

  Parameters differences:

  --- Systemd::Timer::Job[nrpe2nodexp-mariadb_memory].orig
  +++ Systemd::Timer::Job[nrpe2nodexp-mariadb_memory]
  
  -    monitoring_enabled        => False
  -    description               => execution of nrpe2nodexp for the check_mariadb_memory command.
  -    syslog_match_startswith   => True
  -    ensure                    => absent
  -    user                      => nagios
  -    interval                  => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}]
  -    send_mail_to              => root@db2141.codfw.wmnet
  -    logfile_basedir           => /var/log
  -    private_tmp               => False
  -    success_exit_status       => []
  -    send_mail_only_on_error   => True
  -    ignore_errors             => True
  -    logfile_name              => syslog.log
  -    command                   => /usr/local/bin/nrpe2nodexp --alert-rule-hash "b5a92c72542d5f0c031014e7a8db014e" --timeout 10 --check-command "check_mariadb_memory"
  -    syslog_identifier         => nrpe2nodexp-mariadb_memory
  -    monitoring_notes_url      => https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -    logfile_perms             => all
  -    syslog_force_stop         => True
  -    splay                     => 60
  -    logfile_group             => root
  -    group                     => prometheus-node-exporter
  -    send_mail                 => False
  -    logging_enabled           => False
  -    environment               => {}
  -    monitoring_contact_groups => admins
  -    fixed_random_delay        => True
  

• Motd::Message[insetup::data_persistence_ferm]

  Parameters differences:

  --- Motd::Message[insetup::data_persistence_ferm].orig
  +++ Motd::Message[insetup::data_persistence_ferm]
  
  +    ensure   => present
  +    message  => db2141 is a Host being setup by Data Persistence SREs (insetup::data_persistence_ferm)
  +    priority => 5
  

• File[/etc/default/prometheus-mysqld-exporter@s1]

  Parameters differences:

  --- File[/etc/default/prometheus-mysqld-exporter@s1].orig
  +++ File[/etc/default/prometheus-mysqld-exporter@s1]
  
  -    owner  => root
  -    ensure => present
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemctl try-restart prometheus-mysqld-exporter@s1]
  

  Content differences:

  --- /etc/default/prometheus-mysqld-exporter@s1.orig
  +++ /etc/default/prometheus-mysqld-exporter@s1
  @@ -1 +0,0 @@
  -ARGS='--web.listen-address ":13311" --config.my-cnf "/var/lib/prometheus/.my.s1.cnf" --collect.global_status --collect.global_variables --collect.info_schema.processlist --collect.slave_status --collect.heartbeat --collect.heartbeat.utc --no-collect.info_schema.tables'

• Package[grc]

  Parameters differences:

  --- Package[grc].orig
  +++ Package[grc]
  
  -    ensure   => installed
  -    provider => apt
  

• Systemd::Unit[nrpe2nodexp-mysqld.timer]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mysqld.timer].orig
  +++ Systemd::Unit[nrpe2nodexp-mysqld.timer]
  
  -    ensure            => absent
  -    restart           => False
  -    unit              => nrpe2nodexp-mysqld.timer
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• Rsyslog::Conf[nrpe2nodexp-mariadb_replica_io_state_s1]

  Parameters differences:

  --- Rsyslog::Conf[nrpe2nodexp-mariadb_replica_io_state_s1].orig
  +++ Rsyslog::Conf[nrpe2nodexp-mariadb_replica_io_state_s1]
  
  -    mode     => 0444
  -    ensure   => absent
  -    priority => 25
  

• File[/etc/mysql/ssl/server-cert.pem]

  Parameters differences:

  --- File[/etc/mysql/ssl/server-cert.pem].orig
  +++ File[/etc/mysql/ssl/server-cert.pem]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• Exec[systemd daemon-reload for wmf_auto_restart_prometheus-mysqld-exporter@s1.service (wmf_auto_restart_prometheus-mysqld-exporter@s1.service)]

  Parameters differences:

  --- Exec[systemd daemon-reload for wmf_auto_restart_prometheus-mysqld-exporter@s1.service (wmf_auto_restart_prometheus-mysqld-exporter@s1.service)].orig
  +++ Exec[systemd daemon-reload for wmf_auto_restart_prometheus-mysqld-exporter@s1.service (wmf_auto_restart_prometheus-mysqld-exporter@s1.service)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Systemd::Unit[nrpe2nodexp-mysqld.service]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mysqld.service].orig
  +++ Systemd::Unit[nrpe2nodexp-mysqld.service]
  
  -    ensure            => absent
  -    unit              => nrpe2nodexp-mysqld.service
  -    restart           => False
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• Monitoring::Service[mariadb_replica_sql_lag_s1]

  Parameters differences:

  --- Monitoring::Service[mariadb_replica_sql_lag_s1].orig
  +++ Monitoring::Service[mariadb_replica_sql_lag_s1]
  
  -    description    => MariaDB Replica Lag: s1
  -    config_dir     => /etc/nagios
  -    migration_task => T315866
  -    critical       => False
  -    check_interval => 1
  -    contact_group  => admins
  -    freshness      => 36000
  -    ensure         => present
  -    retry_interval => 1
  -    passive        => False
  -    host           => db2141
  -    notes_url      => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica
  -    check_command  => nrpe_check!check_mariadb_replica_sql_lag_s1!10
  -    retries        => 10
  

• Concat_fragment[/etc/mysql_puppet_ca_chain]

  Parameters differences:

  --- Concat_fragment[/etc/mysql_puppet_ca_chain].orig
  +++ Concat_fragment[/etc/mysql_puppet_ca_chain]
  
  -    order  => 02
  -    source => /var/lib/puppet/ssl/certs/ca.pem
  -    tag    => _etc_mysql_ssl_cert.pem
  -    target => /etc/mysql/ssl/cert.pem
  

• Concat_fragment[main contacts]

  Content differences:

  --- main contacts.orig
  +++ main contacts
  @@ -1,3 +1,3 @@
   ---
  -role::mariadb::backup_source:
  +role::insetup::data_persistence_ferm:
   - Data Persistence

• File[/etc/mysql/ssl/cacert.pem]

  Parameters differences:

  --- File[/etc/mysql/ssl/cacert.pem].orig
  +++ File[/etc/mysql/ssl/cacert.pem]
  
  -    owner     => root
  -    ensure    => file
  -    show_diff => False
  -    group     => mysql
  -    mode      => 0440
  -    backup    => False
  

• File[/etc/ferm/conf.d/10_s1_mariadb_dba]

  Parameters differences:

  --- File[/etc/ferm/conf.d/10_s1_mariadb_dba].orig
  +++ File[/etc/ferm/conf.d/10_s1_mariadb_dba]
  
  -    owner   => root
  -    ensure  => present
  -    tag     => ferm
  -    group   => root
  -    mode    => 0400
  -    notify  => Service[ferm]
  -    require => File[/etc/ferm/conf.d]
  

  Content differences:

  --- /etc/ferm/conf.d/10_s1_mariadb_dba.orig
  +++ /etc/ferm/conf.d/10_s1_mariadb_dba
  @@ -1,6 +0,0 @@
  -# Autogenerated by puppet. DO NOT EDIT BY HAND!
  -#
  -# 
  -&R_SERVICE(tcp, 3331, $MYSQL_ROOT_CLIENTS);
  -
  -

• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_memory.timer (nrpe2nodexp-mariadb_memory.timer)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mariadb_memory.timer (nrpe2nodexp-mariadb_memory.timer)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mariadb_memory.timer (nrpe2nodexp-mariadb_memory.timer)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Class[Profile::Monitoring]

  Parameters differences:

  --- Class[Profile::Monitoring].orig
  +++ Class[Profile::Monitoring]
  
  @@
  -    notifications_enabled => True
  +    notifications_enabled => False
  

• File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_state_s1.service]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_state_s1.service].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_state_s1.service]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_state_s1.service (nrpe2nodexp-mariadb_replica_sql_state_s1.service)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_state_s1.service.orig
  +++ /lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_state_s1.service
  @@ -1,11 +0,0 @@
  -[Unit]
  -Description=execution of nrpe2nodexp for the check_mariadb_replica_sql_state_s1 command.
  -Documentation=https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -
  -[Service]
  -Type=oneshot
  -User=nagios
  -
  -Group=prometheus-node-exporter
  -SyslogIdentifier=nrpe2nodexp-mariadb_replica_sql_state_s1
  -ExecStart=-/usr/local/bin/nrpe2nodexp --alert-rule-hash "3f927914a18db09399b7fff42858d634" --timeout 10 --check-command "check_mariadb_replica_sql_state_s1"

• Monitoring::Exported_nagios_service[db2141 mariadb_replica_sql_lag_s1]

  Parameters differences:

  --- Monitoring::Exported_nagios_service[db2141 mariadb_replica_sql_lag_s1].orig
  +++ Monitoring::Exported_nagios_service[db2141 mariadb_replica_sql_lag_s1]
  
  -    host_name              => db2141
  -    servicegroups          => mysql_codfw
  -    passive_checks_enabled => 1
  -    service_description    => MariaDB Replica Lag: s1
  -    ensure                 => present
  -    active_checks_enabled  => 1
  -    max_check_attempts     => 10
  -    check_period           => 24x7
  -    notification_options   => c,r,f
  -    is_volatile            => 0
  -    notes_url              => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica
  -    check_command          => nrpe_check!check_mariadb_replica_sql_lag_s1!10
  -    notifications_enabled  => 1
  -    contact_groups         => admins
  -    check_freshness        => 0
  -    check_interval         => 1
  -    notification_period    => 24x7
  -    retry_interval         => 1
  -    notification_interval  => 0
  

• Prometheus::Mysqld_exporter::Instance[s1]

  Parameters differences:

  --- Prometheus::Mysqld_exporter::Instance[s1].orig
  +++ Prometheus::Mysqld_exporter::Instance[s1]
  
  -    client_socket   => /run/mysqld/mysqld.s1.sock
  -    client_user     => prometheus
  -    listen_address  => :13311
  -    client_password => This is a fake passsword, but cannot be empty due to Debian #953040
  

• Systemd::Timer[wmf_auto_restart_prometheus-mysqld-exporter@s1]

  Parameters differences:

  --- Systemd::Timer[wmf_auto_restart_prometheus-mysqld-exporter@s1].orig
  +++ Systemd::Timer[wmf_auto_restart_prometheus-mysqld-exporter@s1]
  
  -    ensure             => present
  -    unit_name          => wmf_auto_restart_prometheus-mysqld-exporter@s1.service
  -    timer_intervals    => [{'start': 'OnCalendar', 'interval': 'Mon,Tue,Wed,Thu,Fri *-*-* 3:10:00'}]
  -    accuracy           => 15sec
  -    splay              => 0
  -    fixed_random_delay => False
  

• File[/etc/nagios/nrpe.d/check_mysqld.cfg]

  Parameters differences:

  --- File[/etc/nagios/nrpe.d/check_mysqld.cfg].orig
  +++ File[/etc/nagios/nrpe.d/check_mysqld.cfg]
  
  -    owner   => root
  -    ensure  => present
  -    group   => root
  -    mode    => 0444
  -    notify  => Service[nagios-nrpe-server]
  -    tag     => nrpe::check
  -    require => Package[nagios-nrpe-server]
  

  Content differences:

  --- /etc/nagios/nrpe.d/check_mysqld.cfg.orig
  +++ /etc/nagios/nrpe.d/check_mysqld.cfg
  @@ -1,2 +0,0 @@
  -# File generated by puppet. DO NOT edit by hand
  -command[check_mysqld]=/usr/lib/nagios/plugins/check_procs -c 1:1 -C mysqld

• Systemd::Unit[nrpe2nodexp-mariadb_replica_io_state_s1.service]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mariadb_replica_io_state_s1.service].orig
  +++ Systemd::Unit[nrpe2nodexp-mariadb_replica_io_state_s1.service]
  
  -    ensure            => absent
  -    unit              => nrpe2nodexp-mariadb_replica_io_state_s1.service
  -    restart           => False
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• Systemd::Service[nrpe2nodexp-mariadb_replica_sql_lag_s1]

  Parameters differences:

  --- Systemd::Service[nrpe2nodexp-mariadb_replica_sql_lag_s1].orig
  +++ Systemd::Service[nrpe2nodexp-mariadb_replica_sql_lag_s1]
  
  -    monitoring_enabled       => False
  -    restart                  => False
  -    migration_task           => T407130
  -    override                 => False
  -    require                  => Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_lag_s1.service]
  -    monitoring_critical      => False
  -    ensure                   => absent
  -    unit_type                => timer
  -    monitoring_contact_group => admins
  -    service_params           => {}
  

• File[/etc/mysql/grcat.config]

  Parameters differences:

  --- File[/etc/mysql/grcat.config].orig
  +++ File[/etc/mysql/grcat.config]
  
  -    owner  => root
  -    ensure => present
  -    source => puppet:///modules/mariadb/grcat.config
  -    group  => root
  -    mode   => 0644
  

• File[/usr/lib/nagios/plugins/check_mariadb.pl]

  Parameters differences:

  --- File[/usr/lib/nagios/plugins/check_mariadb.pl].orig
  +++ File[/usr/lib/nagios/plugins/check_mariadb.pl]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• Systemd::Service[wmf_auto_restart_prometheus-mysqld-exporter@s1]

  Parameters differences:

  --- Systemd::Service[wmf_auto_restart_prometheus-mysqld-exporter@s1].orig
  +++ Systemd::Service[wmf_auto_restart_prometheus-mysqld-exporter@s1]
  
  -    monitoring_enabled       => False
  -    restart                  => False
  -    migration_task           => T407130
  -    override                 => False
  -    require                  => Systemd::Unit[wmf_auto_restart_prometheus-mysqld-exporter@s1.service]
  -    monitoring_critical      => False
  -    ensure                   => present
  -    unit_type                => timer
  -    monitoring_contact_group => admins
  -    service_params           => {}
  

• Package[wmf-mariadb1011]

  Parameters differences:

  --- Package[wmf-mariadb1011].orig
  +++ Package[wmf-mariadb1011]
  
  -    ensure   => installed
  -    provider => apt
  

• File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_io_state_s1.service]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_io_state_s1.service].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_io_state_s1.service]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_io_state_s1.service (nrpe2nodexp-mariadb_replica_io_state_s1.service)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mariadb_replica_io_state_s1.service.orig
  +++ /lib/systemd/system/nrpe2nodexp-mariadb_replica_io_state_s1.service
  @@ -1,11 +0,0 @@
  -[Unit]
  -Description=execution of nrpe2nodexp for the check_mariadb_replica_io_state_s1 command.
  -Documentation=https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -
  -[Service]
  -Type=oneshot
  -User=nagios
  -
  -Group=prometheus-node-exporter
  -SyslogIdentifier=nrpe2nodexp-mariadb_replica_io_state_s1
  -ExecStart=-/usr/local/bin/nrpe2nodexp --alert-rule-hash "0d5979f7abbb49256cfedd70a646784e" --timeout 10 --check-command "check_mariadb_replica_io_state_s1"

• Nrpe::Monitor_service[mariadb_memory]

  Parameters differences:

  --- Nrpe::Monitor_service[mariadb_memory].orig
  +++ Nrpe::Monitor_service[mariadb_memory]
  
  -    description                 => MariaDB memory
  -    migration_task              => T315866
  -    nrpe2nodexp_parse_perf_data => False
  -    ensure                      => present
  -    enable_nrpe2nodexp          => False
  -    notes_url                   => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting
  -    retries                     => 3
  -    enable_icinga_check         => True
  -    critical                    => False
  -    check_interval              => 1
  -    contact_group               => admins
  -    alertmanager_team           => observability
  -    require                     => Package[monitoring-plugins-contrib]
  -    retry_interval              => 1
  -    timeout                     => 10
  -    nrpe_command                => /usr/lib/nagios/plugins/pmp-check-unix-memory -c 95 -w 90
  

• Systemd::Unit[nrpe2nodexp-mariadb_disk_space.service]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mariadb_disk_space.service].orig
  +++ Systemd::Unit[nrpe2nodexp-mariadb_disk_space.service]
  
  -    ensure            => absent
  -    unit              => nrpe2nodexp-mariadb_disk_space.service
  -    restart           => False
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_read_only_s1.timer (nrpe2nodexp-mariadb_read_only_s1.timer)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mariadb_read_only_s1.timer (nrpe2nodexp-mariadb_read_only_s1.timer)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mariadb_read_only_s1.timer (nrpe2nodexp-mariadb_read_only_s1.timer)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Sudo::User[nrpe-check_mariadb_memory]

  Parameters differences:

  --- Sudo::User[nrpe-check_mariadb_memory].orig
  +++ Sudo::User[nrpe-check_mariadb_memory]
  
  -    ensure     => absent
  -    user       => nagios
  -    tag        => nrpe::check
  -    privileges => []
  -    require    => ['Class[Sudo]']
  

• File[/etc/nagios/nrpe.d/check_mariadb_replica_io_state_s1.cfg]

  Parameters differences:

  --- File[/etc/nagios/nrpe.d/check_mariadb_replica_io_state_s1.cfg].orig
  +++ File[/etc/nagios/nrpe.d/check_mariadb_replica_io_state_s1.cfg]
  
  -    owner   => root
  -    ensure  => present
  -    group   => root
  -    mode    => 0444
  -    notify  => Service[nagios-nrpe-server]
  -    tag     => nrpe::check
  -    require => Package[nagios-nrpe-server]
  

  Content differences:

  --- /etc/nagios/nrpe.d/check_mariadb_replica_io_state_s1.cfg.orig
  +++ /etc/nagios/nrpe.d/check_mariadb_replica_io_state_s1.cfg
  @@ -1,2 +0,0 @@
  -# File generated by puppet. DO NOT edit by hand
  -command[check_mariadb_replica_io_state_s1]=/usr/local/lib/nagios/plugins/check_mariadb --sock=/run/mysqld/mysqld.s1.sock --user=nagios --pass=  --warn-stopped --check=slave_io_state

• Ferm::Service[s1_mariadb_dba]

  Parameters differences:

  --- Ferm::Service[s1_mariadb_dba].orig
  +++ Ferm::Service[s1_mariadb_dba]
  
  -    srange              => $MYSQL_ROOT_CLIENTS
  -    proto               => tcp
  -    prio                => 10
  -    port                => 3331
  -    ensure              => present
  -    unrestricted_access => False
  -    notrack             => False
  -    desc                => 
  

• File[/var/log/wmf_auto_restart_prometheus-mysqld-exporter_s1]

  Parameters differences:

  --- File[/var/log/wmf_auto_restart_prometheus-mysqld-exporter_s1].orig
  +++ File[/var/log/wmf_auto_restart_prometheus-mysqld-exporter_s1]
  
  -    owner  => root
  -    ensure => directory
  -    force  => True
  -    group  => root
  -    mode   => 0755
  -    backup => False
  

• Class[Profile::Mariadb::Dbstore_multiinstance]

  Parameters differences:

  --- Class[Profile::Mariadb::Dbstore_multiinstance].orig
  +++ Class[Profile::Mariadb::Dbstore_multiinstance]
  
  -    section_ports => {'s1': 3311, 's2': 3312, 's3': 3313, 's4': 3314, 's5': 3315, 's6': 3316, 's7': 3317, 's8': 3318, 'x1': 3320, 'x3': 3363, 'm1': 3321, 'm2': 3322, 'm3': 3323, 'm5': 3325, 'staging': 3350, 'matomo': 3351, 'analytics_meta': 3352, 'backup1-eqiad': 3360, 'backup1-codfw': 3361}
  -    instances     => {'s1': '192G'}
  -    require       => ['Class[Profile::Mariadb::Packages_wmf]']
  

• Nrpe::Check[check_mariadb_disk_space]

  Parameters differences:

  --- Nrpe::Check[check_mariadb_disk_space].orig
  +++ Nrpe::Check[check_mariadb_disk_space]
  
  -    ensure  => present
  -    before  => Monitoring::Service[mariadb_disk_space]
  -    command => /usr/lib/nagios/plugins/check_disk -w 10% -c 5% -l -e --exclude-type=tracefs --exclude-type=tmpfs --exclude-type=ramfs --exclude-type=devtmpfs
  

• Systemd::Timer::Job[nrpe2nodexp-mariadb_read_only_s1]

  Parameters differences:

  --- Systemd::Timer::Job[nrpe2nodexp-mariadb_read_only_s1].orig
  +++ Systemd::Timer::Job[nrpe2nodexp-mariadb_read_only_s1]
  
  -    monitoring_enabled        => False
  -    description               => execution of nrpe2nodexp for the check_mariadb_read_only_s1 command.
  -    syslog_match_startswith   => True
  -    ensure                    => absent
  -    user                      => nagios
  -    interval                  => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}]
  -    send_mail_to              => root@db2141.codfw.wmnet
  -    logfile_basedir           => /var/log
  -    private_tmp               => False
  -    success_exit_status       => []
  -    send_mail_only_on_error   => True
  -    ignore_errors             => True
  -    logfile_name              => syslog.log
  -    command                   => /usr/local/bin/nrpe2nodexp --alert-rule-hash "42baf529e0f3bfca391aca0a24c880e9" --timeout 10 --check-command "check_mariadb_read_only_s1"
  -    syslog_identifier         => nrpe2nodexp-mariadb_read_only_s1
  -    monitoring_notes_url      => https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -    logfile_perms             => all
  -    syslog_force_stop         => True
  -    splay                     => 60
  -    logfile_group             => root
  -    group                     => prometheus-node-exporter
  -    send_mail                 => False
  -    logging_enabled           => False
  -    environment               => {}
  -    monitoring_contact_groups => admins
  -    fixed_random_delay        => True
  

• Exec[systemctl try-restart prometheus-mysqld-exporter@s1]

  Parameters differences:

  --- Exec[systemctl try-restart prometheus-mysqld-exporter@s1].orig
  +++ Exec[systemctl try-restart prometheus-mysqld-exporter@s1]
  
  -    refreshonly => True
  -    path        => /usr/bin
  

• Concat::Fragment[/etc/mysql_puppet_agent_cert]

  Parameters differences:

  --- Concat::Fragment[/etc/mysql_puppet_agent_cert].orig
  +++ Concat::Fragment[/etc/mysql_puppet_agent_cert]
  
  -    order  => 01
  -    source => /var/lib/puppet/ssl/certs/db2141.codfw.wmnet.pem
  -    target => /etc/mysql/ssl/cert.pem
  

• Class[Mariadb::Config]

  Parameters differences:

  --- Class[Mariadb::Config].orig
  +++ Class[Mariadb::Config]
  
  -    ssl_cert                => 
  -    binlog_format           => ROW
  -    password                => undefined
  -    replication_role        => standalone
  -    flush_log_at_trx_commit => 1
  -    ssl_key                 => 
  -    socket                  => /run/mysqld/mysqld.sock
  -    port                    => 3306
  -    p_s                     => on
  -    ssl                     => puppet-cert
  -    basedir                 => /opt/wmf-mariadb1011
  -    event_scheduler         => 1
  -    sql_mode                => 
  -    sync_binlog             => 1
  -    prompt                  => \u@\h(\d)>\_
  -    semi_sync               => off
  -    read_only               => 1
  -    ssl_ca                  => 
  -    max_allowed_packet      => 16M
  -    datadir                 => False
  -    innodb_change_buffering => none
  -    expire_logs_days        => 30
  -    config                  => profile/mariadb/mysqld_config/dbstore_multiinstance.my.cnf.erb
  -    ssl_verify_server_cert  => True
  -    tmpdir                  => /srv/tmp
  

• Systemd::Unit[nrpe2nodexp-mariadb_memory.service]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mariadb_memory.service].orig
  +++ Systemd::Unit[nrpe2nodexp-mariadb_memory.service]
  
  -    ensure            => absent
  -    unit              => nrpe2nodexp-mariadb_memory.service
  -    restart           => False
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• Class[Wmfmariadbpy]

  Parameters differences:

  --- Class[Wmfmariadbpy].orig
  +++ Class[Wmfmariadbpy]
  
  -    role          => db
  -    section_ports => {'s1': 3311, 's2': 3312, 's3': 3313, 's4': 3314, 's5': 3315, 's6': 3316, 's7': 3317, 's8': 3318, 'x1': 3320, 'x3': 3363, 'm1': 3321, 'm2': 3322, 'm3': 3323, 'm5': 3325, 'staging': 3350, 'matomo': 3351, 'analytics_meta': 3352, 'backup1-eqiad': 3360, 'backup1-codfw': 3361}
  

• Systemd::Service[nrpe2nodexp-mariadb_disk_space]

  Parameters differences:

  --- Systemd::Service[nrpe2nodexp-mariadb_disk_space].orig
  +++ Systemd::Service[nrpe2nodexp-mariadb_disk_space]
  
  -    monitoring_enabled       => False
  -    restart                  => False
  -    migration_task           => T407130
  -    override                 => False
  -    require                  => Systemd::Unit[nrpe2nodexp-mariadb_disk_space.service]
  -    monitoring_critical      => False
  -    ensure                   => absent
  -    unit_type                => timer
  -    monitoring_contact_group => admins
  -    service_params           => {}
  

• Profile::Mariadb::Ferm[s1]

  Parameters differences:

  --- Profile::Mariadb::Ferm[s1].orig
  +++ Profile::Mariadb::Ferm[s1]
  
  -    port => 3311
  

• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_state_s1.timer (nrpe2nodexp-mariadb_replica_sql_state_s1.timer)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_state_s1.timer (nrpe2nodexp-mariadb_replica_sql_state_s1.timer)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_state_s1.timer (nrpe2nodexp-mariadb_replica_sql_state_s1.timer)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• File[/etc/nagios/nrpe.d/check_mariadb_replica_sql_state_s1.cfg]

  Parameters differences:

  --- File[/etc/nagios/nrpe.d/check_mariadb_replica_sql_state_s1.cfg].orig
  +++ File[/etc/nagios/nrpe.d/check_mariadb_replica_sql_state_s1.cfg]
  
  -    owner   => root
  -    ensure  => present
  -    group   => root
  -    mode    => 0444
  -    notify  => Service[nagios-nrpe-server]
  -    tag     => nrpe::check
  -    require => Package[nagios-nrpe-server]
  

  Content differences:

  --- /etc/nagios/nrpe.d/check_mariadb_replica_sql_state_s1.cfg.orig
  +++ /etc/nagios/nrpe.d/check_mariadb_replica_sql_state_s1.cfg
  @@ -1,2 +0,0 @@
  -# File generated by puppet. DO NOT edit by hand
  -command[check_mariadb_replica_sql_state_s1]=/usr/local/lib/nagios/plugins/check_mariadb --sock=/run/mysqld/mysqld.s1.sock --user=nagios --pass=  --warn-stopped --check=slave_sql_state

• File[/etc/update-motd.d/05-insetup--data-persistence-ferm]

  Parameters differences:

  --- File[/etc/update-motd.d/05-insetup--data-persistence-ferm].orig
  +++ File[/etc/update-motd.d/05-insetup--data-persistence-ferm]
  
  +    mode   => 0555
  +    ensure => present
  +    owner  => root
  +    group  => root
  

  Content differences:

  --- /etc/update-motd.d/05-insetup--data-persistence-ferm.orig
  +++ /etc/update-motd.d/05-insetup--data-persistence-ferm
  @@ -0,0 +1,2 @@
  +#!/bin/sh
  +printf "%s\n" "db2141 is a Host being setup by Data Persistence SREs (insetup::data_persistence_ferm)"

• Class[Profile::Mariadb::Mysql_role]

  Parameters differences:

  --- Class[Profile::Mariadb::Mysql_role].orig
  +++ Class[Profile::Mariadb::Mysql_role]
  
  -    role => slave
  

• Systemd::Unit[nrpe2nodexp-mariadb_disk_space.timer]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mariadb_disk_space.timer].orig
  +++ Systemd::Unit[nrpe2nodexp-mariadb_disk_space.timer]
  
  -    ensure            => absent
  -    restart           => False
  -    unit              => nrpe2nodexp-mariadb_disk_space.timer
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• Nrpe::Monitor_service[mysqld]

  Parameters differences:

  --- Nrpe::Monitor_service[mysqld].orig
  +++ Nrpe::Monitor_service[mysqld]
  
  -    description                 => mysqld processes
  -    migration_task              => T315866
  -    nrpe2nodexp_parse_perf_data => False
  -    enable_icinga_check         => True
  -    critical                    => False
  -    check_interval              => 1
  -    contact_group               => admins
  -    alertmanager_team           => observability
  -    retries                     => 3
  -    ensure                      => present
  -    retry_interval              => 1
  -    enable_nrpe2nodexp          => False
  -    timeout                     => 10
  -    notes_url                   => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting
  -    nrpe_command                => /usr/lib/nagios/plugins/check_procs -c 1:1 -C mysqld
  

• Service[nrpe2nodexp-mysqld.timer]

  Parameters differences:

  --- Service[nrpe2nodexp-mysqld.timer].orig
  +++ Service[nrpe2nodexp-mysqld.timer]
  
  -    ensure   => stopped
  -    before   => ['Exec[systemd daemon-reload for nrpe2nodexp-mysqld.timer (nrpe2nodexp-mysqld.timer)]']
  -    provider => systemd
  -    enable   => False
  

• Rsyslog::Conf[wmf_auto_restart_prometheus-mysqld-exporter_s1]

  Parameters differences:

  --- Rsyslog::Conf[wmf_auto_restart_prometheus-mysqld-exporter_s1].orig
  +++ Rsyslog::Conf[wmf_auto_restart_prometheus-mysqld-exporter_s1]
  
  -    mode     => 0444
  -    ensure   => present
  -    priority => 40
  -    require  => File[/var/log/wmf_auto_restart_prometheus-mysqld-exporter_s1]
  

• Sudo::User[nrpe-check_mariadb_replica_sql_lag_s1]

  Parameters differences:

  --- Sudo::User[nrpe-check_mariadb_replica_sql_lag_s1].orig
  +++ Sudo::User[nrpe-check_mariadb_replica_sql_lag_s1]
  
  -    ensure     => absent
  -    user       => nagios
  -    tag        => nrpe::check
  -    privileges => []
  -    require    => ['Class[Sudo]']
  

• Exec[systemctl-daemon-reload]

  Parameters differences:

  --- Exec[systemctl-daemon-reload].orig
  +++ Exec[systemctl-daemon-reload]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Nrpe::Plugin[check_mariadb]

  Parameters differences:

  --- Nrpe::Plugin[check_mariadb].orig
  +++ Nrpe::Plugin[check_mariadb]
  
  -    ensure => present
  -    source => puppet:///modules/icinga/check_mariadb.pl
  

• Systemd::Timer::Job[nrpe2nodexp-mariadb_disk_space]

  Parameters differences:

  --- Systemd::Timer::Job[nrpe2nodexp-mariadb_disk_space].orig
  +++ Systemd::Timer::Job[nrpe2nodexp-mariadb_disk_space]
  
  -    monitoring_enabled        => False
  -    description               => execution of nrpe2nodexp for the check_mariadb_disk_space command.
  -    syslog_match_startswith   => True
  -    ensure                    => absent
  -    user                      => nagios
  -    interval                  => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}]
  -    send_mail_to              => root@db2141.codfw.wmnet
  -    logfile_basedir           => /var/log
  -    private_tmp               => False
  -    success_exit_status       => []
  -    send_mail_only_on_error   => True
  -    ignore_errors             => True
  -    logfile_name              => syslog.log
  -    command                   => /usr/local/bin/nrpe2nodexp --alert-rule-hash "d2aae7bfec5549be1a8b9413215bd86c" --timeout 10 --check-command "check_mariadb_disk_space"
  -    syslog_identifier         => nrpe2nodexp-mariadb_disk_space
  -    monitoring_notes_url      => https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -    logfile_perms             => all
  -    syslog_force_stop         => True
  -    splay                     => 60
  -    logfile_group             => root
  -    group                     => prometheus-node-exporter
  -    send_mail                 => False
  -    logging_enabled           => False
  -    environment               => {}
  -    monitoring_contact_groups => admins
  -    fixed_random_delay        => True
  

• Monitoring::Exported_nagios_service[db2141 disk_space]

  Parameters differences:

  --- Monitoring::Exported_nagios_service[db2141 disk_space].orig
  +++ Monitoring::Exported_nagios_service[db2141 disk_space]
  
  @@
  -    notifications_enabled => 1
  +    notifications_enabled => 0
  

• File[/var/lib/prometheus/node.d/check_mariadb_replica_sql_lag_s1.prom]

  Parameters differences:

  --- File[/var/lib/prometheus/node.d/check_mariadb_replica_sql_lag_s1.prom].orig
  +++ File[/var/lib/prometheus/node.d/check_mariadb_replica_sql_lag_s1.prom]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-disk-space.conf]

  Parameters differences:

  --- File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-disk-space.conf].orig
  +++ File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-disk-space.conf]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Service[rsyslog]
  

  Content differences:

  --- /etc/rsyslog.d/25-nrpe2nodexp-mariadb-disk-space.conf.orig
  +++ /etc/rsyslog.d/25-nrpe2nodexp-mariadb-disk-space.conf
  @@ -1,10 +0,0 @@
  -# SPDX-License-Identifier: Apache-2.0
  -if $programname contains "nrpe2nodexp-mariadb_disk_space" then {
  -    if ($msg contains "\"ecs.version\": \"1.7.0\"") then {
  -        # Send logs to kafka
  -        set $.log_outputs = "kafka ecs_170 local";
  -    } else {
  -        # Filter out non-relevant nrpe2nodexp messages
  -        stop
  -    }
  -}

• Sudo::User[nrpe-check_mariadb_replica_io_state_s1]

  Parameters differences:

  --- Sudo::User[nrpe-check_mariadb_replica_io_state_s1].orig
  +++ Sudo::User[nrpe-check_mariadb_replica_io_state_s1]
  
  -    ensure     => absent
  -    user       => nagios
  -    tag        => nrpe::check
  -    privileges => []
  -    require    => ['Class[Sudo]']
  

• Sudo::User[nrpe-check_mariadb_replica_sql_state_s1]

  Parameters differences:

  --- Sudo::User[nrpe-check_mariadb_replica_sql_state_s1].orig
  +++ Sudo::User[nrpe-check_mariadb_replica_sql_state_s1]
  
  -    ensure     => absent
  -    user       => nagios
  -    tag        => nrpe::check
  -    privileges => []
  -    require    => ['Class[Sudo]']
  

• Systemd::Timer::Job[nrpe2nodexp-mariadb_replica_sql_state_s1]

  Parameters differences:

  --- Systemd::Timer::Job[nrpe2nodexp-mariadb_replica_sql_state_s1].orig
  +++ Systemd::Timer::Job[nrpe2nodexp-mariadb_replica_sql_state_s1]
  
  -    monitoring_enabled        => False
  -    description               => execution of nrpe2nodexp for the check_mariadb_replica_sql_state_s1 command.
  -    syslog_match_startswith   => True
  -    ensure                    => absent
  -    user                      => nagios
  -    interval                  => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}]
  -    send_mail_to              => root@db2141.codfw.wmnet
  -    logfile_basedir           => /var/log
  -    private_tmp               => False
  -    success_exit_status       => []
  -    send_mail_only_on_error   => True
  -    ignore_errors             => True
  -    logfile_name              => syslog.log
  -    command                   => /usr/local/bin/nrpe2nodexp --alert-rule-hash "3f927914a18db09399b7fff42858d634" --timeout 10 --check-command "check_mariadb_replica_sql_state_s1"
  -    syslog_identifier         => nrpe2nodexp-mariadb_replica_sql_state_s1
  -    monitoring_notes_url      => https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -    logfile_perms             => all
  -    syslog_force_stop         => True
  -    splay                     => 60
  -    logfile_group             => root
  -    group                     => prometheus-node-exporter
  -    send_mail                 => False
  -    logging_enabled           => False
  -    environment               => {}
  -    monitoring_contact_groups => admins
  -    fixed_random_delay        => True
  

• File[/etc/nagios/nrpe.d/check_mariadb_memory.cfg]

  Parameters differences:

  --- File[/etc/nagios/nrpe.d/check_mariadb_memory.cfg].orig
  +++ File[/etc/nagios/nrpe.d/check_mariadb_memory.cfg]
  
  -    owner   => root
  -    ensure  => present
  -    group   => root
  -    mode    => 0444
  -    notify  => Service[nagios-nrpe-server]
  -    tag     => nrpe::check
  -    require => Package[nagios-nrpe-server]
  

  Content differences:

  --- /etc/nagios/nrpe.d/check_mariadb_memory.cfg.orig
  +++ /etc/nagios/nrpe.d/check_mariadb_memory.cfg
  @@ -1,2 +0,0 @@
  -# File generated by puppet. DO NOT edit by hand
  -command[check_mariadb_memory]=/usr/lib/nagios/plugins/pmp-check-unix-memory -c 95 -w 90

• Monitoring::Service[mysqld]

  Parameters differences:

  --- Monitoring::Service[mysqld].orig
  +++ Monitoring::Service[mysqld]
  
  -    description    => mysqld processes
  -    config_dir     => /etc/nagios
  -    migration_task => T315866
  -    critical       => False
  -    check_interval => 1
  -    contact_group  => admins
  -    freshness      => 36000
  -    ensure         => present
  -    retry_interval => 1
  -    passive        => False
  -    host           => db2141
  -    notes_url      => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting
  -    check_command  => nrpe_check!check_mysqld!10
  -    retries        => 3
  

• Systemd::Timer[nrpe2nodexp-mariadb_replica_sql_state_s1]

  Parameters differences:

  --- Systemd::Timer[nrpe2nodexp-mariadb_replica_sql_state_s1].orig
  +++ Systemd::Timer[nrpe2nodexp-mariadb_replica_sql_state_s1]
  
  -    ensure             => absent
  -    unit_name          => nrpe2nodexp-mariadb_replica_sql_state_s1.service
  -    timer_intervals    => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}, {'interval': '1s', 'start': 'OnActiveSec'}]
  -    accuracy           => 15sec
  -    splay              => 60
  -    fixed_random_delay => True
  

• File[/etc/default/prometheus]

  Parameters differences:

  --- File[/etc/default/prometheus].orig
  +++ File[/etc/default/prometheus]
  
  -    mode   => 0550
  -    ensure => directory
  -    owner  => prometheus
  -    group  => prometheus
  

• Systemd::Timer[nrpe2nodexp-mysqld]

  Parameters differences:

  --- Systemd::Timer[nrpe2nodexp-mysqld].orig
  +++ Systemd::Timer[nrpe2nodexp-mysqld]
  
  -    ensure             => absent
  -    unit_name          => nrpe2nodexp-mysqld.service
  -    timer_intervals    => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}, {'interval': '1s', 'start': 'OnActiveSec'}]
  -    accuracy           => 15sec
  -    splay              => 60
  -    fixed_random_delay => True
  

• Systemd::Service[nrpe2nodexp-mariadb_read_only_s1]

  Parameters differences:

  --- Systemd::Service[nrpe2nodexp-mariadb_read_only_s1].orig
  +++ Systemd::Service[nrpe2nodexp-mariadb_read_only_s1]
  
  -    monitoring_enabled       => False
  -    restart                  => False
  -    migration_task           => T407130
  -    override                 => False
  -    require                  => Systemd::Unit[nrpe2nodexp-mariadb_read_only_s1.service]
  -    monitoring_critical      => False
  -    ensure                   => absent
  -    unit_type                => timer
  -    monitoring_contact_group => admins
  -    service_params           => {}
  

• Systemd::Service[nrpe2nodexp-mariadb_replica_io_state_s1]

  Parameters differences:

  --- Systemd::Service[nrpe2nodexp-mariadb_replica_io_state_s1].orig
  +++ Systemd::Service[nrpe2nodexp-mariadb_replica_io_state_s1]
  
  -    monitoring_enabled       => False
  -    restart                  => False
  -    migration_task           => T407130
  -    override                 => False
  -    require                  => Systemd::Unit[nrpe2nodexp-mariadb_replica_io_state_s1.service]
  -    monitoring_critical      => False
  -    ensure                   => absent
  -    unit_type                => timer
  -    monitoring_contact_group => admins
  -    service_params           => {}
  

• File[/etc/mysql/ssl/client-key.pem]

  Parameters differences:

  --- File[/etc/mysql/ssl/client-key.pem].orig
  +++ File[/etc/mysql/ssl/client-key.pem]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• Systemd::Unit[prometheus-mysqld-exporter@]

  Parameters differences:

  --- Systemd::Unit[prometheus-mysqld-exporter@].orig
  +++ Systemd::Unit[prometheus-mysqld-exporter@]
  
  -    ensure            => present
  -    unit              => prometheus-mysqld-exporter@
  -    restart           => False
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Package[prometheus-mysqld-exporter]', 'Class[Systemd]']
  

• File[/etc/sudoers.d/nrpe-check_mariadb_read_only_s1]

  Parameters differences:

  --- File[/etc/sudoers.d/nrpe-check_mariadb_read_only_s1].orig
  +++ File[/etc/sudoers.d/nrpe-check_mariadb_read_only_s1]
  
  -    owner   => root
  -    ensure  => absent
  -    group   => root
  -    require => Package[nagios-nrpe-server]
  

• Motd::Message[mariadb::backup_source]

  Parameters differences:

  --- Motd::Message[mariadb::backup_source].orig
  +++ Motd::Message[mariadb::backup_source]
  
  -    ensure   => present
  -    message  => db2141 is a MariaDB server containing replicas of mediawiki databases used to generate backups (mariadb::backup_source)
  -    priority => 5
  

• File[/var/lib/prometheus/node.d/check_mariadb_replica_sql_state_s1.prom]

  Parameters differences:

  --- File[/var/lib/prometheus/node.d/check_mariadb_replica_sql_state_s1.prom].orig
  +++ File[/var/lib/prometheus/node.d/check_mariadb_replica_sql_state_s1.prom]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• Class[Mariadb::Service]

  Parameters differences:

  --- Class[Mariadb::Service].orig
  +++ Class[Mariadb::Service]
  
  -    manage   => False
  -    override => [Service]
  ExecStartPre=/bin/sh -c "echo 'mariadb main service is disabled, use mariadb@<instance_name> instead'; exit 1"
  -    ensure   => stopped
  -    enable   => False
  

• Systemd::Unit[wmf_auto_restart_prometheus-mysqld-exporter@s1.service]

  Parameters differences:

  --- Systemd::Unit[wmf_auto_restart_prometheus-mysqld-exporter@s1.service].orig
  +++ Systemd::Unit[wmf_auto_restart_prometheus-mysqld-exporter@s1.service]
  
  -    ensure            => present
  -    unit              => wmf_auto_restart_prometheus-mysqld-exporter@s1.service
  -    restart           => False
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_disk_space.timer (nrpe2nodexp-mariadb_disk_space.timer)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mariadb_disk_space.timer (nrpe2nodexp-mariadb_disk_space.timer)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mariadb_disk_space.timer (nrpe2nodexp-mariadb_disk_space.timer)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Service[nrpe2nodexp-mariadb_replica_io_state_s1.timer]

  Parameters differences:

  --- Service[nrpe2nodexp-mariadb_replica_io_state_s1.timer].orig
  +++ Service[nrpe2nodexp-mariadb_replica_io_state_s1.timer]
  
  -    ensure   => stopped
  -    before   => ['Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_io_state_s1.timer (nrpe2nodexp-mariadb_replica_io_state_s1.timer)]']
  -    provider => systemd
  -    enable   => False
  

• Systemd::Unit[nrpe2nodexp-mariadb_memory.timer]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mariadb_memory.timer].orig
  +++ Systemd::Unit[nrpe2nodexp-mariadb_memory.timer]
  
  -    ensure            => absent
  -    restart           => False
  -    unit              => nrpe2nodexp-mariadb_memory.timer
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• Nrpe::Check[check_mariadb_read_only_s1]

  Parameters differences:

  --- Nrpe::Check[check_mariadb_read_only_s1].orig
  +++ Nrpe::Check[check_mariadb_read_only_s1]
  
  -    ensure  => present
  -    before  => Monitoring::Service[mariadb_read_only_s1]
  -    command => db-check-health --port=3311 --icinga --check_read_only=1 --process
  

• File[/lib/systemd/system/nrpe2nodexp-mariadb_read_only_s1.timer]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mariadb_read_only_s1.timer].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mariadb_read_only_s1.timer]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mariadb_read_only_s1.timer (nrpe2nodexp-mariadb_read_only_s1.timer)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mariadb_read_only_s1.timer.orig
  +++ /lib/systemd/system/nrpe2nodexp-mariadb_read_only_s1.timer
  @@ -1,14 +0,0 @@
  -[Unit]
  -Description=Periodic execution of nrpe2nodexp-mariadb_read_only_s1.service
  -
  -[Timer]
  -Unit=nrpe2nodexp-mariadb_read_only_s1.service
  -# Accuracy sets the maximum time interval around the execution time we want to allow
  -AccuracySec=15sec
  -OnUnitInactiveSec=1min
  -OnActiveSec=1s
  -RandomizedDelaySec=60
  -FixedRandomDelay=true
  -
  -[Install]
  -WantedBy=multi-user.target

• Systemd::Timer[nrpe2nodexp-mariadb_memory]

  Parameters differences:

  --- Systemd::Timer[nrpe2nodexp-mariadb_memory].orig
  +++ Systemd::Timer[nrpe2nodexp-mariadb_memory]
  
  -    ensure             => absent
  -    unit_name          => nrpe2nodexp-mariadb_memory.service
  -    timer_intervals    => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}, {'interval': '1s', 'start': 'OnActiveSec'}]
  -    accuracy           => 15sec
  -    splay              => 60
  -    fixed_random_delay => True
  

• Concat::Fragment[/etc/mysql_puppet_ca_chain]

  Parameters differences:

  --- Concat::Fragment[/etc/mysql_puppet_ca_chain].orig
  +++ Concat::Fragment[/etc/mysql_puppet_ca_chain]
  
  -    order  => 02
  -    source => /var/lib/puppet/ssl/certs/ca.pem
  -    target => /etc/mysql/ssl/cert.pem
  

• File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-sql-lag-s1.conf]

  Parameters differences:

  --- File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-sql-lag-s1.conf].orig
  +++ File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-sql-lag-s1.conf]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Service[rsyslog]
  

  Content differences:

  --- /etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-sql-lag-s1.conf.orig
  +++ /etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-sql-lag-s1.conf
  @@ -1,10 +0,0 @@
  -# SPDX-License-Identifier: Apache-2.0
  -if $programname contains "nrpe2nodexp-mariadb_replica_sql_lag_s1" then {
  -    if ($msg contains "\"ecs.version\": \"1.7.0\"") then {
  -        # Send logs to kafka
  -        set $.log_outputs = "kafka ecs_170 local";
  -    } else {
  -        # Filter out non-relevant nrpe2nodexp messages
  -        stop
  -    }
  -}

• Systemd::Unit[wmf_auto_restart_prometheus-mysqld-exporter@s1.timer]

  Parameters differences:

  --- Systemd::Unit[wmf_auto_restart_prometheus-mysqld-exporter@s1.timer].orig
  +++ Systemd::Unit[wmf_auto_restart_prometheus-mysqld-exporter@s1.timer]
  
  -    ensure            => present
  -    restart           => False
  -    unit              => wmf_auto_restart_prometheus-mysqld-exporter@s1.timer
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_disk_space.service (nrpe2nodexp-mariadb_disk_space.service)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mariadb_disk_space.service (nrpe2nodexp-mariadb_disk_space.service)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mariadb_disk_space.service (nrpe2nodexp-mariadb_disk_space.service)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Monitoring::Exported_nagios_service[db2141 raid_megaraid]

  Parameters differences:

  --- Monitoring::Exported_nagios_service[db2141 raid_megaraid].orig
  +++ Monitoring::Exported_nagios_service[db2141 raid_megaraid]
  
  @@
  -    notifications_enabled => 1
  +    notifications_enabled => 0
  

• Systemd::Timer[nrpe2nodexp-mariadb_replica_sql_lag_s1]

  Parameters differences:

  --- Systemd::Timer[nrpe2nodexp-mariadb_replica_sql_lag_s1].orig
  +++ Systemd::Timer[nrpe2nodexp-mariadb_replica_sql_lag_s1]
  
  -    ensure             => absent
  -    unit_name          => nrpe2nodexp-mariadb_replica_sql_lag_s1.service
  -    timer_intervals    => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}, {'interval': '1s', 'start': 'OnActiveSec'}]
  -    accuracy           => 15sec
  -    splay              => 60
  -    fixed_random_delay => True
  

• File[/etc/mysql/mysqld.conf.d]

  Parameters differences:

  --- File[/etc/mysql/mysqld.conf.d].orig
  +++ File[/etc/mysql/mysqld.conf.d]
  
  -    owner  => root
  -    ensure => directory
  -    mode   => 0755
  -    group  => root
  

• Monitoring::Exported_nagios_service[db2141 mysqld]

  Parameters differences:

  --- Monitoring::Exported_nagios_service[db2141 mysqld].orig
  +++ Monitoring::Exported_nagios_service[db2141 mysqld]
  
  -    host_name              => db2141
  -    servicegroups          => mysql_codfw
  -    passive_checks_enabled => 1
  -    service_description    => mysqld processes
  -    ensure                 => present
  -    active_checks_enabled  => 1
  -    max_check_attempts     => 3
  -    check_period           => 24x7
  -    notification_options   => c,r,f
  -    is_volatile            => 0
  -    notes_url              => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting
  -    check_command          => nrpe_check!check_mysqld!10
  -    notifications_enabled  => 1
  -    contact_groups         => admins
  -    check_freshness        => 0
  -    check_interval         => 1
  -    notification_period    => 24x7
  -    retry_interval         => 1
  -    notification_interval  => 0
  

• Profile::Prometheus::Mysqld_exporter_instance[s1]

  Parameters differences:

  --- Profile::Prometheus::Mysqld_exporter_instance[s1].orig
  +++ Profile::Prometheus::Mysqld_exporter_instance[s1]
  
  -    socket => /run/mysqld/mysqld.s1.sock
  -    port   => 13311
  

• File[/etc/mysql/mysqld.conf.d/s1.cnf]

  Parameters differences:

  --- File[/etc/mysql/mysqld.conf.d/s1.cnf].orig
  +++ File[/etc/mysql/mysqld.conf.d/s1.cnf]
  
  -    owner => root
  -    mode  => 0644
  -    group => root
  

  Content differences:

  --- /etc/mysql/mysqld.conf.d/s1.cnf.orig
  +++ /etc/mysql/mysqld.conf.d/s1.cnf
  @@ -1,9 +0,0 @@
  -[mysqld@s1]
  -datadir = /srv/sqldata.s1
  -tmpdir = /srv/tmp.s1
  -socket = /run/mysqld/mysqld.s1.sock
  -port = 3311
  -extra-port = 3331
  -innodb_buffer_pool_size = 192G
  -read-only = 1
  -

• File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_state_s1.timer]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_state_s1.timer].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_state_s1.timer]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_state_s1.timer (nrpe2nodexp-mariadb_replica_sql_state_s1.timer)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_state_s1.timer.orig
  +++ /lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_state_s1.timer
  @@ -1,14 +0,0 @@
  -[Unit]
  -Description=Periodic execution of nrpe2nodexp-mariadb_replica_sql_state_s1.service
  -
  -[Timer]
  -Unit=nrpe2nodexp-mariadb_replica_sql_state_s1.service
  -# Accuracy sets the maximum time interval around the execution time we want to allow
  -AccuracySec=15sec
  -OnUnitInactiveSec=1min
  -OnActiveSec=1s
  -RandomizedDelaySec=60
  -FixedRandomDelay=true
  -
  -[Install]
  -WantedBy=multi-user.target

• Class[Profile::Mariadb::Packages_wmf]

  Parameters differences:

  --- Class[Profile::Mariadb::Packages_wmf].orig
  +++ Class[Profile::Mariadb::Packages_wmf]
  
  -    package => wmf-mariadb1011
  

• Rsyslog::Conf[nrpe2nodexp-mysqld]

  Parameters differences:

  --- Rsyslog::Conf[nrpe2nodexp-mysqld].orig
  +++ Rsyslog::Conf[nrpe2nodexp-mysqld]
  
  -    mode     => 0444
  -    ensure   => absent
  -    priority => 25
  

• Service[nrpe2nodexp-mariadb_replica_sql_lag_s1.timer]

  Parameters differences:

  --- Service[nrpe2nodexp-mariadb_replica_sql_lag_s1.timer].orig
  +++ Service[nrpe2nodexp-mariadb_replica_sql_lag_s1.timer]
  
  -    ensure   => stopped
  -    before   => ['Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_lag_s1.timer (nrpe2nodexp-mariadb_replica_sql_lag_s1.timer)]']
  -    provider => systemd
  -    enable   => False
  

• Systemd::Service[nrpe2nodexp-mysqld]

  Parameters differences:

  --- Systemd::Service[nrpe2nodexp-mysqld].orig
  +++ Systemd::Service[nrpe2nodexp-mysqld]
  
  -    monitoring_enabled       => False
  -    restart                  => False
  -    migration_task           => T407130
  -    override                 => False
  -    require                  => Systemd::Unit[nrpe2nodexp-mysqld.service]
  -    monitoring_critical      => False
  -    ensure                   => absent
  -    unit_type                => timer
  -    monitoring_contact_group => admins
  -    service_params           => {}
  

• Monitoring::Service[mariadb_replica_sql_state_s1]

  Parameters differences:

  --- Monitoring::Service[mariadb_replica_sql_state_s1].orig
  +++ Monitoring::Service[mariadb_replica_sql_state_s1]
  
  -    description    => MariaDB Replica SQL: s1
  -    config_dir     => /etc/nagios
  -    migration_task => T315866
  -    critical       => False
  -    check_interval => 1
  -    contact_group  => admins
  -    freshness      => 36000
  -    ensure         => present
  -    retry_interval => 1
  -    passive        => False
  -    host           => db2141
  -    notes_url      => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica
  -    check_command  => nrpe_check!check_mariadb_replica_sql_state_s1!10
  -    retries        => 3
  

• File[/etc/mysql/ssl/client-cert.pem]

  Parameters differences:

  --- File[/etc/mysql/ssl/client-cert.pem].orig
  +++ File[/etc/mysql/ssl/client-cert.pem]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• Exec[systemd daemon-reload for nrpe2nodexp-mysqld.service (nrpe2nodexp-mysqld.service)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mysqld.service (nrpe2nodexp-mysqld.service)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mysqld.service (nrpe2nodexp-mysqld.service)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Class[Adduser]

  Parameters differences:

  --- Class[Adduser].orig
  +++ Class[Adduser]
  
  @@
  -    before => ['Package[puppet]', 'Package[facter]', 'Package[augeas-tools]', 'Package[virt-what]', 'Package[puppet-module-puppetlabs-augeas-core]', 'Package[python3-prometheus-client]', 'Package[python3-yaml]', 'Package[ruby-net-ssh]', 'Package[openssl]', 'Package[ssl-cert]', 'Package[ca-certificates]', 'Package[wmf-certificates]', 'Package[ntp]', 'Package[systemd-timesyncd]', 'Package[exim4-config]', 'Package[exim4-daemon-light]', 'Package[logrotate]', 'Package[prometheus-node-exporter]', 'Package[bsdutils]', 'Package[smartmontools]', 'Package[rsyslog]', 'Package[rsyslog-openssl]', 'Package[cadvisor]', 'Package[prometheus-ethtool-exporter]', 'Package[acct]', 'Package[byobu]', 'Package[colordiff]', 'Package[curl]', 'Package[debian-goodies]', 'Package[ethtool]', 'Package[gdb]', 'Package[gdisk]', 'Package[git]', 'Package[htop]', 'Package[httpry]', 'Package[iotop]', 'Package[iperf]', 'Package[jq]', 'Package[libtemplate-perl]', 'Package[lldpd]', 'Package[lshw]', 'Package[molly-guard]', 'Package[moreutils]', 'Package[net-tools]', 'Package[numactl]', 'Package[ncdu]', 'Package[ngrep]', 'Package[pigz]', 'Package[psmisc]', 'Package[pv]', 'Package[python3]', 'Package[screen]', 'Package[strace]', 'Package[sysstat]', 'Package[tcpdump]', 'Package[tmux]', 'Package[tree]', 'Package[vim]', 'Package[vim-addon-manager]', 'Package[vim-scripts]', 'Package[wipe]', 'Package[xfsprogs]', 'Package[zsh]', 'Package[icdiff]', 'Package[linux-perf]', 'Package[bsd-mailx]', 'Package[ack]', 'Package[netcat-openbsd]', 'Package[tshark]', 'Package[fzf]', 'Package[ripgrep]', 'Package[fd-find]', 'Package[kitty-terminfo]', 'Package[mtr-tiny]', 'Package[bat]', 'Package[efibootmgr]', 'Package[bind9-dnsutils]', 'Package[tzdata]', 'Package[python3-wmflib]', 'Package[ruby-sorted-set]', 'Package[btop]', 'Package[dstat]', 'Package[apport]', 'Package[command-not-found]', 'Package[command-not-found-data]', 'Package[ecryptfs-utils]', 'Package[mlocate]', 'Package[os-prober]', 'Package[python3-apport]', 'Package[wpasupplicant]', 'Package[atop]', 'Package[apt-listchanges]', 'Package[isc-dhcp-client]', 'Package[rasdaemon]', 'Package[libicu67]', 'Package[libwsutil12]', 'Package[libwireshark14]', 'Package[libopencsd0]', 'Package[libwiretap11]', 'Package[ruby2.7]', 'Package[python3.9-minimal]', 'Package[python3.9]', 'Package[perl-modules-5.32]', 'Package[libpython3.9]', 'Package[libperl5.32]', 'Package[libpython3.9-minimal]', 'Package[libpython3.9-stdlib]', 'Package[libidn11]', 'Package[libldap-2.4-2]', 'Package[liburing1]', 'Package[libwebp6]', 'Package[libcbor0]', 'Package[libusb-0.1-4]', 'Package[telnet]', 'Package[libruby2.7]', 'Package[libdns-export1110]', 'Package[libisc-export1105]', 'Package[libbpf0]', 'Package[openssh-client]', 'Package[openssh-server]', 'Package[debdeploy-client]', 'Package[python3-dateutil]', 'Package[sudo]', 'Package[golang-cfssl]', 'Package[debmonitor-client]', 'Package[megacli]', 'Package[nagios-nrpe-server]', 'Package[monitoring-plugins]', 'Package[monitoring-plugins-basic]', 'Package[monitoring-plugins-standard]', 'Package[liburiparser1]', 'Package[python3-attr]', 'Package[iucode-tool]', 'Package[freeipmi-tools]', 'Package[freeipmi-ipmiseld]', 'Package[rsyslog-kafka]', 'Package[emacs-nox]', 'Package[prometheus-ipmi-exporter]', 'Package[libnet-dns-perl]', 'Package[iptables]', 'Package[ferm]', 'Package[ulogd2]', 'Package[conntrack]', 'Package[wmf-mariadb1011]', 'Package[percona-toolkit]', 'Package[grc]', 'Package[mariadb-backup]', 'Package[python3-wmfmariadbpy]', 'Package[wmfmariadbpy-common]', 'Package[monitoring-plugins-contrib]', 'Package[prometheus-rsyslog-exporter]', 'Package[initramfs-tools]', 'Package[python3-click]', 'Package[python3-box]', 'Package[confd]', 'Package[python3-toml]', 'Package[prometheus-mysqld-exporter]']
  +    before => ['Package[puppet]', 'Package[facter]', 'Package[augeas-tools]', 'Package[virt-what]', 'Package[puppet-module-puppetlabs-augeas-core]', 'Package[python3-prometheus-client]', 'Package[python3-yaml]', 'Package[ruby-net-ssh]', 'Package[openssl]', 'Package[ssl-cert]', 'Package[ca-certificates]', 'Package[wmf-certificates]', 'Package[ntp]', 'Package[systemd-timesyncd]', 'Package[exim4-config]', 'Package[exim4-daemon-light]', 'Package[logrotate]', 'Package[prometheus-node-exporter]', 'Package[bsdutils]', 'Package[smartmontools]', 'Package[rsyslog]', 'Package[rsyslog-openssl]', 'Package[cadvisor]', 'Package[prometheus-ethtool-exporter]', 'Package[acct]', 'Package[byobu]', 'Package[colordiff]', 'Package[curl]', 'Package[debian-goodies]', 'Package[ethtool]', 'Package[gdb]', 'Package[gdisk]', 'Package[git]', 'Package[htop]', 'Package[httpry]', 'Package[iotop]', 'Package[iperf]', 'Package[jq]', 'Package[libtemplate-perl]', 'Package[lldpd]', 'Package[lshw]', 'Package[molly-guard]', 'Package[moreutils]', 'Package[net-tools]', 'Package[numactl]', 'Package[ncdu]', 'Package[ngrep]', 'Package[pigz]', 'Package[psmisc]', 'Package[pv]', 'Package[python3]', 'Package[screen]', 'Package[strace]', 'Package[sysstat]', 'Package[tcpdump]', 'Package[tmux]', 'Package[tree]', 'Package[vim]', 'Package[vim-addon-manager]', 'Package[vim-scripts]', 'Package[wipe]', 'Package[xfsprogs]', 'Package[zsh]', 'Package[icdiff]', 'Package[linux-perf]', 'Package[bsd-mailx]', 'Package[ack]', 'Package[netcat-openbsd]', 'Package[tshark]', 'Package[fzf]', 'Package[ripgrep]', 'Package[fd-find]', 'Package[kitty-terminfo]', 'Package[mtr-tiny]', 'Package[bat]', 'Package[efibootmgr]', 'Package[bind9-dnsutils]', 'Package[tzdata]', 'Package[python3-wmflib]', 'Package[ruby-sorted-set]', 'Package[btop]', 'Package[dstat]', 'Package[apport]', 'Package[command-not-found]', 'Package[command-not-found-data]', 'Package[ecryptfs-utils]', 'Package[mlocate]', 'Package[os-prober]', 'Package[python3-apport]', 'Package[wpasupplicant]', 'Package[atop]', 'Package[apt-listchanges]', 'Package[isc-dhcp-client]', 'Package[rasdaemon]', 'Package[libicu67]', 'Package[libwsutil12]', 'Package[libwireshark14]', 'Package[libopencsd0]', 'Package[libwiretap11]', 'Package[ruby2.7]', 'Package[python3.9-minimal]', 'Package[python3.9]', 'Package[perl-modules-5.32]', 'Package[libpython3.9]', 'Package[libperl5.32]', 'Package[libpython3.9-minimal]', 'Package[libpython3.9-stdlib]', 'Package[libidn11]', 'Package[libldap-2.4-2]', 'Package[liburing1]', 'Package[libwebp6]', 'Package[libcbor0]', 'Package[libusb-0.1-4]', 'Package[telnet]', 'Package[libruby2.7]', 'Package[libdns-export1110]', 'Package[libisc-export1105]', 'Package[libbpf0]', 'Package[openssh-client]', 'Package[openssh-server]', 'Package[debdeploy-client]', 'Package[python3-dateutil]', 'Package[sudo]', 'Package[golang-cfssl]', 'Package[debmonitor-client]', 'Package[megacli]', 'Package[nagios-nrpe-server]', 'Package[monitoring-plugins]', 'Package[monitoring-plugins-basic]', 'Package[monitoring-plugins-standard]', 'Package[liburiparser1]', 'Package[python3-attr]', 'Package[iucode-tool]', 'Package[freeipmi-tools]', 'Package[freeipmi-ipmiseld]', 'Package[rsyslog-kafka]', 'Package[emacs-nox]', 'Package[prometheus-ipmi-exporter]', 'Package[libnet-dns-perl]', 'Package[iptables]', 'Package[ferm]', 'Package[ulogd2]', 'Package[conntrack]', 'Package[prometheus-rsyslog-exporter]', 'Package[initramfs-tools]', 'Package[python3-click]', 'Package[python3-box]', 'Package[confd]', 'Package[python3-toml]']
  

• Sudo::User[nrpe-check_mysqld]

  Parameters differences:

  --- Sudo::User[nrpe-check_mysqld].orig
  +++ Sudo::User[nrpe-check_mysqld]
  
  -    ensure     => absent
  -    user       => nagios
  -    tag        => nrpe::check
  -    privileges => []
  -    require    => ['Class[Sudo]']
  

• Nrpe::Monitor_service[mariadb_read_only_s1]

  Parameters differences:

  --- Nrpe::Monitor_service[mariadb_read_only_s1].orig
  +++ Nrpe::Monitor_service[mariadb_read_only_s1]
  
  -    description                 => MariaDB read only s1
  -    migration_task              => T315866
  -    nrpe2nodexp_parse_perf_data => False
  -    ensure                      => present
  -    enable_nrpe2nodexp          => False
  -    notes_url                   => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Master_comes_back_in_read_only
  -    retries                     => 3
  -    enable_icinga_check         => True
  -    critical                    => False
  -    check_interval              => 1
  -    contact_group               => admins
  -    alertmanager_team           => observability
  -    require                     => Package[wmfmariadbpy-common]
  -    retry_interval              => 1
  -    timeout                     => 10
  -    nrpe_command                => db-check-health --port=3311 --icinga --check_read_only=1 --process
  

• Firewall::Service[s1_orchestrator]

  Parameters differences:

  --- Firewall::Service[s1_orchestrator].orig
  +++ Firewall::Service[s1_orchestrator]
  
  -    srange              => ['dborch1001.wikimedia.org', 'dborch1002.wikimedia.org', 'dborch1003.eqiad.wmnet']
  -    proto               => tcp
  -    prio                => 10
  -    port                => [3311]
  -    ensure              => present
  -    unrestricted_access => False
  -    notrack             => True
  -    desc                => 
  

• File[/etc/update-motd.d/05-mariadb--backup-source]

  Parameters differences:

  --- File[/etc/update-motd.d/05-mariadb--backup-source].orig
  +++ File[/etc/update-motd.d/05-mariadb--backup-source]
  
  -    mode   => 0555
  -    ensure => present
  -    owner  => root
  -    group  => root
  

  Content differences:

  --- /etc/update-motd.d/05-mariadb--backup-source.orig
  +++ /etc/update-motd.d/05-mariadb--backup-source
  @@ -1,2 +0,0 @@
  -#!/bin/sh
  -printf "%s\n" "db2141 is a MariaDB server containing replicas of mediawiki databases used to generate backups (mariadb::backup_source)"

• Nrpe::Check[check_mariadb_replica_io_state_s1]

  Parameters differences:

  --- Nrpe::Check[check_mariadb_replica_io_state_s1].orig
  +++ Nrpe::Check[check_mariadb_replica_io_state_s1]
  
  -    ensure  => present
  -    before  => Monitoring::Service[mariadb_replica_io_state_s1]
  -    command => /usr/local/lib/nagios/plugins/check_mariadb --sock=/run/mysqld/mysqld.s1.sock --user=nagios --pass=  --warn-stopped --check=slave_io_state
  

• File_line[auto_restart_file_presence_prometheus-mysqld-exporter@s1]

  Parameters differences:

  --- File_line[auto_restart_file_presence_prometheus-mysqld-exporter@s1].orig
  +++ File_line[auto_restart_file_presence_prometheus-mysqld-exporter@s1]
  
  -    ensure  => present
  -    line    => prometheus-mysqld-exporter@s1
  -    require => File[/etc/debdeploy-client/autorestarts.conf]
  -    path    => /etc/debdeploy-client/autorestarts.conf
  

• File[/lib/systemd/system/nrpe2nodexp-mysqld.timer]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mysqld.timer].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mysqld.timer]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mysqld.timer (nrpe2nodexp-mysqld.timer)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mysqld.timer.orig
  +++ /lib/systemd/system/nrpe2nodexp-mysqld.timer
  @@ -1,14 +0,0 @@
  -[Unit]
  -Description=Periodic execution of nrpe2nodexp-mysqld.service
  -
  -[Timer]
  -Unit=nrpe2nodexp-mysqld.service
  -# Accuracy sets the maximum time interval around the execution time we want to allow
  -AccuracySec=15sec
  -OnUnitInactiveSec=1min
  -OnActiveSec=1s
  -RandomizedDelaySec=60
  -FixedRandomDelay=true
  -
  -[Install]
  -WantedBy=multi-user.target

• Nrpe::Monitor_service[mariadb_disk_space]

  Parameters differences:

  --- Nrpe::Monitor_service[mariadb_disk_space].orig
  +++ Nrpe::Monitor_service[mariadb_disk_space]
  
  -    description                 => MariaDB disk space
  -    migration_task              => T315866
  -    nrpe2nodexp_parse_perf_data => False
  -    enable_icinga_check         => True
  -    critical                    => False
  -    check_interval              => 1
  -    contact_group               => admins
  -    alertmanager_team           => observability
  -    retries                     => 3
  -    ensure                      => present
  -    retry_interval              => 1
  -    enable_nrpe2nodexp          => False
  -    timeout                     => 10
  -    notes_url                   => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting
  -    nrpe_command                => /usr/lib/nagios/plugins/check_disk -w 10% -c 5% -l -e --exclude-type=tracefs --exclude-type=tmpfs --exclude-type=ramfs --exclude-type=devtmpfs
  

• Class[Profile::Apt]

  Parameters differences:

  --- Class[Profile::Apt].orig
  +++ Class[Profile::Apt]
  
  @@
  -    before => ['Package[puppet]', 'Package[facter]', 'Package[augeas-tools]', 'Package[virt-what]', 'Package[puppet-module-puppetlabs-augeas-core]', 'Package[python3-prometheus-client]', 'Package[python3-yaml]', 'Package[ruby-net-ssh]', 'Package[openssl]', 'Package[ssl-cert]', 'Package[ca-certificates]', 'Package[wmf-certificates]', 'Package[ntp]', 'Package[systemd-timesyncd]', 'Package[exim4-config]', 'Package[exim4-daemon-light]', 'Package[logrotate]', 'Package[prometheus-node-exporter]', 'Package[bsdutils]', 'Package[smartmontools]', 'Package[rsyslog]', 'Package[rsyslog-openssl]', 'Package[cadvisor]', 'Package[prometheus-ethtool-exporter]', 'Package[acct]', 'Package[byobu]', 'Package[colordiff]', 'Package[curl]', 'Package[debian-goodies]', 'Package[ethtool]', 'Package[gdb]', 'Package[gdisk]', 'Package[git]', 'Package[htop]', 'Package[httpry]', 'Package[iotop]', 'Package[iperf]', 'Package[jq]', 'Package[libtemplate-perl]', 'Package[lldpd]', 'Package[lshw]', 'Package[molly-guard]', 'Package[moreutils]', 'Package[net-tools]', 'Package[numactl]', 'Package[ncdu]', 'Package[ngrep]', 'Package[pigz]', 'Package[psmisc]', 'Package[pv]', 'Package[python3]', 'Package[screen]', 'Package[strace]', 'Package[sysstat]', 'Package[tcpdump]', 'Package[tmux]', 'Package[tree]', 'Package[vim]', 'Package[vim-addon-manager]', 'Package[vim-scripts]', 'Package[wipe]', 'Package[xfsprogs]', 'Package[zsh]', 'Package[icdiff]', 'Package[linux-perf]', 'Package[bsd-mailx]', 'Package[ack]', 'Package[netcat-openbsd]', 'Package[tshark]', 'Package[fzf]', 'Package[ripgrep]', 'Package[fd-find]', 'Package[kitty-terminfo]', 'Package[mtr-tiny]', 'Package[bat]', 'Package[efibootmgr]', 'Package[bind9-dnsutils]', 'Package[tzdata]', 'Package[python3-wmflib]', 'Package[ruby-sorted-set]', 'Package[btop]', 'Package[dstat]', 'Package[apport]', 'Package[command-not-found]', 'Package[command-not-found-data]', 'Package[ecryptfs-utils]', 'Package[mlocate]', 'Package[os-prober]', 'Package[python3-apport]', 'Package[wpasupplicant]', 'Package[atop]', 'Package[apt-listchanges]', 'Package[isc-dhcp-client]', 'Package[rasdaemon]', 'Package[libicu67]', 'Package[libwsutil12]', 'Package[libwireshark14]', 'Package[libopencsd0]', 'Package[libwiretap11]', 'Package[ruby2.7]', 'Package[python3.9-minimal]', 'Package[python3.9]', 'Package[perl-modules-5.32]', 'Package[libpython3.9]', 'Package[libperl5.32]', 'Package[libpython3.9-minimal]', 'Package[libpython3.9-stdlib]', 'Package[libidn11]', 'Package[libldap-2.4-2]', 'Package[liburing1]', 'Package[libwebp6]', 'Package[libcbor0]', 'Package[libusb-0.1-4]', 'Package[telnet]', 'Package[libruby2.7]', 'Package[libdns-export1110]', 'Package[libisc-export1105]', 'Package[libbpf0]', 'Package[openssh-client]', 'Package[openssh-server]', 'Package[debdeploy-client]', 'Package[python3-dateutil]', 'Package[sudo]', 'Package[golang-cfssl]', 'Package[debmonitor-client]', 'Package[megacli]', 'Package[nagios-nrpe-server]', 'Package[monitoring-plugins]', 'Package[monitoring-plugins-basic]', 'Package[monitoring-plugins-standard]', 'Package[liburiparser1]', 'Package[python3-attr]', 'Package[iucode-tool]', 'Package[freeipmi-tools]', 'Package[freeipmi-ipmiseld]', 'Package[rsyslog-kafka]', 'Package[emacs-nox]', 'Package[prometheus-ipmi-exporter]', 'Package[libnet-dns-perl]', 'Package[iptables]', 'Package[ferm]', 'Package[ulogd2]', 'Package[conntrack]', 'Package[wmf-mariadb1011]', 'Package[percona-toolkit]', 'Package[grc]', 'Package[mariadb-backup]', 'Package[python3-wmfmariadbpy]', 'Package[wmfmariadbpy-common]', 'Package[monitoring-plugins-contrib]', 'Package[prometheus-rsyslog-exporter]', 'Package[initramfs-tools]', 'Package[python3-click]', 'Package[python3-box]', 'Package[confd]', 'Package[python3-toml]', 'Package[prometheus-mysqld-exporter]']
  +    before => ['Package[puppet]', 'Package[facter]', 'Package[augeas-tools]', 'Package[virt-what]', 'Package[puppet-module-puppetlabs-augeas-core]', 'Package[python3-prometheus-client]', 'Package[python3-yaml]', 'Package[ruby-net-ssh]', 'Package[openssl]', 'Package[ssl-cert]', 'Package[ca-certificates]', 'Package[wmf-certificates]', 'Package[ntp]', 'Package[systemd-timesyncd]', 'Package[exim4-config]', 'Package[exim4-daemon-light]', 'Package[logrotate]', 'Package[prometheus-node-exporter]', 'Package[bsdutils]', 'Package[smartmontools]', 'Package[rsyslog]', 'Package[rsyslog-openssl]', 'Package[cadvisor]', 'Package[prometheus-ethtool-exporter]', 'Package[acct]', 'Package[byobu]', 'Package[colordiff]', 'Package[curl]', 'Package[debian-goodies]', 'Package[ethtool]', 'Package[gdb]', 'Package[gdisk]', 'Package[git]', 'Package[htop]', 'Package[httpry]', 'Package[iotop]', 'Package[iperf]', 'Package[jq]', 'Package[libtemplate-perl]', 'Package[lldpd]', 'Package[lshw]', 'Package[molly-guard]', 'Package[moreutils]', 'Package[net-tools]', 'Package[numactl]', 'Package[ncdu]', 'Package[ngrep]', 'Package[pigz]', 'Package[psmisc]', 'Package[pv]', 'Package[python3]', 'Package[screen]', 'Package[strace]', 'Package[sysstat]', 'Package[tcpdump]', 'Package[tmux]', 'Package[tree]', 'Package[vim]', 'Package[vim-addon-manager]', 'Package[vim-scripts]', 'Package[wipe]', 'Package[xfsprogs]', 'Package[zsh]', 'Package[icdiff]', 'Package[linux-perf]', 'Package[bsd-mailx]', 'Package[ack]', 'Package[netcat-openbsd]', 'Package[tshark]', 'Package[fzf]', 'Package[ripgrep]', 'Package[fd-find]', 'Package[kitty-terminfo]', 'Package[mtr-tiny]', 'Package[bat]', 'Package[efibootmgr]', 'Package[bind9-dnsutils]', 'Package[tzdata]', 'Package[python3-wmflib]', 'Package[ruby-sorted-set]', 'Package[btop]', 'Package[dstat]', 'Package[apport]', 'Package[command-not-found]', 'Package[command-not-found-data]', 'Package[ecryptfs-utils]', 'Package[mlocate]', 'Package[os-prober]', 'Package[python3-apport]', 'Package[wpasupplicant]', 'Package[atop]', 'Package[apt-listchanges]', 'Package[isc-dhcp-client]', 'Package[rasdaemon]', 'Package[libicu67]', 'Package[libwsutil12]', 'Package[libwireshark14]', 'Package[libopencsd0]', 'Package[libwiretap11]', 'Package[ruby2.7]', 'Package[python3.9-minimal]', 'Package[python3.9]', 'Package[perl-modules-5.32]', 'Package[libpython3.9]', 'Package[libperl5.32]', 'Package[libpython3.9-minimal]', 'Package[libpython3.9-stdlib]', 'Package[libidn11]', 'Package[libldap-2.4-2]', 'Package[liburing1]', 'Package[libwebp6]', 'Package[libcbor0]', 'Package[libusb-0.1-4]', 'Package[telnet]', 'Package[libruby2.7]', 'Package[libdns-export1110]', 'Package[libisc-export1105]', 'Package[libbpf0]', 'Package[openssh-client]', 'Package[openssh-server]', 'Package[debdeploy-client]', 'Package[python3-dateutil]', 'Package[sudo]', 'Package[golang-cfssl]', 'Package[debmonitor-client]', 'Package[megacli]', 'Package[nagios-nrpe-server]', 'Package[monitoring-plugins]', 'Package[monitoring-plugins-basic]', 'Package[monitoring-plugins-standard]', 'Package[liburiparser1]', 'Package[python3-attr]', 'Package[iucode-tool]', 'Package[freeipmi-tools]', 'Package[freeipmi-ipmiseld]', 'Package[rsyslog-kafka]', 'Package[emacs-nox]', 'Package[prometheus-ipmi-exporter]', 'Package[libnet-dns-perl]', 'Package[iptables]', 'Package[ferm]', 'Package[ulogd2]', 'Package[conntrack]', 'Package[prometheus-rsyslog-exporter]', 'Package[initramfs-tools]', 'Package[python3-click]', 'Package[python3-box]', 'Package[confd]', 'Package[python3-toml]']
  

• Sudo::User[nrpe-check_mariadb_disk_space]

  Parameters differences:

  --- Sudo::User[nrpe-check_mariadb_disk_space].orig
  +++ Sudo::User[nrpe-check_mariadb_disk_space]
  
  -    ensure     => absent
  -    user       => nagios
  -    tag        => nrpe::check
  -    privileges => []
  -    require    => ['Class[Sudo]']
  

• File[/usr/local/bin/mbstream]

  Parameters differences:

  --- File[/usr/local/bin/mbstream].orig
  +++ File[/usr/local/bin/mbstream]
  
  -    owner   => root
  -    ensure  => link
  -    group   => root
  -    require => Package[wmf-mariadb1011]
  -    target  => /opt/wmf-mariadb1011/bin/mbstream
  

• Monitoring::Exported_nagios_host[db2141]

  Parameters differences:

  --- Monitoring::Exported_nagios_host[db2141].orig
  +++ Monitoring::Exported_nagios_host[db2141]
  
  @@
  -    notifications_enabled => 1
  +    notifications_enabled => 0
  

• File[/lib/systemd/system/prometheus-mysqld-exporter@.service]

  Parameters differences:

  --- File[/lib/systemd/system/prometheus-mysqld-exporter@.service].orig
  +++ File[/lib/systemd/system/prometheus-mysqld-exporter@.service]
  
  -    owner  => root
  -    ensure => present
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for prometheus-mysqld-exporter@.service (prometheus-mysqld-exporter@)]
  

  Content differences:

  --- /lib/systemd/system/prometheus-mysqld-exporter@.service.orig
  +++ /lib/systemd/system/prometheus-mysqld-exporter@.service
  @@ -1,18 +0,0 @@
  -[Unit]
  -Description=Prometheus exporter for MySQL (instance %i)
  -Documentation=https://prometheus.io/docs/introduction/overview/
  -ConditionPathExists=/etc/default/prometheus-mysqld-exporter@%i
  -#Ensure the exporter is (re-)started and stopped with the relevant
  -#mariadb instance
  -After=mariadb@%i.service
  -Requisite=mariadb@%i.service
  -
  -[Service]
  -Restart=always
  -User=prometheus
  -Group=prometheus
  -EnvironmentFile=/etc/default/prometheus-mysqld-exporter@%i
  -ExecStart=/usr/bin/prometheus-mysqld-exporter $ARGS
  -
  -[Install]
  -WantedBy=multi-user.target

• File[/usr/local/etc/my.cnf]

  Parameters differences:

  --- File[/usr/local/etc/my.cnf].orig
  +++ File[/usr/local/etc/my.cnf]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• Nrpe::Monitor_service[mariadb_replica_sql_lag_s1]

  Parameters differences:

  --- Nrpe::Monitor_service[mariadb_replica_sql_lag_s1].orig
  +++ Nrpe::Monitor_service[mariadb_replica_sql_lag_s1]
  
  -    description                 => MariaDB Replica Lag: s1
  -    nrpe_command                => /usr/local/lib/nagios/plugins/check_mariadb --sock=/run/mysqld/mysqld.s1.sock --user=nagios --pass=  --warn-stopped --check=slave_sql_lag                            --shard=s1 --datacenter=eqiad                            --sql-lag-warn=60                            --sql-lag-crit=300
  -    migration_task              => T315866
  -    nrpe2nodexp_parse_perf_data => False
  -    enable_icinga_check         => True
  -    critical                    => False
  -    check_interval              => 1
  -    contact_group               => admins
  -    alertmanager_team           => observability
  -    ensure                      => present
  -    retry_interval              => 1
  -    enable_nrpe2nodexp          => False
  -    timeout                     => 10
  -    notes_url                   => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica
  -    retries                     => 10
  

• Nrpe::Check[check_mariadb_replica_sql_state_s1]

  Parameters differences:

  --- Nrpe::Check[check_mariadb_replica_sql_state_s1].orig
  +++ Nrpe::Check[check_mariadb_replica_sql_state_s1]
  
  -    ensure  => present
  -    before  => Monitoring::Service[mariadb_replica_sql_state_s1]
  -    command => /usr/local/lib/nagios/plugins/check_mariadb --sock=/run/mysqld/mysqld.s1.sock --user=nagios --pass=  --warn-stopped --check=slave_sql_state
  

• File[/etc/mysql/ssl]

  Parameters differences:

  --- File[/etc/mysql/ssl].orig
  +++ File[/etc/mysql/ssl]
  
  -    owner  => mysql
  -    ensure => directory
  -    mode   => 0555
  -    group  => mysql
  

• File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-io-state-s1.conf]

  Parameters differences:

  --- File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-io-state-s1.conf].orig
  +++ File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-io-state-s1.conf]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Service[rsyslog]
  

  Content differences:

  --- /etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-io-state-s1.conf.orig
  +++ /etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-io-state-s1.conf
  @@ -1,10 +0,0 @@
  -# SPDX-License-Identifier: Apache-2.0
  -if $programname contains "nrpe2nodexp-mariadb_replica_io_state_s1" then {
  -    if ($msg contains "\"ecs.version\": \"1.7.0\"") then {
  -        # Send logs to kafka
  -        set $.log_outputs = "kafka ecs_170 local";
  -    } else {
  -        # Filter out non-relevant nrpe2nodexp messages
  -        stop
  -    }
  -}

• File[/lib/systemd/system/wmf_auto_restart_prometheus-mysqld-exporter@s1.timer]

  Parameters differences:

  --- File[/lib/systemd/system/wmf_auto_restart_prometheus-mysqld-exporter@s1.timer].orig
  +++ File[/lib/systemd/system/wmf_auto_restart_prometheus-mysqld-exporter@s1.timer]
  
  -    owner  => root
  -    ensure => present
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for wmf_auto_restart_prometheus-mysqld-exporter@s1.timer (wmf_auto_restart_prometheus-mysqld-exporter@s1.timer)]
  

  Content differences:

  --- /lib/systemd/system/wmf_auto_restart_prometheus-mysqld-exporter@s1.timer.orig
  +++ /lib/systemd/system/wmf_auto_restart_prometheus-mysqld-exporter@s1.timer
  @@ -1,12 +0,0 @@
  -[Unit]
  -Description=Periodic execution of wmf_auto_restart_prometheus-mysqld-exporter@s1.service
  -
  -[Timer]
  -Unit=wmf_auto_restart_prometheus-mysqld-exporter@s1.service
  -# Accuracy sets the maximum time interval around the execution time we want to allow
  -AccuracySec=15sec
  -OnCalendar=Mon,Tue,Wed,Thu,Fri *-*-* 3:10:00
  -RandomizedDelaySec=0
  -
  -[Install]
  -WantedBy=multi-user.target

• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_state_s1.service (nrpe2nodexp-mariadb_replica_sql_state_s1.service)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_state_s1.service (nrpe2nodexp-mariadb_replica_sql_state_s1.service)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_state_s1.service (nrpe2nodexp-mariadb_replica_sql_state_s1.service)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Nrpe::Monitor_service[mariadb_replica_sql_state_s1]

  Parameters differences:

  --- Nrpe::Monitor_service[mariadb_replica_sql_state_s1].orig
  +++ Nrpe::Monitor_service[mariadb_replica_sql_state_s1]
  
  -    description                 => MariaDB Replica SQL: s1
  -    migration_task              => T315866
  -    nrpe2nodexp_parse_perf_data => False
  -    enable_icinga_check         => True
  -    critical                    => False
  -    check_interval              => 1
  -    contact_group               => admins
  -    alertmanager_team           => observability
  -    retries                     => 3
  -    ensure                      => present
  -    retry_interval              => 1
  -    enable_nrpe2nodexp          => False
  -    timeout                     => 10
  -    notes_url                   => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica
  -    nrpe_command                => /usr/local/lib/nagios/plugins/check_mariadb --sock=/run/mysqld/mysqld.s1.sock --user=nagios --pass=  --warn-stopped --check=slave_sql_state
  

• File[/etc/sudoers.d/nrpe-check_mariadb_replica_sql_state_s1]

  Parameters differences:

  --- File[/etc/sudoers.d/nrpe-check_mariadb_replica_sql_state_s1].orig
  +++ File[/etc/sudoers.d/nrpe-check_mariadb_replica_sql_state_s1]
  
  -    owner   => root
  -    ensure  => absent
  -    group   => root
  -    require => Package[nagios-nrpe-server]
  

• Nrpe::Check[check_mariadb_memory]

  Parameters differences:

  --- Nrpe::Check[check_mariadb_memory].orig
  +++ Nrpe::Check[check_mariadb_memory]
  
  -    ensure  => present
  -    before  => Monitoring::Service[mariadb_memory]
  -    command => /usr/lib/nagios/plugins/pmp-check-unix-memory -c 95 -w 90
  

• Systemd::Timer[nrpe2nodexp-mariadb_read_only_s1]

  Parameters differences:

  --- Systemd::Timer[nrpe2nodexp-mariadb_read_only_s1].orig
  +++ Systemd::Timer[nrpe2nodexp-mariadb_read_only_s1]
  
  -    ensure             => absent
  -    unit_name          => nrpe2nodexp-mariadb_read_only_s1.service
  -    timer_intervals    => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}, {'interval': '1s', 'start': 'OnActiveSec'}]
  -    accuracy           => 15sec
  -    splay              => 60
  -    fixed_random_delay => True
  

• File[/etc/mysql/ssl/server-key.pem]

  Parameters differences:

  --- File[/etc/mysql/ssl/server-key.pem].orig
  +++ File[/etc/mysql/ssl/server-key.pem]
  
  -    owner     => root
  -    ensure    => file
  -    show_diff => False
  -    group     => mysql
  -    mode      => 0440
  -    backup    => False
  

• Systemd::Timer::Job[nrpe2nodexp-mariadb_replica_io_state_s1]

  Parameters differences:

  --- Systemd::Timer::Job[nrpe2nodexp-mariadb_replica_io_state_s1].orig
  +++ Systemd::Timer::Job[nrpe2nodexp-mariadb_replica_io_state_s1]
  
  -    monitoring_enabled        => False
  -    description               => execution of nrpe2nodexp for the check_mariadb_replica_io_state_s1 command.
  -    syslog_match_startswith   => True
  -    ensure                    => absent
  -    user                      => nagios
  -    interval                  => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}]
  -    send_mail_to              => root@db2141.codfw.wmnet
  -    logfile_basedir           => /var/log
  -    private_tmp               => False
  -    success_exit_status       => []
  -    send_mail_only_on_error   => True
  -    ignore_errors             => True
  -    logfile_name              => syslog.log
  -    command                   => /usr/local/bin/nrpe2nodexp --alert-rule-hash "0d5979f7abbb49256cfedd70a646784e" --timeout 10 --check-command "check_mariadb_replica_io_state_s1"
  -    syslog_identifier         => nrpe2nodexp-mariadb_replica_io_state_s1
  -    monitoring_notes_url      => https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -    logfile_perms             => all
  -    syslog_force_stop         => True
  -    splay                     => 60
  -    logfile_group             => root
  -    group                     => prometheus-node-exporter
  -    send_mail                 => False
  -    logging_enabled           => False
  -    environment               => {}
  -    monitoring_contact_groups => admins
  -    fixed_random_delay        => True
  

• Class[Profile::Base::Production]

  Parameters differences:

  --- Class[Profile::Base::Production].orig
  +++ Class[Profile::Base::Production]
  
  @@
  -    role_description => MariaDB server containing replicas of mediawiki databases used to generate backups
  +    role_description => Host being setup by Data Persistence SREs
  

• Logrotate::Conf[wmf_auto_restart_prometheus-mysqld-exporter_s1]

  Parameters differences:

  --- Logrotate::Conf[wmf_auto_restart_prometheus-mysqld-exporter_s1].orig
  +++ Logrotate::Conf[wmf_auto_restart_prometheus-mysqld-exporter_s1]
  
  -    ensure => present
  

• Rsyslog::Conf[nrpe2nodexp-mariadb_disk_space]

  Parameters differences:

  --- Rsyslog::Conf[nrpe2nodexp-mariadb_disk_space].orig
  +++ Rsyslog::Conf[nrpe2nodexp-mariadb_disk_space]
  
  -    mode     => 0444
  -    ensure   => absent
  -    priority => 25
  

• Mariadb::Instance[s1]

  Parameters differences:

  --- Mariadb::Instance[s1].orig
  +++ Mariadb::Instance[s1]
  
  -    event_scheduler         => 1
  -    source_dc               => eqiad
  -    socket                  => undefined
  -    read_only               => 1
  -    innodb_buffer_pool_size => 192G
  -    datadir                 => undefined
  -    port                    => 3311
  -    is_critical             => False
  -    mysqld_extra_configs    => {}
  -    tmpdir                  => undefined
  -    template                => mariadb/instance.cnf.erb
  

• File[/etc/systemd/system/mariadb.service.d]

  Parameters differences:

  --- File[/etc/systemd/system/mariadb.service.d].orig
  +++ File[/etc/systemd/system/mariadb.service.d]
  
  -    mode   => 0755
  -    ensure => directory
  -    owner  => root
  -    group  => root
  

• File[/lib/systemd/system/nrpe2nodexp-mariadb_disk_space.service]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mariadb_disk_space.service].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mariadb_disk_space.service]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mariadb_disk_space.service (nrpe2nodexp-mariadb_disk_space.service)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mariadb_disk_space.service.orig
  +++ /lib/systemd/system/nrpe2nodexp-mariadb_disk_space.service
  @@ -1,11 +0,0 @@
  -[Unit]
  -Description=execution of nrpe2nodexp for the check_mariadb_disk_space command.
  -Documentation=https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -
  -[Service]
  -Type=oneshot
  -User=nagios
  -
  -Group=prometheus-node-exporter
  -SyslogIdentifier=nrpe2nodexp-mariadb_disk_space
  -ExecStart=-/usr/local/bin/nrpe2nodexp --alert-rule-hash "d2aae7bfec5549be1a8b9413215bd86c" --timeout 10 --check-command "check_mariadb_disk_space"

• Systemd::Timer::Job[nrpe2nodexp-mysqld]

  Parameters differences:

  --- Systemd::Timer::Job[nrpe2nodexp-mysqld].orig
  +++ Systemd::Timer::Job[nrpe2nodexp-mysqld]
  
  -    monitoring_enabled        => False
  -    description               => execution of nrpe2nodexp for the check_mysqld command.
  -    syslog_match_startswith   => True
  -    ensure                    => absent
  -    user                      => nagios
  -    interval                  => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}]
  -    send_mail_to              => root@db2141.codfw.wmnet
  -    logfile_basedir           => /var/log
  -    private_tmp               => False
  -    success_exit_status       => []
  -    send_mail_only_on_error   => True
  -    ignore_errors             => True
  -    logfile_name              => syslog.log
  -    command                   => /usr/local/bin/nrpe2nodexp --alert-rule-hash "ca81db2c9e98d408f9f65c79817da116" --timeout 10 --check-command "check_mysqld"
  -    syslog_identifier         => nrpe2nodexp-mysqld
  -    monitoring_notes_url      => https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -    logfile_perms             => all
  -    syslog_force_stop         => True
  -    splay                     => 60
  -    logfile_group             => root
  -    group                     => prometheus-node-exporter
  -    send_mail                 => False
  -    logging_enabled           => False
  -    environment               => {}
  -    monitoring_contact_groups => admins
  -    fixed_random_delay        => True
  

• Service[nrpe2nodexp-mariadb_disk_space.timer]

  Parameters differences:

  --- Service[nrpe2nodexp-mariadb_disk_space.timer].orig
  +++ Service[nrpe2nodexp-mariadb_disk_space.timer]
  
  -    ensure   => stopped
  -    before   => ['Exec[systemd daemon-reload for nrpe2nodexp-mariadb_disk_space.timer (nrpe2nodexp-mariadb_disk_space.timer)]']
  -    provider => systemd
  -    enable   => False
  

• File[/srv/tmp.s1]

  Parameters differences:

  --- File[/srv/tmp.s1].orig
  +++ File[/srv/tmp.s1]
  
  -    owner  => mysql
  -    ensure => directory
  -    mode   => 0755
  -    group  => mysql
  

• File[/etc/mysql/ssl/server.key]

  Parameters differences:

  --- File[/etc/mysql/ssl/server.key].orig
  +++ File[/etc/mysql/ssl/server.key]
  
  -    owner     => mysql
  -    ensure    => present
  -    show_diff => False
  -    source    => /var/lib/puppet/ssl/private_keys/db2141.codfw.wmnet.pem
  -    group     => mysql
  -    mode      => 0400
  

• File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-sql-state-s1.conf]

  Parameters differences:

  --- File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-sql-state-s1.conf].orig
  +++ File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-sql-state-s1.conf]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Service[rsyslog]
  

  Content differences:

  --- /etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-sql-state-s1.conf.orig
  +++ /etc/rsyslog.d/25-nrpe2nodexp-mariadb-replica-sql-state-s1.conf
  @@ -1,10 +0,0 @@
  -# SPDX-License-Identifier: Apache-2.0
  -if $programname contains "nrpe2nodexp-mariadb_replica_sql_state_s1" then {
  -    if ($msg contains "\"ecs.version\": \"1.7.0\"") then {
  -        # Send logs to kafka
  -        set $.log_outputs = "kafka ecs_170 local";
  -    } else {
  -        # Filter out non-relevant nrpe2nodexp messages
  -        stop
  -    }
  -}

• Monitoring::Service[mariadb_read_only_s1]

  Parameters differences:

  --- Monitoring::Service[mariadb_read_only_s1].orig
  +++ Monitoring::Service[mariadb_read_only_s1]
  
  -    description    => MariaDB read only s1
  -    config_dir     => /etc/nagios
  -    migration_task => T315866
  -    critical       => False
  -    check_interval => 1
  -    contact_group  => admins
  -    freshness      => 36000
  -    ensure         => present
  -    retry_interval => 1
  -    passive        => False
  -    host           => db2141
  -    notes_url      => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Master_comes_back_in_read_only
  -    check_command  => nrpe_check!check_mariadb_read_only_s1!10
  -    retries        => 3
  

• File[/lib/systemd/system/nrpe2nodexp-mariadb_disk_space.timer]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mariadb_disk_space.timer].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mariadb_disk_space.timer]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mariadb_disk_space.timer (nrpe2nodexp-mariadb_disk_space.timer)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mariadb_disk_space.timer.orig
  +++ /lib/systemd/system/nrpe2nodexp-mariadb_disk_space.timer
  @@ -1,14 +0,0 @@
  -[Unit]
  -Description=Periodic execution of nrpe2nodexp-mariadb_disk_space.service
  -
  -[Timer]
  -Unit=nrpe2nodexp-mariadb_disk_space.service
  -# Accuracy sets the maximum time interval around the execution time we want to allow
  -AccuracySec=15sec
  -OnUnitInactiveSec=1min
  -OnActiveSec=1s
  -RandomizedDelaySec=60
  -FixedRandomDelay=true
  -
  -[Install]
  -WantedBy=multi-user.target

• Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_state_s1.service]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_state_s1.service].orig
  +++ Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_state_s1.service]
  
  -    ensure            => absent
  -    unit              => nrpe2nodexp-mariadb_replica_sql_state_s1.service
  -    restart           => False
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-memory.conf]

  Parameters differences:

  --- File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-memory.conf].orig
  +++ File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-memory.conf]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Service[rsyslog]
  

  Content differences:

  --- /etc/rsyslog.d/25-nrpe2nodexp-mariadb-memory.conf.orig
  +++ /etc/rsyslog.d/25-nrpe2nodexp-mariadb-memory.conf
  @@ -1,10 +0,0 @@
  -# SPDX-License-Identifier: Apache-2.0
  -if $programname contains "nrpe2nodexp-mariadb_memory" then {
  -    if ($msg contains "\"ecs.version\": \"1.7.0\"") then {
  -        # Send logs to kafka
  -        set $.log_outputs = "kafka ecs_170 local";
  -    } else {
  -        # Filter out non-relevant nrpe2nodexp messages
  -        stop
  -    }
  -}

• Prometheus::Alert::Rule[check_mariadb_memory_b5a92c72542d5f0c031014e7a8db014e]

  Parameters differences:

  --- Prometheus::Alert::Rule[check_mariadb_memory_b5a92c72542d5f0c031014e7a8db014e].orig
  +++ Prometheus::Alert::Rule[check_mariadb_memory_b5a92c72542d5f0c031014e7a8db014e]
  
  -    logs               => https://logstash.wikimedia.org/app/dashboards#/view/2d343ac0-6df8-11f0-8e08-7fab0da52b33?_g=(filters:!((query:(match_phrase:(event.module:check_mariadb_memory))),(query:(match_phrase:(host.name:{{$labels.instance|stripPort}})))))
  -    description        => NRPE CHECK: MariaDB memory
  -    severity           => info
  -    runbook            => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting
  -    site               => codfw
  -    alert_name         => nrpe_MariaDB_memory
  -    for                => 3m
  -    team               => observability
  -    instance           => ops
  -    ensure             => absent
  -    expr               => (nagios_nrpe_check_result{alert_rule_hash="b5a92c72542d5f0c031014e7a8db014e",check_name="check_mariadb_memory", status=~"(WARNING|CRITICAL)", severity=~"(warning|critical)"} > 0) * on (instance) group_left (team) role_owner
  -    group              => nrpechecks
  -    summary            => NRPE CHECK: MariaDB memory
  -    def_label_whitelst => ['team', 'severity']
  -    dashboard          => TODO
  

• Class[Mariadb::Monitor_process]

  Parameters differences:

  --- Class[Mariadb::Monitor_process].orig
  +++ Class[Mariadb::Monitor_process]
  
  -    contact_group => admins
  -    is_critical   => False
  -    process_name  => mysqld
  -    process_count => 1
  

• Service[wmf_auto_restart_prometheus-mysqld-exporter@s1.timer]

  Parameters differences:

  --- Service[wmf_auto_restart_prometheus-mysqld-exporter@s1.timer].orig
  +++ Service[wmf_auto_restart_prometheus-mysqld-exporter@s1.timer]
  
  -    ensure   => running
  -    provider => systemd
  -    enable   => True
  

• File[/var/lib/prometheus/node.d/check_mariadb_replica_io_state_s1.prom]

  Parameters differences:

  --- File[/var/lib/prometheus/node.d/check_mariadb_replica_io_state_s1.prom].orig
  +++ File[/var/lib/prometheus/node.d/check_mariadb_replica_io_state_s1.prom]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• Monitoring::Exported_nagios_service[db2141 mariadb_disk_space]

  Parameters differences:

  --- Monitoring::Exported_nagios_service[db2141 mariadb_disk_space].orig
  +++ Monitoring::Exported_nagios_service[db2141 mariadb_disk_space]
  
  -    host_name              => db2141
  -    servicegroups          => mysql_codfw
  -    passive_checks_enabled => 1
  -    service_description    => MariaDB disk space
  -    ensure                 => present
  -    active_checks_enabled  => 1
  -    max_check_attempts     => 3
  -    check_period           => 24x7
  -    notification_options   => c,r,f
  -    is_volatile            => 0
  -    notes_url              => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting
  -    check_command          => nrpe_check!check_mariadb_disk_space!10
  -    notifications_enabled  => 1
  -    contact_groups         => admins
  -    check_freshness        => 0
  -    check_interval         => 1
  -    notification_period    => 24x7
  -    retry_interval         => 1
  -    notification_interval  => 0
  

• File[/etc/systemd/system/mariadb.service.d/override.conf]

  Parameters differences:

  --- File[/etc/systemd/system/mariadb.service.d/override.conf].orig
  +++ File[/etc/systemd/system/mariadb.service.d/override.conf]
  
  -    owner  => root
  -    ensure => present
  -    group  => root
  -    mode   => 0644
  -    notify => Exec[systemctl-daemon-reload]
  

  Content differences:

  --- /etc/systemd/system/mariadb.service.d/override.conf.orig
  +++ /etc/systemd/system/mariadb.service.d/override.conf
  @@ -1,2 +0,0 @@
  -[Service]
  -ExecStartPre=/bin/sh -c "echo 'mariadb main service is disabled, use mariadb@<instance_name> instead'; exit 1"

• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_memory.service (nrpe2nodexp-mariadb_memory.service)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mariadb_memory.service (nrpe2nodexp-mariadb_memory.service)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mariadb_memory.service (nrpe2nodexp-mariadb_memory.service)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• File[/etc/sudoers.d/nrpe-check_mysqld]

  Parameters differences:

  --- File[/etc/sudoers.d/nrpe-check_mysqld].orig
  +++ File[/etc/sudoers.d/nrpe-check_mysqld]
  
  -    owner   => root
  -    ensure  => absent
  -    group   => root
  -    require => Package[nagios-nrpe-server]
  

• File[/etc/sudoers.d/nrpe-check_mariadb_disk_space]

  Parameters differences:

  --- File[/etc/sudoers.d/nrpe-check_mariadb_disk_space].orig
  +++ File[/etc/sudoers.d/nrpe-check_mariadb_disk_space]
  
  -    owner   => root
  -    ensure  => absent
  -    group   => root
  -    require => Package[nagios-nrpe-server]
  

• Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_lag_s1.timer]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_lag_s1.timer].orig
  +++ Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_lag_s1.timer]
  
  -    ensure            => absent
  -    restart           => False
  -    unit              => nrpe2nodexp-mariadb_replica_sql_lag_s1.timer
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• Nrpe::Check[check_mysqld]

  Parameters differences:

  --- Nrpe::Check[check_mysqld].orig
  +++ Nrpe::Check[check_mysqld]
  
  -    ensure  => present
  -    before  => Monitoring::Service[mysqld]
  -    command => /usr/lib/nagios/plugins/check_procs -c 1:1 -C mysqld
  

• File[/lib/systemd/system/nrpe2nodexp-mariadb_read_only_s1.service]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mariadb_read_only_s1.service].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mariadb_read_only_s1.service]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mariadb_read_only_s1.service (nrpe2nodexp-mariadb_read_only_s1.service)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mariadb_read_only_s1.service.orig
  +++ /lib/systemd/system/nrpe2nodexp-mariadb_read_only_s1.service
  @@ -1,11 +0,0 @@
  -[Unit]
  -Description=execution of nrpe2nodexp for the check_mariadb_read_only_s1 command.
  -Documentation=https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -
  -[Service]
  -Type=oneshot
  -User=nagios
  -
  -Group=prometheus-node-exporter
  -SyslogIdentifier=nrpe2nodexp-mariadb_read_only_s1
  -ExecStart=-/usr/local/bin/nrpe2nodexp --alert-rule-hash "42baf529e0f3bfca391aca0a24c880e9" --timeout 10 --check-command "check_mariadb_read_only_s1"

• Prometheus::Alert::Rule[check_mariadb_replica_sql_lag_s1_8ec9d6c1155ae60699aaf9dfd1fa339b]

  Parameters differences:

  --- Prometheus::Alert::Rule[check_mariadb_replica_sql_lag_s1_8ec9d6c1155ae60699aaf9dfd1fa339b].orig
  +++ Prometheus::Alert::Rule[check_mariadb_replica_sql_lag_s1_8ec9d6c1155ae60699aaf9dfd1fa339b]
  
  -    logs               => https://logstash.wikimedia.org/app/dashboards#/view/2d343ac0-6df8-11f0-8e08-7fab0da52b33?_g=(filters:!((query:(match_phrase:(event.module:check_mariadb_replica_sql_lag_s1))),(query:(match_phrase:(host.name:{{$labels.instance|stripPort}})))))
  -    description        => NRPE CHECK: MariaDB Replica Lag: s1
  -    severity           => info
  -    runbook            => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica
  -    site               => codfw
  -    alert_name         => nrpe_MariaDB_Replica_Lag__s1
  -    for                => 10m
  -    team               => observability
  -    instance           => ops
  -    ensure             => absent
  -    expr               => (nagios_nrpe_check_result{alert_rule_hash="8ec9d6c1155ae60699aaf9dfd1fa339b",check_name="check_mariadb_replica_sql_lag_s1", status=~"(WARNING|CRITICAL)", severity=~"(warning|critical)"} > 0) * on (instance) group_left (team) role_owner
  -    group              => nrpechecks
  -    summary            => NRPE CHECK: MariaDB Replica Lag: s1
  -    def_label_whitelst => ['team', 'severity']
  -    dashboard          => TODO
  

• Service[nrpe2nodexp-mariadb_memory.timer]

  Parameters differences:

  --- Service[nrpe2nodexp-mariadb_memory.timer].orig
  +++ Service[nrpe2nodexp-mariadb_memory.timer]
  
  -    ensure   => stopped
  -    before   => ['Exec[systemd daemon-reload for nrpe2nodexp-mariadb_memory.timer (nrpe2nodexp-mariadb_memory.timer)]']
  -    provider => systemd
  -    enable   => False
  

• File[/etc/ferm/conf.d/10_s1_mariadb_internal]

  Parameters differences:

  --- File[/etc/ferm/conf.d/10_s1_mariadb_internal].orig
  +++ File[/etc/ferm/conf.d/10_s1_mariadb_internal]
  
  -    owner   => root
  -    ensure  => present
  -    tag     => ferm
  -    group   => root
  -    mode    => 0400
  -    notify  => Service[ferm]
  -    require => File[/etc/ferm/conf.d]
  

  Content differences:

  --- /etc/ferm/conf.d/10_s1_mariadb_internal.orig
  +++ /etc/ferm/conf.d/10_s1_mariadb_internal
  @@ -1,8 +0,0 @@
  -# Autogenerated by puppet. DO NOT EDIT BY HAND!
  -#
  -# 
  -&R_SERVICE(tcp, 3311, $INTERNAL);
  -
  -
  -
  -&NO_TRACK(tcp, 3311);

• Prometheus::Alert::Rule[check_mariadb_replica_sql_state_s1_3f927914a18db09399b7fff42858d634]

  Parameters differences:

  --- Prometheus::Alert::Rule[check_mariadb_replica_sql_state_s1_3f927914a18db09399b7fff42858d634].orig
  +++ Prometheus::Alert::Rule[check_mariadb_replica_sql_state_s1_3f927914a18db09399b7fff42858d634]
  
  -    logs               => https://logstash.wikimedia.org/app/dashboards#/view/2d343ac0-6df8-11f0-8e08-7fab0da52b33?_g=(filters:!((query:(match_phrase:(event.module:check_mariadb_replica_sql_state_s1))),(query:(match_phrase:(host.name:{{$labels.instance|stripPort}})))))
  -    description        => NRPE CHECK: MariaDB Replica SQL: s1
  -    severity           => info
  -    runbook            => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica
  -    site               => codfw
  -    alert_name         => nrpe_MariaDB_Replica_SQL__s1
  -    for                => 3m
  -    team               => observability
  -    instance           => ops
  -    ensure             => absent
  -    expr               => (nagios_nrpe_check_result{alert_rule_hash="3f927914a18db09399b7fff42858d634",check_name="check_mariadb_replica_sql_state_s1", status=~"(WARNING|CRITICAL)", severity=~"(warning|critical)"} > 0) * on (instance) group_left (team) role_owner
  -    group              => nrpechecks
  -    summary            => NRPE CHECK: MariaDB Replica SQL: s1
  -    def_label_whitelst => ['team', 'severity']
  -    dashboard          => TODO
  

• Mariadb::Monitor_replication[s1]

  Parameters differences:

  --- Mariadb::Monitor_replication[s1].orig
  +++ Mariadb::Monitor_replication[s1]
  
  -    source_dc     => eqiad
  -    socket        => /run/mysqld/mysqld.s1.sock
  -    contact_group => admins
  -    lag_crit      => 300
  -    warn_stopped  => True
  -    is_critical   => False
  -    multisource   => False
  -    lag_warn      => 60
  

• Motd::Script[mariadb::backup_source]

  Parameters differences:

  --- Motd::Script[mariadb::backup_source].orig
  +++ Motd::Script[mariadb::backup_source]
  
  -    ensure   => present
  -    priority => 5
  

• Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_state_s1.timer]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_state_s1.timer].orig
  +++ Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_state_s1.timer]
  
  -    ensure            => absent
  -    restart           => False
  -    unit              => nrpe2nodexp-mariadb_replica_sql_state_s1.timer
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• Ferm::Service[s1_orchestrator]

  Parameters differences:

  --- Ferm::Service[s1_orchestrator].orig
  +++ Ferm::Service[s1_orchestrator]
  
  -    srange              => ['dborch1001.wikimedia.org', 'dborch1002.wikimedia.org', 'dborch1003.eqiad.wmnet']
  -    proto               => tcp
  -    prio                => 10
  -    port                => [3311]
  -    ensure              => present
  -    unrestricted_access => False
  -    notrack             => True
  -    desc                => 
  

• Package[wmfmariadbpy-common]

  Parameters differences:

  --- Package[wmfmariadbpy-common].orig
  +++ Package[wmfmariadbpy-common]
  
  -    ensure   => installed
  -    provider => apt
  

• File[/etc/sudoers.d/nrpe-check_mariadb_replica_sql_lag_s1]

  Parameters differences:

  --- File[/etc/sudoers.d/nrpe-check_mariadb_replica_sql_lag_s1].orig
  +++ File[/etc/sudoers.d/nrpe-check_mariadb_replica_sql_lag_s1]
  
  -    owner   => root
  -    ensure  => absent
  -    group   => root
  -    require => Package[nagios-nrpe-server]
  

• Monitoring::Service[mariadb_memory]

  Parameters differences:

  --- Monitoring::Service[mariadb_memory].orig
  +++ Monitoring::Service[mariadb_memory]
  
  -    description    => MariaDB memory
  -    config_dir     => /etc/nagios
  -    migration_task => T315866
  -    critical       => False
  -    check_interval => 1
  -    contact_group  => admins
  -    freshness      => 36000
  -    ensure         => present
  -    retry_interval => 1
  -    passive        => False
  -    host           => db2141
  -    notes_url      => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting
  -    check_command  => nrpe_check!check_mariadb_memory!10
  -    retries        => 3
  

• Mariadb::Monitor_readonly[s1]

  Parameters differences:

  --- Mariadb::Monitor_readonly[s1].orig
  +++ Mariadb::Monitor_readonly[s1]
  
  -    is_critical   => False
  -    contact_group => admins
  -    read_only     => 1
  -    port          => 3311
  

• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_io_state_s1.service (nrpe2nodexp-mariadb_replica_io_state_s1.service)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_io_state_s1.service (nrpe2nodexp-mariadb_replica_io_state_s1.service)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_io_state_s1.service (nrpe2nodexp-mariadb_replica_io_state_s1.service)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Class[Monitoring]

  Parameters differences:

  --- Class[Monitoring].orig
  +++ Class[Monitoring]
  
  @@
  -    notifications_enabled => True
  +    notifications_enabled => False
  

• File[/etc/sudoers.d/nrpe-check_mariadb_replica_io_state_s1]

  Parameters differences:

  --- File[/etc/sudoers.d/nrpe-check_mariadb_replica_io_state_s1].orig
  +++ File[/etc/sudoers.d/nrpe-check_mariadb_replica_io_state_s1]
  
  -    owner   => root
  -    ensure  => absent
  -    group   => root
  -    require => Package[nagios-nrpe-server]
  

• File[/etc/nagios/nrpe.d/check_mariadb_disk_space.cfg]

  Parameters differences:

  --- File[/etc/nagios/nrpe.d/check_mariadb_disk_space.cfg].orig
  +++ File[/etc/nagios/nrpe.d/check_mariadb_disk_space.cfg]
  
  -    owner   => root
  -    ensure  => present
  -    group   => root
  -    mode    => 0444
  -    notify  => Service[nagios-nrpe-server]
  -    tag     => nrpe::check
  -    require => Package[nagios-nrpe-server]
  

  Content differences:

  --- /etc/nagios/nrpe.d/check_mariadb_disk_space.cfg.orig
  +++ /etc/nagios/nrpe.d/check_mariadb_disk_space.cfg
  @@ -1,2 +0,0 @@
  -# File generated by puppet. DO NOT edit by hand
  -command[check_mariadb_disk_space]=/usr/lib/nagios/plugins/check_disk -w 10% -c 5% -l -e --exclude-type=tracefs --exclude-type=tmpfs --exclude-type=ramfs --exclude-type=devtmpfs

• Puppet::Expose_agent_certs[/etc/mysql]

  Parameters differences:

  --- Puppet::Expose_agent_certs[/etc/mysql].orig
  +++ Puppet::Expose_agent_certs[/etc/mysql]
  
  -    provide_p12     => False
  -    provide_private => True
  -    provide_keypair => False
  -    provide_pem     => True
  -    ensure          => present
  -    user            => mysql
  -    ssldir          => /var/lib/puppet/ssl
  -    group           => mysql
  

• Profile::Auto_restarts::Service[prometheus-mysqld-exporter@s1]

  Parameters differences:

  --- Profile::Auto_restarts::Service[prometheus-mysqld-exporter@s1].orig
  +++ Profile::Auto_restarts::Service[prometheus-mysqld-exporter@s1]
  
  -    ensure => present
  

• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_lag_s1.service (nrpe2nodexp-mariadb_replica_sql_lag_s1.service)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_lag_s1.service (nrpe2nodexp-mariadb_replica_sql_lag_s1.service)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_lag_s1.service (nrpe2nodexp-mariadb_replica_sql_lag_s1.service)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• File[/etc/ferm/conf.d/10_s1_orchestrator]

  Parameters differences:

  --- File[/etc/ferm/conf.d/10_s1_orchestrator].orig
  +++ File[/etc/ferm/conf.d/10_s1_orchestrator]
  
  -    owner   => root
  -    ensure  => present
  -    tag     => ferm
  -    group   => root
  -    mode    => 0400
  -    notify  => Service[ferm]
  -    require => File[/etc/ferm/conf.d]
  

  Content differences:

  --- /etc/ferm/conf.d/10_s1_orchestrator.orig
  +++ /etc/ferm/conf.d/10_s1_orchestrator
  @@ -1,8 +0,0 @@
  -# Autogenerated by puppet. DO NOT EDIT BY HAND!
  -#
  -# 
  -&R_SERVICE(tcp, 3311, (10.64.0.20 208.80.154.9 208.80.155.103 2620:0:861:4:208:80:155:103));
  -
  -
  -
  -&NO_TRACK(tcp, 3311);

• File[/var/lib/prometheus/node.d/role_owner.prom]

  Content differences:

  --- /var/lib/prometheus/node.d/role_owner.prom.orig
  +++ /var/lib/prometheus/node.d/role_owner.prom
  @@ -1,3 +1,3 @@
   # HELP role_owner The team owner of the server role
   # TYPE role_owner gauge
  -role_owner{team="data-persistence",role="mariadb::backup_source",cluster="mysql"} 1.0
  +role_owner{team="data-persistence",role="insetup::data_persistence_ferm",cluster="mysql"} 1.0

• Class[Profile::Mariadb::Wmfmariadbpy]

  Parameters differences:

  --- Class[Profile::Mariadb::Wmfmariadbpy].orig
  +++ Class[Profile::Mariadb::Wmfmariadbpy]
  
  -    role          => db
  -    section_ports => {'s1': 3311, 's2': 3312, 's3': 3313, 's4': 3314, 's5': 3315, 's6': 3316, 's7': 3317, 's8': 3318, 'x1': 3320, 'x3': 3363, 'm1': 3321, 'm2': 3322, 'm3': 3323, 'm5': 3325, 'staging': 3350, 'matomo': 3351, 'analytics_meta': 3352, 'backup1-eqiad': 3360, 'backup1-codfw': 3361}
  

• File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-read-only-s1.conf]

  Parameters differences:

  --- File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-read-only-s1.conf].orig
  +++ File[/etc/rsyslog.d/25-nrpe2nodexp-mariadb-read-only-s1.conf]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Service[rsyslog]
  

  Content differences:

  --- /etc/rsyslog.d/25-nrpe2nodexp-mariadb-read-only-s1.conf.orig
  +++ /etc/rsyslog.d/25-nrpe2nodexp-mariadb-read-only-s1.conf
  @@ -1,10 +0,0 @@
  -# SPDX-License-Identifier: Apache-2.0
  -if $programname contains "nrpe2nodexp-mariadb_read_only_s1" then {
  -    if ($msg contains "\"ecs.version\": \"1.7.0\"") then {
  -        # Send logs to kafka
  -        set $.log_outputs = "kafka ecs_170 local";
  -    } else {
  -        # Filter out non-relevant nrpe2nodexp messages
  -        stop
  -    }
  -}

• File[/etc/mysql/ssl/server-keypair.pem]

  Parameters differences:

  --- File[/etc/mysql/ssl/server-keypair.pem].orig
  +++ File[/etc/mysql/ssl/server-keypair.pem]
  
  -    owner  => mysql
  -    ensure => absent
  -    mode   => 0400
  -    group  => mysql
  

• File[/etc/mysql/ssl/server.p12]

  Parameters differences:

  --- File[/etc/mysql/ssl/server.p12].orig
  +++ File[/etc/mysql/ssl/server.p12]
  
  -    owner  => mysql
  -    ensure => absent
  -    mode   => 0440
  -    group  => mysql
  

• Rsyslog::Conf[nrpe2nodexp-mariadb_read_only_s1]

  Parameters differences:

  --- Rsyslog::Conf[nrpe2nodexp-mariadb_read_only_s1].orig
  +++ Rsyslog::Conf[nrpe2nodexp-mariadb_read_only_s1]
  
  -    mode     => 0444
  -    ensure   => absent
  -    priority => 25
  

• Exec[systemd daemon-reload for wmf_auto_restart_prometheus-mysqld-exporter@s1.timer (wmf_auto_restart_prometheus-mysqld-exporter@s1.timer)]

  Parameters differences:

  --- Exec[systemd daemon-reload for wmf_auto_restart_prometheus-mysqld-exporter@s1.timer (wmf_auto_restart_prometheus-mysqld-exporter@s1.timer)].orig
  +++ Exec[systemd daemon-reload for wmf_auto_restart_prometheus-mysqld-exporter@s1.timer (wmf_auto_restart_prometheus-mysqld-exporter@s1.timer)]
  
  -    before      => ['Service[wmf_auto_restart_prometheus-mysqld-exporter@s1.timer]']
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Service[nrpe2nodexp-mariadb_read_only_s1.timer]

  Parameters differences:

  --- Service[nrpe2nodexp-mariadb_read_only_s1.timer].orig
  +++ Service[nrpe2nodexp-mariadb_read_only_s1.timer]
  
  -    ensure   => stopped
  -    before   => ['Exec[systemd daemon-reload for nrpe2nodexp-mariadb_read_only_s1.timer (nrpe2nodexp-mariadb_read_only_s1.timer)]']
  -    provider => systemd
  -    enable   => False
  

• File[/etc/mysql]

  Parameters differences:

  --- File[/etc/mysql].orig
  +++ File[/etc/mysql]
  
  -    mode   => 0755
  -    ensure => directory
  -    owner  => root
  -    group  => root
  

• Systemd::Timer[nrpe2nodexp-mariadb_replica_io_state_s1]

  Parameters differences:

  --- Systemd::Timer[nrpe2nodexp-mariadb_replica_io_state_s1].orig
  +++ Systemd::Timer[nrpe2nodexp-mariadb_replica_io_state_s1]
  
  -    ensure             => absent
  -    unit_name          => nrpe2nodexp-mariadb_replica_io_state_s1.service
  -    timer_intervals    => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}, {'interval': '1s', 'start': 'OnActiveSec'}]
  -    accuracy           => 15sec
  -    splay              => 60
  -    fixed_random_delay => True
  

• File[/var/lib/prometheus/node.d/check_mysqld.prom]

  Parameters differences:

  --- File[/var/lib/prometheus/node.d/check_mysqld.prom].orig
  +++ File[/var/lib/prometheus/node.d/check_mysqld.prom]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• File[/lib/systemd/system/wmf_auto_restart_prometheus-mysqld-exporter@s1.service]

  Parameters differences:

  --- File[/lib/systemd/system/wmf_auto_restart_prometheus-mysqld-exporter@s1.service].orig
  +++ File[/lib/systemd/system/wmf_auto_restart_prometheus-mysqld-exporter@s1.service]
  
  -    owner  => root
  -    ensure => present
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for wmf_auto_restart_prometheus-mysqld-exporter@s1.service (wmf_auto_restart_prometheus-mysqld-exporter@s1.service)]
  

  Content differences:

  --- /lib/systemd/system/wmf_auto_restart_prometheus-mysqld-exporter@s1.service.orig
  +++ /lib/systemd/system/wmf_auto_restart_prometheus-mysqld-exporter@s1.service
  @@ -1,8 +0,0 @@
  -[Unit]
  -Description=Auto restart job: prometheus-mysqld-exporter@s1
  -Documentation=https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -
  -[Service]
  -Type=oneshot
  -User=root
  -ExecStart=/usr/local/sbin/wmf-auto-restart -s prometheus-mysqld-exporter@s1

• File[/var/lib/prometheus/node.d/check_mariadb_memory.prom]

  Parameters differences:

  --- File[/var/lib/prometheus/node.d/check_mariadb_memory.prom].orig
  +++ File[/var/lib/prometheus/node.d/check_mariadb_memory.prom]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_lag_s1.timer (nrpe2nodexp-mariadb_replica_sql_lag_s1.timer)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_lag_s1.timer (nrpe2nodexp-mariadb_replica_sql_lag_s1.timer)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_lag_s1.timer (nrpe2nodexp-mariadb_replica_sql_lag_s1.timer)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Package[monitoring-plugins-contrib]

  Parameters differences:

  --- Package[monitoring-plugins-contrib].orig
  +++ Package[monitoring-plugins-contrib]
  
  -    ensure   => installed
  -    provider => apt
  

• File[/srv/sqldata.s1]

  Parameters differences:

  --- File[/srv/sqldata.s1].orig
  +++ File[/srv/sqldata.s1]
  
  -    owner  => mysql
  -    ensure => directory
  -    mode   => 0755
  -    group  => mysql
  

• Systemd::Timer::Job[wmf_auto_restart_prometheus-mysqld-exporter@s1]

  Parameters differences:

  --- Systemd::Timer::Job[wmf_auto_restart_prometheus-mysqld-exporter@s1].orig
  +++ Systemd::Timer::Job[wmf_auto_restart_prometheus-mysqld-exporter@s1]
  
  -    monitoring_enabled        => False
  -    description               => Auto restart job: prometheus-mysqld-exporter@s1
  -    syslog_match_startswith   => True
  -    ensure                    => present
  -    user                      => root
  -    interval                  => {'start': 'OnCalendar', 'interval': 'Mon,Tue,Wed,Thu,Fri *-*-* 3:10:00'}
  -    send_mail_to              => root@db2141.codfw.wmnet
  -    logfile_basedir           => /var/log
  -    private_tmp               => False
  -    success_exit_status       => []
  -    send_mail_only_on_error   => True
  -    ignore_errors             => False
  -    logfile_name              => syslog.log
  -    command                   => /usr/local/sbin/wmf-auto-restart -s prometheus-mysqld-exporter@s1
  -    monitoring_notes_url      => https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -    logfile_perms             => all
  -    syslog_force_stop         => True
  -    require                   => File[/usr/local/sbin/wmf-auto-restart]
  -    logfile_group             => root
  -    send_mail                 => False
  -    logging_enabled           => True
  -    environment               => {}
  -    monitoring_contact_groups => admins
  -    fixed_random_delay        => False
  

• Systemd::Service[nrpe2nodexp-mariadb_replica_sql_state_s1]

  Parameters differences:

  --- Systemd::Service[nrpe2nodexp-mariadb_replica_sql_state_s1].orig
  +++ Systemd::Service[nrpe2nodexp-mariadb_replica_sql_state_s1]
  
  -    monitoring_enabled       => False
  -    restart                  => False
  -    migration_task           => T407130
  -    override                 => False
  -    require                  => Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_state_s1.service]
  -    monitoring_critical      => False
  -    ensure                   => absent
  -    unit_type                => timer
  -    monitoring_contact_group => admins
  -    service_params           => {}
  

• Sslcert::X509_to_pkcs12[puppet::expose_agent_cert: /etc/mysql]

  Parameters differences:

  --- Sslcert::X509_to_pkcs12[puppet::expose_agent_cert: /etc/mysql].orig
  +++ Sslcert::X509_to_pkcs12[puppet::expose_agent_cert: /etc/mysql]
  
  -    owner       => mysql
  -    ensure      => absent
  -    outfile     => /etc/mysql/ssl/server.p12
  -    public_key  => /var/lib/puppet/ssl/certs/db2141.codfw.wmnet.pem
  -    group       => mysql
  -    certfile    => /var/lib/puppet/ssl/certs/ca.pem
  -    private_key => /var/lib/puppet/ssl/private_keys/db2141.codfw.wmnet.pem
  

• Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_io_state_s1.timer (nrpe2nodexp-mariadb_replica_io_state_s1.timer)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_io_state_s1.timer (nrpe2nodexp-mariadb_replica_io_state_s1.timer)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_io_state_s1.timer (nrpe2nodexp-mariadb_replica_io_state_s1.timer)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

• Monitoring::Exported_nagios_service[db2141 mariadb_replica_sql_state_s1]

  Parameters differences:

  --- Monitoring::Exported_nagios_service[db2141 mariadb_replica_sql_state_s1].orig
  +++ Monitoring::Exported_nagios_service[db2141 mariadb_replica_sql_state_s1]
  
  -    host_name              => db2141
  -    servicegroups          => mysql_codfw
  -    passive_checks_enabled => 1
  -    service_description    => MariaDB Replica SQL: s1
  -    ensure                 => present
  -    active_checks_enabled  => 1
  -    max_check_attempts     => 3
  -    check_period           => 24x7
  -    notification_options   => c,r,f
  -    is_volatile            => 0
  -    notes_url              => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica
  -    check_command          => nrpe_check!check_mariadb_replica_sql_state_s1!10
  -    notifications_enabled  => 1
  -    contact_groups         => admins
  -    check_freshness        => 0
  -    check_interval         => 1
  -    notification_period    => 24x7
  -    retry_interval         => 1
  -    notification_interval  => 0
  

• File[/lib/systemd/system/nrpe2nodexp-mariadb_memory.service]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mariadb_memory.service].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mariadb_memory.service]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mariadb_memory.service (nrpe2nodexp-mariadb_memory.service)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mariadb_memory.service.orig
  +++ /lib/systemd/system/nrpe2nodexp-mariadb_memory.service
  @@ -1,11 +0,0 @@
  -[Unit]
  -Description=execution of nrpe2nodexp for the check_mariadb_memory command.
  -Documentation=https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -
  -[Service]
  -Type=oneshot
  -User=nagios
  -
  -Group=prometheus-node-exporter
  -SyslogIdentifier=nrpe2nodexp-mariadb_memory
  -ExecStart=-/usr/local/bin/nrpe2nodexp --alert-rule-hash "b5a92c72542d5f0c031014e7a8db014e" --timeout 10 --check-command "check_mariadb_memory"

• File[/etc/rsyslog.d/40-wmf-auto-restart-prometheus-mysqld-exporter-s1.conf]

  Parameters differences:

  --- File[/etc/rsyslog.d/40-wmf-auto-restart-prometheus-mysqld-exporter-s1.conf].orig
  +++ File[/etc/rsyslog.d/40-wmf-auto-restart-prometheus-mysqld-exporter-s1.conf]
  
  -    owner  => root
  -    ensure => present
  -    group  => root
  -    mode   => 0444
  -    notify => Service[rsyslog]
  

  Content differences:

  --- /etc/rsyslog.d/40-wmf-auto-restart-prometheus-mysqld-exporter-s1.conf.orig
  +++ /etc/rsyslog.d/40-wmf-auto-restart-prometheus-mysqld-exporter-s1.conf
  @@ -1,10 +0,0 @@
  -# rsyslog.conf(5) configuration file for services.
  -# This file is managed by Puppet.
  -if $programname startswith "wmf_auto_restart_prometheus-mysqld-exporter_s1" then {
  -    action(
  -        type="omfile" file="/var/log/wmf_auto_restart_prometheus-mysqld-exporter_s1/syslog.log"
  -        fileOwner="root" fileGroup="root"
  -        fileCreateMode="0644"
  -    )
  -    & stop
  -}

• Prometheus::Alert::Rule[check_mariadb_replica_io_state_s1_0d5979f7abbb49256cfedd70a646784e]

  Parameters differences:

  --- Prometheus::Alert::Rule[check_mariadb_replica_io_state_s1_0d5979f7abbb49256cfedd70a646784e].orig
  +++ Prometheus::Alert::Rule[check_mariadb_replica_io_state_s1_0d5979f7abbb49256cfedd70a646784e]
  
  -    logs               => https://logstash.wikimedia.org/app/dashboards#/view/2d343ac0-6df8-11f0-8e08-7fab0da52b33?_g=(filters:!((query:(match_phrase:(event.module:check_mariadb_replica_io_state_s1))),(query:(match_phrase:(host.name:{{$labels.instance|stripPort}})))))
  -    description        => NRPE CHECK: MariaDB Replica IO: s1
  -    severity           => info
  -    runbook            => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica
  -    site               => codfw
  -    alert_name         => nrpe_MariaDB_Replica_IO__s1
  -    for                => 3m
  -    team               => observability
  -    instance           => ops
  -    ensure             => absent
  -    expr               => (nagios_nrpe_check_result{alert_rule_hash="0d5979f7abbb49256cfedd70a646784e",check_name="check_mariadb_replica_io_state_s1", status=~"(WARNING|CRITICAL)", severity=~"(warning|critical)"} > 0) * on (instance) group_left (team) role_owner
  -    group              => nrpechecks
  -    summary            => NRPE CHECK: MariaDB Replica IO: s1
  -    def_label_whitelst => ['team', 'severity']
  -    dashboard          => TODO
  

• File[/etc/wmfmariadbpy]

  Parameters differences:

  --- File[/etc/wmfmariadbpy].orig
  +++ File[/etc/wmfmariadbpy]
  
  -    owner  => root
  -    ensure => directory
  -    mode   => 0755
  -    group  => root
  

• Sudo::User[nrpe-check_mariadb_read_only_s1]

  Parameters differences:

  --- Sudo::User[nrpe-check_mariadb_read_only_s1].orig
  +++ Sudo::User[nrpe-check_mariadb_read_only_s1]
  
  -    ensure     => absent
  -    user       => nagios
  -    tag        => nrpe::check
  -    privileges => []
  -    require    => ['Class[Sudo]']
  

• Systemd::Unit[nrpe2nodexp-mariadb_read_only_s1.service]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mariadb_read_only_s1.service].orig
  +++ Systemd::Unit[nrpe2nodexp-mariadb_read_only_s1.service]
  
  -    ensure            => absent
  -    unit              => nrpe2nodexp-mariadb_read_only_s1.service
  -    restart           => False
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• Rsyslog::Conf[nrpe2nodexp-mariadb_replica_sql_lag_s1]

  Parameters differences:

  --- Rsyslog::Conf[nrpe2nodexp-mariadb_replica_sql_lag_s1].orig
  +++ Rsyslog::Conf[nrpe2nodexp-mariadb_replica_sql_lag_s1]
  
  -    mode     => 0444
  -    ensure   => absent
  -    priority => 25
  

• Systemd::Service[nrpe2nodexp-mariadb_memory]

  Parameters differences:

  --- Systemd::Service[nrpe2nodexp-mariadb_memory].orig
  +++ Systemd::Service[nrpe2nodexp-mariadb_memory]
  
  -    monitoring_enabled       => False
  -    restart                  => False
  -    migration_task           => T407130
  -    override                 => False
  -    require                  => Systemd::Unit[nrpe2nodexp-mariadb_memory.service]
  -    monitoring_critical      => False
  -    ensure                   => absent
  -    unit_type                => timer
  -    monitoring_contact_group => admins
  -    service_params           => {}
  

• File[/var/lib/prometheus/node.d/check_mariadb_read_only_s1.prom]

  Parameters differences:

  --- File[/var/lib/prometheus/node.d/check_mariadb_read_only_s1.prom].orig
  +++ File[/var/lib/prometheus/node.d/check_mariadb_read_only_s1.prom]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• File[/var/lib/prometheus/node.d/check_mariadb_disk_space.prom]

  Parameters differences:

  --- File[/var/lib/prometheus/node.d/check_mariadb_disk_space.prom].orig
  +++ File[/var/lib/prometheus/node.d/check_mariadb_disk_space.prom]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• Monitoring::Service[mariadb_disk_space]

  Parameters differences:

  --- Monitoring::Service[mariadb_disk_space].orig
  +++ Monitoring::Service[mariadb_disk_space]
  
  -    description    => MariaDB disk space
  -    config_dir     => /etc/nagios
  -    migration_task => T315866
  -    critical       => False
  -    check_interval => 1
  -    contact_group  => admins
  -    freshness      => 36000
  -    ensure         => present
  -    retry_interval => 1
  -    passive        => False
  -    host           => db2141
  -    notes_url      => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting
  -    check_command  => nrpe_check!check_mariadb_disk_space!10
  -    retries        => 3
  

• Motd::Script[insetup::data_persistence_ferm]

  Parameters differences:

  --- Motd::Script[insetup::data_persistence_ferm].orig
  +++ Motd::Script[insetup::data_persistence_ferm]
  
  +    ensure   => present
  +    priority => 5
  

• File[/usr/local/lib/nagios/plugins/check_mariadb]

  Parameters differences:

  --- File[/usr/local/lib/nagios/plugins/check_mariadb].orig
  +++ File[/usr/local/lib/nagios/plugins/check_mariadb]
  
  -    owner   => root
  -    ensure  => file
  -    source  => puppet:///modules/icinga/check_mariadb.pl
  -    group   => root
  -    mode    => 0555
  -    tag     => nrpe::plugin
  -    require => File[/usr/local/lib/nagios/plugins/]
  

• Rsyslog::Conf[nrpe2nodexp-mariadb_memory]

  Parameters differences:

  --- Rsyslog::Conf[nrpe2nodexp-mariadb_memory].orig
  +++ Rsyslog::Conf[nrpe2nodexp-mariadb_memory]
  
  -    mode     => 0444
  -    ensure   => absent
  -    priority => 25
  

• File[/lib/systemd/system/nrpe2nodexp-mysqld.service]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mysqld.service].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mysqld.service]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mysqld.service (nrpe2nodexp-mysqld.service)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mysqld.service.orig
  +++ /lib/systemd/system/nrpe2nodexp-mysqld.service
  @@ -1,11 +0,0 @@
  -[Unit]
  -Description=execution of nrpe2nodexp for the check_mysqld command.
  -Documentation=https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -
  -[Service]
  -Type=oneshot
  -User=nagios
  -
  -Group=prometheus-node-exporter
  -SyslogIdentifier=nrpe2nodexp-mysqld
  -ExecStart=-/usr/local/bin/nrpe2nodexp --alert-rule-hash "ca81db2c9e98d408f9f65c79817da116" --timeout 10 --check-command "check_mysqld"

• Class[Mariadb::Monitor_disk]

  Parameters differences:

  --- Class[Mariadb::Monitor_disk].orig
  +++ Class[Mariadb::Monitor_disk]
  
  -    contact_group => admins
  -    is_critical   => False
  -    pct_warning   => 10
  -    pct_critical  => 5
  

• Package[prometheus-mysqld-exporter]

  Parameters differences:

  --- Package[prometheus-mysqld-exporter].orig
  +++ Package[prometheus-mysqld-exporter]
  
  -    ensure   => installed
  -    provider => apt
  

• File[/opt/wmf-mariadb1011/my.cnf]

  Parameters differences:

  --- File[/opt/wmf-mariadb1011/my.cnf].orig
  +++ File[/opt/wmf-mariadb1011/my.cnf]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• Prometheus::Alert::Rule[check_mysqld_ca81db2c9e98d408f9f65c79817da116]

  Parameters differences:

  --- Prometheus::Alert::Rule[check_mysqld_ca81db2c9e98d408f9f65c79817da116].orig
  +++ Prometheus::Alert::Rule[check_mysqld_ca81db2c9e98d408f9f65c79817da116]
  
  -    logs               => https://logstash.wikimedia.org/app/dashboards#/view/2d343ac0-6df8-11f0-8e08-7fab0da52b33?_g=(filters:!((query:(match_phrase:(event.module:check_mysqld))),(query:(match_phrase:(host.name:{{$labels.instance|stripPort}})))))
  -    description        => NRPE CHECK: mysqld processes
  -    severity           => info
  -    runbook            => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting
  -    site               => codfw
  -    alert_name         => nrpe_mysqld_processes
  -    for                => 3m
  -    team               => observability
  -    instance           => ops
  -    ensure             => absent
  -    expr               => (nagios_nrpe_check_result{alert_rule_hash="ca81db2c9e98d408f9f65c79817da116",check_name="check_mysqld", status=~"(WARNING|CRITICAL)", severity=~"(warning|critical)"} > 0) * on (instance) group_left (team) role_owner
  -    group              => nrpechecks
  -    summary            => NRPE CHECK: mysqld processes
  -    def_label_whitelst => ['team', 'severity']
  -    dashboard          => TODO
  

• Systemd::Unit[nrpe2nodexp-mariadb_replica_io_state_s1.timer]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mariadb_replica_io_state_s1.timer].orig
  +++ Systemd::Unit[nrpe2nodexp-mariadb_replica_io_state_s1.timer]
  
  -    ensure            => absent
  -    restart           => False
  -    unit              => nrpe2nodexp-mariadb_replica_io_state_s1.timer
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• User[mysql]

  Parameters differences:

  --- User[mysql].orig
  +++ User[mysql]
  
  -    ensure     => present
  -    gid        => mysql
  -    system     => True
  -    managehome => False
  -    shell      => /bin/false
  -    home       => /nonexistent
  

• File[/etc/update-motd.d/06-db-section-s1]

  Parameters differences:

  --- File[/etc/update-motd.d/06-db-section-s1].orig
  +++ File[/etc/update-motd.d/06-db-section-s1]
  
  -    mode   => 0555
  -    ensure => present
  -    owner  => root
  -    group  => root
  

  Content differences:

  --- /etc/update-motd.d/06-db-section-s1.orig
  +++ /etc/update-motd.d/06-db-section-s1
  @@ -1,2 +0,0 @@
  -#!/bin/sh
  -echo 'DB section s1 (alias: mysql.s1)'

• File[/etc/rsyslog.d/25-nrpe2nodexp-mysqld.conf]

  Parameters differences:

  --- File[/etc/rsyslog.d/25-nrpe2nodexp-mysqld.conf].orig
  +++ File[/etc/rsyslog.d/25-nrpe2nodexp-mysqld.conf]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Service[rsyslog]
  

  Content differences:

  --- /etc/rsyslog.d/25-nrpe2nodexp-mysqld.conf.orig
  +++ /etc/rsyslog.d/25-nrpe2nodexp-mysqld.conf
  @@ -1,10 +0,0 @@
  -# SPDX-License-Identifier: Apache-2.0
  -if $programname contains "nrpe2nodexp-mysqld" then {
  -    if ($msg contains "\"ecs.version\": \"1.7.0\"") then {
  -        # Send logs to kafka
  -        set $.log_outputs = "kafka ecs_170 local";
  -    } else {
  -        # Filter out non-relevant nrpe2nodexp messages
  -        stop
  -    }
  -}

• File[/etc/my.cnf]

  Parameters differences:

  --- File[/etc/my.cnf].orig
  +++ File[/etc/my.cnf]
  
  -    owner => root
  -    mode  => 0644
  -    group => root
  

  Content differences:

  --- /etc/my.cnf.orig
  +++ /etc/my.cnf
  @@ -1,128 +0,0 @@
  -# replicas for backup sources and analytics
  -
  -# Please use separate .cnf templates for each type of server.
  -
  -[client]
  -
  -[mysqld]
  -
  -skip-external-locking
  -skip-name-resolve
  -temp-pool
  -
  -user               = mysql
  -basedir            = /opt/wmf-mariadb1011
  -server_id          = 180363307
  -report_host        = db2141.codfw.wmnet
  -wsrep_cluster_name = codfw # For orchestrator. T266635
  -
  -# gtid_domain_id flag is needed for multisource replication and GTID.
  -# Strictly it is only needed on masters or servers that can potentially be
  -# masters but for consistency it should be set in all of them.
  -# https://mariadb.com/kb/en/mariadb/gtid/
  -gtid_domain_id  = 180363307
  -
  -read_only       = 1
  -key_buffer_size = 1048576
  -
  -secure_file_priv   = /dev/null
  -max_connections    = 250
  -max_allowed_packet = 32M
  -connect_timeout    = 3
  -query_cache_size   = 0
  -query_cache_type   = 0
  -event_scheduler    = 1
  -
  -table_open_cache       = 50000
  -table_definition_cache = 50000
  -
  -# binary log and replication options
  -# We are temporarily enabling the binlogs on these servers to evaluate
  -# CDC functionality with paimon/flink.
  -#
  -# We will revert this change once the evaluation is complete.
  -# See #T258511 for a discussion about the long-term aim and #T358373.
  -log-bin
  -log-slave-updates
  -binlog-format                  = ROW
  -sync-binlog                    = 1
  -binlog_cache_size              = 10M
  -max-binlog_size                = 1000M
  -expire-logs-days               = 7
  -
  -# InnoDB file-per-table + TokuDB love those file descriptors
  -open-files-limit = 200000
  -
  -character_set_server     = binary
  -character_set_filesystem = binary
  -collation_server         = binary
  -
  -innodb_file_per_table          = 1
  -# this can get overiden by per-instance configuration
  -innodb_buffer_pool_size        = 15G
  -innodb_log_file_size           = 4G
  -innodb_flush_log_at_trx_commit = 0
  -innodb_flush_method            = O_DIRECT
  -innodb_io_capacity             = 1000
  -innodb_stats_method            = nulls_unequal
  -innodb_purge_threads           = 1
  -# Changed because of https://jira.mariadb.org/browse/MDEV-22373
  -innodb_change_buffering        = none
  -
  -innodb_strict_mode             = 1
  -
  -# T287244
  -innodb_checksum_algorithm = full_crc32
  -
  -# T268869
  -innodb_adaptive_hash_index=OFF
  -
  -# In 10.6 the default is 90%, 75% worked fine for us.
  -innodb_max_dirty_pages_pct = 75
  -
  -# don't dump and load innodb buffer at start and stop
  -# these servers will have the buffer pool in a bad state due to dumps
  -# so not sure if these will be useful, but we leave them here for now
  -innodb_buffer_pool_load_at_startup  = 1
  -innodb_buffer_pool_dump_at_shutdown = 1
  -
  -optimizer_switch='engine_condition_pushdown=on,optimize_join_buffer_size=on'
  -join_cache_level = 8
  -
  -skip-slave-start
  -slave_transaction_retries = 4294967295
  -
  -
  -# ssl
  -ssl-ca=/etc/ssl/certs/wmf-ca-certificates.crt
  -ssl-cert=/etc/mysql/ssl/cert.pem
  -ssl-key=/etc/mysql/ssl/server.key
  -ssl-cipher=TLSv1.2
  -
  -
  -# Enabling performance_schema (disabled by default in MariaDB10)
  -performance_schema                                     = 1
  -# downsizing performance schema memory usage: T99485
  -performance_schema_digests_size                        = -1
  -performance_schema_max_thread_instances                = 500
  -performance_schema_max_cond_instances                  = 1000
  -performance_schema_accounts_size                       = 300
  -performance_schema_hosts_size                          = 300
  -performance_schema_events_statements_history_size      = 10
  -performance_schema_events_statements_history_long_size = 1000
  -performance_schema_events_waits_history_size           = 10
  -performance_schema_events_waits_history_long_size      = 1000
  -performance_schema_events_stages_history_size          = 10
  -performance_schema_events_stages_history_long_size     = 1000
  -performance_schema_max_mutex_instances                 = 5000
  -performance_schema_max_rwlock_instances                = 2000
  -performance_schema_max_socket_instances                = 500
  -performance_schema_max_table_instances                 = 1000
  -
  -
  -[mysqldump]
  -
  -quick
  -max_allowed_packet = 32M
  -
  -!includedir /etc/mysql/mysqld.conf.d/

• File[/etc/nagios/nrpe.d/check_mariadb_read_only_s1.cfg]

  Parameters differences:

  --- File[/etc/nagios/nrpe.d/check_mariadb_read_only_s1.cfg].orig
  +++ File[/etc/nagios/nrpe.d/check_mariadb_read_only_s1.cfg]
  
  -    owner   => root
  -    ensure  => present
  -    group   => root
  -    mode    => 0444
  -    notify  => Service[nagios-nrpe-server]
  -    tag     => nrpe::check
  -    require => Package[nagios-nrpe-server]
  

  Content differences:

  --- /etc/nagios/nrpe.d/check_mariadb_read_only_s1.cfg.orig
  +++ /etc/nagios/nrpe.d/check_mariadb_read_only_s1.cfg
  @@ -1,2 +0,0 @@
  -# File generated by puppet. DO NOT edit by hand
  -command[check_mariadb_read_only_s1]=db-check-health --port=3311 --icinga --check_read_only=1 --process

• Ferm::Service[s1_mariadb_internal]

  Parameters differences:

  --- Ferm::Service[s1_mariadb_internal].orig
  +++ Ferm::Service[s1_mariadb_internal]
  
  -    srange              => $INTERNAL
  -    proto               => tcp
  -    prio                => 10
  -    port                => 3311
  -    ensure              => present
  -    unrestricted_access => False
  -    notrack             => True
  -    desc                => 
  

• Monitoring::Exported_nagios_service[db2141 mariadb_read_only_s1]

  Parameters differences:

  --- Monitoring::Exported_nagios_service[db2141 mariadb_read_only_s1].orig
  +++ Monitoring::Exported_nagios_service[db2141 mariadb_read_only_s1]
  
  -    host_name              => db2141
  -    servicegroups          => mysql_codfw
  -    passive_checks_enabled => 1
  -    service_description    => MariaDB read only s1
  -    ensure                 => present
  -    active_checks_enabled  => 1
  -    max_check_attempts     => 3
  -    check_period           => 24x7
  -    notification_options   => c,r,f
  -    is_volatile            => 0
  -    notes_url              => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Master_comes_back_in_read_only
  -    check_command          => nrpe_check!check_mariadb_read_only_s1!10
  -    notifications_enabled  => 1
  -    contact_groups         => admins
  -    check_freshness        => 0
  -    check_interval         => 1
  -    notification_period    => 24x7
  -    retry_interval         => 1
  -    notification_interval  => 0
  

• Prometheus::Alert::Rule[check_mariadb_disk_space_d2aae7bfec5549be1a8b9413215bd86c]

  Parameters differences:

  --- Prometheus::Alert::Rule[check_mariadb_disk_space_d2aae7bfec5549be1a8b9413215bd86c].orig
  +++ Prometheus::Alert::Rule[check_mariadb_disk_space_d2aae7bfec5549be1a8b9413215bd86c]
  
  -    logs               => https://logstash.wikimedia.org/app/dashboards#/view/2d343ac0-6df8-11f0-8e08-7fab0da52b33?_g=(filters:!((query:(match_phrase:(event.module:check_mariadb_disk_space))),(query:(match_phrase:(host.name:{{$labels.instance|stripPort}})))))
  -    description        => NRPE CHECK: MariaDB disk space
  -    severity           => info
  -    runbook            => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting
  -    site               => codfw
  -    alert_name         => nrpe_MariaDB_disk_space
  -    for                => 3m
  -    team               => observability
  -    instance           => ops
  -    ensure             => absent
  -    expr               => (nagios_nrpe_check_result{alert_rule_hash="d2aae7bfec5549be1a8b9413215bd86c",check_name="check_mariadb_disk_space", status=~"(WARNING|CRITICAL)", severity=~"(warning|critical)"} > 0) * on (instance) group_left (team) role_owner
  -    group              => nrpechecks
  -    summary            => NRPE CHECK: MariaDB disk space
  -    def_label_whitelst => ['team', 'severity']
  -    dashboard          => TODO
  

• Package[percona-toolkit]

  Parameters differences:

  --- Package[percona-toolkit].orig
  +++ Package[percona-toolkit]
  
  -    ensure   => installed
  -    provider => apt
  

• Concat::Fragment[main contacts]

• Monitoring::Exported_nagios_service[db2141 mariadb_replica_io_state_s1]

  Parameters differences:

  --- Monitoring::Exported_nagios_service[db2141 mariadb_replica_io_state_s1].orig
  +++ Monitoring::Exported_nagios_service[db2141 mariadb_replica_io_state_s1]
  
  -    host_name              => db2141
  -    servicegroups          => mysql_codfw
  -    passive_checks_enabled => 1
  -    service_description    => MariaDB Replica IO: s1
  -    ensure                 => present
  -    active_checks_enabled  => 1
  -    max_check_attempts     => 3
  -    check_period           => 24x7
  -    notification_options   => c,r,f
  -    is_volatile            => 0
  -    notes_url              => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica
  -    check_command          => nrpe_check!check_mariadb_replica_io_state_s1!10
  -    notifications_enabled  => 1
  -    contact_groups         => admins
  -    check_freshness        => 0
  -    check_interval         => 1
  -    notification_period    => 24x7
  -    retry_interval         => 1
  -    notification_interval  => 0
  

• Systemd::Timer::Job[nrpe2nodexp-mariadb_replica_sql_lag_s1]

  Parameters differences:

  --- Systemd::Timer::Job[nrpe2nodexp-mariadb_replica_sql_lag_s1].orig
  +++ Systemd::Timer::Job[nrpe2nodexp-mariadb_replica_sql_lag_s1]
  
  -    monitoring_enabled        => False
  -    description               => execution of nrpe2nodexp for the check_mariadb_replica_sql_lag_s1 command.
  -    syslog_match_startswith   => True
  -    ensure                    => absent
  -    user                      => nagios
  -    interval                  => [{'start': 'OnUnitInactiveSec', 'interval': '1min'}]
  -    send_mail_to              => root@db2141.codfw.wmnet
  -    logfile_basedir           => /var/log
  -    private_tmp               => False
  -    success_exit_status       => []
  -    send_mail_only_on_error   => True
  -    ignore_errors             => True
  -    logfile_name              => syslog.log
  -    command                   => /usr/local/bin/nrpe2nodexp --alert-rule-hash "8ec9d6c1155ae60699aaf9dfd1fa339b" --timeout 10 --check-command "check_mariadb_replica_sql_lag_s1"
  -    syslog_identifier         => nrpe2nodexp-mariadb_replica_sql_lag_s1
  -    monitoring_notes_url      => https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -    logfile_perms             => all
  -    syslog_force_stop         => True
  -    splay                     => 60
  -    logfile_group             => root
  -    group                     => prometheus-node-exporter
  -    send_mail                 => False
  -    logging_enabled           => False
  -    environment               => {}
  -    monitoring_contact_groups => admins
  -    fixed_random_delay        => True
  

• File[/etc/nagios/nrpe.d/check_mariadb_replica_sql_lag_s1.cfg]

  Parameters differences:

  --- File[/etc/nagios/nrpe.d/check_mariadb_replica_sql_lag_s1.cfg].orig
  +++ File[/etc/nagios/nrpe.d/check_mariadb_replica_sql_lag_s1.cfg]
  
  -    owner   => root
  -    ensure  => present
  -    group   => root
  -    mode    => 0444
  -    notify  => Service[nagios-nrpe-server]
  -    tag     => nrpe::check
  -    require => Package[nagios-nrpe-server]
  

  Content differences:

  --- /etc/nagios/nrpe.d/check_mariadb_replica_sql_lag_s1.cfg.orig
  +++ /etc/nagios/nrpe.d/check_mariadb_replica_sql_lag_s1.cfg
  @@ -1,2 +0,0 @@
  -# File generated by puppet. DO NOT edit by hand
  -command[check_mariadb_replica_sql_lag_s1]=/usr/local/lib/nagios/plugins/check_mariadb --sock=/run/mysqld/mysqld.s1.sock --user=nagios --pass=  --warn-stopped --check=slave_sql_lag                            --shard=s1 --datacenter=eqiad                            --sql-lag-warn=60                            --sql-lag-crit=300

• File[/usr/local/bin/mysql.s1]

  Parameters differences:

  --- File[/usr/local/bin/mysql.s1].orig
  +++ File[/usr/local/bin/mysql.s1]
  
  -    owner  => root
  -    ensure => present
  -    mode   => 0555
  -    group  => root
  

  Content differences:

  --- /usr/local/bin/mysql.s1.orig
  +++ /usr/local/bin/mysql.s1
  @@ -1,3 +0,0 @@
  -#!/bin/bash
  -
  -exec sudo mysql -S /run/mysqld/mysqld.s1.sock --prompt="\\u@$(hostname):s1[\\d]> "

• Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_lag_s1.service]

  Parameters differences:

  --- Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_lag_s1.service].orig
  +++ Systemd::Unit[nrpe2nodexp-mariadb_replica_sql_lag_s1.service]
  
  -    ensure            => absent
  -    unit              => nrpe2nodexp-mariadb_replica_sql_lag_s1.service
  -    restart           => False
  -    override_filename => puppet-override.conf
  -    override          => False
  -    require           => ['Class[Systemd]']
  

• File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_lag_s1.service]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_lag_s1.service].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_lag_s1.service]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_lag_s1.service (nrpe2nodexp-mariadb_replica_sql_lag_s1.service)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_lag_s1.service.orig
  +++ /lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_lag_s1.service
  @@ -1,11 +0,0 @@
  -[Unit]
  -Description=execution of nrpe2nodexp for the check_mariadb_replica_sql_lag_s1 command.
  -Documentation=https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
  -
  -[Service]
  -Type=oneshot
  -User=nagios
  -
  -Group=prometheus-node-exporter
  -SyslogIdentifier=nrpe2nodexp-mariadb_replica_sql_lag_s1
  -ExecStart=-/usr/local/bin/nrpe2nodexp --alert-rule-hash "8ec9d6c1155ae60699aaf9dfd1fa339b" --timeout 10 --check-command "check_mariadb_replica_sql_lag_s1"

• Nrpe::Monitor_service[mariadb_replica_io_state_s1]

  Parameters differences:

  --- Nrpe::Monitor_service[mariadb_replica_io_state_s1].orig
  +++ Nrpe::Monitor_service[mariadb_replica_io_state_s1]
  
  -    description                 => MariaDB Replica IO: s1
  -    migration_task              => T315866
  -    nrpe2nodexp_parse_perf_data => False
  -    enable_icinga_check         => True
  -    critical                    => False
  -    check_interval              => 1
  -    contact_group               => admins
  -    alertmanager_team           => observability
  -    retries                     => 3
  -    ensure                      => present
  -    retry_interval              => 1
  -    enable_nrpe2nodexp          => False
  -    timeout                     => 10
  -    notes_url                   => https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting#Depooling_a_replica
  -    nrpe_command                => /usr/local/lib/nagios/plugins/check_mariadb --sock=/run/mysqld/mysqld.s1.sock --user=nagios --pass=  --warn-stopped --check=slave_io_state
  

• Nrpe::Check[check_mariadb_replica_sql_lag_s1]

  Parameters differences:

  --- Nrpe::Check[check_mariadb_replica_sql_lag_s1].orig
  +++ Nrpe::Check[check_mariadb_replica_sql_lag_s1]
  
  -    ensure  => present
  -    before  => Monitoring::Service[mariadb_replica_sql_lag_s1]
  -    command => /usr/local/lib/nagios/plugins/check_mariadb --sock=/run/mysqld/mysqld.s1.sock --user=nagios --pass=  --warn-stopped --check=slave_sql_lag                            --shard=s1 --datacenter=eqiad                            --sql-lag-warn=60                            --sql-lag-crit=300
  

• Package[mariadb-backup]

  Parameters differences:

  --- Package[mariadb-backup].orig
  +++ Package[mariadb-backup]
  
  -    ensure   => installed
  -    provider => apt
  

• Service[nrpe2nodexp-mariadb_replica_sql_state_s1.timer]

  Parameters differences:

  --- Service[nrpe2nodexp-mariadb_replica_sql_state_s1.timer].orig
  +++ Service[nrpe2nodexp-mariadb_replica_sql_state_s1.timer]
  
  -    ensure   => stopped
  -    before   => ['Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_state_s1.timer (nrpe2nodexp-mariadb_replica_sql_state_s1.timer)]']
  -    provider => systemd
  -    enable   => False
  

• File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_lag_s1.timer]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_lag_s1.timer].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_lag_s1.timer]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mariadb_replica_sql_lag_s1.timer (nrpe2nodexp-mariadb_replica_sql_lag_s1.timer)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_lag_s1.timer.orig
  +++ /lib/systemd/system/nrpe2nodexp-mariadb_replica_sql_lag_s1.timer
  @@ -1,14 +0,0 @@
  -[Unit]
  -Description=Periodic execution of nrpe2nodexp-mariadb_replica_sql_lag_s1.service
  -
  -[Timer]
  -Unit=nrpe2nodexp-mariadb_replica_sql_lag_s1.service
  -# Accuracy sets the maximum time interval around the execution time we want to allow
  -AccuracySec=15sec
  -OnUnitInactiveSec=1min
  -OnActiveSec=1s
  -RandomizedDelaySec=60
  -FixedRandomDelay=true
  -
  -[Install]
  -WantedBy=multi-user.target

• File[/etc/mysql/my.cnf]

  Parameters differences:

  --- File[/etc/mysql/my.cnf].orig
  +++ File[/etc/mysql/my.cnf]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  

• Motd::Script[db-section-s1]

  Parameters differences:

  --- Motd::Script[db-section-s1].orig
  +++ Motd::Script[db-section-s1]
  
  -    ensure   => present
  -    priority => 6
  

• File[/lib/systemd/system/nrpe2nodexp-mariadb_memory.timer]

  Parameters differences:

  --- File[/lib/systemd/system/nrpe2nodexp-mariadb_memory.timer].orig
  +++ File[/lib/systemd/system/nrpe2nodexp-mariadb_memory.timer]
  
  -    owner  => root
  -    ensure => absent
  -    group  => root
  -    mode   => 0444
  -    notify => Exec[systemd daemon-reload for nrpe2nodexp-mariadb_memory.timer (nrpe2nodexp-mariadb_memory.timer)]
  

  Content differences:

  --- /lib/systemd/system/nrpe2nodexp-mariadb_memory.timer.orig
  +++ /lib/systemd/system/nrpe2nodexp-mariadb_memory.timer
  @@ -1,14 +0,0 @@
  -[Unit]
  -Description=Periodic execution of nrpe2nodexp-mariadb_memory.service
  -
  -[Timer]
  -Unit=nrpe2nodexp-mariadb_memory.service
  -# Accuracy sets the maximum time interval around the execution time we want to allow
  -AccuracySec=15sec
  -OnUnitInactiveSec=1min
  -OnActiveSec=1s
  -RandomizedDelaySec=60
  -FixedRandomDelay=true
  -
  -[Install]
  -WantedBy=multi-user.target

• Concat_file[/etc/mysql/ssl/cert.pem]

  Parameters differences:

  --- Concat_file[/etc/mysql/ssl/cert.pem].orig
  +++ Concat_file[/etc/mysql/ssl/cert.pem]
  
  -    replace        => True
  -    ensure_newline => False
  -    mode           => 0644
  -    backup         => puppet
  -    tag            => _etc_mysql_ssl_cert.pem
  -    force          => False
  -    format         => plain
  -    show_diff      => True
  -    order          => alpha
  

• Systemd::Syslog[wmf_auto_restart_prometheus-mysqld-exporter_s1]

  Parameters differences:

  --- Systemd::Syslog[wmf_auto_restart_prometheus-mysqld-exporter_s1].orig
  +++ Systemd::Syslog[wmf_auto_restart_prometheus-mysqld-exporter_s1]
  
  -    programname_comparison => startswith
  -    owner                  => root
  -    log_filename           => syslog.log
  -    ensure                 => present
  -    base_dir               => /var/log
  -    group                  => root
  -    readable_by            => all
  -    force_stop             => True
  

• Package[python3-wmfmariadbpy]

  Parameters differences:

  --- Package[python3-wmfmariadbpy].orig
  +++ Package[python3-wmfmariadbpy]
  
  -    ensure   => installed
  -    provider => apt
  

• File[/etc/wmfmariadbpy/section_ports.csv]

  Parameters differences:

  --- File[/etc/wmfmariadbpy/section_ports.csv].orig
  +++ File[/etc/wmfmariadbpy/section_ports.csv]
  
  -    owner  => root
  -    ensure => file
  -    mode   => 0644
  -    group  => root
  

  Content differences:

  --- /etc/wmfmariadbpy/section_ports.csv.orig
  +++ /etc/wmfmariadbpy/section_ports.csv
  @@ -1,19 +0,0 @@
  -s1, 3311
  -s2, 3312
  -s3, 3313
  -s4, 3314
  -s5, 3315
  -s6, 3316
  -s7, 3317
  -s8, 3318
  -x1, 3320
  -x3, 3363
  -m1, 3321
  -m2, 3322
  -m3, 3323
  -m5, 3325
  -staging, 3350
  -matomo, 3351
  -analytics_meta, 3352
  -backup1-eqiad, 3360
  -backup1-codfw, 3361

• Concat_fragment[/etc/mysql_puppet_agent_cert]

  Parameters differences:

  --- Concat_fragment[/etc/mysql_puppet_agent_cert].orig
  +++ Concat_fragment[/etc/mysql_puppet_agent_cert]
  
  -    order  => 01
  -    source => /var/lib/puppet/ssl/certs/db2141.codfw.wmnet.pem
  -    tag    => _etc_mysql_ssl_cert.pem
  -    target => /etc/mysql/ssl/cert.pem
  

• File[/var/lib/prometheus/.my.s1.cnf]

  Parameters differences:

  --- File[/var/lib/prometheus/.my.s1.cnf].orig
  +++ File[/var/lib/prometheus/.my.s1.cnf]
  
  -    owner  => prometheus
  -    ensure => present
  -    group  => prometheus
  -    mode   => 0400
  -    notify => Exec[systemctl try-restart prometheus-mysqld-exporter@s1]
  

  Content differences:

  --- /var/lib/prometheus/.my.s1.cnf.orig
  +++ /var/lib/prometheus/.my.s1.cnf
  @@ -1,5 +0,0 @@
  -[client]
  -socket = /run/mysqld/mysqld.s1.sock
  -user = prometheus
  -password = 'This is a fake passsword, but cannot be empty due to Debian #953040'
  -ssl = false

• Exec[systemd daemon-reload for nrpe2nodexp-mysqld.timer (nrpe2nodexp-mysqld.timer)]

  Parameters differences:

  --- Exec[systemd daemon-reload for nrpe2nodexp-mysqld.timer (nrpe2nodexp-mysqld.timer)].orig
  +++ Exec[systemd daemon-reload for nrpe2nodexp-mysqld.timer (nrpe2nodexp-mysqld.timer)]
  
  -    refreshonly => True
  -    command     => /bin/systemctl daemon-reload
  

Relevant files

• Production catalog
• Change catalog
• Production errors/warnings
• Change errors/warnings
• Core Diff
• Standard Diff