Compilation results for an-launcher1003.eqiad.wmnet: System changes detected

You can retrieve this result from host.json.

Catalog differences

Summary

Total Resources:	4064
Resources added:	36
Resources removed:	12
Resources modified:	50
Change percentage:	2.41%

Resources only in the new catalog

Systemd::Unit[refinery-sqoop-mediawiki-clouddb.service]
Exec[systemd daemon-reload for refinery-sqoop-mediawiki-production.timer (refinery-sqoop-mediawiki-production.timer)]
Systemd::Service[refinery-sqoop-mediawiki-centralauth-production]
Systemd::Unit[refinery-sqoop-mediawiki-production.timer]
File[/lib/systemd/system/refinery-sqoop-mediawiki-centralauth-production.timer]
File[/lib/systemd/system/refinery-sqoop-mediawiki-clouddb.service]
Systemd::Service[refinery-sqoop-mediawiki-production]
Systemd::Timer[refinery-sqoop-mediawiki-clouddb]
Systemd::Timer[refinery-sqoop-mediawiki-centralauth-production]
Kerberos::Systemd_timer[refinery-sqoop-mediawiki-production]
Service[refinery-sqoop-mediawiki-centralauth-production.timer]
Exec[systemd daemon-reload for refinery-sqoop-mediawiki-clouddb.service (refinery-sqoop-mediawiki-clouddb.service)]
Systemd::Timer::Job[refinery-sqoop-mediawiki-production]
Systemd::Service[refinery-sqoop-mediawiki-clouddb]
File[/usr/local/bin/refinery-sqoop-mediawiki-clouddb]
Systemd::Timer::Job[refinery-sqoop-mediawiki-clouddb]
File[/lib/systemd/system/refinery-sqoop-mediawiki-clouddb.timer]
File[/usr/local/bin/refinery-sqoop-mediawiki-centralauth-production]
File[/lib/systemd/system/refinery-sqoop-mediawiki-centralauth-production.service]
Systemd::Timer::Job[refinery-sqoop-mediawiki-centralauth-production]
Systemd::Unit[refinery-sqoop-mediawiki-centralauth-production.timer]
Exec[systemd daemon-reload for refinery-sqoop-mediawiki-production.service (refinery-sqoop-mediawiki-production.service)]
Systemd::Timer[refinery-sqoop-mediawiki-production]
Exec[systemd daemon-reload for refinery-sqoop-mediawiki-clouddb.timer (refinery-sqoop-mediawiki-clouddb.timer)]
File[/lib/systemd/system/refinery-sqoop-mediawiki-production.service]
Systemd::Unit[refinery-sqoop-mediawiki-centralauth-production.service]
Systemd::Unit[refinery-sqoop-mediawiki-production.service]
Kerberos::Systemd_timer[refinery-sqoop-mediawiki-clouddb]
Systemd::Unit[refinery-sqoop-mediawiki-clouddb.timer]
Exec[systemd daemon-reload for refinery-sqoop-mediawiki-centralauth-production.timer (refinery-sqoop-mediawiki-centralauth-production.timer)]
Exec[systemd daemon-reload for refinery-sqoop-mediawiki-centralauth-production.service (refinery-sqoop-mediawiki-centralauth-production.service)]
Kerberos::Systemd_timer[refinery-sqoop-mediawiki-centralauth-production]
File[/lib/systemd/system/refinery-sqoop-mediawiki-production.timer]
File[/usr/local/bin/refinery-sqoop-mediawiki-production]
Service[refinery-sqoop-mediawiki-clouddb.timer]
Service[refinery-sqoop-mediawiki-production.timer]

Resources only in the old catalog

File[/lib/systemd/system/refinery-sqoop-whole-mediawiki.timer]
Kerberos::Systemd_timer[refinery-sqoop-whole-mediawiki]
Systemd::Timer::Job[refinery-sqoop-whole-mediawiki]
Exec[systemd daemon-reload for refinery-sqoop-whole-mediawiki.timer (refinery-sqoop-whole-mediawiki.timer)]
Exec[systemd daemon-reload for refinery-sqoop-whole-mediawiki.service (refinery-sqoop-whole-mediawiki.service)]
File[/usr/local/bin/refinery-sqoop-whole-mediawiki]
Systemd::Timer[refinery-sqoop-whole-mediawiki]
Systemd::Service[refinery-sqoop-whole-mediawiki]
Service[refinery-sqoop-whole-mediawiki.timer]
Systemd::Unit[refinery-sqoop-whole-mediawiki.timer]
File[/lib/systemd/system/refinery-sqoop-whole-mediawiki.service]
Systemd::Unit[refinery-sqoop-whole-mediawiki.service]

Resources modified

Service[refinery-sqoop-whole-mediawiki.timer]

Parameters differences:

--- Service[refinery-sqoop-whole-mediawiki.timer].orig
+++ Service[refinery-sqoop-whole-mediawiki.timer]

-    ensure   => running
-    enable   => True
-    provider => systemd

Systemd::Unit[refinery-sqoop-whole-mediawiki.timer]

Parameters differences:

--- Systemd::Unit[refinery-sqoop-whole-mediawiki.timer].orig
+++ Systemd::Unit[refinery-sqoop-whole-mediawiki.timer]

-    unit              => refinery-sqoop-whole-mediawiki.timer
-    restart           => False
-    ensure            => present
-    require           => ['Class[Systemd]']
-    override          => False
-    override_filename => puppet-override.conf

Exec[systemd daemon-reload for refinery-sqoop-mediawiki-centralauth-production.timer (refinery-sqoop-mediawiki-centralauth-production.timer)]

Parameters differences:

--- Exec[systemd daemon-reload for refinery-sqoop-mediawiki-centralauth-production.timer (refinery-sqoop-mediawiki-centralauth-production.timer)].orig
+++ Exec[systemd daemon-reload for refinery-sqoop-mediawiki-centralauth-production.timer (refinery-sqoop-mediawiki-centralauth-production.timer)]

+    command     => /bin/systemctl daemon-reload
+    refreshonly => True
+    before      => ['Service[refinery-sqoop-mediawiki-centralauth-production.timer]']

File[/lib/systemd/system/refinery-sqoop-mediawiki-clouddb.timer]

Parameters differences:

--- File[/lib/systemd/system/refinery-sqoop-mediawiki-clouddb.timer].orig
+++ File[/lib/systemd/system/refinery-sqoop-mediawiki-clouddb.timer]

+    notify => Exec[systemd daemon-reload for refinery-sqoop-mediawiki-clouddb.timer (refinery-sqoop-mediawiki-clouddb.timer)]
+    ensure => present
+    owner  => root
+    group  => root
+    mode   => 0444

Content differences:

--- /lib/systemd/system/refinery-sqoop-mediawiki-clouddb.timer.orig
+++ /lib/systemd/system/refinery-sqoop-mediawiki-clouddb.timer
@@ -0,0 +1,12 @@
+[Unit]
+Description=Periodic execution of refinery-sqoop-mediawiki-clouddb.service
+
+[Timer]
+Unit=refinery-sqoop-mediawiki-clouddb.service
+# Accuracy sets the maximum time interval around the execution time we want to allow
+AccuracySec=15sec
+OnCalendar=*-*-01 00:00:00
+RandomizedDelaySec=0
+
+[Install]
+WantedBy=multi-user.target

Systemd::Service[refinery-sqoop-whole-mediawiki]

Parameters differences:

--- Systemd::Service[refinery-sqoop-whole-mediawiki].orig
+++ Systemd::Service[refinery-sqoop-whole-mediawiki]

-    restart                  => False
-    service_params           => {}
-    ensure                   => present
-    monitoring_contact_group => admins
-    monitoring_critical      => False
-    monitoring_enabled       => False
-    unit_type                => timer
-    require                  => Systemd::Unit[refinery-sqoop-whole-mediawiki.service]
-    override                 => False
-    migration_task           => T407130

File[/usr/local/bin/refinery-sqoop-mediawiki-clouddb]

Parameters differences:

--- File[/usr/local/bin/refinery-sqoop-mediawiki-clouddb].orig
+++ File[/usr/local/bin/refinery-sqoop-mediawiki-clouddb]

+    ensure  => present
+    require => ['File[/usr/local/bin/refinery-sqoop-mediawiki-history]', 'File[/usr/local/bin/refinery-sqoop-mediawiki-not-history]']
+    owner   => analytics
+    group   => analytics
+    mode    => 0550

Content differences:

--- /usr/local/bin/refinery-sqoop-mediawiki-clouddb.orig
+++ /usr/local/bin/refinery-sqoop-mediawiki-clouddb
@@ -0,0 +1,13 @@
+#!/bin/bash
+# NOTE: This file is managed by puppet
+#
+# This file is a wrapper running sqoop for whole mediawiki tables.
+# It runs three sqoops in series:
+#   * first sqoops tables necessary for the mediawiki history dataset from clouddb
+#   * if successful, sqoops from the production replicas
+#   * and finally, sqoops the remaining tables we care about from clouddb
+#
+# See each script referenced below for the list of cloud replica and prod replica tables
+
+/usr/local/bin/refinery-sqoop-mediawiki-history \
+  && /usr/local/bin/refinery-sqoop-mediawiki-not-history

Systemd::Service[refinery-sqoop-mediawiki-centralauth-production]

Parameters differences:

--- Systemd::Service[refinery-sqoop-mediawiki-centralauth-production].orig
+++ Systemd::Service[refinery-sqoop-mediawiki-centralauth-production]

+    restart                  => False
+    service_params           => {}
+    ensure                   => present
+    monitoring_contact_group => admins
+    monitoring_critical      => False
+    monitoring_enabled       => False
+    unit_type                => timer
+    require                  => Systemd::Unit[refinery-sqoop-mediawiki-centralauth-production.service]
+    override                 => False
+    migration_task           => T407130

Systemd::Timer[refinery-sqoop-whole-mediawiki]

Parameters differences:

--- Systemd::Timer[refinery-sqoop-whole-mediawiki].orig
+++ Systemd::Timer[refinery-sqoop-whole-mediawiki]

-    fixed_random_delay => False
-    accuracy           => 15sec
-    timer_intervals    => [{'start': 'OnCalendar', 'interval': '*-*-01 00:00:00'}]
-    ensure             => present
-    splay              => 0
-    unit_name          => refinery-sqoop-whole-mediawiki.service

Systemd::Timer::Job[refinery-sqoop-mediawiki-clouddb]

Parameters differences:

--- Systemd::Timer::Job[refinery-sqoop-mediawiki-clouddb].orig
+++ Systemd::Timer::Job[refinery-sqoop-mediawiki-clouddb]

+    syslog_match_startswith   => True
+    logging_enabled           => False
+    private_tmp               => False
+    monitoring_notes_url      => https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
+    ignore_errors             => False
+    syslog_force_stop         => True
+    success_exit_status       => []
+    fixed_random_delay        => False
+    monitoring_enabled        => False
+    interval                  => {'start': 'OnCalendar', 'interval': '*-*-01 00:00:00'}
+    send_mail                 => True
+    send_mail_only_on_error   => True
+    logfile_group             => analytics
+    environment               => {}
+    description               => Schedules sqoop to import clouddb MediaWiki databases into Hadoop monthly.
+    send_mail_to              => data-engineering-alerts@wikimedia.org
+    user                      => analytics
+    command                   => /usr/local/bin/kerberos-run-command analytics /usr/local/bin/refinery-sqoop-mediawiki-clouddb
+    logfile_basedir           => /var/log/
+    ensure                    => present
+    monitoring_contact_groups => admins
+    logfile_name              => syslog.log
+    logfile_owner             => analytics
+    logfile_perms             => all

File[/usr/local/bin/refinery-sqoop-whole-mediawiki]

Parameters differences:

--- File[/usr/local/bin/refinery-sqoop-whole-mediawiki].orig
+++ File[/usr/local/bin/refinery-sqoop-whole-mediawiki]

-    ensure  => present
-    require => ['File[/usr/local/bin/refinery-sqoop-mediawiki-history]', 'File[/usr/local/bin/refinery-sqoop-mediawiki-not-history]', 'File[/usr/local/bin/refinery-sqoop-mediawiki-production-history]', 'File[/usr/local/bin/refinery-sqoop-mediawiki-production-not-history]', 'File[/usr/local/bin/refinery-sqoop-centralauth-production]']
-    owner   => analytics
-    group   => analytics
-    mode    => 0550

Content differences:

--- /usr/local/bin/refinery-sqoop-whole-mediawiki.orig
+++ /usr/local/bin/refinery-sqoop-whole-mediawiki
@@ -1,17 +0,0 @@
-#!/bin/bash
-# NOTE: This file is managed by puppet
-#
-# This file is a wrapper running sqoop for whole mediawiki tables.
-# It runs three sqoops in series:
-#   * first sqoops tables necessary for the mediawiki history dataset from clouddb
-#   * if successful, sqoops from the production replicas
-#   * and finally, sqoops the remaining tables we care about from clouddb
-#
-# See each script referenced below for the list of cloud replica and prod replica tables
-
-/usr/local/bin/refinery-sqoop-mediawiki-history \
-  && /usr/local/bin/refinery-sqoop-mediawiki-production-history \
-  && /usr/local/bin/refinery-sqoop-centralauth-production \
-  && /usr/local/bin/refinery-sqoop-mediawiki-not-history \
-  && /usr/local/bin/refinery-sqoop-mediawiki-production-not-history
-

File[/lib/systemd/system/refinery-sqoop-whole-mediawiki.service]

Parameters differences:

--- File[/lib/systemd/system/refinery-sqoop-whole-mediawiki.service].orig
+++ File[/lib/systemd/system/refinery-sqoop-whole-mediawiki.service]

-    notify => Exec[systemd daemon-reload for refinery-sqoop-whole-mediawiki.service (refinery-sqoop-whole-mediawiki.service)]
-    ensure => present
-    owner  => root
-    group  => root
-    mode   => 0444

Content differences:

--- /lib/systemd/system/refinery-sqoop-whole-mediawiki.service.orig
+++ /lib/systemd/system/refinery-sqoop-whole-mediawiki.service
@@ -1,9 +0,0 @@
-[Unit]
-Description=Schedules sqoop to import whole MediaWiki databases into Hadoop monthly.
-Documentation=https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
-
-[Service]
-Type=oneshot
-User=analytics
-SyslogIdentifier=kerberos-run-command
-ExecStart=/usr/local/bin/systemd-timer-mail-wrapper --subject refinery-sqoop-whole-mediawiki --mail-to data-engineering-alerts@wikimedia.org --only-on-error /usr/local/bin/kerberos-run-command analytics /usr/local/bin/refinery-sqoop-whole-mediawiki

File[/usr/local/bin/refinery-sqoop-mediawiki-production]

Parameters differences:

--- File[/usr/local/bin/refinery-sqoop-mediawiki-production].orig
+++ File[/usr/local/bin/refinery-sqoop-mediawiki-production]

+    ensure  => present
+    require => ['File[/usr/local/bin/refinery-sqoop-mediawiki-production-history]', 'File[/usr/local/bin/refinery-sqoop-mediawiki-production-not-history]']
+    owner   => analytics
+    group   => analytics
+    mode    => 0550

Content differences:

--- /usr/local/bin/refinery-sqoop-mediawiki-production.orig
+++ /usr/local/bin/refinery-sqoop-mediawiki-production
@@ -0,0 +1,14 @@
+#!/bin/bash
+# NOTE: This file is managed by puppet
+#
+# This file is a wrapper running sqoop for whole mediawiki tables.
+# It runs three sqoops in series:
+#   * first sqoops tables necessary for the mediawiki history dataset from clouddb
+#   * if successful, sqoops from the production replicas
+#   * and finally, sqoops the remaining tables we care about from clouddb
+#
+# See each script referenced below for the list of cloud replica and prod replica tables
+
+/usr/local/bin/refinery-sqoop-mediawiki-production-history \
+  && /usr/local/bin/refinery-sqoop-mediawiki-production-not-history
+

File[/lib/systemd/system/refinery-sqoop-whole-mediawiki.timer]

Parameters differences:

--- File[/lib/systemd/system/refinery-sqoop-whole-mediawiki.timer].orig
+++ File[/lib/systemd/system/refinery-sqoop-whole-mediawiki.timer]

-    notify => Exec[systemd daemon-reload for refinery-sqoop-whole-mediawiki.timer (refinery-sqoop-whole-mediawiki.timer)]
-    ensure => present
-    owner  => root
-    group  => root
-    mode   => 0444

Content differences:

--- /lib/systemd/system/refinery-sqoop-whole-mediawiki.timer.orig
+++ /lib/systemd/system/refinery-sqoop-whole-mediawiki.timer
@@ -1,12 +0,0 @@
-[Unit]
-Description=Periodic execution of refinery-sqoop-whole-mediawiki.service
-
-[Timer]
-Unit=refinery-sqoop-whole-mediawiki.service
-# Accuracy sets the maximum time interval around the execution time we want to allow
-AccuracySec=15sec
-OnCalendar=*-*-01 00:00:00
-RandomizedDelaySec=0
-
-[Install]
-WantedBy=multi-user.target

Systemd::Timer[refinery-sqoop-mediawiki-production]

Parameters differences:

--- Systemd::Timer[refinery-sqoop-mediawiki-production].orig
+++ Systemd::Timer[refinery-sqoop-mediawiki-production]

+    fixed_random_delay => False
+    accuracy           => 15sec
+    timer_intervals    => [{'start': 'OnCalendar', 'interval': '*-*-01 00:00:00'}]
+    ensure             => present
+    splay              => 0
+    unit_name          => refinery-sqoop-mediawiki-production.service

Exec[systemd daemon-reload for refinery-sqoop-mediawiki-clouddb.timer (refinery-sqoop-mediawiki-clouddb.timer)]

Parameters differences:

--- Exec[systemd daemon-reload for refinery-sqoop-mediawiki-clouddb.timer (refinery-sqoop-mediawiki-clouddb.timer)].orig
+++ Exec[systemd daemon-reload for refinery-sqoop-mediawiki-clouddb.timer (refinery-sqoop-mediawiki-clouddb.timer)]

+    command     => /bin/systemctl daemon-reload
+    refreshonly => True
+    before      => ['Service[refinery-sqoop-mediawiki-clouddb.timer]']

File[/lib/systemd/system/refinery-sqoop-mediawiki-production.service]

Parameters differences:

--- File[/lib/systemd/system/refinery-sqoop-mediawiki-production.service].orig
+++ File[/lib/systemd/system/refinery-sqoop-mediawiki-production.service]

+    notify => Exec[systemd daemon-reload for refinery-sqoop-mediawiki-production.service (refinery-sqoop-mediawiki-production.service)]
+    ensure => present
+    owner  => root
+    group  => root
+    mode   => 0444

Content differences:

--- /lib/systemd/system/refinery-sqoop-mediawiki-production.service.orig
+++ /lib/systemd/system/refinery-sqoop-mediawiki-production.service
@@ -0,0 +1,9 @@
+[Unit]
+Description=Schedules sqoop to import production MediaWiki databases into Hadoop monthly.
+Documentation=https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
+
+[Service]
+Type=oneshot
+User=analytics
+SyslogIdentifier=kerberos-run-command
+ExecStart=/usr/local/bin/systemd-timer-mail-wrapper --subject refinery-sqoop-mediawiki-production --mail-to data-engineering-alerts@wikimedia.org --only-on-error /usr/local/bin/kerberos-run-command analytics /usr/local/bin/refinery-sqoop-mediawiki-production

Systemd::Unit[refinery-sqoop-mediawiki-production.service]

Parameters differences:

--- Systemd::Unit[refinery-sqoop-mediawiki-production.service].orig
+++ Systemd::Unit[refinery-sqoop-mediawiki-production.service]

+    unit              => refinery-sqoop-mediawiki-production.service
+    restart           => False
+    ensure            => present
+    require           => ['Class[Systemd]']
+    override          => False
+    override_filename => puppet-override.conf

Systemd::Service[refinery-sqoop-mediawiki-clouddb]

Parameters differences:

--- Systemd::Service[refinery-sqoop-mediawiki-clouddb].orig
+++ Systemd::Service[refinery-sqoop-mediawiki-clouddb]

+    restart                  => False
+    service_params           => {}
+    ensure                   => present
+    monitoring_contact_group => admins
+    monitoring_critical      => False
+    monitoring_enabled       => False
+    unit_type                => timer
+    require                  => Systemd::Unit[refinery-sqoop-mediawiki-clouddb.service]
+    override                 => False
+    migration_task           => T407130

Systemd::Unit[refinery-sqoop-mediawiki-clouddb.timer]

Parameters differences:

--- Systemd::Unit[refinery-sqoop-mediawiki-clouddb.timer].orig
+++ Systemd::Unit[refinery-sqoop-mediawiki-clouddb.timer]

+    unit              => refinery-sqoop-mediawiki-clouddb.timer
+    restart           => False
+    ensure            => present
+    require           => ['Class[Systemd]']
+    override          => False
+    override_filename => puppet-override.conf

Exec[systemd daemon-reload for refinery-sqoop-whole-mediawiki.service (refinery-sqoop-whole-mediawiki.service)]

Parameters differences:

--- Exec[systemd daemon-reload for refinery-sqoop-whole-mediawiki.service (refinery-sqoop-whole-mediawiki.service)].orig
+++ Exec[systemd daemon-reload for refinery-sqoop-whole-mediawiki.service (refinery-sqoop-whole-mediawiki.service)]

-    command     => /bin/systemctl daemon-reload
-    refreshonly => True

Systemd::Unit[refinery-sqoop-mediawiki-clouddb.service]

Parameters differences:

--- Systemd::Unit[refinery-sqoop-mediawiki-clouddb.service].orig
+++ Systemd::Unit[refinery-sqoop-mediawiki-clouddb.service]

+    unit              => refinery-sqoop-mediawiki-clouddb.service
+    restart           => False
+    ensure            => present
+    require           => ['Class[Systemd]']
+    override          => False
+    override_filename => puppet-override.conf

Kerberos::Systemd_timer[refinery-sqoop-whole-mediawiki]

Parameters differences:

--- Kerberos::Systemd_timer[refinery-sqoop-whole-mediawiki].orig
+++ Kerberos::Systemd_timer[refinery-sqoop-whole-mediawiki]

-    syslog_match_startswith => True
-    send_mail_to            => data-engineering-alerts@wikimedia.org
-    user                    => analytics
-    command                 => /usr/local/bin/refinery-sqoop-whole-mediawiki
-    logfile_basedir         => /var/log/
-    ensure                  => present
-    syslog_force_stop       => True
-    interval                => *-*-01 00:00:00
-    send_mail               => True
-    logfile_group           => analytics
-    logfile_owner           => analytics
-    require                 => ['File[/usr/local/bin/refinery-sqoop-whole-mediawiki]', 'File[/tmp/sqoop-jars]', 'Class[Kerberos::Wrapper]']
-    environment             => {}
-    description             => Schedules sqoop to import whole MediaWiki databases into Hadoop monthly.
-    logfile_perms           => all

Exec[systemd daemon-reload for refinery-sqoop-mediawiki-centralauth-production.service (refinery-sqoop-mediawiki-centralauth-production.service)]

Parameters differences:

--- Exec[systemd daemon-reload for refinery-sqoop-mediawiki-centralauth-production.service (refinery-sqoop-mediawiki-centralauth-production.service)].orig
+++ Exec[systemd daemon-reload for refinery-sqoop-mediawiki-centralauth-production.service (refinery-sqoop-mediawiki-centralauth-production.service)]

+    command     => /bin/systemctl daemon-reload
+    refreshonly => True

Systemd::Timer::Job[refinery-sqoop-mediawiki-production]

Parameters differences:

--- Systemd::Timer::Job[refinery-sqoop-mediawiki-production].orig
+++ Systemd::Timer::Job[refinery-sqoop-mediawiki-production]

+    syslog_match_startswith   => True
+    logging_enabled           => False
+    private_tmp               => False
+    monitoring_notes_url      => https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
+    ignore_errors             => False
+    syslog_force_stop         => True
+    success_exit_status       => []
+    fixed_random_delay        => False
+    monitoring_enabled        => False
+    interval                  => {'start': 'OnCalendar', 'interval': '*-*-01 00:00:00'}
+    send_mail                 => True
+    send_mail_only_on_error   => True
+    logfile_group             => analytics
+    environment               => {}
+    description               => Schedules sqoop to import production MediaWiki databases into Hadoop monthly.
+    send_mail_to              => data-engineering-alerts@wikimedia.org
+    user                      => analytics
+    command                   => /usr/local/bin/kerberos-run-command analytics /usr/local/bin/refinery-sqoop-mediawiki-production
+    logfile_basedir           => /var/log/
+    ensure                    => present
+    monitoring_contact_groups => admins
+    logfile_name              => syslog.log
+    logfile_owner             => analytics
+    logfile_perms             => all

File[/lib/systemd/system/refinery-sqoop-mediawiki-production.timer]

Parameters differences:

--- File[/lib/systemd/system/refinery-sqoop-mediawiki-production.timer].orig
+++ File[/lib/systemd/system/refinery-sqoop-mediawiki-production.timer]

+    notify => Exec[systemd daemon-reload for refinery-sqoop-mediawiki-production.timer (refinery-sqoop-mediawiki-production.timer)]
+    ensure => present
+    owner  => root
+    group  => root
+    mode   => 0444

Content differences:

--- /lib/systemd/system/refinery-sqoop-mediawiki-production.timer.orig
+++ /lib/systemd/system/refinery-sqoop-mediawiki-production.timer
@@ -0,0 +1,12 @@
+[Unit]
+Description=Periodic execution of refinery-sqoop-mediawiki-production.service
+
+[Timer]
+Unit=refinery-sqoop-mediawiki-production.service
+# Accuracy sets the maximum time interval around the execution time we want to allow
+AccuracySec=15sec
+OnCalendar=*-*-01 00:00:00
+RandomizedDelaySec=0
+
+[Install]
+WantedBy=multi-user.target

Systemd::Service[refinery-sqoop-mediawiki-production]

Parameters differences:

--- Systemd::Service[refinery-sqoop-mediawiki-production].orig
+++ Systemd::Service[refinery-sqoop-mediawiki-production]

+    restart                  => False
+    service_params           => {}
+    ensure                   => present
+    monitoring_contact_group => admins
+    monitoring_critical      => False
+    monitoring_enabled       => False
+    unit_type                => timer
+    require                  => Systemd::Unit[refinery-sqoop-mediawiki-production.service]
+    override                 => False
+    migration_task           => T407130

Systemd::Unit[refinery-sqoop-mediawiki-centralauth-production.timer]

Parameters differences:

--- Systemd::Unit[refinery-sqoop-mediawiki-centralauth-production.timer].orig
+++ Systemd::Unit[refinery-sqoop-mediawiki-centralauth-production.timer]

+    unit              => refinery-sqoop-mediawiki-centralauth-production.timer
+    restart           => False
+    ensure            => present
+    require           => ['Class[Systemd]']
+    override          => False
+    override_filename => puppet-override.conf

File[/usr/local/bin/refinery-sqoop-mediawiki-production-history]

Content differences:

--- /usr/local/bin/refinery-sqoop-mediawiki-production-history.orig
+++ /usr/local/bin/refinery-sqoop-mediawiki-production-history
@@ -8,7 +8,7 @@
     --job-name sqoop-mediawiki-monthly-production-history-$(/bin/date --date="$(/bin/date +%Y-%m-15) -1 month" +'%Y-%m') \
     --output-dir /wmf/data/raw/mediawiki_private/tables \
     --wiki-file /mnt/hdfs/wmf/data/wmf/mediawiki/database/grouped_wikis.csv \
-    --tables actor,comment \
+    --tables actor,comment,content \
     --user getup \
     --password-file /user/analytics/mysql-analytics-research-client-pw.txt \
     --partition-name snapshot \

File[/usr/local/bin/refinery-sqoop-mediawiki-centralauth-production]

Parameters differences:

--- File[/usr/local/bin/refinery-sqoop-mediawiki-centralauth-production].orig
+++ File[/usr/local/bin/refinery-sqoop-mediawiki-centralauth-production]

+    ensure  => present
+    require => File[/usr/local/bin/refinery-sqoop-centralauth-production]
+    owner   => analytics
+    group   => analytics
+    mode    => 0550

Content differences:

--- /usr/local/bin/refinery-sqoop-mediawiki-centralauth-production.orig
+++ /usr/local/bin/refinery-sqoop-mediawiki-centralauth-production
@@ -0,0 +1,12 @@
+#!/bin/bash
+# NOTE: This file is managed by puppet
+#
+# This file is a wrapper running sqoop for whole mediawiki tables.
+# It runs three sqoops in series:
+#   * first sqoops tables necessary for the mediawiki history dataset from clouddb
+#   * if successful, sqoops from the production replicas
+#   * and finally, sqoops the remaining tables we care about from clouddb
+#
+# See each script referenced below for the list of cloud replica and prod replica tables
+
+/usr/local/bin/refinery-sqoop-centralauth-production

Systemd::Unit[refinery-sqoop-mediawiki-centralauth-production.service]

Parameters differences:

--- Systemd::Unit[refinery-sqoop-mediawiki-centralauth-production.service].orig
+++ Systemd::Unit[refinery-sqoop-mediawiki-centralauth-production.service]

+    unit              => refinery-sqoop-mediawiki-centralauth-production.service
+    restart           => False
+    ensure            => present
+    require           => ['Class[Systemd]']
+    override          => False
+    override_filename => puppet-override.conf

Systemd::Timer[refinery-sqoop-mediawiki-clouddb]

Parameters differences:

--- Systemd::Timer[refinery-sqoop-mediawiki-clouddb].orig
+++ Systemd::Timer[refinery-sqoop-mediawiki-clouddb]

+    fixed_random_delay => False
+    accuracy           => 15sec
+    timer_intervals    => [{'start': 'OnCalendar', 'interval': '*-*-01 00:00:00'}]
+    ensure             => present
+    splay              => 0
+    unit_name          => refinery-sqoop-mediawiki-clouddb.service

Systemd::Unit[refinery-sqoop-mediawiki-production.timer]

Parameters differences:

--- Systemd::Unit[refinery-sqoop-mediawiki-production.timer].orig
+++ Systemd::Unit[refinery-sqoop-mediawiki-production.timer]

+    unit              => refinery-sqoop-mediawiki-production.timer
+    restart           => False
+    ensure            => present
+    require           => ['Class[Systemd]']
+    override          => False
+    override_filename => puppet-override.conf

Service[refinery-sqoop-mediawiki-centralauth-production.timer]

Parameters differences:

--- Service[refinery-sqoop-mediawiki-centralauth-production.timer].orig
+++ Service[refinery-sqoop-mediawiki-centralauth-production.timer]

+    ensure   => running
+    enable   => True
+    provider => systemd

File[/lib/systemd/system/refinery-sqoop-mediawiki-clouddb.service]

Parameters differences:

--- File[/lib/systemd/system/refinery-sqoop-mediawiki-clouddb.service].orig
+++ File[/lib/systemd/system/refinery-sqoop-mediawiki-clouddb.service]

+    notify => Exec[systemd daemon-reload for refinery-sqoop-mediawiki-clouddb.service (refinery-sqoop-mediawiki-clouddb.service)]
+    ensure => present
+    owner  => root
+    group  => root
+    mode   => 0444

Content differences:

--- /lib/systemd/system/refinery-sqoop-mediawiki-clouddb.service.orig
+++ /lib/systemd/system/refinery-sqoop-mediawiki-clouddb.service
@@ -0,0 +1,9 @@
+[Unit]
+Description=Schedules sqoop to import clouddb MediaWiki databases into Hadoop monthly.
+Documentation=https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
+
+[Service]
+Type=oneshot
+User=analytics
+SyslogIdentifier=kerberos-run-command
+ExecStart=/usr/local/bin/systemd-timer-mail-wrapper --subject refinery-sqoop-mediawiki-clouddb --mail-to data-engineering-alerts@wikimedia.org --only-on-error /usr/local/bin/kerberos-run-command analytics /usr/local/bin/refinery-sqoop-mediawiki-clouddb

Service[refinery-sqoop-mediawiki-production.timer]

Parameters differences:

--- Service[refinery-sqoop-mediawiki-production.timer].orig
+++ Service[refinery-sqoop-mediawiki-production.timer]

+    ensure   => running
+    enable   => True
+    provider => systemd

File[/lib/systemd/system/refinery-sqoop-mediawiki-centralauth-production.timer]

Parameters differences:

--- File[/lib/systemd/system/refinery-sqoop-mediawiki-centralauth-production.timer].orig
+++ File[/lib/systemd/system/refinery-sqoop-mediawiki-centralauth-production.timer]

+    notify => Exec[systemd daemon-reload for refinery-sqoop-mediawiki-centralauth-production.timer (refinery-sqoop-mediawiki-centralauth-production.timer)]
+    ensure => present
+    owner  => root
+    group  => root
+    mode   => 0444

Content differences:

--- /lib/systemd/system/refinery-sqoop-mediawiki-centralauth-production.timer.orig
+++ /lib/systemd/system/refinery-sqoop-mediawiki-centralauth-production.timer
@@ -0,0 +1,12 @@
+[Unit]
+Description=Periodic execution of refinery-sqoop-mediawiki-centralauth-production.service
+
+[Timer]
+Unit=refinery-sqoop-mediawiki-centralauth-production.service
+# Accuracy sets the maximum time interval around the execution time we want to allow
+AccuracySec=15sec
+OnCalendar=*-*-01 00:00:00
+RandomizedDelaySec=0
+
+[Install]
+WantedBy=multi-user.target

File[/lib/systemd/system/refinery-sqoop-mediawiki-centralauth-production.service]

Parameters differences:

--- File[/lib/systemd/system/refinery-sqoop-mediawiki-centralauth-production.service].orig
+++ File[/lib/systemd/system/refinery-sqoop-mediawiki-centralauth-production.service]

+    notify => Exec[systemd daemon-reload for refinery-sqoop-mediawiki-centralauth-production.service (refinery-sqoop-mediawiki-centralauth-production.service)]
+    ensure => present
+    owner  => root
+    group  => root
+    mode   => 0444

Content differences:

--- /lib/systemd/system/refinery-sqoop-mediawiki-centralauth-production.service.orig
+++ /lib/systemd/system/refinery-sqoop-mediawiki-centralauth-production.service
@@ -0,0 +1,9 @@
+[Unit]
+Description=Schedules sqoop to import centralauth MediaWiki databases into Hadoop monthly.
+Documentation=https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
+
+[Service]
+Type=oneshot
+User=analytics
+SyslogIdentifier=kerberos-run-command
+ExecStart=/usr/local/bin/systemd-timer-mail-wrapper --subject refinery-sqoop-mediawiki-centralauth-production --mail-to data-engineering-alerts@wikimedia.org --only-on-error /usr/local/bin/kerberos-run-command analytics /usr/local/bin/refinery-sqoop-mediawiki-centralauth-production

Systemd::Timer::Job[refinery-sqoop-whole-mediawiki]

Parameters differences:

--- Systemd::Timer::Job[refinery-sqoop-whole-mediawiki].orig
+++ Systemd::Timer::Job[refinery-sqoop-whole-mediawiki]

-    syslog_match_startswith   => True
-    logging_enabled           => False
-    private_tmp               => False
-    monitoring_notes_url      => https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
-    ignore_errors             => False
-    syslog_force_stop         => True
-    success_exit_status       => []
-    fixed_random_delay        => False
-    monitoring_enabled        => False
-    interval                  => {'start': 'OnCalendar', 'interval': '*-*-01 00:00:00'}
-    send_mail                 => True
-    send_mail_only_on_error   => True
-    logfile_group             => analytics
-    environment               => {}
-    description               => Schedules sqoop to import whole MediaWiki databases into Hadoop monthly.
-    send_mail_to              => data-engineering-alerts@wikimedia.org
-    user                      => analytics
-    command                   => /usr/local/bin/kerberos-run-command analytics /usr/local/bin/refinery-sqoop-whole-mediawiki
-    logfile_basedir           => /var/log/
-    ensure                    => present
-    monitoring_contact_groups => admins
-    logfile_name              => syslog.log
-    logfile_owner             => analytics
-    logfile_perms             => all

Kerberos::Systemd_timer[refinery-sqoop-mediawiki-clouddb]

Parameters differences:

--- Kerberos::Systemd_timer[refinery-sqoop-mediawiki-clouddb].orig
+++ Kerberos::Systemd_timer[refinery-sqoop-mediawiki-clouddb]

+    syslog_match_startswith => True
+    send_mail_to            => data-engineering-alerts@wikimedia.org
+    user                    => analytics
+    command                 => /usr/local/bin/refinery-sqoop-mediawiki-clouddb
+    logfile_basedir         => /var/log/
+    ensure                  => present
+    syslog_force_stop       => True
+    interval                => *-*-01 00:00:00
+    send_mail               => True
+    logfile_group           => analytics
+    logfile_owner           => analytics
+    require                 => ['File[/usr/local/bin/refinery-sqoop-mediawiki-clouddb]', 'File[/tmp/sqoop-jars]', 'Class[Kerberos::Wrapper]']
+    environment             => {}
+    description             => Schedules sqoop to import clouddb MediaWiki databases into Hadoop monthly.
+    logfile_perms           => all

Exec[systemd daemon-reload for refinery-sqoop-mediawiki-production.timer (refinery-sqoop-mediawiki-production.timer)]

Parameters differences:

--- Exec[systemd daemon-reload for refinery-sqoop-mediawiki-production.timer (refinery-sqoop-mediawiki-production.timer)].orig
+++ Exec[systemd daemon-reload for refinery-sqoop-mediawiki-production.timer (refinery-sqoop-mediawiki-production.timer)]

+    command     => /bin/systemctl daemon-reload
+    refreshonly => True
+    before      => ['Service[refinery-sqoop-mediawiki-production.timer]']

Systemd::Timer::Job[refinery-sqoop-mediawiki-centralauth-production]

Parameters differences:

--- Systemd::Timer::Job[refinery-sqoop-mediawiki-centralauth-production].orig
+++ Systemd::Timer::Job[refinery-sqoop-mediawiki-centralauth-production]

+    syslog_match_startswith   => True
+    logging_enabled           => False
+    private_tmp               => False
+    monitoring_notes_url      => https://wikitech.wikimedia.org/wiki/Monitoring/systemd_unit_state
+    ignore_errors             => False
+    syslog_force_stop         => True
+    success_exit_status       => []
+    fixed_random_delay        => False
+    monitoring_enabled        => False
+    interval                  => {'start': 'OnCalendar', 'interval': '*-*-01 00:00:00'}
+    send_mail                 => True
+    send_mail_only_on_error   => True
+    logfile_group             => analytics
+    environment               => {}
+    description               => Schedules sqoop to import centralauth MediaWiki databases into Hadoop monthly.
+    send_mail_to              => data-engineering-alerts@wikimedia.org
+    user                      => analytics
+    command                   => /usr/local/bin/kerberos-run-command analytics /usr/local/bin/refinery-sqoop-mediawiki-centralauth-production
+    logfile_basedir           => /var/log/
+    ensure                    => present
+    monitoring_contact_groups => admins
+    logfile_name              => syslog.log
+    logfile_owner             => analytics
+    logfile_perms             => all

Exec[systemd daemon-reload for refinery-sqoop-whole-mediawiki.timer (refinery-sqoop-whole-mediawiki.timer)]

Parameters differences:

--- Exec[systemd daemon-reload for refinery-sqoop-whole-mediawiki.timer (refinery-sqoop-whole-mediawiki.timer)].orig
+++ Exec[systemd daemon-reload for refinery-sqoop-whole-mediawiki.timer (refinery-sqoop-whole-mediawiki.timer)]

-    command     => /bin/systemctl daemon-reload
-    refreshonly => True
-    before      => ['Service[refinery-sqoop-whole-mediawiki.timer]']

Kerberos::Systemd_timer[refinery-sqoop-mediawiki-centralauth-production]

Parameters differences:

--- Kerberos::Systemd_timer[refinery-sqoop-mediawiki-centralauth-production].orig
+++ Kerberos::Systemd_timer[refinery-sqoop-mediawiki-centralauth-production]

+    syslog_match_startswith => True
+    send_mail_to            => data-engineering-alerts@wikimedia.org
+    user                    => analytics
+    command                 => /usr/local/bin/refinery-sqoop-mediawiki-centralauth-production
+    logfile_basedir         => /var/log/
+    ensure                  => present
+    syslog_force_stop       => True
+    interval                => *-*-01 00:00:00
+    send_mail               => True
+    logfile_group           => analytics
+    logfile_owner           => analytics
+    require                 => ['File[/usr/local/bin/refinery-sqoop-mediawiki-centralauth-production]', 'File[/tmp/sqoop-jars]', 'Class[Kerberos::Wrapper]']
+    environment             => {}
+    description             => Schedules sqoop to import centralauth MediaWiki databases into Hadoop monthly.
+    logfile_perms           => all

Exec[systemd daemon-reload for refinery-sqoop-mediawiki-production.service (refinery-sqoop-mediawiki-production.service)]

Parameters differences:

--- Exec[systemd daemon-reload for refinery-sqoop-mediawiki-production.service (refinery-sqoop-mediawiki-production.service)].orig
+++ Exec[systemd daemon-reload for refinery-sqoop-mediawiki-production.service (refinery-sqoop-mediawiki-production.service)]

+    command     => /bin/systemctl daemon-reload
+    refreshonly => True

Service[refinery-sqoop-mediawiki-clouddb.timer]

Parameters differences:

--- Service[refinery-sqoop-mediawiki-clouddb.timer].orig
+++ Service[refinery-sqoop-mediawiki-clouddb.timer]

+    ensure   => running
+    enable   => True
+    provider => systemd

Kerberos::Systemd_timer[refinery-sqoop-mediawiki-production]

Parameters differences:

--- Kerberos::Systemd_timer[refinery-sqoop-mediawiki-production].orig
+++ Kerberos::Systemd_timer[refinery-sqoop-mediawiki-production]

+    syslog_match_startswith => True
+    send_mail_to            => data-engineering-alerts@wikimedia.org
+    user                    => analytics
+    command                 => /usr/local/bin/refinery-sqoop-mediawiki-production
+    logfile_basedir         => /var/log/
+    ensure                  => present
+    syslog_force_stop       => True
+    interval                => *-*-01 00:00:00
+    send_mail               => True
+    logfile_group           => analytics
+    logfile_owner           => analytics
+    require                 => ['File[/usr/local/bin/refinery-sqoop-mediawiki-production]', 'File[/tmp/sqoop-jars]', 'Class[Kerberos::Wrapper]']
+    environment             => {}
+    description             => Schedules sqoop to import production MediaWiki databases into Hadoop monthly.
+    logfile_perms           => all

Systemd::Unit[refinery-sqoop-whole-mediawiki.service]

Parameters differences:

--- Systemd::Unit[refinery-sqoop-whole-mediawiki.service].orig
+++ Systemd::Unit[refinery-sqoop-whole-mediawiki.service]

-    unit              => refinery-sqoop-whole-mediawiki.service
-    restart           => False
-    ensure            => present
-    require           => ['Class[Systemd]']
-    override          => False
-    override_filename => puppet-override.conf

Systemd::Timer[refinery-sqoop-mediawiki-centralauth-production]

Parameters differences:

--- Systemd::Timer[refinery-sqoop-mediawiki-centralauth-production].orig
+++ Systemd::Timer[refinery-sqoop-mediawiki-centralauth-production]

+    fixed_random_delay => False
+    accuracy           => 15sec
+    timer_intervals    => [{'start': 'OnCalendar', 'interval': '*-*-01 00:00:00'}]
+    ensure             => present
+    splay              => 0
+    unit_name          => refinery-sqoop-mediawiki-centralauth-production.service

File[/usr/local/bin/refinery-sqoop-mediawiki-history]

Content differences:

--- /usr/local/bin/refinery-sqoop-mediawiki-history.orig
+++ /usr/local/bin/refinery-sqoop-mediawiki-history
@@ -9,7 +9,7 @@
     --clouddb \
     --output-dir /wmf/data/raw/mediawiki/tables \
     --wiki-file /mnt/hdfs/wmf/data/wmf/mediawiki/database/grouped_wikis.csv \
-    --tables archive,change_tag,change_tag_def,content,logging,page,revision,slots,slot_roles,user,user_groups \
+    --tables archive,change_tag,change_tag_def,logging,page,revision,slots,slot_roles,user,user_groups \
     --user ann \
     --password-file /user/analytics/mysql-analytics-labsdb-client-pw.txt \
     --partition-name snapshot \

Exec[systemd daemon-reload for refinery-sqoop-mediawiki-clouddb.service (refinery-sqoop-mediawiki-clouddb.service)]

Parameters differences:

--- Exec[systemd daemon-reload for refinery-sqoop-mediawiki-clouddb.service (refinery-sqoop-mediawiki-clouddb.service)].orig
+++ Exec[systemd daemon-reload for refinery-sqoop-mediawiki-clouddb.service (refinery-sqoop-mediawiki-clouddb.service)]

+    command     => /bin/systemctl daemon-reload
+    refreshonly => True

Compilation results for an-launcher1003.eqiad.wmnet: System changes detected

Catalog differences

Summary

Resources only in the new catalog

Resources only in the old catalog

Resources modified

Relevant files