February 2020 - Mailman-users - lists.mailman3.org

Thread matching query does not exist
by andrew.bernard＠gmail.com March 19, 2020

March 19, 2020

Now I am seeing this in the log every few seconds: 12:12:29 [Q] INFO Process-1:4 processing [rebuild_thread_cache_votes] 12:12:29 [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching query does not exist. : Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/django_q-1.0.1-py3.7.egg/django_q/cluster.py", line 377, in worker res = f(*task['args'], **task['kwargs']) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.2.3-py3.7.egg/hyperkitty/tasks.py", line 189, in _rebuild_thread_cache_votes thread = Thread.objects.get(id=thread_id) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.egg/django/db/models/manager.py", line 82, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.egg/django/db/models/query.py", line 399, in get self.model._meta.object_name hyperkitty.models.thread.Thread.DoesNotExist: Thread matching query does not exist. Any help? How do I identify the thread in question? I imported an archive from a Listserv list, processed into something resembling mbox format (which I now understand not to be a standard at all) and have about 100,000 messages there. I am having a lot of trouble with these sort of errors, as you will see from my flurry of posts recently. Yes, I am running all the jobs. Andrew

3 3

Running customized version of Mailman 3
by Alan Kelm March 3, 2020

March 3, 2020

Since 2005, our organization has been running a customized version of Mailman 2 with extensions that meet our particular needs. The main novelty is support for /fixed subscription lists/, in which the list members are predetermined (corresponding to a "committee"). Fixed list subscribers are not offered the opportunity to unsubscribe, nor can others add themselves to the list. A further enhancement is /hybrid lists/ which, for example, have both a fixed and opt-in part. (This is implemented as a fixed list residing within an opt-in one in a way which is transparent to users). Our customizations consist of code adjustments (patches) to 23 files. We are considering moving to Mailman 3 and would like to do this in a way which makes it possible to periodically upgrade our installation to the newest Mailman version, without clobbering our customizations. Thus, I do not think that installing via "pip" is the right approach for us. While I'm relatively new to git and GitLab, they seem to be ideally suited to this situation. If I understand the developer documentation correctly, I start out by creating a "fork" and can later "fetch" changes from the master branch and "rebase" to bring them into our branch. I would welcome comments on what we are doing. I also wonder whether others might be interested in support for "fixed lists", if they are done in a way which can be "contributed" back into Mailman. I extend our "thank you" to the developers of Mailman who have provided the robust system which has served us well for 15 years and provides the possibility to extend this into the future. -Alan -- Alan Kelm Manager, Electronic Services Canadian Mathematical Society Tel: +1 (613) 733-2662 ext. 799 Please consider the environment. [cms web link] <https://cms.math.ca/> Alan Kelm Chef, services électroniques Société mathématique du Canada Tél : +1 (613) 733-2662 poste 799 Considérez svp l'environnement.

3 5

How to run 'manage.py update_index_one_list' command.
by Frank van den Heuvel Feb. 26, 2020

Feb. 26, 2020

I am importing old archives mbox files from Mailman2. I have fixed the archive mail address to reflect the address of the destination import. These are the steps: 1. sed 's|oldlist@oldexample\.org|testlist@example\.org|g' mbox > mbox.testlist 2. /opt/mailman/mm/bin/django-admin hyperkitty_import --since 01/01/1990 -l testlist(a)example.org mbox.testlist The output of the last command is: Computing thread structure Synchronizing properties with Mailman Warming up cache The full-text search index is not updated for this list. It will not be updated by the 'minutely' incremental update job. \ To update the index for this list, run the 'manage.py update_index_one_list testlist(a)example.org' command. The result is that the e-mail's are imported but not indexed. To finalize this process I am seeking manage.py that will execute the update index command. I am on a Debian 10 with Mailman3 in /opt. locate manage.py returns: /opt/mailman/mm/venv/lib/python3.7/site-packages/django/conf/project_template/manage.py-tpl /opt/mailman/mm/venv/lib/python3.7/site-packages/example_project/manage.py /opt/mailman/mm/venv/lib/python3.7/site-packages/falcon/bench/dj/manage.py None of these python files can execute the needed command. What can I do to get the newly imported posts indexed? Regards, Frank

3 6

Mass unverified subscriptions end up as pending user confirmation instead.
by hansen＠rc.org Feb. 26, 2020

Feb. 26, 2020

After mass subscribing with these settings: Pre confirm: Yes, Pre approved: Yes, Pre Verified (sic): No the addresses appeared in the list's 'Pending user confirmation' list. They were pre-confirmed. The addresses did not appear in the Django Admin's non-verified addresses list. They were not verified. Also why does Postorius lists just 'Pending Approval' and 'Pending Confirmation' but not 'Pending Verification'? Yours, Allan

2 1

Tags in Hyperkitty
by Gila Halpern Feb. 21, 2020

Feb. 21, 2020

Are tags still under development? They don't appear to do anything at the moment, they are not searchable, and clicking on existing tags does nothing.

2 1

leaving Sympa for MM3
by rance.hall＠esu10.org Feb. 21, 2020

Feb. 21, 2020

Our shop is an educational shop and left mailman many years ago for Sympa because of features in Sympa not in mailman. Currently Sympa is showing its age, and is relying on perl modules that have been EOL's and the Sympa community has not discussed (within in ear-shot of me at least) what to do about it. We found that we are not using the extra features Sympa provides anymore and with MM3 already dockerized it seems that MM3 is a much better fit for our organization for the foreseeable future. So I got a dockerized setup up and running in a test environment and am pleased with the results except for now I have to start thinking about migration from Sympa to MM3. The API is useful in this effort as there are python wrappers already done and I didn't have any trouble scripting list creation with the API tools to migrate list owners, moderators and users. Now for the question/hard part. Migrating list archives. In Sympa the list archive is just a maildir format directory structure reflecting month/year. In MM3 the Archive is stored in the db with attributes that are likely only available as the message is processed. I'd really rather not loose the archive data if I can help it. Does anyone have any thoughts on how I could perhaps import this?

2 1

Advice on migrating to Mailman 3
by Christoph Groth Feb. 20, 2020

Feb. 20, 2020

Dear Mailman 3 users, Currently we are hosting the website [1] and mailing list [2] of our free software project with a shared hosting plan of a webhosting company. As such there is no dedicated server, but we do have SSH access (as a regular user) to the shared server. The mailing list software (Mailman 2) is administrated separately by our hoster on a dedicated machine. We are rather happy with this setup: we pay about 10 USD per month and have only little administration work to do. The only problem is that our list runs on Mailman 2. We would like to move to Mailman 3, but this does not seem to be that simple. Perhaps someone here would be so kind to give us advice? The number of (shared) hosters who offer Mailman 3 seems to be very limited [3]. Would it be a good idea to book a virtual private server (VPS) somewhere, that runs, say, Debian, and simply install Mailman 3 through the distribution’s package system? I’m already running a small personal box with nginx on it, and this is very little work, but running Mailman would require sending out up to a few thousand email messages per day (our list has a few hundred subscribers). Is this something that one is commonly allowed to do on a VPS system? Most VPS offers that I see are silent about mail. If we setup such a system, can we assume that it will silently operate without causing much administration work most of the time (like my nginx server)? Or is maintaining a Mailman 3 server a significant burden ([2] seems to imply that)? If yes, are you aware of organizations that propose Mailman 3 hosting for open source projects? Python.org seems to host some lists for third party projects, but otherwise I haven’t seen much. Thanks Christoph [1] https://kwant-project.org/ [2] https://mailman-mail5.webfaction.com/listinfo/kwant-discuss [3] https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/…

6 6

Email verification
by Allan Hansen Feb. 19, 2020

Feb. 19, 2020

Some members cannot get past the email verification when they create their accounts. They insist that they have looked in their spam folders. Their email addresses they entered are correct - the are able to log into their accounts with the right email address. But they get the message saying that a confirmation message was sent and if they don’s see it to contact us. 1. Who is ‘us’? My members are asking... 2. How do I help them? I tried subscribing them to a bogus list with pre-verified email, but that did not work, so both they and I are stuck. Tried finding help in archive, but did not see anything. Yours, Allan Hansen hansen(a)rc.org

4 9

Installing MM3 via pip fails…
by Patrick Ben Koetter Feb. 18, 2020

Feb. 18, 2020

Has anyone managed to install MM3 recently using pip on Ubuntu 18? I followed the instructions at https://docs.mailman3.org/en/latest/install/virtualenv.html#virtualenv-inst…. As soon as I get to the Django part things get hairy. It seems Django requires something that was removed from it. Any ideas or experience how I can get around that? p@rick -- [*] sys4 AG https://sys4.de, +49 (89) 30 90 46 64 Schleißheimer Straße 26/MG,80333 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer, Wolfgang Stief Aufsichtsratsvorsitzender: Florian Kirstein

2 4

No module named 'hyperkitty.urls' after upgrading python3
by jean-christophe manciot Feb. 18, 2020

Feb. 18, 2020

Ubuntu 20.04 python3 3.8.0-3 python3-django-hyperkitty: 1.3.2 ``` Traceback (most recent call last): File "/usr/share/mailman3-web/manage.py", line 10, in <module> execute_from_command_line(sys.argv) File "/usr/lib/python3/dist-packages/django/core/management/__init__.py", line 381, in execute_from_command_line utility.execute() File "/usr/lib/python3/dist-packages/django/core/management/__init__.py", line 375, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/usr/lib/python3/dist-packages/django/core/management/base.py", line 323, in run_from_argv self.execute(*args, **cmd_options) File "/usr/lib/python3/dist-packages/django/core/management/base.py", line 361, in execute self.check() File "/usr/lib/python3/dist-packages/django/core/management/base.py", line 387, in check all_issues = self._run_checks( File "/usr/lib/python3/dist-packages/django/core/management/base.py", line 377, in _run_checks return checks.run_checks(**kwargs) File "/usr/lib/python3/dist-packages/django/core/checks/registry.py", line 72, in run_checks new_errors = check(app_configs=app_configs) File "/usr/lib/python3/dist-packages/django/core/checks/urls.py", line 13, in check_url_config return check_resolver(resolver) File "/usr/lib/python3/dist-packages/django/core/checks/urls.py", line 23, in check_resolver return check_method() File "/usr/lib/python3/dist-packages/django/urls/resolvers.py", line 399, in check for pattern in self.url_patterns: File "/usr/lib/python3/dist-packages/django/utils/functional.py", line 80, in __get__ res = instance.__dict__[self.name] = self.func(instance) File "/usr/lib/python3/dist-packages/django/urls/resolvers.py", line 584, in url_patterns patterns = getattr(self.urlconf_module, "urlpatterns", self.urlconf_module) File "/usr/lib/python3/dist-packages/django/utils/functional.py", line 80, in __get__ res = instance.__dict__[self.name] = self.func(instance) File "/usr/lib/python3/dist-packages/django/urls/resolvers.py", line 577, in urlconf_module return import_module(self.urlconf_name) File "/usr/lib/python3.8/importlib/__init__.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1014, in _gcd_import File "<frozen importlib._bootstrap>", line 991, in _find_and_load File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 671, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 783, in exec_module File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed File "/etc/mailman3/django/urls.py", line 30, in <module> url(r'^hyperkitty/', include('hyperkitty.urls')), File "/usr/lib/python3/dist-packages/django/urls/conf.py", line 34, in include urlconf_module = import_module(urlconf_module) File "/usr/lib/python3.8/importlib/__init__.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1014, in _gcd_import File "<frozen importlib._bootstrap>", line 991, in _find_and_load File "<frozen importlib._bootstrap>", line 973, in _find_and_load_unlocked ModuleNotFoundError: No module named 'hyperkitty.urls' ``` ``` # dpkg --contents python3-django-hyperkitty_1.3.2+b1-20.04_amd64.deb|grep urls -rw-r--r-- root/staff 1356 2020-01-14 12:22 ./usr/local/lib/python3.7/dist-packages/HyperKitty-1.3.2-py3.7.egg/example_project/urls.py -rw-r--r-- root/staff 1043 2020-01-14 12:22 ./usr/local/lib/python3.7/dist-packages/HyperKitty-1.3.2-py3.7.egg/hyperkitty/tests/urls_test.py -rw-r--r-- root/staff 7783 2020-01-14 12:22 ./usr/local/lib/python3.7/dist-packages/HyperKitty-1.3.2-py3.7.egg/hyperkitty/urls.py -rw-r--r-- root/root 1356 2019-09-01 02:56 ./usr/share/doc/python3-django-hyperkitty/examples/urls.py ``` No such issue with python3 3.7.5-3. Any suggestion?

3 6