Hi,

I know I can download the archive on a month-by-month basis from:

http://lists.lazarus.freepascal.org/pipermail/lazarus/

Is there some hidden URL where I could download everything as a single download and even better, as a single large mbox file?

Or does anybody know how I can use a bash script or something to merge all the individual files as one large file.

I've written a new email/nntp/rss program which is SQL based and want to put it through its paces with a large volume of emails. eg: hopefully way over 100,000+ messages.

Regards,
- Graeme -

You're not the only one, it seems:
https://mail.python.org/pipermail/mailman-users/2012-October/074208.html

Michael.

Michael Van Canneyt wrote

You're not the only one, it seems: https://mail.python.org/pipermail/mailman-users/2012-October/074208.html

Nice thanks! That will do perfectly.

That got me thinking... I also found that doing a Google search for: pipermail filetype:mbox

found some archives with 10k-20k of messages each.

ps:
A not so nice feature of Lazarus's mailing list archives, is that it mangled the email addresses, removing the @ symbol and replaced it with the word "at" and added some spaces etc. I'll sure I could tweak the importing tool to fix those though.

Regards,
- Graeme -

Graeme Geldenhuys wrote

A not so nice feature of Lazarus's mailing list archives, is that it mangled the email addresses, removing the @ symbol and replaced it with

Ah, I see that script fixes the email address format too. Very nice. Worked like a charm. Ended up with a 134MB file, and its busy importing it now. :)

Regards,
- Graeme -