I want all Fidonet echomail messages ever created.

Is there such an archive ? is it on "textfiles.com", or did some precient coordinator backup all their uncompressed packets somewhere ?

___ Blue Wave/386 v2.30
--- SBBSecho 3.13-Linux
* Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)

On 28 Feb 21 16:48:00, Marceline Jones said the following to Mark Lewis:

it should also be pointed out that the FTN MSGID standard limits MSGIDs to only 3 years before the serial numbers may be repeated... dupe detection will eliminate many...

Then disable dupe detection or limit each segment to 3 years. It is not necessary to have 1 monolith message base containing data for all years at once. The message base can be broken up into static sections. Or somebody c

Nevermind that lazy bullshit that is MSGID... its really just for reply linking which most messages from the 80's and 90's didn't have. The only "challenge" is deciding on a storage method for containing large amounts of messages.

Nothing is ever purged here. I have message bases going back to.... early 2000's I think? Would love to help out or help track down older stuff.

Nick

--- Renegade vY2Ka2
* Origin: Joey, do you like movies about gladiators? (1:229/426)

not to mention that it is about 30 years too late getting started...

It is not too late. Try telling Jason Scott that it is too late.

yes, it is too late because the messages are simply gone... deleted
during system maint as they were purged out due to the operators'
message retention settings... we won't even mention all the ones that
were lost when a message base overflowed and corrupted itself requiring deletion of the message base data files...

People could still submit what they have. This is a history preservation project.

Somebody should set up a Fidonet Archive mailer to process and dedupe all historical mail. All messages get tossed into a database. SysOps can then scan out all their existing message bases, including older ones from backups. It is that easy.

___ Blue Wave/386 v2.30
--- SBBSecho 3.13-Linux
* Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)

Nevermind that lazy bullshit that is MSGID... its really just for
reply linking which most messages from the 80's and 90's didn't have.
The only "challenge" is deciding on a storage method for containing
large amounts of messages.

Any modern database will handle it.

Nothing is ever purged here. I have message bases going back to....
early 2000's I think? Would love to help out or help track down older stuff.
Nick

You can setup multiple D'Bridge nodes to process gigabytes of mail 24/7. Have a web status page or echo announcing statistics (eg. volume, messages processed, number of [new] contributors, echo size etc).

Someone would have to write a tosser for the database.

___ Blue Wave/386 v2.30
--- SBBSecho 3.13-Linux
* Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)

On 07 Mar 21 17:54:00, Marceline Jones said the following to Nick Andre:

Nevermind that lazy bullshit that is MSGID... its really just for reply linking which most messages from the 80's and 90's didn't have. The only "challenge" is deciding on a storage method for containing large amounts of messages.

Any modern database will handle it.

I know. I put the the word challenge in quotes because:

You can setup multiple D'Bridge nodes to process gigabytes of mail 24/7. Ha a web status page or echo announcing statistics (eg. volume, messages processed, number of [new] contributors, echo size etc).

Someone would have to write a tosser for the database.

Not sure if anyone ever attempted to write a tosser for SQL... it would be
an interesting thing to try.

If this idea is to have some sort of Fido history website... what would be kindof cool is to take that idea further with messages in a database that can be rescanned. Have it so that any Sysop can visit that site, they specify
a Fido address, echoes and quantity to scan. The website builds an archive of packets with the desired address that the Sysop can toss back to their BBS running whatever and thus having whatever backlog of mail they wanted.

Nick

--- Renegade vY2Ka2
* Origin: Joey, do you like movies about gladiators? (1:229/426)

On 14 Mar 21 16:45:00, Marceline Jones said the following to Nick Andre:

My initial thoughts were for a downloadable database like Wikipedia that SysOps can use as a datasource for whatever they want. They can build servi around it, write more import/export scripts, use it to catchup missing mail performance and stress test tools etc. The fun lies in the system design an implementation. Maybe it can run on block chain.

I would be supportive of this; mostly for the rescan-ability for missing mail.

Nick

--- Renegade vY2Ka2
* Origin: Joey, do you like movies about gladiators? (1:229/426)