• .bad QWK files

    From Bob Roberts@1:103/705 to All on Wed Jul 14 11:44:20 2021
    I've got a few .bad QWK files in my /sbbs/data directory.

    When I rename them back to their original name (removing the random characters and the .bad) then force the job to import them, I get this error:

    QNET /sbbs/data/STARFRON.qwk doesn't contain MESSAGES.DAT (/sbbs/temp/event/MESSAGES.DAT)

    Why would a QWK not contain a MESSAGES.DAT?

    Bob Roberts

    ---
    þ Synchronet þ Halls of Valhalla =San=Francisco= hovalbbs.com:2333
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Bob Roberts@1:103/705 to All on Wed Jul 14 13:36:10 2021
    Re: .bad QWK files
    By: Bob Roberts to All on Wed Jul 14 2021 11:44 am

    QNET /sbbs/data/STARFRON.qwk doesn't contain MESSAGES.DAT (/sbbs/temp/event/MESSAGES.DAT)
    Why would a QWK not contain a MESSAGES.DAT?

    When I manually unzip the file I get:

    Archive: STARFRON.qwk.60ef4892.bad
    inflating: HEADERS.DAT
    inflating: MESSAGES.DAT
    inflating: VOTING.DAT
    error: invalid zip file with overlapped components (possible zip bomb)

    The MESSAGES.DAT that is extracted, seems to be valid.... I see a row with a message in it.

    Bob Roberts

    ---
    þ Synchronet þ Halls of Valhalla =San=Francisco= hovalbbs.com:2333
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Digital Man@1:103/705 to Bob Roberts on Wed Jul 14 17:27:12 2021
    Re: .bad QWK files
    By: Bob Roberts to All on Wed Jul 14 2021 11:44 am

    I've got a few .bad QWK files in my /sbbs/data directory.

    When I rename them back to their original name (removing the random characters and the .bad) then force the job to import them, I get this error:

    QNET /sbbs/data/STARFRON.qwk doesn't contain MESSAGES.DAT (/sbbs/temp/event/MESSAGES.DAT)

    Why would a QWK not contain a MESSAGES.DAT?

    That's a good qestion for the sysop of your hub (STARFRON). It would help if you verified it is a valid archive (e.g. ZIP file) and then perhaps list the contents of that zip file.
    --
    digital man

    Synchronet "Real Fact" #117:
    Synchronet v1b r0 (for MS-DOS) was released on September 25, 1992
    Norco, CA WX: 85.1øF, 49.0% humidity, 18 mph NE wind, 0.00 inches rain/24hrs --- SBBSecho 3.14-Linux
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Digital Man@1:103/705 to Bob Roberts on Wed Jul 14 17:31:44 2021
    Re: .bad QWK files
    By: Bob Roberts to All on Wed Jul 14 2021 01:36 pm

    Re: .bad QWK files
    By: Bob Roberts to All on Wed
    Jul 14 2021 11:44 am

    QNET /sbbs/data/STARFRON.qwk doesn't contain MESSAGES.DAT (/sbbs/temp/event/MESSAGES.DAT)
    Why would a QWK not contain a MESSAGES.DAT?

    When I manually unzip the file I get:

    Archive: STARFRON.qwk.60ef4892.bad
    inflating: HEADERS.DAT
    inflating: MESSAGES.DAT
    inflating: VOTING.DAT
    error: invalid zip file with overlapped components (possible zip bomb)

    The MESSAGES.DAT that is extracted, seems to be valid.... I see a row with a message in it.

    See if you can view or extract the archive with exec/archive.js
    (e.g. 'jsexec archive list /path/to/*.bad') or replace 'list' with extract to try and extract it. This will use the libarchive support built-into SBBS v3.19. It's possible the archive is corrupt even though at least some of it can be extracted successfully using unzip.
    --
    digital man

    Synchronet/BBS Terminology Definition #80:
    TCP = Transmission Control Protocol
    Norco, CA WX: 84.3øF, 50.0% humidity, 19 mph ENE wind, 0.00 inches rain/24hrs --- SBBSecho 3.14-Linux
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Bob Roberts@1:103/705 to Digital Man on Thu Jul 15 10:56:36 2021
    Re: .bad QWK files
    By: Digital Man to Bob Roberts on Wed Jul 14 2021 05:31 pm

    See if you can view or extract the archive with exec/archive.js
    (e.g. 'jsexec archive list /path/to/*.bad') or replace 'list' with extract to try and extract it. This will use the libarchive support built-into SBBS v3.19. It's possible the archive is corrupt even though at least some of it can be extracted successfully using unzip. --

    If I "archive list"

    JSexec v3.19a-Linux master/02297d1a2 - Execute Synchronet JavaScript Module Compiled Jul 14 2021 14:51:09 with GCC 9.3.0

    Loading configuration files from /sbbs/ctrl
    JavaScript-C 1.8.5 2011-03-31
    JavaScript: Creating runtime: 8388608 bytes

    Reading script from /sbbs/exec/archive.js
    /sbbs/exec/archive.js compiled in 0.00 seconds
    !STARFRON.qwk.60ef3032.bad: Unsupported archive format
    /sbbs/exec/archive.js executed in 0.00 seconds

    JavaScript: Destroying context
    JavaScript: Destroying runtime

    If I "archive extract"

    JSexec v3.19a-Linux master/02297d1a2 - Execute Synchronet JavaScript Module Compiled Jul 14 2021 14:51:09 with GCC 9.3.0

    Loading configuration files from /sbbs/ctrl
    JavaScript-C 1.8.5 2011-03-31
    JavaScript: Creating runtime: 8388608 bytes

    Reading script from /sbbs/exec/archive.js
    /sbbs/exec/archive.js compiled in 0.00 seconds
    !JavaScript /sbbs/exec/archive.js line 38: Error: archive_read_next_header returned -30: Invalid central directory signature (after extracting 0 items successfully)
    /sbbs/exec/archive.js executed in 0.00 seconds
    !Module (archive) set exit_code: 1

    JavaScript: Destroying context
    JavaScript: Destroying runtime

    Returning error code: 1

    So looks like something is wrong with the Zips coming from STARFRON. I uploaded three of them (in a zip) here, if you want to take a look?

    https://hovalbbs.com/temp/STARFRONbads.zip

    Bob Roberts

    ---
    þ Synchronet þ Halls of Valhalla =San=Francisco= hovalbbs.com:2333
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Digital Man@1:103/705 to Bob Roberts on Thu Jul 15 17:36:32 2021
    Re: .bad QWK files
    By: Bob Roberts to Digital Man on Thu Jul 15 2021 10:56 am

    Re: .bad QWK files
    By: Digital Man to Bob Roberts on
    Wed Jul 14 2021 05:31 pm

    See if you can view or extract the archive with exec/archive.js
    (e.g. 'jsexec archive list /path/to/*.bad') or replace 'list' with extract to try and extract it. This will use the libarchive support built-into SBBS v3.19. It's possible the archive is corrupt even though at least some of it can be extracted successfully using unzip. --

    If I "archive list"

    !STARFRON.qwk.60ef3032.bad: Unsupported archive format

    I added a little bit more debug (log the exception), and I see:

    Error: archive_read_next_header() returned -30: Invalid central directory signature
    !STARFRON.qwk.60ef3032.bad: Unsupported archive format

    Reading script from /sbbs/exec/archive.js
    /sbbs/exec/archive.js compiled in 0.00 seconds
    !JavaScript /sbbs/exec/archive.js line 38: Error: archive_read_next_header returned -30: Invalid central directory signature (after extracting 0 items successfully)

    I see the same.

    So looks like something is wrong with the Zips coming from STARFRON.

    I agree.

    I
    uploaded three of them (in a zip) here, if you want to take a look?

    https://hovalbbs.com/temp/STARFRONbads.zip

    I see the same errors reported by 'unzip -t' (using UnZip 6.00):
    $ unzip -t STARFRON.qwk.60d4*
    Archive: STARFRON.qwk.60d4e861.bad
    testing: HEADERS.DAT OK
    testing: MESSAGES.DAT OK
    testing: VOTING.DAT OK
    error: invalid zip file with overlapped components (possible zip bomb)

    and I see something interesting with PkUNZIP -test (v2.50):

    Testing files from .ZIP: STARFRON.qwk.60ef3032.bad
    Testing: HEADERS.DAT OK
    Testing: OK
    Testing: MESSAGES.DAT OK
    Testing: VOTING.DAT OK

    See that blank file entry? That's suspicious.

    I guess more information is needed from the sysop of Star Frontiers.

    It's interestingly hosted at synchronetbbs.org, so other hosted BBSes there might have the same or similar issue (!).
    --
    digital man

    Breaking Bad quote #10:
    Get a big old raging hard-on at the idea of catching this piece of shit! - Hank Norco, CA WX: 85.6øF, 44.0% humidity, 18 mph NE wind, 0.00 inches rain/24hrs --- SBBSecho 3.14-Linux
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Bob Roberts@1:103/705 to Melkor on Fri Jul 16 08:07:40 2021
    Re: .bad QWK files
    By: Digital Man to Bob Roberts on Thu Jul 15 2021 05:36 pm


    Hi Melkor,

    I've been having some problems with the QWK network files from your BBS (for Starnet). The problem started early this month, and since then all the QWK packets from you (for Starnet) are corrupt zip files. The issue is described below based on my dialog with DM.

    See if you can view or extract the archive with exec/archive.js
    (e.g. 'jsexec archive list /path/to/*.bad') or replace 'list' with
    extract to try and extract it. This will use the libarchive
    support built-into SBBS v3.19. It's possible the archive is
    corrupt even though at least some of it can be extracted
    successfully using unzip. --

    If I "archive list"

    !STARFRON.qwk.60ef3032.bad: Unsupported archive format

    I added a little bit more debug (log the exception), and I see:

    Error: archive_read_next_header() returned -30: Invalid central directory signature !STARFRON.qwk.60ef3032.bad: Unsupported archive format

    Reading script from /sbbs/exec/archive.js
    /sbbs/exec/archive.js compiled in 0.00 seconds
    !JavaScript /sbbs/exec/archive.js line 38: Error:
    archive_read_next_header returned -30: Invalid central directory
    signature (after extracting 0 items successfully)

    I see the same.

    So looks like something is wrong with the Zips coming from STARFRON.

    I agree.

    I
    uploaded three of them (in a zip) here, if you want to take a look?

    https://hovalbbs.com/temp/STARFRONbads.zip

    I see the same errors reported by 'unzip -t' (using UnZip 6.00):
    $ unzip -t STARFRON.qwk.60d4*
    Archive: STARFRON.qwk.60d4e861.bad
    testing: HEADERS.DAT OK
    testing: MESSAGES.DAT OK
    testing: VOTING.DAT OK
    error: invalid zip file with overlapped components (possible zip bomb)

    and I see something interesting with PkUNZIP -test (v2.50):

    Testing files from .ZIP: STARFRON.qwk.60ef3032.bad
    Testing: HEADERS.DAT OK
    Testing: OK
    Testing: MESSAGES.DAT OK
    Testing: VOTING.DAT OK

    See that blank file entry? That's suspicious.

    I guess more information is needed from the sysop of Star Frontiers.

    It's interestingly hosted at synchronetbbs.org, so other hosted BBSes there might have the same or similar issue (!). --
    digital man

    Bob Roberts

    ---
    þ Synchronet þ Halls of Valhalla =San=Francisco= hovalbbs.com:2333
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Marisag@1:103/705 to Digital Man on Fri Jul 16 21:41:00 2021
    Re: .bad QWK files
    By: Digital Man to Bob Roberts on Thu Jul 15 2021 05:36 pm

    So looks like something is wrong with the Zips coming from STARFRON.

    I agree.
    It's interestingly hosted at synchronetbbs.org, so other hosted BBSes there might have the same or similar issue (!).

    I will look into it but haven't heard of this issue before... If you come up with some suggestions I will be glad to hear them!

    Marisa

    ---
    þ Synchronet þ Sent from the Classic Mac BBS
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Digital Man@1:103/705 to Marisag on Sat Jul 17 12:24:48 2021
    Re: .bad QWK files
    By: Marisag to Digital Man on Fri Jul 16 2021 09:41 pm

    Re: .bad QWK files
    By: Digital Man to Bob Roberts on Thu Jul 15 2021 05:36 pm

    So looks like something is wrong with the Zips coming from STARFRON.

    I agree.
    It's interestingly hosted at synchronetbbs.org, so other hosted BBSes there might have the same or similar issue (!).

    I will look into it but haven't heard of this issue before... If you come up with some suggestions I will be glad to hear them!

    Well first would be to see if all the hosted Synchronet instances on your server(s) have this same issue. Are they all running the same build or version of Synchronet or are they updated (i.e. from Git) separately?

    Since Synchronet v3.19 uses libarchive by default for the creation of zip files, it smells like a libarchive issue.
    --
    digital man

    Synchronet/BBS Terminology Definition #50:
    LF = Line Feed (ASCII 10, Ctrl-J)
    Norco, CA WX: 86.8øF, 38.0% humidity, 4 mph ENE wind, 0.00 inches rain/24hrs --- SBBSecho 3.14-Linux
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)
  • From Marisag@1:103/705 to Digital Man on Mon Jul 19 04:48:52 2021
    Re: .bad QWK files
    By: Digital Man to Marisag on Sat Jul 17 2021 12:24 pm

    Havent seen this issue on any other BBS. Each BBS I provide is runniong on a different server, so maybe the users in question might have done something on their host? Maybe updating the SBBS installation on them should be updated...

    Marisa

    ---
    þ Synchronet þ Sent from the Classic Mac BBS
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)