Author Topic: Are files removed from TOSEC dats ?  (Read 280 times)

Offline peo

  • Newbie
  • *
  • Posts: 12
    • Email
Are files removed from TOSEC dats ?
« on: January 27, 2018, 02:24:27 PM »
Hello,

Just finished scanning (of course, with my own tool for *NIX/whatever written in PHP) of all directories containing Amiga floppy disk images, and sorted them out using the current Amiga Floppy TOSEC dats.

I have a few thousands left-overs, not yet checked for duplicates (again, using my tool :) ), from different sources, but at least a few of those coming from earlier Amiga Floppy TOSEC, can just name a few:

Applications:
Maxon Cinema 4D v1.5 (1994)(MAXON Computer)(DE)(Disk 1 of 4)[cr Famous O'Hack][FD-HD]
(disk 1-4)
(When searching for "Maxon Cinema" in the dats, again with my tool, I find "Maxon Cinema 4D Professional", versions 2.1, 3.0 and 3.1)

Coverdisks:
AC's Tech For The Commodore Amiga Vol 1 Issue 1 (1990)(PiM Publications)(US)[Dec 1990]
(vol 1-4, issue 1-4 in each except the last one which might have been the final)
(Searching gives no results)

.. and a lot of more in "Games" ..

All of these left-overs are from Amiga Floppy TOSEC 2012-07-28, about 250 floppy images in total.

As I ask in the subject, are files removed like this ? Is there dat files for these removed content, and possibly with a reason for removal ?

/PeO



Offline mai

  • TOSEC Member
  • Full Member
  • ***
  • Posts: 175
Re: Are files removed from TOSEC dats ?
« Reply #1 on: January 27, 2018, 04:55:17 PM »
Hello,

Just finished scanning (of course, with my own tool for *NIX/whatever written in PHP) of all directories containing Amiga floppy disk images, and sorted them out using the current Amiga Floppy TOSEC dats.

I have a few thousands left-overs, not yet checked for duplicates (again, using my tool :) ), from different sources, but at least a few of those coming from earlier Amiga Floppy TOSEC, can just name a few:

Applications:
Maxon Cinema 4D v1.5 (1994)(MAXON Computer)(DE)(Disk 1 of 4)[cr Famous O'Hack][FD-HD]
(disk 1-4)
(When searching for "Maxon Cinema" in the dats, again with my tool, I find "Maxon Cinema 4D Professional", versions 2.1, 3.0 and 3.1)

Coverdisks:
AC's Tech For The Commodore Amiga Vol 1 Issue 1 (1990)(PiM Publications)(US)[Dec 1990]
(vol 1-4, issue 1-4 in each except the last one which might have been the final)
(Searching gives no results)

.. and a lot of more in "Games" ..

All of these left-overs are from Amiga Floppy TOSEC 2012-07-28, about 250 floppy images in total.

As I ask in the subject, are files removed like this ? Is there dat files for these removed content, and possibly with a reason for removal ?


Both mentioned sets are still in current TOSEC release!

Offline peo

  • Newbie
  • *
  • Posts: 12
    • Email
Re: Are files removed from TOSEC dats ?
« Reply #2 on: January 27, 2018, 07:11:51 PM »
Ok, have to recheck my .dat parser code that should put everything in the MySQL database..

Offline peo

  • Newbie
  • *
  • Posts: 12
    • Email
Re: Are files removed from TOSEC dats ?
« Reply #3 on: January 27, 2018, 07:19:37 PM »
.. and .. found the problem ..
... "Famous O'Hack]" ...
... "AC's Tech" ...
and probably more with names containing '

Offline peo

  • Newbie
  • *
  • Posts: 12
    • Email
Re: Are files removed from TOSEC dats ?
« Reply #4 on: January 27, 2018, 08:43:47 PM »
Problem solved, but I still get 125 left-overs from the Amiga Floppy TOSEC (2010-11-12)..
Some of these (more known names):
./Games/[ADF]/Super Cars II (1991)(Gremlin)(Disk 2 of 2)[cr SR].adf
md5: ebb6208cc02934cbe2e47b49c778a888

./Games/[ADF]/Alien Breed II - The Horror Continues (1993)(Team 17)(Disk 1 of 3)[cr FLT][t +25 INS][a].adf
md5: 5b908174104a635ab1a4aca77ee53146

./Games/[ADF]/Turrican II - The Final Fight (1991)(Rainbow Arts)(Disk 2 of 2)[cr Defjam][a6].adf
md5: 9dbd5aa41420cb5ee8c7b502e6d48cfc

./Games/[ADF]/Alien Breed II - The Horror Continues (demo-playable) (1993)(Team 17)[h QTX][The One Amiga - Dec 1993].adf
md5: 3c1bc76934fac74d6386a814f9b9cd0d

For the above, I searched for the MD5-sum in all of the Amiga floppy dats without any results.

Only 4 left-overs in the previously mentioned 2012-07-28 release.

Offline mai

  • TOSEC Member
  • Full Member
  • ***
  • Posts: 175
Re: Are files removed from TOSEC dats ?
« Reply #5 on: January 27, 2018, 09:26:14 PM »

Offline peo

  • Newbie
  • *
  • Posts: 12
    • Email
Re: Are files removed from TOSEC dats ?
« Reply #6 on: February 09, 2018, 10:43:32 PM »
I read that thread just as you posted it.. it really does not answer the whole question.

As I've understood, files have been deleted for various reasons from the TOSEC dats, giving me those leftovers from my .adf collection mixed from different sources (I even have some useless names like "DISK1.adf", but can track them back to what game/app they might belong to using old file system listings).

For now, I have 1678 leftovers with unique MD5s. Is there some dat file that is able to track these checksums ?

Offline mai

  • TOSEC Member
  • Full Member
  • ***
  • Posts: 175
Re: Are files removed from TOSEC dats ?
« Reply #7 on: February 10, 2018, 12:51:28 PM »


For now, I have 1678 leftovers with unique MD5s. Is there some dat file that is able to track these checksums ?
What means 1678 leftovers, 1678 which were before in TOSEC?
Just create dat file of this leftovers and upload somewhere!

Offline Duncan Twain

  • TOSEC Member
  • Sr. Member
  • ****
  • Posts: 465
Re: Are files removed from TOSEC dats ?
« Reply #8 on: February 10, 2018, 03:00:10 PM »
I've removed a couple of files from the C64 collection. I recollect having taken out a .prg data file that only made sense in the context of a .d64.

Offline peo

  • Newbie
  • *
  • Posts: 12
    • Email
Re: Are files removed from TOSEC dats ?
« Reply #9 on: February 10, 2018, 04:15:03 PM »
What means 1678 leftovers, 1678 which were before in TOSEC?
Just create dat file of this leftovers and upload somewhere!
Most of them are not correctly named to have been in TOSEC, but around 170 (quick search for [ or ( in file name) have names according to TOSEC.
I will double check against old TOSEC/Amiga dats that are available before creating a dat of the files and uploading it "somewehre"..