TOSECdev Forum

TOSEC Project => General Discussion => Topic started by: peo on January 27, 2018, 02:24:27 PM

Title: Are files removed from TOSEC dats ?
Post by: peo on January 27, 2018, 02:24:27 PM
Hello,

Just finished scanning (of course, with my own tool for *NIX/whatever written in PHP) of all directories containing Amiga floppy disk images, and sorted them out using the current Amiga Floppy TOSEC dats.

I have a few thousands left-overs, not yet checked for duplicates (again, using my tool :) ), from different sources, but at least a few of those coming from earlier Amiga Floppy TOSEC, can just name a few:

Applications:
Maxon Cinema 4D v1.5 (1994)(MAXON Computer)(DE)(Disk 1 of 4)[cr Famous O'Hack][FD-HD]
(disk 1-4)
(When searching for "Maxon Cinema" in the dats, again with my tool, I find "Maxon Cinema 4D Professional", versions 2.1, 3.0 and 3.1)

Coverdisks:
AC's Tech For The Commodore Amiga Vol 1 Issue 1 (1990)(PiM Publications)(US)[Dec 1990]
(vol 1-4, issue 1-4 in each except the last one which might have been the final)
(Searching gives no results)

.. and a lot of more in "Games" ..

All of these left-overs are from Amiga Floppy TOSEC 2012-07-28, about 250 floppy images in total.

As I ask in the subject, are files removed like this ? Is there dat files for these removed content, and possibly with a reason for removal ?

/PeO
Title: Re: Are files removed from TOSEC dats ?
Post by: mai on January 27, 2018, 04:55:17 PM
Hello,

Just finished scanning (of course, with my own tool for *NIX/whatever written in PHP) of all directories containing Amiga floppy disk images, and sorted them out using the current Amiga Floppy TOSEC dats.

I have a few thousands left-overs, not yet checked for duplicates (again, using my tool :) ), from different sources, but at least a few of those coming from earlier Amiga Floppy TOSEC, can just name a few:

Applications:
Maxon Cinema 4D v1.5 (1994)(MAXON Computer)(DE)(Disk 1 of 4)[cr Famous O'Hack][FD-HD]
(disk 1-4)
(When searching for "Maxon Cinema" in the dats, again with my tool, I find "Maxon Cinema 4D Professional", versions 2.1, 3.0 and 3.1)

Coverdisks:
AC's Tech For The Commodore Amiga Vol 1 Issue 1 (1990)(PiM Publications)(US)[Dec 1990]
(vol 1-4, issue 1-4 in each except the last one which might have been the final)
(Searching gives no results)

.. and a lot of more in "Games" ..

All of these left-overs are from Amiga Floppy TOSEC 2012-07-28, about 250 floppy images in total.

As I ask in the subject, are files removed like this ? Is there dat files for these removed content, and possibly with a reason for removal ?


Both mentioned sets are still in current TOSEC release!
Title: Re: Are files removed from TOSEC dats ?
Post by: peo on January 27, 2018, 07:11:51 PM
Ok, have to recheck my .dat parser code that should put everything in the MySQL database..
Title: Re: Are files removed from TOSEC dats ?
Post by: peo on January 27, 2018, 07:19:37 PM
.. and .. found the problem ..
... "Famous O'Hack]" ...
... "AC's Tech" ...
and probably more with names containing '
Title: Re: Are files removed from TOSEC dats ?
Post by: peo on January 27, 2018, 08:43:47 PM
Problem solved, but I still get 125 left-overs from the Amiga Floppy TOSEC (2010-11-12)..
Some of these (more known names):
./Games/[ADF]/Super Cars II (1991)(Gremlin)(Disk 2 of 2)[cr SR].adf
md5: ebb6208cc02934cbe2e47b49c778a888

./Games/[ADF]/Alien Breed II - The Horror Continues (1993)(Team 17)(Disk 1 of 3)[cr FLT][t +25 INS][a].adf
md5: 5b908174104a635ab1a4aca77ee53146

./Games/[ADF]/Turrican II - The Final Fight (1991)(Rainbow Arts)(Disk 2 of 2)[cr Defjam][a6].adf
md5: 9dbd5aa41420cb5ee8c7b502e6d48cfc

./Games/[ADF]/Alien Breed II - The Horror Continues (demo-playable) (1993)(Team 17)[h QTX][The One Amiga - Dec 1993].adf
md5: 3c1bc76934fac74d6386a814f9b9cd0d

For the above, I searched for the MD5-sum in all of the Amiga floppy dats without any results.

Only 4 left-overs in the previously mentioned 2012-07-28 release.
Title: Re: Are files removed from TOSEC dats ?
Post by: mai on January 27, 2018, 09:26:14 PM
see this thread:
https://www.tosecdev.org/forum/work-in-progress/mai-wip/
Title: Re: Are files removed from TOSEC dats ?
Post by: peo on February 09, 2018, 10:43:32 PM
I read that thread just as you posted it.. it really does not answer the whole question.

As I've understood, files have been deleted for various reasons from the TOSEC dats, giving me those leftovers from my .adf collection mixed from different sources (I even have some useless names like "DISK1.adf", but can track them back to what game/app they might belong to using old file system listings).

For now, I have 1678 leftovers with unique MD5s. Is there some dat file that is able to track these checksums ?
Title: Re: Are files removed from TOSEC dats ?
Post by: mai on February 10, 2018, 12:51:28 PM


For now, I have 1678 leftovers with unique MD5s. Is there some dat file that is able to track these checksums ?
What means 1678 leftovers, 1678 which were before in TOSEC?
Just create dat file of this leftovers and upload somewhere!
Title: Re: Are files removed from TOSEC dats ?
Post by: Duncan Twain on February 10, 2018, 03:00:10 PM
I've removed a couple of files from the C64 collection. I recollect having taken out a .prg data file that only made sense in the context of a .d64.
Title: Re: Are files removed from TOSEC dats ?
Post by: peo on February 10, 2018, 04:15:03 PM
What means 1678 leftovers, 1678 which were before in TOSEC?
Just create dat file of this leftovers and upload somewhere!
Most of them are not correctly named to have been in TOSEC, but around 170 (quick search for [ or ( in file name) have names according to TOSEC.
I will double check against old TOSEC/Amiga dats that are available before creating a dat of the files and uploading it "somewehre"..