Duncan's WIP

[Duncan Twain]

Need to move many files from 'Coverdisks' to 'Diskmags' and create subfolder 'Commercial' for commercial diskmags.

[Cassiel]

Why the extra classification? Does weather it was charged for or not really require a new genre?

There's no hard and fast rules on the subject, but personally I'm not a fan of splitting images in this way (have posted my views on this before). Seems fairly pointless at best, and needless complicated at worst (IF you do it/and maintain it, properly).

[Duncan Twain]

Hey Cassiel. Last week I talked to Symmo about this and it looked a good thing to do. I'll reconsider and see what impact both ways will have.

[Cassiel]

Well I don't want to tell you what to do, was just throwing out my (alternative) opinion. You've both has obviously thought about it and discussed it though which is good!

FYI posted my views here:
http://www.tosecdev.org/index.php/forum/index.php?topic=249.msg2903#msg2903

But obviously it depends from system to system....

[Symmo]

hi
Yeah well with a system like c64 the file count can be to big for one catergory.
Same as the games need to remove pd and stuff seeing there is still a heap to add in the future.

[Duncan Twain]

Finally found some time to gain time by writing tooling to generate DAT files automatically! No more header edditing again. Tool takes the released DATs and compare them to the WIP folders and spits out the new DAT (if needed).

[Cassiel]

In good enough shape to share?

[Symmo]

^^^^^^^^^ me 2 :-)
Sounds good duccan should make things easier.

[Duncan Twain]

In good enough shape to share?

Yep, I'll upload it soon after adding one final feature.

[Duncan Twain]

Guys,

It's uploaded to TOSEC ftp's folder \Tools\Dir2Dat. You'll need Microsoft.Net Framework 4 to run it. Make sure to change the Dir2Dat.exe.config with you're own settings.

I've run several tests, but not comprehensively. Please reports any bugs and I'll try to fix them asap.

Have fun with it,
Duncan

[Duncan Twain]

Quite a lot files found in the wrong category, need to be fixed.
Same files (different filetype) found across different category.

Will create database to include md5, sha1, crc2 hash of:
- original file (ie. d64)
- unpacked file (ie prg within d64, t64, tap)
- decrunched file (unpack unp64)

Next compare hashed to find obvious mistakes.

[Duncan Twain]

Corrected all [a] flags. There where entries with the [a] flag that shouldn't, or entries having gaps.

[Duncan Twain]

Database created with hashes of >400000 files (and growing) to give insight in collection status and missing entries.

1 - removed label of all d64 files, hashed and matched against tosec files; a couple of hundred files added.
2 - extracted contents of known filetypes (p00, lnx, t64, d64) and hashed. Matched against tosec files; >7000 files found with same content but different title. Need to go through them.
3 - same as 2, to look for incorrect location; some corrections made. Mainly moved files from 'collections' to correct location.
4 - same as 2, but now looking for files to add.

[Duncan Twain]

High Voltage New Games Collection Disk 262 (199x)(Bod & Talent)(Side B).d64 (including alts)
High Voltage New Games Collection Disk 409 (199x)(Bod & Talent)(Side B).d64
are empty disks and will be removed.

[Duncan Twain]

Database nearly finished:
- images: 558.740
- image entries: 3.855.239
- images entry extracts: need to call unp226 to remove compression and put hashes in database. Expected tripling amount of image entries.

Found so far:
- 328 wrong image locations (files that can be moved from Collection/Compilationsto more specific location)
- >10.000 additions
- 25.594 images with matching content and different name