TOSECdev Forum

TOSEC Project => Database / Datfiles => Work In Progress => Topic started by: Diaboł on May 16, 2010, 06:57:32 PM

Title: Diaboł's WIP
Post by: Diaboł on May 16, 2010, 06:57:32 PM
Here is what I do now:

Amstrad GX4000:

- GX40000 is a new system in TOSEC db. We have all dumped games released for this system. I have created the following DATs:


Epoch (Super) Cassette Vision:

-Another new system. 27 sets (4 [a]) in the db. A few more is expected since ~30 games were released.

Mikroelektronika Pyldin

- Pyldin is a new system in TOSEC db. I have created the following DATs:


Texas Instruments:

- All existing Publishers in all TI sets are fixed now ("Sure Name, First Name" where needed),
- All TI sets (except TI-99 4A) are split now into correct categories (file extensions),
- Adding new files to all TI sets (TI-73 and TI-80 are done for now),
- There will be a new TI platform added: 92plus
- The following DATs are ready:


- *.80 and *.txt formats seems to be pure text files (BASIC programs). If there's no difference between them, all txt will be merged with 80. I didn't relay had time to have a look and find it out. About 30000 new sets are waiting to be checked.

Title: Re: Diaboł's WIP
Post by: Diaboł on May 17, 2010, 09:39:59 PM
Texas Instruments TI-81:

-This model was missing until now. There's 183 new sets and 8 new DATs:


That's it for today.
Title: Re: Diaboł's WIP
Post by: PandMonium on May 17, 2010, 11:59:20 PM
Great work! Do i need to check them? :P
Title: Re: Diaboł's WIP
Post by: Diaboł on May 18, 2010, 05:51:19 AM
I already did :D
Title: Re: Diaboł's WIP
Post by: Diaboł on May 20, 2010, 09:35:48 PM
Epoch (Super) Cassette Vision:

-A new dump just came out so I updated the Epoch (Super) Cassette Vision DAT

Title: Re: Diaboł's WIP
Post by: Diaboł on May 25, 2010, 06:31:47 PM
Texas Instruments:

-I have three new DATs:


Mikroelektronika - Pyldin

I just realized that the sets can be split and reorganized a bit. Should be done by tomorrow.


Title: Re: Diaboł's WIP
Post by: Diaboł on May 27, 2010, 04:56:56 PM
Epoch (Super) Cassette Vision:

- Four new dumps added to the DAT file.

Texas Instruments:

- A lot of new Apps added to the TI-82 Applications. I'm halfway to finish this system.

Title: Re: Diaboł's WIP
Post by: Diaboł on May 31, 2010, 02:13:21 PM
Texas Instruments TI-82:

I have 2 new DATs ready:


All the sets + DATs I have created so far will be checked for typos again and probably updated so the number of sets will grow soon.

Edit

I managed to finish a few more:


The TI-82 platform is finished for now. I'm waiting for a new files so I can make an update but now I'm about to start to work on TI-83. I have about 5200 to go so it will take some time...

Title: Re: Diaboł's WIP
Post by: idoru on June 11, 2010, 10:10:00 AM
Hey Diaboł, I've just been going through your submitted sets.  BTW, I did not see any Epoch or Texas Instruments ones there.  Some questions :-

1) Amstrad GX4000 - do we need both BIN/CPR ?  Did you convert the readily available BIN files to CPR (as I can't find the CPR files :P) ?

2) Mikroelektronika Pyldin-601 - There's 2 duplicate checksums in the Firmware dat, which of the following filenames should I keep ?
    Pyldin-601 BIOS v2.60 (1990)(Mikroelektronika)
    Pyldin-601 Fixed BIOS v2.60 (1990)(Eagle Software)

3) Can the Firmware dats for Mikroelektronika Pyldin-601 / Mikroelektronika Pyldin-601A / Mikroelektronika Pyldin-601M be merged ?  It looks like the software works across all 3 & the A/M are revisions of the video hardware only ?  Also the DOS/Pascal/BASIC stuff doesn't belong in a Firmware dat unless they're stored in ROM chips on the hardware, presumably they're software so would be better placed in an Applications (Pascal/BASIC) or Operating Systems dat (DOS).

4) Where on earth can I download the Mikroelektronika files from ?  :P  I've found some of the firmware files & a few Hungarian sites for the Pyldin, but can't seem to either find or navigate to any software downloads.

Thanks ;)

Title: Re: Diaboł's WIP
Post by: Diaboł on June 11, 2010, 10:28:46 AM
I didn't convert anything. I found ROMs in 2 different formats. I can't tell you right now where I found it but I'll check my "favorites" later so I'll let you know. The Pyldin DATs are on hold now. I have to rethink the ROMs organization and perhaps I'll merge and split some of them. For some reason it was a bit difficult. I didn't upload the Epoch and TI DATs yet since I want to test it once again due to sets holding sub folders and zips. I want to make sure people will be able to rebuild their collections without any problems. I made a little mistake some time ago while creating some of the TI DATs and **** up the whole set :-D So I just want to make sure everything is in order. I may upload the Epoch DAT later on and some TI WIP DATs so you can have a look. There is a question if the split by extensions is correct for that platform but let's discus it later. I'm a bit busy right now.
Title: Re: Diaboł's WIP
Post by: idoru on June 11, 2010, 10:56:49 AM
OK, I've moved all the Mikroelektronika Pyldin dats & the Epoch Super Cassette Vision dat into a Work-In-Progress folder in your area & will not include them in any release for now.
Title: Re: Diaboł's WIP
Post by: Diaboł on June 11, 2010, 09:08:40 PM
I'll prepare the final DATs for the TI systems next week. I think the Epoch and Amstrad DATs are ready but I'm waiting for Aral to merge a few split roms. Will be done and ready for the coming release.
Title: Re: Diaboł's WIP
Post by: idoru on June 12, 2010, 12:37:35 PM
Diaboł, were the GX4000 CPR from http://www.cpcmania.com/ ?  Just found that site & downloaded the files, about 50% match your dat the rest don't.
Title: Re: Diaboł's WIP
Post by: Diaboł on June 12, 2010, 05:37:45 PM
I really can't remember now where I found all this CPR files now. I didn't bookmarked it but as far as I remember it was an FTP server.
Title: Re: Diaboł's WIP
Post by: Diaboł on June 13, 2010, 02:24:41 PM
Amstrad GX4000:

- Two DATs updated and uploaded:


Texas Instruments:

I'm testing the new TI-73 DATs now. Hope to upload it today.
Title: Re: Diaboł's WIP
Post by: Diaboł on June 13, 2010, 04:52:27 PM
Texas Instruments:

- Four TI platforms are done: TI-73, TI-80, TI-81, TI-82. There are 2177 sets in total. The old "Various" DATs can be removed. There was no changes to the Texas Instruments TI-82 - Firmware (TOSEC-v2006-04-21_CM) DAT. All the following DATs already uploaded to our FTP:

TI-73:


TI-80:


TI-81:


TI-82:


I work on the TI-83 DATs but have no idea if I can finish before the next TOSEC release.

Title: Re: Diaboł's WIP
Post by: Diaboł on June 15, 2010, 07:56:07 AM
Epoch (Super) Cassette Vision:

- I just uploaded a new DAT to my WIP folder. I have all the games released for this system but four roms are split so that's why this is still WIP. Once I'll get the ROMs merged we can consider this system done and ready for the next release.
Title: Re: Diaboł's WIP
Post by: Diaboł on June 18, 2010, 03:19:45 PM
Texas Instruments:

I have replaced I the TI DATs on our FTP. From now I'm not going to split sets by extensions so I have created new DATs. All the sets are the same, there are no changes. DATs are ready to be published but If I''ll have some time I'll update all of them :-)

Right now I'm working on Texas Instruments TI-83 - Applications DAT. 437 sets already done.
Title: Re: Diaboł's WIP
Post by: Diaboł on June 22, 2010, 06:51:56 AM
I have 3 new DATs uploaded yesterday:


+ one in my WIP folder:

Title: Re: Diaboł's WIP
Post by: Diaboł on June 26, 2010, 09:08:53 AM
Epoch (Super) Cassette Vision:

-Epoch - Super Cassette Vision - Games - [BIN] (TOSEC-v2010-06-26) ready and uploaded.
Title: Re: Diaboł's WIP
Post by: Diaboł on June 28, 2010, 11:14:23 AM
Texas Instruments:

- Texas Instruments TI-83 - Applications (TOSEC-v2010-06-28_WIP): A few TNC errors fixed, tons of new sets added (1809 all together).
- Texas Instruments TI-83 - Shells (TOSEC-v2010-06-28_CM): A new DAT. 34 sets.

I forgot to mention about a little problem you may have if you try to scan / rebuild the TI sets using clrmpro. To do it properly you have to load a DAT (obviously), go to Settings-->Compressor... and make sure that the "Mark Useless folder structs as unneeded (Scaner only)" option is DISABLED otherwise you'll get errors.
Title: Re: Diaboł's WIP
Post by: PandMonium on June 28, 2010, 01:07:25 PM
Humm, that's related with empty folders that are indeed needed for some systems but cmp removes them, right? I thought that could be defined in the dat itself with the nodump option (obsolete, ignore, required or something like this). I guess not, right?
Title: Re: Diaboł's WIP
Post by: Diaboł on June 28, 2010, 01:25:09 PM
I don't think it's related to empty folders since I don't have any in my sets. I was trying to rebuild a few sets containing folders and sub folders some time ago and I was always getting warnings. Clrmpro doesn't show missing roms but there was something wrong with the sets after rebuilding. Some folders were missing if I remember correctly. Here is a little info about this (or similar) issue : http://www.emulab.it/forum/index.php?topic=240.0
Title: Re: Diaboł's WIP
Post by: PandMonium on June 28, 2010, 02:09:21 PM
Ah ok.
From a quick look, exo should be the creator of a DOS games collection and you can find his dats in pd forum and other places, i remember seeing a topic there about his dats and the usage of other tool different from cmp pro because of some folder problems, maybe you should have a look there to see if it is useful. Anyway by that topic you posted it seems to work fine, if that option is needed by default for you (and other dats possibly) we should not forget about it and maybe have a note about it in our main page also (in FAQ for example, any of you wanting to create or post there feel free to ask me :))

A bit more about the problem discussed there, what Roman said is that in a datfile, when a subfolder has files/folders in it, there is no need to have each folder entry on the zip or described in the datfile, example (should be easy to understand but anyway):
Code: [Select]
#1
\folder
\folder\subfolder
\folder\subfolder\romfile.bin

#2
\folder\subfolder\romfile.binInstead of #1, option #2 should be enough to correctly recreate the exact structure when unzipping the zip file. What did you use to create the datfile? cmp?
I remember back when i started trying to fix tim it had a problem with zipfiles and subfolders and that's how i found this too.
My suggestion is for you to do some quicktests if you can to confirm this, create a dat for that file with cmp, scan it with and without the option and see what are the results, extracting the content to see if something changed and also testing how it works with empty sub dirs since some weird old systems might need/have them. :)
Title: Re: Diaboł's WIP
Post by: Diaboł on June 28, 2010, 05:59:28 PM
I use cmpro to create all my DATs. As you say, option 2 is all you need. Here is an example from one of my DATs:

Code: [Select]
game (
name "83Quadster v2.5.2 (2010)(Hiddenfiles)"
description "83Quadster v2.5.2 (2010)(Hiddenfiles)"
rom ( name 83QUAD\83QUAD.TXT size 1951 crc 1c82e8de md5 2857b5cd85bbf9b5fa40d3b1798db8ef sha1 0f36b86650d15181d11c322752e3d314be768e72 )
rom ( name 83QUAD\QUAD83.83P size 3298 crc 8bea9c56 md5 fcb5c01fb6b9073e3c4e6dbe96d91286 sha1 bc6f2ffda00aaab454f7fcc19b947d1038566a64 )
)
There's no problem to properly create a DAT using cmpro. The option that I mention in my last post affects only the Scanner. You will rebuild all the sets no matter if the option is enabled or disabled. It's only important when you want to scan the sets.

In the above example 83Quadster v2.5.2 (2010)(Hiddenfiles) you have two files: 83QUAD.TXT and UAD83.83P in a folder called 83QUAD.

If you run the Scanner with the option "Mark Useless folder structs as unneeded (Scaner only)" enabled it will stop and ask you if you want to remove the unneeded file (sic!) 83QUAD which is a folder really  :)

Now... here is the real fun: if you choose to delete the file(folder) it won't be always deleted. The behaviour I just described is not always repeating  ;D

All of this is not a problem if you remember about the option I mentioned. The rest is rather for Roman to deal with  :P
Title: Re: Diaboł's WIP
Post by: Diaboł on June 28, 2010, 06:43:00 PM
OK, just for peace of mind I have created a mini set and a DAT file. Grab it from here and see how it works in cmpro.

Set+DAT (http://www.speedyshare.com/files/23169772/Set_DAT.zip)

With the "Mark Useless folder structs as unneeded (Scaner only)" option enabled the Scanner will ask if you want to remove unneeded sets (all files from the directory). If you click yes or yes for all it will finish but no files will be actually removed. If you make a new scan again it will NOT ask you about those files again.

Looks like everything is fine even if you ignore the OPTION but I'm almost sure I had some problems before so I decided to mention about that just in case.
Title: Re: Diaboł's WIP
Post by: Diaboł on July 01, 2010, 08:45:18 AM
Texas Instruments:

-Texas Instruments TI-83 - Applications: Updated and uploaded (2026 sets)

Two new DATs:

-Texas Instruments TI-83 - Demos (206 sets)
-Texas Instruments TI-83 - Modules (19 sets)
Title: Re: Diaboł's WIP
Post by: Diaboł on July 03, 2010, 01:29:58 PM
Texas Instruments:

-Texas Instruments TI-83 - Applications: Updated and uploaded. A few sets has been moved to different system. I found a lot of missing version numbers and a few publishers.

Visual Technology:

I have four DATs for a new system called Visual 1050. It was a CP/M 3 based machine produced by Visual Technology (US) in the early 1980s. Stunning multi CPU machine with Z80 and 6502 working as a graphics co-processor.

We have the following DATs ready:


There's a (limited) support for Visual 1050 in MESS.
Title: Re: Diaboł's WIP
Post by: idoru on July 03, 2010, 01:45:25 PM
cool ;)

hopefully i'll get around to going thru the uploaded dats (everyone's, not just yours) tomorrow...
Title: Re: Diaboł's WIP
Post by: Diaboł on July 04, 2010, 12:58:24 PM
Amstrad GX4000:

- Both DATs updated and uploaded.

Texas Instruments:

- A new DAT: Texas Instruments TI-83 - Games (TOSEC-v2010-07-04_WIP) created and uploaded.
Title: Re: Diaboł's WIP
Post by: idoru on July 05, 2010, 03:05:30 PM
Quote from: Diaboł
The old "Various" DATs can be removed.

There are still files left over from the old TI-73 & TI-80 Various dats, are these junked or still to be added?

Also, presumably, the rest of the old dats are still required? ie.
     Texas Instruments TI-82 - Firmware
     Texas Instruments TI-83 - Firmware
     Texas Instruments TI-85 - Firmware
     Texas Instruments TI-86 - Firmware
     Texas Instruments TI-89 - Firmware
     Texas Instruments TI-92 - Applications
     Texas Instruments TI-92 - Firmware
     Texas Instruments TI-92 - Games
     Texas Instruments TI-99 4A - Command Modules
     Texas Instruments TI-99 4A - Various
Title: Re: Diaboł's WIP
Post by: Diaboł on July 05, 2010, 06:44:39 PM
It's not a junk but unfortunately the original file names inside sets were replaced and some files removed by the previous maintainer. I'm trying to restore the original names but it's not easy to find this stuff now. It's just a few sets. I'd say lest keep it away for now. I hope to fix it before the next release.

The rest of the DATs are still required but some firmware DATs were updated. I can't tell you which one right now but I'll try to post it tomorrow.
Title: Re: Diaboł's WIP
Post by: idoru on July 06, 2010, 09:16:09 PM
Oki ;)
Title: Re: Diaboł's WIP
Post by: Diaboł on July 07, 2010, 01:12:29 PM
I found some typos in my DATs so here's a big update. There's just a few new sets.

Texas Instruments:


Texas Instruments TI-73 - Firmware (TOSEC-v2010-07-07_CM) is a new DAT.  Texas Instruments TI-73 - Sources (TOSEC-v2010-07-07_CM) was called Routines before.


Texas Instruments TI-81 - Sources (TOSEC-v2010-07-07_CM) was called Routines before.



All TI-83+ Firmware sets has been moved to a future Texas Instruments TI-83+ - Firmware DAT. There's also one new set in TI-83 - Firmware.

Amstrad GX4000:


Epoch Super Cassette Vision:


I work on the other Texas Instruments systems (currently TI-83) but it's too early to include this stuff in this TOSEC release so I'll keep it as a WIP.
Title: Re: Diaboł's WIP
Post by: Diaboł on July 11, 2010, 03:50:18 PM
I have 3 new DATs for a TI system called Compact Computer 40 (CC-40). The system is pretty rare and there's not much software around (but I didn't look hard due to 42°C outside&inside):


All the DATs are already uploaded.
Title: Re: Diaboł's WIP
Post by: PandMonium on July 11, 2010, 04:20:14 PM
Great :)
Fortunately around here the weather has been cooler the last days, today my thermometer does not pass the 30ºC inside my room, 42ºC must be something impossible : :(
Title: Re: Diaboł's WIP
Post by: Diaboł on July 11, 2010, 06:25:43 PM
If you check the weather forecast they always shows the temperature in the shadow but I have my windows on the south side of the house. Means it's sunny like h**l all day  >:(
Title: Re: Diaboł's WIP
Post by: Diaboł on July 14, 2010, 04:36:44 PM
I finally found some time (and energy) to update the Texas Instruments TI-83 - Games DAT. Not many sets added (about 60) but a few mistakes and missing dates were fixed... Texas Instruments TI-83 - Games (TOSEC-v2010-07-14_WIP).dat uploaded.
Title: Re: Diaboł's WIP
Post by: Diaboł on August 04, 2010, 07:50:06 AM
Texas Instruments TI-83 - Games (TOSEC-v2010-08-04_WIP).dat uploaded. Lots of new sets, lots of changes.
Title: Re: Diaboł's WIP
Post by: Diaboł on August 08, 2010, 06:47:07 PM
Here's another update:


The following DATs are new (some were in WIP stage until now):


I still have a lot of unrenamed games for the TI-83 so this is what I'm going to do next week. All DAT files already on our FTP. Due to new system flags I got a few errors using TOSEC DAT Explorer (v20100607) It would be good to get the tool updated. That's all for now... thx.
Title: Re: Diaboł's WIP
Post by: Diaboł on August 23, 2010, 08:45:01 AM
240 files added to Texas Instruments TI-83 - Games. A few fixes in Texas Instruments TI-82 - Games and Texas Instruments TI-83 - Applications.
Title: Re: Diaboł's WIP
Post by: Diaboł on August 25, 2010, 04:56:47 PM
100 games added to Texas Instruments TI-83 - Games.
Title: Re: Diaboł's WIP
Post by: Cassiel on September 10, 2010, 08:36:20 PM
RE Epoch Super Cassette Vision

The original DAT name/header was correct, the new is wrong:
Right: Epoch Super Cassette Vision - Games (TOSEC-v2010-07-07_CM)
Wrong: Epoch - Super Cassette Vision - Games - [BIN] (TOSEC-v2010-09-06_CM)

You don't need the " - " after Epoch, and you don't need the " [BIN] " unless there's more than one Games DAT, e.g. [CAS] as well.
Title: Re: Diaboł's WIP
Post by: Diaboł on September 11, 2010, 05:05:55 AM
Thx! I guess I was expecting more types than BIN.
Title: Re: Diaboł's WIP
Post by: Cassiel on September 12, 2010, 01:58:13 PM
No sweat...  :)

Have spotted another small problem in: Texas Instruments TI-83 - Applications (TOSEC-v2010-09-06_CM):

name "Cube Form (2000)(Bovenzi, Brad)"
   description "Cube Form (2000)(Bovenzi, Brad)"
   rom ( name CUBEFORM.83P size 334 crc 135ad17f md5 9a39a3613ea545ccb25e8dc8cad7e8ce )
   rom ( name TŽBATTERY.83P size 195 crc f9bfde7c md5 424297296c7fa930e68ccce696496887 )
   rom ( name TŽMEMORY.83P size 141 crc 18940f38 md5 a4bda1c3c2d3a1ab410904ca1c78a570 )

The TNC (frustratingly) only allows so called low ASCII characters:
(http://www.tosecdev.org/index.php/tosec-naming-convention?start=1)
so no "Ž" I'm afraid.....

Title: Re: Diaboł's WIP
Post by: PandMonium on September 12, 2010, 02:43:04 PM
Actually that could raise a problem right there, i suppose that changing romnames is no problem when the rom is a complete image of some media. On the other hand, with some multi image sets, where the content of the set is the entire disk content zipped, renaming one of them might break the program. When running it will fail not finding the right named file, no?

TNC is our naming convention to use on setnames, it is not mandatory to use it on the romnames too (although on single image sets it is used very often), or those 3 roms would be wrong.
Of course, using chars other than low ascii may give some obvious problems when using/extracting files in OSes that don't support them. Anyway, in this case (and most of them) i think there is no problem doing it. :)
Title: Re: Diaboł's WIP
Post by: Cassiel on October 14, 2010, 02:41:21 PM
This is still an issue….

When scanning this set in ClrMame Pro it baulks on these two files containing Ž in their name, as it does when rebuilding (AFAIR). Even if you add them to the archive yourself, it insists the names are wrong (even when they clearly not when you open the archive). Even if it attempts to ‘correct’ them it fails anyway.

This has nothing to do with the OS, the packer (WinRAR/7z/zip), or even CMP itself (all modern versions of the software I’ve just mentioned can easily handle Unicode) – it’s a limitation of the old DAT format.

I raised this issue with Roman to confirm and received the (rather unsurprising) confirmation back:
“You're using a deprecated datfile format. Use XML instead and specify the encoding in the <? xml encoding...> attribute.”

So this leaves us with a few (equally crap) options….
-   Remove the set for now (until we are in a position to support such sets in our DATs properly)
-   Change the Ž character to something else, potentially breaking the image. As well as the other obvious disadvantage of, you know, it being named wrong…
-   Leave as it is (and put up with being asked again and again as to why the TI-83 DAT is broken)
Title: Re: Diaboł's WIP
Post by: Diaboł on October 14, 2010, 04:44:02 PM
I have never seen ClrMame Pro complaining about those files but if it does on your system I'm going to remove the set.

update

Done.
Title: Re: Diaboł's WIP
Post by: Diaboł on October 15, 2010, 06:12:36 PM
We have 3 new DATs:


Title: Re: Diaboł's WIP
Post by: Cassiel on October 16, 2010, 12:44:24 AM
Exactly the same problem unfortunately:

Texas Instruments TI-Nspire - Applications (TOSEC-v2010-10-15_CM):
Equations Library v2.0 (2009)(Sousa, Nelson)(en-pt)

Texas Instruments TI-Nspire - Games (TOSEC-v2010-10-15_CM):
Rolit (2009)(Lenssen, Jan)
TurnRacer (2010)(Lenssen, Jan)
Title: Re: Diaboł's WIP
Post by: Diaboł on October 16, 2010, 07:51:52 AM
I'll remove it today. It would be easier if I could get some errors from CMPRO too. Anyway... looks like using the old format makes us to eliminate or change things instead of preserving. Fortunately I managed somehow to keep my ł  8)
Title: Re: Diaboł's WIP
Post by: Diaboł on October 16, 2010, 10:19:53 AM
Texas Instruments TI-83 - Games (TOSEC-v2010-10-16_CM) - It took me a while but it's finally done. I have renamed all the games (I currently have) for TI-83. New files are on the way but I wouldn't expect them to be included before the upcoming TOSEC release.

@Cassiel

I look at the Rolit (2009)(Lenssen, Jan) and TurnRacer (2010)(Lenssen, Jan) sets but I can't see anything wrong there:

Rolit (2009)(Lenssen, Jan):


TurnRacer (2010)(Lenssen, Jan):


Looks like pure "low ASCII" characters.
Title: Re: Diaboł's WIP
Post by: TKaos on October 16, 2010, 12:31:16 PM
I'll check it later today too and see if I get the errors.
Title: Re: Diaboł's WIP
Post by: Diaboł on October 16, 2010, 05:37:44 PM
Seven new WIP DATs:

Title: Re: Diaboł's WIP
Post by: TKaos on October 16, 2010, 05:45:31 PM
I get only 1 error, clrmamepro wants to rename:
Equas§es 2.0.tns to Equaš§es 2.0.tns
If I choose to rename it nothing happens.
Title: Re: Diaboł's WIP
Post by: Cassiel on October 16, 2010, 08:34:55 PM
The issue would appear to be with these files:

Apps:
Equaš§es 2.0.tns (as already experienced by TKaos)

Games:
Rolit − 10x10 english.tns
TurnRacer − English.tns

The former is the same issue as before. As for the later it would appear to be an issue with the type of dash used: em dash versus en dash (my old English teacher would be so proud that I recognised that!), i.e. '−' rather than '-'.

Unbelievable (as they say), but true. I have uploaded a screen print too.

Additionally, your name also always displays wrong as well - it just doesn't affect the scan/rebuilding functions.
Title: Re: Diaboł's WIP
Post by: Cassiel on October 16, 2010, 08:41:26 PM
Quote from: Diaboł on October 16, 2010, 07:51:52 AM
Anyway... looks like using the old format makes us to eliminate or change things instead of preserving.

Yup.... which is why I've mentioned the whole 'Low ASCII'/XML issue on more than one occasion. Apparently dismissing it or cracking jokes about it is far more productive than implementing a solution though.....
Title: Re: Diaboł's WIP
Post by: Diaboł on October 16, 2010, 09:10:50 PM
I rebuild this set without getting any errors. Not one. I scan it with no errors. The thing is that my OS displays all characters in correct way so If I have a set like "Rolit (2009)(Lenssen, Jan)" and open the zip file everything looks good. At this point it is hard to spot some UTF characters (or say... high ASCII). When I create a DAT, scan or rebuild I don't get any errors. But if I rebuild a set and open it with a (win)rar/zip I see that those characters have been replaced with rubbish. It's obviously because of the DAT format (those characters are being replaced while I build the DAT). Without UTF support I will have to remove those sets.
Title: Re: Diaboł's WIP
Post by: Cassiel on October 17, 2010, 02:41:07 AM
What's the story with the WIP DATs?
Title: Re: Diaboł's WIP
Post by: Diaboł on October 17, 2010, 09:24:04 AM
Not much story behind it :-) I just started to rename roms for TI-83 Plus and made this WIP DATs. You can find all of them in my Work-In-Progress folder but we won't include this DATs in the next release.
Title: Re: Diaboł's WIP
Post by: Diaboł on December 08, 2010, 06:30:57 PM
Amstrad GX4000

A little publisher fix in both dats: Amstrad GX4000 - Games - [BIN] and Amstrad GX4000 - Games - [CPR]
Title: Re: Diaboł's WIP
Post by: Diaboł on December 23, 2010, 10:55:29 AM
Epoch Super Cassette Vision - Games (TOSEC-v2010-09-06_CM).dat fixed and uploaded (under the same name).
Title: Re: Diaboł's WIP
Post by: Diaboł on December 25, 2010, 12:40:13 PM
Texas Instruments:

Three DATs updated (publisher's names corrected) and uploaded:

Title: Re: Diaboł's WIP
Post by: Diaboł on January 18, 2011, 03:07:26 PM
Texas Instruments:

Three DATs updated (new ROMs) and uploaded:


These are XML DATs so consider it as a WIP stuff.

Title: Re: Diaboł's WIP
Post by: Diaboł on February 14, 2011, 04:34:43 PM
I work on Atari ST Demos [ST] DAT now, correcting names, dates, updating country codes and language flags + screenshots (abbreviations). I found most of the [a] and [m] flags possible to describe. Every file is tested under emulator and on real hardware (520ST and 1040STE + a hardware floppy emulator). It takes a lot o time but I managed to check 430 so far. 128 different groups have been described accurately (country, correct names, abbreviations, etc). 16 files temporary removed and about 10 added to fill some gaps. I have also prepared an Excel spreadsheet containing all the details I collect. When finished It can be used to update TOSECDB.
Title: Re: Diaboł's WIP
Post by: Diaboł on February 20, 2011, 07:07:58 PM
Atari ST - Demos - [ST] (TOSEC-v2011-02-20_WIP) uploaded to our FTP. I have all the files from # - D checked (over 600 demos). Fixed wrong or missing dates, corrected titles, group names, country and language flags added. Many [a] and [m] descriptions added but some needs to be... standardize to keep it consistent. A few files have been moved across dats (to games and software).
Title: Re: Diaboł's WIP
Post by: PandMonium on February 22, 2011, 02:51:53 PM
great work! :)
Title: Re: Diaboł's WIP
Post by: Diaboł on February 25, 2011, 09:33:13 PM
I was fixing some publisher flags in the Texas Instruments section today. Six DATs have been updated and uploaded:


I have a little update to ST Demos [ST] too. Files from #-I are done (979 files: some new addition + a few ZZZ-UNK corrected). A new WIP DAT will come soon.
Title: Re: Diaboł's WIP
Post by: Diaboł on March 01, 2011, 07:11:36 PM
Atari ST - Demos - [ST] (TOSEC-v2011-03-01_WIP).dat uploaded. #-M done.
Title: Re: Diaboł's WIP
Post by: Diaboł on March 04, 2011, 07:04:29 PM
I have 6 new DATs ready and uploaded. Files form #-N in Atari ST - Demos - [ST] are checked, names corrected and/or updated. There's about 70 new demos, I moved some files across different DATs:


New images in Floppyshop collection are:


Uploaded DATs:


That's all for today.
Title: Re: Diaboł's WIP
Post by: Diaboł on March 05, 2011, 06:52:06 PM
Atari ST - Collections - Floppyshop got updated again today. Atari ST - Collections - Floppyshop (TOSEC-v2011-03-05_CM) uploaded.
Title: Re: Diaboł's WIP
Post by: Cassiel on March 07, 2011, 03:15:10 PM
Floppyshop seems to have lots of duplicates marked as [a]'s.......?
Title: Re: Diaboł's WIP
Post by: Diaboł on March 07, 2011, 06:46:45 PM
Thanks! Doublekiller didn't work as expected  :P This is fixed already. Please, have a look at the new DAT.
Title: Re: Diaboł's WIP
Post by: TKaos on March 07, 2011, 07:36:43 PM
You need to use the programm on the raw files not on ZIPs, worked always for me. :P
Title: Re: Diaboł's WIP
Post by: Diaboł on March 07, 2011, 07:55:15 PM
I do and I found some dups before I made that DAT... I don't know what was wrong but next time I'll check it twice  :P
Title: Re: Diaboł's WIP
Post by: Diaboł on March 10, 2011, 06:39:47 PM
Atari ST - Demos - [ST] Files from # to Q checked. Some new files added, Atari ST - Demos - [ST] (TOSEC-v2011-03-10_WIP) uploaded.
Title: Re: Diaboł's WIP
Post by: Diaboł on March 18, 2011, 06:30:23 PM
I have a few files removed from ST Demos. The files should be placed in Atari ST - Compilations - Demos so I just made Atari ST - Compilations - Demos (TOSEC-v2011-03-18_CM) to make sure I won't loose this stuff  :P A few games have been also removed from Demos. I have already spoken with kafiend about that and sent him the files. Work with Demos (currently files starting with S) is going pretty well. Lots of set names updated, some files added.
Title: Re: Diaboł's WIP
Post by: Diaboł on March 18, 2011, 07:29:39 PM
One more DAT: Atari ST - Compilations - Various (TOSEC-v2011-03-18_CM) (two files from Demos moved to Compilations - Various). That's all for today.
Title: Re: Diaboł's WIP
Post by: Diaboł on March 19, 2011, 02:56:11 PM
I copmared Atari ST - Collections - Floppyshop and Demos [ST] to find duplicates:

Quote
15:33:08 Starting the scan (on 2011-03-19)
15:33:08 Creating file list
15:33:08 Found 5 649 files to compare (5 649 'fresh', 0 'library').
15:33:08 Starting to compare files
15:34:16 Scan finished, search took 01:08.
15:34:16 Found 354 duplicate files in 177 sets.

I'll clean the Demos tonight. Please, check the attached log for detailed information about the duplicates I found.
Title: Re: Diaboł's WIP
Post by: Cassiel on March 20, 2011, 01:45:54 AM
Atari ST - Compilations - Demos (TOSEC-v2011-03-18_CM)
is missing 'version' in header
Title: Re: Diaboł's WIP
Post by: Diaboł on March 20, 2011, 07:40:30 AM
Thx Cassiel. I didn't notice that.
Title: Re: Diaboł's WIP
Post by: Diaboł on March 20, 2011, 10:16:59 AM
More duplicated files found. This time in Atari ST - Compilations - Demos:

Quote
10:42:14 Starting the scan (on 2011-03-20)
10:42:14 Creating file list
10:42:14 Found 5 429 files to compare (5 429 'fresh', 0 'library').
10:42:14 Starting to compare files
10:45:03 Scan finished, search took 02:48.
10:45:03 Found 40 duplicate files in 20 sets.

All dups are actually Floppyshop disks. Atari ST - Compilations - Demos (TOSEC-v2011-03-20_CM) uploaded. Log attached.
Title: Re: Diaboł's WIP
Post by: Cassiel on March 20, 2011, 02:19:10 PM
"Grazeys Zak Music Hacks Disk 01 (1993)(P.H.F)[a3].st"
has been removed from
Atari ST - Compilations - Demos
but can't see where to...?
Title: Re: Diaboł's WIP
Post by: Diaboł on March 20, 2011, 02:37:13 PM
Grazeys Zak Music Hacks Disk 01 (1993)(P.H.F)[a3].st is actually Floppyshop Demos 5446 (19xx)(Floppyshop).st. This removed files already exist in the Floppyshop collection. Everything is in the attached log. I know it's a bit messy but I don't have much time to edit it so just ask if something is not clear.
Title: Re: Diaboł's WIP
Post by: Cassiel on March 20, 2011, 03:11:02 PM
Different CRC32...?
Title: Re: Diaboł's WIP
Post by: TKaos on March 20, 2011, 03:15:02 PM
Diabol I think you should check out the "Duplicates in C64 DATs" thread in the member section, as far as I know we decided there to correctly identify the files that have been in the "Collection" DATs and not the other way around, so actually the Floppyshop Demos Collection should be renamed to the proper demos and then use something like:
Grazeys Zak Music Hacks Disk 01 (1993)(P.H.F)[Floppyshop 5446].st
as filename.


Anyway, read the thread again, as I don't recall everything about it right now.
Title: Re: Diaboł's WIP
Post by: Diaboł on March 20, 2011, 03:28:24 PM
My mistake. Grazeys Zak Music Hacks Disk 01 (1993)(P.H.F)[a3].st is fine. The one that needs to be moved is Grazeys Zak Music Hacks Disk 03 (19xx)(P.H.F)[a3].st
Title: Re: Diaboł's WIP
Post by: Diaboł on March 20, 2011, 03:40:39 PM
Atari ST - Demos - [ST] Files from # to S checked. Some files moved to Applications [ST] so we have Atari ST - Applications - [ST] (TOSEC-v2011-03-20_CM) and Atari ST - Demos - [ST] (TOSEC-v2011-03-20_CM) uploaded.

I have also an Excel spreadsheet with ST demo groups (names + abbreviations + country codes + some extra info). The file is attached but this is rather WIP so some info might be wrong. Take a look if you want / need.

@Cassiel: I just made a new DAT for Compilations - Demos. I'm not going to do anything else for now until we'll be sure all errors are fixed.
@TKaos: Collections doesn't make much sense to me but I didn't want to mess with this stuff now. It's already a lot of work to do  :P I'll read that thread.
Title: Re: Diaboł's WIP
Post by: Cassiel on March 23, 2011, 01:03:06 PM
Removed files:
Snork (1992)(Future Minds)(Disk 1 of 2)[ b]
Snork (1992)(Future Minds)(Disk 2 of 2)[ b]
?
Title: Re: Diaboł's WIP
Post by: Diaboł on March 23, 2011, 01:18:09 PM
Both files have been moved to Games [ST]

Snork (1992)(Future Minds)(Disk 1 of 2)[ b] is really:

game (
   name "Son Shu Shi (1991)(Expose)(en-fr)(Disk 1 of 2)(Disk A)[cr Terminator Kid][a3]"
   description "Son Shu Shi (1991)(Expose)(en-fr)(Disk 1 of 2)(Disk A)[cr Terminator Kid][a3]"
   rom ( name "Son Shu Shi (1991)(Expose)(en-fr)(Disk 1 of 2)(Disk A)[cr Terminator Kid][a3].st" size 737280 crc 26de78e4 md5 78cb2eadee0e5d6eac5c2bd66b365ff1 sha1 007b5d08c6aea2944550a947979816033e083e3c )
)

and the Snork (1992)(Future Minds)(Disk 2 of 2)[ b] is:

game (
   name "Son Shu Shi (1991)(Expose)(en-fr)(Disk 2 of 2)(Disk B)[cr Terminator Kid][a]"
   description "Son Shu Shi (1991)(Expose)(en-fr)(Disk 2 of 2)(Disk B)[cr Terminator Kid][a]"
   rom ( name "Son Shu Shi (1991)(Expose)(en-fr)(Disk 2 of 2)(Disk B)[cr Terminator Kid][a].st" size 755712 crc 1b8a4947 md5 7e0e79e618e60ca08555ef199f84bdca sha1 20a760cbf1d0432aed6aefbb30c71421ec458459 )
)

I think all files moved from Demos to Games are already in kafiend's latest DAT.
Title: Re: Diaboł's WIP
Post by: Diaboł on April 11, 2011, 12:24:52 PM
Atari ST - Demos - [ST] (TOSEC-v2011-04-11_WIP), Atari ST - Diskmags - [ST] (TOSEC-v2011-04-11) and Atari ST - Compilations - Demos (TOSEC-v2011-04-11) ready and uploaded. As usual a lot of changes + new files. Five files have been moved from Demos [ST]:

Toxic Mag 1 (1991-10)(European Swapping Crew) renamed to Toxic Magazine 01 (1990-10)(TSB)[a4] and moved to Diskmags [ST]
Toxic Mag 1 (1991-10)(European Swapping Crew)[a] renamed to Toxic Magazine 01 (1990-10)(TSB)[a5] and moved to Diskmags [ST]

TSB Compil 2 (19xx)(T.S.B.) renamed to TSB Compil 02 (19xx)(Storm Brothers) and moved to Compilations - Demos
TSK CD 15 (19xx)(-) renamed to TSK CD 15 (19xx)(TSK) and moved to Compilations - Demos
Vieille Demos (1988)(Skyrace) moved to Compilations - Demos
Title: Re: Diaboł's WIP
Post by: Diaboł on April 12, 2011, 06:05:54 PM
I just compared Atari ST - Compilations - Demos & Atari ST - Demos - [ST]. There's about 80 duplicates. Detailed list attached.
Title: Re: Diaboł's WIP
Post by: Diaboł on April 17, 2011, 12:03:27 PM
Checking demos from Atari ST - Demos - [ST]  is almost done. I want to split it into a few DATs. Here are the names:

Title: Re: Diaboł's WIP
Post by: Cassiel on April 19, 2011, 12:49:33 AM
Do we really need it that granular for ST demo's?   :-\
Title: Re: Diaboł's WIP
Post by: Diaboł on April 19, 2011, 06:29:27 AM
Personally I don't need it... I think it's OK now but I thought I could ask and see what people want since some demos on some platform are done this way. I guess I could express that  better in the last post  :P
Title: Re: Diaboł's WIP
Post by: Cassiel on April 21, 2011, 12:08:14 PM
Hmmmm... personally I think it best to avoid going to that lower level. I know we have for some big ‘collections’ (i.e. thousands/tens of thousands), but they usually the exception to the rule……

Understand it’s unavoidable for some systems (like C64) but not sure we should split that was just for the sake of it.
Title: Re: Diaboł's WIP
Post by: Diaboł on April 21, 2011, 04:35:15 PM
Everything's clear. Thx Cassiel.