TOSECdev Forum

TOSEC Project => General Discussion => Topic started by: Latruffe on April 16, 2020, 11:15:24 AM

Title: Looking for a TOSEC database (online or flat file)
Post by: Latruffe on April 16, 2020, 11:15:24 AM
Hello,
there are several years I'm looking after TOSEC project, mainly since I'm an Amiga 500 nostalgic  :'(
Recently I baught a Raspberry PI, I decided to turn it into a retrogaming machine  :D
Then I get the Amiga TOSEC dat file and studied it's naming convention,in order to find a way to filter games according tomy preferences (languages, no bad dump, hacks,...).
But I've quickly realized there is no easy way to develop a simple script (shell, python,...) to filter roms titles.
Then after having search deeply unsuccessfully, I'd like to know where can I find a structured TOSEC database of roms, either through a web UI toapply filters, or merely a db flat file (sqlite,...) to download.
I'm quite sure TOSEC administrators have such a database, from which dat files are build rom naming.
Thanks by advance for your answers and help.

Note : perhaps someone already developped such a script, then I'll be happy to get it as a B plan.
Title: Re: Looking for a TOSEC database (online or flat file)
Post by: NLS on April 16, 2020, 11:26:21 PM
Don't be so sure.
Are you willing to make one?

BTW for your purpose, maybe you need to check no-intro or such a set.
Title: Re: Looking for a TOSEC database (online or flat file)
Post by: Maddog on April 17, 2020, 05:13:00 PM
Use the Commodore Amiga - Games - SPS dat.
This has dumps from original disks that were done by http://softpres.org/
So, by definition it excludes hacks, bad dumps etc.
The IPF files can be used in WinUAE, see here: http://softpres.org/download

For further cleaning up according to your needs, you definitely will have to do the work yourself.
Title: [SOLVED] Looking for a TOSEC database (online or flat file)
Post by: Latruffe on May 01, 2020, 04:57:12 PM
Hello,
thanks for your answers.
Finally, I did the work on my own.
It's a bash script taking as input either a TOSEC datfile or a repository containing ROM files, and given as output a CSV and a JSON files.
I only tested it successfully with last TOSEC Amiga Games ADF ROM datfile.
Just for information, it took about 15 min to perform the job (with an i7-4710MQ + 8Gb RAM). Performance is not my purpose (it's only a bash script).
Feel free to use, study, copy, share, modify, and distribute modified and therefore derivative works, as long as it keeps and inherits copyleft status.
Any feedback is welcome. But I do not promise having enough time to support the script actively.
Regards
Title: Re: Looking for a TOSEC database (online or flat file)
Post by: NLS on May 01, 2020, 07:59:42 PM
thanks
Title: Re: Looking for a TOSEC database (online or flat file)
Post by: Duncan Twain on May 16, 2020, 08:37:05 AM
Nice work Latruffe!
Title: Re: Looking for a TOSEC database (online or flat file)
Post by: Latruffe on May 16, 2020, 12:03:04 PM
You're welcome.If you ever try/tried it (successfully I hope) with a TOSEC datfile,please tell which one.Thanks.
Title: Re: Looking for a TOSEC database (online or flat file)
Post by: load81 on August 27, 2020, 03:42:53 AM
Very cool Latruffe. I'm going to study this. Can you post this somewhere like Github so that others can contribute patches and improvements?
Title: Re: Looking for a TOSEC database (online or flat file)
Post by: Latruffe on September 11, 2020, 09:47:05 AM
Thanks. for your comments.
Nice idea to put it on github in order to allow better share and perhaps community enhancements.
Here is the repository : 
https://github.com/Latruffy/TOSEC_db_datafile_builder.git (https://github.com/Latruffy/TOSEC_db_datafile_builder.git)
Thanks again for your interest.
Regards