Home Page › Forums › General Chat › ZG database
- This topic has 19 replies, 9 voices, and was last updated 3 years, 3 months ago by
gaver.
-
AuthorPosts
-
June 8, 2023 at 3:12 PM #1982044
Is there anyway to get an exported list of all the current available ZG downloads (that are not marked as dead)?
I've decided to purge many terrabytes of DAZ content that i'll probably never use or even look at. But before I delete any I'd like to compare my list with ZG list and upload whatever is missing from ZG so those things will not be lost forever if nobody else seems to have them on hand.
June 8, 2023 at 7:18 PM #1982104No there is not a list like that.
Just upload it to a news server and let it stay there and downloads what you need.
Make weird file names and make sure to password protect it with a strong password.
After that you can delete your filesJune 8, 2023 at 8:59 PM #1982132That would take forever to upload that much stuff, and most of it would be needless since the majority is probably already "live" here. If an admin/mod could export text file from the database, would be great. Would only take a minute or so, to log in to the webserver and send a SQL query to grab the list. If not, no big deal I suppose, unless someone really really wanted something I deleted lol
June 8, 2023 at 9:38 PM #1982147Ive posted stuff from V3 so apparently Daz stuff never dies. Ive got one item Ive never seen posted and one day may eventually run across it on my HD.
June 9, 2023 at 7:12 AM #1982254Not evcerything posted here will remain live forever. Some posts are already dead after a vew days. Not all dead posts will be re-uploaded.
If you lean on that fact I wouldn't remove my items if I were you.June 9, 2023 at 1:41 PM #1982495My Daz is on an external drive. That drive broke last year and I had to buy a new one and reload Daz from scratch. Best thing that ever happened to me. Now I have only G7-8.1 pieces that I actually use rather than files and files of stuff that I didn't touch since downloading.
June 9, 2023 at 2:37 PM #1982511We discussed old stuff a while back and some (actually a LOT) of old torrents where exchanged. There was talk of organizing the whole thing but who has time. I was looking at it all yesterday and while I have a HUGE desire to archive it all, why bother if no one's gonna want it. Some of the older stuff is still very usable with a new shader. Even the clothes can be used as a starting point in Marvelous Designer, there's numerous style that are not made anymore.
July 1, 2023 at 2:31 AM #1992357I've been spending what little time i have for months reorganizing after a major crash and trying to do the same, wish i had the skills to be able to db everything.
July 1, 2023 at 7:51 AM #1992387I had a secret project: cataloging all assets found on ZG and once done, keeping my database up to date every week or so. The idea was to be able to compare what I had "in stock" with what was available on the zone and upload what was missing (or dead link) and download what I was missing.
Carefully, on page at a time, I spent weeks scraping the site, starting from page 1, watching movies or series while clicking on my "scrap" button... (yes, you have OCD or you don't!!).
Anyway, I stopped keeping my list up to date a few month ago (in 2023). Scrapping was easy and somehow fast, reconciliating the assets as they were posted (mainly the names were off) with the real asset as found on the vendor site was a true PITA and a "free time guzzler"... I have a list of 53.911 records that I uploaded there if that interests you:
Asset list - XLSX FormatIf you are not comfortable with excel files, here are some additional formats:
Asset List - CSV Format
Asset List - TXT Format
Asset List - SQL Format
Asset List - JSON FormatOnly the Excel file has been cleaned and columns renamed to make sens (this is a database extract) but whatever the format, you'll find at minimum:
- The category of the asset
- Asset name (as found on the Zone)
- The download URL on the Zone
- The asset SKU (when identified)
- The original asset name as found on the vendor site (when identified)
- The vendor name (when identified)
I don't know if this will help you, but here it is 🙂
I wish you all a good week-end
Cheers
Math
July 1, 2023 at 8:09 AM #1992388My manual install process uses my version of a custom nomenclature, which means my archive ends up being in effect a database.
If I have a accurately named file, I know exactly where it will be if I have it.
If it isn't there, I either haven't got it, or it is in my downloads awaiting archiving.
🙂
July 2, 2023 at 12:59 AM #1992720@mathmathou interesting idea, I could easily write some software to automatically scrape the pages and save into a database automatically and have it run at every X intervals of time. Not sure if it would break any rules here by doing so though. But in the end, would all that work be really useful for anyone else to use? I really only needed it for the one time to prune files from a hard drive. But if others would use/need it for stuff I guess its a thing to consider.
July 2, 2023 at 2:01 AM #1992726In other words, what you need is a way to scan folders and sub-folders, and match items found (based on the name maybe?) against a "general database of known assets"?
If that is the case, I can provide a database of nearly 190.000 references (DAZ, Renderosity, Renderotica and others) with SKU, name, URL, Price...
You'll have to implement the folder scan yourself. I could kit-bash you one but that would require a few days considering my actual "real work" load at the moment 🙂
July 2, 2023 at 2:46 AM #1992729I have been toying with excel and VBA to do something similair, but for hard drives, to get ( like the rest) a proper overview of what assets I have in store.
Started after ransomware "killed" a lot of files, And I was left with a lot of empty folders. To check manual it would take forever. Allas, I am not a programmer so I quit ( couldn't get foldernames in proper collums ( Say an extension of a piece of clothing. To keep them together I placed the extention folder in the item folder, witch messed things up
Apart from that I had following setup
SDK-Itemname-clothing-char-hair...etc worked partially, then things got bit hectic due to sickness off my girlfriend and It kind of got forgotten til l read this post.
IF anybody got a VBA script, I could make some adjustments myself need be, but would be appreciated.
Once the excel would have been finished I was planning to upload so people could see what I have and ask for wanted items i they find them on the list.July 2, 2023 at 2:51 AM #1992731@mathmathou yes,I remember that project you mentioned that we had a thread about. But for the files on the local hard drive, the filenames are not "standardized" and might not match exactly to the official names on the stores pages (or ZG pages). Files could be named anything, sometimes not even spelled correctly. They would have to be "close enough" to hit, with a partial key match, which would generate possibly a few hits that are similar but not the one you are looking for. Might require some manual clean-up work. In a perfect world, each filename would begin with a SKU # followed by the product name, such as 111111_BigBreastedBimbo for Genesis 8.zip and it wouldnt matter what comes after the 111111_ at all, because only 111111_ would be part of the search key, hit or miss. Anything up to the first underscore
July 2, 2023 at 2:56 AM #1992733also, thats why I was thinking, with this scenario, it would be easier to just use a partial key match, and then since i know some files similarly named files will both come up as a hit as a project, might be easier just to assume all files with NO MATCH at all on a partial key are ones to keep and upload to ZG
-
AuthorPosts
- You must be logged in to reply to this topic.




