Go Back   Forums > Community Chatterbox > Tech Corner
Memberlist Forum Rules Today's Posts
Search Forums:
Click here to use Advanced Search

Reply
 
Thread Tools Display Modes
Old 09-11-2010, 10:19 PM   #1
Expack2
Game Request Hunter


 
Join Date: Sep 2010
Location: ,
Posts: 884
Default Requesting Advice on Compressing 'Dense' Files

I've run into a roadblock while trying to create a pre-installed archive for 3-D Ultra Minigolf to be uploaded onto Abandonia. The problem lies in compressing the game's RDX data files, which contain the minigolf holes and the main menu. I've tried making them submit size-wise using standard ZIP, 7-Zip x64, and WinRAR, but the files refuse to compress well. Here's the best results I've had from trying to compress them:

Uncompressed: 229MB
Standard ZIP: 195MB
WinRAR (Best compression, solid archive): 186MB
7-Zip (256MB dictionary, solid archive): 181MB

Does anyone have any sage advice as to how to make 3-D Ultra Minigolf's RDX files submit? If someone would be willing to share any, I'd really appreciate it!
__________________
You like manuals. You like manuals. You love them. You cannot resist manuals.
Your gameplay experience is meaningless without manuals.



Proud Beta Tester for Desura Since October 28, 2010
Expack2 is offline                         Send a private message to Expack2
Reply With Quote
Old 09-11-2010, 10:30 PM   #2
dosraider
Dismembered.
 
dosraider's Avatar

 
Join Date: Aug 2007
Location: Dixmuide, Belgium
Posts: 2,767
Default

Are you asking to get the archive below 150MB?

You could try UHARC, it compresses a lot better then the 'classic' formats, but most n00bs will choke on it ..... there will be a lot of "WTF is this" posts ....
__________________

Not a member of The Victorious People's Shoutbox Liberation Army.
Not a member of the GAG Guerrilla. Don't get A Grip!
FOR RENT
*Advertising space*
dosraider is offline                         Send a private message to dosraider
Reply With Quote
Old 10-11-2010, 12:24 AM   #3
Expack2
Game Request Hunter


 
Join Date: Sep 2010
Location: ,
Posts: 884
Default

Quote:
Originally Posted by dosraider View Post
Are you asking to get the archive below 150MB?

You could try UHARC, it compresses a lot better then the 'classic' formats, but most n00bs will choke on it ..... there will be a lot of "WTF is this" posts ....
While I do thank you for the suggestion, dosraider, WinUHA only succeeded to get the RDX files down to 184MB - definitely over the 150MB limit for Abandonia's FTP site.
__________________
You like manuals. You like manuals. You love them. You cannot resist manuals.
Your gameplay experience is meaningless without manuals.



Proud Beta Tester for Desura Since October 28, 2010
Expack2 is offline                         Send a private message to Expack2
Reply With Quote
Old 10-11-2010, 02:08 AM   #4
dosraider
Dismembered.
 
dosraider's Avatar

 
Join Date: Aug 2007
Location: Dixmuide, Belgium
Posts: 2,767
Default

Ah well, was worth the try.

But I see that 7Zip gets the thing down to a 181MB
Quote:
Originally Posted by Expack2 View Post
7-Zip (256MB dictionary, solid archive): 181MB
Mayhaps they will accept it .... ?
__________________

Not a member of The Victorious People's Shoutbox Liberation Army.
Not a member of the GAG Guerrilla. Don't get A Grip!
FOR RENT
*Advertising space*
dosraider is offline                         Send a private message to dosraider
Reply With Quote
Old 10-11-2010, 10:29 AM   #5
Scatty
Treasure hunter
 
Scatty's Avatar

 
Join Date: Jan 2006
Location: Recklinghuasen
Posts: 1,906
Default

Quote:
Originally Posted by Expack2 View Post
I've run into a roadblock while trying to create a pre-installed archive for 3-D Ultra Minigolf to be uploaded onto Abandonia. The problem lies in compressing the game's RDX data files, which contain the minigolf holes and the main menu. I've tried making them submit size-wise using standard ZIP, 7-Zip x64, and WinRAR, but the files refuse to compress well. Here's the best results I've had from trying to compress them:

Uncompressed: 229MB
Standard ZIP: 195MB
WinRAR (Best compression, solid archive): 186MB
7-Zip (256MB dictionary, solid archive): 181MB

Does anyone have any sage advice as to how to make 3-D Ultra Minigolf's RDX files submit? If someone would be willing to share any, I'd really appreciate it!
If you aren't able to compress files far enough below their original size that usually means that those files are themselves compressed to a degree, using usually own compression algorithm made by the game programmers, and there's no way to compress already compressed files efficiently except using some algorithm that would require 5x the CPU speed of today's computers to work (shortly - not possible). Think of it as if you would be trying to compress a ZIP archive of a high compression level further into a RAR archive, you won't reach much compression there also.
Thus 181MB is probably the highest compression you can reach on those files.
Scatty is offline                         Send a private message to Scatty
Reply With Quote
Old 10-11-2010, 02:17 PM   #6
The Fifth Horseman
FUTURE SCIENCE BASTARD
 
The Fifth Horseman's Avatar


 
Join Date: Oct 2004
Location: Opole, Poland
Posts: 14,276
Default

As you are aware, we're using standard ZIP archives (max compression setting) for games hosted on Abandonia.
The only way to cut down the game's size beyond what that compression provides is by removing ("ripping") some of the game assets (typically videos, music and sound FX, in that order).
__________________

"God. Can't you people see I'm trying to commit a crime against science and nature here?"
-- Reed Richards
The Fifth Horseman is offline                         Send a private message to The Fifth Horseman
Reply With Quote
Old 10-11-2010, 06:38 PM   #7
Expack2
Game Request Hunter


 
Join Date: Sep 2010
Location: ,
Posts: 884
Default

Quote:
Originally Posted by The Fifth Horseman View Post
As you are aware, we're using standard ZIP archives (max compression setting) for games hosted on Abandonia.
The only way to cut down the game's size beyond what that compression provides is by removing ("ripping") some of the game assets (typically videos, music and sound FX, in that order).
Unfortunately, Horseman, the RDX files that 3-D Ultra Minigolf uses contain all the required information for the minigolf holes and the main menu, so getting rid of any of those, being that they'd be the largest files in the archive, would prevent the game from being fully playable. So, I guess that means that 3-D Ultra Minigolf will have to come to Abandonia as part of the ISO Cellar...

EDIT: Dang, where are my manners? Thanks for trying to help me out anyways, Horseman! Oh, and thanks for the explanation about custom compression methods, Scatty!
__________________
You like manuals. You like manuals. You love them. You cannot resist manuals.
Your gameplay experience is meaningless without manuals.



Proud Beta Tester for Desura Since October 28, 2010

Last edited by Expack2; 10-11-2010 at 06:41 PM. Reason: Added Thanks for Help from The Fifth Horseman and Scatty
Expack2 is offline                         Send a private message to Expack2
Reply With Quote
Old 10-11-2010, 07:43 PM   #8
The Fifth Horseman
FUTURE SCIENCE BASTARD
 
The Fifth Horseman's Avatar


 
Join Date: Oct 2004
Location: Opole, Poland
Posts: 14,276
Default

What size is the smallest RDX you've got there? I'd like to take a look at the file structure.
__________________

"God. Can't you people see I'm trying to commit a crime against science and nature here?"
-- Reed Richards
The Fifth Horseman is offline                         Send a private message to The Fifth Horseman
Reply With Quote
Old 10-11-2010, 09:32 PM   #9
Expack2
Game Request Hunter


 
Join Date: Sep 2010
Location: ,
Posts: 884
Default

Quote:
Originally Posted by The Fifth Horseman View Post
What size is the smallest RDX you've got there? I'd like to take a look at the file structure.
The smallest one is the RDX file for the main menu; I've take the liberty of attaching it to this post. If you need a larger RDX file, the next largest is the one for the Rocket minigolf hole, which weighs in at 4.63MB.

Note that while the RDX files are small on their own, there's twenty of them in the DATA folder created by the "Large Install" option for 3-D Ultra Minigolf. All twenty files bring the total size of the DATA folder up to 229MB!
__________________
You like manuals. You like manuals. You love them. You cannot resist manuals.
Your gameplay experience is meaningless without manuals.



Proud Beta Tester for Desura Since October 28, 2010

Last edited by Expack2; 07-04-2012 at 01:08 AM.
Expack2 is offline                         Send a private message to Expack2
Reply With Quote
Old 10-11-2010, 09:59 PM   #10
The Fifth Horseman
FUTURE SCIENCE BASTARD
 
The Fifth Horseman's Avatar


 
Join Date: Oct 2004
Location: Opole, Poland
Posts: 14,276
Default

Oh man. That's not RDX... that's RBX. Aka "almost exactly the same format I've hacked before". One or two more of those files would be good, so that I can work out the differences between this application and the one in Cyberstorm 2 (another Sierra game released around the same time period).

Then it's time for an extractor, figuring out how to dummy out the WAX files and writing a program to pack the stuff back into an RBX. If they are anywhere near close to the WAX format I've dealt with before, they consist of a standarised header followed by a stream of audio data - either uncompressed or encoded using the IMA ADPCM algorithm.
That's probably the part responsible for the huge archive size, BTW.

EDIT: Nevermind, got the minimal format differences cracked now. The problem was in my own assinine old code. The WAX audio appears to be very close (though not identical) to CS2's.
I'll catch some sleep and then look into dummying out the files. FYI, the WAX files take up 3/4rd of that RBX's size.
__________________

"God. Can't you people see I'm trying to commit a crime against science and nature here?"
-- Reed Richards

Last edited by The Fifth Horseman; 10-11-2010 at 10:48 PM.
The Fifth Horseman is offline                         Send a private message to The Fifth Horseman
Reply With Quote
Reply


Similar Threads
Thread Thread Starter Forum Replies Last Post
Eugene being dense again eugene425 Trash Can 0 25-07-2010 04:08 PM
Requesting Help From The Forum Titan Blah, blah, blah... 18 19-07-2007 06:07 AM
Before Requesting A Game :) Fawfulhasfury Trash Can 1 13-07-2007 06:14 PM
Compressing Video Sameeralord Tech Corner 10 07-07-2005 02:31 PM
Requesting some attention grrr Omuletzu Trash Can 20 10-07-2004 10:33 PM


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump
 


The current time is 03:02 AM (GMT)

 
Powered by vBulletin® Version 3.7.1
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.